Adria Navarro
50c8449f4b
Add extra test
2024-07-12 12:17:37 +02:00
Sam Rose
e70e7eeb1d
Merge branch 'master' into fix-flake
2024-07-11 15:08:59 +01:00
Sam Rose
d530909c3b
Fix a flake in the redis.spec.ts file.
2024-07-11 13:58:28 +01:00
mike12345567
8d308b591a
Enabled SQS in self-host/development (single tenancy) as long as the SQS_ENABLED flag has been set, tenants don't need to be specified as there are no tenants.
2024-07-11 13:33:56 +01:00
mike12345567
73881e9895
Only default the CouchDB SQL URL if we are in dev, otherwise attempt to work out what it is based on the main CouchDB URL (as this should work in all default production environments).
2024-07-11 11:11:28 +01:00
Sam Rose
56c6742a0e
Create a way to enable SQS for all tenants.
2024-07-10 15:22:18 +01:00
Sam Rose
551d413900
Merge branch 'master' into sqs-per-tenant
2024-07-10 11:39:31 +01:00
Sam Rose
5356cfdce5
Fix uses of SearchFilterOperator.
2024-07-10 11:08:11 +01:00
Sam Rose
2fa14ab35f
Merge branch 'master' into sqs-per-tenant
2024-07-09 17:30:33 +01:00
Adria Navarro
38f7b88735
Type filters
2024-07-09 14:01:44 +02:00
Adria Navarro
9c6347f7fd
Move constants to types
2024-07-09 12:24:59 +02:00
Adria Navarro
5cba1058d4
Merge branch 'master' into budi-7065-csv-export-fails-for-table-with-composite-primary-key
2024-07-09 10:54:18 +02:00
Adria Navarro
5387717183
Fix
2024-07-09 10:43:53 +02:00
Adria Navarro
5be8882122
Handle composite keys on exports
2024-07-09 10:43:45 +02:00
Sam Rose
014ff81841
Remove accidental imports of the aws-sdk SQS (fml)
2024-07-08 14:25:05 +01:00
Sam Rose
69d54b523d
Finish implementation, fix tests.
2024-07-08 14:21:07 +01:00
Sam Rose
1851e11bc0
wip
2024-07-08 13:28:48 +01:00
Adria Navarro
85827bbf93
Refactor breakRowIdField
2024-07-08 13:27:30 +02:00
mike12345567
e4375c2196
Fixing a build issue uncovered by tests.
2024-07-05 15:27:54 +01:00
mike12345567
62ca71f00e
Merge branch 'master' of github.com:Budibase/budibase into fix/invalid-time-value
2024-07-05 15:02:36 +01:00
mike12345567
77abe6da83
Handling invalid time values when ISO strings are input as filter options.
2024-07-04 18:29:08 +01:00
Sam Rose
a1d07e0ef0
Merge branch 'master' of github.com:budibase/budibase into budi-8417-check-error-responses-in-middleware-for-environment
2024-07-04 13:46:48 +01:00
Adria Navarro
ddcf5598b4
Merge branch 'master' into chore/fix-npm-vulnerabilities
2024-07-04 12:30:40 +02:00
Sam Rose
257ee8fb70
Fix tests actually.
2024-07-04 10:46:09 +01:00
Adria Navarro
7b51799e8d
depcheck clean
2024-07-04 11:22:54 +02:00
Adria Navarro
8da83dac58
Merge branch 'master' into chore/fix-npm-vulnerabilities
2024-07-04 11:08:51 +02:00
Sam Rose
16e293a9ff
Fix tests.
2024-07-04 09:55:36 +01:00
Michael Drury
4933658b98
Merge branch 'master' into fix/couchdb-integration
2024-07-03 17:36:16 +01:00
Sam Rose
4f01cb50cd
Merge branch 'master' of github.com:budibase/budibase into budi-8417-check-error-responses-in-middleware-for-environment
2024-07-03 17:16:44 +01:00
Sam Rose
75360bdb9b
Merge branch 'master' into merge-env-vars
2024-07-03 17:06:14 +01:00
Sam Rose
bab3c07727
Add a couple more secrets.
2024-07-03 16:33:32 +01:00
Sam Rose
d9b94c1dcf
Don't detect empty strings.
2024-07-03 16:31:42 +01:00
Sam Rose
253110ac6f
Detect secrets in error messages.
2024-07-03 16:31:42 +01:00
Sam Rose
cd98882127
Move secrets into backend-core.
2024-07-03 16:30:23 +01:00
Adria Navarro
e74847585e
Merge branch 'master' into BUDI-8416/allow-updating-email-via-scim
2024-07-03 15:59:47 +02:00
Adria Navarro
8fd2cce093
Remove platform user on remove
2024-07-03 15:52:48 +02:00
mike12345567
cb41e4d5a1
Fix for CouchDB integration, the typing in it was very poor and wise hiding issues, I've updated how this is implemented so that static typing can catch issues with it.
2024-07-03 12:50:33 +01:00
mike12345567
cb50cca40b
Stripping credentials from Couch URLs + test cases.
2024-07-03 11:25:21 +01:00
Adria Navarro
19e4e8fdb4
Allow updating email
2024-07-03 12:18:06 +02:00
Adria Navarro
3ed9c9a4a5
Test
2024-07-03 12:15:56 +02:00
Adria Navarro
88e054c366
Basic update test
2024-07-03 12:06:37 +02:00
Adria Navarro
4ddd450a89
More tests
2024-07-03 11:59:12 +02:00
Adria Navarro
8372632579
Add extra tests
2024-07-03 11:14:30 +02:00
Adria Navarro
6510a47c06
Add basic userDB.save test
2024-07-03 11:10:51 +02:00
Adria Navarro
ae4cfd7b47
Fix pouchdb-replication-stream vulnerability
2024-07-02 15:23:47 +02:00
Michael Drury
c1f7561839
Merge branch 'master' into fix/sqs-internal-columns
2024-06-27 18:19:03 +01:00
mike12345567
3394e974d3
Getting casting working again, have to pass down prefix for checking against fields.
2024-06-27 18:18:41 +01:00
Michael Drury
cfeab17ed8
Revert "Revert "Disallow prohibited columns""
2024-06-26 12:40:16 +01:00
Michael Drury
9c92b8eff9
Merge branch 'master' into sustaining/typescript-5.5.2
2024-06-26 11:03:01 +01:00
Sam Rose
314d62bea0
Revert "Disallow prohibited columns"
2024-06-25 14:29:56 +01:00
melohagan
4ac9b657e5
Remove deprecated properties ( #13958 )
...
* Remove deprecated properties
* Fix backend-core test
* Don't run account-portal tests
* Update account-portal ref
* Run account portal unit tests
* Revert "Run account portal unit tests"
This reverts commit b509bf31a4
.
* Revert "Update account-portal ref"
This reverts commit 186391fbb6
.
2024-06-25 08:26:52 +01:00
mike12345567
a7b995e2ad
Merge branch 'master' of github.com:Budibase/budibase into sustaining/typescript-5.5.2
2024-06-24 18:05:32 +01:00
Sam Rose
bb91849976
Merge branch 'master' into budi-8390-receiving-a-column-has-been-specified-more-than-once-in-the
2024-06-24 17:32:26 +01:00
Sam Rose
58d8f2bb64
Respond to PR feedback.
2024-06-24 17:30:10 +01:00
Sam Rose
da1eb6f6ac
Fix primary key appearing twice in the SQL ORDER BY clause.
2024-06-24 17:09:27 +01:00
mike12345567
ebf8f54bb7
Upgrading to Typescript 5.5.2
2024-06-24 16:41:28 +01:00
Sam Rose
01b2f69b74
Merge branch 'master' of github.com:budibase/budibase into budi-8220-support-updating-existing-rows-for-external-databases-using-2
2024-06-24 15:51:03 +01:00
Michael Drury
0d946e7be3
Merge branch 'master' into fix/relationship-filtering-table-or-column
2024-06-24 14:35:30 +01:00
Peter Clement
aefe46b253
Adds _id and _rev back to internal datasource filter options ( #13977 )
...
* Adds _id and _rev back to internal datasource filter options
* add bb default datasource const into shared-core
* re-export var from shared-core
2024-06-24 14:31:27 +01:00
mike12345567
1402716f5c
Some type updates.
2024-06-24 13:10:30 +01:00
Sam Rose
f4378bd561
Merge branch 'master' of github.com:budibase/budibase into budi-8220-support-updating-existing-rows-for-external-databases-using-2
2024-06-21 13:08:39 +01:00
mike12345567
def3b0260e
Disallowing prohibited columns consistently, no matter the case, and backend validation for this as well.
2024-06-20 18:48:22 +01:00
mike12345567
67c00c9e4c
Addressing PR comments.
2024-06-19 18:46:48 +01:00
Sam Rose
602faf1c67
Add test for composite primary keys for external datasource imports.
2024-06-19 17:52:48 +01:00
mike12345567
2aa911b217
re-jigging things to get counting working properly again.
2024-06-19 17:10:15 +01:00
mike12345567
2d74927177
updating how counting disables sorting.
2024-06-19 15:08:12 +01:00
mike12345567
1056efdbf6
Changing how counting occurs in SQL layer.
2024-06-19 14:56:06 +01:00
Michael Drury
223df424fc
Merge branch 'master' into feature/count-rows-to-return
2024-06-19 14:20:31 +01:00
mike12345567
bdbb4c0a66
Commenting on a bug in knex
2024-06-19 13:59:03 +01:00
mike12345567
0de94d3535
Addressing some PR comments.
2024-06-19 11:52:50 +01:00
mike12345567
e0d8a66fd8
Adding test cases for counting as well as some small fixes.
2024-06-18 18:44:17 +01:00
Sam Rose
e288fc8795
Disable upserting for MSSQL in bulkImport for now.
2024-06-18 18:02:20 +01:00
Sam Rose
5ac8a7d514
bulkImport upsert working everywhere excpet mssql
2024-06-18 17:43:25 +01:00
mike12345567
5c45370722
Fixing an issue with the sort order not being deterministic consistently.
2024-06-18 13:39:10 +01:00
mike12345567
278242fb55
Moving limits and offsets back into pre-query.
2024-06-18 12:47:59 +01:00
mike12345567
03b82c0923
Merge branch 'master' of github.com:Budibase/budibase into feature/count-rows-to-return
2024-06-17 13:41:40 +01:00
Sam Rose
6516a01657
Merge branch 'master' into uncomment-search-test-todos
2024-06-17 13:34:53 +01:00
melohagan
9ecf82e0f6
Add endpoint to GET tenant info from tenant global DB. ( #13923 )
...
* Add GET tenant info endpoint
* Add GET global tenant to endpoint list.
* Use correct not found code
* Fix unit test
* Code review comments
* Ignore account portal check types
* remove account-portal-ui from type check ignore
* Remove ignore account-portal-ui from type check
2024-06-17 09:22:44 +00:00
mike12345567
1b36d8af51
Getting counting flow working correctly for external datasources.
2024-06-14 19:00:59 +01:00
mike12345567
e402f9c571
Merge branch 'uncomment-search-test-todos' of github.com:Budibase/budibase into feature/count-rows-to-return
2024-06-14 18:16:47 +01:00
mike12345567
77556820bf
Bit more work towards row counting, as well as moving external SQL to use row + 1 for working out pagination.
2024-06-14 18:12:36 +01:00
Sam Rose
a54048e308
Solve all remaining TODOs in search.spec.ts.
2024-06-14 14:57:31 +01:00
mike12345567
2c6262844b
Some work to limiting, changing how limiting works for pagination so that filtering on relationships doesn't cause problems.
2024-06-14 14:35:35 +01:00
Sam Rose
c27e9c266c
Replace SortDirection with SortOrder, SortDirection is being removed.
2024-06-14 09:45:30 +01:00
Sam Rose
a140a002e2
Merge branch 'master' of github.com:budibase/budibase into fix/aws-session-token-s3-ver2
2024-06-11 18:04:40 +01:00
Michael Drury
869c7e546a
Merge branch 'master' into disable-app-migration-cache
2024-06-11 13:17:16 +01:00
melohagan
115737c46c
Create Tenant endpoint + tenant_info doc ( #13902 )
...
* Create Tenant endpoint + tenant_info doc
* Don't catch on tenant_info put
* PR comments
* unit test
2024-06-11 12:16:15 +01:00
mike12345567
334334bbcd
Adding a check for QA.
2024-06-11 12:13:18 +01:00
mike12345567
75c3b842ad
Fixing issue with in memory queue.
2024-06-10 23:34:08 +01:00
mike12345567
1bd5a41712
Setting debug properly
2024-06-10 15:29:32 +01:00
mike12345567
fe789e7462
Adding test containers debug.
2024-06-10 15:17:01 +01:00
Hector Valcarcel
65c2039d0c
Chore: Allow using an AWS_SESSION_TOKEN for object storage with AWS S3
2024-06-10 11:48:54 +01:00
mike12345567
ee391b30d6
Fixing an issue with multi-tenant app migration failures - the app migration context wasn't getting the tenant ID as needed. Also added some better logging as well as cleaning up the queues properly to remove these dud events.
2024-06-07 22:50:06 +01:00
Michael Drury
b76d535202
Merge branch 'master' into BUDI-7656/add-migration
2024-06-07 10:24:50 +01:00
mike12345567
ab6614a683
Capturing any 500s which occur from SQS cleanup - it appears to 500 if there is nothing to do.
2024-06-06 17:38:52 +01:00
Michael Drury
ea1d3000c2
Merge branch 'master' into BUDI-7656/add-migration
2024-06-06 16:49:48 +01:00
mike12345567
70aa43680d
Addressing PR comments.
2024-06-06 16:49:03 +01:00
mike12345567
2c86ea14fd
Changing how disk cleanup is performed.
2024-06-06 15:07:06 +01:00
Sam Rose
ac53a97176
WIP
2024-06-06 14:55:07 +01:00
mike12345567
4f6076d2ba
Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration
2024-06-05 16:29:45 +01:00
mike12345567
cf6f86cb2f
Updating migrations to correctly cover all the required elements.
2024-06-04 17:24:11 +01:00
mike12345567
e3b1655ad0
Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration
2024-06-04 12:56:59 +01:00
Adria Navarro
a562655361
Merge branch 'master' into feat/readonly-columns
2024-06-04 12:04:49 +02:00
Adria Navarro
2d953f19cc
Clean validation message
2024-06-04 11:11:50 +02:00
mike12345567
155de99b68
Streaming to disk before passing onto S3.
2024-06-03 11:46:20 +01:00
mike12345567
75501c2251
Updating object store stream upload to make sure the stream has finished being processed before trying to upload to AWS (and only uploading a partial stream).
2024-05-31 17:57:31 +01:00
mike12345567
f3d1a8aabc
Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration
2024-05-29 17:20:29 +01:00
Michael Drury
aa232db669
Merge branch 'master' into fix/template-app-rows
2024-05-29 15:06:09 +01:00
Adria Navarro
f5f471a4aa
Merge branch 'master' into BUDI-8284/readonly-settings-columns-in-views
2024-05-29 15:41:20 +02:00
mike12345567
6b7a4f07cb
Quick fix for ambiguous column names _id.
2024-05-29 11:56:52 +01:00
mike12345567
83fa6f952a
re-jigging, making this part of filters rather than meta.
2024-05-28 18:34:08 +01:00
mike12345567
cb99007a42
Fix for issue with templated apps - some template apps are *very* old and therefore don't necessarily abide by the rules that are generally followed for new apps, this is something we should resolve, but for now adding an option that allows searching for only a specific document type.
2024-05-28 18:30:06 +01:00
Adria Navarro
422b1e2753
Fix tests
2024-05-27 14:31:45 +02:00
mike12345567
3b310b188e
Fixing issue with column quoting.
2024-05-24 17:52:40 +01:00
mike12345567
b18ca2670a
Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs
2024-05-24 12:22:20 +01:00
Michael Drury
a3d2871330
Merge branch 'master' into feature/audit-log-sqs
2024-05-23 16:52:50 +01:00
mike12345567
66686fd970
Making sure all JSON column types are correctly handled.
2024-05-23 15:00:13 +01:00
mike12345567
0c28d05d40
Some work to correctly handle JSON columns from SQS as well.
2024-05-23 14:57:38 +01:00
mike12345567
99536c2d0b
PR comments.
2024-05-23 14:24:49 +01:00
Adria Navarro
e169454490
Move utils to backend-core
2024-05-23 14:59:51 +02:00
mike12345567
ff8684d9b4
Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs
2024-05-22 15:23:24 +01:00
mike12345567
a2200a38fb
Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs
2024-05-20 14:09:57 +01:00
mike12345567
d1b6a542fa
Getting audit log searching with sqs working - a bit more work than expected but fixed quite a few SQS bugs along the way.
2024-05-17 20:26:34 +01:00
mike12345567
d7f3109a22
Making sqlite design doc generation more accessible.
2024-05-17 12:35:31 +01:00
Adria Navarro
19cb7b83e0
Merge branch 'master' into BUDI-8248/reduce-googleapi-calls
2024-05-17 12:28:28 +02:00
Adria Navarro
7807b734bb
Persist googlesheet refs in context
2024-05-17 12:07:28 +02:00
mike12345567
0efa1f06ab
Moving some stuff around to make way for other services using the sql layers.
2024-05-16 17:33:47 +01:00
mike12345567
647a8c2a74
Final fix for remove function.
2024-05-16 13:52:38 +01:00
mike12345567
06d6d84b55
Addressing PR comments.
2024-05-16 13:27:54 +01:00
mike12345567
aa51db20ee
Changing how cleanup works - the cleanup is now part of the DB deletion, making sure it cannot be missed.
2024-05-14 15:41:48 +01:00
mike12345567
673211dfbb
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-14 14:38:00 +01:00
mike12345567
39147b80b6
PR comments.
2024-05-14 11:23:50 +01:00
mike12345567
5b5e7e47a2
Fixing some issues with updating rows with attachments, there were some UI bugs that had been raised (undefined being displayed) and the uploading from a URL was not working as expected, due to the stream not matching the expected format of the S3 SDK - this has been fixed by converting the stream to a true readable stream with .
2024-05-13 18:11:40 +01:00
mike12345567
a8e0443cf7
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-13 14:01:14 +01:00
mike12345567
f25703b88e
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-13 13:54:00 +01:00
Adria Navarro
2c68c3ffb1
Merge branch 'master' into chore/remove-unused-packages
2024-05-13 14:38:46 +02:00
Adria Navarro
4bec2a3a48
Merge branch 'master' into feat/budi-8123-single-user
2024-05-13 10:53:49 +02:00
mike12345567
10608f9bb7
Final final fix.
2024-05-10 11:59:11 +01:00
mike12345567
de2d0e6b89
Adding error field.
2024-05-10 11:51:57 +01:00
mike12345567
1aa89c61b6
One small change to keep 404 functionality on destroy DB.
2024-05-10 11:32:57 +01:00
mike12345567
76449782b5
Fixes an issue with fetch information being passed up from DatabaseImpl, making sure errors are fully sanitised.
2024-05-10 11:27:49 +01:00
mike12345567
a3d079f847
Fixing an issue with cleanup, making sure the correct app is cleaned up on deletion.
2024-05-09 18:33:29 +01:00
mike12345567
fd7f6455bd
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-09 17:38:24 +01:00
Adria Navarro
d83e5e21f2
Merge branch 'master' into feat/budi-8123-single-user
2024-05-09 18:05:16 +02:00
deanhannigan
c1874f3376
Merge branch 'master' into feature/filter-bindings
2024-05-09 14:34:07 +01:00
Peter Clement
db273bcd36
Support attachment columns in Automations ( #13567 )
...
* base work to support attachments in create / update row
* handle single attachment column
* fix tests
* pro
* fix some types
* handle case where file exists in storage
* improve attacment processing
* refactor slightly and ensure correct url is used for existing attachments
* add test
* Fixing a build issue.
* update tests
* some lint
* remove cursed backend-core test util
* addressing pr comments
* refactoring nasty automationUtils upload code
* remove uneeded check
* use basneeame for fallback filename
* add a test to ensure coverage of single attachment column type
* fail early when fetching object metadata
---------
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2024-05-09 14:30:56 +01:00
Dean
4c6629d15f
Merge remote-tracking branch 'origin/master' into feature/filter-bindings
2024-05-09 11:05:58 +01:00
mike12345567
21ce586d93
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 17:04:34 +01:00
Sam Rose
5783ee790f
Fix Lucene tests.
2024-05-08 15:36:26 +01:00
Sam Rose
264ce5e272
Merge branch 'master' into search-tests-boolean
2024-05-08 14:20:36 +01:00
Peter Clement
1d300c2577
Remove aws sdk global mock and update tests ( #13637 )
...
* Remove aws sdk global mock and update tests
* add awaits
* Minio healthcheck in tests.
* Bind to 127.0.0.1 instead of 0.0.0.0
* Fix port fetching for minio container.
* Actually fix port mapping this time.
* Pull minio container before running tests.
* Enable testcontainers debug logging.
* Promote minio container to always running in tests, like CouchDB.
* Remove testcontainers debug logging.
---------
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-05-08 14:08:34 +01:00
mike12345567
2e8b655417
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 12:36:42 +01:00
deanhannigan
42a5d3d0e0
Merge branch 'master' into feature/filter-bindings
2024-05-08 10:22:45 +01:00
mike12345567
a2d4f8523c
Some typing improvements, as well as getting deletion/setup working a bit better.
2024-05-07 18:27:47 +01:00
Sam Rose
946bd0ef7d
Fix lucene.spec.ts.
2024-05-07 17:11:05 +01:00
Sam Rose
3bc1e6b387
Fix behaviour of 'when filter empty' for empty and notEmpty filter types.
2024-05-07 16:46:54 +01:00
Sam Rose
32bd505ef9
Respond to PR feedback.
2024-05-07 10:38:47 +01:00
mike12345567
070659c7b1
Fixing an issue with typing + wrong parameter being passed to the direct Couch call functionality.
2024-05-03 18:00:43 +01:00
Sam Rose
27e68f79f5
Remove extraneous comment.
2024-05-03 17:34:03 +01:00
Sam Rose
1777f1f8fe
Fix boolean searching for Lucene/SQS
2024-05-03 17:29:20 +01:00
Dean
3823ffa4fd
Ensure snippet context is disabled by default in test. Add override for search
2024-05-02 17:59:55 +01:00
Dean
5e7d1169f7
Minor refactor to accomodate testing with snippets. More test cases for multiple binding types
2024-05-02 16:26:09 +01:00
Adria Navarro
70c6d56c1e
Merge branch 'feat/budi-8123-single-user' into budi-8123/single-user-column-type
2024-05-02 12:06:42 +01:00
Adria Navarro
6570b2efcc
Remove unused packages from backend-core
2024-05-01 11:38:59 +01:00
mike12345567
7f1500ac86
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-26 15:48:40 +01:00
Sam Rose
dd02224806
Restart testcontainers every day, and add a script to kill them.
2024-04-26 14:01:52 +01:00
Adria Navarro
1c4fc21870
Lint
2024-04-25 16:36:47 +02:00
Adria Navarro
e0216bb00c
Lint
2024-04-25 13:20:59 +02:00
Adria Navarro
d63c5830e5
Typings
2024-04-25 13:20:59 +02:00
Michael Drury
2187d25711
Revert "Changing client library to be retrieved via pre-signed URL for Cloud"
2024-04-24 17:12:36 +01:00
mike12345567
f76abb0ca9
Getting rid of linting error.
2024-04-24 15:59:11 +01:00
mike12345567
849253faba
Bringing back the old mechanism of returning the client library through a pre-signed URL, rather than always serving through the service.
2024-04-24 15:37:47 +01:00
mike12345567
6ff00135bf
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-22 17:22:53 +01:00
Peter Clement
a4c0328c53
REST file handling and SMTP automation block attachments ( #13403 )
...
* handle files in rest connector
* fetch presigned url and return
* further updates to handle files in rest connector
* remove unused important and fix extension bug
* wrong expiry param
* tests
* add const for temp bucket
* handle ttl on bucket
* more bucket ttl work
* split out fileresponse and xmlresponse into utils
* lint
* remove log
* fix tests
* some pr comments
* update function naming and lint
* adding back needed response for frontend
* use fsp
* handle different content-disposition and potential path traversal
* add test container for s3 / minio
* add test case for filename* and ascii filenames
* move tests into separate describe
* remove log
* up timeout
* switch to minio image instead of localstack
* use minio image instead of s3 for testing
* stream file upload instead
* use streamUpload and update signatures
* update bucketcreate return
* throw real error
* tidy up
* pro
* pro ref fix?
* pro fix
* pro fix?
* move minio test provider to backend-core
* update email builder to allow attachments
* testing for sending files via smtp
* use backend-core minio test container in server
* handle different types of url
* fix minio test provider
* test with container host
* lint
* try different hostname?
* Revert "try different hostname?"
This reverts commit cfefdb8ded
.
* fix issue with fetching of signed url with test minio
* update autoamtion attachments to take filename and url
* fix tests
* pro ref
* fix parsing of url object
* pr comments and linting
* pro ref
* fix pro again
* fix pro
* account-portal
* fix null issue
* fix ref
* ref
* When sending a file attachment in email fetch it directly from our object store
* add more checks to ensure we're working with a signed url
* update test to account for direct object store read
* formatting
* fix time issues within test
* update bucket and path extraction to regex
* use const in regex
* pro
* Updating TTL handling in upload functions (#13539 )
* Updating TTL handling in upload functions
* describe ttl type
* account for ttl creation in existing buckets and update types
* fix tests
* pro
* pro
2024-04-22 15:30:57 +00:00
mike12345567
8189952f0b
Adding implementation to DB for purge and cleanup APIs of SQS, to make sure the DB is cleared of any unused tables or rows.
2024-04-19 18:03:38 +01:00
mike12345567
8bb6956925
Merge branch 'master' of github.com:Budibase/budibase into fix-oidc-error-logging
2024-04-19 13:29:21 +01:00
melohagan
6bdc726d55
Allow a displayName to be passed when creating admin user ( #13516 )
...
* Allow a displayName to be passed when creating admin user
* Set the first and last names
* Don't format handlebars files on save
* Use familyName and givenName
2024-04-18 12:52:00 +00:00
Adria Navarro
f12e654811
Merge branch 'master' into chore/remove-disabling-nounusedvars
2024-04-17 15:49:35 +02:00
mike12345567
25dba0be35
This removes the SearchQuery which was a duplication of the SearchFilters interface - the duplicated types were not correctly getting overlay on each other, causing build errors.
2024-04-17 13:54:23 +01:00
Adria Navarro
a88924a418
Remove // eslint-disable-next-line no-unused-vars
2024-04-17 12:24:41 +02:00
Adria Navarro
ec93ea59c1
Remove // eslint-disable-next-line @typescript-eslint/no-unused-vars
2024-04-17 12:17:03 +02:00
Adria Navarro
ca158c33e8
DRY
2024-04-17 10:33:20 +02:00
mike12345567
6e4a66b2e1
Initial implementation of generating SQS junction table definitions.
2024-04-11 18:19:47 +01:00
Michael Drury
c190a9983f
Merge branch 'master' into fix-oidc-error-logging
2024-04-11 17:01:04 +01:00
Martin McKeaveney
4a6e1b7192
fix all cases of lint rule
2024-04-10 17:39:12 +01:00
mike12345567
20da8bb816
Adding support for SQS prepared statement API.
2024-04-10 17:36:57 +01:00
Sam Rose
c5580b4767
Get SQS plumbing working in tests.
2024-04-09 15:31:32 +01:00
mike12345567
efe66186f4
Last PR comment - fixing issue with lucene test case.
2024-04-09 12:37:03 +01:00
mike12345567
5f44b98b7f
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-05 16:36:36 +01:00
mike12345567
86150c58ce
Fixing issue with BB_ADMIN environment variables for user creation introduced by user password becoming optional. Adding a test case as well to cover this to avoid it breaking in future.
2024-04-05 12:14:51 +01:00
mike12345567
d11c316572
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-04 15:02:25 +01:00
Sam Rose
79184e70af
Remove CONTAINER_NAMESPACE, it wasn't the solution.
2024-04-03 12:32:29 +01:00
Sam Rose
258226ddef
Better error message when multiple images are found.
2024-04-03 11:40:14 +01:00
Sam Rose
8cffdeda56
Re-use containers and create namespaces for each test.
2024-04-03 11:33:39 +01:00
Sam Rose
3dff4bf334
Fix lint.
2024-04-03 11:20:43 +01:00
Sam Rose
e3fbce25fa
Merge branch 'master' of github.com:budibase/budibase into reuse-containers
2024-04-03 11:15:11 +01:00
mike12345567
9b8b422f1b
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-03 10:16:23 +01:00
mike12345567
8c326b501b
Adding support for oneOf ID search of users, today the relationship picker attempts to use this for the users table, but it was not supported.
2024-04-02 17:12:31 +01:00
mike12345567
5e186b5c8a
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-02 12:05:34 +01:00
mike12345567
4c755b3af3
Improving typing around search, there was duplicates of SearchParams and SearchResponse - which were a little different, bring all of this together under the types library.
2024-03-28 17:57:37 +00:00
Sam Rose
90cfdd661d
Rework how we connect to containers.
2024-03-28 17:36:26 +00:00
Martin McKeaveney
32a5ce24ec
remove automatic ssoId generation
2024-03-28 15:46:43 +00:00
José Vte. Calderón
b5e0bd1aad
Merge branch 'master' into feature/update-global-user
2024-03-28 12:05:29 +01:00
jvcalderon
b77106480e
Adds POST /api/global/users/sso endpoint
2024-03-28 11:46:58 +01:00
Sam Rose
204b16876a
Run yarn lint:fix
2024-03-27 16:46:11 +00:00
Sam Rose
831c174362
Give SQL integrations their own database when fetching a new datasource.
2024-03-27 15:25:37 +00:00
mike12345567
de518de8fa
Merging issue with static index.
2024-03-26 12:53:45 +00:00
Sam Rose
6ee8f421a5
Merge branch 'master' of github.com:budibase/budibase into remove-jest-testcontainers
2024-03-26 10:05:21 +00:00
Sam Rose
415b27a008
Don't need a globalTeardown, testcontainers handles the removal of containers.
2024-03-26 10:00:34 +00:00
Sam Rose
5d7cd511b5
Correct path to global functions in jest.config.ts.
2024-03-26 09:51:10 +00:00
Sam Rose
f3e9e3d35e
Share a single globalSetup/globalTeardown.
2024-03-26 09:49:33 +00:00
Sam Rose
afacee978d
Add missing environment vars for backend-core tests.
2024-03-25 17:40:46 +00:00
Sam Rose
0dba0cebc7
Remove CouchDB container name.
2024-03-25 17:26:15 +00:00
Sam Rose
44d4e496b6
Fix code to pull CouchDB URL out of docker ps.
2024-03-25 17:11:41 +00:00
Sam Rose
db21542d38
Cherry-pick 6b8422df01
2024-03-25 15:25:30 +00:00
Sam Rose
66cfb8eedd
Remove jest-testcontainers.
2024-03-25 15:24:14 +00:00
jvcalderon
1da10c9a5f
Merge branch 'master' into feature/onboarding
2024-03-25 12:51:57 +01:00
jvcalderon
50c0fb1f97
Override identity for events sent from dispatcher
2024-03-22 10:41:27 +01:00
mike12345567
9995f71871
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-20 13:45:27 +00:00
mike12345567
8df38b8bb2
Merging in most recent changes, recent SQL aliasing changes caused some big differences.
2024-03-20 12:42:07 +00:00
Sam Rose
217b39c232
Reenable no-unused-vars
2024-03-20 11:46:39 +00:00
Sam Rose
009c795f54
Reenable no-undefs.
2024-03-19 17:47:39 +00:00
Sam Rose
f1278312ab
Reenable no-case-declarations.
2024-03-19 15:58:25 +00:00
Sam Rose
f6669c25cf
Merge branch 'master' of github.com:budibase/budibase into reenable-no-case-declarations
2024-03-19 15:53:19 +00:00
Sam Rose
79bba82908
Fix flaky scim test.
2024-03-19 15:45:24 +00:00
Adria Navarro
b7b8a65a54
Don't init DocWritethrough queue on load
2024-03-19 16:01:00 +01:00
Mel O'Hagan
ff231b0095
Make password optional
2024-03-19 13:30:42 +00:00
Adria Navarro
c7276b9005
Merge branch 'master' into BUDI-7656/add-migration
2024-03-19 12:35:39 +01:00
Sam Rose
80008a0739
Reenable no-inner-declarations.
2024-03-19 11:29:19 +00:00
Sam Rose
5749333fc7
Reenable no-useless-escape.
2024-03-19 11:14:16 +00:00
Sam Rose
1785f3af7e
Get lint passing.
2024-03-19 10:55:51 +00:00
Sam Rose
7a63dc9830
Making progress on getting the eslint-jest plugin working.
2024-03-19 10:46:59 +00:00
Sam Rose
1f63f0bddf
Run auto fix.
2024-03-19 09:46:10 +00:00
deanhannigan
7a737e7664
Merge branch 'master' into feature/app-list-actions
2024-03-15 09:31:54 +00:00
deanhannigan
72a671e93b
Merge branch 'master' into feature/app-list-actions
2024-03-15 09:10:57 +00:00
Andrew Kingston
b6eab42c18
Merge branch 'cheeks-lab-day-binding-eval' of github.com:Budibase/budibase into cheeks-snippets-poc
2024-03-14 16:24:16 +00:00
Adria Navarro
62cec7289d
Use guid instead of words
2024-03-14 11:03:43 +01:00
deanhannigan
1db358d5c2
Merge branch 'master' into feature/app-list-actions
2024-03-14 09:33:33 +00:00
Andrew Kingston
8b4ce703e9
Try to fix tests
2024-03-13 17:01:09 +00:00
Andrew Kingston
e45beff059
Merge branch 'master' of github.com:Budibase/budibase into cheeks-snippets-poc
2024-03-13 10:21:07 +00:00
Adria Navarro
cc275983dc
Merge branch 'master' into cleanup-isolates
2024-03-13 10:30:37 +01:00
Andrew Kingston
70821182fe
Update automation context to simplify applying snippet context
2024-03-13 09:15:33 +00:00
Andrew Kingston
3b54daf2c8
Add snippet context before executing automations
2024-03-12 21:40:48 +00:00
Andrew Kingston
16ce5ac65e
Update how snippets are fetched and enriched into context, because HBS helpers can't be async
2024-03-12 17:02:01 +00:00
deanhannigan
66f0deecae
Merge branch 'master' into feature/app-list-actions
2024-03-08 14:44:08 +00:00
Michael Drury
874a6fbd12
Linting.
2024-03-08 12:26:11 +00:00
deanhannigan
460c2573e4
Merge branch 'master' into feature/app-list-actions
2024-03-08 12:24:15 +00:00
Michael Drury
9027e6e82a
Initing doc writethrough cache as part of the worker/server init process, as well as part of doc writethrough tests.
2024-03-08 12:20:52 +00:00
Sam Rose
4325b99d7d
Merge branch 'master' of github.com:budibase/budibase into cleanup-isolates
2024-03-07 13:37:31 +00:00
mike12345567
121ad109ec
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-07 13:27:21 +00:00
Adria Navarro
74f8c3fce8
Merge branch 'master' into BUDI-8046/scim-logger
2024-03-07 14:24:16 +01:00
Adria Navarro
bba26c9184
Change max attempts
2024-03-07 13:58:01 +01:00
Adria Navarro
fc7b6f305d
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 13:19:40 +01:00
Adria Navarro
d75ab4b46c
Remove logWarn
2024-03-07 13:14:26 +01:00
Adria Navarro
a6666f662c
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 11:38:41 +01:00
Adria Navarro
9e55f87d02
Add message
2024-03-07 11:30:59 +01:00
Adria Navarro
536422e60b
Undo
2024-03-07 11:23:09 +01:00
Adria Navarro
17b06703e9
Remove lock
2024-03-07 11:16:08 +01:00
Adria Navarro
440dcb244d
Infinite retries
2024-03-07 11:11:36 +01:00
Adria Navarro
e60033bd89
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 11:05:16 +01:00
Adria Navarro
977daff05c
Retry
2024-03-07 10:54:26 +01:00
Adria Navarro
bb5b40b61c
Lint
2024-03-07 10:35:37 +01:00
Adria Navarro
5df0c85a9b
Merge branch 'master' into BUDI-8064/doc-writethrough
2024-03-07 10:31:33 +01:00
Adria Navarro
1b6954247c
Skip test
2024-03-07 10:30:09 +01:00
Adria Navarro
d06f9e0a1c
Add bulk delete
2024-03-07 00:25:12 +01:00
Adria Navarro
81af85eae0
Expose redis functions
2024-03-07 00:25:04 +01:00
mike12345567
851a423615
Some typing updates to fix some build issues which were occurring.
2024-03-06 18:07:46 +00:00
Sam Rose
6f692723e7
Remove flakiness in SCIM tests.
2024-03-06 17:28:45 +00:00
mike12345567
2eb16a70db
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-06 17:27:53 +00:00
Sam Rose
2946188ab1
Merge branch 'master' into enforce-example-com-emails-in-tests
2024-03-06 17:15:43 +00:00
Sam Rose
2c04fa453c
Merge branch 'master' of github.com:budibase/budibase into budi-7710-user-groups-do-not-fully-support-custom-roles-5
2024-03-06 16:58:16 +00:00
Sam Rose
4b24fb7c68
Merge master.
2024-03-06 14:59:39 +00:00
Sam Rose
30c1b07309
Merge master.
2024-03-06 14:53:54 +00:00
Adria Navarro
ee86cd30d6
Merge branch 'master' into BUDI-8046/redis-delete-if-value
2024-03-06 15:46:16 +01:00
Adria Navarro
a44faad046
Add same key tests
2024-03-06 15:37:38 +01:00
Adria Navarro
4ce85cde1a
Simplify, use only queues
2024-03-06 14:07:39 +01:00
Adria Navarro
5109477e52
Fix checks
2024-03-06 13:39:27 +01:00
Adria Navarro
baa58990c8
Merge branch 'master' into BUDI-8046/redis-increment
2024-03-06 12:32:51 +01:00
Adria Navarro
c198a5ae03
Update packages/backend-core/src/redis/redis.ts
...
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-03-06 12:23:04 +01:00
Adria Navarro
4baadadaa8
Use pipeline instead of eval
2024-03-06 12:22:20 +01:00
Adria Navarro
61c4b83650
Test with spies
2024-03-06 11:55:49 +01:00
Sam Rose
2b206f2105
Fix the TODO I left myself last night.
2024-03-06 10:00:02 +00:00
Adria Navarro
d35d382ddb
Increase timeouts
2024-03-06 00:58:05 +01:00
Adria Navarro
8e8378d1be
Delete info on process
2024-03-06 00:56:30 +01:00
Adria Navarro
a9046e9f26
Use lock name
2024-03-06 00:34:48 +01:00
Adria Navarro
3dbf0b3a64
Throw errors on lock not executed
2024-03-06 00:34:48 +01:00
Adria Navarro
0a2fb4a3a6
Use message id to handle concurrency
2024-03-06 00:34:48 +01:00
Adria Navarro
6707da4ac2
Use bulk
2024-03-06 00:34:48 +01:00
Adria Navarro
f5e2dc7a27
Do not use lock
2024-03-06 00:34:48 +01:00
Adria Navarro
e584d82e6f
Improve redlock non executed response
2024-03-06 00:34:48 +01:00
Adria Navarro
37935112a4
Add comment
2024-03-06 00:34:48 +01:00
Adria Navarro
c4fc94fb28
Remove defaults and init
2024-03-06 00:34:48 +01:00
Adria Navarro
fb2c7467b0
Clean
2024-03-06 00:34:48 +01:00
Adria Navarro
caff2876dd
Tests
2024-03-06 00:34:48 +01:00
Adria Navarro
151bfd103b
Use bull
2024-03-06 00:34:48 +01:00
Adria Navarro
e4d8fe2f47
Add doc-writethrough queue
2024-03-06 00:34:48 +01:00
Adria Navarro
770aff4f5e
Type inMemoryQueue
2024-03-06 00:34:48 +01:00
Adria Navarro
3c944073eb
Use overloads
2024-03-06 00:34:48 +01:00
Adria Navarro
eb78103764
Namespace key in redis by db
2024-03-06 00:34:48 +01:00
Adria Navarro
6bd7e6b374
Namespace key in redis by db
2024-03-06 00:34:47 +01:00
Adria Navarro
608865fe9d
Fix types
2024-03-06 00:34:47 +01:00
Adria Navarro
cd56e1ffff
Type caches
2024-03-06 00:34:47 +01:00
Adria Navarro
8062c28722
Making code more readable
2024-03-06 00:34:47 +01:00
Adria Navarro
6a81d21cb7
Fixes and tests
2024-03-06 00:34:47 +01:00
Adria Navarro
00bf88c5bf
Extra tests
2024-03-06 00:34:47 +01:00
Adria Navarro
319b3afddb
Ensure keys are removed
2024-03-06 00:34:47 +01:00
Adria Navarro
e228b9c207
Test concurrency
2024-03-06 00:34:47 +01:00
Adria Navarro
b1e1226de6
Add extra tests
2024-03-06 00:34:47 +01:00
Adria Navarro
b1027527b3
Add persisting tests
2024-03-06 00:34:47 +01:00
Adria Navarro
64ea969aaf
docWritethrough test
2024-03-06 00:34:47 +01:00
Adria Navarro
3998faaf3a
DatabaseImpl.docExists test
2024-03-06 00:34:47 +01:00
Adria Navarro
48c92377ad
USe get for doc exists
2024-03-06 00:34:47 +01:00
Adria Navarro
c96c57bd9e
DocWritethrough
2024-03-06 00:34:47 +01:00
Adria Navarro
86b715d5ce
Create docWriteThrough redis cache
2024-03-06 00:34:47 +01:00
Adria Navarro
8f486e7bfc
Add tests
2024-03-06 00:33:53 +01:00
Adria Navarro
355dea5b05
Add deleteIfValue
2024-03-06 00:33:53 +01:00
Adria Navarro
60f82610f6
Use redis testcontainer
2024-03-06 00:33:24 +01:00
Adria Navarro
b774987e61
Install testcontainers
2024-03-06 00:33:04 +01:00
Adria Navarro
d4ffc3d5d7
More tests
2024-03-05 22:54:39 +01:00
Adria Navarro
192d7deb2a
Handle errors
2024-03-05 22:52:44 +01:00
Adria Navarro
837395e5e0
Add tests
2024-03-05 22:43:34 +01:00
Adria Navarro
339ca403bf
Add redis.increment
2024-03-05 22:43:28 +01:00
Sam Rose
182a1df960
Fix the bug, I think.
2024-03-05 17:35:04 +00:00
Adria Navarro
db75c05942
Use scim-logs db
2024-03-05 18:25:23 +01:00
Adria Navarro
71c5d2645f
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-05 18:13:59 +01:00
Adria Navarro
ebcb7718b8
Use bulk
2024-03-05 18:11:50 +01:00
Adria Navarro
4fe7e67dd5
Do not use lock
2024-03-05 18:11:50 +01:00
Adria Navarro
2b25f9f0cb
Improve redlock non executed response
2024-03-05 18:11:50 +01:00
Adria Navarro
0649497ab5
Add comment
2024-03-05 18:11:50 +01:00
Adria Navarro
8d87850765
Remove defaults and init
2024-03-05 18:11:50 +01:00
Adria Navarro
b94d28b7d6
Clean
2024-03-05 18:11:50 +01:00
Adria Navarro
420b0ffc03
Tests
2024-03-05 18:11:50 +01:00
Adria Navarro
936ddafee7
Use bull
2024-03-05 18:11:50 +01:00
Adria Navarro
df325e21c3
Add doc-writethrough queue
2024-03-05 18:11:50 +01:00
Adria Navarro
2412d75cac
Type inMemoryQueue
2024-03-05 18:11:49 +01:00
Adria Navarro
774ff42f0c
Use overloads
2024-03-05 18:11:49 +01:00
Adria Navarro
82a6f9027e
Namespace key in redis by db
2024-03-05 18:11:49 +01:00
Adria Navarro
da012c0f08
Namespace key in redis by db
2024-03-05 18:11:49 +01:00
Adria Navarro
e986d34b87
Fix types
2024-03-05 18:11:49 +01:00
Adria Navarro
dc84eb4e80
Type caches
2024-03-05 18:11:49 +01:00
Adria Navarro
eb9a163394
Making code more readable
2024-03-05 18:11:49 +01:00
Adria Navarro
fd93eb79d5
Fixes and tests
2024-03-05 18:11:49 +01:00
Adria Navarro
04fb279623
Extra tests
2024-03-05 18:11:49 +01:00
Adria Navarro
223637999a
Ensure keys are removed
2024-03-05 18:11:49 +01:00
Adria Navarro
41dde9722f
Test concurrency
2024-03-05 18:11:49 +01:00
Adria Navarro
35536592e6
Add extra tests
2024-03-05 18:11:49 +01:00
Adria Navarro
bfde028e9b
Add persisting tests
2024-03-05 18:11:49 +01:00
Adria Navarro
74aae19a7e
docWritethrough test
2024-03-05 18:11:49 +01:00
Adria Navarro
82132d539d
DatabaseImpl.docExists test
2024-03-05 18:11:49 +01:00
Adria Navarro
10568cccff
USe get for doc exists
2024-03-05 18:11:49 +01:00