39147b80b6
PR comments.
2024-05-14 11:23:50 +01:00
5b5e7e47a2
Fixing some issues with updating rows with attachments, there were some UI bugs that had been raised (undefined being displayed) and the uploading from a URL was not working as expected, due to the stream not matching the expected format of the S3 SDK - this has been fixed by converting the stream to a true readable stream with .
2024-05-13 18:11:40 +01:00
a8e0443cf7
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-13 14:01:14 +01:00
f25703b88e
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-13 13:54:00 +01:00
2c68c3ffb1
Merge branch 'master' into chore/remove-unused-packages
2024-05-13 14:38:46 +02:00
4bec2a3a48
Merge branch 'master' into feat/budi-8123-single-user
2024-05-13 10:53:49 +02:00
10608f9bb7
Final final fix.
2024-05-10 11:59:11 +01:00
de2d0e6b89
Adding error field.
2024-05-10 11:51:57 +01:00
1aa89c61b6
One small change to keep 404 functionality on destroy DB.
2024-05-10 11:32:57 +01:00
76449782b5
Fixes an issue with fetch information being passed up from DatabaseImpl, making sure errors are fully sanitised.
2024-05-10 11:27:49 +01:00
a3d079f847
Fixing an issue with cleanup, making sure the correct app is cleaned up on deletion.
2024-05-09 18:33:29 +01:00
fd7f6455bd
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-09 17:38:24 +01:00
d83e5e21f2
Merge branch 'master' into feat/budi-8123-single-user
2024-05-09 18:05:16 +02:00
c1874f3376
Merge branch 'master' into feature/filter-bindings
2024-05-09 14:34:07 +01:00
db273bcd36
Support attachment columns in Automations ( #13567 )
...
* base work to support attachments in create / update row
* handle single attachment column
* fix tests
* pro
* fix some types
* handle case where file exists in storage
* improve attacment processing
* refactor slightly and ensure correct url is used for existing attachments
* add test
* Fixing a build issue.
* update tests
* some lint
* remove cursed backend-core test util
* addressing pr comments
* refactoring nasty automationUtils upload code
* remove uneeded check
* use basneeame for fallback filename
* add a test to ensure coverage of single attachment column type
* fail early when fetching object metadata
---------
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2024-05-09 14:30:56 +01:00
4c6629d15f
Merge remote-tracking branch 'origin/master' into feature/filter-bindings
2024-05-09 11:05:58 +01:00
21ce586d93
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 17:04:34 +01:00
5783ee790f
Fix Lucene tests.
2024-05-08 15:36:26 +01:00
264ce5e272
Merge branch 'master' into search-tests-boolean
2024-05-08 14:20:36 +01:00
1d300c2577
Remove aws sdk global mock and update tests ( #13637 )
...
* Remove aws sdk global mock and update tests
* add awaits
* Minio healthcheck in tests.
* Bind to 127.0.0.1 instead of 0.0.0.0
* Fix port fetching for minio container.
* Actually fix port mapping this time.
* Pull minio container before running tests.
* Enable testcontainers debug logging.
* Promote minio container to always running in tests, like CouchDB.
* Remove testcontainers debug logging.
---------
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-05-08 14:08:34 +01:00
2e8b655417
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 12:36:42 +01:00
42a5d3d0e0
Merge branch 'master' into feature/filter-bindings
2024-05-08 10:22:45 +01:00
a2d4f8523c
Some typing improvements, as well as getting deletion/setup working a bit better.
2024-05-07 18:27:47 +01:00
946bd0ef7d
Fix lucene.spec.ts.
2024-05-07 17:11:05 +01:00
3bc1e6b387
Fix behaviour of 'when filter empty' for empty and notEmpty filter types.
2024-05-07 16:46:54 +01:00
32bd505ef9
Respond to PR feedback.
2024-05-07 10:38:47 +01:00
070659c7b1
Fixing an issue with typing + wrong parameter being passed to the direct Couch call functionality.
2024-05-03 18:00:43 +01:00
27e68f79f5
Remove extraneous comment.
2024-05-03 17:34:03 +01:00
1777f1f8fe
Fix boolean searching for Lucene/SQS
2024-05-03 17:29:20 +01:00
3823ffa4fd
Ensure snippet context is disabled by default in test. Add override for search
2024-05-02 17:59:55 +01:00
5e7d1169f7
Minor refactor to accomodate testing with snippets. More test cases for multiple binding types
2024-05-02 16:26:09 +01:00
70c6d56c1e
Merge branch 'feat/budi-8123-single-user' into budi-8123/single-user-column-type
2024-05-02 12:06:42 +01:00
6570b2efcc
Remove unused packages from backend-core
2024-05-01 11:38:59 +01:00
7f1500ac86
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-26 15:48:40 +01:00
dd02224806
Restart testcontainers every day, and add a script to kill them.
2024-04-26 14:01:52 +01:00
1c4fc21870
Lint
2024-04-25 16:36:47 +02:00
e0216bb00c
Lint
2024-04-25 13:20:59 +02:00
d63c5830e5
Typings
2024-04-25 13:20:59 +02:00
2187d25711
Revert "Changing client library to be retrieved via pre-signed URL for Cloud"
2024-04-24 17:12:36 +01:00
f76abb0ca9
Getting rid of linting error.
2024-04-24 15:59:11 +01:00
849253faba
Bringing back the old mechanism of returning the client library through a pre-signed URL, rather than always serving through the service.
2024-04-24 15:37:47 +01:00
6ff00135bf
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-22 17:22:53 +01:00
a4c0328c53
REST file handling and SMTP automation block attachments ( #13403 )
...
* handle files in rest connector
* fetch presigned url and return
* further updates to handle files in rest connector
* remove unused important and fix extension bug
* wrong expiry param
* tests
* add const for temp bucket
* handle ttl on bucket
* more bucket ttl work
* split out fileresponse and xmlresponse into utils
* lint
* remove log
* fix tests
* some pr comments
* update function naming and lint
* adding back needed response for frontend
* use fsp
* handle different content-disposition and potential path traversal
* add test container for s3 / minio
* add test case for filename* and ascii filenames
* move tests into separate describe
* remove log
* up timeout
* switch to minio image instead of localstack
* use minio image instead of s3 for testing
* stream file upload instead
* use streamUpload and update signatures
* update bucketcreate return
* throw real error
* tidy up
* pro
* pro ref fix?
* pro fix
* pro fix?
* move minio test provider to backend-core
* update email builder to allow attachments
* testing for sending files via smtp
* use backend-core minio test container in server
* handle different types of url
* fix minio test provider
* test with container host
* lint
* try different hostname?
* Revert "try different hostname?"
This reverts commit cfefdb8ded#13539 )
* Updating TTL handling in upload functions
* describe ttl type
* account for ttl creation in existing buckets and update types
* fix tests
* pro
* pro
2024-04-22 15:30:57 +00:00
8189952f0b
Adding implementation to DB for purge and cleanup APIs of SQS, to make sure the DB is cleared of any unused tables or rows.
2024-04-19 18:03:38 +01:00
8bb6956925
Merge branch 'master' of github.com:Budibase/budibase into fix-oidc-error-logging
2024-04-19 13:29:21 +01:00
6bdc726d55
Allow a displayName to be passed when creating admin user ( #13516 )
...
* Allow a displayName to be passed when creating admin user
* Set the first and last names
* Don't format handlebars files on save
* Use familyName and givenName
2024-04-18 12:52:00 +00:00
f12e654811
Merge branch 'master' into chore/remove-disabling-nounusedvars
2024-04-17 15:49:35 +02:00
25dba0be35
This removes the SearchQuery which was a duplication of the SearchFilters interface - the duplicated types were not correctly getting overlay on each other, causing build errors.
2024-04-17 13:54:23 +01:00
a88924a418
Remove // eslint-disable-next-line no-unused-vars
2024-04-17 12:24:41 +02:00
ec93ea59c1
Remove // eslint-disable-next-line @typescript-eslint/no-unused-vars
2024-04-17 12:17:03 +02:00
ca158c33e8
DRY
2024-04-17 10:33:20 +02:00
6e4a66b2e1
Initial implementation of generating SQS junction table definitions.
2024-04-11 18:19:47 +01:00
c190a9983f
Merge branch 'master' into fix-oidc-error-logging
2024-04-11 17:01:04 +01:00
4a6e1b7192
fix all cases of lint rule
2024-04-10 17:39:12 +01:00
20da8bb816
Adding support for SQS prepared statement API.
2024-04-10 17:36:57 +01:00
c5580b4767
Get SQS plumbing working in tests.
2024-04-09 15:31:32 +01:00
efe66186f4
Last PR comment - fixing issue with lucene test case.
2024-04-09 12:37:03 +01:00
5f44b98b7f
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-05 16:36:36 +01:00
86150c58ce
Fixing issue with BB_ADMIN environment variables for user creation introduced by user password becoming optional. Adding a test case as well to cover this to avoid it breaking in future.
2024-04-05 12:14:51 +01:00
d11c316572
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-04 15:02:25 +01:00
79184e70af
Remove CONTAINER_NAMESPACE, it wasn't the solution.
2024-04-03 12:32:29 +01:00
258226ddef
Better error message when multiple images are found.
2024-04-03 11:40:14 +01:00
8cffdeda56
Re-use containers and create namespaces for each test.
2024-04-03 11:33:39 +01:00
3dff4bf334
Fix lint.
2024-04-03 11:20:43 +01:00
e3fbce25fa
Merge branch 'master' of github.com:budibase/budibase into reuse-containers
2024-04-03 11:15:11 +01:00
9b8b422f1b
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-03 10:16:23 +01:00
8c326b501b
Adding support for oneOf ID search of users, today the relationship picker attempts to use this for the users table, but it was not supported.
2024-04-02 17:12:31 +01:00
5e186b5c8a
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-02 12:05:34 +01:00
4c755b3af3
Improving typing around search, there was duplicates of SearchParams and SearchResponse - which were a little different, bring all of this together under the types library.
2024-03-28 17:57:37 +00:00
90cfdd661d
Rework how we connect to containers.
2024-03-28 17:36:26 +00:00
32a5ce24ec
remove automatic ssoId generation
2024-03-28 15:46:43 +00:00
b5e0bd1aad
Merge branch 'master' into feature/update-global-user
2024-03-28 12:05:29 +01:00
b77106480e
Adds POST /api/global/users/sso endpoint
2024-03-28 11:46:58 +01:00
204b16876a
Run yarn lint:fix
2024-03-27 16:46:11 +00:00
831c174362
Give SQL integrations their own database when fetching a new datasource.
2024-03-27 15:25:37 +00:00
de518de8fa
Merging issue with static index.
2024-03-26 12:53:45 +00:00
6ee8f421a5
Merge branch 'master' of github.com:budibase/budibase into remove-jest-testcontainers
2024-03-26 10:05:21 +00:00
415b27a008
Don't need a globalTeardown, testcontainers handles the removal of containers.
2024-03-26 10:00:34 +00:00
5d7cd511b5
Correct path to global functions in jest.config.ts.
2024-03-26 09:51:10 +00:00
f3e9e3d35e
Share a single globalSetup/globalTeardown.
2024-03-26 09:49:33 +00:00
afacee978d
Add missing environment vars for backend-core tests.
2024-03-25 17:40:46 +00:00
0dba0cebc7
Remove CouchDB container name.
2024-03-25 17:26:15 +00:00
44d4e496b6
Fix code to pull CouchDB URL out of docker ps.
2024-03-25 17:11:41 +00:00
db21542d38
Cherry-pick 6b8422df01
2024-03-25 15:25:30 +00:00
66cfb8eedd
Remove jest-testcontainers.
2024-03-25 15:24:14 +00:00
1da10c9a5f
Merge branch 'master' into feature/onboarding
2024-03-25 12:51:57 +01:00
50c0fb1f97
Override identity for events sent from dispatcher
2024-03-22 10:41:27 +01:00
9995f71871
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-20 13:45:27 +00:00
8df38b8bb2
Merging in most recent changes, recent SQL aliasing changes caused some big differences.
2024-03-20 12:42:07 +00:00
217b39c232
Reenable no-unused-vars
2024-03-20 11:46:39 +00:00
009c795f54
Reenable no-undefs.
2024-03-19 17:47:39 +00:00
f1278312ab
Reenable no-case-declarations.
2024-03-19 15:58:25 +00:00
f6669c25cf
Merge branch 'master' of github.com:budibase/budibase into reenable-no-case-declarations
2024-03-19 15:53:19 +00:00
79bba82908
Fix flaky scim test.
2024-03-19 15:45:24 +00:00
b7b8a65a54
Don't init DocWritethrough queue on load
2024-03-19 16:01:00 +01:00
ff231b0095
Make password optional
2024-03-19 13:30:42 +00:00
c7276b9005
Merge branch 'master' into BUDI-7656/add-migration
2024-03-19 12:35:39 +01:00
80008a0739
Reenable no-inner-declarations.
2024-03-19 11:29:19 +00:00
5749333fc7
Reenable no-useless-escape.
2024-03-19 11:14:16 +00:00
1785f3af7e
Get lint passing.
2024-03-19 10:55:51 +00:00
7a63dc9830
Making progress on getting the eslint-jest plugin working.
2024-03-19 10:46:59 +00:00
1f63f0bddf
Run auto fix.
2024-03-19 09:46:10 +00:00
7a737e7664
Merge branch 'master' into feature/app-list-actions
2024-03-15 09:31:54 +00:00
72a671e93b
Merge branch 'master' into feature/app-list-actions
2024-03-15 09:10:57 +00:00
b6eab42c18
Merge branch 'cheeks-lab-day-binding-eval' of github.com:Budibase/budibase into cheeks-snippets-poc
2024-03-14 16:24:16 +00:00
62cec7289d
Use guid instead of words
2024-03-14 11:03:43 +01:00
1db358d5c2
Merge branch 'master' into feature/app-list-actions
2024-03-14 09:33:33 +00:00
8b4ce703e9
Try to fix tests
2024-03-13 17:01:09 +00:00
e45beff059
Merge branch 'master' of github.com:Budibase/budibase into cheeks-snippets-poc
2024-03-13 10:21:07 +00:00
cc275983dc
Merge branch 'master' into cleanup-isolates
2024-03-13 10:30:37 +01:00
70821182fe
Update automation context to simplify applying snippet context
2024-03-13 09:15:33 +00:00
3b54daf2c8
Add snippet context before executing automations
2024-03-12 21:40:48 +00:00
16ce5ac65e
Update how snippets are fetched and enriched into context, because HBS helpers can't be async
2024-03-12 17:02:01 +00:00
66f0deecae
Merge branch 'master' into feature/app-list-actions
2024-03-08 14:44:08 +00:00
874a6fbd12
Linting.
2024-03-08 12:26:11 +00:00
460c2573e4
Merge branch 'master' into feature/app-list-actions
2024-03-08 12:24:15 +00:00
9027e6e82a
Initing doc writethrough cache as part of the worker/server init process, as well as part of doc writethrough tests.
2024-03-08 12:20:52 +00:00
4325b99d7d
Merge branch 'master' of github.com:budibase/budibase into cleanup-isolates
2024-03-07 13:37:31 +00:00
121ad109ec
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-07 13:27:21 +00:00
74f8c3fce8
Merge branch 'master' into BUDI-8046/scim-logger
2024-03-07 14:24:16 +01:00
bba26c9184
Change max attempts
2024-03-07 13:58:01 +01:00
fc7b6f305d
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 13:19:40 +01:00
d75ab4b46c
Remove logWarn
2024-03-07 13:14:26 +01:00
a6666f662c
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 11:38:41 +01:00
9e55f87d02
Add message
2024-03-07 11:30:59 +01:00
536422e60b
Undo
2024-03-07 11:23:09 +01:00
17b06703e9
Remove lock
2024-03-07 11:16:08 +01:00
440dcb244d
Infinite retries
2024-03-07 11:11:36 +01:00
e60033bd89
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 11:05:16 +01:00
977daff05c
Retry
2024-03-07 10:54:26 +01:00
bb5b40b61c
Lint
2024-03-07 10:35:37 +01:00
5df0c85a9b
Merge branch 'master' into BUDI-8064/doc-writethrough
2024-03-07 10:31:33 +01:00
1b6954247c
Skip test
2024-03-07 10:30:09 +01:00
d06f9e0a1c
Add bulk delete
2024-03-07 00:25:12 +01:00
81af85eae0
Expose redis functions
2024-03-07 00:25:04 +01:00
851a423615
Some typing updates to fix some build issues which were occurring.
2024-03-06 18:07:46 +00:00
6f692723e7
Remove flakiness in SCIM tests.
2024-03-06 17:28:45 +00:00
2eb16a70db
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-06 17:27:53 +00:00
2946188ab1
Merge branch 'master' into enforce-example-com-emails-in-tests
2024-03-06 17:15:43 +00:00
2c04fa453c
Merge branch 'master' of github.com:budibase/budibase into budi-7710-user-groups-do-not-fully-support-custom-roles-5
2024-03-06 16:58:16 +00:00
4b24fb7c68
Merge master.
2024-03-06 14:59:39 +00:00
30c1b07309
Merge master.
2024-03-06 14:53:54 +00:00
ee86cd30d6
Merge branch 'master' into BUDI-8046/redis-delete-if-value
2024-03-06 15:46:16 +01:00
a44faad046
Add same key tests
2024-03-06 15:37:38 +01:00
4ce85cde1a
Simplify, use only queues
2024-03-06 14:07:39 +01:00
5109477e52
Fix checks
2024-03-06 13:39:27 +01:00
baa58990c8
Merge branch 'master' into BUDI-8046/redis-increment
2024-03-06 12:32:51 +01:00
c198a5ae03
Update packages/backend-core/src/redis/redis.ts
...
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-03-06 12:23:04 +01:00
4baadadaa8
Use pipeline instead of eval
2024-03-06 12:22:20 +01:00
61c4b83650
Test with spies
2024-03-06 11:55:49 +01:00
2b206f2105
Fix the TODO I left myself last night.
2024-03-06 10:00:02 +00:00
d35d382ddb
Increase timeouts
2024-03-06 00:58:05 +01:00
8e8378d1be
Delete info on process
2024-03-06 00:56:30 +01:00
a9046e9f26
Use lock name
2024-03-06 00:34:48 +01:00
3dbf0b3a64
Throw errors on lock not executed
2024-03-06 00:34:48 +01:00
0a2fb4a3a6
Use message id to handle concurrency
2024-03-06 00:34:48 +01:00
6707da4ac2
Use bulk
2024-03-06 00:34:48 +01:00
f5e2dc7a27
Do not use lock
2024-03-06 00:34:48 +01:00
e584d82e6f
Improve redlock non executed response
2024-03-06 00:34:48 +01:00
37935112a4
Add comment
2024-03-06 00:34:48 +01:00
c4fc94fb28
Remove defaults and init
2024-03-06 00:34:48 +01:00
fb2c7467b0
Clean
2024-03-06 00:34:48 +01:00
caff2876dd
Tests
2024-03-06 00:34:48 +01:00
151bfd103b
Use bull
2024-03-06 00:34:48 +01:00
e4d8fe2f47
Add doc-writethrough queue
2024-03-06 00:34:48 +01:00
770aff4f5e
Type inMemoryQueue
2024-03-06 00:34:48 +01:00
3c944073eb
Use overloads
2024-03-06 00:34:48 +01:00
eb78103764
Namespace key in redis by db
2024-03-06 00:34:48 +01:00
6bd7e6b374
Namespace key in redis by db
2024-03-06 00:34:47 +01:00
608865fe9d
Fix types
2024-03-06 00:34:47 +01:00
cd56e1ffff
Type caches
2024-03-06 00:34:47 +01:00
8062c28722
Making code more readable
2024-03-06 00:34:47 +01:00
6a81d21cb7
Fixes and tests
2024-03-06 00:34:47 +01:00
00bf88c5bf
Extra tests
2024-03-06 00:34:47 +01:00
319b3afddb
Ensure keys are removed
2024-03-06 00:34:47 +01:00
e228b9c207
Test concurrency
2024-03-06 00:34:47 +01:00
b1e1226de6
Add extra tests
2024-03-06 00:34:47 +01:00
b1027527b3
Add persisting tests
2024-03-06 00:34:47 +01:00
64ea969aaf
docWritethrough test
2024-03-06 00:34:47 +01:00
3998faaf3a
DatabaseImpl.docExists test
2024-03-06 00:34:47 +01:00
48c92377ad
USe get for doc exists
2024-03-06 00:34:47 +01:00
c96c57bd9e
DocWritethrough
2024-03-06 00:34:47 +01:00
86b715d5ce
Create docWriteThrough redis cache
2024-03-06 00:34:47 +01:00
8f486e7bfc
Add tests
2024-03-06 00:33:53 +01:00
355dea5b05
Add deleteIfValue
2024-03-06 00:33:53 +01:00
60f82610f6
Use redis testcontainer
2024-03-06 00:33:24 +01:00
b774987e61
Install testcontainers
2024-03-06 00:33:04 +01:00
d4ffc3d5d7
More tests
2024-03-05 22:54:39 +01:00
192d7deb2a
Handle errors
2024-03-05 22:52:44 +01:00
837395e5e0
Add tests
2024-03-05 22:43:34 +01:00
339ca403bf
Add redis.increment
2024-03-05 22:43:28 +01:00
182a1df960
Fix the bug, I think.
2024-03-05 17:35:04 +00:00
db75c05942
Use scim-logs db
2024-03-05 18:25:23 +01:00
71c5d2645f
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-05 18:13:59 +01:00
ebcb7718b8
Use bulk
2024-03-05 18:11:50 +01:00
4fe7e67dd5
Do not use lock
2024-03-05 18:11:50 +01:00
2b25f9f0cb
Improve redlock non executed response
2024-03-05 18:11:50 +01:00
0649497ab5
Add comment
2024-03-05 18:11:50 +01:00
8d87850765
Remove defaults and init
2024-03-05 18:11:50 +01:00
b94d28b7d6
Clean
2024-03-05 18:11:50 +01:00
mike12345567
Adria Navarro
deanhannigan
Peter Clement
Sam Rose
melohagan
Martin McKeaveney
José Vte. Calderón
Mel O'Hagan
Andrew Kingston