Peter Clement
db273bcd36
Support attachment columns in Automations ( #13567 )
...
* base work to support attachments in create / update row
* handle single attachment column
* fix tests
* pro
* fix some types
* handle case where file exists in storage
* improve attacment processing
* refactor slightly and ensure correct url is used for existing attachments
* add test
* Fixing a build issue.
* update tests
* some lint
* remove cursed backend-core test util
* addressing pr comments
* refactoring nasty automationUtils upload code
* remove uneeded check
* use basneeame for fallback filename
* add a test to ensure coverage of single attachment column type
* fail early when fetching object metadata
---------
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2024-05-09 14:30:56 +01:00
Dean
4c6629d15f
Merge remote-tracking branch 'origin/master' into feature/filter-bindings
2024-05-09 11:05:58 +01:00
mike12345567
21ce586d93
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 17:04:34 +01:00
Sam Rose
5783ee790f
Fix Lucene tests.
2024-05-08 15:36:26 +01:00
Sam Rose
264ce5e272
Merge branch 'master' into search-tests-boolean
2024-05-08 14:20:36 +01:00
Peter Clement
1d300c2577
Remove aws sdk global mock and update tests ( #13637 )
...
* Remove aws sdk global mock and update tests
* add awaits
* Minio healthcheck in tests.
* Bind to 127.0.0.1 instead of 0.0.0.0
* Fix port fetching for minio container.
* Actually fix port mapping this time.
* Pull minio container before running tests.
* Enable testcontainers debug logging.
* Promote minio container to always running in tests, like CouchDB.
* Remove testcontainers debug logging.
---------
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-05-08 14:08:34 +01:00
mike12345567
2e8b655417
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 12:36:42 +01:00
deanhannigan
42a5d3d0e0
Merge branch 'master' into feature/filter-bindings
2024-05-08 10:22:45 +01:00
mike12345567
a2d4f8523c
Some typing improvements, as well as getting deletion/setup working a bit better.
2024-05-07 18:27:47 +01:00
Sam Rose
946bd0ef7d
Fix lucene.spec.ts.
2024-05-07 17:11:05 +01:00
Sam Rose
3bc1e6b387
Fix behaviour of 'when filter empty' for empty and notEmpty filter types.
2024-05-07 16:46:54 +01:00
Sam Rose
32bd505ef9
Respond to PR feedback.
2024-05-07 10:38:47 +01:00
mike12345567
070659c7b1
Fixing an issue with typing + wrong parameter being passed to the direct Couch call functionality.
2024-05-03 18:00:43 +01:00
Sam Rose
27e68f79f5
Remove extraneous comment.
2024-05-03 17:34:03 +01:00
Sam Rose
1777f1f8fe
Fix boolean searching for Lucene/SQS
2024-05-03 17:29:20 +01:00
Dean
3823ffa4fd
Ensure snippet context is disabled by default in test. Add override for search
2024-05-02 17:59:55 +01:00
Dean
5e7d1169f7
Minor refactor to accomodate testing with snippets. More test cases for multiple binding types
2024-05-02 16:26:09 +01:00
Adria Navarro
70c6d56c1e
Merge branch 'feat/budi-8123-single-user' into budi-8123/single-user-column-type
2024-05-02 12:06:42 +01:00
Adria Navarro
6570b2efcc
Remove unused packages from backend-core
2024-05-01 11:38:59 +01:00
mike12345567
7f1500ac86
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-26 15:48:40 +01:00
Sam Rose
dd02224806
Restart testcontainers every day, and add a script to kill them.
2024-04-26 14:01:52 +01:00
Adria Navarro
1c4fc21870
Lint
2024-04-25 16:36:47 +02:00
Adria Navarro
e0216bb00c
Lint
2024-04-25 13:20:59 +02:00
Adria Navarro
d63c5830e5
Typings
2024-04-25 13:20:59 +02:00
Michael Drury
2187d25711
Revert "Changing client library to be retrieved via pre-signed URL for Cloud"
2024-04-24 17:12:36 +01:00
mike12345567
f76abb0ca9
Getting rid of linting error.
2024-04-24 15:59:11 +01:00
mike12345567
849253faba
Bringing back the old mechanism of returning the client library through a pre-signed URL, rather than always serving through the service.
2024-04-24 15:37:47 +01:00
mike12345567
6ff00135bf
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-22 17:22:53 +01:00
Peter Clement
a4c0328c53
REST file handling and SMTP automation block attachments ( #13403 )
...
* handle files in rest connector
* fetch presigned url and return
* further updates to handle files in rest connector
* remove unused important and fix extension bug
* wrong expiry param
* tests
* add const for temp bucket
* handle ttl on bucket
* more bucket ttl work
* split out fileresponse and xmlresponse into utils
* lint
* remove log
* fix tests
* some pr comments
* update function naming and lint
* adding back needed response for frontend
* use fsp
* handle different content-disposition and potential path traversal
* add test container for s3 / minio
* add test case for filename* and ascii filenames
* move tests into separate describe
* remove log
* up timeout
* switch to minio image instead of localstack
* use minio image instead of s3 for testing
* stream file upload instead
* use streamUpload and update signatures
* update bucketcreate return
* throw real error
* tidy up
* pro
* pro ref fix?
* pro fix
* pro fix?
* move minio test provider to backend-core
* update email builder to allow attachments
* testing for sending files via smtp
* use backend-core minio test container in server
* handle different types of url
* fix minio test provider
* test with container host
* lint
* try different hostname?
* Revert "try different hostname?"
This reverts commit cfefdb8ded
.
* fix issue with fetching of signed url with test minio
* update autoamtion attachments to take filename and url
* fix tests
* pro ref
* fix parsing of url object
* pr comments and linting
* pro ref
* fix pro again
* fix pro
* account-portal
* fix null issue
* fix ref
* ref
* When sending a file attachment in email fetch it directly from our object store
* add more checks to ensure we're working with a signed url
* update test to account for direct object store read
* formatting
* fix time issues within test
* update bucket and path extraction to regex
* use const in regex
* pro
* Updating TTL handling in upload functions (#13539 )
* Updating TTL handling in upload functions
* describe ttl type
* account for ttl creation in existing buckets and update types
* fix tests
* pro
* pro
2024-04-22 15:30:57 +00:00
mike12345567
8189952f0b
Adding implementation to DB for purge and cleanup APIs of SQS, to make sure the DB is cleared of any unused tables or rows.
2024-04-19 18:03:38 +01:00
mike12345567
8bb6956925
Merge branch 'master' of github.com:Budibase/budibase into fix-oidc-error-logging
2024-04-19 13:29:21 +01:00
melohagan
6bdc726d55
Allow a displayName to be passed when creating admin user ( #13516 )
...
* Allow a displayName to be passed when creating admin user
* Set the first and last names
* Don't format handlebars files on save
* Use familyName and givenName
2024-04-18 12:52:00 +00:00
Adria Navarro
f12e654811
Merge branch 'master' into chore/remove-disabling-nounusedvars
2024-04-17 15:49:35 +02:00
mike12345567
25dba0be35
This removes the SearchQuery which was a duplication of the SearchFilters interface - the duplicated types were not correctly getting overlay on each other, causing build errors.
2024-04-17 13:54:23 +01:00
Adria Navarro
a88924a418
Remove // eslint-disable-next-line no-unused-vars
2024-04-17 12:24:41 +02:00
Adria Navarro
ec93ea59c1
Remove // eslint-disable-next-line @typescript-eslint/no-unused-vars
2024-04-17 12:17:03 +02:00
Adria Navarro
ca158c33e8
DRY
2024-04-17 10:33:20 +02:00
mike12345567
6e4a66b2e1
Initial implementation of generating SQS junction table definitions.
2024-04-11 18:19:47 +01:00
Michael Drury
c190a9983f
Merge branch 'master' into fix-oidc-error-logging
2024-04-11 17:01:04 +01:00
Martin McKeaveney
4a6e1b7192
fix all cases of lint rule
2024-04-10 17:39:12 +01:00
mike12345567
20da8bb816
Adding support for SQS prepared statement API.
2024-04-10 17:36:57 +01:00
Sam Rose
c5580b4767
Get SQS plumbing working in tests.
2024-04-09 15:31:32 +01:00
mike12345567
efe66186f4
Last PR comment - fixing issue with lucene test case.
2024-04-09 12:37:03 +01:00
mike12345567
5f44b98b7f
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-05 16:36:36 +01:00
mike12345567
86150c58ce
Fixing issue with BB_ADMIN environment variables for user creation introduced by user password becoming optional. Adding a test case as well to cover this to avoid it breaking in future.
2024-04-05 12:14:51 +01:00
mike12345567
d11c316572
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-04 15:02:25 +01:00
Sam Rose
79184e70af
Remove CONTAINER_NAMESPACE, it wasn't the solution.
2024-04-03 12:32:29 +01:00
Sam Rose
258226ddef
Better error message when multiple images are found.
2024-04-03 11:40:14 +01:00
Sam Rose
8cffdeda56
Re-use containers and create namespaces for each test.
2024-04-03 11:33:39 +01:00
Sam Rose
3dff4bf334
Fix lint.
2024-04-03 11:20:43 +01:00
Sam Rose
e3fbce25fa
Merge branch 'master' of github.com:budibase/budibase into reuse-containers
2024-04-03 11:15:11 +01:00
mike12345567
9b8b422f1b
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-03 10:16:23 +01:00
mike12345567
8c326b501b
Adding support for oneOf ID search of users, today the relationship picker attempts to use this for the users table, but it was not supported.
2024-04-02 17:12:31 +01:00
mike12345567
5e186b5c8a
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-02 12:05:34 +01:00
mike12345567
4c755b3af3
Improving typing around search, there was duplicates of SearchParams and SearchResponse - which were a little different, bring all of this together under the types library.
2024-03-28 17:57:37 +00:00
Sam Rose
90cfdd661d
Rework how we connect to containers.
2024-03-28 17:36:26 +00:00
Martin McKeaveney
32a5ce24ec
remove automatic ssoId generation
2024-03-28 15:46:43 +00:00
José Vte. Calderón
b5e0bd1aad
Merge branch 'master' into feature/update-global-user
2024-03-28 12:05:29 +01:00
jvcalderon
b77106480e
Adds POST /api/global/users/sso endpoint
2024-03-28 11:46:58 +01:00
Sam Rose
204b16876a
Run yarn lint:fix
2024-03-27 16:46:11 +00:00
Sam Rose
831c174362
Give SQL integrations their own database when fetching a new datasource.
2024-03-27 15:25:37 +00:00
mike12345567
de518de8fa
Merging issue with static index.
2024-03-26 12:53:45 +00:00
Sam Rose
6ee8f421a5
Merge branch 'master' of github.com:budibase/budibase into remove-jest-testcontainers
2024-03-26 10:05:21 +00:00
Sam Rose
415b27a008
Don't need a globalTeardown, testcontainers handles the removal of containers.
2024-03-26 10:00:34 +00:00
Sam Rose
5d7cd511b5
Correct path to global functions in jest.config.ts.
2024-03-26 09:51:10 +00:00
Sam Rose
f3e9e3d35e
Share a single globalSetup/globalTeardown.
2024-03-26 09:49:33 +00:00
Sam Rose
afacee978d
Add missing environment vars for backend-core tests.
2024-03-25 17:40:46 +00:00
Sam Rose
0dba0cebc7
Remove CouchDB container name.
2024-03-25 17:26:15 +00:00
Sam Rose
44d4e496b6
Fix code to pull CouchDB URL out of docker ps.
2024-03-25 17:11:41 +00:00
Sam Rose
db21542d38
Cherry-pick 6b8422df01
2024-03-25 15:25:30 +00:00
Sam Rose
66cfb8eedd
Remove jest-testcontainers.
2024-03-25 15:24:14 +00:00
jvcalderon
1da10c9a5f
Merge branch 'master' into feature/onboarding
2024-03-25 12:51:57 +01:00
jvcalderon
50c0fb1f97
Override identity for events sent from dispatcher
2024-03-22 10:41:27 +01:00
mike12345567
9995f71871
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-20 13:45:27 +00:00
mike12345567
8df38b8bb2
Merging in most recent changes, recent SQL aliasing changes caused some big differences.
2024-03-20 12:42:07 +00:00
Sam Rose
217b39c232
Reenable no-unused-vars
2024-03-20 11:46:39 +00:00
Sam Rose
009c795f54
Reenable no-undefs.
2024-03-19 17:47:39 +00:00
Sam Rose
f1278312ab
Reenable no-case-declarations.
2024-03-19 15:58:25 +00:00
Sam Rose
f6669c25cf
Merge branch 'master' of github.com:budibase/budibase into reenable-no-case-declarations
2024-03-19 15:53:19 +00:00
Sam Rose
79bba82908
Fix flaky scim test.
2024-03-19 15:45:24 +00:00
Adria Navarro
b7b8a65a54
Don't init DocWritethrough queue on load
2024-03-19 16:01:00 +01:00
Mel O'Hagan
ff231b0095
Make password optional
2024-03-19 13:30:42 +00:00
Adria Navarro
c7276b9005
Merge branch 'master' into BUDI-7656/add-migration
2024-03-19 12:35:39 +01:00
Sam Rose
80008a0739
Reenable no-inner-declarations.
2024-03-19 11:29:19 +00:00
Sam Rose
5749333fc7
Reenable no-useless-escape.
2024-03-19 11:14:16 +00:00
Sam Rose
1785f3af7e
Get lint passing.
2024-03-19 10:55:51 +00:00
Sam Rose
7a63dc9830
Making progress on getting the eslint-jest plugin working.
2024-03-19 10:46:59 +00:00
Sam Rose
1f63f0bddf
Run auto fix.
2024-03-19 09:46:10 +00:00
deanhannigan
7a737e7664
Merge branch 'master' into feature/app-list-actions
2024-03-15 09:31:54 +00:00
deanhannigan
72a671e93b
Merge branch 'master' into feature/app-list-actions
2024-03-15 09:10:57 +00:00
Andrew Kingston
b6eab42c18
Merge branch 'cheeks-lab-day-binding-eval' of github.com:Budibase/budibase into cheeks-snippets-poc
2024-03-14 16:24:16 +00:00
Adria Navarro
62cec7289d
Use guid instead of words
2024-03-14 11:03:43 +01:00
deanhannigan
1db358d5c2
Merge branch 'master' into feature/app-list-actions
2024-03-14 09:33:33 +00:00
Andrew Kingston
8b4ce703e9
Try to fix tests
2024-03-13 17:01:09 +00:00
Andrew Kingston
e45beff059
Merge branch 'master' of github.com:Budibase/budibase into cheeks-snippets-poc
2024-03-13 10:21:07 +00:00
Adria Navarro
cc275983dc
Merge branch 'master' into cleanup-isolates
2024-03-13 10:30:37 +01:00
Andrew Kingston
70821182fe
Update automation context to simplify applying snippet context
2024-03-13 09:15:33 +00:00
Andrew Kingston
3b54daf2c8
Add snippet context before executing automations
2024-03-12 21:40:48 +00:00
Andrew Kingston
16ce5ac65e
Update how snippets are fetched and enriched into context, because HBS helpers can't be async
2024-03-12 17:02:01 +00:00
deanhannigan
66f0deecae
Merge branch 'master' into feature/app-list-actions
2024-03-08 14:44:08 +00:00
Michael Drury
874a6fbd12
Linting.
2024-03-08 12:26:11 +00:00
deanhannigan
460c2573e4
Merge branch 'master' into feature/app-list-actions
2024-03-08 12:24:15 +00:00
Michael Drury
9027e6e82a
Initing doc writethrough cache as part of the worker/server init process, as well as part of doc writethrough tests.
2024-03-08 12:20:52 +00:00
Sam Rose
4325b99d7d
Merge branch 'master' of github.com:budibase/budibase into cleanup-isolates
2024-03-07 13:37:31 +00:00
mike12345567
121ad109ec
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-07 13:27:21 +00:00
Adria Navarro
74f8c3fce8
Merge branch 'master' into BUDI-8046/scim-logger
2024-03-07 14:24:16 +01:00
Adria Navarro
bba26c9184
Change max attempts
2024-03-07 13:58:01 +01:00
Adria Navarro
fc7b6f305d
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 13:19:40 +01:00
Adria Navarro
d75ab4b46c
Remove logWarn
2024-03-07 13:14:26 +01:00
Adria Navarro
a6666f662c
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 11:38:41 +01:00
Adria Navarro
9e55f87d02
Add message
2024-03-07 11:30:59 +01:00
Adria Navarro
536422e60b
Undo
2024-03-07 11:23:09 +01:00
Adria Navarro
17b06703e9
Remove lock
2024-03-07 11:16:08 +01:00
Adria Navarro
440dcb244d
Infinite retries
2024-03-07 11:11:36 +01:00
Adria Navarro
e60033bd89
Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger
2024-03-07 11:05:16 +01:00
Adria Navarro
977daff05c
Retry
2024-03-07 10:54:26 +01:00
Adria Navarro
bb5b40b61c
Lint
2024-03-07 10:35:37 +01:00
Adria Navarro
5df0c85a9b
Merge branch 'master' into BUDI-8064/doc-writethrough
2024-03-07 10:31:33 +01:00
Adria Navarro
1b6954247c
Skip test
2024-03-07 10:30:09 +01:00
Adria Navarro
d06f9e0a1c
Add bulk delete
2024-03-07 00:25:12 +01:00
Adria Navarro
81af85eae0
Expose redis functions
2024-03-07 00:25:04 +01:00
mike12345567
851a423615
Some typing updates to fix some build issues which were occurring.
2024-03-06 18:07:46 +00:00
Sam Rose
6f692723e7
Remove flakiness in SCIM tests.
2024-03-06 17:28:45 +00:00
mike12345567
2eb16a70db
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-03-06 17:27:53 +00:00
Sam Rose
2946188ab1
Merge branch 'master' into enforce-example-com-emails-in-tests
2024-03-06 17:15:43 +00:00
Sam Rose
2c04fa453c
Merge branch 'master' of github.com:budibase/budibase into budi-7710-user-groups-do-not-fully-support-custom-roles-5
2024-03-06 16:58:16 +00:00
Sam Rose
4b24fb7c68
Merge master.
2024-03-06 14:59:39 +00:00
Sam Rose
30c1b07309
Merge master.
2024-03-06 14:53:54 +00:00
Adria Navarro
ee86cd30d6
Merge branch 'master' into BUDI-8046/redis-delete-if-value
2024-03-06 15:46:16 +01:00
Adria Navarro
a44faad046
Add same key tests
2024-03-06 15:37:38 +01:00
Adria Navarro
4ce85cde1a
Simplify, use only queues
2024-03-06 14:07:39 +01:00
Adria Navarro
5109477e52
Fix checks
2024-03-06 13:39:27 +01:00
Adria Navarro
baa58990c8
Merge branch 'master' into BUDI-8046/redis-increment
2024-03-06 12:32:51 +01:00
Adria Navarro
c198a5ae03
Update packages/backend-core/src/redis/redis.ts
...
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-03-06 12:23:04 +01:00
Adria Navarro
4baadadaa8
Use pipeline instead of eval
2024-03-06 12:22:20 +01:00
Adria Navarro
61c4b83650
Test with spies
2024-03-06 11:55:49 +01:00
Sam Rose
2b206f2105
Fix the TODO I left myself last night.
2024-03-06 10:00:02 +00:00
Adria Navarro
d35d382ddb
Increase timeouts
2024-03-06 00:58:05 +01:00
Adria Navarro
8e8378d1be
Delete info on process
2024-03-06 00:56:30 +01:00
Adria Navarro
a9046e9f26
Use lock name
2024-03-06 00:34:48 +01:00
Adria Navarro
3dbf0b3a64
Throw errors on lock not executed
2024-03-06 00:34:48 +01:00
Adria Navarro
0a2fb4a3a6
Use message id to handle concurrency
2024-03-06 00:34:48 +01:00
Adria Navarro
6707da4ac2
Use bulk
2024-03-06 00:34:48 +01:00
Adria Navarro
f5e2dc7a27
Do not use lock
2024-03-06 00:34:48 +01:00
Adria Navarro
e584d82e6f
Improve redlock non executed response
2024-03-06 00:34:48 +01:00
Adria Navarro
37935112a4
Add comment
2024-03-06 00:34:48 +01:00
Adria Navarro
c4fc94fb28
Remove defaults and init
2024-03-06 00:34:48 +01:00
Adria Navarro
fb2c7467b0
Clean
2024-03-06 00:34:48 +01:00
Adria Navarro
caff2876dd
Tests
2024-03-06 00:34:48 +01:00
Adria Navarro
151bfd103b
Use bull
2024-03-06 00:34:48 +01:00