65c2039d0c
Chore: Allow using an AWS_SESSION_TOKEN for object storage with AWS S3
2024-06-10 11:48:54 +01:00
ee391b30d6
Fixing an issue with multi-tenant app migration failures - the app migration context wasn't getting the tenant ID as needed. Also added some better logging as well as cleaning up the queues properly to remove these dud events.
2024-06-07 22:50:06 +01:00
b76d535202
Merge branch 'master' into BUDI-7656/add-migration
2024-06-07 10:24:50 +01:00
ab6614a683
Capturing any 500s which occur from SQS cleanup - it appears to 500 if there is nothing to do.
2024-06-06 17:38:52 +01:00
ea1d3000c2
Merge branch 'master' into BUDI-7656/add-migration
2024-06-06 16:49:48 +01:00
70aa43680d
Addressing PR comments.
2024-06-06 16:49:03 +01:00
2c86ea14fd
Changing how disk cleanup is performed.
2024-06-06 15:07:06 +01:00
ac53a97176
WIP
2024-06-06 14:55:07 +01:00
4f6076d2ba
Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration
2024-06-05 16:29:45 +01:00
cf6f86cb2f
Updating migrations to correctly cover all the required elements.
2024-06-04 17:24:11 +01:00
e3b1655ad0
Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration
2024-06-04 12:56:59 +01:00
a562655361
Merge branch 'master' into feat/readonly-columns
2024-06-04 12:04:49 +02:00
2d953f19cc
Clean validation message
2024-06-04 11:11:50 +02:00
155de99b68
Streaming to disk before passing onto S3.
2024-06-03 11:46:20 +01:00
75501c2251
Updating object store stream upload to make sure the stream has finished being processed before trying to upload to AWS (and only uploading a partial stream).
2024-05-31 17:57:31 +01:00
f3d1a8aabc
Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration
2024-05-29 17:20:29 +01:00
aa232db669
Merge branch 'master' into fix/template-app-rows
2024-05-29 15:06:09 +01:00
f5f471a4aa
Merge branch 'master' into BUDI-8284/readonly-settings-columns-in-views
2024-05-29 15:41:20 +02:00
6b7a4f07cb
Quick fix for ambiguous column names _id.
2024-05-29 11:56:52 +01:00
83fa6f952a
re-jigging, making this part of filters rather than meta.
2024-05-28 18:34:08 +01:00
cb99007a42
Fix for issue with templated apps - some template apps are *very* old and therefore don't necessarily abide by the rules that are generally followed for new apps, this is something we should resolve, but for now adding an option that allows searching for only a specific document type.
2024-05-28 18:30:06 +01:00
422b1e2753
Fix tests
2024-05-27 14:31:45 +02:00
3b310b188e
Fixing issue with column quoting.
2024-05-24 17:52:40 +01:00
b18ca2670a
Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs
2024-05-24 12:22:20 +01:00
a3d2871330
Merge branch 'master' into feature/audit-log-sqs
2024-05-23 16:52:50 +01:00
66686fd970
Making sure all JSON column types are correctly handled.
2024-05-23 15:00:13 +01:00
0c28d05d40
Some work to correctly handle JSON columns from SQS as well.
2024-05-23 14:57:38 +01:00
99536c2d0b
PR comments.
2024-05-23 14:24:49 +01:00
e169454490
Move utils to backend-core
2024-05-23 14:59:51 +02:00
ff8684d9b4
Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs
2024-05-22 15:23:24 +01:00
a2200a38fb
Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs
2024-05-20 14:09:57 +01:00
d1b6a542fa
Getting audit log searching with sqs working - a bit more work than expected but fixed quite a few SQS bugs along the way.
2024-05-17 20:26:34 +01:00
d7f3109a22
Making sqlite design doc generation more accessible.
2024-05-17 12:35:31 +01:00
19cb7b83e0
Merge branch 'master' into BUDI-8248/reduce-googleapi-calls
2024-05-17 12:28:28 +02:00
7807b734bb
Persist googlesheet refs in context
2024-05-17 12:07:28 +02:00
0efa1f06ab
Moving some stuff around to make way for other services using the sql layers.
2024-05-16 17:33:47 +01:00
647a8c2a74
Final fix for remove function.
2024-05-16 13:52:38 +01:00
06d6d84b55
Addressing PR comments.
2024-05-16 13:27:54 +01:00
aa51db20ee
Changing how cleanup works - the cleanup is now part of the DB deletion, making sure it cannot be missed.
2024-05-14 15:41:48 +01:00
673211dfbb
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-14 14:38:00 +01:00
39147b80b6
PR comments.
2024-05-14 11:23:50 +01:00
5b5e7e47a2
Fixing some issues with updating rows with attachments, there were some UI bugs that had been raised (undefined being displayed) and the uploading from a URL was not working as expected, due to the stream not matching the expected format of the S3 SDK - this has been fixed by converting the stream to a true readable stream with .
2024-05-13 18:11:40 +01:00
a8e0443cf7
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-13 14:01:14 +01:00
f25703b88e
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-13 13:54:00 +01:00
2c68c3ffb1
Merge branch 'master' into chore/remove-unused-packages
2024-05-13 14:38:46 +02:00
4bec2a3a48
Merge branch 'master' into feat/budi-8123-single-user
2024-05-13 10:53:49 +02:00
10608f9bb7
Final final fix.
2024-05-10 11:59:11 +01:00
de2d0e6b89
Adding error field.
2024-05-10 11:51:57 +01:00
1aa89c61b6
One small change to keep 404 functionality on destroy DB.
2024-05-10 11:32:57 +01:00
76449782b5
Fixes an issue with fetch information being passed up from DatabaseImpl, making sure errors are fully sanitised.
2024-05-10 11:27:49 +01:00
a3d079f847
Fixing an issue with cleanup, making sure the correct app is cleaned up on deletion.
2024-05-09 18:33:29 +01:00
fd7f6455bd
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-09 17:38:24 +01:00
d83e5e21f2
Merge branch 'master' into feat/budi-8123-single-user
2024-05-09 18:05:16 +02:00
c1874f3376
Merge branch 'master' into feature/filter-bindings
2024-05-09 14:34:07 +01:00
db273bcd36
Support attachment columns in Automations ( #13567 )
...
* base work to support attachments in create / update row
* handle single attachment column
* fix tests
* pro
* fix some types
* handle case where file exists in storage
* improve attacment processing
* refactor slightly and ensure correct url is used for existing attachments
* add test
* Fixing a build issue.
* update tests
* some lint
* remove cursed backend-core test util
* addressing pr comments
* refactoring nasty automationUtils upload code
* remove uneeded check
* use basneeame for fallback filename
* add a test to ensure coverage of single attachment column type
* fail early when fetching object metadata
---------
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2024-05-09 14:30:56 +01:00
4c6629d15f
Merge remote-tracking branch 'origin/master' into feature/filter-bindings
2024-05-09 11:05:58 +01:00
21ce586d93
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 17:04:34 +01:00
5783ee790f
Fix Lucene tests.
2024-05-08 15:36:26 +01:00
264ce5e272
Merge branch 'master' into search-tests-boolean
2024-05-08 14:20:36 +01:00
1d300c2577
Remove aws sdk global mock and update tests ( #13637 )
...
* Remove aws sdk global mock and update tests
* add awaits
* Minio healthcheck in tests.
* Bind to 127.0.0.1 instead of 0.0.0.0
* Fix port fetching for minio container.
* Actually fix port mapping this time.
* Pull minio container before running tests.
* Enable testcontainers debug logging.
* Promote minio container to always running in tests, like CouchDB.
* Remove testcontainers debug logging.
---------
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-05-08 14:08:34 +01:00
2e8b655417
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-05-08 12:36:42 +01:00
42a5d3d0e0
Merge branch 'master' into feature/filter-bindings
2024-05-08 10:22:45 +01:00
a2d4f8523c
Some typing improvements, as well as getting deletion/setup working a bit better.
2024-05-07 18:27:47 +01:00
946bd0ef7d
Fix lucene.spec.ts.
2024-05-07 17:11:05 +01:00
3bc1e6b387
Fix behaviour of 'when filter empty' for empty and notEmpty filter types.
2024-05-07 16:46:54 +01:00
32bd505ef9
Respond to PR feedback.
2024-05-07 10:38:47 +01:00
070659c7b1
Fixing an issue with typing + wrong parameter being passed to the direct Couch call functionality.
2024-05-03 18:00:43 +01:00
27e68f79f5
Remove extraneous comment.
2024-05-03 17:34:03 +01:00
1777f1f8fe
Fix boolean searching for Lucene/SQS
2024-05-03 17:29:20 +01:00
3823ffa4fd
Ensure snippet context is disabled by default in test. Add override for search
2024-05-02 17:59:55 +01:00
5e7d1169f7
Minor refactor to accomodate testing with snippets. More test cases for multiple binding types
2024-05-02 16:26:09 +01:00
70c6d56c1e
Merge branch 'feat/budi-8123-single-user' into budi-8123/single-user-column-type
2024-05-02 12:06:42 +01:00
6570b2efcc
Remove unused packages from backend-core
2024-05-01 11:38:59 +01:00
7f1500ac86
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-26 15:48:40 +01:00
dd02224806
Restart testcontainers every day, and add a script to kill them.
2024-04-26 14:01:52 +01:00
1c4fc21870
Lint
2024-04-25 16:36:47 +02:00
e0216bb00c
Lint
2024-04-25 13:20:59 +02:00
d63c5830e5
Typings
2024-04-25 13:20:59 +02:00
2187d25711
Revert "Changing client library to be retrieved via pre-signed URL for Cloud"
2024-04-24 17:12:36 +01:00
f76abb0ca9
Getting rid of linting error.
2024-04-24 15:59:11 +01:00
849253faba
Bringing back the old mechanism of returning the client library through a pre-signed URL, rather than always serving through the service.
2024-04-24 15:37:47 +01:00
6ff00135bf
Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup
2024-04-22 17:22:53 +01:00
a4c0328c53
REST file handling and SMTP automation block attachments ( #13403 )
...
* handle files in rest connector
* fetch presigned url and return
* further updates to handle files in rest connector
* remove unused important and fix extension bug
* wrong expiry param
* tests
* add const for temp bucket
* handle ttl on bucket
* more bucket ttl work
* split out fileresponse and xmlresponse into utils
* lint
* remove log
* fix tests
* some pr comments
* update function naming and lint
* adding back needed response for frontend
* use fsp
* handle different content-disposition and potential path traversal
* add test container for s3 / minio
* add test case for filename* and ascii filenames
* move tests into separate describe
* remove log
* up timeout
* switch to minio image instead of localstack
* use minio image instead of s3 for testing
* stream file upload instead
* use streamUpload and update signatures
* update bucketcreate return
* throw real error
* tidy up
* pro
* pro ref fix?
* pro fix
* pro fix?
* move minio test provider to backend-core
* update email builder to allow attachments
* testing for sending files via smtp
* use backend-core minio test container in server
* handle different types of url
* fix minio test provider
* test with container host
* lint
* try different hostname?
* Revert "try different hostname?"
This reverts commit cfefdb8ded#13539 )
* Updating TTL handling in upload functions
* describe ttl type
* account for ttl creation in existing buckets and update types
* fix tests
* pro
* pro
2024-04-22 15:30:57 +00:00
8189952f0b
Adding implementation to DB for purge and cleanup APIs of SQS, to make sure the DB is cleared of any unused tables or rows.
2024-04-19 18:03:38 +01:00
8bb6956925
Merge branch 'master' of github.com:Budibase/budibase into fix-oidc-error-logging
2024-04-19 13:29:21 +01:00
6bdc726d55
Allow a displayName to be passed when creating admin user ( #13516 )
...
* Allow a displayName to be passed when creating admin user
* Set the first and last names
* Don't format handlebars files on save
* Use familyName and givenName
2024-04-18 12:52:00 +00:00
f12e654811
Merge branch 'master' into chore/remove-disabling-nounusedvars
2024-04-17 15:49:35 +02:00
25dba0be35
This removes the SearchQuery which was a duplication of the SearchFilters interface - the duplicated types were not correctly getting overlay on each other, causing build errors.
2024-04-17 13:54:23 +01:00
a88924a418
Remove // eslint-disable-next-line no-unused-vars
2024-04-17 12:24:41 +02:00
ec93ea59c1
Remove // eslint-disable-next-line @typescript-eslint/no-unused-vars
2024-04-17 12:17:03 +02:00
ca158c33e8
DRY
2024-04-17 10:33:20 +02:00
6e4a66b2e1
Initial implementation of generating SQS junction table definitions.
2024-04-11 18:19:47 +01:00
c190a9983f
Merge branch 'master' into fix-oidc-error-logging
2024-04-11 17:01:04 +01:00
4a6e1b7192
fix all cases of lint rule
2024-04-10 17:39:12 +01:00
20da8bb816
Adding support for SQS prepared statement API.
2024-04-10 17:36:57 +01:00
c5580b4767
Get SQS plumbing working in tests.
2024-04-09 15:31:32 +01:00
efe66186f4
Last PR comment - fixing issue with lucene test case.
2024-04-09 12:37:03 +01:00
5f44b98b7f
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-05 16:36:36 +01:00
86150c58ce
Fixing issue with BB_ADMIN environment variables for user creation introduced by user password becoming optional. Adding a test case as well to cover this to avoid it breaking in future.
2024-04-05 12:14:51 +01:00
d11c316572
Merge branch 'master' of github.com:Budibase/budibase into labday/sqs
2024-04-04 15:02:25 +01:00
Hector Valcarcel
mike12345567
Sam Rose
Adria Navarro
deanhannigan
Peter Clement
melohagan
Martin McKeaveney