Commit Graph

3467 Commits

Author SHA1 Message Date
mike12345567 3b310b188e Fixing issue with column quoting. 2024-05-24 17:52:40 +01:00
mike12345567 b18ca2670a Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs 2024-05-24 12:22:20 +01:00
Michael Drury a3d2871330
Merge branch 'master' into feature/audit-log-sqs 2024-05-23 16:52:50 +01:00
mike12345567 66686fd970 Making sure all JSON column types are correctly handled. 2024-05-23 15:00:13 +01:00
mike12345567 0c28d05d40 Some work to correctly handle JSON columns from SQS as well. 2024-05-23 14:57:38 +01:00
mike12345567 99536c2d0b PR comments. 2024-05-23 14:24:49 +01:00
Adria Navarro e169454490 Move utils to backend-core 2024-05-23 14:59:51 +02:00
mike12345567 ff8684d9b4 Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs 2024-05-22 15:23:24 +01:00
mike12345567 a2200a38fb Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs 2024-05-20 14:09:57 +01:00
mike12345567 d1b6a542fa Getting audit log searching with sqs working - a bit more work than expected but fixed quite a few SQS bugs along the way. 2024-05-17 20:26:34 +01:00
mike12345567 d7f3109a22 Making sqlite design doc generation more accessible. 2024-05-17 12:35:31 +01:00
Adria Navarro 19cb7b83e0
Merge branch 'master' into BUDI-8248/reduce-googleapi-calls 2024-05-17 12:28:28 +02:00
Adria Navarro 7807b734bb Persist googlesheet refs in context 2024-05-17 12:07:28 +02:00
mike12345567 0efa1f06ab Moving some stuff around to make way for other services using the sql layers. 2024-05-16 17:33:47 +01:00
mike12345567 647a8c2a74 Final fix for remove function. 2024-05-16 13:52:38 +01:00
mike12345567 06d6d84b55 Addressing PR comments. 2024-05-16 13:27:54 +01:00
mike12345567 aa51db20ee Changing how cleanup works - the cleanup is now part of the DB deletion, making sure it cannot be missed. 2024-05-14 15:41:48 +01:00
mike12345567 673211dfbb Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-14 14:38:00 +01:00
mike12345567 39147b80b6 PR comments. 2024-05-14 11:23:50 +01:00
mike12345567 5b5e7e47a2 Fixing some issues with updating rows with attachments, there were some UI bugs that had been raised (undefined being displayed) and the uploading from a URL was not working as expected, due to the stream not matching the expected format of the S3 SDK - this has been fixed by converting the stream to a true readable stream with . 2024-05-13 18:11:40 +01:00
mike12345567 a8e0443cf7 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-13 14:01:14 +01:00
mike12345567 f25703b88e Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-13 13:54:00 +01:00
Adria Navarro 2c68c3ffb1 Merge branch 'master' into chore/remove-unused-packages 2024-05-13 14:38:46 +02:00
Adria Navarro 4bec2a3a48
Merge branch 'master' into feat/budi-8123-single-user 2024-05-13 10:53:49 +02:00
mike12345567 10608f9bb7 Final final fix. 2024-05-10 11:59:11 +01:00
mike12345567 de2d0e6b89 Adding error field. 2024-05-10 11:51:57 +01:00
mike12345567 1aa89c61b6 One small change to keep 404 functionality on destroy DB. 2024-05-10 11:32:57 +01:00
mike12345567 76449782b5 Fixes an issue with fetch information being passed up from DatabaseImpl, making sure errors are fully sanitised. 2024-05-10 11:27:49 +01:00
mike12345567 a3d079f847 Fixing an issue with cleanup, making sure the correct app is cleaned up on deletion. 2024-05-09 18:33:29 +01:00
mike12345567 fd7f6455bd Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-09 17:38:24 +01:00
Adria Navarro d83e5e21f2
Merge branch 'master' into feat/budi-8123-single-user 2024-05-09 18:05:16 +02:00
deanhannigan c1874f3376
Merge branch 'master' into feature/filter-bindings 2024-05-09 14:34:07 +01:00
Peter Clement db273bcd36
Support attachment columns in Automations (#13567)
* base work to support attachments in create / update row

* handle single attachment column

* fix tests

* pro

* fix some types

* handle case where file exists in storage

* improve attacment processing

* refactor slightly and ensure correct url is used for existing attachments

* add test

* Fixing a build issue.

* update tests

* some lint

* remove cursed backend-core test util

* addressing pr comments

* refactoring nasty automationUtils upload code

* remove uneeded check

* use basneeame for fallback filename

* add a test to ensure coverage of single attachment column type

* fail early when fetching object metadata

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2024-05-09 14:30:56 +01:00
Dean 4c6629d15f Merge remote-tracking branch 'origin/master' into feature/filter-bindings 2024-05-09 11:05:58 +01:00
mike12345567 21ce586d93 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-08 17:04:34 +01:00
Sam Rose 5783ee790f
Fix Lucene tests. 2024-05-08 15:36:26 +01:00
Sam Rose 264ce5e272
Merge branch 'master' into search-tests-boolean 2024-05-08 14:20:36 +01:00
Peter Clement 1d300c2577
Remove aws sdk global mock and update tests (#13637)
* Remove aws sdk global mock and update tests

* add awaits

* Minio healthcheck in tests.

* Bind to 127.0.0.1 instead of 0.0.0.0

* Fix port fetching for minio container.

* Actually fix port mapping this time.

* Pull minio container before running tests.

* Enable testcontainers debug logging.

* Promote minio container to always running in tests, like CouchDB.

* Remove testcontainers debug logging.

---------

Co-authored-by: Sam Rose <hello@samwho.dev>
2024-05-08 14:08:34 +01:00
mike12345567 2e8b655417 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-08 12:36:42 +01:00
deanhannigan 42a5d3d0e0
Merge branch 'master' into feature/filter-bindings 2024-05-08 10:22:45 +01:00
mike12345567 a2d4f8523c Some typing improvements, as well as getting deletion/setup working a bit better. 2024-05-07 18:27:47 +01:00
Sam Rose 946bd0ef7d
Fix lucene.spec.ts. 2024-05-07 17:11:05 +01:00
Sam Rose 3bc1e6b387
Fix behaviour of 'when filter empty' for empty and notEmpty filter types. 2024-05-07 16:46:54 +01:00
Sam Rose 32bd505ef9
Respond to PR feedback. 2024-05-07 10:38:47 +01:00
mike12345567 070659c7b1 Fixing an issue with typing + wrong parameter being passed to the direct Couch call functionality. 2024-05-03 18:00:43 +01:00
Sam Rose 27e68f79f5
Remove extraneous comment. 2024-05-03 17:34:03 +01:00
Sam Rose 1777f1f8fe
Fix boolean searching for Lucene/SQS 2024-05-03 17:29:20 +01:00
Dean 3823ffa4fd Ensure snippet context is disabled by default in test. Add override for search 2024-05-02 17:59:55 +01:00
Dean 5e7d1169f7 Minor refactor to accomodate testing with snippets. More test cases for multiple binding types 2024-05-02 16:26:09 +01:00
Adria Navarro 70c6d56c1e Merge branch 'feat/budi-8123-single-user' into budi-8123/single-user-column-type 2024-05-02 12:06:42 +01:00
Adria Navarro 6570b2efcc Remove unused packages from backend-core 2024-05-01 11:38:59 +01:00
mike12345567 7f1500ac86 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-04-26 15:48:40 +01:00
Sam Rose dd02224806
Restart testcontainers every day, and add a script to kill them. 2024-04-26 14:01:52 +01:00
Adria Navarro 1c4fc21870 Lint 2024-04-25 16:36:47 +02:00
Adria Navarro e0216bb00c Lint 2024-04-25 13:20:59 +02:00
Adria Navarro d63c5830e5 Typings 2024-04-25 13:20:59 +02:00
Michael Drury 2187d25711
Revert "Changing client library to be retrieved via pre-signed URL for Cloud" 2024-04-24 17:12:36 +01:00
mike12345567 f76abb0ca9 Getting rid of linting error. 2024-04-24 15:59:11 +01:00
mike12345567 849253faba Bringing back the old mechanism of returning the client library through a pre-signed URL, rather than always serving through the service. 2024-04-24 15:37:47 +01:00
mike12345567 6ff00135bf Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-04-22 17:22:53 +01:00
Peter Clement a4c0328c53
REST file handling and SMTP automation block attachments (#13403)
* handle files in rest connector

* fetch presigned url and return

* further updates to handle files in rest connector

* remove unused important and fix extension bug

* wrong expiry param

* tests

* add const for temp bucket

* handle ttl on bucket

* more bucket ttl work

* split out fileresponse and xmlresponse into utils

* lint

* remove log

* fix tests

* some pr comments

* update function naming and lint

* adding back needed response for frontend

* use fsp

* handle different content-disposition and potential path traversal

* add test container for s3 / minio

* add test case for filename* and ascii filenames

* move tests into separate describe

* remove log

* up timeout

* switch to minio image instead of localstack

* use minio image instead of s3 for testing

* stream file upload instead

* use streamUpload and update signatures

* update bucketcreate return

* throw real error

* tidy up

* pro

* pro ref fix?

* pro fix

* pro fix?

* move minio test provider to backend-core

* update email builder to allow attachments

* testing for sending files via smtp

* use backend-core minio test container in server

* handle different types of url

* fix minio test provider

* test with container host

* lint

* try different hostname?

* Revert "try different hostname?"

This reverts commit cfefdb8ded.

* fix issue with fetching of signed url with test minio

* update autoamtion attachments to take filename and url

* fix tests

* pro ref

* fix parsing of url object

* pr comments and linting

* pro ref

* fix pro again

* fix pro

* account-portal

* fix null issue

* fix ref

* ref

* When sending a file attachment in email fetch it directly from our object store

* add more checks to ensure we're working with a signed url

* update test to account for direct object store read

* formatting

* fix time issues within test

* update bucket and path extraction to regex

* use const in regex

* pro

* Updating TTL handling in upload functions (#13539)

* Updating TTL handling in upload functions

* describe ttl type

* account for ttl creation in existing buckets and update types

* fix tests

* pro

* pro
2024-04-22 15:30:57 +00:00
mike12345567 8189952f0b Adding implementation to DB for purge and cleanup APIs of SQS, to make sure the DB is cleared of any unused tables or rows. 2024-04-19 18:03:38 +01:00
mike12345567 8bb6956925 Merge branch 'master' of github.com:Budibase/budibase into fix-oidc-error-logging 2024-04-19 13:29:21 +01:00
melohagan 6bdc726d55
Allow a displayName to be passed when creating admin user (#13516)
* Allow a displayName to be passed when creating admin user

* Set the first and last names

* Don't format handlebars files on save

* Use familyName and givenName
2024-04-18 12:52:00 +00:00
Adria Navarro f12e654811
Merge branch 'master' into chore/remove-disabling-nounusedvars 2024-04-17 15:49:35 +02:00
mike12345567 25dba0be35 This removes the SearchQuery which was a duplication of the SearchFilters interface - the duplicated types were not correctly getting overlay on each other, causing build errors. 2024-04-17 13:54:23 +01:00
Adria Navarro a88924a418 Remove // eslint-disable-next-line no-unused-vars 2024-04-17 12:24:41 +02:00
Adria Navarro ec93ea59c1 Remove // eslint-disable-next-line @typescript-eslint/no-unused-vars 2024-04-17 12:17:03 +02:00
Adria Navarro ca158c33e8 DRY 2024-04-17 10:33:20 +02:00
mike12345567 6e4a66b2e1 Initial implementation of generating SQS junction table definitions. 2024-04-11 18:19:47 +01:00
Michael Drury c190a9983f
Merge branch 'master' into fix-oidc-error-logging 2024-04-11 17:01:04 +01:00
Martin McKeaveney 4a6e1b7192 fix all cases of lint rule 2024-04-10 17:39:12 +01:00
mike12345567 20da8bb816 Adding support for SQS prepared statement API. 2024-04-10 17:36:57 +01:00
Sam Rose c5580b4767
Get SQS plumbing working in tests. 2024-04-09 15:31:32 +01:00
mike12345567 efe66186f4 Last PR comment - fixing issue with lucene test case. 2024-04-09 12:37:03 +01:00
mike12345567 5f44b98b7f Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-05 16:36:36 +01:00
mike12345567 86150c58ce Fixing issue with BB_ADMIN environment variables for user creation introduced by user password becoming optional. Adding a test case as well to cover this to avoid it breaking in future. 2024-04-05 12:14:51 +01:00
mike12345567 d11c316572 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-04 15:02:25 +01:00
Sam Rose 79184e70af
Remove CONTAINER_NAMESPACE, it wasn't the solution. 2024-04-03 12:32:29 +01:00
Sam Rose 258226ddef
Better error message when multiple images are found. 2024-04-03 11:40:14 +01:00
Sam Rose 8cffdeda56
Re-use containers and create namespaces for each test. 2024-04-03 11:33:39 +01:00
Sam Rose 3dff4bf334
Fix lint. 2024-04-03 11:20:43 +01:00
Sam Rose e3fbce25fa
Merge branch 'master' of github.com:budibase/budibase into reuse-containers 2024-04-03 11:15:11 +01:00
mike12345567 9b8b422f1b Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-03 10:16:23 +01:00
mike12345567 8c326b501b Adding support for oneOf ID search of users, today the relationship picker attempts to use this for the users table, but it was not supported. 2024-04-02 17:12:31 +01:00
mike12345567 5e186b5c8a Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-02 12:05:34 +01:00
mike12345567 4c755b3af3 Improving typing around search, there was duplicates of SearchParams and SearchResponse - which were a little different, bring all of this together under the types library. 2024-03-28 17:57:37 +00:00
Sam Rose 90cfdd661d
Rework how we connect to containers. 2024-03-28 17:36:26 +00:00
Martin McKeaveney 32a5ce24ec remove automatic ssoId generation 2024-03-28 15:46:43 +00:00
José Vte. Calderón b5e0bd1aad
Merge branch 'master' into feature/update-global-user 2024-03-28 12:05:29 +01:00
jvcalderon b77106480e Adds POST /api/global/users/sso endpoint 2024-03-28 11:46:58 +01:00
Sam Rose 204b16876a
Run yarn lint:fix 2024-03-27 16:46:11 +00:00
Sam Rose 831c174362
Give SQL integrations their own database when fetching a new datasource. 2024-03-27 15:25:37 +00:00
mike12345567 de518de8fa Merging issue with static index. 2024-03-26 12:53:45 +00:00
Sam Rose 6ee8f421a5
Merge branch 'master' of github.com:budibase/budibase into remove-jest-testcontainers 2024-03-26 10:05:21 +00:00
Sam Rose 415b27a008
Don't need a globalTeardown, testcontainers handles the removal of containers. 2024-03-26 10:00:34 +00:00
Sam Rose 5d7cd511b5
Correct path to global functions in jest.config.ts. 2024-03-26 09:51:10 +00:00
Sam Rose f3e9e3d35e
Share a single globalSetup/globalTeardown. 2024-03-26 09:49:33 +00:00
Sam Rose afacee978d
Add missing environment vars for backend-core tests. 2024-03-25 17:40:46 +00:00
Sam Rose 0dba0cebc7
Remove CouchDB container name. 2024-03-25 17:26:15 +00:00