Commit Graph

3997 Commits

Author SHA1 Message Date
Sam Rose cd98882127
Move secrets into backend-core. 2024-07-03 16:30:23 +01:00
Adria Navarro e74847585e
Merge branch 'master' into BUDI-8416/allow-updating-email-via-scim 2024-07-03 15:59:47 +02:00
Adria Navarro 8fd2cce093 Remove platform user on remove 2024-07-03 15:52:48 +02:00
mike12345567 cb41e4d5a1 Fix for CouchDB integration, the typing in it was very poor and wise hiding issues, I've updated how this is implemented so that static typing can catch issues with it. 2024-07-03 12:50:33 +01:00
mike12345567 cb50cca40b Stripping credentials from Couch URLs + test cases. 2024-07-03 11:25:21 +01:00
Adria Navarro 19e4e8fdb4 Allow updating email 2024-07-03 12:18:06 +02:00
Adria Navarro 3ed9c9a4a5 Test 2024-07-03 12:15:56 +02:00
Adria Navarro 88e054c366 Basic update test 2024-07-03 12:06:37 +02:00
Adria Navarro 4ddd450a89 More tests 2024-07-03 11:59:12 +02:00
Adria Navarro 8372632579 Add extra tests 2024-07-03 11:14:30 +02:00
Adria Navarro 6510a47c06 Add basic userDB.save test 2024-07-03 11:10:51 +02:00
Adria Navarro ae4cfd7b47 Fix pouchdb-replication-stream vulnerability 2024-07-02 15:23:47 +02:00
Michael Drury c1f7561839
Merge branch 'master' into fix/sqs-internal-columns 2024-06-27 18:19:03 +01:00
mike12345567 3394e974d3 Getting casting working again, have to pass down prefix for checking against fields. 2024-06-27 18:18:41 +01:00
Michael Drury cfeab17ed8
Revert "Revert "Disallow prohibited columns"" 2024-06-26 12:40:16 +01:00
Michael Drury 9c92b8eff9
Merge branch 'master' into sustaining/typescript-5.5.2 2024-06-26 11:03:01 +01:00
Sam Rose 314d62bea0
Revert "Disallow prohibited columns" 2024-06-25 14:29:56 +01:00
melohagan 4ac9b657e5
Remove deprecated properties (#13958)
* Remove deprecated properties

* Fix backend-core test

* Don't run account-portal tests

* Update account-portal ref

* Run account portal unit tests

* Revert "Run account portal unit tests"

This reverts commit b509bf31a4.

* Revert "Update account-portal ref"

This reverts commit 186391fbb6.
2024-06-25 08:26:52 +01:00
mike12345567 a7b995e2ad Merge branch 'master' of github.com:Budibase/budibase into sustaining/typescript-5.5.2 2024-06-24 18:05:32 +01:00
Sam Rose bb91849976
Merge branch 'master' into budi-8390-receiving-a-column-has-been-specified-more-than-once-in-the 2024-06-24 17:32:26 +01:00
Sam Rose 58d8f2bb64
Respond to PR feedback. 2024-06-24 17:30:10 +01:00
Sam Rose da1eb6f6ac
Fix primary key appearing twice in the SQL ORDER BY clause. 2024-06-24 17:09:27 +01:00
mike12345567 ebf8f54bb7 Upgrading to Typescript 5.5.2 2024-06-24 16:41:28 +01:00
Sam Rose 01b2f69b74
Merge branch 'master' of github.com:budibase/budibase into budi-8220-support-updating-existing-rows-for-external-databases-using-2 2024-06-24 15:51:03 +01:00
Michael Drury 0d946e7be3
Merge branch 'master' into fix/relationship-filtering-table-or-column 2024-06-24 14:35:30 +01:00
Peter Clement aefe46b253
Adds _id and _rev back to internal datasource filter options (#13977)
* Adds _id and _rev back to internal datasource filter options

* add bb default datasource const into shared-core

* re-export var from shared-core
2024-06-24 14:31:27 +01:00
mike12345567 1402716f5c Some type updates. 2024-06-24 13:10:30 +01:00
Sam Rose f4378bd561
Merge branch 'master' of github.com:budibase/budibase into budi-8220-support-updating-existing-rows-for-external-databases-using-2 2024-06-21 13:08:39 +01:00
mike12345567 def3b0260e Disallowing prohibited columns consistently, no matter the case, and backend validation for this as well. 2024-06-20 18:48:22 +01:00
mike12345567 67c00c9e4c Addressing PR comments. 2024-06-19 18:46:48 +01:00
Sam Rose 602faf1c67
Add test for composite primary keys for external datasource imports. 2024-06-19 17:52:48 +01:00
mike12345567 2aa911b217 re-jigging things to get counting working properly again. 2024-06-19 17:10:15 +01:00
mike12345567 2d74927177 updating how counting disables sorting. 2024-06-19 15:08:12 +01:00
mike12345567 1056efdbf6 Changing how counting occurs in SQL layer. 2024-06-19 14:56:06 +01:00
Michael Drury 223df424fc
Merge branch 'master' into feature/count-rows-to-return 2024-06-19 14:20:31 +01:00
mike12345567 bdbb4c0a66 Commenting on a bug in knex 2024-06-19 13:59:03 +01:00
mike12345567 0de94d3535 Addressing some PR comments. 2024-06-19 11:52:50 +01:00
mike12345567 e0d8a66fd8 Adding test cases for counting as well as some small fixes. 2024-06-18 18:44:17 +01:00
Sam Rose e288fc8795
Disable upserting for MSSQL in bulkImport for now. 2024-06-18 18:02:20 +01:00
Sam Rose 5ac8a7d514
bulkImport upsert working everywhere excpet mssql 2024-06-18 17:43:25 +01:00
mike12345567 5c45370722 Fixing an issue with the sort order not being deterministic consistently. 2024-06-18 13:39:10 +01:00
mike12345567 278242fb55 Moving limits and offsets back into pre-query. 2024-06-18 12:47:59 +01:00
mike12345567 03b82c0923 Merge branch 'master' of github.com:Budibase/budibase into feature/count-rows-to-return 2024-06-17 13:41:40 +01:00
Sam Rose 6516a01657
Merge branch 'master' into uncomment-search-test-todos 2024-06-17 13:34:53 +01:00
melohagan 9ecf82e0f6
Add endpoint to GET tenant info from tenant global DB. (#13923)
* Add GET tenant info endpoint

* Add GET global tenant to endpoint list.

* Use correct not found code

* Fix unit test

* Code review comments

* Ignore account portal check types

* remove account-portal-ui from type check ignore

* Remove ignore account-portal-ui from type check
2024-06-17 09:22:44 +00:00
mike12345567 1b36d8af51 Getting counting flow working correctly for external datasources. 2024-06-14 19:00:59 +01:00
mike12345567 e402f9c571 Merge branch 'uncomment-search-test-todos' of github.com:Budibase/budibase into feature/count-rows-to-return 2024-06-14 18:16:47 +01:00
mike12345567 77556820bf Bit more work towards row counting, as well as moving external SQL to use row + 1 for working out pagination. 2024-06-14 18:12:36 +01:00
Sam Rose a54048e308
Solve all remaining TODOs in search.spec.ts. 2024-06-14 14:57:31 +01:00
mike12345567 2c6262844b Some work to limiting, changing how limiting works for pagination so that filtering on relationships doesn't cause problems. 2024-06-14 14:35:35 +01:00
Sam Rose c27e9c266c
Replace SortDirection with SortOrder, SortDirection is being removed. 2024-06-14 09:45:30 +01:00
Sam Rose a140a002e2
Merge branch 'master' of github.com:budibase/budibase into fix/aws-session-token-s3-ver2 2024-06-11 18:04:40 +01:00
Michael Drury 869c7e546a
Merge branch 'master' into disable-app-migration-cache 2024-06-11 13:17:16 +01:00
melohagan 115737c46c
Create Tenant endpoint + tenant_info doc (#13902)
* Create Tenant endpoint + tenant_info doc

* Don't catch on tenant_info put

* PR comments

* unit test
2024-06-11 12:16:15 +01:00
mike12345567 334334bbcd Adding a check for QA. 2024-06-11 12:13:18 +01:00
mike12345567 75c3b842ad Fixing issue with in memory queue. 2024-06-10 23:34:08 +01:00
mike12345567 1bd5a41712 Setting debug properly 2024-06-10 15:29:32 +01:00
mike12345567 fe789e7462 Adding test containers debug. 2024-06-10 15:17:01 +01:00
Hector Valcarcel 65c2039d0c Chore: Allow using an AWS_SESSION_TOKEN for object storage with AWS S3 2024-06-10 11:48:54 +01:00
mike12345567 ee391b30d6 Fixing an issue with multi-tenant app migration failures - the app migration context wasn't getting the tenant ID as needed. Also added some better logging as well as cleaning up the queues properly to remove these dud events. 2024-06-07 22:50:06 +01:00
Michael Drury b76d535202
Merge branch 'master' into BUDI-7656/add-migration 2024-06-07 10:24:50 +01:00
mike12345567 ab6614a683 Capturing any 500s which occur from SQS cleanup - it appears to 500 if there is nothing to do. 2024-06-06 17:38:52 +01:00
Michael Drury ea1d3000c2
Merge branch 'master' into BUDI-7656/add-migration 2024-06-06 16:49:48 +01:00
mike12345567 70aa43680d Addressing PR comments. 2024-06-06 16:49:03 +01:00
mike12345567 2c86ea14fd Changing how disk cleanup is performed. 2024-06-06 15:07:06 +01:00
Sam Rose ac53a97176
WIP 2024-06-06 14:55:07 +01:00
mike12345567 4f6076d2ba Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration 2024-06-05 16:29:45 +01:00
mike12345567 cf6f86cb2f Updating migrations to correctly cover all the required elements. 2024-06-04 17:24:11 +01:00
mike12345567 e3b1655ad0 Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration 2024-06-04 12:56:59 +01:00
Adria Navarro a562655361
Merge branch 'master' into feat/readonly-columns 2024-06-04 12:04:49 +02:00
Adria Navarro 2d953f19cc Clean validation message 2024-06-04 11:11:50 +02:00
mike12345567 155de99b68 Streaming to disk before passing onto S3. 2024-06-03 11:46:20 +01:00
mike12345567 75501c2251 Updating object store stream upload to make sure the stream has finished being processed before trying to upload to AWS (and only uploading a partial stream). 2024-05-31 17:57:31 +01:00
mike12345567 f3d1a8aabc Merge branch 'master' of github.com:Budibase/budibase into BUDI-7656/add-migration 2024-05-29 17:20:29 +01:00
Michael Drury aa232db669
Merge branch 'master' into fix/template-app-rows 2024-05-29 15:06:09 +01:00
Adria Navarro f5f471a4aa Merge branch 'master' into BUDI-8284/readonly-settings-columns-in-views 2024-05-29 15:41:20 +02:00
mike12345567 6b7a4f07cb Quick fix for ambiguous column names _id. 2024-05-29 11:56:52 +01:00
mike12345567 83fa6f952a re-jigging, making this part of filters rather than meta. 2024-05-28 18:34:08 +01:00
mike12345567 cb99007a42 Fix for issue with templated apps - some template apps are *very* old and therefore don't necessarily abide by the rules that are generally followed for new apps, this is something we should resolve, but for now adding an option that allows searching for only a specific document type. 2024-05-28 18:30:06 +01:00
Adria Navarro 422b1e2753 Fix tests 2024-05-27 14:31:45 +02:00
mike12345567 3b310b188e Fixing issue with column quoting. 2024-05-24 17:52:40 +01:00
mike12345567 b18ca2670a Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs 2024-05-24 12:22:20 +01:00
Michael Drury a3d2871330
Merge branch 'master' into feature/audit-log-sqs 2024-05-23 16:52:50 +01:00
mike12345567 66686fd970 Making sure all JSON column types are correctly handled. 2024-05-23 15:00:13 +01:00
mike12345567 0c28d05d40 Some work to correctly handle JSON columns from SQS as well. 2024-05-23 14:57:38 +01:00
mike12345567 99536c2d0b PR comments. 2024-05-23 14:24:49 +01:00
Adria Navarro e169454490 Move utils to backend-core 2024-05-23 14:59:51 +02:00
mike12345567 ff8684d9b4 Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs 2024-05-22 15:23:24 +01:00
mike12345567 a2200a38fb Merge branch 'master' of github.com:Budibase/budibase into feature/audit-log-sqs 2024-05-20 14:09:57 +01:00
mike12345567 d1b6a542fa Getting audit log searching with sqs working - a bit more work than expected but fixed quite a few SQS bugs along the way. 2024-05-17 20:26:34 +01:00
mike12345567 d7f3109a22 Making sqlite design doc generation more accessible. 2024-05-17 12:35:31 +01:00
Adria Navarro 19cb7b83e0
Merge branch 'master' into BUDI-8248/reduce-googleapi-calls 2024-05-17 12:28:28 +02:00
Adria Navarro 7807b734bb Persist googlesheet refs in context 2024-05-17 12:07:28 +02:00
mike12345567 0efa1f06ab Moving some stuff around to make way for other services using the sql layers. 2024-05-16 17:33:47 +01:00
mike12345567 647a8c2a74 Final fix for remove function. 2024-05-16 13:52:38 +01:00
mike12345567 06d6d84b55 Addressing PR comments. 2024-05-16 13:27:54 +01:00
mike12345567 aa51db20ee Changing how cleanup works - the cleanup is now part of the DB deletion, making sure it cannot be missed. 2024-05-14 15:41:48 +01:00
mike12345567 673211dfbb Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-14 14:38:00 +01:00
mike12345567 39147b80b6 PR comments. 2024-05-14 11:23:50 +01:00
mike12345567 5b5e7e47a2 Fixing some issues with updating rows with attachments, there were some UI bugs that had been raised (undefined being displayed) and the uploading from a URL was not working as expected, due to the stream not matching the expected format of the S3 SDK - this has been fixed by converting the stream to a true readable stream with . 2024-05-13 18:11:40 +01:00
mike12345567 a8e0443cf7 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-13 14:01:14 +01:00
mike12345567 f25703b88e Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-13 13:54:00 +01:00
Adria Navarro 2c68c3ffb1 Merge branch 'master' into chore/remove-unused-packages 2024-05-13 14:38:46 +02:00
Adria Navarro 4bec2a3a48
Merge branch 'master' into feat/budi-8123-single-user 2024-05-13 10:53:49 +02:00
mike12345567 10608f9bb7 Final final fix. 2024-05-10 11:59:11 +01:00
mike12345567 de2d0e6b89 Adding error field. 2024-05-10 11:51:57 +01:00
mike12345567 1aa89c61b6 One small change to keep 404 functionality on destroy DB. 2024-05-10 11:32:57 +01:00
mike12345567 76449782b5 Fixes an issue with fetch information being passed up from DatabaseImpl, making sure errors are fully sanitised. 2024-05-10 11:27:49 +01:00
mike12345567 a3d079f847 Fixing an issue with cleanup, making sure the correct app is cleaned up on deletion. 2024-05-09 18:33:29 +01:00
mike12345567 fd7f6455bd Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-09 17:38:24 +01:00
Adria Navarro d83e5e21f2
Merge branch 'master' into feat/budi-8123-single-user 2024-05-09 18:05:16 +02:00
deanhannigan c1874f3376
Merge branch 'master' into feature/filter-bindings 2024-05-09 14:34:07 +01:00
Peter Clement db273bcd36
Support attachment columns in Automations (#13567)
* base work to support attachments in create / update row

* handle single attachment column

* fix tests

* pro

* fix some types

* handle case where file exists in storage

* improve attacment processing

* refactor slightly and ensure correct url is used for existing attachments

* add test

* Fixing a build issue.

* update tests

* some lint

* remove cursed backend-core test util

* addressing pr comments

* refactoring nasty automationUtils upload code

* remove uneeded check

* use basneeame for fallback filename

* add a test to ensure coverage of single attachment column type

* fail early when fetching object metadata

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2024-05-09 14:30:56 +01:00
Dean 4c6629d15f Merge remote-tracking branch 'origin/master' into feature/filter-bindings 2024-05-09 11:05:58 +01:00
mike12345567 21ce586d93 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-08 17:04:34 +01:00
Sam Rose 5783ee790f
Fix Lucene tests. 2024-05-08 15:36:26 +01:00
Sam Rose 264ce5e272
Merge branch 'master' into search-tests-boolean 2024-05-08 14:20:36 +01:00
Peter Clement 1d300c2577
Remove aws sdk global mock and update tests (#13637)
* Remove aws sdk global mock and update tests

* add awaits

* Minio healthcheck in tests.

* Bind to 127.0.0.1 instead of 0.0.0.0

* Fix port fetching for minio container.

* Actually fix port mapping this time.

* Pull minio container before running tests.

* Enable testcontainers debug logging.

* Promote minio container to always running in tests, like CouchDB.

* Remove testcontainers debug logging.

---------

Co-authored-by: Sam Rose <hello@samwho.dev>
2024-05-08 14:08:34 +01:00
mike12345567 2e8b655417 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-05-08 12:36:42 +01:00
deanhannigan 42a5d3d0e0
Merge branch 'master' into feature/filter-bindings 2024-05-08 10:22:45 +01:00
mike12345567 a2d4f8523c Some typing improvements, as well as getting deletion/setup working a bit better. 2024-05-07 18:27:47 +01:00
Sam Rose 946bd0ef7d
Fix lucene.spec.ts. 2024-05-07 17:11:05 +01:00
Sam Rose 3bc1e6b387
Fix behaviour of 'when filter empty' for empty and notEmpty filter types. 2024-05-07 16:46:54 +01:00
Sam Rose 32bd505ef9
Respond to PR feedback. 2024-05-07 10:38:47 +01:00
mike12345567 070659c7b1 Fixing an issue with typing + wrong parameter being passed to the direct Couch call functionality. 2024-05-03 18:00:43 +01:00
Sam Rose 27e68f79f5
Remove extraneous comment. 2024-05-03 17:34:03 +01:00
Sam Rose 1777f1f8fe
Fix boolean searching for Lucene/SQS 2024-05-03 17:29:20 +01:00
Dean 3823ffa4fd Ensure snippet context is disabled by default in test. Add override for search 2024-05-02 17:59:55 +01:00
Dean 5e7d1169f7 Minor refactor to accomodate testing with snippets. More test cases for multiple binding types 2024-05-02 16:26:09 +01:00
Adria Navarro 70c6d56c1e Merge branch 'feat/budi-8123-single-user' into budi-8123/single-user-column-type 2024-05-02 12:06:42 +01:00
Adria Navarro 6570b2efcc Remove unused packages from backend-core 2024-05-01 11:38:59 +01:00
mike12345567 7f1500ac86 Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-04-26 15:48:40 +01:00
Sam Rose dd02224806
Restart testcontainers every day, and add a script to kill them. 2024-04-26 14:01:52 +01:00
Adria Navarro 1c4fc21870 Lint 2024-04-25 16:36:47 +02:00
Adria Navarro e0216bb00c Lint 2024-04-25 13:20:59 +02:00
Adria Navarro d63c5830e5 Typings 2024-04-25 13:20:59 +02:00
Michael Drury 2187d25711
Revert "Changing client library to be retrieved via pre-signed URL for Cloud" 2024-04-24 17:12:36 +01:00
mike12345567 f76abb0ca9 Getting rid of linting error. 2024-04-24 15:59:11 +01:00
mike12345567 849253faba Bringing back the old mechanism of returning the client library through a pre-signed URL, rather than always serving through the service. 2024-04-24 15:37:47 +01:00
mike12345567 6ff00135bf Merge branch 'master' of github.com:Budibase/budibase into feature/sqs-table-cleanup 2024-04-22 17:22:53 +01:00
Peter Clement a4c0328c53
REST file handling and SMTP automation block attachments (#13403)
* handle files in rest connector

* fetch presigned url and return

* further updates to handle files in rest connector

* remove unused important and fix extension bug

* wrong expiry param

* tests

* add const for temp bucket

* handle ttl on bucket

* more bucket ttl work

* split out fileresponse and xmlresponse into utils

* lint

* remove log

* fix tests

* some pr comments

* update function naming and lint

* adding back needed response for frontend

* use fsp

* handle different content-disposition and potential path traversal

* add test container for s3 / minio

* add test case for filename* and ascii filenames

* move tests into separate describe

* remove log

* up timeout

* switch to minio image instead of localstack

* use minio image instead of s3 for testing

* stream file upload instead

* use streamUpload and update signatures

* update bucketcreate return

* throw real error

* tidy up

* pro

* pro ref fix?

* pro fix

* pro fix?

* move minio test provider to backend-core

* update email builder to allow attachments

* testing for sending files via smtp

* use backend-core minio test container in server

* handle different types of url

* fix minio test provider

* test with container host

* lint

* try different hostname?

* Revert "try different hostname?"

This reverts commit cfefdb8ded.

* fix issue with fetching of signed url with test minio

* update autoamtion attachments to take filename and url

* fix tests

* pro ref

* fix parsing of url object

* pr comments and linting

* pro ref

* fix pro again

* fix pro

* account-portal

* fix null issue

* fix ref

* ref

* When sending a file attachment in email fetch it directly from our object store

* add more checks to ensure we're working with a signed url

* update test to account for direct object store read

* formatting

* fix time issues within test

* update bucket and path extraction to regex

* use const in regex

* pro

* Updating TTL handling in upload functions (#13539)

* Updating TTL handling in upload functions

* describe ttl type

* account for ttl creation in existing buckets and update types

* fix tests

* pro

* pro
2024-04-22 15:30:57 +00:00
mike12345567 8189952f0b Adding implementation to DB for purge and cleanup APIs of SQS, to make sure the DB is cleared of any unused tables or rows. 2024-04-19 18:03:38 +01:00
mike12345567 8bb6956925 Merge branch 'master' of github.com:Budibase/budibase into fix-oidc-error-logging 2024-04-19 13:29:21 +01:00
melohagan 6bdc726d55
Allow a displayName to be passed when creating admin user (#13516)
* Allow a displayName to be passed when creating admin user

* Set the first and last names

* Don't format handlebars files on save

* Use familyName and givenName
2024-04-18 12:52:00 +00:00
Adria Navarro f12e654811
Merge branch 'master' into chore/remove-disabling-nounusedvars 2024-04-17 15:49:35 +02:00
mike12345567 25dba0be35 This removes the SearchQuery which was a duplication of the SearchFilters interface - the duplicated types were not correctly getting overlay on each other, causing build errors. 2024-04-17 13:54:23 +01:00
Adria Navarro a88924a418 Remove // eslint-disable-next-line no-unused-vars 2024-04-17 12:24:41 +02:00
Adria Navarro ec93ea59c1 Remove // eslint-disable-next-line @typescript-eslint/no-unused-vars 2024-04-17 12:17:03 +02:00
Adria Navarro ca158c33e8 DRY 2024-04-17 10:33:20 +02:00
mike12345567 6e4a66b2e1 Initial implementation of generating SQS junction table definitions. 2024-04-11 18:19:47 +01:00
Michael Drury c190a9983f
Merge branch 'master' into fix-oidc-error-logging 2024-04-11 17:01:04 +01:00
Martin McKeaveney 4a6e1b7192 fix all cases of lint rule 2024-04-10 17:39:12 +01:00
mike12345567 20da8bb816 Adding support for SQS prepared statement API. 2024-04-10 17:36:57 +01:00
Sam Rose c5580b4767
Get SQS plumbing working in tests. 2024-04-09 15:31:32 +01:00
mike12345567 efe66186f4 Last PR comment - fixing issue with lucene test case. 2024-04-09 12:37:03 +01:00
mike12345567 5f44b98b7f Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-05 16:36:36 +01:00
mike12345567 86150c58ce Fixing issue with BB_ADMIN environment variables for user creation introduced by user password becoming optional. Adding a test case as well to cover this to avoid it breaking in future. 2024-04-05 12:14:51 +01:00
mike12345567 d11c316572 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-04 15:02:25 +01:00
Sam Rose 79184e70af
Remove CONTAINER_NAMESPACE, it wasn't the solution. 2024-04-03 12:32:29 +01:00
Sam Rose 258226ddef
Better error message when multiple images are found. 2024-04-03 11:40:14 +01:00
Sam Rose 8cffdeda56
Re-use containers and create namespaces for each test. 2024-04-03 11:33:39 +01:00
Sam Rose 3dff4bf334
Fix lint. 2024-04-03 11:20:43 +01:00
Sam Rose e3fbce25fa
Merge branch 'master' of github.com:budibase/budibase into reuse-containers 2024-04-03 11:15:11 +01:00
mike12345567 9b8b422f1b Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-03 10:16:23 +01:00
mike12345567 8c326b501b Adding support for oneOf ID search of users, today the relationship picker attempts to use this for the users table, but it was not supported. 2024-04-02 17:12:31 +01:00
mike12345567 5e186b5c8a Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-04-02 12:05:34 +01:00
mike12345567 4c755b3af3 Improving typing around search, there was duplicates of SearchParams and SearchResponse - which were a little different, bring all of this together under the types library. 2024-03-28 17:57:37 +00:00
Sam Rose 90cfdd661d
Rework how we connect to containers. 2024-03-28 17:36:26 +00:00
Martin McKeaveney 32a5ce24ec remove automatic ssoId generation 2024-03-28 15:46:43 +00:00
José Vte. Calderón b5e0bd1aad
Merge branch 'master' into feature/update-global-user 2024-03-28 12:05:29 +01:00
jvcalderon b77106480e Adds POST /api/global/users/sso endpoint 2024-03-28 11:46:58 +01:00
Sam Rose 204b16876a
Run yarn lint:fix 2024-03-27 16:46:11 +00:00
Sam Rose 831c174362
Give SQL integrations their own database when fetching a new datasource. 2024-03-27 15:25:37 +00:00
mike12345567 de518de8fa Merging issue with static index. 2024-03-26 12:53:45 +00:00
Sam Rose 6ee8f421a5
Merge branch 'master' of github.com:budibase/budibase into remove-jest-testcontainers 2024-03-26 10:05:21 +00:00
Sam Rose 415b27a008
Don't need a globalTeardown, testcontainers handles the removal of containers. 2024-03-26 10:00:34 +00:00
Sam Rose 5d7cd511b5
Correct path to global functions in jest.config.ts. 2024-03-26 09:51:10 +00:00
Sam Rose f3e9e3d35e
Share a single globalSetup/globalTeardown. 2024-03-26 09:49:33 +00:00
Sam Rose afacee978d
Add missing environment vars for backend-core tests. 2024-03-25 17:40:46 +00:00
Sam Rose 0dba0cebc7
Remove CouchDB container name. 2024-03-25 17:26:15 +00:00
Sam Rose 44d4e496b6
Fix code to pull CouchDB URL out of docker ps. 2024-03-25 17:11:41 +00:00
Sam Rose db21542d38
Cherry-pick 6b8422df01 2024-03-25 15:25:30 +00:00
Sam Rose 66cfb8eedd
Remove jest-testcontainers. 2024-03-25 15:24:14 +00:00
jvcalderon 1da10c9a5f Merge branch 'master' into feature/onboarding 2024-03-25 12:51:57 +01:00
jvcalderon 50c0fb1f97 Override identity for events sent from dispatcher 2024-03-22 10:41:27 +01:00
mike12345567 9995f71871 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-03-20 13:45:27 +00:00
mike12345567 8df38b8bb2 Merging in most recent changes, recent SQL aliasing changes caused some big differences. 2024-03-20 12:42:07 +00:00
Sam Rose 217b39c232
Reenable no-unused-vars 2024-03-20 11:46:39 +00:00
Sam Rose 009c795f54
Reenable no-undefs. 2024-03-19 17:47:39 +00:00
Sam Rose f1278312ab
Reenable no-case-declarations. 2024-03-19 15:58:25 +00:00
Sam Rose f6669c25cf
Merge branch 'master' of github.com:budibase/budibase into reenable-no-case-declarations 2024-03-19 15:53:19 +00:00
Sam Rose 79bba82908
Fix flaky scim test. 2024-03-19 15:45:24 +00:00
Adria Navarro b7b8a65a54 Don't init DocWritethrough queue on load 2024-03-19 16:01:00 +01:00
Mel O'Hagan ff231b0095 Make password optional 2024-03-19 13:30:42 +00:00
Adria Navarro c7276b9005
Merge branch 'master' into BUDI-7656/add-migration 2024-03-19 12:35:39 +01:00
Sam Rose 80008a0739
Reenable no-inner-declarations. 2024-03-19 11:29:19 +00:00
Sam Rose 5749333fc7
Reenable no-useless-escape. 2024-03-19 11:14:16 +00:00
Sam Rose 1785f3af7e
Get lint passing. 2024-03-19 10:55:51 +00:00
Sam Rose 7a63dc9830
Making progress on getting the eslint-jest plugin working. 2024-03-19 10:46:59 +00:00
Sam Rose 1f63f0bddf
Run auto fix. 2024-03-19 09:46:10 +00:00
deanhannigan 7a737e7664
Merge branch 'master' into feature/app-list-actions 2024-03-15 09:31:54 +00:00
deanhannigan 72a671e93b
Merge branch 'master' into feature/app-list-actions 2024-03-15 09:10:57 +00:00
Andrew Kingston b6eab42c18 Merge branch 'cheeks-lab-day-binding-eval' of github.com:Budibase/budibase into cheeks-snippets-poc 2024-03-14 16:24:16 +00:00
Adria Navarro 62cec7289d Use guid instead of words 2024-03-14 11:03:43 +01:00
deanhannigan 1db358d5c2
Merge branch 'master' into feature/app-list-actions 2024-03-14 09:33:33 +00:00
Andrew Kingston 8b4ce703e9 Try to fix tests 2024-03-13 17:01:09 +00:00
Andrew Kingston e45beff059 Merge branch 'master' of github.com:Budibase/budibase into cheeks-snippets-poc 2024-03-13 10:21:07 +00:00
Adria Navarro cc275983dc
Merge branch 'master' into cleanup-isolates 2024-03-13 10:30:37 +01:00
Andrew Kingston 70821182fe Update automation context to simplify applying snippet context 2024-03-13 09:15:33 +00:00
Andrew Kingston 3b54daf2c8 Add snippet context before executing automations 2024-03-12 21:40:48 +00:00
Andrew Kingston 16ce5ac65e Update how snippets are fetched and enriched into context, because HBS helpers can't be async 2024-03-12 17:02:01 +00:00
deanhannigan 66f0deecae
Merge branch 'master' into feature/app-list-actions 2024-03-08 14:44:08 +00:00
Michael Drury 874a6fbd12 Linting. 2024-03-08 12:26:11 +00:00
deanhannigan 460c2573e4
Merge branch 'master' into feature/app-list-actions 2024-03-08 12:24:15 +00:00
Michael Drury 9027e6e82a Initing doc writethrough cache as part of the worker/server init process, as well as part of doc writethrough tests. 2024-03-08 12:20:52 +00:00
Sam Rose 4325b99d7d
Merge branch 'master' of github.com:budibase/budibase into cleanup-isolates 2024-03-07 13:37:31 +00:00
mike12345567 121ad109ec Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-03-07 13:27:21 +00:00
Adria Navarro 74f8c3fce8
Merge branch 'master' into BUDI-8046/scim-logger 2024-03-07 14:24:16 +01:00
Adria Navarro bba26c9184 Change max attempts 2024-03-07 13:58:01 +01:00
Adria Navarro fc7b6f305d Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger 2024-03-07 13:19:40 +01:00
Adria Navarro d75ab4b46c Remove logWarn 2024-03-07 13:14:26 +01:00
Adria Navarro a6666f662c Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger 2024-03-07 11:38:41 +01:00
Adria Navarro 9e55f87d02 Add message 2024-03-07 11:30:59 +01:00
Adria Navarro 536422e60b Undo 2024-03-07 11:23:09 +01:00
Adria Navarro 17b06703e9 Remove lock 2024-03-07 11:16:08 +01:00
Adria Navarro 440dcb244d Infinite retries 2024-03-07 11:11:36 +01:00
Adria Navarro e60033bd89 Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger 2024-03-07 11:05:16 +01:00
Adria Navarro 977daff05c Retry 2024-03-07 10:54:26 +01:00
Adria Navarro bb5b40b61c Lint 2024-03-07 10:35:37 +01:00
Adria Navarro 5df0c85a9b
Merge branch 'master' into BUDI-8064/doc-writethrough 2024-03-07 10:31:33 +01:00
Adria Navarro 1b6954247c Skip test 2024-03-07 10:30:09 +01:00
Adria Navarro d06f9e0a1c Add bulk delete 2024-03-07 00:25:12 +01:00
Adria Navarro 81af85eae0 Expose redis functions 2024-03-07 00:25:04 +01:00
mike12345567 851a423615 Some typing updates to fix some build issues which were occurring. 2024-03-06 18:07:46 +00:00
Sam Rose 6f692723e7
Remove flakiness in SCIM tests. 2024-03-06 17:28:45 +00:00
mike12345567 2eb16a70db Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-03-06 17:27:53 +00:00
Sam Rose 2946188ab1
Merge branch 'master' into enforce-example-com-emails-in-tests 2024-03-06 17:15:43 +00:00
Sam Rose 2c04fa453c
Merge branch 'master' of github.com:budibase/budibase into budi-7710-user-groups-do-not-fully-support-custom-roles-5 2024-03-06 16:58:16 +00:00
Sam Rose 4b24fb7c68
Merge master. 2024-03-06 14:59:39 +00:00
Sam Rose 30c1b07309
Merge master. 2024-03-06 14:53:54 +00:00
Adria Navarro ee86cd30d6
Merge branch 'master' into BUDI-8046/redis-delete-if-value 2024-03-06 15:46:16 +01:00
Adria Navarro a44faad046 Add same key tests 2024-03-06 15:37:38 +01:00
Adria Navarro 4ce85cde1a Simplify, use only queues 2024-03-06 14:07:39 +01:00
Adria Navarro 5109477e52 Fix checks 2024-03-06 13:39:27 +01:00
Adria Navarro baa58990c8
Merge branch 'master' into BUDI-8046/redis-increment 2024-03-06 12:32:51 +01:00
Adria Navarro c198a5ae03
Update packages/backend-core/src/redis/redis.ts
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-03-06 12:23:04 +01:00
Adria Navarro 4baadadaa8 Use pipeline instead of eval 2024-03-06 12:22:20 +01:00
Adria Navarro 61c4b83650 Test with spies 2024-03-06 11:55:49 +01:00
Sam Rose 2b206f2105
Fix the TODO I left myself last night. 2024-03-06 10:00:02 +00:00
Adria Navarro d35d382ddb Increase timeouts 2024-03-06 00:58:05 +01:00
Adria Navarro 8e8378d1be Delete info on process 2024-03-06 00:56:30 +01:00
Adria Navarro a9046e9f26 Use lock name 2024-03-06 00:34:48 +01:00
Adria Navarro 3dbf0b3a64 Throw errors on lock not executed 2024-03-06 00:34:48 +01:00
Adria Navarro 0a2fb4a3a6 Use message id to handle concurrency 2024-03-06 00:34:48 +01:00
Adria Navarro 6707da4ac2 Use bulk 2024-03-06 00:34:48 +01:00
Adria Navarro f5e2dc7a27 Do not use lock 2024-03-06 00:34:48 +01:00
Adria Navarro e584d82e6f Improve redlock non executed response 2024-03-06 00:34:48 +01:00
Adria Navarro 37935112a4 Add comment 2024-03-06 00:34:48 +01:00
Adria Navarro c4fc94fb28 Remove defaults and init 2024-03-06 00:34:48 +01:00
Adria Navarro fb2c7467b0 Clean 2024-03-06 00:34:48 +01:00
Adria Navarro caff2876dd Tests 2024-03-06 00:34:48 +01:00
Adria Navarro 151bfd103b Use bull 2024-03-06 00:34:48 +01:00
Adria Navarro e4d8fe2f47 Add doc-writethrough queue 2024-03-06 00:34:48 +01:00
Adria Navarro 770aff4f5e Type inMemoryQueue 2024-03-06 00:34:48 +01:00
Adria Navarro 3c944073eb Use overloads 2024-03-06 00:34:48 +01:00
Adria Navarro eb78103764 Namespace key in redis by db 2024-03-06 00:34:48 +01:00
Adria Navarro 6bd7e6b374 Namespace key in redis by db 2024-03-06 00:34:47 +01:00
Adria Navarro 608865fe9d Fix types 2024-03-06 00:34:47 +01:00
Adria Navarro cd56e1ffff Type caches 2024-03-06 00:34:47 +01:00
Adria Navarro 8062c28722 Making code more readable 2024-03-06 00:34:47 +01:00
Adria Navarro 6a81d21cb7 Fixes and tests 2024-03-06 00:34:47 +01:00
Adria Navarro 00bf88c5bf Extra tests 2024-03-06 00:34:47 +01:00
Adria Navarro 319b3afddb Ensure keys are removed 2024-03-06 00:34:47 +01:00
Adria Navarro e228b9c207 Test concurrency 2024-03-06 00:34:47 +01:00
Adria Navarro b1e1226de6 Add extra tests 2024-03-06 00:34:47 +01:00
Adria Navarro b1027527b3 Add persisting tests 2024-03-06 00:34:47 +01:00
Adria Navarro 64ea969aaf docWritethrough test 2024-03-06 00:34:47 +01:00
Adria Navarro 3998faaf3a DatabaseImpl.docExists test 2024-03-06 00:34:47 +01:00
Adria Navarro 48c92377ad USe get for doc exists 2024-03-06 00:34:47 +01:00
Adria Navarro c96c57bd9e DocWritethrough 2024-03-06 00:34:47 +01:00
Adria Navarro 86b715d5ce Create docWriteThrough redis cache 2024-03-06 00:34:47 +01:00
Adria Navarro 8f486e7bfc Add tests 2024-03-06 00:33:53 +01:00
Adria Navarro 355dea5b05 Add deleteIfValue 2024-03-06 00:33:53 +01:00
Adria Navarro 60f82610f6 Use redis testcontainer 2024-03-06 00:33:24 +01:00
Adria Navarro b774987e61 Install testcontainers 2024-03-06 00:33:04 +01:00
Adria Navarro d4ffc3d5d7 More tests 2024-03-05 22:54:39 +01:00
Adria Navarro 192d7deb2a Handle errors 2024-03-05 22:52:44 +01:00
Adria Navarro 837395e5e0 Add tests 2024-03-05 22:43:34 +01:00
Adria Navarro 339ca403bf Add redis.increment 2024-03-05 22:43:28 +01:00
Sam Rose 182a1df960
Fix the bug, I think. 2024-03-05 17:35:04 +00:00
Adria Navarro db75c05942 Use scim-logs db 2024-03-05 18:25:23 +01:00
Adria Navarro 71c5d2645f Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger 2024-03-05 18:13:59 +01:00
Adria Navarro ebcb7718b8 Use bulk 2024-03-05 18:11:50 +01:00
Adria Navarro 4fe7e67dd5 Do not use lock 2024-03-05 18:11:50 +01:00
Adria Navarro 2b25f9f0cb Improve redlock non executed response 2024-03-05 18:11:50 +01:00
Adria Navarro 0649497ab5 Add comment 2024-03-05 18:11:50 +01:00
Adria Navarro 8d87850765 Remove defaults and init 2024-03-05 18:11:50 +01:00
Adria Navarro b94d28b7d6 Clean 2024-03-05 18:11:50 +01:00
Adria Navarro 420b0ffc03 Tests 2024-03-05 18:11:50 +01:00
Adria Navarro 936ddafee7 Use bull 2024-03-05 18:11:50 +01:00
Adria Navarro df325e21c3 Add doc-writethrough queue 2024-03-05 18:11:50 +01:00
Adria Navarro 2412d75cac Type inMemoryQueue 2024-03-05 18:11:49 +01:00
Adria Navarro 774ff42f0c Use overloads 2024-03-05 18:11:49 +01:00
Adria Navarro 82a6f9027e Namespace key in redis by db 2024-03-05 18:11:49 +01:00
Adria Navarro da012c0f08 Namespace key in redis by db 2024-03-05 18:11:49 +01:00
Adria Navarro e986d34b87 Fix types 2024-03-05 18:11:49 +01:00
Adria Navarro dc84eb4e80 Type caches 2024-03-05 18:11:49 +01:00
Adria Navarro eb9a163394 Making code more readable 2024-03-05 18:11:49 +01:00
Adria Navarro fd93eb79d5 Fixes and tests 2024-03-05 18:11:49 +01:00
Adria Navarro 04fb279623 Extra tests 2024-03-05 18:11:49 +01:00
Adria Navarro 223637999a Ensure keys are removed 2024-03-05 18:11:49 +01:00
Adria Navarro 41dde9722f Test concurrency 2024-03-05 18:11:49 +01:00
Adria Navarro 35536592e6 Add extra tests 2024-03-05 18:11:49 +01:00
Adria Navarro bfde028e9b Add persisting tests 2024-03-05 18:11:49 +01:00
Adria Navarro 74aae19a7e docWritethrough test 2024-03-05 18:11:49 +01:00
Adria Navarro 82132d539d DatabaseImpl.docExists test 2024-03-05 18:11:49 +01:00
Adria Navarro 10568cccff USe get for doc exists 2024-03-05 18:11:49 +01:00
Adria Navarro 9f42ea6bbf DocWritethrough 2024-03-05 18:11:49 +01:00
Adria Navarro 40cc383c01 Create docWriteThrough redis cache 2024-03-05 18:11:49 +01:00
Adria Navarro a093cfca99 Fix test 2024-03-05 18:11:12 +01:00
Adria Navarro de0527384a Support complex objects 2024-03-05 18:10:45 +01:00
Adria Navarro 82ff748fd9 Add complex object tests 2024-03-05 18:10:33 +01:00
Adria Navarro f2330144de Clean 2024-03-05 17:57:28 +01:00
Dean 136eeefc26 Merge remote-tracking branch 'origin/master' into feature/app-list-actions 2024-03-05 16:24:14 +00:00
Adria Navarro 8f9e8b60c3 Fix types 2024-03-05 17:19:26 +01:00
Adria Navarro 38d557ea1c
Merge branch 'master' into BUDI-8046/redis-bulk-store 2024-03-05 17:11:13 +01:00
Adria Navarro 3baf981d48 Add TTL tests 2024-03-05 17:08:08 +01:00
Adria Navarro 1b0a943e13 Atomic expires 2024-03-05 17:04:46 +01:00
Adria Navarro d9a5899b27 Bulk store test 2024-03-05 16:49:45 +01:00
Adria Navarro 49db47e1fd Add bulk store 2024-03-05 16:46:33 +01:00
Adria Navarro a4288a9dd3 Basic test 2024-03-05 16:41:49 +01:00
Adria Navarro 56870bed5b Typings 2024-03-05 16:30:45 +01:00
Adria Navarro a5d6d094e6 Update types 2024-03-05 16:28:31 +01:00
Sam Rose 4170213c0d
Merge branch 'master' of github.com:budibase/budibase into budi-7710-user-groups-do-not-fully-support-custom-roles-5 2024-03-05 14:47:56 +00:00
Sam Rose 488cfea1f4
Fix typing. 2024-03-05 14:40:29 +00:00
Adria Navarro e076c0e5f5 Use typed redis clients 2024-03-05 15:10:51 +01:00
Adria Navarro 5bd5ea06e7 Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger 2024-03-05 14:20:09 +01:00
Adria Navarro ca0f583399 Remove defaults and init 2024-03-05 14:19:05 +01:00
Adria Navarro 82d2116ce0 Merge branch 'BUDI-8064/doc-writethrough' into BUDI-8046/scim-logger 2024-03-05 13:59:33 +01:00
Adria Navarro caf142f1db Clean 2024-03-05 13:55:07 +01:00
Adria Navarro e648503e4f Tests 2024-03-05 13:50:58 +01:00
Sam Rose aa124524d4
Add a simpler test. 2024-03-05 10:05:05 +00:00
Sam Rose fced2f3696
Respond to PR feedback. 2024-03-05 09:23:48 +00:00
Sam Rose 9d8c18337d
Type role controller. 2024-03-04 16:42:41 +00:00
Adria Navarro 2d84bc5da2 Use bull 2024-03-04 16:34:05 +01:00
Adria Navarro 91468d2569 Add doc-writethrough queue 2024-03-04 16:18:01 +01:00
Dean 41b55c28b7 Merge remote-tracking branch 'origin/master' into feature/app-list-actions 2024-03-04 15:13:47 +00:00
Adria Navarro 62fe394139 Merge branch 'BUDI-8046/improve-test-queues' into BUDI-8064/doc-writethrough 2024-03-04 15:41:10 +01:00
Adria Navarro 824dd1c1fc Type inMemoryQueue 2024-03-04 15:38:45 +01:00
Dean 42893c1218 Merge remote-tracking branch 'origin/master' into feature/app-list-actions 2024-03-04 10:00:03 +00:00
mike12345567 ad0c1a94c9 Fixing some typing that was added. 2024-03-01 13:59:42 +00:00
Adria Navarro 4ff2b36553 Use overloads 2024-03-01 13:59:51 +01:00
Adria Navarro 2da5cb3ddb Namespace key in redis by db 2024-03-01 13:41:40 +01:00
Adria Navarro 93e462b8c7 Namespace key in redis by db 2024-03-01 13:38:48 +01:00
Adria Navarro 4e53cb5143 Flags 2024-03-01 13:09:42 +01:00
Adria Navarro 3a341338a1 Log requests 2024-03-01 13:07:27 +01:00
Adria Navarro 1c17121568 Fix types 2024-03-01 11:12:31 +01:00
Adria Navarro 8611fade5e
Merge branch 'master' into BUDI-8064/doc-writethrough 2024-03-01 11:08:49 +01:00
Adria Navarro ff7c784342 Type caches 2024-03-01 11:04:55 +01:00
Adria Navarro 2b7c988823 Making code more readable 2024-03-01 11:04:30 +01:00
Adria Navarro 66751728bb Fixes and tests 2024-03-01 10:53:18 +01:00
Sam Rose f876c5c6e4
Merge master. 2024-02-29 17:34:16 +00:00
mike12345567 50bbbb2e06 Updating datasource controller types, this branched out a little bit to removing as many anys as possible, and allowing RowValue to correctly be returned from the allDocs function of the DB. 2024-02-29 16:28:00 +00:00
Adria Navarro 6b8f67ed41 Extra tests 2024-02-29 17:01:16 +01:00
Adria Navarro 3068e58c31 Ensure keys are removed 2024-02-29 16:48:16 +01:00
Adria Navarro 720d5a4105 Test concurrency 2024-02-29 15:51:42 +01:00
Adria Navarro 3ec0052481 Add extra tests 2024-02-29 15:41:26 +01:00
Adria Navarro dc4d1fdbda Add persisting tests 2024-02-29 15:28:35 +01:00
Adria Navarro 40d7a0a741 docWritethrough test 2024-02-29 15:23:32 +01:00
Adria Navarro 3af2da3b7d DatabaseImpl.docExists test 2024-02-29 15:17:18 +01:00
mike12345567 7641e84430 Merge branch 'revert-13160-revert-13128-feature/sql-query-aliasing' of github.com:Budibase/budibase into labday/sqs 2024-02-29 13:14:37 +00:00
Adria Navarro 7d50a70d03 USe get for doc exists 2024-02-29 13:47:18 +01:00
Adria Navarro ff7c8d3b95 DocWritethrough 2024-02-29 13:44:52 +01:00
Sam Rose 6b306266b5
Only show stack traces if you ask for them. 2024-02-29 11:09:39 +00:00
Adria Navarro 76b9cbcc5f Create docWriteThrough redis cache 2024-02-29 11:22:27 +01:00
Sam Rose 8488ff4144
Print stack traces from inside request handler. 2024-02-29 09:19:14 +00:00
mike12345567 71ad1fde0f Fixing some build/type issues. 2024-02-28 17:16:36 +00:00
mike12345567 2d75e1e85c Merge branch 'feature/sql-query-aliasing' of github.com:Budibase/budibase into labday/sqs 2024-02-28 17:03:59 +00:00
Sam Rose 237634386c
More typing fixes. 2024-02-28 12:19:08 +00:00
Sam Rose 2e8eda47f1
Respond to PR feedback. 2024-02-26 17:38:33 +00:00
Sam Rose 8f61b69ee5
Merge branch 'master' of github.com:budibase/budibase into budi-7710-user-groups-do-not-fully-support-custom-roles 2024-02-26 17:28:51 +00:00
Sam Rose c15554547b
Respond to PR feedback. 2024-02-26 17:28:37 +00:00
mike12345567 90c06e633b Merging latest master. 2024-02-26 15:46:00 +00:00
Sam Rose b9600d8330
More progress on modernising application tests. 2024-02-26 11:57:56 +00:00
Dean 8556a869b9 Merge remote-tracking branch 'origin/master' into feature/app-list-actions 2024-02-26 11:01:01 +00:00
jvcalderon eafb8a6903 Merge branch 'master' into feature/synchronicity 2024-02-23 16:49:24 +01:00
jvcalderon 1ef5e54c29 Add BPM_EVENTS to Redis DB list 2024-02-23 16:26:23 +01:00
Dean 6877d0a016 Merge remote-tracking branch 'origin/master' into feature/app-list-actions 2024-02-22 15:00:34 +00:00
Dean 18f09f4e13 Duplicate app behaviour and test updates 2024-02-22 15:00:16 +00:00
Adria Navarro 8e77365c19 Allow mocking multiple features 2024-02-22 13:55:38 +01:00
Adria Navarro fb1bfbdae8 Clean code 2024-02-22 13:55:26 +01:00
Sam Rose ba66bc3232
Merge master. 2024-02-21 15:06:59 +00:00
Sam Rose 686697e890
Enforce using example.com as a domain for emails. 2024-02-21 11:30:22 +00:00
Adria Navarro ac638badd4
Merge branch 'master' into BUDI-7656/add-migration 2024-02-19 17:40:47 +01:00
melohagan c12e5fd196
Fix array type missing from query schema selector (#12772)
* Tidy MongoDB aggregation pipeline view

* Remove unused code

* WIP

* Add bindings for bindings drawer

* Is not external table if it's a query

* Add QueryArrayFetch

* Bug fix

* JavaScript is the worst

* refactor

* Add array label to query schema

* Remove console log

* type fix

* Don't include Array in SchemaTypeOptions, but show label

* Fix bindings

* refactor

* Rename isObject to hasSchema

* WIP

* Typing WIP

* Type not Types

* Unused import

* type fix

* Handle json array subtype

* Support queryarray datasource type

* refactor

* yarn lock

* update account portal

---------

Co-authored-by: Sam Rose <hello@samwho.dev>
2024-02-19 09:13:03 +00:00
mike12345567 364579acc4 Fixing an issue when invalid version is supplied (not semver) shouldn't crash server. 2024-02-16 15:41:36 +00:00
Sam Rose e4b0330866
Simplify the typing of workerRequests.ts 2024-02-15 15:49:30 +00:00
Sam Rose dde8f77877
Type workerRequests.ts 2024-02-15 14:48:47 +00:00
Adria Navarro 4f42fd832d Lint 2024-02-09 16:47:58 +01:00
Adria Navarro 7ce9756d8c Revert jsRunner changes to vm 2024-02-09 16:36:43 +01:00
Sam Rose 77b3d479a0
Update dd-trace to 5.2.0. 2024-02-09 12:01:37 +00:00
Adria Navarro 573096e869
Merge branch 'master' into revert-12934-revert-12930-revert-12929-revert-12769-isolated-vm 2024-02-08 18:15:36 +01:00
Sam Rose 8e9db069e5
Remove all uses of test.com in the code, replace them with example.com and create a lint rule to prevent this in future. 2024-02-08 16:32:14 +00:00
Adria Navarro 3b8b60aa03 Use wrapper 2024-02-08 09:38:09 +01:00
Adria Navarro 218ba1d283 VM types 2024-02-08 09:38:09 +01:00
Adria Navarro d0d767ce5e
Merge branch 'master' into revert-12934-revert-12930-revert-12929-revert-12769-isolated-vm 2024-02-08 09:37:39 +01:00
mike12345567 7dc2c3551f Updating the listObjects functionality to correctly handle truncated responses, when not all objects can be returned at once we need to loop, but we weren't correctly picking up the token that should be passed. 2024-02-07 17:03:44 +00:00
Martin McKeaveney b17bd4d8fd merge 2024-02-02 17:00:09 -03:00
mike12345567 d87c7a1c4a Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-02-02 17:09:54 +00:00
Adria Navarro 8dfcc3aeb1
Revert "Revert "Migrate from `vm` to `isolated-vm`"" 2024-02-02 12:02:09 +01:00
Sam Rose 332a201ae7
Revert "Migrate from `vm` to `isolated-vm`" 2024-02-02 09:51:46 +00:00
Sam Rose ba002f9649
Clean up isolates when a request is finished. 2024-02-02 09:30:33 +00:00
Adria Navarro 45ea6a6fd6
Revert "Revert "Migrate from `vm` to `isolated-vm`"" 2024-02-01 16:47:41 +01:00
Adria Navarro 16749ec3dd
Revert "Migrate from `vm` to `isolated-vm`" 2024-02-01 16:30:34 +01:00
Adria Navarro 87501bf25e
Merge branch 'master' into isolated-vm 2024-02-01 13:15:47 +01:00
Adria Navarro 2ea70e1010
Merge pull request #12922 from Budibase/test-isolated-vm
Test isolated vm
2024-02-01 13:15:33 +01:00
Adria Navarro 3aff1004c8
Merge branch 'master' into isolated-vm 2024-02-01 12:42:48 +01:00
Adria Navarro 181d462cdf Update uuid 2024-02-01 11:15:21 +01:00
mike12345567 85f7d66a99 Handling very large exports/backup downloads. 2024-01-31 17:16:51 +00:00
Sam Rose 682c3c6c14
Merge branch 'master' into update-nano 2024-01-31 14:43:44 +00:00
Martin McKeaveney a23f76b8c8 update expiry time for attachments/images 2024-01-31 08:57:54 -03:00
Sam Rose f3e0dfd466
Update to @budibase/nano 10.1.5 2024-01-31 11:55:29 +00:00
Adria Navarro 623b4f5dab
Merge branch 'master' into isolated-vm 2024-01-31 10:47:08 +01:00
mike12345567 21a8d44ec7 Adding a 'SESSION_EXPIRY_SECONDS' environment variable which can be set on the services to configure how long before an idle user is logged out. 2024-01-25 16:22:39 +00:00
Adria Navarro bc7825dc93 Keep isolateRefs in context 2024-01-24 14:02:34 +01:00
Adria Navarro 09d8951fc3
Merge branch 'master' into isolated-vm 2024-01-18 14:21:13 +01:00
jvcalderon 64d3114c9f Refactor: usersUtils -> userUtils 2024-01-18 12:03:26 +01:00
jvcalderon 03f7fb37ed Calculate creators count when group role changes 2024-01-18 11:14:25 +01:00
mike12345567 b370e2a0e5 Updating dd-trace to 5.0.0 across all packages now that the memory leak is solved, this also removes the erronous message on startup describing DataDog startup problems. 2024-01-15 17:44:52 +00:00
Adria Navarro 73fee7dec7 Fix build 2024-01-15 12:04:35 +01:00
Sam Rose c508a435d6
Isolate and context re-use. 2024-01-12 15:08:08 +00:00
mike12345567 e69ba75849 Fixing typing for performCall. 2024-01-11 17:17:38 +00:00
mike12345567 8483a53178 This removes the need for constant DB HEAD requests to check if a database exists or not. Instead, it tries to make the request, and if it fails it will check if the reason for failure is the database not existing. If it doesn't exist it runs through the same old flow to confirm that it definitely doesn't exist, and if it doesn't then it will create it. 2024-01-11 16:44:15 +00:00
Martin McKeaveney a34ae9e2e2 merge with master 2024-01-08 16:44:32 +00:00
Michael Drury 5a18944a4b
Merge branch 'master' into BUDI-7656/add-migration 2024-01-08 13:20:33 +00:00
Sam Rose 7ca748a3be
Remove objects from setUser call. We can add them later if we need them. 2024-01-05 18:10:23 +00:00
Sam Rose 26fd6b55cd
Merge branch 'master' into attach-user-to-spans 2024-01-05 14:46:53 +00:00
Sam Rose 946a73f1b6
Set user ID correctly. 2024-01-05 14:40:16 +00:00
Michael Drury 9004428ef3
Merge branch 'master' into fix/password-length-admin-user-startup 2024-01-05 14:06:37 +00:00
mike12345567 b4b8e16f22 PR comments. 2024-01-05 13:58:31 +00:00
Sam Rose b3cd74e877
Remove user email from DataDog user info. 2024-01-05 13:49:01 +00:00
mike12345567 f2f16cfcee Adding an option to disable password validation when creating an admin user - this means that the environment variables used for BB_ADMIN creation can have any length of password (not breaking change). 2024-01-05 13:17:10 +00:00
Sam Rose 69bfd01bf0
Attach authenticated user to DataDog spans. 2024-01-05 11:37:10 +00:00
mike12345567 bbeaed48a7 Removing the use of the addQueries quota functionality from row API - we don't make use of these statistics anymore (and haven't in a while) counting them is pointless and could be causing some loss in performance in these heavily used endpoints. 2024-01-04 17:38:54 +00:00
Sam Rose 68468fadb3
Add an extra JS execution time limit check to prevent creating unnecesary VM context. 2024-01-04 10:10:00 +00:00
Adria Navarro 7413fd96a8
Merge branch 'master' into chore/node-20 2024-01-03 14:15:21 +01:00
Michael Drury e0a550e098
Merge branch 'master' into fix/multi-tenancy-dev-access 2024-01-03 12:57:17 +00:00
mike12345567 9a5fb8b8de Fix test. 2024-01-03 12:56:53 +00:00
mike12345567 9feb91793c Fix for multi-tenancy issue in local development, couldn't load apps as it requires a tenant ID in the subdomain when in multi-tenancy mode which isn't possible in development - this makes sure that local development can work by using the users cookie instead. 2024-01-03 12:38:31 +00:00
Adria Navarro 1403f65708 Revert "Add breaking change"
This reverts commit 62e445c1e6.
2024-01-03 13:00:14 +01:00
Adria Navarro 62e445c1e6 Add breaking change 2024-01-03 12:59:05 +01:00
Martin McKeaveney 57cf6dec94 merge 2024-01-03 11:43:27 +00:00
Adria Navarro 699555c04b Fix hosting 2024-01-03 12:35:52 +01:00
Adria Navarro b09f941027 Fix tests 2024-01-03 12:06:23 +01:00
Adria Navarro b45717a1e1 Move password checks to db 2024-01-03 12:00:25 +01:00
Adria Navarro 66fd8b936f Clean log 2024-01-03 11:45:25 +01:00
Adria Navarro ba2b54f842 Use env variables instead of checking if isdev 2024-01-03 10:12:22 +01:00
Adria Navarro fe0ac28851 Fix test 2024-01-02 17:03:13 +01:00
Adria Navarro b0a12e034d Remove limits from password in dev 2024-01-02 16:58:47 +01:00
Adria Navarro 780a0ee687 Increase limits 2024-01-02 16:38:58 +01:00
Adria Navarro 59fba524bc Lint 2024-01-02 16:33:00 +01:00
Adria Navarro 0685caf8a2 Validate password in backend-core 2024-01-02 15:23:12 +01:00
Adria Navarro 5609db3545 Add max limit 2024-01-02 15:16:09 +01:00
Sam Rose a4e134b841
Merge branch 'master' into revert-12655-dd-tracer-nuke 2024-01-02 13:25:12 +00:00
Martin McKeaveney b80d0b490a bullboard, mongo and jimp patches 2024-01-02 13:23:55 +00:00
Adria Navarro 3b50d1a988 Copy change 2024-01-02 13:22:38 +01:00
Adria Navarro d9c921e101 Add tests 2024-01-02 12:56:08 +01:00
Sam Rose 642b75e0ae
Revert "Remove all custom tracing to see if it's the cause of the memory leak." 2024-01-02 11:36:32 +00:00
Adria Navarro f4d70ad7f3
Merge branch 'master' into BUDI-7656/add-multiple-relationships-dev-script 2024-01-02 12:34:32 +01:00
Adria Navarro c15a917e00 Validate password in backend-core 2024-01-02 12:29:27 +01:00
Adria Navarro c94c3d09dc
Merge branch 'master' into vulnerability/budi-7794-invalidate-session-on-password-reset 2024-01-02 12:25:42 +01:00
Adria Navarro f74264c1c8 Add tests 2023-12-29 16:37:34 +01:00
Adria Navarro dcacd6bf17 Add basic test 2023-12-29 16:07:26 +01:00
Adria Navarro f722f9e2d6 Invalidate reset code once used 2023-12-29 15:06:04 +01:00
Adria Navarro e265cc635c Create link docs to new docs 2023-12-29 13:41:46 +01:00
Adria Navarro 90db9efb70 Allow skipping migrations 2023-12-29 12:43:39 +01:00
mike12345567 3cfe641486 Fixing issue with Redis disconnection - this should correctly reconnect the service when Redis service becomes available again. 2023-12-22 18:28:07 +00:00
Martin McKeaveney 8f1470f5a5 merge with master 2023-12-22 17:08:32 +00:00
Adria Navarro c7bb63da35 Update node refs to 20 2023-12-22 14:55:22 +01:00
Adria Navarro c0a19c2a7e Type cache arguments 2023-12-22 14:37:54 +01:00
Sam Rose 3c0901f530
Remove all custom tracing to see if it's the cause of the memory leak. 2023-12-21 11:06:05 +00:00
Sam Rose 1f3a75e892
Downgrade back to dd-trace 3.13.2 2023-12-20 17:20:30 +00:00
Sam Rose c4fd5342cf
Merge branch 'master' into trace-automations 2023-12-20 09:57:24 +00:00
Sam Rose 9b750ed160
Merge branch 'master' into trace-automations 2023-12-20 09:43:55 +00:00
Sam Rose 2e58f2cdde
Add traces to track running arbitrary JS. 2023-12-19 18:20:13 +00:00
Sam Rose 2a0be7c8cd
Give db operation spans better names. 2023-12-19 17:18:40 +00:00
Sam Rose fef3107c0e
Fix automation tests. 2023-12-19 16:17:34 +00:00
Sam Rose 4739fd94c2
Merge branch 'master' into limit-js-execution-per-request 2023-12-19 11:57:21 +00:00
Sam Rose 96f64b4344
Manually inject DataDog trace context to log messages. 2023-12-19 11:47:41 +00:00
Adria Navarro dbc45da7f5
Merge branch 'master' into limit-js-execution-per-request 2023-12-19 12:44:37 +01:00
Sam Rose 93da29611d
Fix type error. 2023-12-19 10:11:51 +00:00
Sam Rose 4093f311c9
Respond to PR feedback. 2023-12-19 09:47:12 +00:00
mike12345567 987e280bc9 Merge branch 'instrument-couch' of github.com:Budibase/budibase into instrument-couch 2023-12-18 18:33:20 +00:00
mike12345567 d681d5298b Type fixes. 2023-12-18 18:33:04 +00:00
Sam Rose 78d039c949
Update backend-core to dd-trace 4.20.0 2023-12-18 17:43:50 +00:00
Sam Rose 1c34147357
Add tests for per-request execution timeout. 2023-12-18 17:01:56 +00:00
Sam Rose bd324f3225
Implement per-request JS execution limiting. 2023-12-18 15:29:56 +00:00
Martin McKeaveney e73576d8d6 more patches 2023-12-17 15:58:10 +00:00
Sam Rose 1717fb7930
Instrument CouchDB client with DD APM traces. 2023-12-15 11:30:02 +00:00
Sam Rose 7ec2c3860b
Optimise the performance of Writethrough.put. 2023-12-14 16:20:31 +00:00
Adria Navarro a0dd71f990 Renames 2023-12-14 10:31:04 +01:00
Adria Navarro 46f8f4da58 Fix parsing appid from path with ? 2023-12-14 10:09:23 +01:00
Adria Navarro f3e046ba98 Move header constants to shared-core 2023-12-14 10:07:46 +01:00
Adria Navarro 34d3edc2db Add header 2023-12-14 10:07:45 +01:00
Michael Drury b9593d1933
Merge branch 'master' into fix/try-once-logging 2023-12-13 15:57:21 +00:00
mike12345567 c8128325c6 Improving type handling. 2023-12-13 15:39:04 +00:00
mike12345567 c4af5214ef Improving types around the writethrough cache, exposing the proper typing from the database and removing a log statement which is useless, errors are correctly propogated if they matter (and handled above this level with proper context) or in the 99% scenario it is not a real error (such as try once locks already being held) and a log is just spammy. 2023-12-13 15:08:23 +00:00
Sam Rose 4934b4a428
Fix broken test. 2023-12-13 11:58:56 +00:00
Sam Rose 614a659032
Merge branch 'master' of github.com:budibase/budibase into budi-7664-sqs-self-host-ui-for-detecting-lack-of-sqs-support 2023-12-12 14:44:08 +00:00
melohagan 9d56039d03
Revert TTL on signed urls (#12556) 2023-12-12 10:52:14 +00:00
Sam Rose f249dadcc7
Merge branch 'master' of github.com:budibase/budibase into budi-7664-sqs-self-host-ui-for-detecting-lack-of-sqs-support 2023-12-11 17:46:27 +00:00
Sam Rose 6b491815a5
Add isSqsAvailable key to the environment endpoint. 2023-12-11 15:22:02 +00:00
mike12345567 09bb15e67f Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-12-11 11:30:34 +00:00
Adria Navarro 1e267fca5b Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-12-11 09:50:48 +01:00
Adria Navarro e5d27181f2
Merge branch 'master' into BUDI-7655/migration-backend 2023-12-11 09:31:56 +01:00
mike12345567 4302c720ed Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-12-08 16:13:09 +00:00
mike12345567 3dcb3062f5 Adding a check to make sure that encryption does not execute upon directories, as well as adding copy to warn that attachments are not encrypted. 2023-12-06 16:38:03 +00:00
mike12345567 244a1d9329 PR comment. 2023-12-06 14:47:13 +00:00
mike12345567 8628c67c90 Fixing typing issues. 2023-12-05 18:17:27 +00:00
mike12345567 33b7e4d5d2 Some final refactoring, using proper jwt lib rather than requiring (proper typing). 2023-12-05 16:28:19 +00:00
mike12345567 2bf65601a1 Another simplification. 2023-12-05 15:55:09 +00:00
mike12345567 50270b8854 Quick refactor while in the area. 2023-12-05 15:54:33 +00:00
Adria Navarro e7859a8a47
Merge branch 'master' into BUDI-7655/migration-backend 2023-12-05 12:57:37 +01:00
mike12345567 7e4a9016a8 Merge branch 'master' of github.com:Budibase/budibase into fix/massive-attachment-export 2023-12-04 18:08:59 +00:00
mike12345567 a7410020c7 Adding cookie clearing/logout for when a cross tenant session is detected, make sure that the cookie cannot be used/considered valid after the call is made. 2023-12-04 16:47:41 +00:00
Adria Navarro 8ac9420e5b Add middleware to queue 2023-12-04 16:30:07 +01:00
Adria Navarro e4237c0620 Remove conflicting typing 2023-12-04 15:15:40 +01:00
mike12345567 3e2311ad5c Merge branch 'master' of github.com:Budibase/budibase into fix/massive-attachment-export 2023-12-04 13:11:55 +00:00
Adria Navarro 0eae73a5f0
Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-12-04 12:31:33 +01:00
Adria Navarro 9c9f45436f Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-12-04 09:30:00 +01:00
Adria Navarro 188d5d09a2 Typo
Co-authored-by: Sam Rose <hello@samwho.dev>
2023-12-04 09:12:58 +01:00
Adria Navarro fa7693f6df Typo
Co-authored-by: Sam Rose <hello@samwho.dev>
2023-12-04 09:12:58 +01:00
Adria Navarro 7f52a1e28c Guard migration 2023-12-04 09:12:58 +01:00
Adria Navarro 14fc91d58a Add tests 2023-12-04 09:12:58 +01:00
Adria Navarro f62dd56dd6 Add doInAppMigrationContext 2023-12-04 09:12:58 +01:00
Adria Navarro fe0efc7539 Remove unused test context code 2023-12-04 09:12:57 +01:00
mike12345567 00a3c630ef Initial work to get file streaming working when dealing with a large amount of file exports, tested with up to 1.5GB of attachments. 2023-12-01 18:36:40 +00:00
Adria Navarro 12015c79ae Add comments 2023-11-30 18:39:33 +01:00
Adria Navarro 670853a0ea Renames 2023-11-30 18:39:33 +01:00
Adria Navarro fb72b77ac1 Use jest.useFakeTimers 2023-11-30 18:39:33 +01:00
Adria Navarro bd89633e61 Fix wrong commited code 2023-11-30 18:39:33 +01:00
Adria Navarro a8ac4eed6d Autoextend without ttl 2023-11-30 18:39:33 +01:00
Adria Navarro 25099ee28e Clean redlock test settings 2023-11-30 18:39:33 +01:00
Adria Navarro 57b4c08731 Increase timeouts 2023-11-30 18:39:33 +01:00
Adria Navarro dcb6933eaa Clean 2023-11-30 18:39:33 +01:00
Adria Navarro c86d949680 Add and dry tests 2023-11-30 18:39:33 +01:00
Adria Navarro db6517bc0c Use real sleeps 2023-11-30 18:39:33 +01:00
Adria Navarro 078384941a Clean 2023-11-30 18:39:33 +01:00
Adria Navarro 9c12c5b62e Fix comments 2023-11-30 18:39:33 +01:00
Adria Navarro 73fd1f66c5 Fix 2023-11-30 18:39:33 +01:00