Commit Graph

2030 Commits

Author SHA1 Message Date
Adria Navarro 3ec0052481 Add extra tests 2024-02-29 15:41:26 +01:00
Adria Navarro dc4d1fdbda Add persisting tests 2024-02-29 15:28:35 +01:00
Adria Navarro 40d7a0a741 docWritethrough test 2024-02-29 15:23:32 +01:00
Adria Navarro 3af2da3b7d DatabaseImpl.docExists test 2024-02-29 15:17:18 +01:00
mike12345567 7641e84430 Merge branch 'revert-13160-revert-13128-feature/sql-query-aliasing' of github.com:Budibase/budibase into labday/sqs 2024-02-29 13:14:37 +00:00
Adria Navarro 7d50a70d03 USe get for doc exists 2024-02-29 13:47:18 +01:00
Adria Navarro ff7c8d3b95 DocWritethrough 2024-02-29 13:44:52 +01:00
Sam Rose 6b306266b5
Only show stack traces if you ask for them. 2024-02-29 11:09:39 +00:00
Adria Navarro 76b9cbcc5f Create docWriteThrough redis cache 2024-02-29 11:22:27 +01:00
Sam Rose 8488ff4144
Print stack traces from inside request handler. 2024-02-29 09:19:14 +00:00
mike12345567 71ad1fde0f Fixing some build/type issues. 2024-02-28 17:16:36 +00:00
mike12345567 2d75e1e85c Merge branch 'feature/sql-query-aliasing' of github.com:Budibase/budibase into labday/sqs 2024-02-28 17:03:59 +00:00
Sam Rose 237634386c
More typing fixes. 2024-02-28 12:19:08 +00:00
Sam Rose 2e8eda47f1
Respond to PR feedback. 2024-02-26 17:38:33 +00:00
Sam Rose 8f61b69ee5
Merge branch 'master' of github.com:budibase/budibase into budi-7710-user-groups-do-not-fully-support-custom-roles 2024-02-26 17:28:51 +00:00
Sam Rose c15554547b
Respond to PR feedback. 2024-02-26 17:28:37 +00:00
mike12345567 90c06e633b Merging latest master. 2024-02-26 15:46:00 +00:00
Sam Rose b9600d8330
More progress on modernising application tests. 2024-02-26 11:57:56 +00:00
Dean 8556a869b9 Merge remote-tracking branch 'origin/master' into feature/app-list-actions 2024-02-26 11:01:01 +00:00
jvcalderon eafb8a6903 Merge branch 'master' into feature/synchronicity 2024-02-23 16:49:24 +01:00
jvcalderon 1ef5e54c29 Add BPM_EVENTS to Redis DB list 2024-02-23 16:26:23 +01:00
Dean 6877d0a016 Merge remote-tracking branch 'origin/master' into feature/app-list-actions 2024-02-22 15:00:34 +00:00
Dean 18f09f4e13 Duplicate app behaviour and test updates 2024-02-22 15:00:16 +00:00
Adria Navarro fb1bfbdae8 Clean code 2024-02-22 13:55:26 +01:00
Sam Rose ba66bc3232
Merge master. 2024-02-21 15:06:59 +00:00
Adria Navarro ac638badd4
Merge branch 'master' into BUDI-7656/add-migration 2024-02-19 17:40:47 +01:00
melohagan c12e5fd196
Fix array type missing from query schema selector (#12772)
* Tidy MongoDB aggregation pipeline view

* Remove unused code

* WIP

* Add bindings for bindings drawer

* Is not external table if it's a query

* Add QueryArrayFetch

* Bug fix

* JavaScript is the worst

* refactor

* Add array label to query schema

* Remove console log

* type fix

* Don't include Array in SchemaTypeOptions, but show label

* Fix bindings

* refactor

* Rename isObject to hasSchema

* WIP

* Typing WIP

* Type not Types

* Unused import

* type fix

* Handle json array subtype

* Support queryarray datasource type

* refactor

* yarn lock

* update account portal

---------

Co-authored-by: Sam Rose <hello@samwho.dev>
2024-02-19 09:13:03 +00:00
mike12345567 364579acc4 Fixing an issue when invalid version is supplied (not semver) shouldn't crash server. 2024-02-16 15:41:36 +00:00
Sam Rose e4b0330866
Simplify the typing of workerRequests.ts 2024-02-15 15:49:30 +00:00
Sam Rose dde8f77877
Type workerRequests.ts 2024-02-15 14:48:47 +00:00
Adria Navarro 4f42fd832d Lint 2024-02-09 16:47:58 +01:00
Adria Navarro 7ce9756d8c Revert jsRunner changes to vm 2024-02-09 16:36:43 +01:00
Adria Navarro 573096e869
Merge branch 'master' into revert-12934-revert-12930-revert-12929-revert-12769-isolated-vm 2024-02-08 18:15:36 +01:00
Sam Rose 8e9db069e5
Remove all uses of test.com in the code, replace them with example.com and create a lint rule to prevent this in future. 2024-02-08 16:32:14 +00:00
Adria Navarro 3b8b60aa03 Use wrapper 2024-02-08 09:38:09 +01:00
Adria Navarro 218ba1d283 VM types 2024-02-08 09:38:09 +01:00
Adria Navarro d0d767ce5e
Merge branch 'master' into revert-12934-revert-12930-revert-12929-revert-12769-isolated-vm 2024-02-08 09:37:39 +01:00
mike12345567 7dc2c3551f Updating the listObjects functionality to correctly handle truncated responses, when not all objects can be returned at once we need to loop, but we weren't correctly picking up the token that should be passed. 2024-02-07 17:03:44 +00:00
mike12345567 d87c7a1c4a Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2024-02-02 17:09:54 +00:00
Adria Navarro 8dfcc3aeb1
Revert "Revert "Migrate from `vm` to `isolated-vm`"" 2024-02-02 12:02:09 +01:00
Sam Rose 332a201ae7
Revert "Migrate from `vm` to `isolated-vm`" 2024-02-02 09:51:46 +00:00
Sam Rose ba002f9649
Clean up isolates when a request is finished. 2024-02-02 09:30:33 +00:00
Adria Navarro 45ea6a6fd6
Revert "Revert "Migrate from `vm` to `isolated-vm`"" 2024-02-01 16:47:41 +01:00
Adria Navarro 16749ec3dd
Revert "Migrate from `vm` to `isolated-vm`" 2024-02-01 16:30:34 +01:00
Adria Navarro 87501bf25e
Merge branch 'master' into isolated-vm 2024-02-01 13:15:47 +01:00
Adria Navarro 3aff1004c8
Merge branch 'master' into isolated-vm 2024-02-01 12:42:48 +01:00
mike12345567 85f7d66a99 Handling very large exports/backup downloads. 2024-01-31 17:16:51 +00:00
Martin McKeaveney a23f76b8c8 update expiry time for attachments/images 2024-01-31 08:57:54 -03:00
Adria Navarro 623b4f5dab
Merge branch 'master' into isolated-vm 2024-01-31 10:47:08 +01:00
mike12345567 21a8d44ec7 Adding a 'SESSION_EXPIRY_SECONDS' environment variable which can be set on the services to configure how long before an idle user is logged out. 2024-01-25 16:22:39 +00:00
Adria Navarro bc7825dc93 Keep isolateRefs in context 2024-01-24 14:02:34 +01:00
jvcalderon 64d3114c9f Refactor: usersUtils -> userUtils 2024-01-18 12:03:26 +01:00
jvcalderon 03f7fb37ed Calculate creators count when group role changes 2024-01-18 11:14:25 +01:00
Adria Navarro 73fee7dec7 Fix build 2024-01-15 12:04:35 +01:00
Sam Rose c508a435d6
Isolate and context re-use. 2024-01-12 15:08:08 +00:00
mike12345567 e69ba75849 Fixing typing for performCall. 2024-01-11 17:17:38 +00:00
mike12345567 8483a53178 This removes the need for constant DB HEAD requests to check if a database exists or not. Instead, it tries to make the request, and if it fails it will check if the reason for failure is the database not existing. If it doesn't exist it runs through the same old flow to confirm that it definitely doesn't exist, and if it doesn't then it will create it. 2024-01-11 16:44:15 +00:00
Michael Drury 5a18944a4b
Merge branch 'master' into BUDI-7656/add-migration 2024-01-08 13:20:33 +00:00
Sam Rose 7ca748a3be
Remove objects from setUser call. We can add them later if we need them. 2024-01-05 18:10:23 +00:00
Sam Rose 26fd6b55cd
Merge branch 'master' into attach-user-to-spans 2024-01-05 14:46:53 +00:00
Sam Rose 946a73f1b6
Set user ID correctly. 2024-01-05 14:40:16 +00:00
Michael Drury 9004428ef3
Merge branch 'master' into fix/password-length-admin-user-startup 2024-01-05 14:06:37 +00:00
mike12345567 b4b8e16f22 PR comments. 2024-01-05 13:58:31 +00:00
Sam Rose b3cd74e877
Remove user email from DataDog user info. 2024-01-05 13:49:01 +00:00
mike12345567 f2f16cfcee Adding an option to disable password validation when creating an admin user - this means that the environment variables used for BB_ADMIN creation can have any length of password (not breaking change). 2024-01-05 13:17:10 +00:00
Sam Rose 69bfd01bf0
Attach authenticated user to DataDog spans. 2024-01-05 11:37:10 +00:00
mike12345567 bbeaed48a7 Removing the use of the addQueries quota functionality from row API - we don't make use of these statistics anymore (and haven't in a while) counting them is pointless and could be causing some loss in performance in these heavily used endpoints. 2024-01-04 17:38:54 +00:00
Sam Rose 68468fadb3
Add an extra JS execution time limit check to prevent creating unnecesary VM context. 2024-01-04 10:10:00 +00:00
Michael Drury e0a550e098
Merge branch 'master' into fix/multi-tenancy-dev-access 2024-01-03 12:57:17 +00:00
mike12345567 9a5fb8b8de Fix test. 2024-01-03 12:56:53 +00:00
mike12345567 9feb91793c Fix for multi-tenancy issue in local development, couldn't load apps as it requires a tenant ID in the subdomain when in multi-tenancy mode which isn't possible in development - this makes sure that local development can work by using the users cookie instead. 2024-01-03 12:38:31 +00:00
Adria Navarro 1403f65708 Revert "Add breaking change"
This reverts commit 62e445c1e6.
2024-01-03 13:00:14 +01:00
Adria Navarro 62e445c1e6 Add breaking change 2024-01-03 12:59:05 +01:00
Adria Navarro 699555c04b Fix hosting 2024-01-03 12:35:52 +01:00
Adria Navarro b45717a1e1 Move password checks to db 2024-01-03 12:00:25 +01:00
Adria Navarro 66fd8b936f Clean log 2024-01-03 11:45:25 +01:00
Adria Navarro ba2b54f842 Use env variables instead of checking if isdev 2024-01-03 10:12:22 +01:00
Adria Navarro fe0ac28851 Fix test 2024-01-02 17:03:13 +01:00
Adria Navarro b0a12e034d Remove limits from password in dev 2024-01-02 16:58:47 +01:00
Adria Navarro 780a0ee687 Increase limits 2024-01-02 16:38:58 +01:00
Adria Navarro 59fba524bc Lint 2024-01-02 16:33:00 +01:00
Adria Navarro 0685caf8a2 Validate password in backend-core 2024-01-02 15:23:12 +01:00
Adria Navarro 5609db3545 Add max limit 2024-01-02 15:16:09 +01:00
Sam Rose a4e134b841
Merge branch 'master' into revert-12655-dd-tracer-nuke 2024-01-02 13:25:12 +00:00
Adria Navarro 3b50d1a988 Copy change 2024-01-02 13:22:38 +01:00
Adria Navarro d9c921e101 Add tests 2024-01-02 12:56:08 +01:00
Sam Rose 642b75e0ae
Revert "Remove all custom tracing to see if it's the cause of the memory leak." 2024-01-02 11:36:32 +00:00
Adria Navarro f4d70ad7f3
Merge branch 'master' into BUDI-7656/add-multiple-relationships-dev-script 2024-01-02 12:34:32 +01:00
Adria Navarro c15a917e00 Validate password in backend-core 2024-01-02 12:29:27 +01:00
Adria Navarro c94c3d09dc
Merge branch 'master' into vulnerability/budi-7794-invalidate-session-on-password-reset 2024-01-02 12:25:42 +01:00
Adria Navarro f74264c1c8 Add tests 2023-12-29 16:37:34 +01:00
Adria Navarro dcacd6bf17 Add basic test 2023-12-29 16:07:26 +01:00
Adria Navarro f722f9e2d6 Invalidate reset code once used 2023-12-29 15:06:04 +01:00
Adria Navarro e265cc635c Create link docs to new docs 2023-12-29 13:41:46 +01:00
Adria Navarro 90db9efb70 Allow skipping migrations 2023-12-29 12:43:39 +01:00
mike12345567 3cfe641486 Fixing issue with Redis disconnection - this should correctly reconnect the service when Redis service becomes available again. 2023-12-22 18:28:07 +00:00
Adria Navarro c0a19c2a7e Type cache arguments 2023-12-22 14:37:54 +01:00
Sam Rose 3c0901f530
Remove all custom tracing to see if it's the cause of the memory leak. 2023-12-21 11:06:05 +00:00
Sam Rose c4fd5342cf
Merge branch 'master' into trace-automations 2023-12-20 09:57:24 +00:00
Sam Rose 9b750ed160
Merge branch 'master' into trace-automations 2023-12-20 09:43:55 +00:00
Sam Rose 2e58f2cdde
Add traces to track running arbitrary JS. 2023-12-19 18:20:13 +00:00
Sam Rose 2a0be7c8cd
Give db operation spans better names. 2023-12-19 17:18:40 +00:00
Sam Rose fef3107c0e
Fix automation tests. 2023-12-19 16:17:34 +00:00
Sam Rose 4739fd94c2
Merge branch 'master' into limit-js-execution-per-request 2023-12-19 11:57:21 +00:00
Sam Rose 96f64b4344
Manually inject DataDog trace context to log messages. 2023-12-19 11:47:41 +00:00
Adria Navarro dbc45da7f5
Merge branch 'master' into limit-js-execution-per-request 2023-12-19 12:44:37 +01:00
Sam Rose 93da29611d
Fix type error. 2023-12-19 10:11:51 +00:00
Sam Rose 4093f311c9
Respond to PR feedback. 2023-12-19 09:47:12 +00:00
mike12345567 d681d5298b Type fixes. 2023-12-18 18:33:04 +00:00
Sam Rose 1c34147357
Add tests for per-request execution timeout. 2023-12-18 17:01:56 +00:00
Sam Rose bd324f3225
Implement per-request JS execution limiting. 2023-12-18 15:29:56 +00:00
Sam Rose 1717fb7930
Instrument CouchDB client with DD APM traces. 2023-12-15 11:30:02 +00:00
Sam Rose 7ec2c3860b
Optimise the performance of Writethrough.put. 2023-12-14 16:20:31 +00:00
Adria Navarro a0dd71f990 Renames 2023-12-14 10:31:04 +01:00
Adria Navarro 46f8f4da58 Fix parsing appid from path with ? 2023-12-14 10:09:23 +01:00
Adria Navarro f3e046ba98 Move header constants to shared-core 2023-12-14 10:07:46 +01:00
Adria Navarro 34d3edc2db Add header 2023-12-14 10:07:45 +01:00
Michael Drury b9593d1933
Merge branch 'master' into fix/try-once-logging 2023-12-13 15:57:21 +00:00
mike12345567 c8128325c6 Improving type handling. 2023-12-13 15:39:04 +00:00
mike12345567 c4af5214ef Improving types around the writethrough cache, exposing the proper typing from the database and removing a log statement which is useless, errors are correctly propogated if they matter (and handled above this level with proper context) or in the 99% scenario it is not a real error (such as try once locks already being held) and a log is just spammy. 2023-12-13 15:08:23 +00:00
Sam Rose 4934b4a428
Fix broken test. 2023-12-13 11:58:56 +00:00
Sam Rose 614a659032
Merge branch 'master' of github.com:budibase/budibase into budi-7664-sqs-self-host-ui-for-detecting-lack-of-sqs-support 2023-12-12 14:44:08 +00:00
melohagan 9d56039d03
Revert TTL on signed urls (#12556) 2023-12-12 10:52:14 +00:00
Sam Rose 6b491815a5
Add isSqsAvailable key to the environment endpoint. 2023-12-11 15:22:02 +00:00
mike12345567 09bb15e67f Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-12-11 11:30:34 +00:00
Adria Navarro e5d27181f2
Merge branch 'master' into BUDI-7655/migration-backend 2023-12-11 09:31:56 +01:00
mike12345567 4302c720ed Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-12-08 16:13:09 +00:00
mike12345567 3dcb3062f5 Adding a check to make sure that encryption does not execute upon directories, as well as adding copy to warn that attachments are not encrypted. 2023-12-06 16:38:03 +00:00
mike12345567 244a1d9329 PR comment. 2023-12-06 14:47:13 +00:00
mike12345567 8628c67c90 Fixing typing issues. 2023-12-05 18:17:27 +00:00
mike12345567 33b7e4d5d2 Some final refactoring, using proper jwt lib rather than requiring (proper typing). 2023-12-05 16:28:19 +00:00
mike12345567 2bf65601a1 Another simplification. 2023-12-05 15:55:09 +00:00
mike12345567 50270b8854 Quick refactor while in the area. 2023-12-05 15:54:33 +00:00
Adria Navarro e7859a8a47
Merge branch 'master' into BUDI-7655/migration-backend 2023-12-05 12:57:37 +01:00
mike12345567 7e4a9016a8 Merge branch 'master' of github.com:Budibase/budibase into fix/massive-attachment-export 2023-12-04 18:08:59 +00:00
mike12345567 a7410020c7 Adding cookie clearing/logout for when a cross tenant session is detected, make sure that the cookie cannot be used/considered valid after the call is made. 2023-12-04 16:47:41 +00:00
Adria Navarro 8ac9420e5b Add middleware to queue 2023-12-04 16:30:07 +01:00
Adria Navarro e4237c0620 Remove conflicting typing 2023-12-04 15:15:40 +01:00
mike12345567 3e2311ad5c Merge branch 'master' of github.com:Budibase/budibase into fix/massive-attachment-export 2023-12-04 13:11:55 +00:00
Adria Navarro 188d5d09a2 Typo
Co-authored-by: Sam Rose <hello@samwho.dev>
2023-12-04 09:12:58 +01:00
Adria Navarro fa7693f6df Typo
Co-authored-by: Sam Rose <hello@samwho.dev>
2023-12-04 09:12:58 +01:00
Adria Navarro 7f52a1e28c Guard migration 2023-12-04 09:12:58 +01:00
Adria Navarro 14fc91d58a Add tests 2023-12-04 09:12:58 +01:00
Adria Navarro f62dd56dd6 Add doInAppMigrationContext 2023-12-04 09:12:58 +01:00
Adria Navarro fe0efc7539 Remove unused test context code 2023-12-04 09:12:57 +01:00
mike12345567 00a3c630ef Initial work to get file streaming working when dealing with a large amount of file exports, tested with up to 1.5GB of attachments. 2023-12-01 18:36:40 +00:00
Adria Navarro 12015c79ae Add comments 2023-11-30 18:39:33 +01:00
Adria Navarro 670853a0ea Renames 2023-11-30 18:39:33 +01:00
Adria Navarro fb72b77ac1 Use jest.useFakeTimers 2023-11-30 18:39:33 +01:00
Adria Navarro bd89633e61 Fix wrong commited code 2023-11-30 18:39:33 +01:00
Adria Navarro a8ac4eed6d Autoextend without ttl 2023-11-30 18:39:33 +01:00
Adria Navarro 25099ee28e Clean redlock test settings 2023-11-30 18:39:33 +01:00
Adria Navarro 57b4c08731 Increase timeouts 2023-11-30 18:39:33 +01:00
Adria Navarro dcb6933eaa Clean 2023-11-30 18:39:33 +01:00
Adria Navarro c86d949680 Add and dry tests 2023-11-30 18:39:33 +01:00
Adria Navarro db6517bc0c Use real sleeps 2023-11-30 18:39:33 +01:00
Adria Navarro 078384941a Clean 2023-11-30 18:39:33 +01:00
Adria Navarro 9c12c5b62e Fix comments 2023-11-30 18:39:33 +01:00
Adria Navarro 73fd1f66c5 Fix 2023-11-30 18:39:33 +01:00
Adria Navarro 4cd76ea0fc Add tests 2023-11-30 18:39:33 +01:00
Adria Navarro a32582eb8a Use autoextend as locktype 2023-11-30 18:39:33 +01:00
Adria Navarro 26a77298ac Use timers 2023-11-30 18:39:33 +01:00
Adria Navarro 5a7dbb0076 Async 2023-11-30 18:39:33 +01:00
Adria Navarro 3073397800 Fix ttl 2023-11-30 18:39:33 +01:00
Adria Navarro f71e1ac03a Allow locks without TTL 2023-11-30 18:39:33 +01:00
Martin McKeaveney 5301c1edd9 update presigned url time 2023-11-27 19:03:37 +00:00
Martin McKeaveney a65b29eb88 banner changes for new pricing, fix for onboarding to prevent flash of UI before onboarding tutorial 2023-11-27 18:50:44 +00:00
Andrew Kingston a05fc97715 Ensure adding a user as an app builder sets their role to creator 2023-11-24 15:54:46 +00:00
mike12345567 0636580d28 Merge branch 'creator-changes' of github.com:Budibase/budibase into creator-changes 2023-11-23 17:36:13 +00:00
mike12345567 b6c6e6ec6e Clearing out per-app builders when app is deleted. 2023-11-23 17:35:55 +00:00
Andrew Kingston d217053e87 Allow saving per-app builder metadata without a license 2023-11-23 17:29:01 +00:00
Andrew Kingston ce5d6267cc Move per creator utils into backend core, allow creators to create apps 2023-11-23 17:13:51 +00:00
Andrew Kingston c2c0012013 Add new permission type for creators, update app creation endpoint to allow creators and assign access to new apps 2023-11-23 16:22:16 +00:00
mike12345567 90a624884e Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-11-22 12:52:27 +00:00
Michael Drury 1d368be5de
Merge branch 'master' into fix/admin-user-backup 2023-11-22 10:59:45 +00:00
mike12345567 0144a5b844 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-11-21 18:16:11 +00:00
mike12345567 ddd8482013 Updating bb admin user creation so that it can be used incase in self host a user gets locked out, the environment variables can be used to create a simple user to access the system. 2023-11-21 17:30:11 +00:00
Adria Navarro 3a3658fd03
Merge branch 'master' into chore/lint_imports 2023-11-21 13:51:39 +01:00
mike12345567 0df315c478 There has been quite a few redlock errors the last while - the message does not provide much information about what is going wrong - trying to rectify this to see if this is an error that could be impacting performance. 2023-11-21 10:52:50 +00:00
Adria Navarro db2c20e3ae eslint import/newline-after-import 2023-11-20 21:52:29 +01:00
Adria Navarro 92f411bf77 Prettier 2023-11-20 21:48:49 +01:00
Adria Navarro 4d27ff1dc0 eslint import/no-duplicates 2023-11-20 21:48:49 +01:00
Adria Navarro 8e0cb4b17b
Merge branch 'master' into chore/lint_js_tests 2023-11-20 16:43:36 +01:00
mike12345567 8fdf378a57 Fix an issue with account portal redis connection, if no Redis port is supplied in URL we should assume the default port number 6379. 2023-11-20 15:34:16 +00:00
Adria Navarro 742eb4ff46 Lint fix 2023-11-20 15:36:55 +01:00
mike12345567 3228463749 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-11-17 17:23:25 +00:00
Michael Drury d4cb22f264
Merge branch 'master' into fix/cyclic-issues 2023-11-17 16:55:44 +00:00
mike12345567 258ea803bc Further PR comments. 2023-11-17 16:37:00 +00:00
mike12345567 57fa9baef8 PR comments and possible fix for test failures. 2023-11-17 16:33:58 +00:00
mike12345567 7fb6c0927a Moving things around to get rid of cyclics created by moving invite/passwordReset into backend-core - also updating currentapp test case to mock a bit better. 2023-11-17 16:20:10 +00:00
Adria Navarro 00f65f396e
Merge branch 'master' into fix/build-references 2023-11-17 14:45:41 +00:00
Adria Navarro e8abb5cb46 Detect non-barrel workspace usages 2023-11-17 14:39:52 +01:00
Sam Rose f2406889df
Merge branch 'master' into bug/budi-7008-i-was-able-to-send-two-invitations-to-the-same-user-email-2 2023-11-10 16:24:51 +00:00
Sam Rose 4c7c10b121
Set Redis initialisation back to how it was before I started messing with it. 2023-11-10 16:17:18 +00:00
mike12345567 a427d990a1 Quick addition - if the object has been deleted but the key is still known, then CouchDB will alert us to the fact that it is deleted, leaving the response in a weird state. 2023-11-10 11:58:07 +00:00
Sam Rose 94983c289f
Hook redis init flow into overall worker init flow. 2023-11-10 11:39:26 +00:00
Sam Rose dd2f68d099
Hook new Redis clients into init/shutdown flow. 2023-11-10 11:24:55 +00:00
Sam Rose d98e217c6c
Fix backend-core redis imports. 2023-11-10 11:21:36 +00:00
Sam Rose 15767e2fd5
Merge branch 'master' of github.com:budibase/budibase into bug/budi-7008-i-was-able-to-send-two-invitations-to-the-same-user-email-2 2023-11-10 11:15:38 +00:00
mike12345567 dde446286d Switching getMultiple to default to failure if not all entries found, then updating usages. 2023-11-09 17:08:14 +00:00
Sam Rose 7f530eeab5
Add tests for the onboarding endpoint. 2023-11-09 15:13:59 +00:00
mike12345567 37e34c8ed2 Adding the ability to fail on getMultiple if needed. 2023-11-09 14:53:14 +00:00
Sam Rose b29cfc600c
Move Invite and PasswordReset code into backend-core. 2023-11-09 14:51:07 +00:00
mike12345567 a26f2e83e4 Some of the new table getters did not account for table IDs not being found, adding a new function which properly accounts for IDs being missing and manages it correctly, rather than leaving tables in an undefined state. 2023-11-09 14:45:23 +00:00
Michael Drury c511f621d3
Merge branch 'master' into more-db-typing-improvements 2023-11-08 18:50:39 +00:00
Sam Rose e3a4c34f8d
Pass types through context callbacks. 2023-11-08 16:17:24 +00:00
mike12345567 4dc6b1eeda Merge branch 'master' of github.com:Budibase/budibase into fix/11972-external-relationship-formulas 2023-11-08 14:41:53 +00:00
Sam Rose 47292b8ab4
Make DB name non-optional. 2023-11-08 14:37:19 +00:00
mike12345567 e8fb43d30c Updating DesignDocument and View typing - making it more clear how view and lucene indexing works. 2023-11-08 12:46:00 +00:00
Sam Rose fdfda100c1
Ensure that the DB always returns Documents. 2023-11-07 18:14:52 +00:00
mike12345567 8d35453f01 Adding test case for circular detection. 2023-11-07 13:56:42 +00:00
mike12345567 312415ca7d Enforcing squash for rows which contain circular structures. 2023-11-07 13:47:21 +00:00
Martin McKeaveney 5dd6c40a29
Merge branch 'master' into fix/update-bull-queue-parameters 2023-11-06 18:02:49 +00:00
mike12345567 08c4ba0097 Updating redis option functions usage, as it is no longer returned as a part of the getRedisOptions response. 2023-11-03 18:06:12 +00:00
mike12345567 7bf307b0c2 Further updates to typing. 2023-11-03 18:03:11 +00:00
mike12345567 001cf01303 Updating public API rate limiting functionality to be better typed as well. 2023-11-03 18:00:13 +00:00
mike12345567 f8f1ec4ce9 Removing old redisProtocol string - it is causing confusion and should not be necessary. 2023-11-03 17:17:20 +00:00
Sam Rose a27a9dc2af
Eliminate TOCTOU problem in creating bbTmp. 2023-11-03 14:29:54 +00:00
Michael Drury 12a7811847
Revert "Reverting changes to bull parameters" 2023-11-03 13:05:23 +00:00
Michael Drury 96534e625f
Revert "Updating bull parameters - help queue stalling" 2023-11-03 12:22:32 +00:00
mike12345567 17b6985f06 Adding a duration utility for changing between time types. 2023-11-01 17:48:13 +00:00
mike12345567 de1862448d Merge branch 'master' of github.com:Budibase/budibase into fix/update-bull-queue-parameters 2023-11-01 17:18:07 +00:00
mike12345567 df6f8dad7e Updating bull parameters to see if this helps with queue stalling. 2023-10-31 16:56:19 +00:00
Andrew Kingston 68553e85d4 Simplify page size logic in user search 2023-10-31 13:01:19 +00:00
Andrew Kingston 99a0c8b08b Fix bug breaking pagination in global users search 2023-10-31 12:10:41 +00:00
Sam Rose d0fecc1c64
Merge branch 'master' into feature/budi-7607-migrate-user-relationship-columns-to-the-new-user-column 2023-10-30 09:45:21 +00:00
jvcalderon cd283ad0b0 Merge branch 'master' into feature/per-creator-final 2023-10-30 09:02:02 +01:00
mike12345567 330059991e Removing any. 2023-10-27 18:04:28 +01:00
mike12345567 d4929ea3b6 Fixing an issue where unpublished apps with custom roles, when used in groups would cause users to be unable to login. 2023-10-27 18:03:06 +01:00
Sam Rose 45543cbc03
Catch a few more edge cases with column names, add tests for them. 2023-10-27 15:59:31 +01:00
Sam Rose 536d85d828
WIP: Improving the use of DatabaseQueryOpts. 2023-10-26 15:04:33 +01:00
Michael Drury c6b377c565
Revert "Revert "Client library fetching through server"" 2023-10-24 18:13:36 +01:00
Michael Drury e2e5c9044c
Revert "Client library fetching through server" 2023-10-24 18:12:20 +01:00
Michael Drury 2888335724
Merge branch 'master' into fix/client-lib-fetching 2023-10-24 17:31:44 +01:00
mike12345567 701d30abb4 Don't pass through default tenant ID. 2023-10-24 17:30:57 +01:00
mike12345567 ba5b1d7cfa Adding tenant ID to query string and fixing test cases. 2023-10-24 17:27:58 +01:00
mike12345567 b53158ac08 Moving the client library to be retrieved using the same mechanism as we do in development, through the server instance (same as the builder itself). This should help with the CDN issues that we have been having, although attachments are still currently affected. 2023-10-24 16:25:14 +01:00
jvcalderon cea1c04b73 Creators count functionality 2023-10-24 17:16:44 +02:00
jvcalderon 980a46abb3 Merge branch 'master' into feature/per-creator-migration 2023-10-24 11:03:02 +02:00
jvcalderon f643bc5ee8 Keep only migrations 2023-10-24 10:24:00 +02:00
Adria Navarro 3deb8341d3
Merge branch 'master' into BUDI-7641/package_version_from_env 2023-10-23 15:57:24 +02:00
Adria Navarro 3c85f1ce9e Fix after renames 2023-10-23 13:55:58 +02:00
jvcalderon a285fb1d40 Missed code in merge 2023-10-23 13:33:27 +02:00
jvcalderon 648410348d [Revert] [Added] Per user per creator changes 2023-10-23 13:27:59 +02:00
Adria Navarro 4ee1fd0f7a Default to package.json 2023-10-23 12:23:44 +02:00
Adria Navarro e83e45e2b6
Merge branch 'master' into BUDI-7641/package_version_from_env 2023-10-20 17:40:17 +02:00
mike12345567 04a2bbc61a Two fixes here - a quick fix for the builder side panel, making sure it fills up with users correctly (not all, but enough to make it look more pleasant) as well as dropping user search endpoint permissions to allow basic users to access it for user columns. 2023-10-20 15:45:35 +01:00
Adria Navarro 961913b88a Use version from environment 2023-10-20 16:21:35 +02:00
mike12345567 fdfd58391a Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-10-19 18:25:11 +01:00
jvcalderon 44474b063a Merge branch 'master' into features/per-user-per-creator-realease2 2023-10-18 13:43:11 +02:00
jvcalderon 5b2f55a592 Per user per creator changes 2023-10-18 13:36:34 +02:00
Sam Rose 767900aec6
Remove type information from JSDoc in .ts files, it's redundant. 2023-10-17 16:46:32 +01:00
mike12345567 b267e4ca28 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-10-17 14:53:09 +01:00
Adria Navarro 26618794ae Merge branch 'master' into BUDI-7573/use_existing_image_cache 2023-10-16 16:17:26 +02:00
Martin McKeaveney 2ef9871fda merge with master 2023-10-16 14:42:50 +01:00
Adria Navarro dc4fc27fc8 Merge branch 'master' into BUDI-7573/use_existing_image_cache 2023-10-16 10:38:09 +02:00
mike12345567 d3366a535b PR comments. 2023-10-13 10:22:29 +01:00
Adria Navarro 5ef90a3855 Fix import 2023-10-13 09:08:07 +02:00
mike12345567 16d551542e Frontend component of updating the API and accounting for default value not being in the paginated results of the relationship picker. 2023-10-12 19:00:53 +01:00
mike12345567 7b8e23eb82 Merge branch 'master' of github.com:Budibase/budibase into BUDI-7573/use_existing_image_cache 2023-10-12 11:08:12 +01:00
mike12345567 f1b73058c2 Merge branch 'fix/update-vm2' of github.com:Budibase/budibase into backmerge-20231011 2023-10-11 18:49:39 +01:00
Adria Navarro f22467fa53 Validate user column 2023-10-10 13:52:47 +02:00
mike12345567 c87a67a37a Converting user IDs where necessary to global user IDs in the frontend, correcting the null entry when using current user IDs, or other user IDs, as a default value for a user column form type. 2023-10-09 18:18:34 +01:00
Adria Navarro 18545b1c79 Fix vulnerabilities 2023-10-03 23:45:39 +02:00
mike12345567 8db231064a Merge branch 'develop' of github.com:Budibase/budibase into labday/sqs 2023-10-03 12:58:49 +01:00
Samuel Martineau 84d30e4f4a Merge branch 'Budibase:develop' into allow-plugins-contribute-datasourceplus 2023-10-02 17:49:34 -04:00
mike12345567 1db95a3006 Merge branch 'develop' of github.com:Budibase/budibase into labday/sqs 2023-10-02 16:32:10 +01:00
Michael Drury a67f78fead Merge branch 'develop' into fix/BUDI-7236 2023-09-27 17:08:21 +01:00
Martin McKeaveney 65af2ed7c2 backmerge from master 2023-09-27 17:06:57 +01:00
mike12345567 395969e0f0 Fixing build issue,. 2023-09-27 16:24:12 +01:00
mike12345567 4bfda10fbb Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-7236 2023-09-27 15:51:49 +01:00
mike12345567 e916178046 Adding test case for new endpoint and covering public, builder and normal roles. 2023-09-27 15:46:04 +01:00
mike12345567 bb2892cbc2 Getting client library loading in Webstorm debug, as well as adding accessible roles endpoint. 2023-09-27 14:21:25 +01:00
Samuel Martineau 08bbfa09c2 Merge branch 'Budibase:develop' into allow-plugins-contribute-datasourceplus 2023-09-26 21:28:26 -04:00
Samuel-Martineau 2aac1c992a Correct bugs with Datasource+ plugins 2023-09-26 21:26:40 -04:00
Adria Navarro 1fdb822699 Missing dependencies 2023-09-26 13:09:16 +02:00
Martin McKeaveney 83f042eeaf update name of platform users view so it rebuilds 2023-09-25 13:57:10 +01:00
Martin McKeaveney 6d4e3082e3 type tidy up and lint 2023-09-24 22:07:40 +01:00
Samuel-Martineau df111f8b44 Allow plugins to contribute DatasourcePlus integrations 2023-09-23 14:05:49 -04:00
Martin McKeaveney b979b29313 e2e secure microsoft auth 2023-09-23 00:10:12 +01:00
Adria Navarro 9cd7ef7827 Typing redis 2023-09-19 14:32:05 +02:00
Adria Navarro e128f1c921 Fix types 2023-09-19 13:28:24 +02:00
Adria Navarro 1d63b219b8 Make use of UserDB 2023-09-19 13:28:24 +02:00
Adria Navarro 9e1ccc35ee Handle missing users 2023-09-19 13:28:24 +02:00
Adria Navarro 7b4585ce68 Tenantid optional 2023-09-19 13:28:24 +02:00
Adria Navarro 6f1d027126 Fix test 2023-09-19 13:28:24 +02:00
Adria Navarro 4311d563d2 Add tests 2023-09-19 13:28:24 +02:00
Adria Navarro d3b04ef4de Add tests 2023-09-19 13:28:24 +02:00
Adria Navarro 3336433de8 User cache, get in bulk 2023-09-19 13:28:24 +02:00
Mitch-Budibase 64ec4fe9e2 Merge branch 'develop' into account-portal-auth-api-testing-2 2023-09-07 16:39:37 +01:00
Adria Navarro 205d33f172 Clean cypress refs 2023-09-07 15:37:22 +02:00
Mitch-Budibase 6fb012dc04 Merge branch 'develop' into account-portal-auth-api-testing-2 2023-09-06 10:19:21 +01:00
Adria Navarro b0dc777af7 Fix role tests 2023-09-06 01:34:39 +02:00
Mitch-Budibase 720516ed9f Merge branch 'develop' into account-portal-auth-api-testing-2 2023-09-05 13:44:54 +01:00
mike12345567 83875cd2d6 Merge branch 'develop' of github.com:Budibase/budibase into merge-master-develop 2023-09-05 12:29:27 +01:00
mike12345567 d096f359d7 Revert "Revert "Merge branch 'develop' into master""
This reverts commit 3265042025.
2023-09-05 12:28:56 +01:00
Adria Navarro 5ee4f6f6cc Clean code 2023-09-04 17:03:25 +02:00
Adria Navarro 111e999962 Merge branch 'develop' into BUDI-7393/use_permissions_on_middleware 2023-09-04 15:51:45 +02:00
Adria Navarro fc0ee3f462 Types 2023-09-04 13:23:21 +02:00
Adria Navarro a012c0a458 Add back base default legacy views permissions 2023-09-04 12:00:58 +02:00
Rory Powell 64af549341 Revert "Merge pull request #11489 from Budibase/fix/automation-disable"
This reverts commit e6319cce67, reversing
changes made to 7c12280fe3.
2023-09-01 15:12:23 +01:00
Mitch-Budibase 178b807573 Merge branch 'develop' into account-portal-auth-api-testing-2 2023-08-30 15:14:48 +01:00
Martin McKeaveney 3265042025 Revert "Merge branch 'develop' into master"
This reverts commit 99adc2039b, reversing
changes made to fec20e526e.
2023-08-29 14:27:39 +01:00
mike12345567 3395a5b96b Some other minor changes to fully support the per app builder from groups, making sure middlewares are properly aware. 2023-08-22 19:15:47 +01:00
mike12345567 a5a1c62eb1 Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7108 2023-08-18 14:34:08 +01:00
mike12345567 7110351bdc Revert "revert develop into master"
This reverts commit fd099658a0.
2023-08-18 14:33:21 +01:00
mike12345567 aef7f28ccb Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7108 2023-08-18 13:30:47 +01:00
mike12345567 621b1fadea Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7108 2023-08-18 13:22:34 +01:00
mike12345567 9cfab6fbfd Merge branch 'fix/automation-improvements' of github.com:Budibase/budibase into fix/automation-improvements 2023-08-17 17:45:17 +01:00
mike12345567 ba5e390b3f Quick PR comments. 2023-08-17 17:44:59 +01:00
mike12345567 e174211440 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-08-17 17:34:44 +01:00
melohagan b57a8c1130 Move when filter empty option into filter drawer (#11262)
* Add when filter empty dropdown

* Add unit tests

* "fix" typescript issue

* Add empty filter check for external

* Add unit test

* Hide empty filter option for custom query

* Make onEmptyFilter optional

* Fix unit tests

* Remove onEmptyFilter automation input

* Remove unused var

* Refactor

* Fix path

* Fix type issue

* Fix types
2023-08-17 13:31:52 +01:00
Martin McKeaveney fd099658a0 revert develop into master 2023-08-17 10:28:15 +01:00
mike12345567 a6a70c2d09 Building out the role assignment/unassignment APIs as new components of the public API. 2023-08-15 16:46:21 +01:00
Adria Navarro f6838631b0 Merge branch 'develop' into master-backmerge-20230810 2023-08-10 15:32:00 +03:00
mike12345567 63006e36d4 Adding the ability to disable an automation, as well making sure that automations have steps before running. 2023-08-09 16:24:57 +01:00
mike12345567 41a9041268 PR fixes. 2023-08-07 16:36:28 +01:00
jvcalderon 989bfe76fb Merge branch 'develop' into account-portal-auth-api-testing-2 2023-08-02 17:44:01 +02:00
Adria Navarro e011ccd0c4 Merge branch 'develop' into chore/typecheck_tests 2023-08-01 16:49:06 +01:00
Adria Navarro 8b693a6fa3 Check types on backend-core 2023-08-01 13:08:09 +02:00
mike12345567 dce38908c9 PR comments (backend). 2023-08-01 10:56:47 +01:00
mike12345567 7a74ce98f1 Moving user functions in UserDB to fully static as none of the class properties ever change - simplifying currying. 2023-07-31 18:46:21 +01:00
mike12345567 31f9693185 Quick update to SCIM now that user functionality is available from backend-core. 2023-07-31 17:10:27 +01:00
jvcalderon 17980d4bcc Merge account-portal-auth-api-testing 2023-07-31 16:09:45 +02:00
mike12345567 8522cb94d3 Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-28 17:10:43 +01:00
mike12345567 7b9f86d7ea Fix found by authorized test case. 2023-07-28 17:06:53 +01:00
mike12345567 3a211b8865 Some builder test cases, check the service type switch works as expected. 2023-07-28 16:50:44 +01:00
Adria Navarro beaeff90cc Improve lodash imports 2023-07-28 17:11:48 +02:00
mike12345567 f061426b60 Fixing build issue. 2023-07-28 16:08:33 +01:00
mike12345567 72438f531d Update for worker, get builder endpoints working for app builders. 2023-07-28 15:39:59 +01:00
mike12345567 454f832b75 Updates after running through tests, adding mocking of app builders feature for test cases to work. 2023-07-28 12:58:05 +01:00
mike12345567 7d978e0dec Making sure that if the app builders are updated through the API, they are ignored. 2023-07-27 18:50:45 +01:00
mike12345567 812f1af5ca Moving app builder API into pro, along with the changes involved with achieving this. 2023-07-27 18:46:55 +01:00
mike12345567 64a5426d36 Updates to remove app builder concept, denying access to app creation for app builders. 2023-07-26 17:32:21 +01:00
mike12345567 43024e1a30 Merge branch 'develop' of github.com:Budibase/budibase into labday/sqs 2023-07-26 14:40:49 +01:00
mike12345567 8253ad0a2e Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-26 14:24:29 +01:00
mike12345567 43bfb943a3 Some fixes post testing. 2023-07-25 18:52:59 +01:00
Adria Navarro 3ce92e8034 Implement and test external field selector 2023-07-25 19:48:46 +02:00
Adria Navarro d93c99b947 Return data when schema is defined 2023-07-25 19:48:46 +02:00
mike12345567 66fbdfe4e8 Breaking out pro components back into the worker user SDK, and attempting to separate the pro components as much as possible from the user SDK itself, so that it can be easily re-created in other services. 2023-07-25 18:39:40 +01:00
mike12345567 90371b9d69 Refactoring users core to move into backend, allowing app builder endpoints to move into pro. 2023-07-25 17:48:57 +01:00
mike12345567 c375f860ba Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-24 13:46:49 +01:00
Rory Powell 5c4d29e349 Merge branch 'develop' into feature/offline-license 2023-07-24 10:06:04 +01:00
Martin McKeaveney 7a327dc40d Merge branch 'develop' of github.com:Budibase/budibase into fix/bb-alerts 2023-07-23 09:45:52 +01:00
mike12345567 c185dd7dd0 Merge branch 'develop' of github.com:Budibase/budibase into labday/sqs 2023-07-21 18:41:48 +01:00
mike12345567 87d80e08f5 Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-21 17:34:27 +01:00
Adria Navarro d168a0b902 Honor level on logging 2023-07-21 17:52:54 +02:00
Adria Navarro 0ac639fe7a Add default process.stdout if no dev 2023-07-21 14:26:57 +02:00
Adria Navarro 2dcb1a67a1 Add service name to the logs only on self-host 2023-07-21 14:16:43 +02:00
Martin McKeaveney 108d18df75 fix type check for deleted app type 2023-07-21 09:57:37 +01:00
Martin McKeaveney 567c7fd485 code review 2023-07-21 09:43:25 +01:00
mike12345567 3abe5d4cb2 Frontend work to support logging in as an app builder - also making sure when a new app is created that the user is assigned app access to it. 2023-07-20 18:34:12 +01:00
Martin McKeaveney b5340c20d8 lint 2023-07-20 16:56:31 +01:00
Martin McKeaveney 6b6fba9393 optional chain 2023-07-20 16:38:24 +01:00
Martin McKeaveney 054fb24ea9 demote some app metadata related bb-alert messages 2023-07-20 16:15:59 +01:00
mike12345567 b84b8dd988 Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-20 14:25:04 +01:00
Rory Powell 5ac024a655 Merge branch 'develop' into feature/offline-license 2023-07-20 12:27:04 +01:00
mike12345567 e469abb679 reworking frontend to use shared core functions to check if is admin or builder (needs further expansion). 2023-07-19 18:05:02 +01:00
Rory Powell 6631c2644d Fixing merge issue 2023-07-19 17:18:37 +01:00
mike12345567 85dea47a31 Moving user admin/builder functions to shared-core for frontend to use. 2023-07-19 16:19:34 +01:00
Mitch-Budibase 7eb65ed347 Merge branch 'develop' into account-api-tests 2023-07-19 15:21:50 +01:00
Rory Powell c5337c652a Remove no longer needed `LOG_CONTEXT` setting on logger module, update qa-core to disable pino logger via env var, add configurable jest timeout via env var 2023-07-18 21:13:17 +01:00
mike12345567 91847504c8 Adding test cases for admin/builder checking middlewares. 2023-07-18 18:10:15 +01:00
mike12345567 39746e0bf0 Main body of work to handle the new approach of per app builders support. 2023-07-18 16:57:48 +01:00
Adria Navarro 1072292b9f Type breaking changes as any 2023-07-18 10:49:39 +02:00
Mitch-Budibase d8d4686e01 Account Portal API Testing 2023-07-13 12:36:50 +01:00
Adria Navarro c7f6f6b73c Merge branch 'develop' into backmerge-20230711 2023-07-11 15:34:58 +01:00
Adria Navarro 252ee9d27c Dropping the default values 2023-07-11 14:02:18 +02:00
Adria Navarro 2d27587d0c Support even values 2023-07-11 14:01:42 +02:00
Adria Navarro dc73e57ba8 Respect max values 2023-07-11 13:48:52 +02:00
Adria Navarro 6e2a8e0ab9 Rename .log extensions 2023-07-11 13:09:51 +02:00
melohagan 0ccfaf03af Fixing problems when switching between match any and match all (#11179)
* Make sure displayed filter count is correct

* Fix for false boolean filter
2023-07-11 10:06:19 +01:00
Adria Navarro e0c0e9bd65 Clean 2023-07-11 10:44:10 +02:00
Adria Navarro 2585b73723 Use native history 2023-07-11 10:44:10 +02:00
Adria Navarro 8375ea4c5a Fix order 2023-07-11 10:44:10 +02:00
Adria Navarro bb28d09eab Add logs endpoint 2023-07-11 10:44:09 +02:00
Adria Navarro 61abb7541a Fix imports 2023-07-11 10:44:09 +02:00
Adria Navarro 580985c7be Extract code 2023-07-11 10:44:09 +02:00
Adria Navarro e351a77f75 Decorate service 2023-07-11 10:44:09 +02:00
Adria Navarro b0f2306c50 Fix types 2023-07-11 10:44:09 +02:00
Adria Navarro 2411b59709 Unify logs 2023-07-11 10:44:09 +02:00
Adria Navarro ef0888fcad Read package name 2023-07-11 10:44:09 +02:00
Adria Navarro a50834127a Use destinations instead of transports 2023-07-11 10:44:09 +02:00
Adria Navarro ff67df8e79 Rotate logs 2023-07-11 10:44:09 +02:00
Adria Navarro d33663f5ac Store logs to file 2023-07-11 10:44:09 +02:00
Rory Powell 6ae59d767b offline license sdk module 2023-07-10 12:48:52 +01:00
Rory Powell 7831579e98 api / license.spec.ts updates 2023-07-07 21:15:40 +01:00
mike12345567 adef1ed5ce Initial attempt to get SQS up and running within BB. 2023-07-06 21:49:25 +01:00
Rory Powell 586bca16d0 Move OFFLINE_MODE to backend-core environment 2023-07-06 20:44:48 +01:00
mike12345567 c1e9bc3c81 PR comments. 2023-07-04 11:59:56 +01:00
mike12345567 deca999183 Allowing logWarn to take an object for warning. 2023-07-03 16:01:54 +01:00
mike12345567 4e560a1f32 Adding warning back in for non-409 errors of user sync. 2023-07-03 16:00:33 +01:00
Michael Drury f7cdf5f2bc Merge pull request #11001 from Budibase/feature/custom-role-readable-ids
Custom roles - readable IDs
2023-06-27 16:17:08 +01:00
mike12345567 fc537a0aab Further PR comments. 2023-06-27 14:56:24 +01:00
Michael Drury a3ebcb2896 Merge pull request #11033 from Budibase/fix/BUDI-7188
Don't sync automation logs from prod to dev app
2023-06-27 12:52:07 +01:00
mike12345567 4d2aa2a67b PR comments. 2023-06-27 12:45:00 +01:00
Dean eaecd3ab68 Merge remote-tracking branch 'origin/develop' into merge-master 2023-06-27 09:31:35 +01:00
mike12345567 3eff4d85d0 Adding a test case for the removal of automation logs from app sync, as well as adding to the publish/sync filter a check to not carry over automation logs. 2023-06-26 18:52:15 +01:00
Dean ceecd85d76 OIDC icon fix recreated on a new branch 2023-06-23 14:47:58 +01:00
mike12345567 baecab785d Handling the removal of the role_ prefix where applicable so that new role IDs present in the exact same way as built in roles. 2023-06-22 18:02:35 +01:00
Dean 998f1806aa Updated analytics tests to account for the embedded 2023-06-20 16:29:09 +01:00
Dean 2304032423 Added embed state, behaviours and event tracking to client app. UI/UX Refactoring 2023-06-16 12:30:08 +01:00
Jonny McCullagh 757ca6a166 Merge master develop (#10897)
* Binding drawer fixes

* Added missing headless flag for the bindable combobox

* Fix for QueryEditor width

* Fix svelte transitions in grid new row component breaking routify

* Bump version to 2.7.7

* fix REST connector failure to save

* Bump version to 2.7.8

* Bump version to 2.7.9

* Unexpected token when export data (#10721)

* Tidy ID string for JSON parse

* Display error for composite keys

* Unit test WIP

* directly assign the mock function on the datasource

* Unit tests for exportRows ID handling

---------

Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>

* Return all rows if oneOf value is falsey (#10638)

* Bump version to 2.7.10

* Make sure divider fields are left-most (#10627)

* Make sure divider fields are left most

* Refactor

* Bump version to 2.7.11

* Temporarily remove the focus store update as it triggers a full redraw of the component settings

* Linting

* Removed commented out code

* Bump version to 2.7.12

* Bump version to 2.7.13

* Do not show Business tag for Email action (#10867)

* Bump version to 2.7.14

* new deploy trigger (#10892)

* point the deploys at the new env

* Bump version to 2.7.15

---------

Co-authored-by: Dean <deanhannigan@gmail.com>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: Budibase Staging Release Bot <>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Adria Navarro <adria@budibase.com>
2023-06-14 16:18:09 +01:00
Michael Drury 6776f3d78c Merge pull request #10881 from Budibase/fix/budi-7026
Custom roles breaking app access when not published
2023-06-14 15:10:30 +01:00
Adria Navarro 4b065dda8b Fix exports/imports 2023-06-14 12:32:26 +01:00
mike12345567 1bdf55e966 Some type updates and fixes for test case. 2023-06-13 14:45:33 +01:00
mike12345567 bedc8e5cce Fix for custom roles that have not been published causing users to be unable to access an app completely. They should instead be treated as public users as their role isn't valid. 2023-06-12 18:39:30 +01:00
Adria Navarro 57c5facc6e Zip exports 2023-06-12 17:54:09 +01:00
Adria Navarro 70798a6b93 Clean 2023-06-12 17:50:07 +01:00
Adria Navarro ded738a566 Clean code 2023-06-12 17:49:12 +01:00
Adria Navarro 92a8c97aba Close streams 2023-06-12 17:34:12 +01:00
Adria Navarro 2971dfba9d Renames 2023-06-12 17:31:08 +01:00
Adria Navarro 551ca404b4 Decrypt file 2023-06-12 16:27:19 +01:00
Adria Navarro 1f4cdf348f Encrypt files 2023-06-12 11:49:38 +01:00
Adria Navarro 978591e2ba Enable encrypting 2023-06-09 16:26:48 +01:00
melohagan b88e5ecc95 Return all rows if oneOf value is falsey (#10638) 2023-06-09 13:02:29 +01:00
mike12345567 532583e66e Fixing develop currentapp.spec.js test case, when packages within backend-core import all of backend-core they can create cyclics that cause issues. 2023-06-08 13:47:16 +01:00
Adria Navarro deeba8bae3 Revert "Merge branch 'develop' into master"
This reverts commit 6f29c978e0, reversing
changes made to 1c6ff73c19.
2023-06-06 22:06:34 +01:00
Rory Powell ad7f6cf5e2 Merge branch 'develop' into merge-master 2023-06-06 11:49:49 +01:00
Adria Navarro 25c921e340 Validate url 2023-06-06 11:29:49 +01:00
Adria Navarro d4ba73f331 Open continue 2023-06-06 11:29:49 +01:00
Adria Navarro 3a6a3eb8a5 Store tokens in cache and amend redirect 2023-06-06 11:29:49 +01:00
Andrew Kingston d70e49d74f Add event for tracking user collaboration 2023-06-06 10:11:51 +01:00
Rory Powell abbd8c5c8b Merge branch 'master' into develop 2023-06-05 23:19:43 +01:00
Andrew Kingston 680b70643c Merge pull request #10775 from Budibase/collaboration-fixes
Collaboration fixes
2023-06-02 18:03:11 +01:00
mike12345567 c13530ef32 Stop attempt at bundling ioredis-mock, only need to check at runtime. 2023-06-02 13:59:33 +01:00
mike12345567 ddeb25b68d Updating mock redis to only import if it is needed. 2023-06-02 11:52:50 +01:00
Andrew Kingston d8d3d71523 Update websocket logic to ignore events trigger by API requests originating from the same session 2023-06-01 17:14:32 +01:00
Michael Drury a3f9759a47 Reverting ioredis-mock removal for test cases - will come back to this in future as it currently breaks pro tests. 2023-06-01 00:02:55 +01:00
mike12345567 fba3ec987e Merge branch 'develop' of github.com:Budibase/budibase into fix/datasource-info-endpoint 2023-05-31 17:37:17 +01:00
mike12345567 249625ad1a Updating backend tests to actually utilise the redis container which is spun up as part of the tests, doing away with the somewhat problematic ioredis-mock which was breaking some tests due to the addition of the changes for multi-dev collab. 2023-05-31 17:18:01 +01:00
Andrew Kingston 8a2d4b7052 Merge branch 'develop' of github.com:Budibase/budibase into websocket-redis-integration 2023-05-31 16:28:14 +01:00
Andrew Kingston e3b5d711df Disable redis select command in tests 2023-05-31 16:27:49 +01:00
Andrew Kingston ffbbf04e86 Lint 2023-05-31 16:08:35 +01:00
Andrew Kingston 05e34076f7 Fully rewrite websocket redis integration to use individual keys per session, enable TTLs on sesisons, prune sessions when users connect and add a heartbeat to sockets 2023-05-31 15:13:22 +01:00
Andrew Kingston d926650232 Add back in functionality to select different redis DB's per client 2023-05-31 10:52:39 +01:00
Michael Drury 1547280514 Merge pull request #10739 from Budibase/fix/multi-dev-conflicts
Multidev lock and conflict management
2023-05-30 22:57:00 +01:00
Michael Drury 99607ca06e Reverting try twice change to writethrough. 2023-05-30 20:45:10 +01:00
Michael Drury 5249148d6c Updating writethrough test to be aware of the double attempt locks. 2023-05-30 20:20:22 +01:00
mike12345567 7c7bd4d5cb Fix for debugging with webstorm the old way (if desired), updating the builder middleware to be more multi-dev capable, ignoring 409s when attempting to update the last updated at for apps (if multiple devs hit at same time, only use one) also updating writethrough cache to retry once, with the extended TTL on locks, plus the multi-dev collab it can take a minute to update usage quota doc when a lot of updates occur at once. 2023-05-30 17:41:20 +01:00
Rory Powell 6230e62b9b Automation investigation logging + max doc size fix for automation log 2023-05-30 16:37:39 +01:00
Andrew Kingston 5e480a1527 Use socker.io redis adapter to broadcast events to all server instances 2023-05-25 08:48:56 +01:00
Michael Drury 62e9777407 Merge pull request #10633 from Budibase/fix/live-app-user-updates
Production app user updates
2023-05-18 10:46:31 +01:00
Rory Powell a685f181da Merge branch 'master' into develop 2023-05-18 09:10:51 +01:00
Rory Powell 55ee94892a Support setting object name for logged json objects 2023-05-17 22:18:50 +01:00
mike12345567 5fdd7d9076 Fixing an issue with the tenant ID not being found in self host (default) for identification purposes, stopping doc update queue from activating and working as expected. 2023-05-17 19:21:32 +01:00
Rory Powell 78daed6ec1 Lint 2023-05-17 15:31:14 +01:00
Rory Powell 0aff89a479 Merge pull request #10626 from Budibase/chore/automation-logging-updates
Automation logging updates
2023-05-17 14:58:16 +01:00
Rory Powell f41b134d31 Refactor to use param for doInAutomationContext 2023-05-17 14:57:29 +01:00
Rory Powell 6c412c7cd9 Test fix 2023-05-17 14:22:23 +01:00
Rory Powell 578b599428 Lint 2023-05-17 14:10:22 +01:00
Rory Powell ad37186665 Logging updates for automations 2023-05-17 13:54:20 +01:00
Adria Navarro 4f3139a47b Merge branch 'develop' into feature/datasource-conns 2023-05-17 12:00:56 +02:00
mike12345567 14806809e8 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-05-16 14:54:44 +01:00
mike12345567 1aad88adc8 Fix for CLI startup complaining about version not being found. 2023-05-15 15:52:59 +01:00
Adria Navarro 5456866c45 Fix tests to use connection string instead of env 2023-05-15 13:54:32 +02:00
Adria Navarro 209ada0c38 Validate couchdb 2023-05-15 13:54:32 +02:00
Adria Navarro deb73be17d Merge branch 'develop' into budi-6158/allow_searching_users
# Conflicts:
#	packages/pro
2023-05-15 13:02:03 +02:00
jvcalderon 946cd45b3f Refactor: BUILDER_REFERER_PREFIX -> BUILDER_APP_PREFIX 2023-05-12 15:59:42 +02:00
jvcalderon a48fc00a54 Change the PUBLIC_API_PREFIX to prevent failures if we increase in the future the API version 2023-05-12 15:54:59 +02:00
José Vte. Calderón 8eac0d99f7 Update packages/backend-core/src/utils/tests/utils.spec.ts
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-05-12 15:38:39 +02:00
jvcalderon 1f7ebe8502 Remove unneeded 'beforeEach' import 2023-05-12 15:34:57 +02:00
Adria Navarro 0d5c14f22a Rename view 2023-05-10 14:54:30 +02:00
Martin McKeaveney b387f969d9 allow passwordless redis 2023-05-08 15:59:12 +01:00
jvcalderon d4d1bc03b3 Fix ESLint 2023-05-08 13:42:26 +02:00
jvcalderon 80d3b99b90 Provide some functions to check the path in the context 2023-05-08 13:26:00 +02:00
Rory Powell 595db7d346 Merge pull request #10495 from Budibase/fix/custom-locks
Fix usage of custom locks
2023-05-05 15:21:58 +01:00
Rory Powell 1ba5eda149 Fix usage of custom locks 2023-05-05 14:42:21 +01:00
mike12345567 0d7959f720 Fixing some un-identified listeners, queue messages not being correctly printed, also improving the mechanism for detecting if in the main thread or not. 2023-05-04 17:20:21 +01:00
Martin McKeaveney 50de32a8a0 Merge pull request #10452 from Budibase/feature/clustering-support
attaching clustered mode to an env var
2023-05-04 14:25:23 +01:00
Martin McKeaveney 167dfd39d7 fix ts build 2023-05-04 13:32:17 +01:00
Rory Powell e1a147e823 Merge branch 'master' into develop 2023-05-03 16:06:42 +01:00
Rory Powell 7762235769 Merge branch 'develop' into pricing/hubspot-updates 2023-05-03 13:51:13 +01:00
Rory Powell 9647ac5dee Create hubspot expansions and churns as users are added and deleted 2023-05-02 20:08:51 +01:00
mike12345567 f61f9eba68 Linting. 2023-05-02 16:28:56 +01:00
mike12345567 552499b781 Re-writing the disabling of pino/logging - it seems that the pino logger is causing a variety of issues in the built CLI version - easier to offer an environment variable for backend-core which completely removes the logger. 2023-05-02 16:22:43 +01:00
Martin McKeaveney e75e91e248 control all redis clustering through env var 2023-04-28 19:53:15 +01:00
Martin McKeaveney f73af919a7 attaching clustered mode to an env var 2023-04-28 19:09:22 +01:00
melohagan 8742fb39d3 is empty lucene query with OR fix (#10451)
* empty lucene query with OR fix

* Fix unit test
2023-04-28 17:17:32 +01:00
Rory Powell 0b88848277 Lint 2023-04-28 11:24:05 +01:00
Rory Powell a20dfa588a Type updates for plan changed event 2023-04-27 21:58:42 +01:00
Adria Navarro c47ff6ccfb Merge branch 'develop' into chore/remove_package.json_dependency 2023-04-24 18:42:55 +02:00
Martin McKeaveney 86dc082f57 Merge pull request #10366 from Budibase/budi-5186-dynamic-filter-contains-option
Dynamic filter contains option
2023-04-24 09:32:58 +01:00
Rory Powell ec06f13aa6 Per user pricing (#10378)
* Update pro version to 2.4.44-alpha.9 (#10231)

Co-authored-by: Budibase Staging Release Bot <>

* Track installation and unique tenant id on licence activate (#10146)

* changes and exports

* removing the extend

* Lint + tidy

* Update account.ts

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>

* Type updates for loading new plans (#10245)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS` (#10247)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete + migration (#10250)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Lint

* Types and structures for user subscription quantity sync (#10280)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing for licensing (#10346)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing

* Lint

* Pricing/billing page (#10353)

* bbui updates for billing page

* Require all PlanTypes in PlanMinimums for compile time safety

* fix test package utils

* Incoming user limits warnings (#10379)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* Types and test updates for subscription quantity changes in account-portal (#10372)

* Add chance extensions for `arrayOf`. Update events spies with license events

* Add generics to doInTenant response

* Update account structure with quota usage

* User count limits (#10385)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* user limit messaging on add users modal

* user limit messaging on import users modal

* update licensing store to be more generic

* some styling updates

* remove console log

* Store tweaks

* Add startDate to Quota type

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>

* Lint

* Support custom lock options

* Reactivity fixes for add user modals

* Update ethereal email creds

* Add warn for getting invite from code error

* Extract disabling user import condition

* Handling unlimited users in modals logic and adding start date processing to store

* Lint

* Integration testing fixes (#10389)

* lint

---------

Co-authored-by: Mateus Badan de Pieri <mateuspieri@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Peter Clement <PClmnt@users.noreply.github.com>
2023-04-24 09:31:48 +01:00
Mel O'Hagan 458b23fc1b Add escape for forward slash 2023-04-20 21:57:48 +01:00
Mel O'Hagan 66a573dcc9 Fix fuzzy search internal DB 2023-04-20 18:14:41 +01:00
Mel O'Hagan 68ba2402a0 Fix substring regex 2023-04-20 17:51:58 +01:00
Mel O'Hagan e58cd0a106 Check substring if contains not array 2023-04-20 17:30:45 +01:00
adrinr b128306262 Increase writethrough cache timeout 2023-04-19 16:47:48 +01:00
Michael Drury 42c37eea46 Merge pull request #10276 from Budibase/labday/automation-plugins
Automation step plugins
2023-04-18 17:33:25 +01:00
mike12345567 3b03766f9e Adding plugin validation unit tests. 2023-04-18 16:36:03 +01:00
mike12345567 b4e6cbce7a Some final updates to get tests passing again, issue with publisher tenant ID being the 'unique' format which cannot actually be used. 2023-04-17 15:59:59 +01:00
mike12345567 b6f14a3f55 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-17 14:58:40 +01:00
adrinr 8e95121ac8 Implement find version 2023-04-17 14:07:49 +01:00
mike12345567 453d5cc0e6 Further PR comments. 2023-04-17 14:03:54 +01:00
adrinr e5227febd8 Use version from environment 2023-04-17 14:02:50 +01:00
adrinr 33c3b67f8c Merge branch 'develop' into chore/remove_old_zlib_ref 2023-04-17 11:28:43 +01:00
adrinr ac4e45a433 Replace usages 2023-04-17 10:27:37 +01:00
Mateus Badan de Pieri de968b5332 changin syntax to permission function 2023-04-17 10:04:50 +01:00
Mateus Badan de Pieri 643ca614a4 changing test to it 2023-04-16 22:27:02 +01:00
Michael Drury ef5bcc4b66 Main body of PR comments, switching event handling to be a publisher of async events, a generic event; then adding a new async document update processor, which can later be converted to be part of the event processing pipeline. 2023-04-15 00:37:22 +01:00
Mateus Badan de Pieri 5180ac29d2 final functions being tested 2023-04-14 12:16:01 +01:00
Mateus Badan de Pieri 2f98ce9772 reverting some breaking changes 2023-04-14 11:45:27 +01:00
Mateus Badan de Pieri 038476523f doesHaveBasePermission tests 2023-04-14 11:39:52 +01:00
Mateus Badan de Pieri 696eea9f92 exporting function to test 2023-04-14 11:39:36 +01:00
Mateus Badan de Pieri fa83c5d7a1 added get allowed levels (not working yet) 2023-04-14 10:29:52 +01:00
Mateus Badan de Pieri 9bf580e761 Merge branch 'develop' into permissions-test 2023-04-14 10:27:35 +01:00
Mateus Badan de Pieri 62b5e08cde primary test cases, level to number working already 2023-04-14 10:25:38 +01:00
mike12345567 23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567 a9fb09424b Merge branch 'develop' of github.com:Budibase/budibase into labday/automation-plugins 2023-04-12 14:27:50 +01:00
mike12345567 3eb718ea6d Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 13:42:46 +01:00
Mateus Badan de Pieri df38368eaf removing tests 2023-04-12 11:06:01 +01:00
mike12345567 ada052e043 Merging in develop - fixing some test cases which broke in the process. 2023-04-12 10:56:21 +01:00
Mateus Badan de Pieri f427763308 export function to make test easier 2023-04-12 02:29:30 +01:00
Mateus Badan de Pieri ef0293bc6c encryption tests 100% 2023-04-12 02:25:53 +01:00
mike12345567 1aafdbe9a7 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-11 17:28:14 +01:00
adrinr c77ed3d737 Renames 2023-04-11 13:39:13 +01:00
adrinr e1279ffecd Use proper errors instead of string throwing 2023-04-11 13:39:13 +01:00
mike12345567 c4a4bdc9da Fixing tenancy.spec.ts - mocking was a bit messed up, moving it all around to work as expected. 2023-04-11 10:54:04 +01:00
Mateus Badan de Pieri de613d2b28 latest version 2023-04-11 10:22:47 +01:00
Michael Drury 1c7c06e983 Bulk of the automation plugin system, supporting custom plugins. 2023-04-10 23:48:54 +01:00
Michael Drury 4badd04e33 Some automation fixes and adding option to disable logging for CLI. 2023-04-10 22:33:53 +01:00
mike12345567 400a112a4b Refactoring automation steps to be better defined in Typescript, which allows writing the validator for automations. 2023-04-06 18:11:44 +01:00
mike12345567 0803b08217 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-05 17:59:18 +01:00
Mateus Badan de Pieri f1b7ff0f7c fixing expect on throw 2023-04-05 16:30:00 +01:00
Mateus Badan de Pieri b0df710a2a tweaks on some tests 2023-04-05 16:13:39 +01:00
Rory Powell 77ffb8d86d Run integration suite in CI again / auto detect tenancy / refactors (#10209)
* qa-core-ci-fixes

* global setup and teardown wip

* Updates to logs and setup

* Remove date and console mocking

* Update CI to spin up minimal dev env

* Update readme

* Fix scopeBackend.sh

* Ensure docker services are initialised before starting worker

* Lint

* Fix admin user being created on startup (#10219)

* use regular bootstrap and build

* Lint

* Temp: re-use global setup to get around app limit in QA
2023-04-05 15:33:56 +01:00
Mateus Badan de Pieri 6bd950717c mocked correctly 2023-04-05 14:14:55 +01:00
Rory Powell 976b3a55ca Update logging to support dd trace attributes (#10086)
* Update logging middleware to integrate with pino for console logging

* Remove elastic apm references, use updated core middlewares

* Remove redundant LOG_LEVEL definitions

* Remove no longer needed jest logging overrides

* lint

* Backwards compat between console log helpers and pino

* Configurable DISABLE_HTTP_LOGGING

* Don't log 4xx as errors

* Remove redundant ENABLE_4XX_HTTP_LOGGING

* Cleanup migrations and event logging

* Improve bb-alert logging

* Add DISABLE_HTTP_LOGGING to helm chart

* Add ops endpoints for testing

* Disable http logging in dev

* Backwards compatible tracing implementation

* Naming update on http logging env var

* lint

* Update packages/backend-core/src/environment.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Merge

* Lint

* Fix console.warn failing mock by replacing with alerts mock instead

* Lint

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-04-04 15:08:46 +01:00
mike12345567 e128642bce Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-04 13:37:59 +01:00
Michael Drury ff98ba5a0a Adding a document update queue based on the events which can be used to track when certain documents have changed, using this for users and groups to detect when a re-sync is needed. 2023-04-04 00:25:15 +01:00
adrinr c0d7f2329a Extract valid email util 2023-04-03 16:42:30 +01:00
Adria Navarro e1669c8260 Merge pull request #10022 from Budibase/feature/scim
Feature - SCIM endpoints
2023-04-03 13:22:01 +02:00
Mateus Badan de Pieri b6fd3b7cf7 primary tests cases 2023-04-03 11:28:20 +01:00
Mateus Badan de Pieri e6ac534fca isUserInAppTenant tests working 2023-03-31 15:07:28 +01:00
Michael Drury 1c6465edcb Merge pull request #10172 from Budibase/fix/budi-6797
Googlesheets onboarding - fix in cloud, disable self host
2023-03-31 13:19:29 +01:00
mike12345567 75baba76d6 Resolving PR comments. 2023-03-31 11:38:09 +01:00
adrinr 48b964378b Remove all app cookie references (not really needed anymore) 2023-03-31 09:01:40 +01:00
mike12345567 42320b1d95 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6797 2023-03-30 17:29:58 +01:00
Mateus Badan de Pieri 6404f07cfe first tenancy tests working 2023-03-30 17:27:13 +01:00
Mateus Badan de Pieri d03b27f79f first 2 tests passing 2023-03-30 17:08:18 +01:00
mike12345567 24fc72657d Fixing all broken test cases after breaking out context fully from jestSetup/backend-core jest loading. 2023-03-30 16:35:25 +01:00
mike12345567 47897c8afa Basic moving around of assets. 2023-03-30 16:07:59 +01:00
Rory Powell 38e6d61709 Explictly check for google datasource configured (#10165)
* Explictly check for google datasource configured

* Unit tests for getGoogleDatasourceConfig

* Update /api/global/configs/public test + lint
2023-03-30 13:40:59 +01:00
mike12345567 32c78ec9bf This makes it so that Googlesheets works correctly as part of onboarding in the Cloud, in self host the googlesheets onboarding option has been hidden as it is too complex to get the user to setup the correct integrations with their google account while doing the first time onboarding to an app. 2023-03-29 19:58:24 +01:00
Michael Drury d255bfad0b Merge pull request #10149 from Budibase/fix/budicloud-log-out
Budicloud logout on googlesheet auth
2023-03-29 14:47:15 +01:00
Rory Powell d6992bbf94 Merge branch 'master' into merge-master-develop 2023-03-29 11:52:09 +01:00
mike12345567 b7fe83ad17 Adding a check to config for isDev - don't use multi-tenant google SSO default in dev. 2023-03-28 18:14:04 +01:00
adrinr 31f94f6c3c Fix tests 2023-03-28 16:46:23 +01:00
Adria Navarro e662e8febe Update packages/backend-core/src/configs/configs.ts
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-03-28 16:46:23 +01:00
adrinr f7a34dedfa Use generic types instead of overrides 2023-03-28 16:46:23 +01:00
adrinr 1a9653a4db Tests configs 2023-03-28 16:46:23 +01:00
adrinr d0772ee142 Test when scim is disabled 2023-03-28 16:46:23 +01:00
adrinr 1838f75dbc Add test 2023-03-28 16:46:23 +01:00
adrinr 54265816cc Renames 2023-03-28 16:46:23 +01:00
adrinr 8a6400c7d0 Add viaScim to group events 2023-03-28 16:46:23 +01:00
adrinr 7821c637c6 Move event one level up 2023-03-28 16:46:23 +01:00
adrinr 099cc145bf Clean code 2023-03-28 16:46:23 +01:00
adrinr 04bd9dda9c Use new scim context functions 2023-03-28 16:46:23 +01:00
adrinr 62cd6a43f2 Remove "duplicated" events 2023-03-28 16:46:23 +01:00
adrinr 648247b10e Add scim info in update/delete user events 2023-03-28 16:46:23 +01:00
adrinr 6df08799bb Add isScim to user created event 2023-03-28 16:46:23 +01:00
adrinr 31eaa36883 Unify create events 2023-03-28 16:46:23 +01:00
adrinr 924c103ccc Use ids instead of email on the events 2023-03-28 16:46:23 +01:00
adrinr 26f077cc1c Event on delete 2023-03-28 16:46:23 +01:00
adrinr cbadf69a29 Dispatch event on user update 2023-03-28 16:46:23 +01:00
adrinr e6ff0a44fb Dispatch event on scim user created 2023-03-28 16:46:23 +01:00
adrinr 771e3b8862 Bookmark optional 2023-03-28 16:46:22 +01:00
adrinr 43c25436c8 Test skip with filters 2023-03-28 16:46:22 +01:00
adrinr 348b06948b Test limits 2023-03-28 16:46:22 +01:00
adrinr 9a2eaaad42 Test deep pagination 2023-03-28 16:46:22 +01:00
adrinr 30c66748af Add skip tests 2023-03-28 16:46:22 +01:00
adrinr 47cc291551 Exclude session fields 2023-03-28 16:46:22 +01:00
adrinr f181cb02d0 Remove comment 2023-03-28 16:46:22 +01:00
adrinr 5ffa51d1f4 Rename 2023-03-28 16:46:22 +01:00
adrinr 41537cd00c Add comments 2023-03-28 16:46:22 +01:00
adrinr bf32801917 Handle skip on execution 2023-03-28 16:46:22 +01:00
adrinr a91e4b4da1 Make QueryBuilder vars private 2023-03-28 16:46:22 +01:00
adrinr 06245fee98 Make includeDocs private 2023-03-28 16:46:22 +01:00
adrinr 6c6d060550 Remove view 2023-03-28 16:46:22 +01:00
adrinr 1c828db694 Return total rows 2023-03-28 16:46:22 +01:00
adrinr c763c6fae5 Expose index 2023-03-28 16:46:22 +01:00
mike12345567 900e6c8129 Adding search index for user. 2023-03-28 16:46:22 +01:00
adrinr 621c06eada Add view 2023-03-28 16:46:22 +01:00
adrinr 2072664294 Move user search to core 2023-03-28 16:46:22 +01:00
adrinr f65ded4282 Allow bearer token for auth 2023-03-28 16:46:22 +01:00
mike12345567 cf5316ec8d General fixes for open handles, attempting to find and close all issues in server which are stopping shutdown of Jest suite. 2023-03-27 19:38:49 +01:00
Michael Drury 34e8009f08 Merge pull request #9949 from Budibase/fix/blacklist
Blacklisting
2023-03-20 10:33:11 +00:00
mike12345567 39bfbdfac1 PR comments. 2023-03-16 16:49:31 +00:00
mike12345567 c106c3291a Merge branch 'develop' of github.com:Budibase/budibase into fix/api-key-error 2023-03-16 13:39:24 +00:00
Rory Powell de89b9112a Simplify errors framework (#10042)
* Simplify errors framework

* Use enum for ErrorCode

* Lint

* Update base BudibaseError type to use enum

* For for public error on UsageLimitError

* Build fix

* Build fix
2023-03-16 08:42:02 +00:00
mike12345567 29fc91d6d1 Making it obvious that API key is invalid - error otherwise is quite cryptic. 2023-03-15 17:26:21 +00:00
mike12345567 63cf91218d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-03-14 14:12:32 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
mike12345567 bff6a51af2 Adding test case for scenario. 2023-03-13 11:48:13 +00:00
mike12345567 212b93cbe9 Fix for not contains with all or - variety of changes needed to achieve the actual expected functionality. 2023-03-13 11:48:03 +00:00
Michael Drury 5eabe9db22 Merge pull request #9779 from Budibase/jonny/api-metrics
metrics api endpoint
2023-03-10 12:12:51 +00:00
mike12345567 564c724be1 Provides the option for blacklisting IPs. 2023-03-08 16:30:26 +00:00
adrinr 84d450a931 Renames 2023-03-07 12:47:27 +01:00
adrinr 49493d80be Use name suffix instead of complex key object 2023-03-07 12:45:20 +01:00
adrinr 4d854ea5a7 Merge remote-tracking branch 'origin/develop' into bug/budi-5901-usage-quota-document-conflicts-can-cause 2023-03-07 12:41:58 +01:00
mike12345567 c51b9fb4b3 Merge branch 'develop' of github.com:Budibase/budibase into jonny/api-metrics 2023-03-06 15:23:35 +00:00
mike12345567 96208a5e8a Fixing build issue. 2023-03-03 12:05:30 +00:00
mike12345567 04ef7eeb9c Minor fixes - after removing axios altogether and adding a start script to make life easier for running from ts. 2023-03-03 10:03:33 +00:00
mike12345567 2bc0e988af Getting proper tenant ID for use by audit logs queue. 2023-03-02 13:39:26 +00:00
mike12345567 2335932978 Some updates to core types - used in pro update. 2023-03-02 10:20:49 +00:00
mike12345567 b787fafb32 Removing skip setup, tests depend on this behaviour - will update in separate PR. 2023-03-01 19:45:59 +00:00
mike12345567 5b150e7748 Removing migration change and fixing #9738 - making sure that exports with excludeRows enabled don't include attachments. 2023-03-01 19:43:40 +00:00
mike12345567 923e9d8ec4 Adding in test check. 2023-03-01 19:17:45 +00:00
mike12345567 eba18a4159 Fix for #9739 - there was an issue with the mango syntax, when working with multi attachment columns it was using an AND comparator instead of OR, it should be searching for rows that contain any attachment column, not all attachment columns. 2023-03-01 19:01:13 +00:00
Michael Drury a7d5f0fa7e Merge pull request #9844 from Budibase/fix/audit-log-muli-tenant
Audit log multi-tenancy fix
2023-03-01 17:27:55 +00:00
mike12345567 bba6f6941c Minor fix for audit log system - after the switch to use an async queue for handling of audit log storage, context was lost - in multi-tenant environments need to carry the tenant ID into the queue job so that context can be applied. 2023-03-01 16:38:19 +00:00
Rory Powell c83684ed83 Prevent showing user exists for password disabled actions 2023-03-01 14:49:44 +00:00
Rory Powell 2dfca0f67c Fix settings doc id in new installs 2023-03-01 14:32:01 +00:00
adrinr 04566dbabd Merge remote-tracking branch 'origin/develop' into bug/budi-5901-usage-quota-document-conflicts-can-cause 2023-03-01 13:31:56 +01:00
adrinr dded8beaeb Fix writethrough falling behind 2023-03-01 13:16:57 +01:00
Dean a5c6dbe4ae Merge remote-tracking branch 'origin/develop' into feature/app-user-onboarding-ux 2023-02-28 16:38:44 +00:00
adrinr b922fc3b00 Improve testing 2023-02-28 15:03:18 +01:00
adrinr c1462a7c9c Clean code 2023-02-28 14:54:43 +01:00
adrinr c254c565e4 Use redlock for writethrough 2023-02-28 14:54:34 +01:00
adrinr 66217d6b08 Return redlock execution info 2023-02-28 12:52:43 +01:00
adrinr 24161d12bf Type locks 2023-02-28 12:47:28 +01:00
Rory Powell ab69bbc299 lint 2023-02-28 11:03:56 +00:00
Rory Powell 312c01a879 Prefer default config for google sheets in cloud, don't use env vars for regular auth 2023-02-28 10:36:29 +00:00
Dean dd08845a44 Merge remote-tracking branch 'origin/develop' into feature/app-user-onboarding-ux 2023-02-28 09:38:15 +00:00
Dean 61ed62e6c4 Builder user onboarding 2023-02-28 09:37:03 +00:00
mike12345567 b47101e1fb Updating lucene test case to improve coverage. 2023-02-27 21:48:05 +00:00
mike12345567 c3a3fa1176 Adding a lucene test case. 2023-02-27 21:18:06 +00:00
mike12345567 2fb33e2cf3 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-27 14:51:33 +00:00
mike12345567 fefc6d920f Fixing open handle issue - now that the worker has access to queues needs to shut them down. 2023-02-27 14:41:28 +00:00
Rory Powell 2c46109e7d Enforceable SSO (#9787)
* Add ENFORCEABLE_SSO feature flag

* First draft of enforce sso configuration / show single sign on url

* Reading and writing isSSOEnforced + integration with login page

* Enable CI + lint

* Set correct base branch for CI

* Test fix for expected string changed

* Use tenant aware platform url as SSO link

* Bring in latest pro changes

* Lint

* Add useEnforceableSSO mock helper function

* Update configs.spec.ts with coverage for public settings

* Update users.spec.ts with additional tests for isPreventPasswordActions

* Lint

* Update refresh OAuthToken to use correct enum and add case statement
2023-02-27 13:42:51 +00:00
mike12345567 0fa984f26f Moving is audited and adding in env var for ip address/user agent auditing. 2023-02-27 11:42:52 +00:00
mike12345567 65646ba01b Further PR comments. 2023-02-27 11:00:13 +00:00
mike12345567 3e7c1d10cf Fix based on test cases. 2023-02-24 19:04:40 +00:00
mike12345567 8fb5168d56 Fix for auth logout test case. 2023-02-24 17:42:22 +00:00
mike12345567 d6b0b7610a Fixing circular dependencies which were blocking tests. 2023-02-24 17:31:58 +00:00
mike12345567 3ba76ce5cd Adding test case for PII clear out. 2023-02-24 16:51:04 +00:00
mike12345567 62501b0185 Adding a system for checking audited data in events, so that PII can be removed by posthog processor. 2023-02-24 16:45:33 +00:00
mike12345567 a293d3842f Fixing build issue. 2023-02-24 13:55:36 +00:00
mike12345567 8853776c79 Moving around processors to separate audit logs out of central event handling. 2023-02-24 13:52:54 +00:00
mike12345567 58fab29fb4 Main body of PR comments. 2023-02-24 13:32:45 +00:00
mike12345567 f070be5f65 Moving search index to an enum. 2023-02-24 13:15:14 +00:00
mike12345567 42fc004212 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-24 12:46:58 +00:00
mike12345567 0b48075688 Implementing a few basic tests to create and search the audit logs. 2023-02-23 17:23:06 +00:00
Rory Powell 4e1bebe897 Server flaky tests fixes - improving tenancy config 2023-02-23 13:43:27 +00:00
Rory Powell d3a7286711 Configs updates: remove circular deps, dedicated module, typing improvements, reduce db reads 2023-02-23 13:41:35 +00:00
mike12345567 0bc340052c Adding the ability to cleanup users from get functions (default is old behaviour). 2023-02-23 11:28:18 +00:00
Jonny McCullagh dde1237ed2 allUsers function & more metrics 2023-02-22 21:10:35 +00:00
mike12345567 01076bd35f Getting downloading working correctly, some minor UI updates, adding a new middleware for converting a query string to a body (useful for when a GET has to be used). 2023-02-22 18:50:27 +00:00
mike12345567 c6dadaa4ff Some work to make sure the user agent and ip address are always passed correctly to audit logs. 2023-02-22 16:10:54 +00:00
Rory Powell 6a88cfc32d Update locks error logging (#9768)
* Fix intermittent backend-core migration test failure

* Update lock logging
2023-02-22 08:32:03 +00:00
mike12345567 22f42ef898 Adding new mechanism to get the ipAddress and userAgent of call for audit logs. 2023-02-21 19:14:57 +00:00
mike12345567 ef30c03fa6 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-21 17:26:24 +00:00
Rory Powell 940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
mike12345567 b48acd8cf4 Some DB type updates (typing dump function) and adding in main audit log event publishers. 2023-02-21 14:56:38 +00:00
Rory Powell cacf275a99 Prevent SSO users from setting / resetting a password (#9672)
* Prevent SSO users from setting / resetting a password

* Add support for ENABLE_SSO_MAINTENANCE_MODE

* Add typing to self api and build out user update sdk

* Integrate sso checks with user sdk. Integrate user sdk with self api

* Test fixes

* Move self update into SDK

* Lock down maintenance mode to admin user

* Fix typo

* Add health status response and return type signature to accounts.getStatus

* Remove some unnecessary comments

* Make sso save user function non optional

* Remove redundant check on sso auth details provider

* Update syncProfilePicture function name to getProfilePictureUrl

* Update packages/worker/src/sdk/users/events.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Add ENABLE_EMAIL_TEST_MODE flag

* Fix for logging in as sso user when existing user has password already

* Hide password update and force reset from ui for sso users

* Always disable sso maintenance mode in cloud

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-02-21 08:23:53 +00:00
mike12345567 6cc96f39b1 Minor fixes for friendly audited events, and a new function for comparing app IDs. 2023-02-20 17:20:42 +00:00
Rory Powell a57f0c9dea Merge branch 'develop' into rory/february 2023-02-20 09:57:17 +00:00
mike12345567 70e525b928 Updating types for audit logs to correctly handle the deletion of resources like users or apps. 2023-02-17 19:00:45 +00:00
mike12345567 eca34d73ed Finishing up search API, updating typing in lucene layer. 2023-02-17 17:46:49 +00:00
mike12345567 6ec5e97ce9 Required work to support the new lucene audit logs search indexing. 2023-02-17 16:26:55 +00:00
mike12345567 2afd3e1580 Updating events to include a proper friendly map of audited events. 2023-02-15 19:44:32 +00:00
mike12345567 6d83ea9bec Adding in event auditing to server/worker. 2023-02-15 18:03:55 +00:00
Rory Powell bb1faac62a Merge master into develop 2023-02-15 15:10:02 +00:00
mike12345567 c60b6da0ab Removing pro from backend-core. 2023-02-15 13:49:30 +00:00
mike12345567 1ed4f4b8fe Update on audit logs, getting the full write flow from events configured. 2023-02-15 12:37:32 +00:00
mike12345567 46e9bf1443 Some updates to add in the audit log DB. 2023-02-13 18:16:13 +00:00
mike12345567 05ceee1cfe Moving lucene handling to backend-core so that it can be used for other databases (outside row indexes). 2023-02-13 17:13:59 +00:00
Rory Powell cc7eb64a3b Rename LOG_4XX to ENABLE_4XX_HTTP_LOGGING and enable by default 2023-02-13 14:39:24 +00:00
Rory Powell 0e3a17ab18 Merge pull request #9669 from Budibase/budi-6558-configurable-test-log-levels-and-common
Configurable test log levels and common error handling
2023-02-13 14:31:43 +00:00
Rory Powell eb5aa8786d Merge pull request #9670 from Budibase/budi-6559-enable-higher-concurrency-and-resiliency
Enable higher concurrency and resiliency in worker tests
2023-02-13 14:31:14 +00:00
Rory Powell f53faff7ad Add LOG_4XX to environment 2023-02-13 12:27:49 +00:00
Rory Powell 07e5598538 Enable use of redis container in worker tests 2023-02-13 12:09:16 +00:00
Rory Powell ae9979929a Enable higher concurrency and resiliency in worker tests 2023-02-13 11:57:30 +00:00
Rory Powell 5cd6cb166a Configurable test log levels and common error handling 2023-02-13 11:53:01 +00:00
mike12345567 464ab7a1bb Merge branch 'develop' of github.com:Budibase/budibase into fix/cli-memory-issues 2023-02-07 09:56:49 +00:00
mike12345567 4d86df057b Some fixes for #8770 - the CLI was very memory intensive when working with large databases, that contained many revisions. We don't need the revisions for app exports/backups, therefore I've updated our export systems to drop the revision history as it compacts the database significantly and speeds up exports/reduces memory usage. 2023-02-06 17:54:40 +00:00
Adria Navarro 6ac57d424c Don't log on CI 2023-02-04 21:04:40 +00:00
adrinr 11a7742d90 Cleanup 2023-02-03 19:23:36 +00:00
adrinr 2e29ac9ec7 Rename name for id 2023-02-03 12:09:56 +00:00
adrinr 5d58fc5948 Dry 2023-02-03 11:28:27 +00:00
adrinr 9936d03e27 Merge branch 'develop' into feature/dependencies-image 2023-02-03 10:44:40 +00:00
adrinr 6dab44a569 Clean code 2023-02-03 09:37:34 +00:00
Dean 436564709e Merge remote-tracking branch 'origin/develop' into fix/add-onboarding-tour-tenant-flag 2023-02-02 11:38:57 +00:00
Dean 065e74024e Added new unit tests for feature flags 2023-02-02 11:38:10 +00:00
adrinr 11fa2313f1 Undone user cache changes 2023-02-01 17:20:48 +00:00
adrinr 79ee85dab3 Remove remaning faker refs 2023-02-01 17:19:56 +00:00
adrinr c7d0a077be Replace faker for chance 2023-02-01 17:11:50 +00:00
Adria Navarro b125b5478b Merge branch 'develop' into feature/dependencies-image 2023-02-01 16:32:00 +00:00
Dean 0eed617866 Updated default feature flags to include onboarding by default. Added tenant overrides to allow exclusion from global features 2023-02-01 14:12:43 +00:00
mike12345567 048cf8f188 PR comments. 2023-02-01 13:01:38 +00:00
adrinr 1d8c27bdc4 Increase timeout 2023-02-01 12:29:03 +00:00
adrinr e639b7cf26 More seq 2023-02-01 11:46:31 +00:00
adrinr 34278349c3 Merge branch 'develop' into feature/dependencies-image 2023-02-01 10:56:22 +00:00
mike12345567 f4379fcb4f Updates to use our new Nano layer for CouchDB integration rather than PouchDB. 2023-01-31 19:49:31 +00:00
adrinr 2ab3680538 Fix installation race conditions 2023-01-31 17:27:25 +00:00
deanhannigan ee288c1f2d Merge pull request #9409 from Budibase/feature/user-onboarding-overlays
Feature/user onboarding overlays
2023-01-31 16:37:18 +00:00
adrinr b2813db5db Handle db creation race conditions 2023-01-31 16:15:11 +00:00
Adria Navarro 16e53957bc Merge branch 'develop' into feature/dependencies-image 2023-01-30 18:54:05 +00:00
adrinr 1dabf71f68 Run conflicting tests in sequential mode 2023-01-30 13:35:09 +00:00
adrinr e4c898c327 Use test-containers for backend-core tests 2023-01-27 11:43:36 +00:00
adrinr 7027abeaa2 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
Adria Navarro Redo b94546b1a1 Fix user test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 9242470f6f Fix snapshots test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 8c68741f98 Fix application delete tests 2023-01-26 18:20:21 +00:00
Adria Navarro 26fa3bd484 tweak tests 2023-01-24 15:46:50 +00:00
Adria Navarro fc6c4d5290 Remove test logic from getAllDbs 2023-01-24 14:06:28 +00:00
mike12345567 5a2937c8d2 Adding events for environment variables (created, deleted, upgrade panel opened). 2023-01-23 18:18:06 +00:00
Adria Navarro 6806404465 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:08:19 +00:00
Adria Navarro 486bc6b18d Add jest-testcontainers-config 2023-01-23 15:52:23 +00:00
Dean a10bd138ff Merge remote-tracking branch 'origin/develop' into feature/user-onboarding-overlays 2023-01-23 09:34:20 +00:00
Dean 14da8c0c9e Added new onboarding tour flow for builder 2023-01-23 00:32:01 +00:00
mike12345567 0f33fd8d48 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-20 19:55:11 +00:00
mike12345567 3659768c42 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns 48e1695318 JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
mike12345567 c645a9bc21 Some type updates and an improvement to encryption to allow selecting the secret from an option list. 2023-01-16 18:15:43 +00:00
mike12345567 fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
Dean 4fd91ef617 Merge remote-tracking branch 'origin/cheeks-lab-day-portal-redesign' into feature/user-onboarding-overlays 2023-01-13 09:22:41 +00:00
Dean 7b3733d659 Merge commit 2023-01-13 09:20:55 +00:00
Peter Clement 117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Rory Powell f85ecd4810 Fix pino request id generation (#9324)
Remove the duplicated pino config in favour of the common config. Move request id generation into common configuration
2023-01-12 10:25:21 +00:00
Rory Powell 92ba282ee5 Logging type updates to fix account portal build (#9317) 2023-01-12 08:37:41 +00:00
Rory Powell e5e767f18d Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567 69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567 75df57c3d1 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-11 10:31:57 +00:00
Rory Powell e95222c0f4 Prefer app url resolution over referer (#9218)
* Prefer app url resolution over referer

* Update lockfiles
2023-01-11 10:24:57 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
mike12345567 d347b8015b Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-10 18:49:07 +00:00
mike12345567 c9d8668062 Licensing updates for environment variables. 2023-01-09 15:42:09 +00:00
Hong Phuc Nguyen 6825b2e3fc Doing sanitizeKey when doing deleteFile(s) (#9209)
* Doing sanitizeKey when doing deleteFile(s)

Doing sanitizeKey when doing deleteFile(s). 
In case of backup file name in backups bucket backup-2023-01-03T185512.686Z.tar.gz but in global-db store backup filename is backup-2023-01-03T18:55:12.686Z.tar.gz
sanitizeKey on deleteFile(s) method will prevent all other case related to this bug

* use .promise() instead callback for workaround aws-sdk bug
2023-01-05 08:54:10 +00:00
mike12345567 ea5b515783 Playing around with getting tests working. 2023-01-04 19:47:56 +00:00
Martin McKeaveney 84ab7862d1 fixes for google sheets, admin checklist, and deleting an app from API (#8846)
* fixes for google sheets, admin checklist, and deleting an app from API

* code review

* splitting unpublish endpoint, moving deploy endpoint to applications controller. Still to do public API work and move deployment controller into application controller

* updating REST method for unpublish in API test

* unpublish and publish endpoint on public API, delete endpoint unpublishes and deletes app

* removing skip_setup from prodAppDb call

* removing commented code

* unit tests and open API spec updates

* unpublish, publish unit tests - delete still in progress

* remove line updating app name in API test

* unit tests

* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

* v2.2.4

* Update pro version to 2.2.4

* lock changes (#9047)

* v2.2.5

* Update pro version to 2.2.5

* Make looping arrow point in right direction (#9053)

* v2.2.6

* Update pro version to 2.2.6

* Types/attaching license to account (#9065)

* adding license type to account

* removing planDuration

* v2.2.7

* Update pro version to 2.2.7

* Environment variable type coercion fix (#9074)

* Environment variable type coercion fix

* Update .gitignore

* v2.2.8

* Update pro version to 2.2.8

* tests passing

* all tests passing, updates to public API response

* update unpublish call to return 204, openAPI spec and unit

* fixing API tests

Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-19 13:18:00 +00:00
Rory Powell f4a39080de Minio and local licensing fixes (#9071) 2022-12-16 11:14:31 +00:00
Andrew Kingston 090ae5df49 Master => Develop (#9049)
* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2022-12-15 12:13:42 +00:00
Rory Powell 786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Rory Powell f935f05509 Offline license POC (#9046) 2022-12-14 21:48:48 +00:00
Peter Clement 9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
mike12345567 20984e8072 Some fixes based on test failure. 2022-12-07 17:33:26 +00:00
Andrew Kingston 8567ae70af Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-29 12:22:56 +00:00
mike12345567 a02e9017ec Final fixes after re-running all test suites. 2022-11-28 19:12:23 +00:00
mike12345567 d6e9380c06 General work after running some tests in CI - general refactoring as well. 2022-11-28 17:54:04 +00:00
mike12345567 3a6200144a Fix for account portal. 2022-11-28 14:09:18 +00:00
mike12345567 70242f3be7 Fixing some issues detected by testing. 2022-11-26 21:26:19 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567 90362b65c1 Disabling js interop in Typescript build of backend-core and worker, fixing build issues. 2022-11-26 14:46:01 +00:00
mike12345567 a3bb2e0d77 Automation overhaul to Typescript, plus type updates. 2022-11-25 19:57:07 +00:00
Andrew Kingston abedb5d9eb Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-25 11:24:57 +00:00
mike12345567 d3c4c99e16 Complete conversion of backend-core to Typescript. 2022-11-24 18:48:51 +00:00
Andrew Kingston cd24c408fe Rename migration 2022-11-24 14:27:49 +00:00
mike12345567 bfaef13768 Refactoring worker, converting all controllers/routes to Typescript and all imports of backend-core to new style. 2022-11-23 18:25:20 +00:00
mike12345567 4959a491d7 Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-23 10:30:57 +00:00
Rory Powell 6f3f858d81 Account portal <-> backend-core fixes 2022-11-22 22:24:45 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 92210144ff More controller typescript conversions. 2022-11-22 16:52:25 +00:00
Andrew Kingston c01b9af1f0 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-22 16:52:09 +00:00
Rory Powell 7610065db1 Fix view creation 2022-11-22 16:28:51 +00:00
mike12345567 8a4da7d4ce Typescript conversion of the table controllers. 2022-11-22 13:56:01 +00:00
mike12345567 8f94664ddd Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-22 12:03:31 +00:00
mike12345567 de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
Dean 192c9b56e2 Import refactoring and some review updates. 2022-11-21 15:53:47 +00:00
Dean 64e7239d42 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 15:40:11 +00:00
mike12345567 3e7bed067b Merge branch 'develop' of github.com:Budibase/budibase into develop 2022-11-21 15:06:44 +00:00
mike12345567 cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
mike12345567 f49233d883 Fix for table deletion, updating DatabaseImpl to define pouch functions directly. 2022-11-21 14:41:19 +00:00
Dean 0441704c57 Import fixes for backend core constants. Minor name change for default data source from Test DB to Sample Data 2022-11-21 12:47:36 +00:00
mike12345567 3c93101fdb Adding IDs to backup events. 2022-11-21 12:12:57 +00:00
Rory Powell 6cb71b5272 Add remove overload to allow for doc removal 2022-11-21 11:38:37 +00:00
Dean 02a902ebd3 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 11:10:29 +00:00
Andrew Kingston c58067a589 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-21 10:30:25 +00:00
mike12345567 12a9ed6dcb Adding type to triggered. 2022-11-17 23:09:49 +00:00
Michael Drury 3aa5c25da9 PR comments. 2022-11-17 19:38:47 +00:00
mike12345567 24d5d2a22c Adding an event for when a backup is triggered. 2022-11-17 17:15:35 +00:00
mike12345567 0d13a77409 Some minor updates after running qa-core tests, found some issues that likely exists before context update. 2022-11-17 16:30:38 +00:00
Dean e932aa105b Shifted the budibase datasource constant to backend-core 2022-11-17 16:28:48 +00:00
mike12345567 31c198888a Updating some enums, plural to single. 2022-11-17 14:59:18 +00:00
mike12345567 0557219140 Fixing permission types. 2022-11-17 14:47:52 +00:00
mike12345567 58e59bfacc Updating PouchLike to be an interface in types, with its impl stored in backend-core, now called Database. 2022-11-17 14:35:03 +00:00
mike12345567 bc857d7bb8 PR comments - still experiencing build issues. 2022-11-17 13:31:54 +00:00
mike12345567 f5760b6601 Fixes post merge. 2022-11-16 18:28:45 +00:00
mike12345567 29dd98a7fc Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-16 18:12:31 +00:00
mike12345567 4328ed1b67 Updating middlewares to Typescript, as well as some fixes based on running tests. 2022-11-16 17:24:13 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
Rory Powell 9c169087e6 Add copy button to sso callback urls, e2e unit testing for OIDC, stub out other auth tests 2022-11-16 11:34:16 +00:00
mike12345567 e7e2d91fef Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-15 16:45:25 +00:00
Rory Powell 1612044dc1 Merge branch 'develop' into subdomain-tenancy 2022-11-15 16:18:59 +00:00
Rory Powell f48ff01045 ensure fetch and aws are always mocked 2022-11-15 15:50:15 +00:00
Rory Powell f7af8621d5 Update waitForCompletion and pouch / backup type 2022-11-15 14:28:02 +00:00
Andrew Kingston 2b42b21b3a Add migration to automatically convert legacy table settings into new action setting 2022-11-15 11:54:45 +00:00
Rory Powell 9973f2e161 Bump jest and ts-jest to be consistent across backend packages to fix CI issue, test config updates 2022-11-14 22:55:47 +00:00
mike12345567 72c9aadae0 Updating test cases - trying to get everything in order for merge. 2022-11-14 20:25:05 +00:00
mike12345567 3f0e53f90c Updating context test, some minor adjustments based on getting the test working again. 2022-11-14 18:29:15 +00:00
mike12345567 3f6cdd787c Replacing CLS with local-storage, simplified usage which should remove the memory leak permenantly. 2022-11-14 18:00:20 +00:00
Rory Powell c6fba4de3d Test fixes 2022-11-11 15:43:41 +00:00
mike12345567 b4b471e054 Re-jigging things a bit, hiding as much of the couch/pouch stuff away. 2022-11-11 12:46:32 +00:00
mike12345567 bc94f20794 Typescript conversions - trying to get all of context/db layer into TS. 2022-11-11 11:57:50 +00:00
Rory Powell 72562278c0 Support path variable tenancy detection, add /api/system/* tests, update no tenancy matchers to be more accurate 2022-11-11 11:10:07 +00:00
mike12345567 c63c3b48c5 Typescript conversions, as well as updating context to just use an object map. 2022-11-10 17:38:26 +00:00
mike12345567 45e7ef61ef Re-building the context module to use a single object, meaning we can create new context frames and copy over whatever exists, then update. 2022-11-10 16:38:32 +00:00
melohagan b6ff581d5e Merge pull request #8593 from Budibase/bug/sev2/mongodb-aggregate-readable
MongoDB aggregate readable
2022-11-10 15:27:08 +00:00