Commit Graph

3105 Commits

Author SHA1 Message Date
Adria Navarro c0a19c2a7e Type cache arguments 2023-12-22 14:37:54 +01:00
Sam Rose 3c0901f530
Remove all custom tracing to see if it's the cause of the memory leak. 2023-12-21 11:06:05 +00:00
Sam Rose 1f3a75e892
Downgrade back to dd-trace 3.13.2 2023-12-20 17:20:30 +00:00
Sam Rose c4fd5342cf
Merge branch 'master' into trace-automations 2023-12-20 09:57:24 +00:00
Sam Rose 9b750ed160
Merge branch 'master' into trace-automations 2023-12-20 09:43:55 +00:00
Sam Rose 2e58f2cdde
Add traces to track running arbitrary JS. 2023-12-19 18:20:13 +00:00
Sam Rose 2a0be7c8cd
Give db operation spans better names. 2023-12-19 17:18:40 +00:00
Sam Rose fef3107c0e
Fix automation tests. 2023-12-19 16:17:34 +00:00
Sam Rose 4739fd94c2
Merge branch 'master' into limit-js-execution-per-request 2023-12-19 11:57:21 +00:00
Sam Rose 96f64b4344
Manually inject DataDog trace context to log messages. 2023-12-19 11:47:41 +00:00
Adria Navarro dbc45da7f5
Merge branch 'master' into limit-js-execution-per-request 2023-12-19 12:44:37 +01:00
Sam Rose 93da29611d
Fix type error. 2023-12-19 10:11:51 +00:00
Sam Rose 4093f311c9
Respond to PR feedback. 2023-12-19 09:47:12 +00:00
mike12345567 987e280bc9 Merge branch 'instrument-couch' of github.com:Budibase/budibase into instrument-couch 2023-12-18 18:33:20 +00:00
mike12345567 d681d5298b Type fixes. 2023-12-18 18:33:04 +00:00
Sam Rose 78d039c949
Update backend-core to dd-trace 4.20.0 2023-12-18 17:43:50 +00:00
Sam Rose 1c34147357
Add tests for per-request execution timeout. 2023-12-18 17:01:56 +00:00
Sam Rose bd324f3225
Implement per-request JS execution limiting. 2023-12-18 15:29:56 +00:00
Martin McKeaveney e73576d8d6 more patches 2023-12-17 15:58:10 +00:00
Sam Rose 1717fb7930
Instrument CouchDB client with DD APM traces. 2023-12-15 11:30:02 +00:00
Sam Rose 7ec2c3860b
Optimise the performance of Writethrough.put. 2023-12-14 16:20:31 +00:00
Adria Navarro a0dd71f990 Renames 2023-12-14 10:31:04 +01:00
Adria Navarro 46f8f4da58 Fix parsing appid from path with ? 2023-12-14 10:09:23 +01:00
Adria Navarro f3e046ba98 Move header constants to shared-core 2023-12-14 10:07:46 +01:00
Adria Navarro 34d3edc2db Add header 2023-12-14 10:07:45 +01:00
Michael Drury b9593d1933
Merge branch 'master' into fix/try-once-logging 2023-12-13 15:57:21 +00:00
mike12345567 c8128325c6 Improving type handling. 2023-12-13 15:39:04 +00:00
mike12345567 c4af5214ef Improving types around the writethrough cache, exposing the proper typing from the database and removing a log statement which is useless, errors are correctly propogated if they matter (and handled above this level with proper context) or in the 99% scenario it is not a real error (such as try once locks already being held) and a log is just spammy. 2023-12-13 15:08:23 +00:00
Sam Rose 4934b4a428
Fix broken test. 2023-12-13 11:58:56 +00:00
Sam Rose 614a659032
Merge branch 'master' of github.com:budibase/budibase into budi-7664-sqs-self-host-ui-for-detecting-lack-of-sqs-support 2023-12-12 14:44:08 +00:00
melohagan 9d56039d03
Revert TTL on signed urls (#12556) 2023-12-12 10:52:14 +00:00
Sam Rose f249dadcc7
Merge branch 'master' of github.com:budibase/budibase into budi-7664-sqs-self-host-ui-for-detecting-lack-of-sqs-support 2023-12-11 17:46:27 +00:00
Sam Rose 6b491815a5
Add isSqsAvailable key to the environment endpoint. 2023-12-11 15:22:02 +00:00
Adria Navarro 1e267fca5b Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-12-11 09:50:48 +01:00
Adria Navarro e5d27181f2
Merge branch 'master' into BUDI-7655/migration-backend 2023-12-11 09:31:56 +01:00
mike12345567 3dcb3062f5 Adding a check to make sure that encryption does not execute upon directories, as well as adding copy to warn that attachments are not encrypted. 2023-12-06 16:38:03 +00:00
mike12345567 244a1d9329 PR comment. 2023-12-06 14:47:13 +00:00
mike12345567 8628c67c90 Fixing typing issues. 2023-12-05 18:17:27 +00:00
mike12345567 33b7e4d5d2 Some final refactoring, using proper jwt lib rather than requiring (proper typing). 2023-12-05 16:28:19 +00:00
mike12345567 2bf65601a1 Another simplification. 2023-12-05 15:55:09 +00:00
mike12345567 50270b8854 Quick refactor while in the area. 2023-12-05 15:54:33 +00:00
Adria Navarro e7859a8a47
Merge branch 'master' into BUDI-7655/migration-backend 2023-12-05 12:57:37 +01:00
mike12345567 7e4a9016a8 Merge branch 'master' of github.com:Budibase/budibase into fix/massive-attachment-export 2023-12-04 18:08:59 +00:00
mike12345567 a7410020c7 Adding cookie clearing/logout for when a cross tenant session is detected, make sure that the cookie cannot be used/considered valid after the call is made. 2023-12-04 16:47:41 +00:00
Adria Navarro 8ac9420e5b Add middleware to queue 2023-12-04 16:30:07 +01:00
Adria Navarro e4237c0620 Remove conflicting typing 2023-12-04 15:15:40 +01:00
mike12345567 3e2311ad5c Merge branch 'master' of github.com:Budibase/budibase into fix/massive-attachment-export 2023-12-04 13:11:55 +00:00
Adria Navarro 0eae73a5f0
Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-12-04 12:31:33 +01:00
Adria Navarro 9c9f45436f Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-12-04 09:30:00 +01:00
Adria Navarro 188d5d09a2 Typo
Co-authored-by: Sam Rose <hello@samwho.dev>
2023-12-04 09:12:58 +01:00
Adria Navarro fa7693f6df Typo
Co-authored-by: Sam Rose <hello@samwho.dev>
2023-12-04 09:12:58 +01:00
Adria Navarro 7f52a1e28c Guard migration 2023-12-04 09:12:58 +01:00
Adria Navarro 14fc91d58a Add tests 2023-12-04 09:12:58 +01:00
Adria Navarro f62dd56dd6 Add doInAppMigrationContext 2023-12-04 09:12:58 +01:00
Adria Navarro fe0efc7539 Remove unused test context code 2023-12-04 09:12:57 +01:00
mike12345567 00a3c630ef Initial work to get file streaming working when dealing with a large amount of file exports, tested with up to 1.5GB of attachments. 2023-12-01 18:36:40 +00:00
Adria Navarro 12015c79ae Add comments 2023-11-30 18:39:33 +01:00
Adria Navarro 670853a0ea Renames 2023-11-30 18:39:33 +01:00
Adria Navarro fb72b77ac1 Use jest.useFakeTimers 2023-11-30 18:39:33 +01:00
Adria Navarro bd89633e61 Fix wrong commited code 2023-11-30 18:39:33 +01:00
Adria Navarro a8ac4eed6d Autoextend without ttl 2023-11-30 18:39:33 +01:00
Adria Navarro 25099ee28e Clean redlock test settings 2023-11-30 18:39:33 +01:00
Adria Navarro 57b4c08731 Increase timeouts 2023-11-30 18:39:33 +01:00
Adria Navarro dcb6933eaa Clean 2023-11-30 18:39:33 +01:00
Adria Navarro c86d949680 Add and dry tests 2023-11-30 18:39:33 +01:00
Adria Navarro db6517bc0c Use real sleeps 2023-11-30 18:39:33 +01:00
Adria Navarro 078384941a Clean 2023-11-30 18:39:33 +01:00
Adria Navarro 9c12c5b62e Fix comments 2023-11-30 18:39:33 +01:00
Adria Navarro 73fd1f66c5 Fix 2023-11-30 18:39:33 +01:00
Adria Navarro f1fafc07f2 Update ioredis-mock 2023-11-30 18:39:33 +01:00
Adria Navarro 4cd76ea0fc Add tests 2023-11-30 18:39:33 +01:00
Adria Navarro a32582eb8a Use autoextend as locktype 2023-11-30 18:39:33 +01:00
Adria Navarro 26a77298ac Use timers 2023-11-30 18:39:33 +01:00
Adria Navarro 5a7dbb0076 Async 2023-11-30 18:39:33 +01:00
Adria Navarro 3073397800 Fix ttl 2023-11-30 18:39:33 +01:00
Adria Navarro f71e1ac03a Allow locks without TTL 2023-11-30 18:39:33 +01:00
Sam Rose 71a4e96d58
Move CODEOWNERS to the root to see if that fixes it. 2023-11-30 11:34:11 +00:00
Sam Rose fb3c072165
Capitalise @Budibase. 2023-11-29 09:22:47 +00:00
Sam Rose 204769b6e9
Add @budibase/backend as code owners to packages/{server,worker,backend-core} 2023-11-29 09:19:08 +00:00
Adria Navarro e7bcabf1d2 Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-11-27 20:48:32 +01:00
Martin McKeaveney 5301c1edd9 update presigned url time 2023-11-27 19:03:37 +00:00
Martin McKeaveney a65b29eb88 banner changes for new pricing, fix for onboarding to prevent flash of UI before onboarding tutorial 2023-11-27 18:50:44 +00:00
Andrew Kingston a05fc97715 Ensure adding a user as an app builder sets their role to creator 2023-11-24 15:54:46 +00:00
mike12345567 0636580d28 Merge branch 'creator-changes' of github.com:Budibase/budibase into creator-changes 2023-11-23 17:36:13 +00:00
mike12345567 b6c6e6ec6e Clearing out per-app builders when app is deleted. 2023-11-23 17:35:55 +00:00
Andrew Kingston d217053e87 Allow saving per-app builder metadata without a license 2023-11-23 17:29:01 +00:00
Andrew Kingston ce5d6267cc Move per creator utils into backend core, allow creators to create apps 2023-11-23 17:13:51 +00:00
Andrew Kingston c2c0012013 Add new permission type for creators, update app creation endpoint to allow creators and assign access to new apps 2023-11-23 16:22:16 +00:00
Michael Drury 1d368be5de
Merge branch 'master' into fix/admin-user-backup 2023-11-22 10:59:45 +00:00
mike12345567 ddd8482013 Updating bb admin user creation so that it can be used incase in self host a user gets locked out, the environment variables can be used to create a simple user to access the system. 2023-11-21 17:30:11 +00:00
Adria Navarro 3a3658fd03
Merge branch 'master' into chore/lint_imports 2023-11-21 13:51:39 +01:00
mike12345567 0df315c478 There has been quite a few redlock errors the last while - the message does not provide much information about what is going wrong - trying to rectify this to see if this is an error that could be impacting performance. 2023-11-21 10:52:50 +00:00
Adria Navarro db2c20e3ae eslint import/newline-after-import 2023-11-20 21:52:29 +01:00
Adria Navarro 92f411bf77 Prettier 2023-11-20 21:48:49 +01:00
Adria Navarro 4d27ff1dc0 eslint import/no-duplicates 2023-11-20 21:48:49 +01:00
Adria Navarro 8e0cb4b17b
Merge branch 'master' into chore/lint_js_tests 2023-11-20 16:43:36 +01:00
mike12345567 8fdf378a57 Fix an issue with account portal redis connection, if no Redis port is supplied in URL we should assume the default port number 6379. 2023-11-20 15:34:16 +00:00
Adria Navarro 742eb4ff46 Lint fix 2023-11-20 15:36:55 +01:00
Michael Drury d4cb22f264
Merge branch 'master' into fix/cyclic-issues 2023-11-17 16:55:44 +00:00
mike12345567 258ea803bc Further PR comments. 2023-11-17 16:37:00 +00:00
mike12345567 57fa9baef8 PR comments and possible fix for test failures. 2023-11-17 16:33:58 +00:00
mike12345567 7fb6c0927a Moving things around to get rid of cyclics created by moving invite/passwordReset into backend-core - also updating currentapp test case to mock a bit better. 2023-11-17 16:20:10 +00:00
Adria Navarro 00f65f396e
Merge branch 'master' into fix/build-references 2023-11-17 14:45:41 +00:00
Adria Navarro e8abb5cb46 Detect non-barrel workspace usages 2023-11-17 14:39:52 +01:00
Sam Rose f2406889df
Merge branch 'master' into bug/budi-7008-i-was-able-to-send-two-invitations-to-the-same-user-email-2 2023-11-10 16:24:51 +00:00
Sam Rose 4c7c10b121
Set Redis initialisation back to how it was before I started messing with it. 2023-11-10 16:17:18 +00:00
mike12345567 a427d990a1 Quick addition - if the object has been deleted but the key is still known, then CouchDB will alert us to the fact that it is deleted, leaving the response in a weird state. 2023-11-10 11:58:07 +00:00
Sam Rose 94983c289f
Hook redis init flow into overall worker init flow. 2023-11-10 11:39:26 +00:00
Sam Rose dd2f68d099
Hook new Redis clients into init/shutdown flow. 2023-11-10 11:24:55 +00:00
Sam Rose d98e217c6c
Fix backend-core redis imports. 2023-11-10 11:21:36 +00:00
Sam Rose 15767e2fd5
Merge branch 'master' of github.com:budibase/budibase into bug/budi-7008-i-was-able-to-send-two-invitations-to-the-same-user-email-2 2023-11-10 11:15:38 +00:00
mike12345567 dde446286d Switching getMultiple to default to failure if not all entries found, then updating usages. 2023-11-09 17:08:14 +00:00
Sam Rose 7f530eeab5
Add tests for the onboarding endpoint. 2023-11-09 15:13:59 +00:00
mike12345567 37e34c8ed2 Adding the ability to fail on getMultiple if needed. 2023-11-09 14:53:14 +00:00
Sam Rose b29cfc600c
Move Invite and PasswordReset code into backend-core. 2023-11-09 14:51:07 +00:00
mike12345567 a26f2e83e4 Some of the new table getters did not account for table IDs not being found, adding a new function which properly accounts for IDs being missing and manages it correctly, rather than leaving tables in an undefined state. 2023-11-09 14:45:23 +00:00
Sam Rose 3d73891f5e
Merge branch 'master' into bug/budi-7008-i-was-able-to-send-two-invitations-to-the-same-user-email-2 2023-11-09 13:43:05 +00:00
Sam Rose 3f69b17c94
Fully type the worker redis utils file. 2023-11-09 11:05:42 +00:00
Michael Drury c511f621d3
Merge branch 'master' into more-db-typing-improvements 2023-11-08 18:50:39 +00:00
Sam Rose e3a4c34f8d
Pass types through context callbacks. 2023-11-08 16:17:24 +00:00
Adria Navarro 6fd8a58850
Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-11-08 17:05:42 +01:00
mike12345567 4dc6b1eeda Merge branch 'master' of github.com:Budibase/budibase into fix/11972-external-relationship-formulas 2023-11-08 14:41:53 +00:00
Sam Rose 47292b8ab4
Make DB name non-optional. 2023-11-08 14:37:19 +00:00
mike12345567 e8fb43d30c Updating DesignDocument and View typing - making it more clear how view and lucene indexing works. 2023-11-08 12:46:00 +00:00
Sam Rose fdfda100c1
Ensure that the DB always returns Documents. 2023-11-07 18:14:52 +00:00
Adria Navarro ef914882d4 Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-11-07 19:06:33 +01:00
mike12345567 8d35453f01 Adding test case for circular detection. 2023-11-07 13:56:42 +00:00
mike12345567 312415ca7d Enforcing squash for rows which contain circular structures. 2023-11-07 13:47:21 +00:00
Martin McKeaveney 5dd6c40a29
Merge branch 'master' into fix/update-bull-queue-parameters 2023-11-06 18:02:49 +00:00
Adria Navarro 004e0a5f11 Update jest 2023-11-06 14:24:33 +01:00
Adria Navarro fb9215d2e4 Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-11-06 10:32:56 +01:00
mike12345567 08c4ba0097 Updating redis option functions usage, as it is no longer returned as a part of the getRedisOptions response. 2023-11-03 18:06:12 +00:00
mike12345567 7bf307b0c2 Further updates to typing. 2023-11-03 18:03:11 +00:00
mike12345567 001cf01303 Updating public API rate limiting functionality to be better typed as well. 2023-11-03 18:00:13 +00:00
mike12345567 f8f1ec4ce9 Removing old redisProtocol string - it is causing confusion and should not be necessary. 2023-11-03 17:17:20 +00:00
Sam Rose a27a9dc2af
Eliminate TOCTOU problem in creating bbTmp. 2023-11-03 14:29:54 +00:00
Michael Drury 12a7811847
Revert "Reverting changes to bull parameters" 2023-11-03 13:05:23 +00:00
Michael Drury 96534e625f
Revert "Updating bull parameters - help queue stalling" 2023-11-03 12:22:32 +00:00
Adria Navarro 8c90b9ddfb Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-11-02 13:35:17 +01:00
mike12345567 17b6985f06 Adding a duration utility for changing between time types. 2023-11-01 17:48:13 +00:00
mike12345567 de1862448d Merge branch 'master' of github.com:Budibase/budibase into fix/update-bull-queue-parameters 2023-11-01 17:18:07 +00:00
mike12345567 df6f8dad7e Updating bull parameters to see if this helps with queue stalling. 2023-10-31 16:56:19 +00:00
Michael Drury 3ef2b4a3ac
Merge branch 'master' into fix/backups-remove-automation-logs 2023-10-31 16:32:03 +00:00
Andrew Kingston 68553e85d4 Simplify page size logic in user search 2023-10-31 13:01:19 +00:00
Andrew Kingston 99a0c8b08b Fix bug breaking pagination in global users search 2023-10-31 12:10:41 +00:00
mike12345567 88cc8a19ee Resetting timekeeper and resetting pro back to normal. 2023-10-31 11:19:53 +00:00
mike12345567 2b96de3c30 Merge branch 'master' of github.com:Budibase/budibase into fix/backups-remove-automation-logs 2023-10-31 10:38:07 +00:00
Adria Navarro 18b8d6d3ef Merge branch 'master' into BUDI-7580/account_portal_submodule 2023-10-31 09:55:30 +01:00
mike12345567 41d99f6a58 Updating app backup exports to not include automation logs as these bloat the backups. 2023-10-30 17:41:08 +00:00
Sam Rose d0fecc1c64
Merge branch 'master' into feature/budi-7607-migrate-user-relationship-columns-to-the-new-user-column 2023-10-30 09:45:21 +00:00