Commit Graph

258 Commits

Author SHA1 Message Date
mike12345567 f4f7ac42ec Adding test cases for interpolation of SQL, confirming that the context correctly gets cleaned up before passing into bindings. 2024-03-22 11:40:44 +00:00
mike12345567 c32163a9be Initial fix for defaulting parameters, switch to null rather than strings, this is important for prepared statements/SQL queries. 2024-03-21 18:26:35 +00:00
Andrew Kingston c25ea7a9d7 Fix external triggers not getting snippet context 2024-03-13 09:42:31 +00:00
Andrew Kingston 8b71c2731b Merge branch 'cheeks-lab-day-binding-eval' of github.com:Budibase/budibase into cheeks-snippets-poc 2024-03-11 16:16:29 +00:00
mike12345567 507fa2b417 Quick fix for #12502 - the schema was never updating in the UI no matter what was input despite the response - cleaned up the key parsing a little on the backend and made sure there is simply one schema that the frontend always uses, respecting whatever the backend responds with. 2024-03-08 16:50:59 +00:00
Andrew Kingston 2189e3ee0f Fix duped import 2024-03-01 15:26:02 +00:00
Andrew Kingston b7b1e95eb8 Add working PoC of snippets for both polyfilled vm and isolated-vm 2024-03-01 15:25:40 +00:00
mike12345567 c03a4b0792 Addressing PR comments. 2024-02-23 11:48:10 +00:00
melohagan 0c9d13c79a
Dynamic schema generation for query arrays: bug fix and refactor (#13082)
* Bug fix and refactor

* lint

* Refactor

* refactor

* lint

* type fixes

* Unit test fix and refactor

* refactor

* Make name option for preview, required for query

* Refactor unit tests

* Fix test

* update account-portal

* Revert "update account-portal"

This reverts commit e378f8d702.

* simplify set iteration

* comment
2024-02-21 15:33:13 +00:00
Adria Navarro b9afe1b926 Remove vm2 wrapper 2024-02-20 12:33:19 +01:00
Sam Rose 93b18b81e0
Fix re-used context in JS runner. 2024-02-20 10:49:45 +00:00
Adria Navarro 85052ca361 Fix query 2024-02-19 19:34:15 +01:00
mike12345567 87d60ca5f2 Removing env vars to disable isolated-vm usage. 2024-02-19 17:55:04 +00:00
Adria Navarro ae7a978998 Fix tests 2024-02-19 17:27:01 +01:00
Adria Navarro 09dbc694fa Fix imports 2024-02-19 17:01:27 +01:00
Adria Navarro ce76329be8 Merge branch 'wrap-existing-runners' into reenable-isolatedvm 2024-02-19 16:52:59 +01:00
Adria Navarro 1367cf3636 Use wrappers 2024-02-19 16:18:56 +01:00
mike12345567 28e3e8d6ed Merge branch 'master' of github.com:Budibase/budibase into reenable-isolatedvm 2024-02-16 11:06:05 +00:00
mike12345567 cfd1c98c85 Updating timeouts for automations, making it easier to manage/find the various timeout limits. Also adding a new environment variable AUTOMATION_THREAD_TIMEOUT which can be used to control how long automations can run for. 2024-02-14 11:44:07 +00:00
Adria Navarro 6f6100e7a2 Use isolated-vm 2024-02-12 18:07:17 +01:00
Adria Navarro 6823b23ac4 Init jsrunners on threads 2024-02-12 16:59:14 +01:00
Adria Navarro c42a8969c8 Fix build 2024-02-09 16:55:58 +01:00
Adria Navarro 599860b558 Use bson only for mongo 2024-02-07 10:58:43 +01:00
Adria Navarro 716e642d08 Types 2024-02-07 10:58:43 +01:00
Sam Rose b3c949b091
Fix case where if a binding returned an int it would throw an error. 2024-01-30 11:06:09 +00:00
Sam Rose 72d63d0c00
Rename executeSynchronously to be a bit less confusing, as it does not execute synchronously. 2024-01-30 10:57:25 +00:00
Sam Rose 456817ee7b
More loop step typing improvements. 2024-01-30 10:37:23 +00:00
Sam Rose 669b0743ac
Typing improvements around automation loop tests. 2024-01-30 10:00:44 +00:00
mike12345567 35a3d663ba Comments on PR - some small changes. 2024-01-24 12:33:29 +00:00
mike12345567 db7c2c804b Updating query responses to follow the same form consistently. 2024-01-19 18:13:12 +00:00
Sam Rose 642b75e0ae
Revert "Remove all custom tracing to see if it's the cause of the memory leak." 2024-01-02 11:36:32 +00:00
Sam Rose 3c0901f530
Remove all custom tracing to see if it's the cause of the memory leak. 2023-12-21 11:06:05 +00:00
Sam Rose 406410d916
Add DataDog tracing to automations. 2023-12-19 15:57:56 +00:00
Adria Navarro db2c20e3ae eslint import/newline-after-import 2023-11-20 21:52:29 +01:00
Adria Navarro 92f411bf77 Prettier 2023-11-20 21:48:49 +01:00
Adria Navarro 4d27ff1dc0 eslint import/no-duplicates 2023-11-20 21:48:49 +01:00
Sam Rose e3a4c34f8d
Pass types through context callbacks. 2023-11-08 16:17:24 +00:00
mike12345567 96327eaef1 Quick fix for REST schema being updated by user, when the request is sent again/query performed again user updates are lost - this means that changes are maintained across runs. 2023-09-29 13:17:14 +01:00
mike12345567 2f115b5b64 Quick fix for automation timing. 2023-09-07 15:27:52 +01:00
mike12345567 c6223ca935 Linting. 2023-09-05 12:33:01 +01:00
mike12345567 d096f359d7 Revert "Revert "Merge branch 'develop' into master""
This reverts commit 3265042025.
2023-09-05 12:28:56 +01:00
Rory Powell 64af549341 Revert "Merge pull request #11489 from Budibase/fix/automation-disable"
This reverts commit e6319cce67, reversing
changes made to 7c12280fe3.
2023-09-01 15:12:23 +01:00
Martin McKeaveney 3265042025 Revert "Merge branch 'develop' into master"
This reverts commit 99adc2039b, reversing
changes made to fec20e526e.
2023-08-29 14:27:39 +01:00
mike12345567 7110351bdc Revert "revert develop into master"
This reverts commit fd099658a0.
2023-08-18 14:33:21 +01:00
mike12345567 e068e301ff Updating automation history tab to handle the stopped error status which can occur for CRONs. 2023-08-16 18:21:53 +01:00
mike12345567 2622fecd93 Quick fix. 2023-08-09 16:33:37 +01:00
mike12345567 63006e36d4 Adding the ability to disable an automation, as well making sure that automations have steps before running. 2023-08-09 16:24:57 +01:00
Michael Drury 2ea45e1351 Merge branch 'master' into log/automation-id-with-execution 2023-08-07 15:03:38 +01:00
Martin McKeaveney b7810f915e fix lint 2023-08-07 12:55:28 +01:00
Martin McKeaveney 14785ca49d move to info log line 2023-08-07 12:36:19 +01:00
Martin McKeaveney ac5ce13f80 debug log for automation ID 2023-08-07 10:59:42 +01:00
Adria Navarro 2698e47ec4 Type internal db.get 2023-07-18 11:41:51 +02:00
Michael Drury 67588f1051 Adding a JSON parse incase the input is actually an array in the form of a string (HBS). 2023-06-01 12:14:34 +01:00
Peter Clement c6d0da33f4 add import for performance lib 2023-05-31 11:33:52 +01:00
Peter Clement 162ea5d969 update log formatting 2023-05-31 10:51:54 +01:00
Peter Clement 702c908ae8 remove logging 2023-05-31 09:42:44 +01:00
Rory Powell a1dbd67535 Remove debug log 2023-05-30 19:23:19 +01:00
Rory Powell b0783d373a Lint 2023-05-30 19:16:36 +01:00
Peter Clement ef9fc94728 Merge branch 'fix/looping-performance-bug' of github.com:Budibase/budibase into fix/looping-performance-bug 2023-05-30 16:52:34 +01:00
Peter Clement ed6cd8144b lint 2023-05-30 16:52:22 +01:00
Rory Powell 207512396a Merge pull request #10738 from Budibase/automation-investigation
Automation investigation logging + max doc size fix for automation log
2023-05-30 16:45:27 +01:00
Rory Powell 6230e62b9b Automation investigation logging + max doc size fix for automation log 2023-05-30 16:37:39 +01:00
Peter Clement 3119ba5a8d remove log 2023-05-30 14:41:04 +01:00
Peter Clement 0a91e5bed1 update let to const 2023-05-30 14:26:49 +01:00
Peter Clement 5a7f0ba586 Fix performance issue with looping and context 2023-05-30 14:25:28 +01:00
Peter Clement b0a32f03b4 remove log 2023-05-25 09:14:09 +01:00
Peter Clement a9bb534cdf set flag in automation orchestrator 2023-05-24 14:41:58 +01:00
Peter Clement d271bbdadb rename syncWebHooks to syncAutomations 2023-05-19 10:07:02 +01:00
Peter Clement e1eda14204 move sync automations away from bull and call directly 2023-05-18 17:01:53 +01:00
Rory Powell 578b599428 Lint 2023-05-17 14:10:22 +01:00
Rory Powell 42f472b038 Type updates for automation jobs 2023-05-17 12:26:07 +01:00
mike12345567 0d7959f720 Fixing some un-identified listeners, queue messages not being correctly printed, also improving the mechanism for detecting if in the main thread or not. 2023-05-04 17:20:21 +01:00
Michael Drury 1c7c06e983 Bulk of the automation plugin system, supporting custom plugins. 2023-04-10 23:48:54 +01:00
Peter Clement 0a567a3302 add new status to handle no iterations during loop 2023-03-31 12:23:10 +01:00
mike12345567 3859a4159f Minor fix for automations, the wrong function had the environment variables being added to environment, this is very minor, it simply makes sure that environment variables are in context for the whole of the automation runner - e.g. if utilising many datasources each of them doesn't need to re-retrieve the environment variables, instead they will be available based on the env vars retrieved at the start of the execution. 2023-02-10 14:14:43 +00:00
Martin McKeaveney d4a0e44b31 merge 2023-02-05 22:11:37 +00:00
Rory Powell da2c809a09 Merge branch 'develop' into feature/environment-variables 2023-01-27 11:27:11 +00:00
mike12345567 fe7b632727 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-24 19:09:36 +00:00
mike12345567 5e68a4d814 Minor updates to the context system and also adding env vars to automation context. 2023-01-16 16:47:59 +00:00
Martin McKeaveney fbf8230a3d allow all user bindings in SQL queries (#9354) 2023-01-16 12:24:32 +00:00
mike12345567 fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
mike12345567 87cf52192d Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID. 2023-01-12 14:38:12 +00:00
mike12345567 d27674de5c Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
mike12345567 69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
Peter Clement 57a5d8505d assign wasLoopStep correctly 2023-01-05 12:16:45 +00:00
Peter Clement 90f3d28bb5 fix for looping issue wher output was incorrect 2023-01-05 10:52:50 +00:00
Peter Clement 9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
Michael Drury 4f4eb4da26 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-29 11:13:54 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
Dean f4c027c25b User/Auth context now being passed to dynamic variable request updates 2022-11-24 10:16:05 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 5f658a0398 Converting further DB layers to TS - fixing mocks. 2022-11-15 18:33:24 +00:00
mike12345567 b702c7482a Fixes for cronjob stop - correctly handle this without stalled job handle. 2022-10-14 13:26:42 +01:00
Peter Clement bd47c948c5 one more log 2022-10-05 10:01:11 +01:00
Peter Clement f4c9fc6897 remove logs 2022-10-05 09:53:47 +01:00
Peter Clement 2f220d668b fix looping issues in automations 2022-10-05 09:20:59 +01:00
Rory Powell 45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
mike12345567 86c8618e8f Fix for #7431 - reboot didn't work at all previously which is why apps couldn't be published with it enabled, this is now a self host only feature, I've removed the ability to enable a reboot cron in the Cloud and it will not run the lookup/execution. 2022-09-07 17:05:17 +01:00