0d7959f720
Fixing some un-identified listeners, queue messages not being correctly printed, also improving the mechanism for detecting if in the main thread or not.
2023-05-04 17:20:21 +01:00
1c7c06e983
Bulk of the automation plugin system, supporting custom plugins.
2023-04-10 23:48:54 +01:00
0a567a3302
add new status to handle no iterations during loop
2023-03-31 12:23:10 +01:00
3859a4159f
Minor fix for automations, the wrong function had the environment variables being added to environment, this is very minor, it simply makes sure that environment variables are in context for the whole of the automation runner - e.g. if utilising many datasources each of them doesn't need to re-retrieve the environment variables, instead they will be available based on the env vars retrieved at the start of the execution.
2023-02-10 14:14:43 +00:00
d4a0e44b31
merge
2023-02-05 22:11:37 +00:00
da2c809a09
Merge branch 'develop' into feature/environment-variables
2023-01-27 11:27:11 +00:00
fe7b632727
Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding.
2023-01-24 19:09:36 +00:00
5e68a4d814
Minor updates to the context system and also adding env vars to automation context.
2023-01-16 16:47:59 +00:00
fbf8230a3d
allow all user bindings in SQL queries ( #9354 )
2023-01-16 12:24:32 +00:00
fc5f6ca530
Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries.
2023-01-13 19:53:46 +00:00
87cf52192d
Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID.
2023-01-12 14:38:12 +00:00
d27674de5c
Replacing some require statements with imports.
2023-01-11 19:07:01 +00:00
69b9af51ff
Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables
2023-01-11 18:08:49 +00:00
03df57d077
Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK.
2023-01-11 17:57:51 +00:00
fba7ef26ad
Replace ts-jest with swc/jest ( #9289 )
...
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
57a5d8505d
assign wasLoopStep correctly
2023-01-05 12:16:45 +00:00
90f3d28bb5
fix for looping issue wher output was incorrect
2023-01-05 10:52:50 +00:00
9d841bc947
Server and Worker tests ( #8928 )
...
* automation unit tests
* row processor tests
* update executeQuery test
* update groups assertion
* some more worker tests
* plugin tests and tidying up
* linting
* temporarily disable group tests
* more tests
* fix import
* fix backup tests
* add pro mocks to worker
* check for app existence in import test
* test new tsconfig
* testing changes
* Pro test utils (#9020 )
* Pro test utils changes
* Add test fixes
* Remove ts-ignore
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
4f4eb4da26
Merge branch 'master' of github.com:Budibase/budibase into develop
2022-11-29 11:13:54 +00:00
658f12281d
Fixes based on server build so far.
2022-11-26 15:10:41 +00:00
f4c027c25b
User/Auth context now being passed to dynamic variable request updates
2022-11-24 10:16:05 +00:00
02ede5d067
Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions.
2022-11-22 19:49:59 +00:00
5f658a0398
Converting further DB layers to TS - fixing mocks.
2022-11-15 18:33:24 +00:00
b702c7482a
Fixes for cronjob stop - correctly handle this without stalled job handle.
2022-10-14 13:26:42 +01:00
bd47c948c5
one more log
2022-10-05 10:01:11 +01:00
f4c9fc6897
remove logs
2022-10-05 09:53:47 +01:00
2f220d668b
fix looping issues in automations
2022-10-05 09:20:59 +01:00
45a43baee2
Merge branch 'master' into develop
2022-09-12 14:05:36 +01:00
86c8618e8f
Fix for #7431 - reboot didn't work at all previously which is why apps couldn't be published with it enabled, this is now a self host only feature, I've removed the ability to enable a reboot cron in the Cloud and it will not run the lookup/execution.
2022-09-07 17:05:17 +01:00
320cbfada3
Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience
2022-08-31 15:53:32 +01:00
dd86875ea2
Update shutdown logging
2022-08-31 10:47:41 +01:00
28cdb16e08
enable stalled job disabling
2022-08-20 11:02:22 +01:00
f273a6f779
Add logging to all event listeners for automations + stalled handling stub
2022-08-19 23:14:19 +01:00
51e06a9c7a
Adding custom datasources to UI.
2022-08-15 18:38:09 +01:00
b803a3fd93
Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes.
2022-08-11 13:50:05 +01:00
f4db17502a
Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop
2022-07-26 17:28:57 +01:00
61f24fe03f
Adding UI for displaying when the CRON job has been stopped and alert the user to next steps.
2022-07-26 13:59:22 +01:00
3fad32899f
Main body of updates to support disabling the cron, some cleanup of metadata at deployment to make sure they can be re-ran.
2022-07-25 20:45:29 +01:00
07de5faa2d
Main bulk of logic around detecting cron recurring failure, still need to disable.
2022-07-20 22:38:06 +01:00
ff0c3e501f
Converting main automation thread to typescript.
2022-07-20 19:05:54 +01:00
078cf9e95f
Fixing an issue with automations being unable to access app databases due to new context stack up.
2022-07-18 17:38:58 +01:00
688c69fce2
Ensure a binding exists before continuing with loop
2022-07-18 13:10:18 +01:00
d34739f459
Updated query tests to remove altered datasource. Updated messaging for refresh failure messaging
2022-07-08 11:19:41 +01:00
02c0b433bb
Fixed issue where mutation was causing expression bindings to be lost. Request retries will now have them intact for re-enrichment
2022-07-08 09:29:16 +01:00
a59d0c7f31
Linting commit
2022-07-06 13:09:13 +01:00
084a469442
Surface refresh process error messaging
2022-07-06 13:03:25 +01:00
9fcedfa979
Properly invalidate the cached user ensuring up-to-date credentials are always used
2022-07-06 11:51:48 +01:00
4805f73cb5
Merge remote-tracking branch 'origin/develop' into sso-rest-requests
2022-07-05 09:28:56 +01:00
37ce29fa2d
Merge pull request #6315 from Budibase/feature/current-user-rest-bindings
...
REST query bindings for Current User
2022-07-05 09:22:03 +01:00
b0daf30b4a
Merge remote-tracking branch 'origin/develop' into sso-rest-requests
2022-07-05 09:07:33 +01:00
1e6845d5cb
Refresh the OAuth tokens automatically when making rest calls. Fix to remove the password from the api token authentication.
2022-07-03 21:13:15 +01:00
85e755fc7f
Ignore authconfigs for datasources if they are empty
2022-07-03 18:55:44 +01:00
31b51e1ecf
Fixes for datasource authentication parsing. Mapping UX updates
2022-07-01 17:27:24 +01:00
21a78d6fc8
Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-logs
2022-07-01 15:14:12 +01:00
ac1df878d4
Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings
2022-06-29 18:50:14 +01:00
705af49e5a
Merge remote-tracking branch 'origin/develop' into sso-rest-requests
2022-06-29 09:17:18 +01:00
74261661f1
Updating filter/condition action to show a stopped status rather than error, updating everything else to be aware of this.
2022-06-28 17:02:24 +01:00
fadd4292ad
update handling of max iterations
2022-06-23 16:08:25 +01:00
5fd385ab30
Merge commit
2022-06-23 14:29:19 +01:00
42cd5e2c63
Fix to ignore global rest query headers when they are not configured.
2022-06-15 10:09:47 +01:00
d50a62fd37
Context binding for authenticated user in REST API querys. Includes fix for REST datasource UI
2022-06-14 10:14:05 +01:00
fe84c0f21c
Adding pagination control to the API and to the frontend, as well as getting view working as expected, emitting different key combinations to be able to search by any pattern.
2022-06-01 22:39:51 +01:00
34759c7916
Adding real history to the history tab, getting storage to couch and retrieval + api working.
2022-06-01 16:01:06 +01:00
702f4057bd
Progress towards using couchdb for automation logs, after testing redis and realising it won't work.
2022-05-31 19:52:35 +01:00
fa30457f2b
Fixing issue with server not shutting down correctly when an error occurs, making sure that everything clears up gracefully.
2022-05-30 21:22:06 +01:00
4c77cf2516
parse max iterations value correctly
2022-05-19 16:38:16 +01:00
637ce41b3f
Fixing an issue where HBS statements couldn't be used for passing arrays through to a looping action in automations.
2022-05-11 11:29:33 +01:00
a2b38adac3
remove log
2022-05-04 13:30:08 +01:00
dea5e73317
account for objects in failure condition
2022-05-04 13:25:46 +01:00
45fd19583c
linting
2022-05-04 11:55:26 +01:00
af9b9b6921
Some foreach block fixes
2022-05-04 10:24:28 +01:00
9386a82e6f
Fixing similar issue in queries for context handling and fixing some issues raised by IDE.
2022-05-03 16:04:59 +01:00
c66cbcd522
Fix for automation issue, doInAppContext for automation thread wasn't async, was immediately closing the database, rather than waiting for the operations to complete.
2022-05-03 15:54:03 +01:00
9ca4dacbaa
merge with master
2022-04-26 10:21:45 +01:00
fa66c07578
PR review
2022-04-25 11:45:15 +01:00
94419024a4
Merge pull request #5510 from Budibase/fix/pouch-leak
...
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
d2a4e0a934
Merge branch 'develop' into feature/licensing
2022-04-20 14:59:36 +01:00
41144db055
Remove remaining direct usage of CouchDB. Add common pouch config to backend-core
2022-04-19 16:45:27 +01:00
1000ef35e1
Improve handling of loop handlebars string replacement
2022-04-18 09:22:23 +01:00
80a41235dd
Fixing REST UI query error notification and adding better error for query timeout.
2022-04-14 17:28:14 +01:00
5180603374
Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements.
2022-04-14 13:06:22 +01:00
43b4dd8737
add environment variable
2022-04-13 10:23:40 +01:00
03ba6d914f
Merge branch 'develop' into feature/licensing
2022-04-12 16:18:41 +01:00
2d75e68717
add max iterations env variable
2022-04-12 09:13:01 +01:00
47480450d8
fix failure condition
2022-04-11 23:10:29 +01:00
999199dcf6
Add handling for failure conditions
2022-04-11 10:26:59 +01:00
b439e59137
Merge remote-tracking branch 'origin/develop' into feature/foreach-block
2022-04-07 22:32:44 +01:00
4d084383f3
Fix for #5242 - string interpolation in SQL queries was too wide, it was combining parts of multiple strings, rather than searching for bindings within distinct strings.
2022-04-04 19:08:56 +01:00
035cda1177
Extension of fix for 4978 - fixing an issue where parentheses are added to the IN query, causing the query system to not recognise the need to switch out the binding.
2022-04-04 15:39:38 +01:00
417ba977fa
redis integration complete
2022-03-31 15:44:06 +01:00
006bf368bb
more parsing of output bindings
2022-03-29 10:29:51 +01:00
73151722ec
update bindings to support looping
2022-03-28 10:01:56 +01:00
25258ba055
improve context handling
2022-03-25 10:52:22 +00:00
7817d65eb3
Automation foreach block
2022-03-25 09:26:55 +00:00
52b123f154
Merge pull request #4991 from Budibase/fix/sql-query-in
...
Fixing SQL in queries
2022-03-22 13:00:32 +00:00
ad27b41823
Fixing review comment.
2022-03-21 17:57:26 +00:00
107c593e47
Fixing issue #4978 - fixing an issue with using the keyword 'in' as part of an SQL query.
2022-03-21 17:16:18 +00:00
715d42d3e6
Merge branch 'develop' into feature/licensing
2022-03-21 17:13:16 +00:00
5c3c4d28b2
Remove automation usage increment
2022-03-21 16:08:25 +00:00
795b48bfb0
Published apps, automations and query count quotas
2022-03-20 01:13:54 +00:00
d55a385072
Fixing an issue with detecting fully qualified Redis URL despite not in use.
2022-03-14 16:50:01 +00:00
07bcaf2d0a
Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable.
2022-03-11 00:19:26 +00:00
eefe4ea2ad
Integrate usage quotas with licensing
2022-03-08 14:21:41 +00:00
ec910b8fd2
Fixing issue brought up by test case.
2022-03-02 22:51:50 +00:00
546bbc2ff6
Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism.
2022-03-02 22:45:10 +00:00
1b45a9190d
Fixes for SQL issues raised by Marty.
2022-03-02 17:40:50 +00:00
a35a8cb81c
Addomg a fix for #4370 - allow queries to contain newlines, they will always be escaped.
2022-02-07 17:56:01 +00:00
f2a025013e
Fix for #4308 - triple brace conversion was not working correctly, wrote this into the string templates instead - also fixing an issue with the RBAC for Rest.
2022-02-03 18:44:34 +00:00
d3a90acc55
Final pass refactoring - need to test but all code in server converted.
2022-01-28 00:05:39 +00:00
bc67974996
Share validation between app modals, add yup based validation framework, add url to app modals
2022-01-20 16:01:09 +00:00
9a7cc4113d
Merge branch 'develop' of github.com:Budibase/budibase into rest-pagination
2022-01-13 09:44:09 +00:00
5ee6aa24b2
Refactoring core library usage in monorepo, make it a bit cleaner/easier to search/more standardised.
2022-01-12 11:32:14 +00:00
b33523a73d
Merge branch 'develop' of github.com:Budibase/budibase into feature/auth-core
2022-01-11 15:16:07 +00:00
bdb9a3456d
Fixing #3228 - allowing access to parameters in the transformer.
2022-01-11 11:17:35 +00:00
1327394784
Switching out @budibase/auth to @budibase/backend-core.
2022-01-10 19:33:00 +00:00
f5649b48d1
Add support for cursor based pagination in query params
2022-01-05 17:28:57 +00:00
8210ed7ee4
Delete and invalidate linked dynamic variables when a query is deleted
2022-01-05 11:54:59 -05:00
69a1b503c2
Fix paginationValues being attached to every object inside a query due to recursion
2022-01-05 14:26:13 +00:00
abc02d812a
Merge branch 'feature/query-variables' of github.com:Budibase/budibase into rest-pagination
2022-01-05 09:21:25 +00:00
e2478e478e
Add support for query param based pagination in REST queries
2022-01-05 09:16:10 +00:00
6904e6a1df
Prevent escaping in query parameter bindings
2021-12-21 13:48:54 -05:00
ab77c081bd
Some minor UI tweaks.
2021-12-17 18:21:36 +00:00
52eef17da0
Adding query invalidation, when a query fails that has dynamic variables it will invalidate the cache value for all dynamic variable values.
2021-12-17 17:56:28 +00:00
d61cb6c037
Some fixes after testing dynamic variables in rest a bit more.
2021-12-17 14:08:48 +00:00
c2a7c53b87
Adding in dynamic variable processing - finding which variables need to be used and then calling them from within the query thread.
2021-12-16 22:43:14 +00:00
f03f3c8864
Fixing some issues discovered with saving queries and dynamic variables, also displaying dynamic variables in a reactive way.
2021-12-16 19:33:47 +00:00
4960ad760e
Adding start to redis caching.
2021-12-16 16:58:15 +00:00
65f4b91e8b
Merge branch 'master' of github.com:Budibase/budibase into develop
2021-12-15 16:25:32 +00:00
e9acb690a8
Don't run change if not threading.
2021-12-15 12:26:29 +00:00
d1127f3220
Fixing an issue with automations throwing a Pouch error due to the auth library database not being setup.
2021-12-15 11:25:52 +00:00
ad1007ffdc
Adding in the ability to retrieve and view the headers from a rest response.
2021-12-09 12:30:05 +00:00
b31cd5b6f7
Adding in raw functionality.
2021-12-06 18:35:44 +00:00
99e2cd52e8
Adding stats, code, timings and size of request.
2021-12-06 18:23:18 +00:00
0335b1cee3
Fixing issue from review, values weren't wiped when delete modals closed, also adding a fix for threading to disable it in development as node-ts was causing memory leaks on low memory systems (doesn't apply to production built version).
2021-11-22 17:42:41 +00:00
11debac115
Updating to manage completed events piling up, this will periodically clear out all events - repeats cannot be removed with the removeOnCompleted job option.
2021-11-16 18:58:24 +00:00
9f4ff190c3
Fixing issues dsicovered by automation test cases, as well as disabling threading for test scenarios.
2021-11-11 16:20:30 +00:00
cca28ce255
Adding worker controls to both automations and queries.
2021-11-11 12:11:09 +00:00
mike12345567
Peter Clement
Martin McKeaveney
Rory Powell
Martin McKeaveney
Peter Clement
Dean
Andrew Kingston
Andrew Kingston