Commit Graph

905 Commits

Author SHA1 Message Date
Adria Navarro 1d041a3dd5 Support nulls when optional 2023-05-02 12:48:05 +01:00
Adria Navarro 6e7c78362e Return null instead of undefined 2023-05-02 12:46:53 +01:00
Adria Navarro 650cbc1f01 Handle cast as undefineds 2023-05-02 11:57:18 +01:00
Adria Navarro c87cc39cea Add basic tests 2023-05-02 10:44:25 +01:00
Adria Navarro 29df12c247 Add csvutils 2023-05-02 10:34:45 +01:00
mike12345567 4f7e56fed9 Making build script into a module, so that it can be used in a specialised server build which also builds the thread scripts as required for worker-farm. 2023-04-27 19:00:01 +01:00
Michael Drury 9c93bf91c0 Merge pull request #10352 from Budibase/fix/10349
Allow SQL formulas using related row information to be used as display columns
2023-04-24 17:50:49 +01:00
mike12345567 1aca5d6407 Fixing an issue with creating relationships between existing tables, not using the correct type for the primary key in the foreign key relationship. 2023-04-19 17:17:37 +01:00
Michael Drury 42c37eea46 Merge pull request #10276 from Budibase/labday/automation-plugins
Automation step plugins
2023-04-18 17:33:25 +01:00
mike12345567 23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567 ac37d00f69 Updating plugins to have a SDK, which can be used for automation action retrieval as well as datasources. 2023-04-11 16:37:26 +01:00
mike12345567 e699f4684a Updating the global user sync to be more accurate and also remove old user metadata from apps that users don't have access to anymore. 2023-04-04 18:03:56 +01:00
mike12345567 2e80bab7ad Removing requirement for built client library in component test case. 2023-03-31 17:13:25 +01:00
mike12345567 906d614c64 Merge branch 'merge-master-develop' of github.com:Budibase/budibase into merge-master-develop 2023-03-31 13:51:20 +01:00
Rory Powell 44aa19a99a Merge branch 'master' into merge-master-develop 2023-03-31 12:26:04 +01:00
Rory Powell 79bec7d86d Add force exit, -e flag and streaming to tests (#10151)
* Add force exit, -e flag and streaming to tests

* Temp remove script usage from worker tests

* Revert "Temp remove script usage from worker tests"

This reverts commit 5e0ed2e92d.

* Always fail test

* Ignore server test package from coverage report

* Unscope server only

* Run all server tests again

* Update backend core test script to fail when any command fails and force exit

* Don't try to require client in test

* Port memory limit fix from develop

* Remove always failing test and commented out block for client require

* Fixing some issues with test cases.

* Revert assertions in internalSearch.spec.js

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-31 10:32:13 +01:00
adrinr 8d45e44e2f Fix types 2023-03-30 11:30:35 +01:00
mike12345567 1c73b92595 Fix for app sync, base it on group roles, not just user roles - stops app sync from pulling in group users which do not actually have access to the app. 2023-03-21 13:55:28 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
Peter Clement 1cb03c7603 fix roleId being undefined leading to groups override 2023-03-07 13:30:24 +00:00
Rory Powell 940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
Adria Navarro 16e53957bc Merge branch 'develop' into feature/dependencies-image 2023-01-30 18:54:05 +00:00
adrinr d160430ac8 Start race condition 2023-01-30 18:51:22 +00:00
mike12345567 3659768c42 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns 48e1695318 JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
Peter Clement 117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Rory Powell e5e767f18d Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567 d27674de5c Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
Rory Powell 786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Peter Clement 9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
mike12345567 b9ce140d95 Fix for #7732 - as well as some tests for it, make sure that it is working as expected. 2022-12-06 17:20:26 +00:00
Michael Drury a656c6e678 Adding test case for char encoding and being explicit about utf8 export. 2022-11-29 16:03:22 +00:00
Michael Drury 31fbc937b0 Removing old JS file. 2022-11-29 15:23:01 +00:00
Michael Drury bcf2aadbaa Merge branch 'develop' of github.com:Budibase/budibase into fix/charset-encoding 2022-11-29 11:57:45 +00:00
mike12345567 12d6e60525 One file left in the server, some fixes after converting the internal row controller. 2022-11-26 15:42:53 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567 a3bb2e0d77 Automation overhaul to Typescript, plus type updates. 2022-11-25 19:57:07 +00:00
mike12345567 7eac8fafd6 Some server typescript re-writes, only automations left and some controllers. 2022-11-25 15:01:46 +00:00
mike12345567 514f9a1210 Some fixes based on test runs. 2022-11-23 11:44:15 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 8c2d9ebec8 Updating all of the route files to typescript, as well as some controllers. 2022-11-22 18:49:19 +00:00
mike12345567 8a4da7d4ce Typescript conversion of the table controllers. 2022-11-22 13:56:01 +00:00
mike12345567 4cdcafac36 More Typescript conversion, as part of backend-core importing improvements. 2022-11-22 12:41:36 +00:00
mike12345567 de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
mike12345567 31c198888a Updating some enums, plural to single. 2022-11-17 14:59:18 +00:00
mike12345567 4328ed1b67 Updating middlewares to Typescript, as well as some fixes based on running tests. 2022-11-16 17:24:13 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
mike12345567 5f658a0398 Converting further DB layers to TS - fixing mocks. 2022-11-15 18:33:24 +00:00
mike12345567 b5472f882b Some updates for currentapp.spec.js test case. 2022-11-15 17:35:17 +00:00
Rory Powell 998beddc30 Configurable CDN 2022-11-07 09:45:00 +00:00
mike12345567 11115aab56 Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-17 14:49:31 +01:00
Dean 7125e3f6e3 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-13 16:16:28 +01:00
mike12345567 9d34ccfaca Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-12 11:59:00 +01:00
Rory Powell 2f0f36e635 Merge branch 'master' into merge-master 2022-10-12 10:19:46 +01:00
mike12345567 19133f08e6 Adding import functionality - still need to update the attachments URL. 2022-10-11 20:25:22 +01:00
mike12345567 7c71f76b70 Export to tarball through tmp. 2022-10-11 18:21:58 +01:00
Rory Powell ef4b1dd32b Fix user metadata update 2022-10-11 12:42:35 +01:00
mike12345567 1f36eec89a Some updates towards supporting attachments in app exports. 2022-10-10 20:08:59 +01:00
Dean 07be0208e5 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-10 09:08:48 +01:00
mike12345567 2d4eb10aba Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-07 20:48:28 +01:00
mike12345567 197d195cb4 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 18:05:18 +01:00
Michael Drury 060b2aba3c Merge pull request #8175 from Budibase/fix/remove-app-scans
Removing Redis SCAN operation from app services
2022-10-07 17:35:05 +01:00
mike12345567 0c4a40c795 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 16:05:01 +01:00
Dean c09154b03e Renamed the 'Scanned Code' field type to 'Barcode/QR'. The component is also now listed as 'Barcode/QR Scanner'. Minor fix to include longform text columns in the table csv import list 2022-10-07 11:00:25 +01:00
mike12345567 ef52bde670 Building out initial SDK work - converting some existing exporting work to typescript. 2022-10-06 19:10:45 +01:00
mike12345567 ea2fb6de1b Merge branch 'master' of github.com:Budibase/budibase into develop 2022-10-06 16:54:25 +01:00
Dean e251c914ff Review feedback changes. Changed 'Code' labelling to 'Scanned Code' 2022-10-06 13:02:17 +01:00
Dean 2ec21741d1 Initial commit of QR Reader field 2022-10-05 09:28:07 +01:00
Andrew Kingston f2f842444a Update plugin URL utility export to use CJS syntax 2022-10-05 08:57:26 +01:00
Andrew Kingston 788dac0f8d Use CJS style imports in plugin URL helper to work in jest, and respect plugin bucket env var 2022-10-05 08:25:50 +01:00
Andrew Kingston b487855348 Update plugin JS URL handling 2022-10-04 16:28:21 +01:00
Andrew Kingston de9b2c44cb Add utility for generating plugin JS URLs 2022-10-04 16:27:04 +01:00
Rory Powell 79226777b1 Merge develop 2022-09-28 08:56:45 +01:00
Martin McKeaveney c309d25b16 Merge pull request #7881 from Budibase/feature/email-cc
Add CC and BCC (with multiple email support) to Send Email automation action step
2022-09-25 13:40:33 +01:00
Michael Drury c7fb092294 Fixing issue discovered by test. 2022-09-23 22:24:31 +01:00
mike12345567 e0b6ef66ac Fixing a few issues with roles being correctly reverted. 2022-09-23 17:45:26 +01:00
mike12345567 9b29bd6709 Merge branch 'develop' of github.com:Budibase/budibase into group-fixes 2022-09-22 18:44:16 +01:00
mike12345567 e3f054470a Updating a few core endpoints to better integrate the groups system and make sure users always have the correct role ID updated onto them. 2022-09-22 18:27:43 +01:00
Mel O'Hagan 1b49f02092 CC and BCC interface 2022-09-21 15:58:04 +01:00
Martin McKeaveney 9b5ed59f34 Merge pull request #7792 from Budibase/feature/plugin-pro
Plugin pro integration
2022-09-18 10:34:06 +01:00
mike12345567 6bad41e3ce Minor fix - datasource hot reloading was working apart from the the CJS require caching, need to clear down the cache entry before reloading. 2022-09-16 11:25:28 +01:00
Martin McKeaveney c86bdffc52 Merge pull request #7646 from Budibase/qa/qa-core-jest
QA Core repo, and Jest API tests running end to end
2022-09-15 21:12:45 +01:00
mike12345567 40688f6783 Adding budibase/pro integration for plugins, controlling quota limits. 2022-09-15 14:57:27 +01:00
Rory Powell 0f98f2fcaa Merge branch 'master' into develop 2022-09-15 10:19:56 +01:00
Martin McKeaveney ddc585fad3 Merge branch 'develop' into qa/qa-core-jest 2022-09-15 01:18:58 +01:00
mike12345567 416a2c999f Fixing issue with plugin import for datasources - extract the integration correctly. 2022-09-13 12:16:00 +01:00
mike12345567 722a087af5 Reverting organisation page changes. 2022-09-12 16:21:47 +01:00
mike12345567 828066de46 Merge branch 'develop' of github.com:Budibase/budibase into feature/plugin-management-ui 2022-09-12 15:34:34 +01:00
mike12345567 bbed4cce74 Fixing an intermettient test issue. 2022-09-12 15:16:31 +01:00
Rory Powell 45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
mike12345567 3d66e71d7d Fixing an issue with deleting large apps with a lot of internal table data and adding back the export modal which allows picking whether an export includes internal table rows - #7583. 2022-09-09 20:06:29 +01:00
mike12345567 8e56a7a4d9 Fixing an issue with external tables containing time only fields. 2022-09-07 17:57:02 +01:00
NEOLPAR c2bca8a025 uploading plugin for github, npm and url 2022-09-06 16:28:35 +01:00
Martin McKeaveney c3f15b5af2 QA Core repo, and Jest API tests running end to end 2022-09-05 18:28:53 +01:00
NEOLPAR 4c47c3a418 sorting npm stuff out 2022-09-05 15:04:26 +01:00
NEOLPAR 7d8940f0cb Merge branch 'plugins-dev-experience' into feature/plugin-management-ui 2022-09-05 09:38:24 +01:00
mike12345567 a5f475872d Updating plugins to not think about versions, only ever one version of each plugin by name, making plugins self host only and adding error checking for datasource implementations. 2022-09-02 19:32:15 +01:00
NEOLPAR 54eed13541 create plugin github public and private 2022-09-01 20:04:45 +01:00
NEOLPAR 0e2a86460c uploading npm and url plugins 2022-08-31 16:09:47 +01:00
mike12345567 320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Rory Powell 5f022e04a3 Merge branch 'develop' into user-fixes 2022-08-31 11:39:41 +01:00
Rory Powell 435465f93a Update shutdown logging 2022-08-31 11:05:49 +01:00
NEOLPAR e5446d2f8a plugin create npm 2022-08-30 21:37:08 +01:00
Martin McKeaveney 02c93071ee merge 2022-08-30 10:33:37 +01:00
Martin McKeaveney 4aa99336d7 adding path variable 2022-08-25 11:07:35 +01:00
Martin McKeaveney d5c2f32df3 additional logging around component definitions 2022-08-25 10:57:30 +01:00
Andrew Kingston 975afc29d2 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-22 11:27:18 +01:00
Andrew Kingston 23a91b89a7 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-22 11:27:04 +01:00
Rory Powell 917bb96ae6 add on() to mock queue 2022-08-20 11:42:51 +01:00
mike12345567 f329f9868c Adding management of the new README.md file that is retrieved with the plugin skeletons. 2022-08-18 18:23:07 +01:00
mike12345567 2bb32253d8 Adding in hash handling for datasource plugins. 2022-08-18 15:21:55 +01:00
mike12345567 7dfe049ae6 Adding full builder integration of custom components - splitting into own section properly - fixing some issues with SVG class overlap. 2022-08-17 23:13:51 +01:00
mike12345567 b6a5ccbf10 Adding some controls around datasource config creation and updating minio fetch. 2022-08-17 11:01:25 +01:00
mike12345567 2aaff7576b Adding full flow for creating custom datasource. 2022-08-17 10:05:13 +01:00
Mel O'Hagan 5171fc09fb Delete attachments on field clear 2022-08-12 11:29:57 +01:00
mike12345567 76d427001a Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:34:01 +01:00
mike12345567 fc6111272e Fixing viewname enumeration. 2022-08-11 14:40:17 +01:00
mike12345567 b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
mike12345567 a683665a99 Adding plugin upload API - takes a file form-data and then extracts, uploads to minio and stores data about the plugin to CouchDB. 2022-08-10 20:01:48 +01:00
Martin McKeaveney 7de6117421 changing readstream let to const 2022-08-08 13:54:11 +01:00
Martin McKeaveney 9ec178c7c8 charset encoding 2022-08-08 13:51:02 +01:00
mike12345567 2dea5c5614 Some various session fixes based on current data. 2022-08-05 21:35:26 +01:00
Peter Clement c3a4941119 Merge pull request #6989 from Budibase/pc/fixes
User Management UI fixes
2022-08-01 09:39:55 +01:00
Peter Clement 79f7fd380d pr comments and updating group check to be more safe 2022-07-30 11:38:08 +01:00
mike12345567 07f3897b55 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-29 14:31:18 +01:00
Peter Clement dca37a61da adding tests and pr comments 2022-07-27 10:20:39 +01:00
Peter Clement 548e8d518c Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-26 20:19:33 +01:00
Peter Clement 46a6fc5048 refactor groups into pro and some other pr comments 2022-07-26 20:04:29 +01:00
mike12345567 f4db17502a Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-26 17:28:57 +01:00
mike12345567 3fad32899f Main body of updates to support disabling the cron, some cleanup of metadata at deployment to make sure they can be re-ran. 2022-07-25 20:45:29 +01:00
mike12345567 a84d4d014d Fixing issues with exporting apps, first removing the deleted documents when exporting and second making it so that the user has a choice whether to export the development app or the published app from the UI. 2022-07-22 18:16:14 +01:00
Peter Clement dd34282a33 2nd fix for multi tenancy groups 2022-07-22 10:56:16 +01:00
Peter Clement 723bbd65e4 fixing bug on multi tenant environment 2022-07-22 10:12:16 +01:00
Peter Clement ba74fa9500 update handling of group roles 2022-07-19 14:20:57 +01:00
Peter Clement ca41e88045 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 11:23:31 +01:00
mike12345567 c525721854 Fix for #6709 - Adding the option to set a role for app action, allowing users to set what level an automation can be accessed from. 2022-07-15 17:13:45 +01:00
Peter Clement f3fa67e802 split out id parsing into pro repo 2022-07-15 11:29:20 +01:00
Martin McKeaveney 367cf37795 remove beta stuff and remove self-host banners 2022-07-11 11:08:56 +01:00
Andrew Kingston 467cc27f47 Add env vars to automatically create initial admin user on first run 2022-06-30 11:28:52 +01:00
Martin McKeaveney 251520bcd1 adding types 2022-06-28 12:16:23 +01:00
Rory Powell 4dc5cfc5a7 Merge branch 'release' into merge-release 2022-06-13 11:45:18 +01:00
Martin McKeaveney c470c2f676 merge with master 2022-06-08 13:26:14 +01:00
Andrew Kingston 72397530ec Apply timezones patch from existing ignore-timezones branch 2022-06-07 08:31:00 +01:00
Martin McKeaveney d15dfb83fc new ui functionality working from S3 bucket 2022-06-06 23:30:36 +01:00
Peter Clement 5bd5d7df1b Merge pull request #6059 from Budibase/feat/dont-export-app-rows
Allow export of app without rows
2022-06-06 16:31:21 +01:00
Peter Clement bd737cc1ca negate export button 2022-06-06 15:17:14 +01:00
Martin McKeaveney d57c4987fe Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-01 09:47:13 +01:00
mike12345567 fa30457f2b Fixing issue with server not shutting down correctly when an error occurs, making sure that everything clears up gracefully. 2022-05-30 21:22:06 +01:00
mike12345567 723b96c5a5 Adding the ID inputs for the quota breakdown functionality. 2022-05-26 16:01:10 +01:00
Peter Clement 5a67be19fa Merge remote-tracking branch 'origin/develop' into feat/dont-export-app-rows 2022-05-26 10:32:18 +01:00
mike12345567 8bc0142a37 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-25 18:12:27 +01:00
mike12345567 84d0b61588 Swapping bcryptjs for bcrypt. 2022-05-25 16:14:45 +01:00
Peter Clement af5c1a7e1f change variable to reflect negation 2022-05-25 15:06:41 +01:00
Peter Clement 955b9a4d63 Export app without rows 2022-05-25 09:26:10 +01:00
Martin McKeaveney 92ed60af54 Merge pull request #5786 from Budibase/feature/app-overview-section
Feature/app overview section
2022-05-24 15:16:17 +01:00
mike12345567 1f3d552199 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-23 17:03:36 +01:00
mike12345567 aede23d44e Improving performance of load script, can generate thousands of users a second. 2022-05-22 18:29:02 +01:00
mike12345567 c528896e2d Finishing off UI, expanding settings menus from 80ch to 90ch as they were quite restricted and made the usage UI a bit difficult to view. Added a DISABLE_DEVELOPER_LICENSE env variable for testing. 2022-05-17 17:44:40 +01:00
Dean 5104631d20 Initial Commit for app overview 2022-05-05 12:52:17 +01:00
mike12345567 9e46413202 Fix for export issue reported in #5669 - streaming + closing the database didn't work well together, have to support an edge case for our code stopping execution, but DB access continuing. 2022-05-03 15:20:46 +01:00
Michael Drury 8d78698c60 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-04-26 20:10:26 +01:00
mike12345567 194b76985c Fix for #5269 - the sub type was being lost in some scenarios related to the user table being updated - making sure it is consistently kept when dealing with either of the related tables. 2022-04-26 14:24:51 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
mike12345567 345bbf603c Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
Rory Powell 41144db055 Remove remaining direct usage of CouchDB. Add common pouch config to backend-core 2022-04-19 16:45:27 +01:00
mike12345567 2accebec7f Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Rory Powell 0a4b1eb552 Tests complete + backwards compatibility for deployment 2022-03-22 00:23:22 +00:00
Rory Powell 715d42d3e6 Merge branch 'develop' into feature/licensing 2022-03-21 17:13:16 +00:00
Rory Powell 795b48bfb0 Published apps, automations and query count quotas 2022-03-20 01:13:54 +00:00
mike12345567 53386909ab Updating row search bookmark to handle numbers as bookmarks. 2022-03-09 10:12:26 +00:00
Rory Powell eefe4ea2ad Integrate usage quotas with licensing 2022-03-08 14:21:41 +00:00
mike12345567 b6e6f81d15 Adding test cases for user implementation with mocks. 2022-02-25 19:01:17 +00:00
mike12345567 cf27667580 Users implementation added. 2022-02-25 19:00:12 +00:00
mike12345567 8f6e55e65b Adding controllers for row, query and applications public APIs. 2022-02-23 18:31:32 +00:00
mike12345567 edd4a3233e Shifting over all of self API, deprecating old endpoints. 2022-02-14 18:11:35 +00:00
mike12345567 dbc048b365 Review comments, renaming deployed -> prod in terms of app IDs. 2022-01-31 17:42:51 +00:00
mike12345567 1095ad17c6 Adding comments to areas that need to keep using old db creation method. 2022-01-31 17:27:47 +00:00
mike12345567 476f34fb93 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 17:16:59 +00:00
mike12345567 9198439f7f Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 17:00:22 +00:00
mike12345567 f9c7877e02 Merge branch 'develop' of github.com:Budibase/budibase into feature/formula-filtering 2022-01-31 15:21:15 +00:00
mike12345567 91a90e62b2 Fixing some issues discovered by the cypress tests, cleaning up how Couch is used. 2022-01-28 18:52:34 +00:00
mike12345567 d5f8cc1023 Tests updating, all now passing, fixed some issues discovered by them. 2022-01-28 15:43:51 +00:00
Michael Drury d3a90acc55 Final pass refactoring - need to test but all code in server converted. 2022-01-28 00:05:39 +00:00
mike12345567 d2fe119d90 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00
mike12345567 ab5c7766b4 Bit of refactoring, adding in functionality to remove invalid static formula when the elements that the formula depends on are removed. 2022-01-24 18:22:59 +00:00
mike12345567 da26761773 Make sure attachments are deleted when table is deleted, or column is removed. 2022-01-24 16:32:41 +00:00
mike12345567 10a2915bcb Getting relationship re-enrichment working, so that static formulas will update when the value of the relationship changes. 2022-01-21 17:45:24 +00:00
Rory Powell 81e8ceff1a Merge branch 'develop' into feature/app-urls 2022-01-21 17:35:23 +00:00
Rory Powell e0dcc7648c Remove server -> worker request to retrieve apps, remove hosting endpoints and store 2022-01-21 17:31:18 +00:00
mike12345567 deb4a34c18 Adding the ability to filter using the filter drawer for formula fields, getting them based on the enriched contents of a row - adding functionality to denote to each table which other tables depend on them for formula. 2022-01-21 16:24:24 +00:00
mike12345567 87d5e0d39e Merge branch 'develop' of github.com:Budibase/budibase into feature/formula-filtering 2022-01-21 12:52:58 +00:00
Rory Powell 04386bd1d8 Merge pull request #4000 from Budibase/fix/sync-apps-reset-rows-quotas
App and Row Quota Fixes
2022-01-21 11:20:14 +00:00
mike12345567 50eff577f9 Getting the static formulas being processed on input, not re-processing on output. 2022-01-20 18:04:44 +00:00
Michael Drury 9d5d8284cb Quick fix for #4093 - make sure the App ID/App URL returned for deployed apps is always lowercase, as URLs are not case sensitive and should not be compared as such. 2022-01-18 20:54:19 +00:00
Rory Powell 604d316834 Add dryRun to automation row create and remove env conditional on delete 2022-01-18 15:53:55 +00:00
Rory Powell fc043e116d Support template and app import in quotas + logging 2022-01-18 15:37:16 +00:00
Rory Powell 79c10fba7c Account for duplicate row ids caused by app import 2022-01-18 12:48:54 +00:00
Rory Powell ff887f8f88 Sync row usage with app deletion 2022-01-17 18:07:26 +00:00
Rory Powell 8fc60af820 Calculate total rows in migration, centralise quota enabled logic and tidy to use env vars only 2022-01-17 12:44:53 +00:00
Rory Powell a12a30c8ad Merge branch 'develop' into fix/sync-apps-reset-rows-quotas 2022-01-14 10:12:57 +00:00
Martin McKeaveney 4b6e88075d merge with master 2022-01-13 14:58:17 +01:00
mike12345567 bca8212d1d Merge branch 'develop' of github.com:Budibase/budibase into fix/sync-apps-reset-rows-quotas 2022-01-12 13:20:22 +00:00
mike12345567 97c6f3298a Removing use of direct package access. 2022-01-12 12:54:25 +00:00
mike12345567 5ee6aa24b2 Refactoring core library usage in monorepo, make it a bit cleaner/easier to search/more standardised. 2022-01-12 11:32:14 +00:00
Rory Powell e58bd14dcc Merge branch 'develop' into fix/sync-apps-reset-rows-quotas 2022-01-12 09:34:14 +00:00
Rory Powell 979313f966 Enable migration 2022-01-11 18:38:18 +00:00
Rory Powell 726315afde Sync app quota to correct number, reset and disable rows quota 2022-01-11 17:49:42 +00:00
mike12345567 37d0617ace Renaming some variables to core, fixing test cases that referenced auth directly. 2022-01-11 16:18:30 +00:00
mike12345567 b33523a73d Merge branch 'develop' of github.com:Budibase/budibase into feature/auth-core 2022-01-11 15:16:07 +00:00
mike12345567 1327394784 Switching out @budibase/auth to @budibase/backend-core. 2022-01-10 19:33:00 +00:00
mike12345567 c75cc47ad3 Updating to handle prod vs dev apps and deletion of attachments, as well as handling it on update. 2022-01-06 18:45:40 +00:00
mike12345567 f1981220af Removing attachments when row is deleted (always, need to restrict if app is deployed). 2022-01-06 17:59:29 +00:00
Martin McKeaveney 4d77353692 adding minio URL to objectStoreUrl check 2021-12-31 13:28:52 +00:00
Andrew Kingston d06cc93757 Merge branch 'develop' of github.com:Budibase/budibase into feature/json-backend 2021-12-15 13:36:10 +00:00
Andrew Kingston 7146b994ff Merge branch 'develop' of github.com:Budibase/budibase into feature/json-backend 2021-12-07 15:11:32 +00:00
mike12345567 99e2cd52e8 Adding stats, code, timings and size of request. 2021-12-06 18:23:18 +00:00
mike12345567 a6de5a4fa1 Exporting date and auto id field, but not importing autocolumns when table is created. 2021-12-02 16:17:10 +00:00
mike12345567 003b6424a2 Fixing issue with updating row validation to allow empty objects. 2021-11-29 17:54:09 +00:00
Michael Drury a726d158b8 Merge pull request #3338 from Budibase/feature/query-rbac-timeouts
Query RBAC, query and automation threading/timeouts
2021-11-17 11:39:09 +00:00
mike12345567 11debac115 Updating to manage completed events piling up, this will periodically clear out all events - repeats cannot be removed with the removeOnCompleted job option. 2021-11-16 18:58:24 +00:00
mike12345567 f13257bebe Updating the getAllApps function to use a cached version of the app metadata, rather than retrieving it individually everytime. Also invalidating the results everytime they are updated (at least in the important locations). 2021-11-15 17:40:45 +00:00
Michael Drury 0ac5c4713a Fixing test case (didn't provide a schema). 2021-11-12 20:23:00 +00:00
mike12345567 1d7fe369c6 Linting and updating csv parser test case to match new functionality. 2021-11-12 19:39:12 +00:00
mike12345567 d9d5391a40 Some UI work, as well as moving SQL to using a proper bulk insert method and fixing an issue found with csv parsing and removing of invalid columns. 2021-11-12 19:24:56 +00:00
mike12345567 af5e196b4c Adding all required controls for data import to internal tables, just need to implement external table data import. 2021-11-12 18:26:57 +00:00
mike12345567 5c8670c7f4 Merge branch 'develop' of github.com:Budibase/budibase into feature/query-rbac-timeouts 2021-11-11 13:50:42 +00:00
mike12345567 dc8d0aa533 Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-11 13:48:07 +00:00
mike12345567 cca28ce255 Adding worker controls to both automations and queries. 2021-11-11 12:11:09 +00:00
Martin McKeaveney 2a2963dac4 bust cache when app versions are different 2021-11-11 12:21:45 +01:00
mike12345567 781e8359a1 Adding worker-farm back to have a mechanism to run queries within which we can timeout. 2021-11-10 19:35:09 +00:00
mike12345567 94ee13ffc4 Adding the sync call from the worker for creation, updating and deletion of users. Making sure that production and development apps are always up to date with user metadata. 2021-11-04 14:53:03 +00:00
Michael Drury 3a5e004f36 Adding sync user endpoint to server which can be used by the worker. 2021-11-03 23:15:38 +00:00
Rory Powell ad61f2af3b Prevent non builder from accessing dev apps 2021-10-25 16:59:09 +01:00
Andrew Kingston 029b447ce7 Merge pull request #3042 from Budibase/fix/app-export-performance
Improve app export experience
2021-10-20 10:25:59 +01:00
Andrew Kingston d00f3f27fe Refactor app exports to allow a streaming realtime backup, and tidy up 2021-10-18 12:08:12 +01:00
Rory Powell a94becac9c Merge pull request #2975 from Budibase/no-access-role
No access role / public by default
2021-10-18 11:08:45 +01:00
Peter Clement 5cfaa17798 add check for missing _rev 2021-10-18 09:51:13 +01:00
Peter Clement eb957bc94f Potential fix for issues with updating and saving rows and columns 2021-10-17 21:23:30 +01:00
mike12345567 5b81d25d1a Fixing some issues which were causing errors during the cypress test runs, such as not redirect /api/system/ requests to the worker. 2021-10-14 16:25:07 +01:00
mike12345567 b46a945fc4 Adding the basics of the query transformers to the frontend and to the backend, as well as switching to vm2 for script running. 2021-10-12 18:45:13 +01:00
Rory Powell 8c67f3da13 No access role / public by default 2021-10-12 10:05:57 +01:00
mike12345567 183b6e7b50 Fixing issue with user's being logged in and trying to access other tenants public apps, this work makes sure that users from other tenants will not be 403'd immediately (too aggressive) but instead they will have all other their RBAC roles revoked. 2021-10-07 15:49:26 +01:00
Martin McKeaveney ab24e02941 UX improvements 2021-10-05 23:49:32 +01:00
Martin McKeaveney 4c59087904 templates working end to end 2021-10-05 23:02:28 +01:00
Rory Powell 380e3b4ccf Merge pull request #2882 from Budibase/honour-quota
Deny only when usage quota is exceeded
2021-10-04 16:47:53 +01:00
Rory Powell c3a95d6c03 Deny only when usage quota is exceeded 2021-10-04 14:07:10 +01:00
mike12345567 c82c9df522 Fixing issue with direct app request in self host not working when un-authenticated (doesn't re-direct to login). 2021-10-04 13:31:53 +01:00
Michael Drury 5a203d7b7d Merge pull request #2847 from Budibase/fix/2665
Fix created by/updated by auto columns breaking public forms
2021-10-01 15:16:22 +01:00