Commit Graph

854 Commits

Author SHA1 Message Date
mike12345567 4d86df057b Some fixes for #8770 - the CLI was very memory intensive when working with large databases, that contained many revisions. We don't need the revisions for app exports/backups, therefore I've updated our export systems to drop the revision history as it compacts the database significantly and speeds up exports/reduces memory usage. 2023-02-06 17:54:40 +00:00
Adria Navarro 6ac57d424c Don't log on CI 2023-02-04 21:04:40 +00:00
adrinr 11a7742d90 Cleanup 2023-02-03 19:23:36 +00:00
adrinr 2e29ac9ec7 Rename name for id 2023-02-03 12:09:56 +00:00
adrinr 5d58fc5948 Dry 2023-02-03 11:28:27 +00:00
adrinr 9936d03e27 Merge branch 'develop' into feature/dependencies-image 2023-02-03 10:44:40 +00:00
adrinr 6dab44a569 Clean code 2023-02-03 09:37:34 +00:00
Dean 436564709e Merge remote-tracking branch 'origin/develop' into fix/add-onboarding-tour-tenant-flag 2023-02-02 11:38:57 +00:00
Dean 065e74024e Added new unit tests for feature flags 2023-02-02 11:38:10 +00:00
adrinr 11fa2313f1 Undone user cache changes 2023-02-01 17:20:48 +00:00
adrinr 79ee85dab3 Remove remaning faker refs 2023-02-01 17:19:56 +00:00
adrinr c7d0a077be Replace faker for chance 2023-02-01 17:11:50 +00:00
Adria Navarro b125b5478b Merge branch 'develop' into feature/dependencies-image 2023-02-01 16:32:00 +00:00
Dean 0eed617866 Updated default feature flags to include onboarding by default. Added tenant overrides to allow exclusion from global features 2023-02-01 14:12:43 +00:00
mike12345567 048cf8f188 PR comments. 2023-02-01 13:01:38 +00:00
adrinr 1d8c27bdc4 Increase timeout 2023-02-01 12:29:03 +00:00
adrinr e639b7cf26 More seq 2023-02-01 11:46:31 +00:00
adrinr 34278349c3 Merge branch 'develop' into feature/dependencies-image 2023-02-01 10:56:22 +00:00
mike12345567 f4379fcb4f Updates to use our new Nano layer for CouchDB integration rather than PouchDB. 2023-01-31 19:49:31 +00:00
adrinr 2ab3680538 Fix installation race conditions 2023-01-31 17:27:25 +00:00
deanhannigan ee288c1f2d Merge pull request #9409 from Budibase/feature/user-onboarding-overlays
Feature/user onboarding overlays
2023-01-31 16:37:18 +00:00
adrinr b2813db5db Handle db creation race conditions 2023-01-31 16:15:11 +00:00
Adria Navarro 16e53957bc Merge branch 'develop' into feature/dependencies-image 2023-01-30 18:54:05 +00:00
adrinr 1dabf71f68 Run conflicting tests in sequential mode 2023-01-30 13:35:09 +00:00
adrinr e4c898c327 Use test-containers for backend-core tests 2023-01-27 11:43:36 +00:00
adrinr 7027abeaa2 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
Adria Navarro Redo b94546b1a1 Fix user test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 9242470f6f Fix snapshots test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 8c68741f98 Fix application delete tests 2023-01-26 18:20:21 +00:00
Adria Navarro 26fa3bd484 tweak tests 2023-01-24 15:46:50 +00:00
Adria Navarro fc6c4d5290 Remove test logic from getAllDbs 2023-01-24 14:06:28 +00:00
mike12345567 5a2937c8d2 Adding events for environment variables (created, deleted, upgrade panel opened). 2023-01-23 18:18:06 +00:00
Adria Navarro 6806404465 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:08:19 +00:00
Adria Navarro 486bc6b18d Add jest-testcontainers-config 2023-01-23 15:52:23 +00:00
Dean a10bd138ff Merge remote-tracking branch 'origin/develop' into feature/user-onboarding-overlays 2023-01-23 09:34:20 +00:00
Dean 14da8c0c9e Added new onboarding tour flow for builder 2023-01-23 00:32:01 +00:00
mike12345567 0f33fd8d48 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-20 19:55:11 +00:00
mike12345567 3659768c42 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns 48e1695318 JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
mike12345567 c645a9bc21 Some type updates and an improvement to encryption to allow selecting the secret from an option list. 2023-01-16 18:15:43 +00:00
mike12345567 fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
Dean 4fd91ef617 Merge remote-tracking branch 'origin/cheeks-lab-day-portal-redesign' into feature/user-onboarding-overlays 2023-01-13 09:22:41 +00:00
Dean 7b3733d659 Merge commit 2023-01-13 09:20:55 +00:00
Peter Clement 117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Rory Powell f85ecd4810 Fix pino request id generation (#9324)
Remove the duplicated pino config in favour of the common config. Move request id generation into common configuration
2023-01-12 10:25:21 +00:00
Rory Powell 92ba282ee5 Logging type updates to fix account portal build (#9317) 2023-01-12 08:37:41 +00:00
Rory Powell e5e767f18d Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567 69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567 75df57c3d1 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-11 10:31:57 +00:00
Rory Powell e95222c0f4 Prefer app url resolution over referer (#9218)
* Prefer app url resolution over referer

* Update lockfiles
2023-01-11 10:24:57 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
mike12345567 d347b8015b Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-10 18:49:07 +00:00
mike12345567 c9d8668062 Licensing updates for environment variables. 2023-01-09 15:42:09 +00:00
Hong Phuc Nguyen 6825b2e3fc Doing sanitizeKey when doing deleteFile(s) (#9209)
* Doing sanitizeKey when doing deleteFile(s)

Doing sanitizeKey when doing deleteFile(s). 
In case of backup file name in backups bucket backup-2023-01-03T185512.686Z.tar.gz but in global-db store backup filename is backup-2023-01-03T18:55:12.686Z.tar.gz
sanitizeKey on deleteFile(s) method will prevent all other case related to this bug

* use .promise() instead callback for workaround aws-sdk bug
2023-01-05 08:54:10 +00:00
mike12345567 ea5b515783 Playing around with getting tests working. 2023-01-04 19:47:56 +00:00
Martin McKeaveney 84ab7862d1 fixes for google sheets, admin checklist, and deleting an app from API (#8846)
* fixes for google sheets, admin checklist, and deleting an app from API

* code review

* splitting unpublish endpoint, moving deploy endpoint to applications controller. Still to do public API work and move deployment controller into application controller

* updating REST method for unpublish in API test

* unpublish and publish endpoint on public API, delete endpoint unpublishes and deletes app

* removing skip_setup from prodAppDb call

* removing commented code

* unit tests and open API spec updates

* unpublish, publish unit tests - delete still in progress

* remove line updating app name in API test

* unit tests

* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

* v2.2.4

* Update pro version to 2.2.4

* lock changes (#9047)

* v2.2.5

* Update pro version to 2.2.5

* Make looping arrow point in right direction (#9053)

* v2.2.6

* Update pro version to 2.2.6

* Types/attaching license to account (#9065)

* adding license type to account

* removing planDuration

* v2.2.7

* Update pro version to 2.2.7

* Environment variable type coercion fix (#9074)

* Environment variable type coercion fix

* Update .gitignore

* v2.2.8

* Update pro version to 2.2.8

* tests passing

* all tests passing, updates to public API response

* update unpublish call to return 204, openAPI spec and unit

* fixing API tests

Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-19 13:18:00 +00:00
Rory Powell f4a39080de Minio and local licensing fixes (#9071) 2022-12-16 11:14:31 +00:00
Andrew Kingston 090ae5df49 Master => Develop (#9049)
* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2022-12-15 12:13:42 +00:00
Rory Powell 786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Rory Powell f935f05509 Offline license POC (#9046) 2022-12-14 21:48:48 +00:00
Peter Clement 9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
mike12345567 20984e8072 Some fixes based on test failure. 2022-12-07 17:33:26 +00:00
Andrew Kingston 8567ae70af Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-29 12:22:56 +00:00
mike12345567 a02e9017ec Final fixes after re-running all test suites. 2022-11-28 19:12:23 +00:00
mike12345567 d6e9380c06 General work after running some tests in CI - general refactoring as well. 2022-11-28 17:54:04 +00:00
mike12345567 3a6200144a Fix for account portal. 2022-11-28 14:09:18 +00:00
mike12345567 70242f3be7 Fixing some issues detected by testing. 2022-11-26 21:26:19 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567 90362b65c1 Disabling js interop in Typescript build of backend-core and worker, fixing build issues. 2022-11-26 14:46:01 +00:00
mike12345567 a3bb2e0d77 Automation overhaul to Typescript, plus type updates. 2022-11-25 19:57:07 +00:00
Andrew Kingston abedb5d9eb Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-25 11:24:57 +00:00
mike12345567 d3c4c99e16 Complete conversion of backend-core to Typescript. 2022-11-24 18:48:51 +00:00
Andrew Kingston cd24c408fe Rename migration 2022-11-24 14:27:49 +00:00
mike12345567 bfaef13768 Refactoring worker, converting all controllers/routes to Typescript and all imports of backend-core to new style. 2022-11-23 18:25:20 +00:00
mike12345567 4959a491d7 Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-23 10:30:57 +00:00
Rory Powell 6f3f858d81 Account portal <-> backend-core fixes 2022-11-22 22:24:45 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 92210144ff More controller typescript conversions. 2022-11-22 16:52:25 +00:00
Andrew Kingston c01b9af1f0 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-22 16:52:09 +00:00
Rory Powell 7610065db1 Fix view creation 2022-11-22 16:28:51 +00:00
mike12345567 8a4da7d4ce Typescript conversion of the table controllers. 2022-11-22 13:56:01 +00:00
mike12345567 8f94664ddd Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-22 12:03:31 +00:00
mike12345567 de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
Dean 192c9b56e2 Import refactoring and some review updates. 2022-11-21 15:53:47 +00:00
Dean 64e7239d42 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 15:40:11 +00:00
mike12345567 3e7bed067b Merge branch 'develop' of github.com:Budibase/budibase into develop 2022-11-21 15:06:44 +00:00
mike12345567 cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
mike12345567 f49233d883 Fix for table deletion, updating DatabaseImpl to define pouch functions directly. 2022-11-21 14:41:19 +00:00
Dean 0441704c57 Import fixes for backend core constants. Minor name change for default data source from Test DB to Sample Data 2022-11-21 12:47:36 +00:00
mike12345567 3c93101fdb Adding IDs to backup events. 2022-11-21 12:12:57 +00:00
Rory Powell 6cb71b5272 Add remove overload to allow for doc removal 2022-11-21 11:38:37 +00:00
Dean 02a902ebd3 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 11:10:29 +00:00
Andrew Kingston c58067a589 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-21 10:30:25 +00:00
mike12345567 12a9ed6dcb Adding type to triggered. 2022-11-17 23:09:49 +00:00
Michael Drury 3aa5c25da9 PR comments. 2022-11-17 19:38:47 +00:00
mike12345567 24d5d2a22c Adding an event for when a backup is triggered. 2022-11-17 17:15:35 +00:00
mike12345567 0d13a77409 Some minor updates after running qa-core tests, found some issues that likely exists before context update. 2022-11-17 16:30:38 +00:00
Dean e932aa105b Shifted the budibase datasource constant to backend-core 2022-11-17 16:28:48 +00:00
mike12345567 31c198888a Updating some enums, plural to single. 2022-11-17 14:59:18 +00:00
mike12345567 0557219140 Fixing permission types. 2022-11-17 14:47:52 +00:00
mike12345567 58e59bfacc Updating PouchLike to be an interface in types, with its impl stored in backend-core, now called Database. 2022-11-17 14:35:03 +00:00
mike12345567 bc857d7bb8 PR comments - still experiencing build issues. 2022-11-17 13:31:54 +00:00
mike12345567 f5760b6601 Fixes post merge. 2022-11-16 18:28:45 +00:00
mike12345567 29dd98a7fc Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-16 18:12:31 +00:00
mike12345567 4328ed1b67 Updating middlewares to Typescript, as well as some fixes based on running tests. 2022-11-16 17:24:13 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
Rory Powell 9c169087e6 Add copy button to sso callback urls, e2e unit testing for OIDC, stub out other auth tests 2022-11-16 11:34:16 +00:00
mike12345567 e7e2d91fef Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-15 16:45:25 +00:00
Rory Powell 1612044dc1 Merge branch 'develop' into subdomain-tenancy 2022-11-15 16:18:59 +00:00
Rory Powell f48ff01045 ensure fetch and aws are always mocked 2022-11-15 15:50:15 +00:00
Rory Powell f7af8621d5 Update waitForCompletion and pouch / backup type 2022-11-15 14:28:02 +00:00
Andrew Kingston 2b42b21b3a Add migration to automatically convert legacy table settings into new action setting 2022-11-15 11:54:45 +00:00
Rory Powell 9973f2e161 Bump jest and ts-jest to be consistent across backend packages to fix CI issue, test config updates 2022-11-14 22:55:47 +00:00
mike12345567 72c9aadae0 Updating test cases - trying to get everything in order for merge. 2022-11-14 20:25:05 +00:00
mike12345567 3f0e53f90c Updating context test, some minor adjustments based on getting the test working again. 2022-11-14 18:29:15 +00:00
mike12345567 3f6cdd787c Replacing CLS with local-storage, simplified usage which should remove the memory leak permenantly. 2022-11-14 18:00:20 +00:00
Rory Powell c6fba4de3d Test fixes 2022-11-11 15:43:41 +00:00
mike12345567 b4b471e054 Re-jigging things a bit, hiding as much of the couch/pouch stuff away. 2022-11-11 12:46:32 +00:00
mike12345567 bc94f20794 Typescript conversions - trying to get all of context/db layer into TS. 2022-11-11 11:57:50 +00:00
Rory Powell 72562278c0 Support path variable tenancy detection, add /api/system/* tests, update no tenancy matchers to be more accurate 2022-11-11 11:10:07 +00:00
mike12345567 c63c3b48c5 Typescript conversions, as well as updating context to just use an object map. 2022-11-10 17:38:26 +00:00
mike12345567 45e7ef61ef Re-building the context module to use a single object, meaning we can create new context frames and copy over whatever exists, then update. 2022-11-10 16:38:32 +00:00
melohagan b6ff581d5e Merge pull request #8593 from Budibase/bug/sev2/mongodb-aggregate-readable
MongoDB aggregate readable
2022-11-10 15:27:08 +00:00
Mel O'Hagan be32ef1cb6 Add readable flag to datasource validation 2022-11-10 14:23:22 +00:00
mike12345567 9e01a9d1be Some minor updates based on getting the worker using the new pouchlike impl. 2022-11-09 17:53:35 +00:00
mike12345567 c744d23832 Major update - removing the use of context for PouchDB instances, swapping knowledge of PouchDB to the PouchLike structure that replaces it. 2022-11-09 16:53:42 +00:00
Rory Powell 6783fd713e Update tenancy detection to honour any subdomain pattern according to platform url 2022-11-09 16:35:16 +00:00
mike12345567 a5624142a8 Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-09 14:44:01 +00:00
mike12345567 ecb398bf98 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-09 13:41:51 +00:00
Michael Drury 41a65bbe47 Exporting roles differently to fix issue raised by test. 2022-11-08 20:01:01 +00:00
Michael Drury 2240b060d4 Quick fix to not expose the builder ID outside of the role impl. 2022-11-08 19:48:16 +00:00
mike12345567 eb251fb48e Exporting some functions that were previously exported. 2022-11-08 18:35:21 +00:00
mike12345567 693d6b6242 Typescript re-write of the roles layer, this is the backbone of a lot of our security features, and I believe the issue was generally to do with a lack of handling of null-ish inputs. 2022-11-08 18:25:37 +00:00
mike12345567 9e7ac26aa0 Getting basic pouch replacement working. 2022-11-08 16:32:13 +00:00
mike12345567 2f01caa88d Adding more type handling around the upload object store function. 2022-11-08 11:49:07 +00:00
mike12345567 913eb96ab0 Fixing an issue which was alerting, x-amz-meta-fieldname contains an invalid value, this error isn't really documented, but comes from if a metadata tag is sent up with nullish, or a non-string type. Fixing this in the core library, removing an invalid inputs. 2022-11-08 11:34:16 +00:00
mike12345567 2426123686 First version of pouch-like system, a wrapper for Couch nano. 2022-11-07 18:27:39 +00:00
Rory Powell b36634f510 Add extra auth logging to authenticated.ts 2022-11-04 08:30:44 +00:00
mike12345567 b9caf0aef5 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-02 20:12:01 +00:00
mike12345567 19669575e4 Fixing issue with self host build - import of backend-core changes mean that loading the public API files can require setup of backend-core, making it so that the JWT Strategy doesn't need to be setup to load backend-core. 2022-11-01 12:59:10 +00:00
mike12345567 6228d3346e Merge branch 'develop' of github.com:Budibase/budibase into fix/mike-oct-fixes 2022-10-26 10:37:01 +01:00
Rory Powell 887470d4b5 Ensure tmpDir/.budibase always exists 2022-10-26 09:24:28 +01:00
mike12345567 a24694a4ea Refactoring a lot of content around webhooks to Typescript, as well as fixing webhooks and automation app IDs on import of new app. 2022-10-25 18:19:18 +01:00
Rory Powell 56456f3f6d Startup fixes 2022-10-25 13:37:26 +01:00
Rory Powell 9face50a07 Fix build failure around PouchDB type 2022-10-25 09:02:55 +01:00
mike12345567 5340b49d6b Some fixes based on PR comments. 2022-10-24 12:06:50 +01:00
mike12345567 4daf9c2615 Addressing majority of PR comments. 2022-10-24 10:04:14 +01:00
mike12345567 2a2f41a861 Fixing issue discovered by tests. 2022-10-21 16:02:13 +01:00
mike12345567 f5557fd805 Fetching a list of backup/restore events includes the full user object. 2022-10-20 15:05:50 +01:00
mike12345567 113a23ba3d Adding statistics output for backups. 2022-10-19 16:48:32 +01:00
mike12345567 bb4e3ba8cf Adding in required events for app backup system. 2022-10-17 15:26:09 +01:00
mike12345567 1373630b33 Minor fixes after testing manual backup system. 2022-10-14 20:10:44 +01:00
mike12345567 0bd2a18e46 Main types and work for the CRUD operations of app backup backend in pro + the listeners to handle exporting apps from the server. 2022-10-14 19:24:03 +01:00
mike12345567 b702c7482a Fixes for cronjob stop - correctly handle this without stalled job handle. 2022-10-14 13:26:42 +01:00
mike12345567 d620e54fdb Handling listeners as part of queue creation, rather than external part. 2022-10-13 17:55:05 +01:00
mike12345567 35525bfedd Moving queue implementation into backend-core - so that pro can access. 2022-10-13 17:27:04 +01:00
mike12345567 8fdba78bde Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-13 15:59:31 +01:00
mike12345567 2eae3f2a6c Fixes for find functionality after testing. 2022-10-12 17:57:31 +01:00
mike12345567 4da3705851 Quick fixes to DB TS conversion. 2022-10-12 17:37:52 +01:00
mike12345567 f5dd87f8f9 Adding first pass of attachments updating. 2022-10-12 17:34:17 +01:00
mike12345567 8d7f40e443 Refactoring more to Typescript, adding the ability to use the _find API of CouchDB. 2022-10-12 17:02:23 +01:00
Rory Powell 281eb151e2 Merge pull request #8164 from Budibase/feature/quota-emails
Approaching and Exceeded Usage Limit Notifications
2022-10-12 12:31:17 +01:00
mike12345567 9d34ccfaca Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-12 11:59:00 +01:00
Rory Powell 2f0f36e635 Merge branch 'master' into merge-master 2022-10-12 10:19:46 +01:00
mike12345567 19133f08e6 Adding import functionality - still need to update the attachments URL. 2022-10-11 20:25:22 +01:00
mike12345567 f237befbce Some fixes + cleanup of tmp directory. 2022-10-11 19:28:13 +01:00
mike12345567 1f36eec89a Some updates towards supporting attachments in app exports. 2022-10-10 20:08:59 +01:00
Martin McKeaveney 536b7238e9 redis fix for new instances, removing relationship options from google sheets integration 2022-10-10 11:00:45 +01:00
Rory Powell 84685d3340 Add locking framework 2022-10-10 08:21:17 +01:00
mike12345567 197d195cb4 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 18:05:18 +01:00
Michael Drury 060b2aba3c Merge pull request #8175 from Budibase/fix/remove-app-scans
Removing Redis SCAN operation from app services
2022-10-07 17:35:05 +01:00
mike12345567 0c4a40c795 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 16:05:01 +01:00
Michael Drury af603afbc3 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-10-01 15:44:11 +01:00
mike12345567 f9269faf08 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-09-30 14:55:00 +01:00
Rory Powell 3fba690240 Merge pull request #6074 from Budibase/feature/app-quotas
App/resource ID breakdown of quotas
2022-09-30 13:28:07 +01:00
mike12345567 22d501edee Merge branch 'fix/allow-removing-crud-plugins' of github.com:Budibase/budibase into feature/plugin-icons 2022-09-30 08:58:26 +01:00
mike12345567 95136a54f2 Adding ability for datasource plugins to have a custom icon svg. 2022-09-29 19:30:53 +01:00
mike12345567 504412112f Allow removing CRUD operations from custom datasource plugins. 2022-09-29 16:56:46 +01:00
Rory Powell d87e3904ae Create generic quota sync migration 2022-09-28 13:13:37 +01:00
Rory Powell 98168aee29 Merge branch 'develop' into feature/app-quotas 2022-09-28 12:33:39 +01:00
Rory Powell 79226777b1 Merge develop 2022-09-28 08:56:45 +01:00
Michael Drury 6adb30fc1c Merge pull request #7981 from Budibase/feature/group-app-add
Add apps to a group from within groups interface
2022-09-26 19:18:44 +01:00
Martin McKeaveney 57bbf28119 merge with master 2022-09-26 17:57:23 +01:00
mike12345567 2acdf6b7eb Feature to allow adding apps from within the groups interface, rather than having to go to apps individually to do this. 2022-09-26 17:54:00 +01:00
mike12345567 e460864091 Adding a migration for the plugin quotas to make sure they are always accurate in self host at startup. 2022-09-24 12:10:09 +01:00
mike12345567 e235073cc5 Adding tenancy awareness for plugin bucket. 2022-09-23 16:30:45 +01:00
mike12345567 a1b1798e13 Minor update to feature flag name. 2022-09-23 13:08:18 +01:00
mike12345567 9b29bd6709 Merge branch 'develop' of github.com:Budibase/budibase into group-fixes 2022-09-22 18:44:16 +01:00
mike12345567 e3f054470a Updating a few core endpoints to better integrate the groups system and make sure users always have the correct role ID updated onto them. 2022-09-22 18:27:43 +01:00
mike12345567 c382b86fb2 Self API in worker conversion to typescript. 2022-09-22 14:09:20 +01:00
Rory Powell c3ee8b0e56 Merge pull request #7859 from Budibase/feature/enterprise
Enterprise / license override support
2022-09-21 20:18:54 +01:00
Rory Powell a8782c4629 License analytics 2022-09-21 15:45:29 +01:00
mike12345567 115a0c146b Adding a user core bulk update function. 2022-09-21 13:55:10 +01:00
mike12345567 e6c91b6f8e Adding group cleanup, removing group IDs from users when group is deleted. 2022-09-21 12:43:09 +01:00
mike12345567 34771e1ef7 Updates to improve the view development experience. 2022-09-20 19:12:48 +01:00
Mel O'Hagan c72cd71467 Add 'extra' validation for plugin datasource 2022-09-20 15:47:17 +01:00
Rory Powell f7ec431a45 Move tenancy/utils to db/tenancy to resolve circular imports between tenancy and db package. This should remove all reliance on the tenancy package from the db package 2022-09-20 10:20:36 +01:00
mike12345567 40688f6783 Adding budibase/pro integration for plugins, controlling quota limits. 2022-09-15 14:57:27 +01:00
Rory Powell 060251ab03 Merge pull request #7782 from Budibase/feature/day-pass-pricing
Day pass pricing
2022-09-15 13:36:10 +01:00
Rory Powell f7fa9969f4 Fixes 2022-09-15 11:59:46 +01:00
Michael Drury b8462eea0c Merge pull request #7774 from Budibase/events/plugins
Plugin init, imported and deleted events
2022-09-15 12:55:40 +02:00
Rory Powell 4787f9ccab Pre-review tidy, add new badge to plugins 2022-09-15 11:23:51 +01:00
Rory Powell 086d9ebdf9 Merge branch 'develop' into feature/day-pass-pricing 2022-09-15 10:56:50 +01:00
Rory Powell 0f98f2fcaa Merge branch 'master' into develop 2022-09-15 10:19:56 +01:00
Rory Powell 8cfd6a9faa Merge branch 'develop' into feature/day-pass-pricing 2022-09-15 08:55:33 +01:00
mike12345567 46c1590c83 Adding types for plugin events, specifically for plugin init, import and deletion, this is across the CLI and the server. 2022-09-14 17:35:46 +01:00
Martin McKeaveney 41a300c2f9 Merge pull request #7591 from Budibase/fix/platform-email-casing
Fix/platform email casing
2022-09-14 16:09:52 +01:00
Martin McKeaveney 110211c53a fixing tests 2022-09-14 14:22:53 +01:00
Rory Powell a551532e73 Navigation updates, cookie constant, update link-dependencies and localdomain scripts 2022-09-14 10:53:14 +01:00
mike12345567 5c5e1b10b4 Fixing CLI build - prebuilds required for hashing can be disabled via environment variable. 2022-09-13 18:00:10 +01:00
Martin McKeaveney 7d9253b8d4 fix circular dependency issues 2022-09-13 17:29:31 +01:00
Martin McKeaveney 19a2049475 remove references to module exports 2022-09-13 12:35:17 +01:00
Martin McKeaveney 07f2f66b04 convert views to typescript 2022-09-13 12:22:03 +01:00
mike12345567 828066de46 Merge branch 'develop' of github.com:Budibase/budibase into feature/plugin-management-ui 2022-09-12 15:34:34 +01:00
Rory Powell 45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
Rory Powell 884f446671 Merge branch 'develop' into feature/day-pass-pricing-temp 2022-09-12 11:33:02 +01:00
Rory Powell f4963db294 Add buttonText to InlineAlert, export TooltipWrapper, update Account type with license key activate time, convert error package to TS 2022-09-12 10:43:26 +01:00
NEOLPAR 171970108e fix build error exporting and declaring plugins 2022-09-09 12:01:04 +01:00
NEOLPAR e5806b832f moved validate to backend-core to be used in server and cli 2022-09-09 11:12:14 +01:00
Martin McKeaveney 2991d05d5b PR comments 2022-09-07 23:21:14 +01:00
mike12345567 86c8618e8f Fix for #7431 - reboot didn't work at all previously which is why apps couldn't be published with it enabled, this is now a self host only feature, I've removed the ability to enable a reboot cron in the Cloud and it will not run the lookup/execution. 2022-09-07 17:05:17 +01:00
Rory Powell 5abdd102a9 Error handling, wildcard feature flags 2022-09-07 12:08:10 +01:00
mike12345567 2d183e0c6c Adding compaction before each replication to try to reduce size of database, as well as removing the possibility of app metadata being in conflict as per issue #7494. 2022-09-06 18:07:18 +01:00
Rory Powell 165194658b Move day pass middleware from authenticated to licensing, sent activity to account portal 2022-09-06 16:24:36 +01:00
NEOLPAR 06b36315b6 adding headers param in case it is needed for auth or similar 2022-09-06 15:46:11 +01:00
Rory Powell 818e7fd5f4 Day pass middleware 2022-09-06 12:25:57 +01:00
Martin McKeaveney 381622aa7a revert back to circular dep 2022-09-02 18:44:03 +01:00
Martin McKeaveney e02b7c1c68 fixing circular dep issue 2022-09-02 16:55:55 +01:00
Martin McKeaveney 7e5252e2e2 remove unnecessary files 2022-09-02 16:07:30 +01:00
Martin McKeaveney 0db194b412 platform view casing 2022-09-02 15:42:20 +01:00
Martin McKeaveney 9e2fd5222b platform user casing view 2022-09-02 09:12:03 +01:00
Rory Powell 276c455a11 Merge branch 'develop' into feature/day-pass-pricing 2022-09-01 15:26:16 +01:00
mike12345567 320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Rory Powell 7c2c4a0f94 Add conditional around joiValidator schema.append 2022-08-31 12:24:12 +01:00
Rory Powell 5f022e04a3 Merge branch 'develop' into user-fixes 2022-08-31 11:39:41 +01:00
Martin McKeaveney 02c93071ee merge 2022-08-30 10:33:37 +01:00
Rory Powell 59a53736ac update bulk create and bulk delete backend 2022-08-25 19:41:47 +01:00
Martin McKeaveney 2470d711b0 fixing s3 outage errors and scoping AWS configuration to service level 2022-08-25 17:01:12 +01:00
Rory Powell d591acf2d3 User fixes wip 2022-08-23 09:37:13 +01:00
Rory Powell 8fc8308530 Merge branch 'develop' into feature/day-pass-pricing 2022-08-19 14:08:03 +01:00
Rory Powell af7c64255b usage page updates 2022-08-19 09:28:26 +01:00
Rory Powell 76e18fb6de Support tiered pricing for day passes and update upgrade UI 2022-08-16 12:13:47 +01:00
mike12345567 c9c468a424 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:36:07 +01:00
mike12345567 76d427001a Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:34:01 +01:00
mike12345567 1c7f860184 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-11 16:28:46 +01:00
Andrew Kingston e8b9a49074 Attach correct content type to JS files when uploading to object store 2022-08-11 15:25:04 +01:00
mike12345567 b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
Martin McKeaveney b89c429f40 simplify if 2022-08-11 11:31:16 +01:00
Martin McKeaveney 68df1b14e6 skip empty dbs in test 2022-08-11 09:30:29 +01:00
mike12345567 a683665a99 Adding plugin upload API - takes a file form-data and then extracts, uploads to minio and stores data about the plugin to CouchDB. 2022-08-10 20:01:48 +01:00
Martin McKeaveney a60398b3b3 dont get app db name if undefined 2022-08-10 18:39:41 +01:00
Rory Powell 664cb2b0b0 Merge branch 'master' into develop 2022-08-10 14:36:49 +01:00
mike12345567 1ba804f507 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-10 11:55:53 +01:00
Rory Powell 54df92a8c3 Add timezone to served events 2022-08-10 11:29:11 +01:00
Rory Powell 500e697974 Trigger served events on ping endpoint 2022-08-10 11:01:54 +01:00
Rory Powell dd0395995f Rename async to emit 2022-08-09 14:01:55 +01:00
Rory Powell f7210e96e4 Fix served events 2022-08-09 13:31:12 +01:00
Martin McKeaveney c44ae30721 merge from master 2022-08-09 11:52:48 +01:00
Rory Powell 57ca5261bf Support per app events 2022-08-08 16:22:26 +01:00
Rory Powell 3b5abda2cf Rate limit served:X events 2022-08-08 15:44:29 +01:00
Rory Powell 3b9343b3e6 Merge branch 'master' into develop 2022-08-08 11:50:22 +01:00
Rory Powell cc9bc937b6 Reduce event frequency 2022-08-08 10:47:39 +01:00
Rory Powell fe17ffffb6 Bulk session wipe fix + logging 2022-08-08 09:34:45 +01:00
mike12345567 2dea5c5614 Some various session fixes based on current data. 2022-08-05 21:35:26 +01:00
mike12345567 52d16d1099 Updating sessions to TS, adding env var to set the session update length, adding reasons for invalidation, making sure errors are never considered authenticated. 2022-08-05 17:13:03 +01:00
mike12345567 b3a6efa2f9 Updating authenticated middleware to typescript and updating the TTL once per minute rather than every API request. 2022-08-05 15:21:12 +01:00
mike12345567 44a6aa85a9 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-04 21:35:55 +01:00
mike12345567 cfe3db835b Updating pino logging to remove health check spam. 2022-08-04 20:23:45 +01:00
mike12345567 f3418c4107 Some more logging, moving middlewares to backend-core. 2022-08-04 19:03:50 +01:00
mike12345567 382a2a3050 Adding logging for session invalidation. 2022-08-04 16:06:59 +01:00
Rory Powell 1b6b877546 Sync global-info users to fix login + prevent double password hashing 2022-08-04 14:49:56 +01:00
Andrew Kingston 7c4bf7aedd Fix crashing when determining roles when no apps exist 2022-08-02 16:01:38 +01:00
Rory Powell 466e41302b Merge pull request #7037 from Budibase/fix/joi-createdAt-updatedAt
Add updatedAt and createdAt as optional to all joi middleware
2022-08-02 14:35:58 +01:00
Rory Powell 6102ace3a9 Reduce event frequency 2022-08-02 10:52:09 +01:00
Rory Powell 09127df617 Add updatedAt and createdAt as optional to all joi middleware 2022-08-02 09:39:30 +01:00
Peter Clement c3a4941119 Merge pull request #6989 from Budibase/pc/fixes
User Management UI fixes
2022-08-01 09:39:55 +01:00
mike12345567 07f3897b55 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-29 14:31:18 +01:00
Peter Clement 2689c48fa1 flag user groups untill licensing ready 2022-07-29 13:22:59 +01:00
Rory Powell 1dc062a3fb Merge branch 'master' into develop 2022-07-27 16:32:36 -04:00
mike12345567 d42f3c3385 Adding fix for issue in cloud with user password deletion causing undefined errors. 2022-07-27 17:15:01 +01:00
Peter Clement dca37a61da adding tests and pr comments 2022-07-27 10:20:39 +01:00
Peter Clement fda6ed6e62 update feature error 2022-07-26 20:25:59 +01:00
Peter Clement 548e8d518c Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-26 20:19:33 +01:00
Peter Clement 46a6fc5048 refactor groups into pro and some other pr comments 2022-07-26 20:04:29 +01:00
mike12345567 f4db17502a Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-26 17:28:57 +01:00
mike12345567 d30e27d27d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-07-26 17:25:55 +01:00
Peter Clement cd426a5ca7 adding limits for uploading users 2022-07-26 12:17:01 +01:00
Peter Clement 9e75b18784 adding new custom feature disabled error 2022-07-25 19:45:50 +01:00
Peter Clement 3f8a006626 some more pr comments 2022-07-25 18:57:10 +01:00
Peter Clement 25d13d4a72 move bulk update / delete functionality out of controller 2022-07-25 16:58:30 +01:00
Andrew Kingston d9dacbc901 Use warn rather than info when notifying about ignored conflicts 2022-07-25 12:23:30 +01:00
Andrew Kingston 8bd254f313 Use log rather than warn for logInfo 2022-07-25 12:22:27 +01:00
Andrew Kingston f82b407f30 Ignore 409s in write-through cache 2022-07-25 12:17:40 +01:00
Peter Clement af451840ac move worker middleware to backend-core 2022-07-22 11:50:51 +01:00
Michael Drury 07de5faa2d Main bulk of logic around detecting cron recurring failure, still need to disable. 2022-07-20 22:38:06 +01:00
Peter Clement 94d999faf9 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 14:54:29 +01:00
mike12345567 1c02c3d3c3 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-07-19 14:12:48 +01:00
Peter Clement ca41e88045 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 11:23:31 +01:00
Rory Powell 3820182359 Write users and activity to dynamo 2022-07-18 16:11:52 -04:00