Commit Graph

1050 Commits

Author SHA1 Message Date
Rory Powell 2c46109e7d Enforceable SSO (#9787)
* Add ENFORCEABLE_SSO feature flag

* First draft of enforce sso configuration / show single sign on url

* Reading and writing isSSOEnforced + integration with login page

* Enable CI + lint

* Set correct base branch for CI

* Test fix for expected string changed

* Use tenant aware platform url as SSO link

* Bring in latest pro changes

* Lint

* Add useEnforceableSSO mock helper function

* Update configs.spec.ts with coverage for public settings

* Update users.spec.ts with additional tests for isPreventPasswordActions

* Lint

* Update refresh OAuthToken to use correct enum and add case statement
2023-02-27 13:42:51 +00:00
mike12345567 0fa984f26f Moving is audited and adding in env var for ip address/user agent auditing. 2023-02-27 11:42:52 +00:00
mike12345567 65646ba01b Further PR comments. 2023-02-27 11:00:13 +00:00
mike12345567 3e7c1d10cf Fix based on test cases. 2023-02-24 19:04:40 +00:00
mike12345567 8fb5168d56 Fix for auth logout test case. 2023-02-24 17:42:22 +00:00
mike12345567 d6b0b7610a Fixing circular dependencies which were blocking tests. 2023-02-24 17:31:58 +00:00
mike12345567 3ba76ce5cd Adding test case for PII clear out. 2023-02-24 16:51:04 +00:00
mike12345567 62501b0185 Adding a system for checking audited data in events, so that PII can be removed by posthog processor. 2023-02-24 16:45:33 +00:00
mike12345567 a293d3842f Fixing build issue. 2023-02-24 13:55:36 +00:00
mike12345567 8853776c79 Moving around processors to separate audit logs out of central event handling. 2023-02-24 13:52:54 +00:00
mike12345567 58fab29fb4 Main body of PR comments. 2023-02-24 13:32:45 +00:00
mike12345567 f070be5f65 Moving search index to an enum. 2023-02-24 13:15:14 +00:00
mike12345567 42fc004212 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-24 12:46:58 +00:00
mike12345567 0b48075688 Implementing a few basic tests to create and search the audit logs. 2023-02-23 17:23:06 +00:00
Rory Powell 4e1bebe897 Server flaky tests fixes - improving tenancy config 2023-02-23 13:43:27 +00:00
Rory Powell d3a7286711 Configs updates: remove circular deps, dedicated module, typing improvements, reduce db reads 2023-02-23 13:41:35 +00:00
mike12345567 0bc340052c Adding the ability to cleanup users from get functions (default is old behaviour). 2023-02-23 11:28:18 +00:00
Jonny McCullagh dde1237ed2 allUsers function & more metrics 2023-02-22 21:10:35 +00:00
mike12345567 01076bd35f Getting downloading working correctly, some minor UI updates, adding a new middleware for converting a query string to a body (useful for when a GET has to be used). 2023-02-22 18:50:27 +00:00
mike12345567 c6dadaa4ff Some work to make sure the user agent and ip address are always passed correctly to audit logs. 2023-02-22 16:10:54 +00:00
Rory Powell 6a88cfc32d Update locks error logging (#9768)
* Fix intermittent backend-core migration test failure

* Update lock logging
2023-02-22 08:32:03 +00:00
mike12345567 22f42ef898 Adding new mechanism to get the ipAddress and userAgent of call for audit logs. 2023-02-21 19:14:57 +00:00
mike12345567 ef30c03fa6 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-21 17:26:24 +00:00
Rory Powell 940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
mike12345567 b48acd8cf4 Some DB type updates (typing dump function) and adding in main audit log event publishers. 2023-02-21 14:56:38 +00:00
Rory Powell cacf275a99 Prevent SSO users from setting / resetting a password (#9672)
* Prevent SSO users from setting / resetting a password

* Add support for ENABLE_SSO_MAINTENANCE_MODE

* Add typing to self api and build out user update sdk

* Integrate sso checks with user sdk. Integrate user sdk with self api

* Test fixes

* Move self update into SDK

* Lock down maintenance mode to admin user

* Fix typo

* Add health status response and return type signature to accounts.getStatus

* Remove some unnecessary comments

* Make sso save user function non optional

* Remove redundant check on sso auth details provider

* Update syncProfilePicture function name to getProfilePictureUrl

* Update packages/worker/src/sdk/users/events.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Add ENABLE_EMAIL_TEST_MODE flag

* Fix for logging in as sso user when existing user has password already

* Hide password update and force reset from ui for sso users

* Always disable sso maintenance mode in cloud

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-02-21 08:23:53 +00:00
mike12345567 6cc96f39b1 Minor fixes for friendly audited events, and a new function for comparing app IDs. 2023-02-20 17:20:42 +00:00
Rory Powell a57f0c9dea Merge branch 'develop' into rory/february 2023-02-20 09:57:17 +00:00
mike12345567 70e525b928 Updating types for audit logs to correctly handle the deletion of resources like users or apps. 2023-02-17 19:00:45 +00:00
mike12345567 eca34d73ed Finishing up search API, updating typing in lucene layer. 2023-02-17 17:46:49 +00:00
mike12345567 6ec5e97ce9 Required work to support the new lucene audit logs search indexing. 2023-02-17 16:26:55 +00:00
mike12345567 2afd3e1580 Updating events to include a proper friendly map of audited events. 2023-02-15 19:44:32 +00:00
mike12345567 6d83ea9bec Adding in event auditing to server/worker. 2023-02-15 18:03:55 +00:00
Rory Powell bb1faac62a Merge master into develop 2023-02-15 15:10:02 +00:00
mike12345567 c60b6da0ab Removing pro from backend-core. 2023-02-15 13:49:30 +00:00
mike12345567 1ed4f4b8fe Update on audit logs, getting the full write flow from events configured. 2023-02-15 12:37:32 +00:00
mike12345567 46e9bf1443 Some updates to add in the audit log DB. 2023-02-13 18:16:13 +00:00
mike12345567 05ceee1cfe Moving lucene handling to backend-core so that it can be used for other databases (outside row indexes). 2023-02-13 17:13:59 +00:00
Rory Powell cc7eb64a3b Rename LOG_4XX to ENABLE_4XX_HTTP_LOGGING and enable by default 2023-02-13 14:39:24 +00:00
Rory Powell 0e3a17ab18 Merge pull request #9669 from Budibase/budi-6558-configurable-test-log-levels-and-common
Configurable test log levels and common error handling
2023-02-13 14:31:43 +00:00
Rory Powell eb5aa8786d Merge pull request #9670 from Budibase/budi-6559-enable-higher-concurrency-and-resiliency
Enable higher concurrency and resiliency in worker tests
2023-02-13 14:31:14 +00:00
Rory Powell f53faff7ad Add LOG_4XX to environment 2023-02-13 12:27:49 +00:00
Rory Powell 07e5598538 Enable use of redis container in worker tests 2023-02-13 12:09:16 +00:00
Rory Powell ae9979929a Enable higher concurrency and resiliency in worker tests 2023-02-13 11:57:30 +00:00
Rory Powell 5cd6cb166a Configurable test log levels and common error handling 2023-02-13 11:53:01 +00:00
mike12345567 464ab7a1bb Merge branch 'develop' of github.com:Budibase/budibase into fix/cli-memory-issues 2023-02-07 09:56:49 +00:00
mike12345567 4d86df057b Some fixes for #8770 - the CLI was very memory intensive when working with large databases, that contained many revisions. We don't need the revisions for app exports/backups, therefore I've updated our export systems to drop the revision history as it compacts the database significantly and speeds up exports/reduces memory usage. 2023-02-06 17:54:40 +00:00
Adria Navarro 6ac57d424c Don't log on CI 2023-02-04 21:04:40 +00:00
adrinr 11a7742d90 Cleanup 2023-02-03 19:23:36 +00:00
adrinr 2e29ac9ec7 Rename name for id 2023-02-03 12:09:56 +00:00
adrinr 5d58fc5948 Dry 2023-02-03 11:28:27 +00:00
adrinr 9936d03e27 Merge branch 'develop' into feature/dependencies-image 2023-02-03 10:44:40 +00:00
adrinr 6dab44a569 Clean code 2023-02-03 09:37:34 +00:00
Dean 436564709e Merge remote-tracking branch 'origin/develop' into fix/add-onboarding-tour-tenant-flag 2023-02-02 11:38:57 +00:00
Dean 065e74024e Added new unit tests for feature flags 2023-02-02 11:38:10 +00:00
adrinr 11fa2313f1 Undone user cache changes 2023-02-01 17:20:48 +00:00
adrinr 79ee85dab3 Remove remaning faker refs 2023-02-01 17:19:56 +00:00
adrinr c7d0a077be Replace faker for chance 2023-02-01 17:11:50 +00:00
Adria Navarro b125b5478b Merge branch 'develop' into feature/dependencies-image 2023-02-01 16:32:00 +00:00
Dean 0eed617866 Updated default feature flags to include onboarding by default. Added tenant overrides to allow exclusion from global features 2023-02-01 14:12:43 +00:00
mike12345567 048cf8f188 PR comments. 2023-02-01 13:01:38 +00:00
adrinr 1d8c27bdc4 Increase timeout 2023-02-01 12:29:03 +00:00
adrinr e639b7cf26 More seq 2023-02-01 11:46:31 +00:00
adrinr 34278349c3 Merge branch 'develop' into feature/dependencies-image 2023-02-01 10:56:22 +00:00
mike12345567 f4379fcb4f Updates to use our new Nano layer for CouchDB integration rather than PouchDB. 2023-01-31 19:49:31 +00:00
adrinr 2ab3680538 Fix installation race conditions 2023-01-31 17:27:25 +00:00
deanhannigan ee288c1f2d Merge pull request #9409 from Budibase/feature/user-onboarding-overlays
Feature/user onboarding overlays
2023-01-31 16:37:18 +00:00
adrinr b2813db5db Handle db creation race conditions 2023-01-31 16:15:11 +00:00
Adria Navarro 16e53957bc Merge branch 'develop' into feature/dependencies-image 2023-01-30 18:54:05 +00:00
adrinr 1dabf71f68 Run conflicting tests in sequential mode 2023-01-30 13:35:09 +00:00
adrinr e4c898c327 Use test-containers for backend-core tests 2023-01-27 11:43:36 +00:00
adrinr 7027abeaa2 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
Adria Navarro Redo b94546b1a1 Fix user test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 9242470f6f Fix snapshots test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 8c68741f98 Fix application delete tests 2023-01-26 18:20:21 +00:00
Adria Navarro 26fa3bd484 tweak tests 2023-01-24 15:46:50 +00:00
Adria Navarro fc6c4d5290 Remove test logic from getAllDbs 2023-01-24 14:06:28 +00:00
mike12345567 5a2937c8d2 Adding events for environment variables (created, deleted, upgrade panel opened). 2023-01-23 18:18:06 +00:00
Adria Navarro 6806404465 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:08:19 +00:00
Adria Navarro 486bc6b18d Add jest-testcontainers-config 2023-01-23 15:52:23 +00:00
Dean a10bd138ff Merge remote-tracking branch 'origin/develop' into feature/user-onboarding-overlays 2023-01-23 09:34:20 +00:00
Dean 14da8c0c9e Added new onboarding tour flow for builder 2023-01-23 00:32:01 +00:00
mike12345567 0f33fd8d48 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-20 19:55:11 +00:00
mike12345567 3659768c42 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns 48e1695318 JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
mike12345567 c645a9bc21 Some type updates and an improvement to encryption to allow selecting the secret from an option list. 2023-01-16 18:15:43 +00:00
mike12345567 fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
Dean 4fd91ef617 Merge remote-tracking branch 'origin/cheeks-lab-day-portal-redesign' into feature/user-onboarding-overlays 2023-01-13 09:22:41 +00:00
Dean 7b3733d659 Merge commit 2023-01-13 09:20:55 +00:00
Peter Clement 117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Rory Powell f85ecd4810 Fix pino request id generation (#9324)
Remove the duplicated pino config in favour of the common config. Move request id generation into common configuration
2023-01-12 10:25:21 +00:00
Rory Powell 92ba282ee5 Logging type updates to fix account portal build (#9317) 2023-01-12 08:37:41 +00:00
Rory Powell e5e767f18d Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567 69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567 75df57c3d1 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-11 10:31:57 +00:00
Rory Powell e95222c0f4 Prefer app url resolution over referer (#9218)
* Prefer app url resolution over referer

* Update lockfiles
2023-01-11 10:24:57 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
mike12345567 d347b8015b Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-10 18:49:07 +00:00
mike12345567 c9d8668062 Licensing updates for environment variables. 2023-01-09 15:42:09 +00:00
Hong Phuc Nguyen 6825b2e3fc Doing sanitizeKey when doing deleteFile(s) (#9209)
* Doing sanitizeKey when doing deleteFile(s)

Doing sanitizeKey when doing deleteFile(s). 
In case of backup file name in backups bucket backup-2023-01-03T185512.686Z.tar.gz but in global-db store backup filename is backup-2023-01-03T18:55:12.686Z.tar.gz
sanitizeKey on deleteFile(s) method will prevent all other case related to this bug

* use .promise() instead callback for workaround aws-sdk bug
2023-01-05 08:54:10 +00:00
mike12345567 ea5b515783 Playing around with getting tests working. 2023-01-04 19:47:56 +00:00
Martin McKeaveney 84ab7862d1 fixes for google sheets, admin checklist, and deleting an app from API (#8846)
* fixes for google sheets, admin checklist, and deleting an app from API

* code review

* splitting unpublish endpoint, moving deploy endpoint to applications controller. Still to do public API work and move deployment controller into application controller

* updating REST method for unpublish in API test

* unpublish and publish endpoint on public API, delete endpoint unpublishes and deletes app

* removing skip_setup from prodAppDb call

* removing commented code

* unit tests and open API spec updates

* unpublish, publish unit tests - delete still in progress

* remove line updating app name in API test

* unit tests

* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

* v2.2.4

* Update pro version to 2.2.4

* lock changes (#9047)

* v2.2.5

* Update pro version to 2.2.5

* Make looping arrow point in right direction (#9053)

* v2.2.6

* Update pro version to 2.2.6

* Types/attaching license to account (#9065)

* adding license type to account

* removing planDuration

* v2.2.7

* Update pro version to 2.2.7

* Environment variable type coercion fix (#9074)

* Environment variable type coercion fix

* Update .gitignore

* v2.2.8

* Update pro version to 2.2.8

* tests passing

* all tests passing, updates to public API response

* update unpublish call to return 204, openAPI spec and unit

* fixing API tests

Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-19 13:18:00 +00:00
Rory Powell f4a39080de Minio and local licensing fixes (#9071) 2022-12-16 11:14:31 +00:00
Andrew Kingston 090ae5df49 Master => Develop (#9049)
* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2022-12-15 12:13:42 +00:00
Rory Powell 786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Rory Powell f935f05509 Offline license POC (#9046) 2022-12-14 21:48:48 +00:00
Peter Clement 9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
mike12345567 20984e8072 Some fixes based on test failure. 2022-12-07 17:33:26 +00:00
Andrew Kingston 8567ae70af Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-29 12:22:56 +00:00
mike12345567 a02e9017ec Final fixes after re-running all test suites. 2022-11-28 19:12:23 +00:00
mike12345567 d6e9380c06 General work after running some tests in CI - general refactoring as well. 2022-11-28 17:54:04 +00:00
mike12345567 3a6200144a Fix for account portal. 2022-11-28 14:09:18 +00:00
mike12345567 70242f3be7 Fixing some issues detected by testing. 2022-11-26 21:26:19 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567 90362b65c1 Disabling js interop in Typescript build of backend-core and worker, fixing build issues. 2022-11-26 14:46:01 +00:00
mike12345567 a3bb2e0d77 Automation overhaul to Typescript, plus type updates. 2022-11-25 19:57:07 +00:00
Andrew Kingston abedb5d9eb Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-25 11:24:57 +00:00
mike12345567 d3c4c99e16 Complete conversion of backend-core to Typescript. 2022-11-24 18:48:51 +00:00
Andrew Kingston cd24c408fe Rename migration 2022-11-24 14:27:49 +00:00
mike12345567 bfaef13768 Refactoring worker, converting all controllers/routes to Typescript and all imports of backend-core to new style. 2022-11-23 18:25:20 +00:00
mike12345567 4959a491d7 Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-23 10:30:57 +00:00
Rory Powell 6f3f858d81 Account portal <-> backend-core fixes 2022-11-22 22:24:45 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 92210144ff More controller typescript conversions. 2022-11-22 16:52:25 +00:00
Andrew Kingston c01b9af1f0 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-22 16:52:09 +00:00
Rory Powell 7610065db1 Fix view creation 2022-11-22 16:28:51 +00:00
mike12345567 8a4da7d4ce Typescript conversion of the table controllers. 2022-11-22 13:56:01 +00:00
mike12345567 8f94664ddd Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-22 12:03:31 +00:00
mike12345567 de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
Dean 192c9b56e2 Import refactoring and some review updates. 2022-11-21 15:53:47 +00:00
Dean 64e7239d42 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 15:40:11 +00:00
mike12345567 3e7bed067b Merge branch 'develop' of github.com:Budibase/budibase into develop 2022-11-21 15:06:44 +00:00
mike12345567 cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
mike12345567 f49233d883 Fix for table deletion, updating DatabaseImpl to define pouch functions directly. 2022-11-21 14:41:19 +00:00
Dean 0441704c57 Import fixes for backend core constants. Minor name change for default data source from Test DB to Sample Data 2022-11-21 12:47:36 +00:00
mike12345567 3c93101fdb Adding IDs to backup events. 2022-11-21 12:12:57 +00:00
Rory Powell 6cb71b5272 Add remove overload to allow for doc removal 2022-11-21 11:38:37 +00:00
Dean 02a902ebd3 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 11:10:29 +00:00
Andrew Kingston c58067a589 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-21 10:30:25 +00:00
mike12345567 12a9ed6dcb Adding type to triggered. 2022-11-17 23:09:49 +00:00
Michael Drury 3aa5c25da9 PR comments. 2022-11-17 19:38:47 +00:00
mike12345567 24d5d2a22c Adding an event for when a backup is triggered. 2022-11-17 17:15:35 +00:00
mike12345567 0d13a77409 Some minor updates after running qa-core tests, found some issues that likely exists before context update. 2022-11-17 16:30:38 +00:00
Dean e932aa105b Shifted the budibase datasource constant to backend-core 2022-11-17 16:28:48 +00:00
mike12345567 31c198888a Updating some enums, plural to single. 2022-11-17 14:59:18 +00:00
mike12345567 0557219140 Fixing permission types. 2022-11-17 14:47:52 +00:00
mike12345567 58e59bfacc Updating PouchLike to be an interface in types, with its impl stored in backend-core, now called Database. 2022-11-17 14:35:03 +00:00
mike12345567 bc857d7bb8 PR comments - still experiencing build issues. 2022-11-17 13:31:54 +00:00
mike12345567 f5760b6601 Fixes post merge. 2022-11-16 18:28:45 +00:00
mike12345567 29dd98a7fc Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-16 18:12:31 +00:00
mike12345567 4328ed1b67 Updating middlewares to Typescript, as well as some fixes based on running tests. 2022-11-16 17:24:13 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
Rory Powell 9c169087e6 Add copy button to sso callback urls, e2e unit testing for OIDC, stub out other auth tests 2022-11-16 11:34:16 +00:00
mike12345567 e7e2d91fef Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-15 16:45:25 +00:00
Rory Powell 1612044dc1 Merge branch 'develop' into subdomain-tenancy 2022-11-15 16:18:59 +00:00
Rory Powell f48ff01045 ensure fetch and aws are always mocked 2022-11-15 15:50:15 +00:00
Rory Powell f7af8621d5 Update waitForCompletion and pouch / backup type 2022-11-15 14:28:02 +00:00
Andrew Kingston 2b42b21b3a Add migration to automatically convert legacy table settings into new action setting 2022-11-15 11:54:45 +00:00
Rory Powell 9973f2e161 Bump jest and ts-jest to be consistent across backend packages to fix CI issue, test config updates 2022-11-14 22:55:47 +00:00
mike12345567 72c9aadae0 Updating test cases - trying to get everything in order for merge. 2022-11-14 20:25:05 +00:00
mike12345567 3f0e53f90c Updating context test, some minor adjustments based on getting the test working again. 2022-11-14 18:29:15 +00:00
mike12345567 3f6cdd787c Replacing CLS with local-storage, simplified usage which should remove the memory leak permenantly. 2022-11-14 18:00:20 +00:00
Rory Powell c6fba4de3d Test fixes 2022-11-11 15:43:41 +00:00
mike12345567 b4b471e054 Re-jigging things a bit, hiding as much of the couch/pouch stuff away. 2022-11-11 12:46:32 +00:00
mike12345567 bc94f20794 Typescript conversions - trying to get all of context/db layer into TS. 2022-11-11 11:57:50 +00:00
Rory Powell 72562278c0 Support path variable tenancy detection, add /api/system/* tests, update no tenancy matchers to be more accurate 2022-11-11 11:10:07 +00:00
mike12345567 c63c3b48c5 Typescript conversions, as well as updating context to just use an object map. 2022-11-10 17:38:26 +00:00
mike12345567 45e7ef61ef Re-building the context module to use a single object, meaning we can create new context frames and copy over whatever exists, then update. 2022-11-10 16:38:32 +00:00
melohagan b6ff581d5e Merge pull request #8593 from Budibase/bug/sev2/mongodb-aggregate-readable
MongoDB aggregate readable
2022-11-10 15:27:08 +00:00
Mel O'Hagan be32ef1cb6 Add readable flag to datasource validation 2022-11-10 14:23:22 +00:00
mike12345567 9e01a9d1be Some minor updates based on getting the worker using the new pouchlike impl. 2022-11-09 17:53:35 +00:00
mike12345567 c744d23832 Major update - removing the use of context for PouchDB instances, swapping knowledge of PouchDB to the PouchLike structure that replaces it. 2022-11-09 16:53:42 +00:00
Rory Powell 6783fd713e Update tenancy detection to honour any subdomain pattern according to platform url 2022-11-09 16:35:16 +00:00
mike12345567 a5624142a8 Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-09 14:44:01 +00:00
mike12345567 ecb398bf98 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-09 13:41:51 +00:00
Michael Drury 41a65bbe47 Exporting roles differently to fix issue raised by test. 2022-11-08 20:01:01 +00:00
Michael Drury 2240b060d4 Quick fix to not expose the builder ID outside of the role impl. 2022-11-08 19:48:16 +00:00
mike12345567 eb251fb48e Exporting some functions that were previously exported. 2022-11-08 18:35:21 +00:00
mike12345567 693d6b6242 Typescript re-write of the roles layer, this is the backbone of a lot of our security features, and I believe the issue was generally to do with a lack of handling of null-ish inputs. 2022-11-08 18:25:37 +00:00
mike12345567 9e7ac26aa0 Getting basic pouch replacement working. 2022-11-08 16:32:13 +00:00
mike12345567 2f01caa88d Adding more type handling around the upload object store function. 2022-11-08 11:49:07 +00:00
mike12345567 913eb96ab0 Fixing an issue which was alerting, x-amz-meta-fieldname contains an invalid value, this error isn't really documented, but comes from if a metadata tag is sent up with nullish, or a non-string type. Fixing this in the core library, removing an invalid inputs. 2022-11-08 11:34:16 +00:00
mike12345567 2426123686 First version of pouch-like system, a wrapper for Couch nano. 2022-11-07 18:27:39 +00:00
Rory Powell b36634f510 Add extra auth logging to authenticated.ts 2022-11-04 08:30:44 +00:00
mike12345567 b9caf0aef5 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-02 20:12:01 +00:00
mike12345567 19669575e4 Fixing issue with self host build - import of backend-core changes mean that loading the public API files can require setup of backend-core, making it so that the JWT Strategy doesn't need to be setup to load backend-core. 2022-11-01 12:59:10 +00:00
mike12345567 6228d3346e Merge branch 'develop' of github.com:Budibase/budibase into fix/mike-oct-fixes 2022-10-26 10:37:01 +01:00
Rory Powell 887470d4b5 Ensure tmpDir/.budibase always exists 2022-10-26 09:24:28 +01:00
mike12345567 a24694a4ea Refactoring a lot of content around webhooks to Typescript, as well as fixing webhooks and automation app IDs on import of new app. 2022-10-25 18:19:18 +01:00
Rory Powell 56456f3f6d Startup fixes 2022-10-25 13:37:26 +01:00
Rory Powell 9face50a07 Fix build failure around PouchDB type 2022-10-25 09:02:55 +01:00
mike12345567 5340b49d6b Some fixes based on PR comments. 2022-10-24 12:06:50 +01:00
mike12345567 4daf9c2615 Addressing majority of PR comments. 2022-10-24 10:04:14 +01:00
mike12345567 2a2f41a861 Fixing issue discovered by tests. 2022-10-21 16:02:13 +01:00
mike12345567 f5557fd805 Fetching a list of backup/restore events includes the full user object. 2022-10-20 15:05:50 +01:00
mike12345567 113a23ba3d Adding statistics output for backups. 2022-10-19 16:48:32 +01:00
mike12345567 bb4e3ba8cf Adding in required events for app backup system. 2022-10-17 15:26:09 +01:00
mike12345567 1373630b33 Minor fixes after testing manual backup system. 2022-10-14 20:10:44 +01:00
mike12345567 0bd2a18e46 Main types and work for the CRUD operations of app backup backend in pro + the listeners to handle exporting apps from the server. 2022-10-14 19:24:03 +01:00
mike12345567 b702c7482a Fixes for cronjob stop - correctly handle this without stalled job handle. 2022-10-14 13:26:42 +01:00
mike12345567 d620e54fdb Handling listeners as part of queue creation, rather than external part. 2022-10-13 17:55:05 +01:00
mike12345567 35525bfedd Moving queue implementation into backend-core - so that pro can access. 2022-10-13 17:27:04 +01:00
mike12345567 8fdba78bde Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-13 15:59:31 +01:00
mike12345567 2eae3f2a6c Fixes for find functionality after testing. 2022-10-12 17:57:31 +01:00
mike12345567 4da3705851 Quick fixes to DB TS conversion. 2022-10-12 17:37:52 +01:00
mike12345567 f5dd87f8f9 Adding first pass of attachments updating. 2022-10-12 17:34:17 +01:00
mike12345567 8d7f40e443 Refactoring more to Typescript, adding the ability to use the _find API of CouchDB. 2022-10-12 17:02:23 +01:00
Rory Powell 281eb151e2 Merge pull request #8164 from Budibase/feature/quota-emails
Approaching and Exceeded Usage Limit Notifications
2022-10-12 12:31:17 +01:00
mike12345567 9d34ccfaca Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-12 11:59:00 +01:00
Rory Powell 2f0f36e635 Merge branch 'master' into merge-master 2022-10-12 10:19:46 +01:00
mike12345567 19133f08e6 Adding import functionality - still need to update the attachments URL. 2022-10-11 20:25:22 +01:00
mike12345567 f237befbce Some fixes + cleanup of tmp directory. 2022-10-11 19:28:13 +01:00
mike12345567 1f36eec89a Some updates towards supporting attachments in app exports. 2022-10-10 20:08:59 +01:00
Martin McKeaveney 536b7238e9 redis fix for new instances, removing relationship options from google sheets integration 2022-10-10 11:00:45 +01:00
Rory Powell 84685d3340 Add locking framework 2022-10-10 08:21:17 +01:00
mike12345567 197d195cb4 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 18:05:18 +01:00
Michael Drury 060b2aba3c Merge pull request #8175 from Budibase/fix/remove-app-scans
Removing Redis SCAN operation from app services
2022-10-07 17:35:05 +01:00
mike12345567 0c4a40c795 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 16:05:01 +01:00
Michael Drury af603afbc3 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-10-01 15:44:11 +01:00
mike12345567 f9269faf08 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-09-30 14:55:00 +01:00
Rory Powell 3fba690240 Merge pull request #6074 from Budibase/feature/app-quotas
App/resource ID breakdown of quotas
2022-09-30 13:28:07 +01:00
mike12345567 22d501edee Merge branch 'fix/allow-removing-crud-plugins' of github.com:Budibase/budibase into feature/plugin-icons 2022-09-30 08:58:26 +01:00
mike12345567 95136a54f2 Adding ability for datasource plugins to have a custom icon svg. 2022-09-29 19:30:53 +01:00
mike12345567 504412112f Allow removing CRUD operations from custom datasource plugins. 2022-09-29 16:56:46 +01:00
Rory Powell d87e3904ae Create generic quota sync migration 2022-09-28 13:13:37 +01:00
Rory Powell 98168aee29 Merge branch 'develop' into feature/app-quotas 2022-09-28 12:33:39 +01:00
Rory Powell 79226777b1 Merge develop 2022-09-28 08:56:45 +01:00
Michael Drury 6adb30fc1c Merge pull request #7981 from Budibase/feature/group-app-add
Add apps to a group from within groups interface
2022-09-26 19:18:44 +01:00
Martin McKeaveney 57bbf28119 merge with master 2022-09-26 17:57:23 +01:00
mike12345567 2acdf6b7eb Feature to allow adding apps from within the groups interface, rather than having to go to apps individually to do this. 2022-09-26 17:54:00 +01:00
mike12345567 e460864091 Adding a migration for the plugin quotas to make sure they are always accurate in self host at startup. 2022-09-24 12:10:09 +01:00
mike12345567 e235073cc5 Adding tenancy awareness for plugin bucket. 2022-09-23 16:30:45 +01:00
mike12345567 a1b1798e13 Minor update to feature flag name. 2022-09-23 13:08:18 +01:00
mike12345567 9b29bd6709 Merge branch 'develop' of github.com:Budibase/budibase into group-fixes 2022-09-22 18:44:16 +01:00
mike12345567 e3f054470a Updating a few core endpoints to better integrate the groups system and make sure users always have the correct role ID updated onto them. 2022-09-22 18:27:43 +01:00
mike12345567 c382b86fb2 Self API in worker conversion to typescript. 2022-09-22 14:09:20 +01:00
Rory Powell c3ee8b0e56 Merge pull request #7859 from Budibase/feature/enterprise
Enterprise / license override support
2022-09-21 20:18:54 +01:00
Rory Powell a8782c4629 License analytics 2022-09-21 15:45:29 +01:00
mike12345567 115a0c146b Adding a user core bulk update function. 2022-09-21 13:55:10 +01:00
mike12345567 e6c91b6f8e Adding group cleanup, removing group IDs from users when group is deleted. 2022-09-21 12:43:09 +01:00
mike12345567 34771e1ef7 Updates to improve the view development experience. 2022-09-20 19:12:48 +01:00
Mel O'Hagan c72cd71467 Add 'extra' validation for plugin datasource 2022-09-20 15:47:17 +01:00
Rory Powell f7ec431a45 Move tenancy/utils to db/tenancy to resolve circular imports between tenancy and db package. This should remove all reliance on the tenancy package from the db package 2022-09-20 10:20:36 +01:00
mike12345567 40688f6783 Adding budibase/pro integration for plugins, controlling quota limits. 2022-09-15 14:57:27 +01:00
Rory Powell 060251ab03 Merge pull request #7782 from Budibase/feature/day-pass-pricing
Day pass pricing
2022-09-15 13:36:10 +01:00
Rory Powell f7fa9969f4 Fixes 2022-09-15 11:59:46 +01:00
Michael Drury b8462eea0c Merge pull request #7774 from Budibase/events/plugins
Plugin init, imported and deleted events
2022-09-15 12:55:40 +02:00
Rory Powell 4787f9ccab Pre-review tidy, add new badge to plugins 2022-09-15 11:23:51 +01:00
Rory Powell 086d9ebdf9 Merge branch 'develop' into feature/day-pass-pricing 2022-09-15 10:56:50 +01:00
Rory Powell 0f98f2fcaa Merge branch 'master' into develop 2022-09-15 10:19:56 +01:00
Rory Powell 8cfd6a9faa Merge branch 'develop' into feature/day-pass-pricing 2022-09-15 08:55:33 +01:00
mike12345567 46c1590c83 Adding types for plugin events, specifically for plugin init, import and deletion, this is across the CLI and the server. 2022-09-14 17:35:46 +01:00
Martin McKeaveney 41a300c2f9 Merge pull request #7591 from Budibase/fix/platform-email-casing
Fix/platform email casing
2022-09-14 16:09:52 +01:00
Martin McKeaveney 110211c53a fixing tests 2022-09-14 14:22:53 +01:00
Rory Powell a551532e73 Navigation updates, cookie constant, update link-dependencies and localdomain scripts 2022-09-14 10:53:14 +01:00
mike12345567 5c5e1b10b4 Fixing CLI build - prebuilds required for hashing can be disabled via environment variable. 2022-09-13 18:00:10 +01:00
Martin McKeaveney 7d9253b8d4 fix circular dependency issues 2022-09-13 17:29:31 +01:00
Martin McKeaveney 19a2049475 remove references to module exports 2022-09-13 12:35:17 +01:00
Martin McKeaveney 07f2f66b04 convert views to typescript 2022-09-13 12:22:03 +01:00
mike12345567 828066de46 Merge branch 'develop' of github.com:Budibase/budibase into feature/plugin-management-ui 2022-09-12 15:34:34 +01:00
Rory Powell 45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
Rory Powell 884f446671 Merge branch 'develop' into feature/day-pass-pricing-temp 2022-09-12 11:33:02 +01:00
Rory Powell f4963db294 Add buttonText to InlineAlert, export TooltipWrapper, update Account type with license key activate time, convert error package to TS 2022-09-12 10:43:26 +01:00
NEOLPAR 171970108e fix build error exporting and declaring plugins 2022-09-09 12:01:04 +01:00
NEOLPAR e5806b832f moved validate to backend-core to be used in server and cli 2022-09-09 11:12:14 +01:00
Martin McKeaveney 2991d05d5b PR comments 2022-09-07 23:21:14 +01:00
mike12345567 86c8618e8f Fix for #7431 - reboot didn't work at all previously which is why apps couldn't be published with it enabled, this is now a self host only feature, I've removed the ability to enable a reboot cron in the Cloud and it will not run the lookup/execution. 2022-09-07 17:05:17 +01:00
Rory Powell 5abdd102a9 Error handling, wildcard feature flags 2022-09-07 12:08:10 +01:00
mike12345567 2d183e0c6c Adding compaction before each replication to try to reduce size of database, as well as removing the possibility of app metadata being in conflict as per issue #7494. 2022-09-06 18:07:18 +01:00
Rory Powell 165194658b Move day pass middleware from authenticated to licensing, sent activity to account portal 2022-09-06 16:24:36 +01:00
NEOLPAR 06b36315b6 adding headers param in case it is needed for auth or similar 2022-09-06 15:46:11 +01:00
Rory Powell 818e7fd5f4 Day pass middleware 2022-09-06 12:25:57 +01:00
Martin McKeaveney 381622aa7a revert back to circular dep 2022-09-02 18:44:03 +01:00
Martin McKeaveney e02b7c1c68 fixing circular dep issue 2022-09-02 16:55:55 +01:00
Martin McKeaveney 7e5252e2e2 remove unnecessary files 2022-09-02 16:07:30 +01:00
Martin McKeaveney 0db194b412 platform view casing 2022-09-02 15:42:20 +01:00
Martin McKeaveney 9e2fd5222b platform user casing view 2022-09-02 09:12:03 +01:00
Rory Powell 276c455a11 Merge branch 'develop' into feature/day-pass-pricing 2022-09-01 15:26:16 +01:00
mike12345567 320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Rory Powell 7c2c4a0f94 Add conditional around joiValidator schema.append 2022-08-31 12:24:12 +01:00
Rory Powell 5f022e04a3 Merge branch 'develop' into user-fixes 2022-08-31 11:39:41 +01:00
Martin McKeaveney 02c93071ee merge 2022-08-30 10:33:37 +01:00
Rory Powell 59a53736ac update bulk create and bulk delete backend 2022-08-25 19:41:47 +01:00
Martin McKeaveney 2470d711b0 fixing s3 outage errors and scoping AWS configuration to service level 2022-08-25 17:01:12 +01:00
Rory Powell d591acf2d3 User fixes wip 2022-08-23 09:37:13 +01:00
Rory Powell 8fc8308530 Merge branch 'develop' into feature/day-pass-pricing 2022-08-19 14:08:03 +01:00
Rory Powell af7c64255b usage page updates 2022-08-19 09:28:26 +01:00
Rory Powell 76e18fb6de Support tiered pricing for day passes and update upgrade UI 2022-08-16 12:13:47 +01:00
mike12345567 c9c468a424 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:36:07 +01:00
mike12345567 76d427001a Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:34:01 +01:00
mike12345567 1c7f860184 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-11 16:28:46 +01:00
Andrew Kingston e8b9a49074 Attach correct content type to JS files when uploading to object store 2022-08-11 15:25:04 +01:00
mike12345567 b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
Martin McKeaveney b89c429f40 simplify if 2022-08-11 11:31:16 +01:00
Martin McKeaveney 68df1b14e6 skip empty dbs in test 2022-08-11 09:30:29 +01:00
mike12345567 a683665a99 Adding plugin upload API - takes a file form-data and then extracts, uploads to minio and stores data about the plugin to CouchDB. 2022-08-10 20:01:48 +01:00
Martin McKeaveney a60398b3b3 dont get app db name if undefined 2022-08-10 18:39:41 +01:00
Rory Powell 664cb2b0b0 Merge branch 'master' into develop 2022-08-10 14:36:49 +01:00
mike12345567 1ba804f507 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-10 11:55:53 +01:00
Rory Powell 54df92a8c3 Add timezone to served events 2022-08-10 11:29:11 +01:00
Rory Powell 500e697974 Trigger served events on ping endpoint 2022-08-10 11:01:54 +01:00
Rory Powell dd0395995f Rename async to emit 2022-08-09 14:01:55 +01:00
Rory Powell f7210e96e4 Fix served events 2022-08-09 13:31:12 +01:00
Martin McKeaveney c44ae30721 merge from master 2022-08-09 11:52:48 +01:00
Rory Powell 57ca5261bf Support per app events 2022-08-08 16:22:26 +01:00
Rory Powell 3b5abda2cf Rate limit served:X events 2022-08-08 15:44:29 +01:00
Rory Powell 3b9343b3e6 Merge branch 'master' into develop 2022-08-08 11:50:22 +01:00
Rory Powell cc9bc937b6 Reduce event frequency 2022-08-08 10:47:39 +01:00
Rory Powell fe17ffffb6 Bulk session wipe fix + logging 2022-08-08 09:34:45 +01:00
mike12345567 2dea5c5614 Some various session fixes based on current data. 2022-08-05 21:35:26 +01:00
mike12345567 52d16d1099 Updating sessions to TS, adding env var to set the session update length, adding reasons for invalidation, making sure errors are never considered authenticated. 2022-08-05 17:13:03 +01:00
mike12345567 b3a6efa2f9 Updating authenticated middleware to typescript and updating the TTL once per minute rather than every API request. 2022-08-05 15:21:12 +01:00
mike12345567 44a6aa85a9 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-04 21:35:55 +01:00
mike12345567 cfe3db835b Updating pino logging to remove health check spam. 2022-08-04 20:23:45 +01:00
mike12345567 f3418c4107 Some more logging, moving middlewares to backend-core. 2022-08-04 19:03:50 +01:00
mike12345567 382a2a3050 Adding logging for session invalidation. 2022-08-04 16:06:59 +01:00
Rory Powell 1b6b877546 Sync global-info users to fix login + prevent double password hashing 2022-08-04 14:49:56 +01:00
Andrew Kingston 7c4bf7aedd Fix crashing when determining roles when no apps exist 2022-08-02 16:01:38 +01:00
Rory Powell 466e41302b Merge pull request #7037 from Budibase/fix/joi-createdAt-updatedAt
Add updatedAt and createdAt as optional to all joi middleware
2022-08-02 14:35:58 +01:00
Rory Powell 6102ace3a9 Reduce event frequency 2022-08-02 10:52:09 +01:00
Rory Powell 09127df617 Add updatedAt and createdAt as optional to all joi middleware 2022-08-02 09:39:30 +01:00
Peter Clement c3a4941119 Merge pull request #6989 from Budibase/pc/fixes
User Management UI fixes
2022-08-01 09:39:55 +01:00
mike12345567 07f3897b55 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-29 14:31:18 +01:00
Peter Clement 2689c48fa1 flag user groups untill licensing ready 2022-07-29 13:22:59 +01:00
Rory Powell 1dc062a3fb Merge branch 'master' into develop 2022-07-27 16:32:36 -04:00
mike12345567 d42f3c3385 Adding fix for issue in cloud with user password deletion causing undefined errors. 2022-07-27 17:15:01 +01:00
Peter Clement dca37a61da adding tests and pr comments 2022-07-27 10:20:39 +01:00
Peter Clement fda6ed6e62 update feature error 2022-07-26 20:25:59 +01:00
Peter Clement 548e8d518c Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-26 20:19:33 +01:00
Peter Clement 46a6fc5048 refactor groups into pro and some other pr comments 2022-07-26 20:04:29 +01:00
mike12345567 f4db17502a Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-26 17:28:57 +01:00
mike12345567 d30e27d27d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-07-26 17:25:55 +01:00
Peter Clement cd426a5ca7 adding limits for uploading users 2022-07-26 12:17:01 +01:00
Peter Clement 9e75b18784 adding new custom feature disabled error 2022-07-25 19:45:50 +01:00
Peter Clement 3f8a006626 some more pr comments 2022-07-25 18:57:10 +01:00
Peter Clement 25d13d4a72 move bulk update / delete functionality out of controller 2022-07-25 16:58:30 +01:00
Andrew Kingston d9dacbc901 Use warn rather than info when notifying about ignored conflicts 2022-07-25 12:23:30 +01:00
Andrew Kingston 8bd254f313 Use log rather than warn for logInfo 2022-07-25 12:22:27 +01:00
Andrew Kingston f82b407f30 Ignore 409s in write-through cache 2022-07-25 12:17:40 +01:00
Peter Clement af451840ac move worker middleware to backend-core 2022-07-22 11:50:51 +01:00
Michael Drury 07de5faa2d Main bulk of logic around detecting cron recurring failure, still need to disable. 2022-07-20 22:38:06 +01:00
Peter Clement 94d999faf9 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 14:54:29 +01:00
mike12345567 1c02c3d3c3 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-07-19 14:12:48 +01:00
Peter Clement ca41e88045 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 11:23:31 +01:00
Rory Powell 3820182359 Write users and activity to dynamo 2022-07-18 16:11:52 -04:00
mike12345567 2f27e750f5 PR comments. 2022-07-18 18:18:01 +01:00
mike12345567 078cf9e95f Fixing an issue with automations being unable to access app databases due to new context stack up. 2022-07-18 17:38:58 +01:00
mike12345567 d4b1ed58b8 Removing console log. 2022-07-18 14:18:15 +01:00
mike12345567 a8a7bea658 Merge branch 'develop' of github.com:Budibase/budibase into labday/backups 2022-07-18 13:59:46 +01:00
Peter Clement fb7456fa33 lint 2022-07-18 12:33:56 +01:00
Peter Clement f3fa67e802 split out id parsing into pro repo 2022-07-15 11:29:20 +01:00
mike12345567 fcfe1341a1 PR comments. 2022-07-14 19:02:00 +01:00
mike12345567 5057994b45 Merge branch 'master' of github.com:Budibase/budibase into fix/memory-leak 2022-07-14 18:53:58 +01:00
mike12345567 3b4d7950d0 Merge branch 'master' of github.com:Budibase/budibase into fix/memory-leak 2022-07-14 16:40:23 +01:00
mike12345567 e2042ebefb Fixing some issues highlighted by test cases, as well as refactoring context a bit to make it easier to edit. 2022-07-14 16:02:05 +01:00
Peter Clement 819ce4e360 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-14 13:32:51 +01:00
Peter Clement 545f3d62b7 overview card updates 2022-07-14 08:39:39 +01:00
Michael Drury c604a076f4 Adding a mechanism to deprecate a view and replace it with a new one. 2022-07-13 21:50:19 +01:00
Rory Powell 1c4473ba30 WIP: Memory leak fix 2022-07-13 08:22:21 -04:00
Martin McKeaveney adb265564e merge 2022-07-11 10:19:07 +01:00
Rory Powell c40d80a3f3 Re-apply quota restrictions 2022-07-08 10:52:23 +01:00
mike12345567 d43de2b6c7 Merge branch 'develop' of github.com:Budibase/budibase into labday/backups 2022-07-07 13:40:52 +01:00
Peter Clement f2139df344 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-06 16:30:24 +01:00
mike12345567 53ead79de2 Updating user search endpoint to allow searching by app ID with a new view, as well as updating user page to have a search input again. 2022-07-06 16:09:05 +01:00
mike12345567 3cc8b7d4a9 Updating logging to typescript to fix build issue. 2022-07-06 14:04:04 +01:00
mike12345567 85cb766d14 Merge branch 'develop' of github.com:Budibase/budibase into develop 2022-07-06 13:38:20 +01:00
mike12345567 097e088a3d Adding null parameter so that TS doesn't build with strict requirement. 2022-07-06 13:36:29 +01:00
Dean 9fcedfa979 Properly invalidate the cached user ensuring up-to-date credentials are always used 2022-07-06 11:51:48 +01:00
Peter Clement 6df456411f fixing users api references 2022-07-06 08:45:22 +01:00
mike12345567 228b2506cc Merge branch 'develop' of github.com:Budibase/budibase into labday/backups 2022-07-05 17:47:22 +01:00
Peter Clement 00ef0e3ef9 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-05 16:04:01 +01:00
Dean b0daf30b4a Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-05 09:07:33 +01:00
mike12345567 0074b0cb1f Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-logs 2022-07-04 15:47:52 +01:00
mike12345567 d390bb9c20 Moving majority of automation logging functionality to pro. 2022-07-04 15:44:47 +01:00
Dean 5c1ea3cfe1 Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-04 13:16:39 +01:00
Dean 1ff9785498 Code review updates 2022-07-04 12:54:26 +01:00
mike12345567 11f1e95cc0 Main body of PR comments - still need to move a bit to pro. 2022-07-04 11:12:08 +01:00
Dean db016b319c Merge remote-tracking branch 'origin/develop' into fix/update-icon-context 2022-07-04 10:38:16 +01:00
Dean 129a5c2672 OIDC config test fix 2022-07-03 22:39:16 +01:00
Dean 86063063f3 Removed debugging line 2022-07-03 22:17:29 +01:00
Dean 3c193129f4 Fix for oauth user db update 2022-07-03 22:14:18 +01:00
Dean 1e6845d5cb Refresh the OAuth tokens automatically when making rest calls. Fix to remove the password from the api token authentication. 2022-07-03 21:13:15 +01:00
Dean 9972ec403d Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-03 09:55:05 +01:00
mike12345567 21a78d6fc8 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-logs 2022-07-01 15:14:12 +01:00
mike12345567 e5ddcd9f86 Adding MinIO handling, backing up to disk by bucket name. 2022-06-30 20:26:49 +01:00
mike12345567 11df05a7a0 Adding main functionality for exporting CouchDB to disk, just need to add MinIO export. 2022-06-30 19:20:50 +01:00
mike12345567 062d834950 Updating user page to search through the backend and building a basic pagination store that can be used for it. 2022-06-30 15:39:26 +01:00
Martin McKeaveney 385004ca1c cherry pick new ui from develop 2022-06-30 12:52:07 +01:00
mike12345567 98c486655b Adding user pagination, removing usages of the global user list from builder and replacing with direct user lookups where possible, still need to apply filtering to username/email serverside. 2022-06-29 19:11:00 +01:00
Dean 705af49e5a Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-06-29 09:17:18 +01:00
Martin McKeaveney 251520bcd1 adding types 2022-06-28 12:16:23 +01:00
mike12345567 5100d86752 Moving get of logs to pro. 2022-06-27 18:00:48 +01:00
Dean 9301f2ac5b Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-06-27 09:14:40 +01:00
mike12345567 a625fa573d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-24 17:50:55 +01:00
mike12345567 0bf9072cd1 Fixing an issue where periodically the cache state of the couch revision gets out of sync and need to update it for cache to be able to write again. 2022-06-24 17:41:17 +01:00
mike12345567 53e9f79c65 Adding explanation of the difference between Database and SelectableDatabase in Redis. 2022-06-24 14:42:15 +01:00
mike12345567 b5f0d7c4fd Adding case to handle multi-DB setups, to confirm store same doc ID to different databases and they run in different cache keys. 2022-06-24 14:28:45 +01:00
mike12345567 389856795d Updating writethrough cache a bit to make sure it implements the PouchDB API properly. 2022-06-24 13:34:00 +01:00
mike12345567 cd6a92994b Fixing test case and review comments. 2022-06-24 12:08:29 +01:00
Dean 8eabd7ff20 Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-06-24 09:21:07 +01:00
mike12345567 56956dba4f Adding a class wrapper incase using get/put functions multiple times, functions like the PouchDB constructor. 2022-06-23 20:27:20 +01:00
mike12345567 b4bed6c0ce Updating redis to use typescript and adding the option of a writethrough cache which can be used, by passing a DB and a value to be written + a delay for writes. 2022-06-23 20:22:51 +01:00
Dean 5fd385ab30 Merge commit 2022-06-23 14:29:19 +01:00
Andrew Kingston 686c38cf47 Improve Couch DB URL parsing to handle edge cases and special characters 2022-06-23 09:14:22 +01:00
Peter Clement d952b9a3bb updated store and finished groups tab 2022-06-22 13:55:31 +01:00
Peter Clement b7cc71a623 saving and fetching groups from couch 2022-06-15 16:51:30 +01:00
Rory Powell 0054c2a502 Ensure tests can't send events even when token is set 2022-06-15 14:09:02 +01:00
Rory Powell 6cc2bbadd7 Add deployment environment to identities 2022-06-15 11:46:03 +01:00
Rory Powell 3da4fb33cd Better handle first time startup + dedicated event 2022-06-15 11:20:13 +01:00
Rory Powell 97bd8e01f1 Add hosting to all identities and events, add installationId to tenant group 2022-06-14 17:34:32 +01:00
Rory Powell 46d7eab105 Fix user id generation 2022-06-13 22:26:15 +01:00
Rory Powell ee9a19a1d5 Back populate no-op migrations on new app and tenant create 2022-06-13 10:51:29 +01:00
Rory Powell 12aa9fa1ce Dev improvements - remove need to rebuilds of backend-core/dist and enable debugging when running tests and backend services, use source directly using typescript and jest path mappings 2022-06-10 22:57:12 +01:00
Rory Powell 0cf777a0cd Build fixes 2022-06-09 12:33:10 +01:00
Martin McKeaveney c470c2f676 merge with master 2022-06-08 13:26:14 +01:00
Martin McKeaveney d15dfb83fc new ui functionality working from S3 bucket 2022-06-06 23:30:36 +01:00
Rory Powell 361ffd224f Merge branch 'release' into feature/event-backfill 2022-06-06 09:50:06 +01:00
Martin McKeaveney d5540bbd57 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Rory Powell 86d094dda4 Migration locks and add optional preventRetry option 2022-06-01 17:52:41 +01:00
Rory Powell 081db8423e Fix key eviction 2022-06-01 15:31:27 +01:00
Rory Powell 4f34e1b2c7 app id fixes 2022-06-01 15:17:49 +01:00
Rory Powell 7f26a60cc9 Default to historical timestamp 2022-06-01 14:44:12 +01:00
Rory Powell a4eef3daab Add awareness of deployment environment 2022-06-01 14:10:00 +01:00
Martin McKeaveney d57c4987fe Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-01 09:47:13 +01:00
Rory Powell 7ebfaf8a31 Failover protection with event cache 2022-05-31 21:04:41 +01:00
mike12345567 f1c81436cc Review comments and test fix. 2022-05-31 10:16:22 +01:00
Rory Powell a9ab8b2629 Lots of failure handling and caching 2022-05-30 21:46:08 +01:00
mike12345567 fa30457f2b Fixing issue with server not shutting down correctly when an error occurs, making sure that everything clears up gracefully. 2022-05-30 21:22:06 +01:00
mike12345567 dae6a6b81c Fixing minor issue with automation quota updates. 2022-05-30 14:06:42 +01:00
Rory Powell 2a00f6498d Merge branch 'feature/posthog-v2' into feature/event-backfill 2022-05-29 00:25:40 +01:00
Rory Powell 857cd2d735 Merge branch 'develop' into feature/posthog-v2 2022-05-28 23:03:31 +01:00
Rory Powell c0d6fa34a4 Identity tenant and installation groups, property updates 2022-05-28 21:38:22 +01:00
Rory Powell 3c1b13083c Installation identities, upgrade / downgrade events, filling in more event properties 2022-05-26 23:57:14 +01:00
mike12345567 15526a4000 Merge branch 'develop' of github.com:Budibase/budibase into feature/app-quotas 2022-05-26 13:31:32 +01:00
Rory Powell ba1c4ead90 app and account properties, add account details to all user and tenant identities 2022-05-26 10:13:26 +01:00
Dean c17e625961 Refactored approach to ensure the request context is set appropriately 2022-05-26 10:03:29 +01:00
Dean 4bd315c1bd Merge remote-tracking branch 'origin/develop' into fix/update-icon-context 2022-05-26 09:02:13 +01:00
Rory Powell b986b689d6 Historical timestamps 2022-05-25 21:32:08 +01:00
mike12345567 8bc0142a37 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-25 18:12:27 +01:00
mike12345567 4eaf3f698c Merge branch 'master' of github.com:Budibase/budibase into feature/load-testing 2022-05-25 16:15:59 +01:00
mike12345567 84d0b61588 Swapping bcryptjs for bcrypt. 2022-05-25 16:14:45 +01:00
Dean 756f5b3aa6 Explicitly passing requested appId when calling updateAppPackage 2022-05-25 15:10:37 +01:00
Martin McKeaveney 4bbfae3880 add better logging on session invalidation 2022-05-25 13:02:15 +01:00
mike12345567 5ba7942282 Moving table, datasource and datasource plus document types into the backend core. 2022-05-25 10:52:19 +01:00
Rory Powell 6a4c601ae8 timestamp support, logging updates, migration progress indicators, identification updates 2022-05-25 00:15:52 +01:00
Martin McKeaveney 06fbcc4573 catch block in invalidate sessions 2022-05-24 22:57:32 +01:00
Rory Powell b3f04e7e8f Identity updates 2022-05-24 20:01:13 +01:00
Rory Powell 5d8bd9c2a3 Merge branch 'master' into develop 2022-05-24 10:20:08 +01:00
Rory Powell ff48aaec6e User context updates and misc fixes 2022-05-24 09:54:36 +01:00