Commit Graph

1661 Commits

Author SHA1 Message Date
mike12345567 c9c468a424 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:36:07 +01:00
mike12345567 76d427001a Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:34:01 +01:00
mike12345567 1c7f860184 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-11 16:28:46 +01:00
Andrew Kingston e8b9a49074 Attach correct content type to JS files when uploading to object store 2022-08-11 15:25:04 +01:00
mike12345567 b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
Martin McKeaveney b89c429f40 simplify if 2022-08-11 11:31:16 +01:00
Martin McKeaveney 68df1b14e6 skip empty dbs in test 2022-08-11 09:30:29 +01:00
mike12345567 a683665a99 Adding plugin upload API - takes a file form-data and then extracts, uploads to minio and stores data about the plugin to CouchDB. 2022-08-10 20:01:48 +01:00
Martin McKeaveney a60398b3b3 dont get app db name if undefined 2022-08-10 18:39:41 +01:00
Rory Powell 664cb2b0b0 Merge branch 'master' into develop 2022-08-10 14:36:49 +01:00
mike12345567 1ba804f507 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-10 11:55:53 +01:00
Rory Powell 54df92a8c3 Add timezone to served events 2022-08-10 11:29:11 +01:00
Rory Powell 500e697974 Trigger served events on ping endpoint 2022-08-10 11:01:54 +01:00
Rory Powell dd0395995f Rename async to emit 2022-08-09 14:01:55 +01:00
Rory Powell f7210e96e4 Fix served events 2022-08-09 13:31:12 +01:00
Martin McKeaveney c44ae30721 merge from master 2022-08-09 11:52:48 +01:00
Rory Powell 57ca5261bf Support per app events 2022-08-08 16:22:26 +01:00
Rory Powell 3b5abda2cf Rate limit served:X events 2022-08-08 15:44:29 +01:00
Rory Powell 3b9343b3e6 Merge branch 'master' into develop 2022-08-08 11:50:22 +01:00
Rory Powell cc9bc937b6 Reduce event frequency 2022-08-08 10:47:39 +01:00
Rory Powell fe17ffffb6 Bulk session wipe fix + logging 2022-08-08 09:34:45 +01:00
mike12345567 2dea5c5614 Some various session fixes based on current data. 2022-08-05 21:35:26 +01:00
mike12345567 52d16d1099 Updating sessions to TS, adding env var to set the session update length, adding reasons for invalidation, making sure errors are never considered authenticated. 2022-08-05 17:13:03 +01:00
mike12345567 b3a6efa2f9 Updating authenticated middleware to typescript and updating the TTL once per minute rather than every API request. 2022-08-05 15:21:12 +01:00
mike12345567 44a6aa85a9 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-04 21:35:55 +01:00
mike12345567 cfe3db835b Updating pino logging to remove health check spam. 2022-08-04 20:23:45 +01:00
mike12345567 f3418c4107 Some more logging, moving middlewares to backend-core. 2022-08-04 19:03:50 +01:00
mike12345567 382a2a3050 Adding logging for session invalidation. 2022-08-04 16:06:59 +01:00
Rory Powell 1b6b877546 Sync global-info users to fix login + prevent double password hashing 2022-08-04 14:49:56 +01:00
Andrew Kingston 7c4bf7aedd Fix crashing when determining roles when no apps exist 2022-08-02 16:01:38 +01:00
Rory Powell 466e41302b Merge pull request #7037 from Budibase/fix/joi-createdAt-updatedAt
Add updatedAt and createdAt as optional to all joi middleware
2022-08-02 14:35:58 +01:00
Rory Powell 6102ace3a9 Reduce event frequency 2022-08-02 10:52:09 +01:00
Rory Powell 09127df617 Add updatedAt and createdAt as optional to all joi middleware 2022-08-02 09:39:30 +01:00
Peter Clement c3a4941119 Merge pull request #6989 from Budibase/pc/fixes
User Management UI fixes
2022-08-01 09:39:55 +01:00
mike12345567 07f3897b55 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-29 14:31:18 +01:00
Peter Clement 2689c48fa1 flag user groups untill licensing ready 2022-07-29 13:22:59 +01:00
Rory Powell 1dc062a3fb Merge branch 'master' into develop 2022-07-27 16:32:36 -04:00
mike12345567 d42f3c3385 Adding fix for issue in cloud with user password deletion causing undefined errors. 2022-07-27 17:15:01 +01:00
Peter Clement dca37a61da adding tests and pr comments 2022-07-27 10:20:39 +01:00
Peter Clement fda6ed6e62 update feature error 2022-07-26 20:25:59 +01:00
Peter Clement 548e8d518c Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-26 20:19:33 +01:00
Peter Clement 46a6fc5048 refactor groups into pro and some other pr comments 2022-07-26 20:04:29 +01:00
mike12345567 f4db17502a Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-26 17:28:57 +01:00
mike12345567 d30e27d27d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-07-26 17:25:55 +01:00
Peter Clement cd426a5ca7 adding limits for uploading users 2022-07-26 12:17:01 +01:00
Peter Clement 9e75b18784 adding new custom feature disabled error 2022-07-25 19:45:50 +01:00
Peter Clement 3f8a006626 some more pr comments 2022-07-25 18:57:10 +01:00
Peter Clement 25d13d4a72 move bulk update / delete functionality out of controller 2022-07-25 16:58:30 +01:00
Andrew Kingston d9dacbc901 Use warn rather than info when notifying about ignored conflicts 2022-07-25 12:23:30 +01:00
Andrew Kingston 8bd254f313 Use log rather than warn for logInfo 2022-07-25 12:22:27 +01:00
Andrew Kingston f82b407f30 Ignore 409s in write-through cache 2022-07-25 12:17:40 +01:00
Peter Clement af451840ac move worker middleware to backend-core 2022-07-22 11:50:51 +01:00
Michael Drury 07de5faa2d Main bulk of logic around detecting cron recurring failure, still need to disable. 2022-07-20 22:38:06 +01:00
Peter Clement 94d999faf9 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 14:54:29 +01:00
mike12345567 1c02c3d3c3 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-07-19 14:12:48 +01:00
Peter Clement ca41e88045 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 11:23:31 +01:00
Rory Powell 3820182359 Write users and activity to dynamo 2022-07-18 16:11:52 -04:00
mike12345567 2f27e750f5 PR comments. 2022-07-18 18:18:01 +01:00
mike12345567 078cf9e95f Fixing an issue with automations being unable to access app databases due to new context stack up. 2022-07-18 17:38:58 +01:00
mike12345567 d4b1ed58b8 Removing console log. 2022-07-18 14:18:15 +01:00
mike12345567 a8a7bea658 Merge branch 'develop' of github.com:Budibase/budibase into labday/backups 2022-07-18 13:59:46 +01:00
Peter Clement fb7456fa33 lint 2022-07-18 12:33:56 +01:00
Peter Clement f3fa67e802 split out id parsing into pro repo 2022-07-15 11:29:20 +01:00
mike12345567 fcfe1341a1 PR comments. 2022-07-14 19:02:00 +01:00
mike12345567 5057994b45 Merge branch 'master' of github.com:Budibase/budibase into fix/memory-leak 2022-07-14 18:53:58 +01:00
mike12345567 3b4d7950d0 Merge branch 'master' of github.com:Budibase/budibase into fix/memory-leak 2022-07-14 16:40:23 +01:00
mike12345567 e2042ebefb Fixing some issues highlighted by test cases, as well as refactoring context a bit to make it easier to edit. 2022-07-14 16:02:05 +01:00
Peter Clement 819ce4e360 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-14 13:32:51 +01:00
Peter Clement 545f3d62b7 overview card updates 2022-07-14 08:39:39 +01:00
Michael Drury c604a076f4 Adding a mechanism to deprecate a view and replace it with a new one. 2022-07-13 21:50:19 +01:00
Rory Powell 1c4473ba30 WIP: Memory leak fix 2022-07-13 08:22:21 -04:00
Martin McKeaveney adb265564e merge 2022-07-11 10:19:07 +01:00
Rory Powell c40d80a3f3 Re-apply quota restrictions 2022-07-08 10:52:23 +01:00
mike12345567 d43de2b6c7 Merge branch 'develop' of github.com:Budibase/budibase into labday/backups 2022-07-07 13:40:52 +01:00
Peter Clement f2139df344 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-06 16:30:24 +01:00
mike12345567 53ead79de2 Updating user search endpoint to allow searching by app ID with a new view, as well as updating user page to have a search input again. 2022-07-06 16:09:05 +01:00
mike12345567 3cc8b7d4a9 Updating logging to typescript to fix build issue. 2022-07-06 14:04:04 +01:00
mike12345567 85cb766d14 Merge branch 'develop' of github.com:Budibase/budibase into develop 2022-07-06 13:38:20 +01:00
mike12345567 097e088a3d Adding null parameter so that TS doesn't build with strict requirement. 2022-07-06 13:36:29 +01:00
Dean 9fcedfa979 Properly invalidate the cached user ensuring up-to-date credentials are always used 2022-07-06 11:51:48 +01:00
Peter Clement 6df456411f fixing users api references 2022-07-06 08:45:22 +01:00
mike12345567 228b2506cc Merge branch 'develop' of github.com:Budibase/budibase into labday/backups 2022-07-05 17:47:22 +01:00
Peter Clement 00ef0e3ef9 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-05 16:04:01 +01:00
Dean b0daf30b4a Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-05 09:07:33 +01:00
mike12345567 0074b0cb1f Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-logs 2022-07-04 15:47:52 +01:00
mike12345567 d390bb9c20 Moving majority of automation logging functionality to pro. 2022-07-04 15:44:47 +01:00
Dean 5c1ea3cfe1 Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-04 13:16:39 +01:00
Dean 1ff9785498 Code review updates 2022-07-04 12:54:26 +01:00
mike12345567 11f1e95cc0 Main body of PR comments - still need to move a bit to pro. 2022-07-04 11:12:08 +01:00
Dean db016b319c Merge remote-tracking branch 'origin/develop' into fix/update-icon-context 2022-07-04 10:38:16 +01:00
Dean 129a5c2672 OIDC config test fix 2022-07-03 22:39:16 +01:00
Dean 86063063f3 Removed debugging line 2022-07-03 22:17:29 +01:00
Dean 3c193129f4 Fix for oauth user db update 2022-07-03 22:14:18 +01:00
Dean 1e6845d5cb Refresh the OAuth tokens automatically when making rest calls. Fix to remove the password from the api token authentication. 2022-07-03 21:13:15 +01:00
Dean 9972ec403d Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-03 09:55:05 +01:00
mike12345567 21a78d6fc8 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-logs 2022-07-01 15:14:12 +01:00
mike12345567 e5ddcd9f86 Adding MinIO handling, backing up to disk by bucket name. 2022-06-30 20:26:49 +01:00
mike12345567 11df05a7a0 Adding main functionality for exporting CouchDB to disk, just need to add MinIO export. 2022-06-30 19:20:50 +01:00
mike12345567 062d834950 Updating user page to search through the backend and building a basic pagination store that can be used for it. 2022-06-30 15:39:26 +01:00
Martin McKeaveney 385004ca1c cherry pick new ui from develop 2022-06-30 12:52:07 +01:00
mike12345567 98c486655b Adding user pagination, removing usages of the global user list from builder and replacing with direct user lookups where possible, still need to apply filtering to username/email serverside. 2022-06-29 19:11:00 +01:00
Dean 705af49e5a Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-06-29 09:17:18 +01:00
Martin McKeaveney 251520bcd1 adding types 2022-06-28 12:16:23 +01:00
mike12345567 5100d86752 Moving get of logs to pro. 2022-06-27 18:00:48 +01:00
Dean 9301f2ac5b Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-06-27 09:14:40 +01:00
mike12345567 a625fa573d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-24 17:50:55 +01:00
mike12345567 0bf9072cd1 Fixing an issue where periodically the cache state of the couch revision gets out of sync and need to update it for cache to be able to write again. 2022-06-24 17:41:17 +01:00
mike12345567 53e9f79c65 Adding explanation of the difference between Database and SelectableDatabase in Redis. 2022-06-24 14:42:15 +01:00
mike12345567 b5f0d7c4fd Adding case to handle multi-DB setups, to confirm store same doc ID to different databases and they run in different cache keys. 2022-06-24 14:28:45 +01:00
mike12345567 389856795d Updating writethrough cache a bit to make sure it implements the PouchDB API properly. 2022-06-24 13:34:00 +01:00
mike12345567 cd6a92994b Fixing test case and review comments. 2022-06-24 12:08:29 +01:00
Dean 8eabd7ff20 Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-06-24 09:21:07 +01:00
mike12345567 56956dba4f Adding a class wrapper incase using get/put functions multiple times, functions like the PouchDB constructor. 2022-06-23 20:27:20 +01:00
mike12345567 b4bed6c0ce Updating redis to use typescript and adding the option of a writethrough cache which can be used, by passing a DB and a value to be written + a delay for writes. 2022-06-23 20:22:51 +01:00
Dean 5fd385ab30 Merge commit 2022-06-23 14:29:19 +01:00
Andrew Kingston 686c38cf47 Improve Couch DB URL parsing to handle edge cases and special characters 2022-06-23 09:14:22 +01:00
Peter Clement d952b9a3bb updated store and finished groups tab 2022-06-22 13:55:31 +01:00
Peter Clement b7cc71a623 saving and fetching groups from couch 2022-06-15 16:51:30 +01:00
Rory Powell 0054c2a502 Ensure tests can't send events even when token is set 2022-06-15 14:09:02 +01:00
Rory Powell 6cc2bbadd7 Add deployment environment to identities 2022-06-15 11:46:03 +01:00
Rory Powell 3da4fb33cd Better handle first time startup + dedicated event 2022-06-15 11:20:13 +01:00
Rory Powell 97bd8e01f1 Add hosting to all identities and events, add installationId to tenant group 2022-06-14 17:34:32 +01:00
Rory Powell 46d7eab105 Fix user id generation 2022-06-13 22:26:15 +01:00
Rory Powell ee9a19a1d5 Back populate no-op migrations on new app and tenant create 2022-06-13 10:51:29 +01:00
Rory Powell 12aa9fa1ce Dev improvements - remove need to rebuilds of backend-core/dist and enable debugging when running tests and backend services, use source directly using typescript and jest path mappings 2022-06-10 22:57:12 +01:00
Rory Powell 0cf777a0cd Build fixes 2022-06-09 12:33:10 +01:00
Martin McKeaveney c470c2f676 merge with master 2022-06-08 13:26:14 +01:00
Martin McKeaveney d15dfb83fc new ui functionality working from S3 bucket 2022-06-06 23:30:36 +01:00
Rory Powell 361ffd224f Merge branch 'release' into feature/event-backfill 2022-06-06 09:50:06 +01:00
Martin McKeaveney d5540bbd57 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Rory Powell 86d094dda4 Migration locks and add optional preventRetry option 2022-06-01 17:52:41 +01:00
Rory Powell 081db8423e Fix key eviction 2022-06-01 15:31:27 +01:00
Rory Powell 4f34e1b2c7 app id fixes 2022-06-01 15:17:49 +01:00
Rory Powell 7f26a60cc9 Default to historical timestamp 2022-06-01 14:44:12 +01:00
Rory Powell a4eef3daab Add awareness of deployment environment 2022-06-01 14:10:00 +01:00
Martin McKeaveney d57c4987fe Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-01 09:47:13 +01:00
Rory Powell 7ebfaf8a31 Failover protection with event cache 2022-05-31 21:04:41 +01:00
mike12345567 f1c81436cc Review comments and test fix. 2022-05-31 10:16:22 +01:00
Rory Powell a9ab8b2629 Lots of failure handling and caching 2022-05-30 21:46:08 +01:00
mike12345567 fa30457f2b Fixing issue with server not shutting down correctly when an error occurs, making sure that everything clears up gracefully. 2022-05-30 21:22:06 +01:00
mike12345567 dae6a6b81c Fixing minor issue with automation quota updates. 2022-05-30 14:06:42 +01:00
Rory Powell 2a00f6498d Merge branch 'feature/posthog-v2' into feature/event-backfill 2022-05-29 00:25:40 +01:00
Rory Powell 857cd2d735 Merge branch 'develop' into feature/posthog-v2 2022-05-28 23:03:31 +01:00
Rory Powell c0d6fa34a4 Identity tenant and installation groups, property updates 2022-05-28 21:38:22 +01:00
Rory Powell 3c1b13083c Installation identities, upgrade / downgrade events, filling in more event properties 2022-05-26 23:57:14 +01:00
mike12345567 15526a4000 Merge branch 'develop' of github.com:Budibase/budibase into feature/app-quotas 2022-05-26 13:31:32 +01:00
Rory Powell ba1c4ead90 app and account properties, add account details to all user and tenant identities 2022-05-26 10:13:26 +01:00
Dean c17e625961 Refactored approach to ensure the request context is set appropriately 2022-05-26 10:03:29 +01:00
Dean 4bd315c1bd Merge remote-tracking branch 'origin/develop' into fix/update-icon-context 2022-05-26 09:02:13 +01:00
Rory Powell b986b689d6 Historical timestamps 2022-05-25 21:32:08 +01:00
mike12345567 8bc0142a37 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-25 18:12:27 +01:00
mike12345567 4eaf3f698c Merge branch 'master' of github.com:Budibase/budibase into feature/load-testing 2022-05-25 16:15:59 +01:00
mike12345567 84d0b61588 Swapping bcryptjs for bcrypt. 2022-05-25 16:14:45 +01:00
Dean 756f5b3aa6 Explicitly passing requested appId when calling updateAppPackage 2022-05-25 15:10:37 +01:00
Martin McKeaveney 4bbfae3880 add better logging on session invalidation 2022-05-25 13:02:15 +01:00
mike12345567 5ba7942282 Moving table, datasource and datasource plus document types into the backend core. 2022-05-25 10:52:19 +01:00
Rory Powell 6a4c601ae8 timestamp support, logging updates, migration progress indicators, identification updates 2022-05-25 00:15:52 +01:00
Martin McKeaveney 06fbcc4573 catch block in invalidate sessions 2022-05-24 22:57:32 +01:00
Rory Powell b3f04e7e8f Identity updates 2022-05-24 20:01:13 +01:00
Rory Powell 5d8bd9c2a3 Merge branch 'master' into develop 2022-05-24 10:20:08 +01:00
Rory Powell ff48aaec6e User context updates and misc fixes 2022-05-24 09:54:36 +01:00
Martin McKeaveney 4fb6eb972f adding default license env variable 2022-05-24 09:12:39 +01:00
mike12345567 a7e6eb2851 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-23 23:43:57 +01:00
mike12345567 484dbbb605 Adding the ability to force a new context. 2022-05-23 23:23:49 +01:00
Rory Powell 28b48a88fe Event identification 2022-05-23 22:14:44 +01:00
mike12345567 1f3d552199 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-23 17:03:36 +01:00
Martin McKeaveney 518797295e merge 2022-05-23 16:52:34 +01:00
Martin McKeaveney 9d813292de enable clustering on server and worker services, better log output on user not found errors 2022-05-23 16:24:29 +01:00
mike12345567 8fbbba16ee Updating cache to 1 hour. 2022-05-23 16:06:47 +01:00
mike12345567 76f19def26 Moving the withCache function to backend-core so that it can be shared, as well as adding a cache busting function which can be used when one of the checklist configs changes. 2022-05-23 15:03:52 +01:00
Rory Powell 4841c84861 Merge branch 'feature/posthog-v2' into feature/event-backfill 2022-05-23 10:29:33 +01:00
Rory Powell 70fff5c7b9 Merge branch 'develop' into feature/posthog-v2 2022-05-23 09:04:00 +01:00
Martin McKeaveney e6a28aaeed Merge pull request #6007 from Budibase/fix/postgres-connection
Postgres connection - fixing sporadic issues
2022-05-23 08:42:17 +01:00
Martin McKeaveney 6d3aa6a806 withCache wrapper for working with redis 2022-05-23 00:09:03 +01:00
mike12345567 aede23d44e Improving performance of load script, can generate thousands of users a second. 2022-05-22 18:29:02 +01:00
Rory Powell 443b664e33 Finish global migration 2022-05-20 21:16:29 +01:00
mike12345567 1b86041c68 Removing the use of pouchdb-all-dbs from testing environment, it was causing more harm than good and was entirely avoidable. 2022-05-20 18:29:37 +01:00
Rory Powell 756f5b51aa App migrations finished 2022-05-20 12:29:31 +01:00
mike12345567 e846d27c42 Review comments. 2022-05-19 10:32:14 +01:00
Rory Powell 498c130e71 Migration for apps, automations, datasources, layouts, queries, roles, tables 2022-05-19 08:19:25 +01:00
Martin McKeaveney 296a327ee9 use platform url env 2022-05-18 21:00:42 +01:00
Rory Powell 8da427284c Stub out migrations + start tests + add build watching for backend-core 2022-05-18 10:56:44 +01:00
mike12345567 e61efc5474 Merge branch 'develop' of github.com:Budibase/budibase into feature/portal-usage 2022-05-18 10:56:44 +01:00
mike12345567 c528896e2d Finishing off UI, expanding settings menus from 80ch to 90ch as they were quite restricted and made the usage UI a bit difficult to view. Added a DISABLE_DEVELOPER_LICENSE env variable for testing. 2022-05-17 17:44:40 +01:00
Rory Powell fb18904ad8 Fix tests and build 2022-05-17 10:05:05 +01:00
Rory Powell 99b83a4496 Update getPlatformUrl usage to use a single interface 2022-05-17 09:52:38 +01:00
Martin McKeaveney b98476349e editing getPlatformUrl for cloud 2022-05-16 23:22:33 +01:00
mike12345567 08f53591e6 Fixing test cases. 2022-05-16 12:31:07 +01:00
Rory Powell a57c35ee76 Add execute automation to basic user / write permission set 2022-05-12 17:35:31 +01:00
mike12345567 e5922269aa Switching over to using our own version of cls-hooked which has the memory leak (no async hooks disable call) fixed as well as changing how we use the CLS namespaces to allow us to destroy the namespace we use per request. 2022-05-10 16:37:24 +01:00
mike12345567 944851d182 Adding our own version of cls hooked with the memory leak fixed. 2022-05-10 16:34:20 +01:00
Rory Powell 8e885075b6 handlers -> publishers and analtics -> processors 2022-05-10 10:33:59 +01:00
mike12345567 26441255cf Unit tests for the utility functions that have changed around app ID checks/generation./ 2022-05-09 13:28:01 +01:00
mike12345567 8e704cc70f Fixing issue #5778 - making sure to only remove the first app_ element of the app ID. 2022-05-09 12:29:44 +01:00
Martin McKeaveney e46ac20317 Merge pull request #5643 from Budibase/feature/small-april-tickets
Feature/small april tickets
2022-05-06 16:27:50 +01:00
Martin McKeaveney 8899527da8 merge 2022-05-05 12:45:09 +01:00
Rory Powell 34474d5c10 Re-enable gsheets for verification 2022-05-05 09:59:10 +01:00
Rory Powell 77cb7c480c Merge branch 'feature/posthog-v2' into feature/event-backfill 2022-05-05 09:22:01 +01:00
Rory Powell e45c0f98c7 Merge pull request #5694 from Budibase/add-types-package
Add @budibase/types package
2022-05-05 08:50:37 +01:00
Rory Powell e4257f1e04 Merge branch 'develop' into feature/posthog-v2 2022-05-05 08:47:06 +01:00
Rory Powell 1f56d31ebb App backfill (wip) 2022-05-05 08:32:14 +01:00
Rory Powell 4e7a16db30 Add isDev() to backend-core/env 2022-05-04 12:28:21 +01:00
Rory Powell 11ea9d90e3 Add ts watch support for backend-core + stub out migrations 2022-05-04 11:22:50 +01:00
Rory Powell 3b9142f103 Build and test fixes 2022-05-03 22:58:19 +01:00
Rory Powell 8b4f4c813a Add @budibase/types package 2022-05-03 17:13:13 +01:00
Rory Powell 185b591db5 Merge branch 'labday/backend-core-ts' into feature/posthog-v2 2022-04-29 14:01:13 +01:00
Martin McKeaveney 2a7fa4d8f7 merge 2022-04-29 00:05:43 +01:00
Rory Powell cfa75a8af3 backend-core typescript building successfully 2022-04-28 22:39:21 +01:00
mike12345567 a2c6917bfa Fixing test case. 2022-04-27 22:57:03 +01:00
mike12345567 2865d6531c Review comments. 2022-04-27 22:36:45 +01:00
mike12345567 061868c826 Fixing an issue with cookie auth. 2022-04-27 16:56:30 +01:00
Rory Powell 1caf4b1965 Merge branch 'develop' into feature/posthog-v2 2022-04-27 16:32:00 +01:00
mike12345567 48eda78f67 Fix for issue being able to delete apps. 2022-04-27 15:58:55 +01:00
Rory Powell 12abe4adcc Bypass couch db when using tenancy middleware 2022-04-26 17:13:45 +01:00
Martin McKeaveney a91cf354b6 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
mike12345567 2441f42c54 Merge branch 'develop' of github.com:Budibase/budibase into fix/develop-merge 2022-04-26 16:31:17 +01:00
Dean 8b8baf9bdd Merge remote-tracking branch 'origin/develop' into feature/new-app-publish-workflow 2022-04-26 12:12:50 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
Rory Powell dd0e6099b8 Fix: google sso 2022-04-25 22:49:56 +01:00
Rory Powell b9a39e193e Fix developer count migration when only single developer 2022-04-25 15:38:37 +01:00
Rory Powell f6284cc697 Sync versions of pro and backend-core 2022-04-25 12:19:36 +01:00
Martin McKeaveney bbce5a9c7f Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 46b424308f only save refresh token in google auth 2022-04-24 23:33:50 +01:00
Martin McKeaveney 84d2bb3cf5 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
mike12345567 7627230be6 Fixing an issue we've experienced with couch, using a base64 cookie that we control manually. 2022-04-22 17:24:50 +01:00
mike12345567 7083470baa Adding a dep:clean function, cleaning up lock files and fixing backend-core test which did not utilise tenancy (no global db). 2022-04-21 15:20:23 +01:00
mike12345567 345bbf603c Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
Dean 61150c82cf Merge remote-tracking branch 'origin/develop' into feature/new-app-publish-workflow 2022-04-21 14:10:58 +01:00
mike12345567 13cb5f7f7c Adding another check to make sure context is the same. 2022-04-20 23:13:08 +01:00
mike12345567 151ed604f8 Fixing some issues detected by the test cases, making the in-use mechanism for context more clear to complete avoid stack up of contexts (leading to loss of knowledge around previous databases. 2022-04-20 23:10:39 +01:00
mike12345567 6afe3a28ef Closing global DB using the standard function - not directly. 2022-04-20 18:07:48 +01:00
mike12345567 9899781fc5 Some updates, making sure databases will always close directly using finally checks around the actual tasks, updating how replication works to have a close statement (to make sure it is controlled correctly) and then updating to PouchDB 7.3.0 for one of the memory leak fixes. 2022-04-20 17:33:42 +01:00
Rory Powell d2a4e0a934 Merge branch 'develop' into feature/licensing 2022-04-20 14:59:36 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
Rory Powell 41144db055 Remove remaining direct usage of CouchDB. Add common pouch config to backend-core 2022-04-19 16:45:27 +01:00
Dean f78aaa640f Code style check 2022-04-19 14:56:56 +01:00
Dean 26c19891bb Unpublish refactored to stop development applications being mistakenly deleted. Minor updates to the modal content component to allow the replacement of the header. Further work to implement the publishing workflow changes 2022-04-19 14:38:09 +01:00
Andrew Kingston f6eef900ad Merge pull request #5272 from Budibase/cheeks-lab-day-devtools
DevTools
2022-04-14 12:57:01 +01:00
Rory Powell 03c3ebbbbf Handle no developers on first time startup migration 2022-04-13 23:14:36 +01:00
Rory Powell 33719fcb09 Merge branch 'feature/licensing' into feature/posthog-v2 2022-04-12 17:12:46 +01:00
Rory Powell 03ba6d914f Merge branch 'develop' into feature/licensing 2022-04-12 16:18:41 +01:00
Rory Powell a6107dc7f9 Test updates 2022-04-12 15:37:49 +01:00
Rory Powell d99f579bf6 User management events 2022-04-12 12:34:36 +01:00
Rory Powell 957e90fe86 View/Filter/Calculation events 2022-04-12 00:19:52 +01:00
Rory Powell 6db5c62e48 View/Table/Row Import/Export events 2022-04-11 22:32:12 +01:00
Rory Powell 5ab9f1a9c5 Table CRUD events + add timekeeper for tests 2022-04-11 14:39:31 +01:00
Rory Powell d41037a859 builder / app / app preview served events 2022-04-08 14:07:11 +01:00
Rory Powell c316a27f26 screen events 2022-04-08 10:55:39 +01:00
Rory Powell e98e659346 user / rbac events + tests 2022-04-08 01:28:22 +01:00
Dean 352c021955 Refactored the invalidate session functionality. 2022-04-07 12:32:00 +01:00
Rory Powell ac8573b67e query / update events + tests 2022-04-07 00:38:18 +01:00
Rory Powell 8a08e9322f org settings events + tests + stub license events 2022-04-06 22:53:33 +01:00
Martin McKeaveney bff43d37d5 Merge pull request #5151 from mslourens/prevent_multiple_sessions
invalidate sessions before login
2022-04-06 22:18:17 +01:00
Rory Powell deaf0de349 layout events + tests 2022-04-06 22:07:21 +01:00
Rory Powell cd0e37d2c1 rename data -> structures 2022-04-06 22:00:10 +01:00
Rory Powell 266b34aaa0 automation events + tests 2022-04-06 13:54:57 +01:00
Andrew Kingston c2d61d8ebc Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-devtools 2022-04-06 11:50:43 +01:00
Rory Powell 82597a1afa sso activated/deactivated events + tests 2022-04-06 00:54:07 +01:00
Rory Powell d706ec8efd google/oidc created/deleted events + tests 2022-04-05 23:14:53 +01:00
Rory Powell aa662a3744 account event mocks 2022-04-05 21:53:27 +01:00
Rory Powell 6128dfadcf Logout events 2022-04-05 16:56:28 +01:00
Rory Powell 8d39bf9f2e sso auth + datasource events, test updates 2022-04-05 15:46:04 +01:00
Rory Powell d0af6cc8ca App events 2022-04-04 15:59:00 +01:00
Rory Powell de7d57558d Add event domain 2022-04-01 21:29:44 +01:00
Martin McKeaveney 034408b3c2 merge with master 2022-03-30 15:44:22 +01:00
Rory Powell 0aa141e7c6 Add tests for base db config 2022-03-30 15:43:18 +01:00
Rory Powell 2a5df40ffa Add createdAt and updatedAt to all new put requests 2022-03-30 14:24:04 +01:00
Rory Powell 15b676ce1c Remove remaining direct usage of CouchDB. Add common pouch config to backend-core 2022-03-29 16:03:44 +01:00
Maurits Lourens 5f91841a26 move invalidation to the creation of a session 2022-03-29 11:59:16 +02:00
Maurits Lourens 65b3561244 invalidate sessions before login 2022-03-29 10:06:54 +02:00
Martin McKeaveney aed9bfc728 fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
mike12345567 88437e11d0 Fix for #5103 - some templates are built on an older version that stored permissions differently, we can't migrate these as they will keep being added, easiest to just support the old method (apply the old rule and convert to the new format when retrieving roles). 2022-03-28 16:34:50 +01:00
Martin McKeaveney dc940d33db fix launch.json 2022-03-28 12:03:44 +01:00
Rory Powell 75d5c0c0b9 Merge branch 'feature/licensing' into feature/posthog-v2 2022-03-28 09:47:34 +01:00
Rory Powell 7db6075f82 Fixes 2022-03-25 16:08:12 +00:00
Rory Powell 3e5e95a9c1 Add analytics to backend-core. Update server posthog usage 2022-03-25 13:04:34 +00:00
Rory Powell 819f9b75de Link app context with tenancy, remove app tenancy middleware 2022-03-24 13:04:49 +00:00
Rory Powell a68abf2730 Fix cross tenant apps with session 2022-03-23 16:45:06 +00:00
Rory Powell 0a4b1eb552 Tests complete + backwards compatibility for deployment 2022-03-22 00:23:22 +00:00
Rory Powell 715d42d3e6 Merge branch 'develop' into feature/licensing 2022-03-21 17:13:16 +00:00
Rory Powell 795b48bfb0 Published apps, automations and query count quotas 2022-03-20 01:13:54 +00:00
Rory Powell 661367333d Add developer usage restrictions to SSO user creation 2022-03-18 08:01:31 +00:00
Rory Powell e695a57853 Better error handling around license errors 2022-03-16 17:29:47 +00:00
mike12345567 5b79126dbf Fixing an issue with the public API loading for the first time in a multi-tenant environment, also fixing an issue in self host when switching between environments with different secrets. 2022-03-14 19:05:02 +00:00
mike12345567 d55a385072 Fixing an issue with detecting fully qualified Redis URL despite not in use. 2022-03-14 16:50:01 +00:00
mike12345567 30651e81d5 Making the URL optional for application creation/update in OpenAPI spec, removing unused parameter and fixing getRedisOptions function to work with fully qualified URLs. 2022-03-10 15:53:23 +00:00
Rory Powell 7698e9293c Self Host <-> Licensing integration 2022-03-09 21:16:22 +00:00
Rory Powell 7151c86224 Merge branch 'develop' into labday/status-banner 2022-03-08 16:31:07 +00:00
Rory Powell eefe4ea2ad Integrate usage quotas with licensing 2022-03-08 14:21:41 +00:00
Rory Powell ad4a268a69 Move licensing middleware to pro repo 2022-03-08 08:01:41 +00:00
Rory Powell b686c19658 Enforce licensed developer count + error types/codes framework 2022-03-04 13:42:50 +00:00
Rory Powell a81041bc40 Add shared licensing cache 2022-03-03 13:37:04 +00:00
Rory Powell 8c61f92123 Invalidate user cache on logout 2022-03-03 07:20:30 +00:00
Rory Powell 4df48d306c Handle no license found 2022-03-02 07:27:14 +00:00
Rory Powell ee7fdcfaba Start to integrate licensing with sessions 2022-03-01 21:11:45 +00:00
mike12345567 83d4994f55 Starting to fix up test cases. 2022-02-25 15:55:19 +00:00
mike12345567 53f108865a Merge branch 'develop' of github.com:Budibase/budibase into feature/budibase-api 2022-02-24 18:19:20 +00:00
Rory Powell 9e0a10955a Add status banner that reacts to cypress healthcheck failures 2022-02-24 14:41:24 +00:00
Andrew Kingston 66715b8290 Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-devtools 2022-02-24 14:03:29 +00:00
mike12345567 8f6e55e65b Adding controllers for row, query and applications public APIs. 2022-02-23 18:31:32 +00:00
mike12345567 8685abf99e Refactoring how endpoints are specified so that the middlewares can be applied in a more generic fashion. 2022-02-22 18:40:09 +00:00
Rory Powell 53c0e37f83 Fix app list retrieval in migrations 2022-02-22 07:49:33 +00:00
mike12345567 e1352ffbd2 Merge branch 'develop' of github.com:Budibase/budibase into feature/budibase-api 2022-02-21 16:54:39 +00:00
Rory Powell ed9c6c4ec8 Respect custom tenantIds in run migrations endpoint 2022-02-21 15:27:51 +00:00
mike12345567 6cbf186ead Merge branch 'develop' of github.com:Budibase/budibase into feature/budibase-api 2022-02-21 14:34:06 +00:00
Rory Powell 02c0c49594 Deprovision and local couch db url fix 2022-02-18 17:36:23 +00:00
Rory Powell da9be1b20a Add 'location = /' -> 4001 to nginx dev conf 2022-02-18 11:18:59 +00:00
mike12345567 73ee8fea29 Quick fix for checklist API performance on default tenant in cloud. 2022-02-16 11:59:43 +00:00
Michael Drury 02479e4112 Using 10K iteration string stretching for encryption. 2022-02-14 21:37:40 +00:00
mike12345567 df4af0fb9a Adding basic encrypt/decrypt pathway. 2022-02-14 18:32:09 +00:00
mike12345567 249b2dbba8 Adding tenancy to the API key, making the authenticated middleware aware of new user API keys, using a view to lookup the user by API key. 2022-02-11 22:24:48 +00:00
mike12345567 594cb77b1e Getting api key/dev info docs setup and in use. 2022-02-10 19:06:49 +00:00
Martin McKeaveney d1cebc61a9 merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney 3a653e9f98 merge with master 2022-02-10 18:24:36 +01:00
Martin McKeaveney 0966720982 use google env variable for client secret and ID, update helm chart to pass variables to worker 2022-02-10 10:28:46 +01:00
Martin McKeaveney 08a3ae0e7c use env platform URL for datasource auth to prevent tenant overrides 2022-02-09 18:33:29 +01:00
Andrew Kingston 2969f2d24c Merge branch 'develop' of github.com:Budibase/budibase into frontend-core 2022-02-07 14:45:14 +00:00
mike12345567 a214400e03 Fixing issue which was blocking the ability to logout fully, as well as causing issues with new user signup and password reset. 2022-02-04 17:35:45 +00:00
mike12345567 d87b8c0563 Fix for #4267 - allow admins to access all roles. 2022-02-04 17:34:39 +00:00
Andrew Kingston 2724ce00c3 Merge branch 'develop' of github.com:Budibase/budibase into frontend-core 2022-02-03 14:46:59 +00:00
Michael Drury 4b23a78bc9 Fixing a typescript issue in server. 2022-02-01 20:29:12 +00:00
Andrew Kingston de12e0dc79 Merge branch 'develop' of github.com:Budibase/budibase into frontend-core 2022-02-01 16:46:00 +00:00
mike12345567 72534c6ed2 Refactoring backend-core tenancy to context, splitting out tenancy functionality to its own area. 2022-01-31 17:53:19 +00:00
mike12345567 dbc048b365 Review comments, renaming deployed -> prod in terms of app IDs. 2022-01-31 17:42:51 +00:00
mike12345567 476f34fb93 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 17:16:59 +00:00
mike12345567 e718b18127 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 14:09:07 +00:00
Andrew Kingston 9b1754ad70 Merge branch 'develop' of github.com:Budibase/budibase into frontend-core 2022-01-31 09:40:33 +00:00
Rory Powell 54a32b41ef Merge branch 'develop' into feature/migrations-2.0 2022-01-30 22:37:11 +00:00
Rory Powell 0089fb06d9 Merge branch 'develop' into csrf 2022-01-30 21:20:48 +00:00
mike12345567 91a90e62b2 Fixing some issues discovered by the cypress tests, cleaning up how Couch is used. 2022-01-28 18:52:34 +00:00
mike12345567 d5f8cc1023 Tests updating, all now passing, fixed some issues discovered by them. 2022-01-28 15:43:51 +00:00
Rory Powell e001376e6d Fix loop early exit 2022-01-28 11:32:28 +00:00
Michael Drury d3a90acc55 Final pass refactoring - need to test but all code in server converted. 2022-01-28 00:05:39 +00:00
mike12345567 d2fe119d90 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00
Rory Powell 758a8a023f Merge branch 'develop' into feature/migrations-2.0 2022-01-27 10:49:52 +00:00
Rory Powell 767354ad60 Add app db support + app url migration 2022-01-27 10:40:31 +00:00
Andrew Kingston bfe209e3e6 Merge branch 'develop' of github.com:Budibase/budibase into frontend-core 2022-01-26 17:49:27 +00:00
Martin McKeaveney 19d27c97a4 code review and merge with develop 2022-01-26 17:45:28 +01:00
Martin McKeaveney efde072e70 code review 2022-01-26 17:14:47 +01:00
Andrew Kingston c7cd6b923d Merge branch 'develop' of github.com:Budibase/budibase into frontend-core 2022-01-26 16:02:27 +00:00
Rory Powell e5d04d2830 Merge branch 'develop' into feature/migrations-2.0 2022-01-26 15:00:52 +00:00
Rory Powell 20ec58b775 Don't apply csrf to existing sessions. Handle only supported content types 2022-01-26 12:52:53 +00:00
Rory Powell 0b9bb42817 Revert "Fix dev app preview return url"
This reverts commit 13d0bfb190.
2022-01-26 09:33:14 +00:00
Rory Powell ffcf5354eb Add CSRF Token 2022-01-25 22:54:50 +00:00
Andrew Kingston 611dc0ab48 Use correct casing for login error 2022-01-24 19:15:43 +00:00
Rory Powell 3fdce44d56 Migrations 2.0 2022-01-24 10:48:59 +00:00
Rory Powell 04386bd1d8 Merge pull request #4000 from Budibase/fix/sync-apps-reset-rows-quotas
App and Row Quota Fixes
2022-01-21 11:20:14 +00:00
Martin McKeaveney 328aef00e1 tidy up 2022-01-18 17:41:38 +01:00
Rory Powell fc043e116d Support template and app import in quotas + logging 2022-01-18 15:37:16 +00:00
Rory Powell 439fa9a010 Refactor to allow for future quota migrations 2022-01-18 14:43:24 +00:00
Martin McKeaveney 4ff339cae2 removing comment 2022-01-18 10:30:54 +01:00
Martin McKeaveney 9663806bfc more flexible datasource auth config 2022-01-17 15:52:10 +01:00
Martin McKeaveney c39bbf46fb Revert "sameSite and secure cookie settings" 2022-01-17 09:39:22 +01:00
Martin McKeaveney a70b96a21a gsheets E2E 2022-01-15 19:28:04 +01:00
Martin McKeaveney 6a3882cb1f sameSite and secure cookie settings 2022-01-13 20:47:16 +01:00
Rory Powell 13d0bfb190 Fix dev app preview return url 2022-01-13 16:29:55 +00:00
mike12345567 bca8212d1d Merge branch 'develop' of github.com:Budibase/budibase into fix/sync-apps-reset-rows-quotas 2022-01-12 13:20:22 +00:00
mike12345567 5ee6aa24b2 Refactoring core library usage in monorepo, make it a bit cleaner/easier to search/more standardised. 2022-01-12 11:32:14 +00:00
Rory Powell e58bd14dcc Merge branch 'develop' into fix/sync-apps-reset-rows-quotas 2022-01-12 09:34:14 +00:00
mike12345567 b33523a73d Merge branch 'develop' of github.com:Budibase/budibase into feature/auth-core 2022-01-11 15:16:07 +00:00
mike12345567 12ae9993ca Changing directory. 2022-01-10 19:30:35 +00:00