Commit Graph

343 Commits

Author SHA1 Message Date
Andrew Kingston 60060fac6f Improve Couch DB URL parsing to handle edge cases and special characters 2022-06-23 09:14:22 +01:00
Peter Clement 8d264fe983 updated store and finished groups tab 2022-06-22 13:55:31 +01:00
Peter Clement 4ab7e8cd11 saving and fetching groups from couch 2022-06-15 16:51:30 +01:00
Rory Powell acbb411a0a Ensure tests can't send events even when token is set 2022-06-15 14:09:02 +01:00
Rory Powell 7283e01442 Add deployment environment to identities 2022-06-15 11:46:03 +01:00
Rory Powell 4cfedf7252 Better handle first time startup + dedicated event 2022-06-15 11:20:13 +01:00
Rory Powell cfad5af382 Add hosting to all identities and events, add installationId to tenant group 2022-06-14 17:34:32 +01:00
Rory Powell 29292395ef Fix user id generation 2022-06-13 22:26:15 +01:00
Rory Powell eb0214a231 Back populate no-op migrations on new app and tenant create 2022-06-13 10:51:29 +01:00
Rory Powell a2b9fcd448 Dev improvements - remove need to rebuilds of backend-core/dist and enable debugging when running tests and backend services, use source directly using typescript and jest path mappings 2022-06-10 22:57:12 +01:00
Rory Powell e447fd11d1 Build fixes 2022-06-09 12:33:10 +01:00
Martin McKeaveney 80a0c59c8a merge with master 2022-06-08 13:26:14 +01:00
Martin McKeaveney bf3a14dda4 new ui functionality working from S3 bucket 2022-06-06 23:30:36 +01:00
Rory Powell 4e77571ddb Merge branch 'release' into feature/event-backfill 2022-06-06 09:50:06 +01:00
Martin McKeaveney 493607b853 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Rory Powell 9f2620dd7a Migration locks and add optional preventRetry option 2022-06-01 17:52:41 +01:00
Rory Powell eae5223fe3 Fix key eviction 2022-06-01 15:31:27 +01:00
Rory Powell 090fdb58e0 app id fixes 2022-06-01 15:17:49 +01:00
Rory Powell b570563d41 Default to historical timestamp 2022-06-01 14:44:12 +01:00
Rory Powell bf9c6cbc42 Add awareness of deployment environment 2022-06-01 14:10:00 +01:00
Martin McKeaveney 9be1bddf85 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-01 09:47:13 +01:00
Rory Powell 429f379431 Failover protection with event cache 2022-05-31 21:04:41 +01:00
mike12345567 e439d7097b Review comments and test fix. 2022-05-31 10:16:22 +01:00
Rory Powell fd845284d3 Lots of failure handling and caching 2022-05-30 21:46:08 +01:00
mike12345567 06a32ed357 Fixing issue with server not shutting down correctly when an error occurs, making sure that everything clears up gracefully. 2022-05-30 21:22:06 +01:00
Rory Powell f2f6bf779d Merge branch 'feature/posthog-v2' into feature/event-backfill 2022-05-29 00:25:40 +01:00
Rory Powell 64d73e2f96 Merge branch 'develop' into feature/posthog-v2 2022-05-28 23:03:31 +01:00
Rory Powell 9610d8f1e7 Identity tenant and installation groups, property updates 2022-05-28 21:38:22 +01:00
Rory Powell 398a4e7034 Installation identities, upgrade / downgrade events, filling in more event properties 2022-05-26 23:57:14 +01:00
Rory Powell cbc3e72757 app and account properties, add account details to all user and tenant identities 2022-05-26 10:13:26 +01:00
Dean e9554562bb Refactored approach to ensure the request context is set appropriately 2022-05-26 10:03:29 +01:00
Dean 550f6f4d61 Merge remote-tracking branch 'origin/develop' into fix/update-icon-context 2022-05-26 09:02:13 +01:00
Rory Powell 163b667f95 Historical timestamps 2022-05-25 21:32:08 +01:00
mike12345567 09f8675816 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-25 18:12:27 +01:00
mike12345567 7957ca2a58 Merge branch 'master' of github.com:Budibase/budibase into feature/load-testing 2022-05-25 16:15:59 +01:00
mike12345567 157802b70a Swapping bcryptjs for bcrypt. 2022-05-25 16:14:45 +01:00
Dean e86dce30e3 Explicitly passing requested appId when calling updateAppPackage 2022-05-25 15:10:37 +01:00
Martin McKeaveney 543cd8deb1 add better logging on session invalidation 2022-05-25 13:02:15 +01:00
Rory Powell 54e8a5dafd timestamp support, logging updates, migration progress indicators, identification updates 2022-05-25 00:15:52 +01:00
Martin McKeaveney 50c6ad9630 catch block in invalidate sessions 2022-05-24 22:57:32 +01:00
Rory Powell b69a0836f5 Identity updates 2022-05-24 20:01:13 +01:00
Rory Powell ef13d6a821 Merge branch 'master' into develop 2022-05-24 10:20:08 +01:00
Rory Powell 9d0b4ef45e User context updates and misc fixes 2022-05-24 09:54:36 +01:00
Martin McKeaveney 10fe43050f adding default license env variable 2022-05-24 09:12:39 +01:00
mike12345567 d535afa542 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-23 23:43:57 +01:00
mike12345567 fe1016d01b Adding the ability to force a new context. 2022-05-23 23:23:49 +01:00
Rory Powell 22aa226ca9 Event identification 2022-05-23 22:14:44 +01:00
mike12345567 806a0c0389 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-05-23 17:03:36 +01:00
Martin McKeaveney f8d0e6fea8 merge 2022-05-23 16:52:34 +01:00
Martin McKeaveney b30c045663 enable clustering on server and worker services, better log output on user not found errors 2022-05-23 16:24:29 +01:00
mike12345567 7be0dad245 Updating cache to 1 hour. 2022-05-23 16:06:47 +01:00
mike12345567 100f5a6f3c Moving the withCache function to backend-core so that it can be shared, as well as adding a cache busting function which can be used when one of the checklist configs changes. 2022-05-23 15:03:52 +01:00
Rory Powell 6ea7912a73 Merge branch 'feature/posthog-v2' into feature/event-backfill 2022-05-23 10:29:33 +01:00
Rory Powell 80a82bbcc3 Merge branch 'develop' into feature/posthog-v2 2022-05-23 09:04:00 +01:00
Martin McKeaveney 7e5607fe3b
Merge pull request #6007 from Budibase/fix/postgres-connection
Postgres connection - fixing sporadic issues
2022-05-23 08:42:17 +01:00
Martin McKeaveney 9483712c7e withCache wrapper for working with redis 2022-05-23 00:09:03 +01:00
mike12345567 8ab3fc810b Improving performance of load script, can generate thousands of users a second. 2022-05-22 18:29:02 +01:00
Rory Powell 63dd69f5b3 Finish global migration 2022-05-20 21:16:29 +01:00
mike12345567 eae5d4dc4d Removing the use of pouchdb-all-dbs from testing environment, it was causing more harm than good and was entirely avoidable. 2022-05-20 18:29:37 +01:00
Rory Powell 8ae358d237 App migrations finished 2022-05-20 12:29:31 +01:00
mike12345567 d922a5794b Review comments. 2022-05-19 10:32:14 +01:00
Rory Powell 9fdba2b6e1 Migration for apps, automations, datasources, layouts, queries, roles, tables 2022-05-19 08:19:25 +01:00
Martin McKeaveney aa61a86c4a use platform url env 2022-05-18 21:00:42 +01:00
Rory Powell ca3206f4e4 Stub out migrations + start tests + add build watching for backend-core 2022-05-18 10:56:44 +01:00
mike12345567 39806d470d Merge branch 'develop' of github.com:Budibase/budibase into feature/portal-usage 2022-05-18 10:56:44 +01:00
mike12345567 36a190b0ed Finishing off UI, expanding settings menus from 80ch to 90ch as they were quite restricted and made the usage UI a bit difficult to view. Added a DISABLE_DEVELOPER_LICENSE env variable for testing. 2022-05-17 17:44:40 +01:00
Rory Powell eb935cf143 Fix tests and build 2022-05-17 10:05:05 +01:00
Rory Powell e50813bbd7 Update getPlatformUrl usage to use a single interface 2022-05-17 09:52:38 +01:00
Martin McKeaveney 557e4ec3f8 editing getPlatformUrl for cloud 2022-05-16 23:22:33 +01:00
mike12345567 bcf7e1782a Fixing test cases. 2022-05-16 12:31:07 +01:00
Rory Powell c9b199570a Add execute automation to basic user / write permission set 2022-05-12 17:35:31 +01:00
mike12345567 bba1fdcb7c Switching over to using our own version of cls-hooked which has the memory leak (no async hooks disable call) fixed as well as changing how we use the CLS namespaces to allow us to destroy the namespace we use per request. 2022-05-10 16:37:24 +01:00
mike12345567 5048469cfc Adding our own version of cls hooked with the memory leak fixed. 2022-05-10 16:34:20 +01:00
Rory Powell 182831d502 handlers -> publishers and analtics -> processors 2022-05-10 10:33:59 +01:00
mike12345567 2abfeb9356 Unit tests for the utility functions that have changed around app ID checks/generation./ 2022-05-09 13:28:01 +01:00
mike12345567 7b461c03dd Fixing issue #5778 - making sure to only remove the first app_ element of the app ID. 2022-05-09 12:29:44 +01:00
Martin McKeaveney e26d79b83c
Merge pull request #5643 from Budibase/feature/small-april-tickets
Feature/small april tickets
2022-05-06 16:27:50 +01:00
Martin McKeaveney 6cddc3f8f9 merge 2022-05-05 12:45:09 +01:00
Rory Powell 2cfb7be30a Re-enable gsheets for verification 2022-05-05 09:59:10 +01:00
Rory Powell 5672adb4b6 Merge branch 'feature/posthog-v2' into feature/event-backfill 2022-05-05 09:22:01 +01:00
Rory Powell ab778190cb
Merge pull request #5694 from Budibase/add-types-package
Add @budibase/types package
2022-05-05 08:50:37 +01:00
Rory Powell 3e254e46bb Merge branch 'develop' into feature/posthog-v2 2022-05-05 08:47:06 +01:00
Rory Powell 78b64fdfb9 App backfill (wip) 2022-05-05 08:32:14 +01:00
Rory Powell 320c1e7009 Add isDev() to backend-core/env 2022-05-04 12:28:21 +01:00
Rory Powell 23cbd217cd Add ts watch support for backend-core + stub out migrations 2022-05-04 11:22:50 +01:00
Rory Powell 606d21b313 Build and test fixes 2022-05-03 22:58:19 +01:00
Rory Powell e1a656b76f Add @budibase/types package 2022-05-03 17:13:13 +01:00
Rory Powell 1e7e6bdab8 Merge branch 'labday/backend-core-ts' into feature/posthog-v2 2022-04-29 14:01:13 +01:00
Martin McKeaveney 06774c1452 merge 2022-04-29 00:05:43 +01:00
Rory Powell 36f7358a20 backend-core typescript building successfully 2022-04-28 22:39:21 +01:00
mike12345567 28584a01db Fixing test case. 2022-04-27 22:57:03 +01:00
mike12345567 84afa832c5 Review comments. 2022-04-27 22:36:45 +01:00
mike12345567 00c67289b0 Fixing an issue with cookie auth. 2022-04-27 16:56:30 +01:00
Rory Powell bd33c827eb Merge branch 'develop' into feature/posthog-v2 2022-04-27 16:32:00 +01:00
mike12345567 4a02f7f9aa Fix for issue being able to delete apps. 2022-04-27 15:58:55 +01:00
Rory Powell 716eab5d10 Bypass couch db when using tenancy middleware 2022-04-26 17:13:45 +01:00
Martin McKeaveney a5bdf70cf7 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
mike12345567 95c7963c0a Merge branch 'develop' of github.com:Budibase/budibase into fix/develop-merge 2022-04-26 16:31:17 +01:00
Dean 5545cd84c5 Merge remote-tracking branch 'origin/develop' into feature/new-app-publish-workflow 2022-04-26 12:12:50 +01:00
Martin McKeaveney e01ef9bdfb merge with master 2022-04-26 10:21:45 +01:00
Rory Powell 0f04715062 Fix: google sso 2022-04-25 22:49:56 +01:00
Rory Powell b7cbd2a56a Fix developer count migration when only single developer 2022-04-25 15:38:37 +01:00
Rory Powell fa136ba4ca Sync versions of pro and backend-core 2022-04-25 12:19:36 +01:00
Martin McKeaveney 9f0cb41f49
Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 0fbb841855 only save refresh token in google auth 2022-04-24 23:33:50 +01:00
Martin McKeaveney 33717ceb30 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
mike12345567 9828fc6f58 Fixing an issue we've experienced with couch, using a base64 cookie that we control manually. 2022-04-22 17:24:50 +01:00
mike12345567 a6b249dc7e Adding a dep:clean function, cleaning up lock files and fixing backend-core test which did not utilise tenancy (no global db). 2022-04-21 15:20:23 +01:00
mike12345567 fe846f86a5 Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
Dean 91a6f8645c Merge remote-tracking branch 'origin/develop' into feature/new-app-publish-workflow 2022-04-21 14:10:58 +01:00
mike12345567 9d01028bd0 Adding another check to make sure context is the same. 2022-04-20 23:13:08 +01:00
mike12345567 1d61ff906a Fixing some issues detected by the test cases, making the in-use mechanism for context more clear to complete avoid stack up of contexts (leading to loss of knowledge around previous databases. 2022-04-20 23:10:39 +01:00
mike12345567 9ee1be79fb Closing global DB using the standard function - not directly. 2022-04-20 18:07:48 +01:00
mike12345567 7792a07899 Some updates, making sure databases will always close directly using finally checks around the actual tasks, updating how replication works to have a close statement (to make sure it is controlled correctly) and then updating to PouchDB 7.3.0 for one of the memory leak fixes. 2022-04-20 17:33:42 +01:00
Rory Powell 2269bf677b Merge branch 'develop' into feature/licensing 2022-04-20 14:59:36 +01:00
mike12345567 ea6f580501 Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
Rory Powell 769f48f935 Remove remaining direct usage of CouchDB. Add common pouch config to backend-core 2022-04-19 16:45:27 +01:00
Dean 4cc1a85f25 Code style check 2022-04-19 14:56:56 +01:00
Dean 3e74118f81 Unpublish refactored to stop development applications being mistakenly deleted. Minor updates to the modal content component to allow the replacement of the header. Further work to implement the publishing workflow changes 2022-04-19 14:38:09 +01:00
Andrew Kingston 98eefb1dd2
Merge pull request #5272 from Budibase/cheeks-lab-day-devtools
DevTools
2022-04-14 12:57:01 +01:00
Rory Powell 3018aaf078 Handle no developers on first time startup migration 2022-04-13 23:14:36 +01:00
Rory Powell 23b68660c2 Merge branch 'feature/licensing' into feature/posthog-v2 2022-04-12 17:12:46 +01:00
Rory Powell dd740df387 Merge branch 'develop' into feature/licensing 2022-04-12 16:18:41 +01:00
Rory Powell 76d4e5d760 Test updates 2022-04-12 15:37:49 +01:00
Rory Powell 6a346d4650 User management events 2022-04-12 12:34:36 +01:00
Rory Powell 6bfb50b590 View/Filter/Calculation events 2022-04-12 00:19:52 +01:00
Rory Powell 06d70266cd View/Table/Row Import/Export events 2022-04-11 22:32:12 +01:00
Rory Powell 2c682d3507 Table CRUD events + add timekeeper for tests 2022-04-11 14:39:31 +01:00
Rory Powell eec094b581 builder / app / app preview served events 2022-04-08 14:07:11 +01:00
Rory Powell e725b1fb52 screen events 2022-04-08 10:55:39 +01:00
Rory Powell 75be1e031b user / rbac events + tests 2022-04-08 01:28:22 +01:00
Dean cbc3d3b946 Refactored the invalidate session functionality. 2022-04-07 12:32:00 +01:00
Rory Powell ed9836d8a6 query / update events + tests 2022-04-07 00:38:18 +01:00
Rory Powell 9d264ef1ba org settings events + tests + stub license events 2022-04-06 22:53:33 +01:00
Martin McKeaveney d7dbaef8be
Merge pull request #5151 from mslourens/prevent_multiple_sessions
invalidate sessions before login
2022-04-06 22:18:17 +01:00
Rory Powell 7846fff25d layout events + tests 2022-04-06 22:07:21 +01:00
Rory Powell e3cf9b0661 rename data -> structures 2022-04-06 22:00:10 +01:00
Rory Powell d9da559bba automation events + tests 2022-04-06 13:54:57 +01:00
Andrew Kingston 7c91d9dceb Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-devtools 2022-04-06 11:50:43 +01:00
Rory Powell 9ebdf837fc sso activated/deactivated events + tests 2022-04-06 00:54:07 +01:00
Rory Powell fde16cf548 google/oidc created/deleted events + tests 2022-04-05 23:14:53 +01:00
Rory Powell 5b8ea1cdbe account event mocks 2022-04-05 21:53:27 +01:00
Rory Powell a4b49c3633 Logout events 2022-04-05 16:56:28 +01:00
Rory Powell 39ef2438a3 sso auth + datasource events, test updates 2022-04-05 15:46:04 +01:00
Rory Powell 7a5df9010c App events 2022-04-04 15:59:00 +01:00
Rory Powell c428ed7177 Add event domain 2022-04-01 21:29:44 +01:00
Martin McKeaveney e263cc31bb merge with master 2022-03-30 15:44:22 +01:00
Rory Powell ec0dcb42ee Add tests for base db config 2022-03-30 15:43:18 +01:00
Rory Powell 1339af11ae Add createdAt and updatedAt to all new put requests 2022-03-30 14:24:04 +01:00
Rory Powell 4ad846f116 Remove remaining direct usage of CouchDB. Add common pouch config to backend-core 2022-03-29 16:03:44 +01:00