Commit Graph

762 Commits

Author SHA1 Message Date
adrinr 43c25436c8 Test skip with filters 2023-03-28 16:46:22 +01:00
adrinr 348b06948b Test limits 2023-03-28 16:46:22 +01:00
adrinr 9a2eaaad42 Test deep pagination 2023-03-28 16:46:22 +01:00
adrinr 30c66748af Add skip tests 2023-03-28 16:46:22 +01:00
adrinr 47cc291551 Exclude session fields 2023-03-28 16:46:22 +01:00
adrinr f181cb02d0 Remove comment 2023-03-28 16:46:22 +01:00
adrinr 5ffa51d1f4 Rename 2023-03-28 16:46:22 +01:00
adrinr 41537cd00c Add comments 2023-03-28 16:46:22 +01:00
adrinr bf32801917 Handle skip on execution 2023-03-28 16:46:22 +01:00
adrinr a91e4b4da1 Make QueryBuilder vars private 2023-03-28 16:46:22 +01:00
adrinr 06245fee98 Make includeDocs private 2023-03-28 16:46:22 +01:00
adrinr 6c6d060550 Remove view 2023-03-28 16:46:22 +01:00
adrinr 1c828db694 Return total rows 2023-03-28 16:46:22 +01:00
adrinr c763c6fae5 Expose index 2023-03-28 16:46:22 +01:00
mike12345567 900e6c8129 Adding search index for user. 2023-03-28 16:46:22 +01:00
adrinr 621c06eada Add view 2023-03-28 16:46:22 +01:00
adrinr 2072664294 Move user search to core 2023-03-28 16:46:22 +01:00
adrinr f65ded4282 Allow bearer token for auth 2023-03-28 16:46:22 +01:00
mike12345567 cf5316ec8d General fixes for open handles, attempting to find and close all issues in server which are stopping shutdown of Jest suite. 2023-03-27 19:38:49 +01:00
Michael Drury 34e8009f08 Merge pull request #9949 from Budibase/fix/blacklist
Blacklisting
2023-03-20 10:33:11 +00:00
mike12345567 39bfbdfac1 PR comments. 2023-03-16 16:49:31 +00:00
mike12345567 c106c3291a Merge branch 'develop' of github.com:Budibase/budibase into fix/api-key-error 2023-03-16 13:39:24 +00:00
Rory Powell de89b9112a Simplify errors framework (#10042)
* Simplify errors framework

* Use enum for ErrorCode

* Lint

* Update base BudibaseError type to use enum

* For for public error on UsageLimitError

* Build fix

* Build fix
2023-03-16 08:42:02 +00:00
mike12345567 29fc91d6d1 Making it obvious that API key is invalid - error otherwise is quite cryptic. 2023-03-15 17:26:21 +00:00
mike12345567 63cf91218d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-03-14 14:12:32 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
mike12345567 bff6a51af2 Adding test case for scenario. 2023-03-13 11:48:13 +00:00
mike12345567 212b93cbe9 Fix for not contains with all or - variety of changes needed to achieve the actual expected functionality. 2023-03-13 11:48:03 +00:00
Michael Drury 5eabe9db22 Merge pull request #9779 from Budibase/jonny/api-metrics
metrics api endpoint
2023-03-10 12:12:51 +00:00
mike12345567 564c724be1 Provides the option for blacklisting IPs. 2023-03-08 16:30:26 +00:00
adrinr 84d450a931 Renames 2023-03-07 12:47:27 +01:00
adrinr 49493d80be Use name suffix instead of complex key object 2023-03-07 12:45:20 +01:00
adrinr 4d854ea5a7 Merge remote-tracking branch 'origin/develop' into bug/budi-5901-usage-quota-document-conflicts-can-cause 2023-03-07 12:41:58 +01:00
mike12345567 c51b9fb4b3 Merge branch 'develop' of github.com:Budibase/budibase into jonny/api-metrics 2023-03-06 15:23:35 +00:00
mike12345567 96208a5e8a Fixing build issue. 2023-03-03 12:05:30 +00:00
mike12345567 04ef7eeb9c Minor fixes - after removing axios altogether and adding a start script to make life easier for running from ts. 2023-03-03 10:03:33 +00:00
mike12345567 2bc0e988af Getting proper tenant ID for use by audit logs queue. 2023-03-02 13:39:26 +00:00
mike12345567 2335932978 Some updates to core types - used in pro update. 2023-03-02 10:20:49 +00:00
mike12345567 b787fafb32 Removing skip setup, tests depend on this behaviour - will update in separate PR. 2023-03-01 19:45:59 +00:00
mike12345567 5b150e7748 Removing migration change and fixing #9738 - making sure that exports with excludeRows enabled don't include attachments. 2023-03-01 19:43:40 +00:00
mike12345567 923e9d8ec4 Adding in test check. 2023-03-01 19:17:45 +00:00
mike12345567 eba18a4159 Fix for #9739 - there was an issue with the mango syntax, when working with multi attachment columns it was using an AND comparator instead of OR, it should be searching for rows that contain any attachment column, not all attachment columns. 2023-03-01 19:01:13 +00:00
Michael Drury a7d5f0fa7e Merge pull request #9844 from Budibase/fix/audit-log-muli-tenant
Audit log multi-tenancy fix
2023-03-01 17:27:55 +00:00
mike12345567 bba6f6941c Minor fix for audit log system - after the switch to use an async queue for handling of audit log storage, context was lost - in multi-tenant environments need to carry the tenant ID into the queue job so that context can be applied. 2023-03-01 16:38:19 +00:00
Rory Powell c83684ed83 Prevent showing user exists for password disabled actions 2023-03-01 14:49:44 +00:00
Rory Powell 2dfca0f67c Fix settings doc id in new installs 2023-03-01 14:32:01 +00:00
adrinr 04566dbabd Merge remote-tracking branch 'origin/develop' into bug/budi-5901-usage-quota-document-conflicts-can-cause 2023-03-01 13:31:56 +01:00
adrinr dded8beaeb Fix writethrough falling behind 2023-03-01 13:16:57 +01:00
Dean a5c6dbe4ae Merge remote-tracking branch 'origin/develop' into feature/app-user-onboarding-ux 2023-02-28 16:38:44 +00:00
adrinr b922fc3b00 Improve testing 2023-02-28 15:03:18 +01:00
adrinr c1462a7c9c Clean code 2023-02-28 14:54:43 +01:00
adrinr c254c565e4 Use redlock for writethrough 2023-02-28 14:54:34 +01:00
adrinr 66217d6b08 Return redlock execution info 2023-02-28 12:52:43 +01:00
adrinr 24161d12bf Type locks 2023-02-28 12:47:28 +01:00
Rory Powell ab69bbc299 lint 2023-02-28 11:03:56 +00:00
Rory Powell 312c01a879 Prefer default config for google sheets in cloud, don't use env vars for regular auth 2023-02-28 10:36:29 +00:00
Dean dd08845a44 Merge remote-tracking branch 'origin/develop' into feature/app-user-onboarding-ux 2023-02-28 09:38:15 +00:00
Dean 61ed62e6c4 Builder user onboarding 2023-02-28 09:37:03 +00:00
mike12345567 b47101e1fb Updating lucene test case to improve coverage. 2023-02-27 21:48:05 +00:00
mike12345567 c3a3fa1176 Adding a lucene test case. 2023-02-27 21:18:06 +00:00
mike12345567 2fb33e2cf3 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-27 14:51:33 +00:00
mike12345567 fefc6d920f Fixing open handle issue - now that the worker has access to queues needs to shut them down. 2023-02-27 14:41:28 +00:00
Rory Powell 2c46109e7d Enforceable SSO (#9787)
* Add ENFORCEABLE_SSO feature flag

* First draft of enforce sso configuration / show single sign on url

* Reading and writing isSSOEnforced + integration with login page

* Enable CI + lint

* Set correct base branch for CI

* Test fix for expected string changed

* Use tenant aware platform url as SSO link

* Bring in latest pro changes

* Lint

* Add useEnforceableSSO mock helper function

* Update configs.spec.ts with coverage for public settings

* Update users.spec.ts with additional tests for isPreventPasswordActions

* Lint

* Update refresh OAuthToken to use correct enum and add case statement
2023-02-27 13:42:51 +00:00
mike12345567 0fa984f26f Moving is audited and adding in env var for ip address/user agent auditing. 2023-02-27 11:42:52 +00:00
mike12345567 65646ba01b Further PR comments. 2023-02-27 11:00:13 +00:00
mike12345567 3e7c1d10cf Fix based on test cases. 2023-02-24 19:04:40 +00:00
mike12345567 8fb5168d56 Fix for auth logout test case. 2023-02-24 17:42:22 +00:00
mike12345567 d6b0b7610a Fixing circular dependencies which were blocking tests. 2023-02-24 17:31:58 +00:00
mike12345567 3ba76ce5cd Adding test case for PII clear out. 2023-02-24 16:51:04 +00:00
mike12345567 62501b0185 Adding a system for checking audited data in events, so that PII can be removed by posthog processor. 2023-02-24 16:45:33 +00:00
mike12345567 a293d3842f Fixing build issue. 2023-02-24 13:55:36 +00:00
mike12345567 8853776c79 Moving around processors to separate audit logs out of central event handling. 2023-02-24 13:52:54 +00:00
mike12345567 58fab29fb4 Main body of PR comments. 2023-02-24 13:32:45 +00:00
mike12345567 f070be5f65 Moving search index to an enum. 2023-02-24 13:15:14 +00:00
mike12345567 42fc004212 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-24 12:46:58 +00:00
mike12345567 0b48075688 Implementing a few basic tests to create and search the audit logs. 2023-02-23 17:23:06 +00:00
Rory Powell 4e1bebe897 Server flaky tests fixes - improving tenancy config 2023-02-23 13:43:27 +00:00
Rory Powell d3a7286711 Configs updates: remove circular deps, dedicated module, typing improvements, reduce db reads 2023-02-23 13:41:35 +00:00
mike12345567 0bc340052c Adding the ability to cleanup users from get functions (default is old behaviour). 2023-02-23 11:28:18 +00:00
Jonny McCullagh dde1237ed2 allUsers function & more metrics 2023-02-22 21:10:35 +00:00
mike12345567 01076bd35f Getting downloading working correctly, some minor UI updates, adding a new middleware for converting a query string to a body (useful for when a GET has to be used). 2023-02-22 18:50:27 +00:00
mike12345567 c6dadaa4ff Some work to make sure the user agent and ip address are always passed correctly to audit logs. 2023-02-22 16:10:54 +00:00
Rory Powell 6a88cfc32d Update locks error logging (#9768)
* Fix intermittent backend-core migration test failure

* Update lock logging
2023-02-22 08:32:03 +00:00
mike12345567 22f42ef898 Adding new mechanism to get the ipAddress and userAgent of call for audit logs. 2023-02-21 19:14:57 +00:00
mike12345567 ef30c03fa6 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-21 17:26:24 +00:00
Rory Powell 940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
mike12345567 b48acd8cf4 Some DB type updates (typing dump function) and adding in main audit log event publishers. 2023-02-21 14:56:38 +00:00
Rory Powell cacf275a99 Prevent SSO users from setting / resetting a password (#9672)
* Prevent SSO users from setting / resetting a password

* Add support for ENABLE_SSO_MAINTENANCE_MODE

* Add typing to self api and build out user update sdk

* Integrate sso checks with user sdk. Integrate user sdk with self api

* Test fixes

* Move self update into SDK

* Lock down maintenance mode to admin user

* Fix typo

* Add health status response and return type signature to accounts.getStatus

* Remove some unnecessary comments

* Make sso save user function non optional

* Remove redundant check on sso auth details provider

* Update syncProfilePicture function name to getProfilePictureUrl

* Update packages/worker/src/sdk/users/events.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Add ENABLE_EMAIL_TEST_MODE flag

* Fix for logging in as sso user when existing user has password already

* Hide password update and force reset from ui for sso users

* Always disable sso maintenance mode in cloud

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-02-21 08:23:53 +00:00
mike12345567 6cc96f39b1 Minor fixes for friendly audited events, and a new function for comparing app IDs. 2023-02-20 17:20:42 +00:00
Rory Powell a57f0c9dea Merge branch 'develop' into rory/february 2023-02-20 09:57:17 +00:00
mike12345567 70e525b928 Updating types for audit logs to correctly handle the deletion of resources like users or apps. 2023-02-17 19:00:45 +00:00
mike12345567 eca34d73ed Finishing up search API, updating typing in lucene layer. 2023-02-17 17:46:49 +00:00
mike12345567 6ec5e97ce9 Required work to support the new lucene audit logs search indexing. 2023-02-17 16:26:55 +00:00
mike12345567 2afd3e1580 Updating events to include a proper friendly map of audited events. 2023-02-15 19:44:32 +00:00
mike12345567 6d83ea9bec Adding in event auditing to server/worker. 2023-02-15 18:03:55 +00:00
Rory Powell bb1faac62a Merge master into develop 2023-02-15 15:10:02 +00:00
mike12345567 c60b6da0ab Removing pro from backend-core. 2023-02-15 13:49:30 +00:00
mike12345567 1ed4f4b8fe Update on audit logs, getting the full write flow from events configured. 2023-02-15 12:37:32 +00:00
mike12345567 46e9bf1443 Some updates to add in the audit log DB. 2023-02-13 18:16:13 +00:00
mike12345567 05ceee1cfe Moving lucene handling to backend-core so that it can be used for other databases (outside row indexes). 2023-02-13 17:13:59 +00:00