Commit Graph

888 Commits

Author SHA1 Message Date
mike12345567 b6f14a3f55 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-17 14:58:40 +01:00
adrinr 8e95121ac8 Implement find version 2023-04-17 14:07:49 +01:00
mike12345567 453d5cc0e6 Further PR comments. 2023-04-17 14:03:54 +01:00
adrinr e5227febd8 Use version from environment 2023-04-17 14:02:50 +01:00
adrinr 33c3b67f8c Merge branch 'develop' into chore/remove_old_zlib_ref 2023-04-17 11:28:43 +01:00
adrinr ac4e45a433 Replace usages 2023-04-17 10:27:37 +01:00
Mateus Badan de Pieri de968b5332 changin syntax to permission function 2023-04-17 10:04:50 +01:00
Mateus Badan de Pieri 643ca614a4 changing test to it 2023-04-16 22:27:02 +01:00
Michael Drury ef5bcc4b66 Main body of PR comments, switching event handling to be a publisher of async events, a generic event; then adding a new async document update processor, which can later be converted to be part of the event processing pipeline. 2023-04-15 00:37:22 +01:00
Mateus Badan de Pieri 5180ac29d2 final functions being tested 2023-04-14 12:16:01 +01:00
Mateus Badan de Pieri 2f98ce9772 reverting some breaking changes 2023-04-14 11:45:27 +01:00
Mateus Badan de Pieri 038476523f doesHaveBasePermission tests 2023-04-14 11:39:52 +01:00
Mateus Badan de Pieri 696eea9f92 exporting function to test 2023-04-14 11:39:36 +01:00
Mateus Badan de Pieri fa83c5d7a1 added get allowed levels (not working yet) 2023-04-14 10:29:52 +01:00
Mateus Badan de Pieri 9bf580e761 Merge branch 'develop' into permissions-test 2023-04-14 10:27:35 +01:00
Mateus Badan de Pieri 62b5e08cde primary test cases, level to number working already 2023-04-14 10:25:38 +01:00
mike12345567 23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567 a9fb09424b Merge branch 'develop' of github.com:Budibase/budibase into labday/automation-plugins 2023-04-12 14:27:50 +01:00
mike12345567 3eb718ea6d Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 13:42:46 +01:00
Mateus Badan de Pieri df38368eaf removing tests 2023-04-12 11:06:01 +01:00
mike12345567 ada052e043 Merging in develop - fixing some test cases which broke in the process. 2023-04-12 10:56:21 +01:00
Mateus Badan de Pieri f427763308 export function to make test easier 2023-04-12 02:29:30 +01:00
Mateus Badan de Pieri ef0293bc6c encryption tests 100% 2023-04-12 02:25:53 +01:00
mike12345567 1aafdbe9a7 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-11 17:28:14 +01:00
adrinr c77ed3d737 Renames 2023-04-11 13:39:13 +01:00
adrinr e1279ffecd Use proper errors instead of string throwing 2023-04-11 13:39:13 +01:00
mike12345567 c4a4bdc9da Fixing tenancy.spec.ts - mocking was a bit messed up, moving it all around to work as expected. 2023-04-11 10:54:04 +01:00
Mateus Badan de Pieri de613d2b28 latest version 2023-04-11 10:22:47 +01:00
Michael Drury 1c7c06e983 Bulk of the automation plugin system, supporting custom plugins. 2023-04-10 23:48:54 +01:00
Michael Drury 4badd04e33 Some automation fixes and adding option to disable logging for CLI. 2023-04-10 22:33:53 +01:00
mike12345567 400a112a4b Refactoring automation steps to be better defined in Typescript, which allows writing the validator for automations. 2023-04-06 18:11:44 +01:00
mike12345567 0803b08217 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-05 17:59:18 +01:00
Mateus Badan de Pieri f1b7ff0f7c fixing expect on throw 2023-04-05 16:30:00 +01:00
Mateus Badan de Pieri b0df710a2a tweaks on some tests 2023-04-05 16:13:39 +01:00
Rory Powell 77ffb8d86d Run integration suite in CI again / auto detect tenancy / refactors (#10209)
* qa-core-ci-fixes

* global setup and teardown wip

* Updates to logs and setup

* Remove date and console mocking

* Update CI to spin up minimal dev env

* Update readme

* Fix scopeBackend.sh

* Ensure docker services are initialised before starting worker

* Lint

* Fix admin user being created on startup (#10219)

* use regular bootstrap and build

* Lint

* Temp: re-use global setup to get around app limit in QA
2023-04-05 15:33:56 +01:00
Mateus Badan de Pieri 6bd950717c mocked correctly 2023-04-05 14:14:55 +01:00
Rory Powell 976b3a55ca Update logging to support dd trace attributes (#10086)
* Update logging middleware to integrate with pino for console logging

* Remove elastic apm references, use updated core middlewares

* Remove redundant LOG_LEVEL definitions

* Remove no longer needed jest logging overrides

* lint

* Backwards compat between console log helpers and pino

* Configurable DISABLE_HTTP_LOGGING

* Don't log 4xx as errors

* Remove redundant ENABLE_4XX_HTTP_LOGGING

* Cleanup migrations and event logging

* Improve bb-alert logging

* Add DISABLE_HTTP_LOGGING to helm chart

* Add ops endpoints for testing

* Disable http logging in dev

* Backwards compatible tracing implementation

* Naming update on http logging env var

* lint

* Update packages/backend-core/src/environment.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Merge

* Lint

* Fix console.warn failing mock by replacing with alerts mock instead

* Lint

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-04-04 15:08:46 +01:00
mike12345567 e128642bce Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-04 13:37:59 +01:00
Michael Drury ff98ba5a0a Adding a document update queue based on the events which can be used to track when certain documents have changed, using this for users and groups to detect when a re-sync is needed. 2023-04-04 00:25:15 +01:00
adrinr c0d7f2329a Extract valid email util 2023-04-03 16:42:30 +01:00
Adria Navarro e1669c8260 Merge pull request #10022 from Budibase/feature/scim
Feature - SCIM endpoints
2023-04-03 13:22:01 +02:00
Mateus Badan de Pieri b6fd3b7cf7 primary tests cases 2023-04-03 11:28:20 +01:00
Mateus Badan de Pieri e6ac534fca isUserInAppTenant tests working 2023-03-31 15:07:28 +01:00
Michael Drury 1c6465edcb Merge pull request #10172 from Budibase/fix/budi-6797
Googlesheets onboarding - fix in cloud, disable self host
2023-03-31 13:19:29 +01:00
mike12345567 75baba76d6 Resolving PR comments. 2023-03-31 11:38:09 +01:00
adrinr 48b964378b Remove all app cookie references (not really needed anymore) 2023-03-31 09:01:40 +01:00
mike12345567 42320b1d95 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6797 2023-03-30 17:29:58 +01:00
Mateus Badan de Pieri 6404f07cfe first tenancy tests working 2023-03-30 17:27:13 +01:00
Mateus Badan de Pieri d03b27f79f first 2 tests passing 2023-03-30 17:08:18 +01:00
mike12345567 24fc72657d Fixing all broken test cases after breaking out context fully from jestSetup/backend-core jest loading. 2023-03-30 16:35:25 +01:00
mike12345567 47897c8afa Basic moving around of assets. 2023-03-30 16:07:59 +01:00
Rory Powell 38e6d61709 Explictly check for google datasource configured (#10165)
* Explictly check for google datasource configured

* Unit tests for getGoogleDatasourceConfig

* Update /api/global/configs/public test + lint
2023-03-30 13:40:59 +01:00
mike12345567 32c78ec9bf This makes it so that Googlesheets works correctly as part of onboarding in the Cloud, in self host the googlesheets onboarding option has been hidden as it is too complex to get the user to setup the correct integrations with their google account while doing the first time onboarding to an app. 2023-03-29 19:58:24 +01:00
Michael Drury d255bfad0b Merge pull request #10149 from Budibase/fix/budicloud-log-out
Budicloud logout on googlesheet auth
2023-03-29 14:47:15 +01:00
Rory Powell d6992bbf94 Merge branch 'master' into merge-master-develop 2023-03-29 11:52:09 +01:00
mike12345567 b7fe83ad17 Adding a check to config for isDev - don't use multi-tenant google SSO default in dev. 2023-03-28 18:14:04 +01:00
adrinr 31f94f6c3c Fix tests 2023-03-28 16:46:23 +01:00
Adria Navarro e662e8febe Update packages/backend-core/src/configs/configs.ts
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-03-28 16:46:23 +01:00
adrinr f7a34dedfa Use generic types instead of overrides 2023-03-28 16:46:23 +01:00
adrinr 1a9653a4db Tests configs 2023-03-28 16:46:23 +01:00
adrinr d0772ee142 Test when scim is disabled 2023-03-28 16:46:23 +01:00
adrinr 1838f75dbc Add test 2023-03-28 16:46:23 +01:00
adrinr 54265816cc Renames 2023-03-28 16:46:23 +01:00
adrinr 8a6400c7d0 Add viaScim to group events 2023-03-28 16:46:23 +01:00
adrinr 7821c637c6 Move event one level up 2023-03-28 16:46:23 +01:00
adrinr 099cc145bf Clean code 2023-03-28 16:46:23 +01:00
adrinr 04bd9dda9c Use new scim context functions 2023-03-28 16:46:23 +01:00
adrinr 62cd6a43f2 Remove "duplicated" events 2023-03-28 16:46:23 +01:00
adrinr 648247b10e Add scim info in update/delete user events 2023-03-28 16:46:23 +01:00
adrinr 6df08799bb Add isScim to user created event 2023-03-28 16:46:23 +01:00
adrinr 31eaa36883 Unify create events 2023-03-28 16:46:23 +01:00
adrinr 924c103ccc Use ids instead of email on the events 2023-03-28 16:46:23 +01:00
adrinr 26f077cc1c Event on delete 2023-03-28 16:46:23 +01:00
adrinr cbadf69a29 Dispatch event on user update 2023-03-28 16:46:23 +01:00
adrinr e6ff0a44fb Dispatch event on scim user created 2023-03-28 16:46:23 +01:00
adrinr 771e3b8862 Bookmark optional 2023-03-28 16:46:22 +01:00
adrinr 43c25436c8 Test skip with filters 2023-03-28 16:46:22 +01:00
adrinr 348b06948b Test limits 2023-03-28 16:46:22 +01:00
adrinr 9a2eaaad42 Test deep pagination 2023-03-28 16:46:22 +01:00
adrinr 30c66748af Add skip tests 2023-03-28 16:46:22 +01:00
adrinr 47cc291551 Exclude session fields 2023-03-28 16:46:22 +01:00
adrinr f181cb02d0 Remove comment 2023-03-28 16:46:22 +01:00
adrinr 5ffa51d1f4 Rename 2023-03-28 16:46:22 +01:00
adrinr 41537cd00c Add comments 2023-03-28 16:46:22 +01:00
adrinr bf32801917 Handle skip on execution 2023-03-28 16:46:22 +01:00
adrinr a91e4b4da1 Make QueryBuilder vars private 2023-03-28 16:46:22 +01:00
adrinr 06245fee98 Make includeDocs private 2023-03-28 16:46:22 +01:00
adrinr 6c6d060550 Remove view 2023-03-28 16:46:22 +01:00
adrinr 1c828db694 Return total rows 2023-03-28 16:46:22 +01:00
adrinr c763c6fae5 Expose index 2023-03-28 16:46:22 +01:00
mike12345567 900e6c8129 Adding search index for user. 2023-03-28 16:46:22 +01:00
adrinr 621c06eada Add view 2023-03-28 16:46:22 +01:00
adrinr 2072664294 Move user search to core 2023-03-28 16:46:22 +01:00
adrinr f65ded4282 Allow bearer token for auth 2023-03-28 16:46:22 +01:00
mike12345567 cf5316ec8d General fixes for open handles, attempting to find and close all issues in server which are stopping shutdown of Jest suite. 2023-03-27 19:38:49 +01:00
Michael Drury 34e8009f08 Merge pull request #9949 from Budibase/fix/blacklist
Blacklisting
2023-03-20 10:33:11 +00:00
mike12345567 39bfbdfac1 PR comments. 2023-03-16 16:49:31 +00:00
mike12345567 c106c3291a Merge branch 'develop' of github.com:Budibase/budibase into fix/api-key-error 2023-03-16 13:39:24 +00:00
Rory Powell de89b9112a Simplify errors framework (#10042)
* Simplify errors framework

* Use enum for ErrorCode

* Lint

* Update base BudibaseError type to use enum

* For for public error on UsageLimitError

* Build fix

* Build fix
2023-03-16 08:42:02 +00:00
mike12345567 29fc91d6d1 Making it obvious that API key is invalid - error otherwise is quite cryptic. 2023-03-15 17:26:21 +00:00
mike12345567 63cf91218d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-03-14 14:12:32 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
mike12345567 bff6a51af2 Adding test case for scenario. 2023-03-13 11:48:13 +00:00
mike12345567 212b93cbe9 Fix for not contains with all or - variety of changes needed to achieve the actual expected functionality. 2023-03-13 11:48:03 +00:00
Michael Drury 5eabe9db22 Merge pull request #9779 from Budibase/jonny/api-metrics
metrics api endpoint
2023-03-10 12:12:51 +00:00
mike12345567 564c724be1 Provides the option for blacklisting IPs. 2023-03-08 16:30:26 +00:00
adrinr 84d450a931 Renames 2023-03-07 12:47:27 +01:00
adrinr 49493d80be Use name suffix instead of complex key object 2023-03-07 12:45:20 +01:00
adrinr 4d854ea5a7 Merge remote-tracking branch 'origin/develop' into bug/budi-5901-usage-quota-document-conflicts-can-cause 2023-03-07 12:41:58 +01:00
mike12345567 c51b9fb4b3 Merge branch 'develop' of github.com:Budibase/budibase into jonny/api-metrics 2023-03-06 15:23:35 +00:00
mike12345567 96208a5e8a Fixing build issue. 2023-03-03 12:05:30 +00:00
mike12345567 04ef7eeb9c Minor fixes - after removing axios altogether and adding a start script to make life easier for running from ts. 2023-03-03 10:03:33 +00:00
mike12345567 2bc0e988af Getting proper tenant ID for use by audit logs queue. 2023-03-02 13:39:26 +00:00
mike12345567 2335932978 Some updates to core types - used in pro update. 2023-03-02 10:20:49 +00:00
mike12345567 b787fafb32 Removing skip setup, tests depend on this behaviour - will update in separate PR. 2023-03-01 19:45:59 +00:00
mike12345567 5b150e7748 Removing migration change and fixing #9738 - making sure that exports with excludeRows enabled don't include attachments. 2023-03-01 19:43:40 +00:00
mike12345567 923e9d8ec4 Adding in test check. 2023-03-01 19:17:45 +00:00
mike12345567 eba18a4159 Fix for #9739 - there was an issue with the mango syntax, when working with multi attachment columns it was using an AND comparator instead of OR, it should be searching for rows that contain any attachment column, not all attachment columns. 2023-03-01 19:01:13 +00:00
Michael Drury a7d5f0fa7e Merge pull request #9844 from Budibase/fix/audit-log-muli-tenant
Audit log multi-tenancy fix
2023-03-01 17:27:55 +00:00
mike12345567 bba6f6941c Minor fix for audit log system - after the switch to use an async queue for handling of audit log storage, context was lost - in multi-tenant environments need to carry the tenant ID into the queue job so that context can be applied. 2023-03-01 16:38:19 +00:00
Rory Powell c83684ed83 Prevent showing user exists for password disabled actions 2023-03-01 14:49:44 +00:00
Rory Powell 2dfca0f67c Fix settings doc id in new installs 2023-03-01 14:32:01 +00:00
adrinr 04566dbabd Merge remote-tracking branch 'origin/develop' into bug/budi-5901-usage-quota-document-conflicts-can-cause 2023-03-01 13:31:56 +01:00
adrinr dded8beaeb Fix writethrough falling behind 2023-03-01 13:16:57 +01:00
Dean a5c6dbe4ae Merge remote-tracking branch 'origin/develop' into feature/app-user-onboarding-ux 2023-02-28 16:38:44 +00:00
adrinr b922fc3b00 Improve testing 2023-02-28 15:03:18 +01:00
adrinr c1462a7c9c Clean code 2023-02-28 14:54:43 +01:00
adrinr c254c565e4 Use redlock for writethrough 2023-02-28 14:54:34 +01:00
adrinr 66217d6b08 Return redlock execution info 2023-02-28 12:52:43 +01:00
adrinr 24161d12bf Type locks 2023-02-28 12:47:28 +01:00
Rory Powell ab69bbc299 lint 2023-02-28 11:03:56 +00:00
Rory Powell 312c01a879 Prefer default config for google sheets in cloud, don't use env vars for regular auth 2023-02-28 10:36:29 +00:00
Dean dd08845a44 Merge remote-tracking branch 'origin/develop' into feature/app-user-onboarding-ux 2023-02-28 09:38:15 +00:00
Dean 61ed62e6c4 Builder user onboarding 2023-02-28 09:37:03 +00:00
mike12345567 b47101e1fb Updating lucene test case to improve coverage. 2023-02-27 21:48:05 +00:00
mike12345567 c3a3fa1176 Adding a lucene test case. 2023-02-27 21:18:06 +00:00
mike12345567 2fb33e2cf3 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-27 14:51:33 +00:00
mike12345567 fefc6d920f Fixing open handle issue - now that the worker has access to queues needs to shut them down. 2023-02-27 14:41:28 +00:00
Rory Powell 2c46109e7d Enforceable SSO (#9787)
* Add ENFORCEABLE_SSO feature flag

* First draft of enforce sso configuration / show single sign on url

* Reading and writing isSSOEnforced + integration with login page

* Enable CI + lint

* Set correct base branch for CI

* Test fix for expected string changed

* Use tenant aware platform url as SSO link

* Bring in latest pro changes

* Lint

* Add useEnforceableSSO mock helper function

* Update configs.spec.ts with coverage for public settings

* Update users.spec.ts with additional tests for isPreventPasswordActions

* Lint

* Update refresh OAuthToken to use correct enum and add case statement
2023-02-27 13:42:51 +00:00
mike12345567 0fa984f26f Moving is audited and adding in env var for ip address/user agent auditing. 2023-02-27 11:42:52 +00:00
mike12345567 65646ba01b Further PR comments. 2023-02-27 11:00:13 +00:00
mike12345567 3e7c1d10cf Fix based on test cases. 2023-02-24 19:04:40 +00:00
mike12345567 8fb5168d56 Fix for auth logout test case. 2023-02-24 17:42:22 +00:00
mike12345567 d6b0b7610a Fixing circular dependencies which were blocking tests. 2023-02-24 17:31:58 +00:00
mike12345567 3ba76ce5cd Adding test case for PII clear out. 2023-02-24 16:51:04 +00:00
mike12345567 62501b0185 Adding a system for checking audited data in events, so that PII can be removed by posthog processor. 2023-02-24 16:45:33 +00:00
mike12345567 a293d3842f Fixing build issue. 2023-02-24 13:55:36 +00:00
mike12345567 8853776c79 Moving around processors to separate audit logs out of central event handling. 2023-02-24 13:52:54 +00:00
mike12345567 58fab29fb4 Main body of PR comments. 2023-02-24 13:32:45 +00:00
mike12345567 f070be5f65 Moving search index to an enum. 2023-02-24 13:15:14 +00:00