Commit Graph

4110 Commits

Author SHA1 Message Date
Michael Drury 58d0a82108 First sync test, checking that a user is created correctly. 2023-04-05 22:35:01 +01:00
Michael Drury 0771ec55fb Small change to make sure no duplicates ever occur. 2023-04-05 21:22:50 +01:00
Michael Drury 70c9d06832 Adding group management to background user/group sync. 2023-04-05 20:51:47 +01:00
mike12345567 0803b08217 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-05 17:59:18 +01:00
Rory Powell 77ffb8d86d Run integration suite in CI again / auto detect tenancy / refactors (#10209)
* qa-core-ci-fixes

* global setup and teardown wip

* Updates to logs and setup

* Remove date and console mocking

* Update CI to spin up minimal dev env

* Update readme

* Fix scopeBackend.sh

* Ensure docker services are initialised before starting worker

* Lint

* Fix admin user being created on startup (#10219)

* use regular bootstrap and build

* Lint

* Temp: re-use global setup to get around app limit in QA
2023-04-05 15:33:56 +01:00
adrinr 38535e8ef4 Format 2023-04-05 12:17:32 +01:00
adrinr ae9f91885f Fix flaky tests 2023-04-05 12:17:02 +01:00
mike12345567 e699f4684a Updating the global user sync to be more accurate and also remove old user metadata from apps that users don't have access to anymore. 2023-04-04 18:03:56 +01:00
Rory Powell 976b3a55ca Update logging to support dd trace attributes (#10086)
* Update logging middleware to integrate with pino for console logging

* Remove elastic apm references, use updated core middlewares

* Remove redundant LOG_LEVEL definitions

* Remove no longer needed jest logging overrides

* lint

* Backwards compat between console log helpers and pino

* Configurable DISABLE_HTTP_LOGGING

* Don't log 4xx as errors

* Remove redundant ENABLE_4XX_HTTP_LOGGING

* Cleanup migrations and event logging

* Improve bb-alert logging

* Add DISABLE_HTTP_LOGGING to helm chart

* Add ops endpoints for testing

* Disable http logging in dev

* Backwards compatible tracing implementation

* Naming update on http logging env var

* lint

* Update packages/backend-core/src/environment.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Merge

* Lint

* Fix console.warn failing mock by replacing with alerts mock instead

* Lint

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-04-04 15:08:46 +01:00
Michael Drury ff98ba5a0a Adding a document update queue based on the events which can be used to track when certain documents have changed, using this for users and groups to detect when a re-sync is needed. 2023-04-04 00:25:15 +01:00
mike12345567 29def1408a Fixing syntax error and linting. 2023-04-03 15:36:34 +01:00
Michael Drury 2f57b3b16d Merge pull request #10077 from robert4dt/develop
Handle application/pdf content type in rest integration
2023-04-03 15:30:03 +01:00
Peter Clement f2eced6ea4 Merge pull request #10180 from Budibase/fix/no-iterations-loop
Add new status to handle no iterations during loop
2023-04-03 12:00:15 +01:00
Michael Drury d3e749d2de Fix for 409 conflict which occurs in one of the user test cases - should stop it occurring in future. 2023-03-31 23:32:33 +01:00
Michael Drury 09a48a1d21 Merge branch 'develop' of github.com:Budibase/budibase into fix/no-iterations-loop 2023-03-31 23:29:21 +01:00
mike12345567 2e80bab7ad Removing requirement for built client library in component test case. 2023-03-31 17:13:25 +01:00
mike12345567 906d614c64 Merge branch 'merge-master-develop' of github.com:Budibase/budibase into merge-master-develop 2023-03-31 13:51:20 +01:00
Adria Navarro 7d794f005e Merge pull request #10162 from Budibase/bug/budi-6782-internal-table-all-row-ids-for
Bug - BUDI-6782 - Internal table all row ids for
2023-03-31 14:21:15 +02:00
Michael Drury 1c6465edcb Merge pull request #10172 from Budibase/fix/budi-6797
Googlesheets onboarding - fix in cloud, disable self host
2023-03-31 13:19:29 +01:00
Rory Powell e9322be28f Merge branch 'develop' into merge-master-develop 2023-03-31 12:39:22 +01:00
Rory Powell 44aa19a99a Merge branch 'master' into merge-master-develop 2023-03-31 12:26:04 +01:00
Peter Clement 0a567a3302 add new status to handle no iterations during loop 2023-03-31 12:23:10 +01:00
Adria Navarro cfb93063b2 Merge pull request #10153 from Budibase/budi-6803-delete-users-when-group-removed
BUDI-6803 - Remove users that should not be there anymore when syncGlobalUsers
2023-03-31 13:15:11 +02:00
Andrew Kingston b2d2cf3989 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-03-31 12:08:58 +01:00
adrinr 4ca6982d27 Prevent double deletions 2023-03-31 11:25:51 +01:00
Rory Powell 79bec7d86d Add force exit, -e flag and streaming to tests (#10151)
* Add force exit, -e flag and streaming to tests

* Temp remove script usage from worker tests

* Revert "Temp remove script usage from worker tests"

This reverts commit 5e0ed2e92d.

* Always fail test

* Ignore server test package from coverage report

* Unscope server only

* Run all server tests again

* Update backend core test script to fail when any command fails and force exit

* Don't try to require client in test

* Port memory limit fix from develop

* Remove always failing test and commented out block for client require

* Fixing some issues with test cases.

* Revert assertions in internalSearch.spec.js

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-31 10:32:13 +01:00
adrinr 6a257bf9c3 Tweak tests 2023-03-31 09:01:40 +01:00
adrinr 48b964378b Remove all app cookie references (not really needed anymore) 2023-03-31 09:01:40 +01:00
mike12345567 42320b1d95 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6797 2023-03-30 17:29:58 +01:00
mike12345567 b19df9da22 Some final updates to get event spyOn working again. 2023-03-30 17:15:49 +01:00
adrinr 8e8f4ac02d Add extra assertion 2023-03-30 15:16:45 +01:00
adrinr 2dd8b078e5 Test removing users from group 2023-03-30 15:14:16 +01:00
adrinr b8fe9671b1 Rename test 2023-03-30 15:12:40 +01:00
Dean 3cba6109f6 First for meta card title override behaviour 2023-03-30 13:08:40 +01:00
Martin McKeaveney 586a31e4b9 Merge pull request #10141 from Budibase/fix/sample-data-auto-ids
fix auto columns in sample data
2023-03-30 12:25:54 +01:00
adrinr 8d45e44e2f Fix types 2023-03-30 11:30:35 +01:00
adrinr eb0d445295 Add test for autoid when importing 2023-03-30 10:37:38 +01:00
adrinr 6c610a3181 Types (with forced checks!) 2023-03-30 10:21:50 +01:00
adrinr 420cfd0f96 Fix autoids when importing internal data 2023-03-30 10:12:50 +01:00
mike12345567 32c78ec9bf This makes it so that Googlesheets works correctly as part of onboarding in the Cloud, in self host the googlesheets onboarding option has been hidden as it is too complex to get the user to setup the correct integrations with their google account while doing the first time onboarding to an app. 2023-03-29 19:58:24 +01:00
adrinr 301ad598ad Test user group deletion 2023-03-29 17:05:32 +01:00
adrinr efff31e181 Test user groups 2023-03-29 17:02:56 +01:00
adrinr 4cb6b99982 Types 2023-03-29 16:42:55 +01:00
adrinr 8783f0123d Add tests for admins vs app users 2023-03-29 16:42:31 +01:00
adrinr b368c14308 Add unit tests to test new users 2023-03-29 16:18:32 +01:00
adrinr e25429632b Remove users that should not be there anymore when syncGlobalUsers 2023-03-29 15:35:55 +01:00
mike12345567 7a18d19aa6 Merge branch 'master' of github.com:Budibase/budibase into merge-master-develop 2023-03-29 12:41:06 +01:00
mike12345567 e5ba70e7b4 Removing validation endpoint for external tables, always valid. 2023-03-29 12:16:14 +01:00
mike12345567 e10943e6f8 Removing external table validation - will have to come up with a best way to do this and a test suite for it. 2023-03-29 12:13:23 +01:00
mike12345567 25fd16f753 Revert "Revert "Merge pull request #10038 from Budibase/fix/budi-6723" (#10143)"
This reverts commit 89d19a87a7.
2023-03-29 12:12:38 +01:00
Rory Powell d6992bbf94 Merge branch 'master' into merge-master-develop 2023-03-29 11:52:09 +01:00
Rory Powell 89d19a87a7 Revert "Merge pull request #10038 from Budibase/fix/budi-6723" (#10143)
This reverts commit b1b18bef18, reversing
changes made to e841ccd0ed.
2023-03-29 08:48:06 +01:00
Andrew Kingston e0e5ca7a3c Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-03-28 15:47:53 +01:00
Martin McKeaveney fa30769ddb fix auto columns in sample data 2023-03-28 14:58:22 +01:00
melohagan 9e8ab55e18 Lowercase values for Oracle LIKE (#10134) 2023-03-28 11:46:29 +01:00
Dean 8557c307dd Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-28 11:19:08 +01:00
Rory Powell cd3b2ba199 Lint 2023-03-27 22:39:35 +01:00
Rory Powell 60650b031b Move branding read behind pro 2023-03-27 22:28:25 +01:00
mike12345567 2e0e5a0aa8 Merge branch 'fix/budi-6657' of github.com:Budibase/budibase into fix/budi-6657 2023-03-27 19:39:08 +01:00
mike12345567 cf5316ec8d General fixes for open handles, attempting to find and close all issues in server which are stopping shutdown of Jest suite. 2023-03-27 19:38:49 +01:00
Michael Drury 669c4ebd5c Fix for currentapp build issue. 2023-03-22 17:46:37 +00:00
mike12345567 926ee18703 Updating Jest to latest 29.5.0 and then fixing snapshots to work with this - also setting worker memory limits for Node 16.10+ - where a leak can occur. 2023-03-21 19:52:06 +00:00
mike12345567 82286d519f Fixing some issues with test cases. 2023-03-21 17:27:31 +00:00
mike12345567 1c73b92595 Fix for app sync, base it on group roles, not just user roles - stops app sync from pulling in group users which do not actually have access to the app. 2023-03-21 13:55:28 +00:00
Dean bfd7e49c72 Template fixes and updates to the file picker. Error handling added to display a warning when navigating to an unpublished or invalid app url. 2023-03-21 09:20:43 +00:00
Michael Drury 34e8009f08 Merge pull request #9949 from Budibase/fix/blacklist
Blacklisting
2023-03-20 10:33:11 +00:00
T4DT GmbH 9a4ab17c53 Update rest.ts 2023-03-20 11:31:45 +01:00
Dean ce33afdeae Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-16 09:07:58 +00:00
Dean 253ee413a2 Working commit 2023-03-16 09:07:21 +00:00
Rory Powell de89b9112a Simplify errors framework (#10042)
* Simplify errors framework

* Use enum for ErrorCode

* Lint

* Update base BudibaseError type to use enum

* For for public error on UsageLimitError

* Build fix

* Build fix
2023-03-16 08:42:02 +00:00
mike12345567 6174b6ae18 Squashing #10024 for master merge. 2023-03-15 14:16:45 +00:00
Dean c7e54947a8 Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 10:28:08 +00:00
Dean f3b58923cf Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 09:13:36 +00:00
mike12345567 79f2e9d970 Fixing build issue. 2023-03-14 17:04:25 +00:00
mike12345567 859ec85fe9 Fix for schema endpoint, needed secrets removed as well. 2023-03-14 16:13:28 +00:00
mike12345567 f2484eafec Fix for spaces in table names (external). 2023-03-14 16:13:14 +00:00
Peter Clement cc4a911505 Merge pull request #9984 from Budibase/fix/automation-saving-fix
Fix issue with saving of automation fields
2023-03-14 14:39:24 +00:00
mike12345567 c2de0ade7d Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6723 2023-03-14 14:25:46 +00:00
mike12345567 63cf91218d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-03-14 14:12:32 +00:00
mike12345567 da9e1bed64 Fix for googlesheets issue - when table initially created doesn't have the correct schema, adding a function to handle static schemas like Gsheets. 2023-03-14 12:11:01 +00:00
melohagan 878bc65eb2 Add missing readable flag (#10016) 2023-03-14 10:06:01 +00:00
mike12345567 3d84409a58 Making sure created flag gets carried across for external tables. 2023-03-13 18:18:04 +00:00
mike12345567 65ada7f8b2 Adding back a base column for sheet creation. 2023-03-13 18:10:35 +00:00
mike12345567 2a1f215351 Removing relationship option from Googlesheets as it doesn't add value, as well as multi-select as it can't really be supported. Also fixing issues with re-fetching after adding some special column types./ 2023-03-13 18:04:29 +00:00
mike12345567 d3464ce166 Adding mechanism for bulk creation of rows in gsheets, used for CSV imports. 2023-03-13 17:21:04 +00:00
mike12345567 6b8d0ca9dd Adding mechanism for verifying the Budibase properties, such as required and min/max as part of the external API. 2023-03-13 16:21:22 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
Dean 5ce52cad06 Working commit 2023-03-13 12:33:16 +00:00
Andrew Kingston 909118d398 Merge branch 'develop' of github.com:Budibase/budibase into just-dataspace-things 2023-03-13 11:30:18 +00:00
mike12345567 9037ab86d5 Adding an error for XLSX type sheets not working, adding the sheets URL as an option for google config (should be added to redirect URL) and fixing some error states. 2023-03-10 18:46:48 +00:00
Michael Drury c553f053fe Merge pull request #9965 from Budibase/budi-6667-change-oracle-db-name-to-service-name
Change Database to Service Name in Oracle config
2023-03-10 16:38:06 +00:00
mike12345567 ddaafe6379 Merge branch 'master' of github.com:Budibase/budibase into fix/9886 2023-03-10 14:49:41 +00:00
Peter Clement bd7c91b1bd Fix automation saving issue 2023-03-10 14:47:26 +00:00
Michael Drury 5eabe9db22 Merge pull request #9779 from Budibase/jonny/api-metrics
metrics api endpoint
2023-03-10 12:12:51 +00:00
Andrew Kingston c4e3667b6c Merge branch 'develop' of github.com:Budibase/budibase into just-dataspace-things 2023-03-09 17:54:58 +00:00
Rory Powell c33ea4dcfe Update deployment templates to remove unused cdn url and fix empty env vars (#9967) 2023-03-09 16:13:26 +00:00
Mel O'Hagan ad7bda17bb Change database to Service Name in oracle 2023-03-09 15:52:16 +00:00
Adria Navarro 63afd34eb2 Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 12:25:12 +00:00
Adria Navarro 158703daef Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 08:50:26 +00:00
mike12345567 564c724be1 Provides the option for blacklisting IPs. 2023-03-08 16:30:26 +00:00