Commit Graph

4032 Commits

Author SHA1 Message Date
Rory Powell de89b9112a Simplify errors framework (#10042)
* Simplify errors framework

* Use enum for ErrorCode

* Lint

* Update base BudibaseError type to use enum

* For for public error on UsageLimitError

* Build fix

* Build fix
2023-03-16 08:42:02 +00:00
mike12345567 6174b6ae18 Squashing #10024 for master merge. 2023-03-15 14:16:45 +00:00
Dean c7e54947a8 Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 10:28:08 +00:00
Dean f3b58923cf Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 09:13:36 +00:00
mike12345567 79f2e9d970 Fixing build issue. 2023-03-14 17:04:25 +00:00
mike12345567 859ec85fe9 Fix for schema endpoint, needed secrets removed as well. 2023-03-14 16:13:28 +00:00
mike12345567 f2484eafec Fix for spaces in table names (external). 2023-03-14 16:13:14 +00:00
Peter Clement cc4a911505 Merge pull request #9984 from Budibase/fix/automation-saving-fix
Fix issue with saving of automation fields
2023-03-14 14:39:24 +00:00
mike12345567 c2de0ade7d Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6723 2023-03-14 14:25:46 +00:00
mike12345567 63cf91218d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-03-14 14:12:32 +00:00
mike12345567 da9e1bed64 Fix for googlesheets issue - when table initially created doesn't have the correct schema, adding a function to handle static schemas like Gsheets. 2023-03-14 12:11:01 +00:00
melohagan 878bc65eb2 Add missing readable flag (#10016) 2023-03-14 10:06:01 +00:00
mike12345567 3d84409a58 Making sure created flag gets carried across for external tables. 2023-03-13 18:18:04 +00:00
mike12345567 65ada7f8b2 Adding back a base column for sheet creation. 2023-03-13 18:10:35 +00:00
mike12345567 2a1f215351 Removing relationship option from Googlesheets as it doesn't add value, as well as multi-select as it can't really be supported. Also fixing issues with re-fetching after adding some special column types./ 2023-03-13 18:04:29 +00:00
mike12345567 d3464ce166 Adding mechanism for bulk creation of rows in gsheets, used for CSV imports. 2023-03-13 17:21:04 +00:00
mike12345567 6b8d0ca9dd Adding mechanism for verifying the Budibase properties, such as required and min/max as part of the external API. 2023-03-13 16:21:22 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
Dean 5ce52cad06 Working commit 2023-03-13 12:33:16 +00:00
mike12345567 9037ab86d5 Adding an error for XLSX type sheets not working, adding the sheets URL as an option for google config (should be added to redirect URL) and fixing some error states. 2023-03-10 18:46:48 +00:00
Michael Drury c553f053fe Merge pull request #9965 from Budibase/budi-6667-change-oracle-db-name-to-service-name
Change Database to Service Name in Oracle config
2023-03-10 16:38:06 +00:00
mike12345567 ddaafe6379 Merge branch 'master' of github.com:Budibase/budibase into fix/9886 2023-03-10 14:49:41 +00:00
Peter Clement bd7c91b1bd Fix automation saving issue 2023-03-10 14:47:26 +00:00
Michael Drury 5eabe9db22 Merge pull request #9779 from Budibase/jonny/api-metrics
metrics api endpoint
2023-03-10 12:12:51 +00:00
Rory Powell c33ea4dcfe Update deployment templates to remove unused cdn url and fix empty env vars (#9967) 2023-03-09 16:13:26 +00:00
Mel O'Hagan ad7bda17bb Change database to Service Name in oracle 2023-03-09 15:52:16 +00:00
Adria Navarro 63afd34eb2 Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 12:25:12 +00:00
Adria Navarro 158703daef Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 08:50:26 +00:00
mike12345567 564c724be1 Provides the option for blacklisting IPs. 2023-03-08 16:30:26 +00:00
melohagan a8f873fff3 Try/catch automation Create Row relationship (#9924)
* Try/catch

* Increase height of automation test output

* Unit tests

* lint
2023-03-08 13:39:18 +00:00
Peter Clement 1abab9421e Merge pull request #9915 from Budibase/fix/9441-group-roles
fix roleId being undefined leading to group role overriding incorrectly
2023-03-07 16:01:53 +00:00
mike12345567 0342d409c3 Fix for #9790 - formulas never exist in the database and so were always being considered deleted, handling this. 2023-03-07 15:29:58 +00:00
Peter Clement 1cb03c7603 fix roleId being undefined leading to groups override 2023-03-07 13:30:24 +00:00
mike12345567 0026f86cc6 Fixing operation ID. 2023-03-06 17:41:24 +00:00
mike12345567 36683459b8 Updating metrics endpoint to have examples of expected data format - show OpenMetrics response. 2023-03-06 15:55:55 +00:00
mike12345567 13ae950101 Updating test case. 2023-03-06 15:31:27 +00:00
mike12345567 c51b9fb4b3 Merge branch 'develop' of github.com:Budibase/budibase into jonny/api-metrics 2023-03-06 15:23:35 +00:00
Jonny McCullagh cbc377b0f4 unit tests 2023-03-06 11:51:49 +00:00
Martin McKeaveney 26660b12fb PR comments 2023-03-06 10:33:49 +00:00
Martin McKeaveney edac525424 remove import 2023-03-06 10:24:45 +00:00
Martin McKeaveney e8c73cdee0 return gsheets config in test regardless 2023-03-06 10:22:32 +00:00
mike12345567 5b150e7748 Removing migration change and fixing #9738 - making sure that exports with excludeRows enabled don't include attachments. 2023-03-01 19:43:40 +00:00
mike12345567 eba18a4159 Fix for #9739 - there was an issue with the mango syntax, when working with multi attachment columns it was using an AND comparator instead of OR, it should be searching for rows that contain any attachment column, not all attachment columns. 2023-03-01 19:01:13 +00:00
Michael Drury 4abb2801f0 Merge pull request #9828 from Budibase/fix/9778
Fix for operationId in OpenAPI specs
2023-03-01 13:09:16 +00:00
mike12345567 cb39053b12 Fix for #9778 - there was an issue with operationId in the OpenAPI spec, these need to be unique to be compliant with the spec as brought up in the issue. Also re-writing the spec generation to Typescript to be compliant with how backend code is now written. 2023-02-28 18:10:56 +00:00
Michael Drury fcb9f3e116 Merge pull request #9815 from Budibase/bug/budi-6076-cannot-delete-columns-in-google-sheet
Bug - budi-6076 cannot delete columns in google sheet
2023-02-28 13:56:32 +00:00
Rory Powell 312c01a879 Prefer default config for google sheets in cloud, don't use env vars for regular auth 2023-02-28 10:36:29 +00:00
adrinr b05d568518 Merge remote-tracking branch 'origin/develop' into bug/budi-6076-cannot-delete-columns-in-google-sheet 2023-02-27 17:45:37 +01:00
adrinr f017f0d54e Catch issue on test 2023-02-27 17:41:42 +01:00
adrinr f85ea527bd Add tests for adding/removing columns in a google spreadsheet 2023-02-27 17:25:48 +01:00
adrinr abe06a127a Types 2023-02-27 17:25:26 +01:00
mike12345567 2fb33e2cf3 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-27 14:51:33 +00:00
Rory Powell 2e829ce8a6 Merge pull request #9785 from Budibase/configs-refactor-and-server-test-fixes
Configs /  Server tests / Failing real email tests updates
2023-02-27 14:00:21 +00:00
adrinr 30fde61d4d Handle deletes 2023-02-27 13:33:19 +01:00
mike12345567 65646ba01b Further PR comments. 2023-02-27 11:00:13 +00:00
mike12345567 8853776c79 Moving around processors to separate audit logs out of central event handling. 2023-02-24 13:52:54 +00:00
mike12345567 58fab29fb4 Main body of PR comments. 2023-02-24 13:32:45 +00:00
mike12345567 f070be5f65 Moving search index to an enum. 2023-02-24 13:15:14 +00:00
mike12345567 42fc004212 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-24 12:46:58 +00:00
adrinr d5fd635d6c Remove @ts-ignore 2023-02-24 11:26:05 +01:00
adrinr 045822d65e Dry 2023-02-24 11:24:29 +01:00
adrinr 2fc97189e5 Merge remote-tracking branch 'origin/develop' into bug/budi-6619/cannot_update_relationships_in_postgresql_many_to_one 2023-02-24 11:12:07 +01:00
adrinr d6363f07b3 Renamings 2023-02-24 10:51:55 +01:00
adrinr 2e45f94d79 Improve verbosity 2023-02-24 10:47:32 +01:00
Andrew Kingston 8cd7ba1fdf Undo/Redo for Design and Automate sections + automations refactor (#9714)
* Add full undo/redo support for screens

* Add loading states to disable spamming undo/redo

* Add keyboard shortcuts for undo and redo

* Fix modals not closing in design section when escape is pressed

* Remove log

* Add smart metadata saving to undo/redo

* Add error handling to undo/redo

* Add active state to hoverable icons

* Fix screen deletion

* Always attempt to get latest doc version before deleting in case rev has changed

* Move undo listener top level, hide controls when on certain tabs, and improve selection state

* Add tooltips to undo/redo control

* Update automation section nav to match other sections

* Fix automation list padding

* Fix some styles in create automation modal

* Improve automation section styles and add undo/redo

* Update styles in add action modal

* Fix button size when creating admin user

* Fix styles in add automation step modal

* Fix issue selecting disabled automation steps

* Reset automation history store when changing app

* Reduce spammy unnecessary API calls when editing cron trigger

* WIP automation refactor

* Rewrite most automation state

* Rewrite most of the rest of automation state

* Finish refactor of automation state

* Fix selection state when selecting new doc after history recreates it

* Prune nullish or empty block inputs from automations and avoid sending API requests when no changes have been made

* Fix animation issues with automations

* Sort automations and refetch list when adding or deleting

* Fix formatting

* Add back in ability to swap between values and bindings for block inputs

* Lint

* Format

* Fix potential issue in design section when selected screen is unset

* Fix automation arrow directions everywhere, tidy up logic and fix crash when using invalid looping

* Lint

* Fix more cases of automation errors

* Fix implicity any TS error

* Respect _id specified when creating automations

* Fix crash in history store when reverting a change on a doc whose ID has changed

* Lint

* Ensure cloneDeep helper doesn't crash when a nullish value is passed in

* Remove deprecated frontend automation test

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-02-23 13:55:18 +00:00
Rory Powell 4e1bebe897 Server flaky tests fixes - improving tenancy config 2023-02-23 13:43:27 +00:00
Rory Powell d3a7286711 Configs updates: remove circular deps, dedicated module, typing improvements, reduce db reads 2023-02-23 13:41:35 +00:00
adrinr 5207f51080 Test enrich for all relationship types 2023-02-23 10:50:18 +01:00
adrinr 7868fc657d Fix many-to-one tests 2023-02-23 10:39:16 +01:00
adrinr 9e0d003038 Fix creation 2023-02-23 10:28:24 +01:00
adrinr 70689c0369 Fix tests 2023-02-23 00:06:57 +01:00
adrinr 83649f1959 Setup o2m and m2m relationships 2023-02-22 22:40:50 +01:00
Jonny McCullagh dde1237ed2 allUsers function & more metrics 2023-02-22 21:10:35 +00:00
adrinr f00994af7f Fix wrong relationship mapping 2023-02-22 17:18:05 +01:00
adrinr 8c906c1681 Merge remote-tracking branch 'origin/develop' into bug/budi-6619/cannot_update_relationships_in_postgresql_many_to_one 2023-02-22 15:00:41 +01:00
adrinr 63af59a5b0 Handle link fields 2023-02-22 14:59:42 +01:00
Rory Powell 4b85583f5f Update builder and authorized middleware to be more strict towards unauthenticated (#9774)
* Update builder and authorized middleware to be more strict towards unauthenticated

* Remove unnecessary variable
2023-02-22 13:39:31 +00:00
adrinr e350f6b166 Undo literal changes 2023-02-22 11:02:32 +00:00
adrinr b9c54b6fe6 Update many to many 2023-02-22 10:54:55 +00:00
mike12345567 22f42ef898 Adding new mechanism to get the ipAddress and userAgent of call for audit logs. 2023-02-21 19:14:57 +00:00
mike12345567 ef30c03fa6 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-21 17:26:24 +00:00
mike12345567 41eb0c3964 Updating worker db config to have replication available (for audit logs). 2023-02-21 17:22:23 +00:00
Rory Powell 940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
mike12345567 f7f9e63fe8 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-21 16:53:28 +00:00
adrinr e0242d0883 Fix the many to one updates 2023-02-21 16:29:18 +00:00
adrinr be81767a46 Replace maps for foreach 2023-02-21 15:57:56 +00:00
adrinr e0b3976ee4 Add return select statement back on update 2023-02-21 15:57:04 +00:00
adrinr 1ada790d50 Fix postgres update for relationships 2023-02-21 15:21:00 +00:00
adrinr ea8e779d10 Merge remote-tracking branch 'origin/develop' into test/fix_foreigndata_pg_test 2023-02-21 11:37:16 +00:00
adrinr 483f15a5d6 Add explicit check for the foreign field 2023-02-21 09:51:07 +00:00
adrinr 3c5d5f4c25 Fix relation get test to test expected behaviour 2023-02-21 09:42:56 +00:00
Rory Powell cacf275a99 Prevent SSO users from setting / resetting a password (#9672)
* Prevent SSO users from setting / resetting a password

* Add support for ENABLE_SSO_MAINTENANCE_MODE

* Add typing to self api and build out user update sdk

* Integrate sso checks with user sdk. Integrate user sdk with self api

* Test fixes

* Move self update into SDK

* Lock down maintenance mode to admin user

* Fix typo

* Add health status response and return type signature to accounts.getStatus

* Remove some unnecessary comments

* Make sso save user function non optional

* Remove redundant check on sso auth details provider

* Update syncProfilePicture function name to getProfilePictureUrl

* Update packages/worker/src/sdk/users/events.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Add ENABLE_EMAIL_TEST_MODE flag

* Fix for logging in as sso user when existing user has password already

* Hide password update and force reset from ui for sso users

* Always disable sso maintenance mode in cloud

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-02-21 08:23:53 +00:00
Jonny McCullagh a908125ea3 add metrics endpoint to api 2023-02-20 19:56:04 +00:00
mike12345567 1eb2307fed Fix for #9749 - static formulas would sometimes attempt to update the same row multiple times, filter down to just the unique row list which requires updating. 2023-02-20 15:35:14 +00:00
mike12345567 b60013cbb8 switching metadataSearch to fullSearch. 2023-02-20 11:29:43 +00:00
Rory Powell a57f0c9dea Merge branch 'develop' into rory/february 2023-02-20 09:57:17 +00:00
mike12345567 6ec5e97ce9 Required work to support the new lucene audit logs search indexing. 2023-02-17 16:26:55 +00:00
melohagan 8fe0cdf89f Handle webhook errors (#9715) 2023-02-16 16:23:44 +00:00
mike12345567 6d83ea9bec Adding in event auditing to server/worker. 2023-02-15 18:03:55 +00:00
Jonny McCullagh c5bc0d4ffb add datadog apm (#9693)
* add datadog apm

* datadog init not start

* extra env vars for DD APM

* add datadog apm

* datadog init not start

* extra env vars for DD APM

* add datadog apm

* remove space

* Enable typescript integration with apm agents

* Fix typo

---------

Co-authored-by: Jonny <Jonny McCullagh>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-02-15 16:28:20 +00:00