Commit Graph

4032 Commits

Author SHA1 Message Date
mike12345567 49da99c8ac Adding context update to test case since it used to rely on the context update functionality. 2023-01-30 10:59:54 +00:00
mike12345567 ec719b251c Adding test case for secret-value replacement, to confirm that datasources API correctly replaces secret values with the actual secret. 2023-01-27 18:27:03 +00:00
mike12345567 fec16e23a0 Fixes for tests, allow any handlebars for datasources (dynamic vars). 2023-01-27 18:06:39 +00:00
Dean 4745b6d2bd Expanding mime check for cloud tarball import 2023-01-27 18:01:12 +00:00
mike12345567 3a40a64d15 Updating datasources to use new onlyFound option. 2023-01-27 15:21:04 +00:00
mike12345567 d667276fa1 Adding a onlyFound option to our handlebars system so that we can enrich only the parts we have and leave other components for further enrichment. 2023-01-27 15:15:07 +00:00
mike12345567 6e3f87c798 Fixing issue with apps not being created correctly due to the recent update to context. 2023-01-27 13:37:36 +00:00
Rory Powell da2c809a09 Merge branch 'develop' into feature/environment-variables 2023-01-27 11:27:11 +00:00
adrinr cae83684ea Remove wrong createApp 2023-01-26 18:24:20 +00:00
adrinr 7027abeaa2 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
mike12345567 b38399cb74 Adding test cases as per PR comments. 2023-01-26 18:20:21 +00:00
mike12345567 27b472b662 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-26 18:20:21 +00:00
Adria Navarro Redo b94546b1a1 Fix user test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 33f1628000 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 8c1e539fc7 Fix date related tests 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 6a4fe1d5e6 Fix automation test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 9242470f6f Fix snapshots test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo a54c1a1647 Set expected id 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 8c68741f98 Fix application delete tests 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 067462f458 Use multitenancy for tests 2023-01-26 18:20:21 +00:00
adrinr 74269dbb27 Fix timespan issues 2023-01-26 18:20:05 +00:00
mike12345567 697cd8b4ea Adding test cases as per PR comments. 2023-01-25 18:27:58 +00:00
Adria Navarro 8f186041ac Don't create the apps on test 2023-01-25 10:13:35 +00:00
mike12345567 fe7b632727 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-24 19:09:36 +00:00
mike12345567 6349b08888 Don't check whether or not a datasource uses env vars when the function specifically includes the env vars, always fetch them so that they can be returned and put into context for queries to use. 2023-01-24 18:56:19 +00:00
Adria Navarro 6259ffad3b Wipe db before tests 2023-01-24 18:51:15 +00:00
Adria Navarro 9371f19419 Remove mocks 2023-01-24 17:48:49 +00:00
Adria Navarro 26fa3bd484 tweak tests 2023-01-24 15:46:50 +00:00
Peter Clement 22e1c1cccf ensure object is passed to processObjectSync 2023-01-24 15:44:34 +00:00
Adria Navarro 4df4494d00 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:43:36 +00:00
Adria Navarro 17f6c505e0 Merge branch 'develop' into feature/test-image
# Conflicts:
#	packages/worker/yarn.lock
2023-01-23 18:40:44 +00:00
Adria Navarro 6806404465 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:08:19 +00:00
Adria Navarro d1d8ce3611 Move more stuff to .env.test 2023-01-23 18:02:28 +00:00
Adria Navarro d6f0e5b1ec Dry, moving env variables to a .env.test file 2023-01-23 17:41:32 +00:00
Adria Navarro 98aa60879f Set parameters 2023-01-23 16:53:34 +00:00
melohagan 0daacf3425 Add fields for MongoDB SSL cert file paths (#8260)
* Added fields for tls certificate files

* lint

* Only include cert fields if SELF_HOSTED

* lint

* Refactor getSchema function

* Add datasource field group with accordion

* Handle no display column on fieldGroup field

* Override text transform accordian header

* Renamed from TLS to SSL in UI config

* readable flag

* Add accordion component

* Refactor
2023-01-23 16:46:02 +00:00
Adria Navarro 106563c449 Use couchdb from docker container 2023-01-23 16:45:06 +00:00
Dean 45b907cfde Merge remote-tracking branch 'origin/develop' into feature/configurable-data-export 2023-01-23 11:43:15 +00:00
melohagan 19696fb1fe Treat bigint as string (#8877)
* Make bigint string type

* Handle BigInt relationships

* remove unused var

* Revert CreateEditRelationship modal changes
2023-01-22 19:19:16 +00:00
mike12345567 0f33fd8d48 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-20 19:55:11 +00:00
melohagan 458ab7dadc SQL filtering: Always escape key in LIKE statements (#9278)
* Always escape key in like statements

* lint
2023-01-20 14:03:14 +00:00
Adria Navarro 46994a45f9 Update openapi specs 2023-01-20 12:12:59 +00:00
Adria Navarro dec7e69391 Fix types 2023-01-20 12:03:00 +00:00
Adria Navarro 27171e7680 Extra typings 2023-01-20 11:48:11 +00:00
Adria Navarro 62b372ce59 Fix broken tests 2023-01-20 10:29:11 +00:00
Adria Navarro 12118fd028 Fix old tests 2023-01-20 10:12:52 +00:00
Adria Navarro 7f53cbeca7 Fix types 2023-01-20 09:58:59 +00:00
Adria Navarro 5fb20abcfd Add enrich test 2023-01-19 20:09:39 +00:00
mike12345567 f4d389797c Some minor updates after reviewing. 2023-01-19 19:10:41 +00:00
Adria Navarro af42e789ff Test delete multiple 2023-01-19 17:28:42 +00:00
Adria Navarro bcfb0f3727 Change tests to use internal apis 2023-01-19 17:23:48 +00:00
Adria Navarro f8a3c12608 Add get all rows tests 2023-01-19 16:46:05 +00:00
Adria Navarro bf8e65fa3e Fix validate schema 2023-01-19 16:43:39 +00:00
Adria Navarro 959b4fb2b3 Rename file 2023-01-19 16:21:37 +00:00
Adria Navarro 2bc45336fc Use right tableid 2023-01-19 16:10:29 +00:00
Adria Navarro 2e240508c7 Merge remote-tracking branch 'origin/develop' into test/9339-sqlpostgres-row-api-test-suite 2023-01-19 15:25:46 +00:00
Mateus Badan de Pieri eae7b529a7 adding validation for envvar bindings
adding validation for envvar bindings
2023-01-19 15:07:56 +00:00
melohagan a193d7fcaa Do not set sort column if display is formula (#9378)
* Unset sort column if it is formula

* Null safety
2023-01-19 13:32:45 +00:00
Adria Navarro f4553bca7c Add "get" tests 2023-01-19 11:44:48 +00:00
Adria Navarro 86c2f6dce7 Add pagination and sort tests 2023-01-19 11:35:00 +00:00
Adria Navarro 2a6d921521 Add search query tests 2023-01-19 11:20:20 +00:00
Adria Navarro e6dcc47240 Improve tests 2023-01-19 11:06:41 +00:00
Adria Navarro e13433557a Add search test 2023-01-19 11:00:51 +00:00
Adria Navarro e5509d86de Merge branch 'develop' into test/9339-sqlpostgres-row-api-test-suite 2023-01-19 10:05:58 +00:00
mike12345567 b659060beb Updating datasource API to remove secrets when returning datasources. 2023-01-18 19:16:19 +00:00
Adria Navarro 38e718b6f1 Test delete 2023-01-18 17:21:17 +00:00
Adria Navarro 233f54f036 Add update test 2023-01-18 17:11:52 +00:00
Adria Navarro ac9ad71a11 Dry tests 2023-01-18 17:07:09 +00:00
Adria Navarro 6a1589ba64 Adding more tests 2023-01-18 16:48:18 +00:00
Adria Navarro 4ae43f1a96 Retrieve row test 2023-01-18 16:46:40 +00:00
Adria Navarro 5313c51e0f Create an app before each test 2023-01-18 16:06:45 +00:00
Andrew Kingston d92f1a7097 Portal redesign (#9336)
* Update BB logo to black

* Update top nav bar and core layout

* Add redesign for apps pages

* Update user and groups pages

* More WIP portal redesign!

* Fix top nav colours and fix selected tab not updating

* Remove log

* Update copy on settings pages

* Update and standardise page headers and subtitles, and remove side nav titles

* Update font styles to allow for easy customisation

* Update button styles to always use newStyles, update auth page styles

* Update settings pages to new designs

* Update structure for account pages

* Add initial rewrite of app overview section

* Update config checklist to properly center

* Update app overview version and name/url screens

* Add tooltip to explain why URL cannot be changed until unpublishing

* Update overview automation history tab

* Update overview backups page

* Rewrite app overview access tab

* Update table hover colours

* Remove scrolling from tables when not required and stop selects from updating their own state locally

* Update table styles to support flexible column widths much better

* Fix extremely long strings in breadcrumbs not wrapping

* Fix multiple issues with long text overflow

* Fix flashing in version settings page

* Fix loading bugs in app backups page

* Add sidebar for portal and use it for automation history. Fix multiple overflow and scrolling issues

* Tidy up

* Update user details page to use tables and match designs

* Update users detail page

* Update user and group details pages with new tables

* Fix automation error linking from apps page and improve automation fetching logic in automation history

* Move theme and API key into user profile dropdown instead of settings

* Move settings before account and show plugins for devs

* Convert plugins page to table and update components and modals

* Update links when going back from the builder

* Update plugin search placeholder

* Fix URLs in app overview

* Properly handle text overflow in plugins table

* Remove getting started checklist

* Fix checklist removal and fix profile modal

* Update email details page to match new designs

* Cleanup

* Add licensing and env logic to determine which account links to show

* Update upgrade button URL for cloud accounts

* Update app list to use a more compact style

* Make core page layout responsive and update apps list to be responsive

* Update mobile design of apps page

* Update more pages to be responsive and add mobile specific components

* Refactor main portal page into multiple components

* Update multiple pages to be responsive and improve loading experience

* Make automation history page responsive

* Update backups page to be responsive

* Update pickers to use absolutely positioned root popover so that overflow does not matter

* Fix some responsive styles

* Fix update link in app overview

* Improve dropdown logic

* Lint

* Update click outside handler to handle modals properly

* Remove log

* Fix mobile menu upgrade button not closing menu

* Hide groups page if disabled at tenant level

* Centralise menu logic and show full menu on mobile

* Update app access assignment and fix backups table

* Ensure avatars cannot be squished

* Standardise disabled field text colour

* Allow developer users to access users, groups and usage pages

* Allow readonly access to users and groups for developer users

* Remove logs

* Improve users page loading experience

* Improve responsiveness on apps list page and fix discussions link styles

* Update spacing on user and group detail page and fix usage page showing wrong copy

* Fix logo override not working

* Pin minio version to an old one that supports the fs backend in dev

* Shrink upgrade button

* Shrink user dropdown

* Update assignment modal text

* Remove clickable visual styles from plugins

* Always show groups section in app access page

* Update app overview button styles to include more CTAs

* Hide edit and view links in more menu on overview page unless on mobile

* Make usage stats responsive and fix layout issues

* Add comment to docker-compose config
2023-01-18 13:56:53 +00:00
Adria Navarro 3bb85f6e46 Clean code 2023-01-18 13:55:24 +00:00
Adria Navarro 8e73814675 Add test for multiple rows 2023-01-18 12:26:26 +00:00
Adria Navarro e9361a5819 Use postgres as datasource 2023-01-18 12:19:40 +00:00
Adria Navarro 6bc658c1ff Fix types 2023-01-18 11:50:00 +00:00
Adria Navarro 1d66110d01 More typings 2023-01-18 10:45:42 +00:00
Adria Navarro cc930097a8 Implement test 2023-01-17 17:39:59 +00:00
Adria Navarro 89e0610600 Add basic test 2023-01-17 17:22:31 +00:00
Adria Navarro 6412da730c Type tests utils 2023-01-17 17:19:39 +00:00
Adria Navarro 70168a20fa Prevent killing tests when stopping the server 2023-01-17 16:07:26 +00:00
Adria Navarro ffc322da88 Treat new tests are "no tests" 2023-01-17 16:05:02 +00:00
Adria Navarro 7c05b45408 Merge remote-tracking branch 'origin/develop' into test/9339-sqlpostgres-row-api-test-suite 2023-01-17 15:25:25 +00:00
mike12345567 3659768c42 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns 48e1695318 JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
Adria Navarro da8f7eff6c Delete apps on end 2023-01-17 10:28:51 +00:00
mike12345567 5e68a4d814 Minor updates to the context system and also adding env vars to automation context. 2023-01-16 16:47:59 +00:00
Adria Navarro 343a19250b Typing supertest parameters 2023-01-16 15:35:41 +00:00
mike12345567 10d1455b35 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-16 14:26:26 +00:00
Martin McKeaveney fbf8230a3d allow all user bindings in SQL queries (#9354) 2023-01-16 12:24:32 +00:00
Adria Navarro 70a01c48f1 Merge pull request #9337 from Budibase/bug/#7220-removing-user-from-auth-does-not-remove-from-app
Bug - #7220 removing user from auth does not remove from app
2023-01-16 10:49:27 +00:00
Adria Navarro dc8e54cd84 Add test 2023-01-16 10:19:05 +00:00
Adria Navarro 946cc35ff7 Type request and body 2023-01-16 10:15:00 +00:00
mike12345567 fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
Adria Navarro 748b55c732 Fix undefineds 2023-01-13 14:48:01 +00:00
Adria Navarro ff10fa422b Unify endpoints 2023-01-13 14:45:04 +00:00
Adria Navarro 50565dc226 Fix copy on reponse message 2023-01-13 13:33:40 +00:00
Adria Navarro a5c145d9f6 Replace BBContext for Ctx 2023-01-13 13:31:48 +00:00
Adria Navarro 34cd26781b Delete instead of deactivating 2023-01-13 10:26:05 +00:00
Adria Navarro 09b4533cc8 Add endpoint to deactivate user from app on delete 2023-01-12 16:26:46 +00:00
Peter Clement e8e29ddc8c Merge remote-tracking branch 'origin/cheeks-lab-day-portal-redesign' into feature/environment-variables 2023-01-12 16:00:07 +00:00
Adria Navarro 24f8f3a7cb Fix currentapp middleware to allow app_ parameters 2023-01-12 15:38:22 +00:00
Peter Clement 117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Andrew Kingston b21f0b3925 Lint 2023-01-12 14:48:05 +00:00
mike12345567 87cf52192d Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID. 2023-01-12 14:38:12 +00:00
Rory Powell e5e767f18d Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567 d27674de5c Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
mike12345567 c479a7da2f Fixing minor Typescript issue, some old requires. 2023-01-11 18:16:30 +00:00
mike12345567 69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567 75df57c3d1 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-11 10:31:57 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
mike12345567 d347b8015b Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-10 18:49:07 +00:00
deanhannigan 94e76864bf Render view groupBy array options as tags (#8764)
* Fix to properly render groupBy options as tags

* Fixes for viewBuilder function definition and some typescript updates
2023-01-10 16:25:23 +00:00
Dean 2bf724b9b3 Updated cleanExportRows import 2023-01-10 09:50:32 +00:00
Dean 4479c2477c Merge remote-tracking branch 'origin/develop' into feature/configurable-data-export 2023-01-10 09:39:11 +00:00
mike12345567 c9d8668062 Licensing updates for environment variables. 2023-01-09 15:42:09 +00:00
mike12345567 f4f730aae2 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-06 17:29:35 +00:00
mike12345567 76825c38b9 Adding test cases for the attachment re-write feature, mocking the direct couch find functionality. 2023-01-06 13:33:22 +00:00
mike12345567 cf90282303 Moving some stuff around to make more testable. 2023-01-06 12:47:12 +00:00
mike12345567 0c37c57a4b Fix for #9249 - there was an issue with the updating of attachment URLs when importing an app/backup, this resolves it by utilising pagination in the CouchDB find API, making sure to iterate through all documents when there is a larger number. 2023-01-05 18:03:36 +00:00
mike12345567 a079cb6fec Merge branch 'develop' of github.com:Budibase/budibase into develop 2023-01-05 17:09:02 +00:00
mike12345567 3cd097a7f1 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-05 17:04:24 +00:00
Peter Clement 57a5d8505d assign wasLoopStep correctly 2023-01-05 12:16:45 +00:00
Peter Clement 90f3d28bb5 fix for looping issue wher output was incorrect 2023-01-05 10:52:50 +00:00
mike12345567 ea5b515783 Playing around with getting tests working. 2023-01-04 19:47:56 +00:00
Mel O'Hagan b70fdf907a Cast bit buffer as boolean 2023-01-04 15:18:53 +00:00
Andrew Kingston 66674c7277 Ensure view names are properly encoded to handle certain special characters (#9145) 2022-12-22 13:09:07 +00:00
Rory Powell 5f36a84470 Fix docker build (#9116) 2022-12-19 22:05:47 +00:00
Martin McKeaveney 72573c818b pulling from master 2022-12-19 18:54:58 +00:00
melohagan 1b74895abc SQL server relationship fix for tables in schema (#9103)
* Add schema to LEFT JOIN

* lint
2022-12-19 18:12:05 +00:00
Martin McKeaveney 84ab7862d1 fixes for google sheets, admin checklist, and deleting an app from API (#8846)
* fixes for google sheets, admin checklist, and deleting an app from API

* code review

* splitting unpublish endpoint, moving deploy endpoint to applications controller. Still to do public API work and move deployment controller into application controller

* updating REST method for unpublish in API test

* unpublish and publish endpoint on public API, delete endpoint unpublishes and deletes app

* removing skip_setup from prodAppDb call

* removing commented code

* unit tests and open API spec updates

* unpublish, publish unit tests - delete still in progress

* remove line updating app name in API test

* unit tests

* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

* v2.2.4

* Update pro version to 2.2.4

* lock changes (#9047)

* v2.2.5

* Update pro version to 2.2.5

* Make looping arrow point in right direction (#9053)

* v2.2.6

* Update pro version to 2.2.6

* Types/attaching license to account (#9065)

* adding license type to account

* removing planDuration

* v2.2.7

* Update pro version to 2.2.7

* Environment variable type coercion fix (#9074)

* Environment variable type coercion fix

* Update .gitignore

* v2.2.8

* Update pro version to 2.2.8

* tests passing

* all tests passing, updates to public API response

* update unpublish call to return 204, openAPI spec and unit

* fixing API tests

Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-19 13:18:00 +00:00
Rory Powell 712f1d1fc1 Environment variable type coercion fix (#9074)
* Environment variable type coercion fix

* Update .gitignore
2022-12-16 13:16:37 +00:00
Andrew Kingston 090ae5df49 Master => Develop (#9049)
* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2022-12-15 12:13:42 +00:00
Rory Powell 786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Andrew Kingston c3b6afbb6f Fix SQL table `_id` filtering (#9030)
* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules
2022-12-15 09:22:28 +00:00
Rory Powell f935f05509 Offline license POC (#9046) 2022-12-14 21:48:48 +00:00
Dean cdcefa16bb Filtering and sort on data row export 2022-12-13 10:13:17 +00:00
Peter Clement 9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
Michael Drury d4f89ad315 Merge pull request #8968 from Budibase/fix/user-self-update
Minor update - stop users updating their own admin/global flags
2022-12-08 09:01:41 +00:00
mike12345567 a120ba0c8d Fixing repl options. 2022-12-07 18:22:02 +00:00
mike12345567 b3e5483eca Adding back compaction. 2022-12-07 18:09:17 +00:00
mike12345567 be0b15428b Linting. 2022-12-07 14:43:27 +00:00
mike12345567 617863ddd1 Fix for #7865 - if you deleted a cron automation immediately after creating/publishing it there was a scenario where prod automations would be out of sync with dev automations and it wouldn't really delete. To get around this, we do an automation sync back to dev DB - meaning that the cron ID is known and can be disabled. 2022-12-07 14:32:29 +00:00
mike12345567 85dd6f2880 Extension on fix for user self assignment, don't allow users to change their admin/builder status. 2022-12-07 12:42:14 +00:00
mike12345567 4300e5c733 Fix for CI build failure. 2022-12-06 18:23:55 +00:00
mike12345567 b9ce140d95 Fix for #7732 - as well as some tests for it, make sure that it is working as expected. 2022-12-06 17:20:26 +00:00
mike12345567 dbde23a4de Fixes based on test failures. 2022-12-06 12:47:48 +00:00
mike12345567 2ba9088faa PR comments, moving more stuff into SDK. 2022-12-06 12:22:41 +00:00
mike12345567 53a6c0e74b Fix for #8896 - the automation logs were already being sync'd to the dev database, but when unpublished they are in-accessible. Some minor updates to make sure that before unpublishing there is a sync, and then most of the changes are in pro. 2022-12-05 18:24:25 +00:00
mike12345567 0ca1c359a5 Final fix for #8882 - adding text to show the error - as well as fixing an issue with many to many updating correctly. 2022-12-02 17:28:37 +00:00
mike12345567 2a51091ffb Adding some null controls. 2022-12-02 16:17:56 +00:00
Andrew Kingston b336a916c7 Merge pull request #8788 from Budibase/side-panel
Side panels
2022-11-30 16:04:35 +00:00
deanhannigan 67f06c8eb9 Merge pull request #8857 from Budibase/fix/sample-data-edit-removed-delete-fixed
Remove ability to edit the 'Sample Data' datasource name
2022-11-30 09:08:54 +00:00
Andrew Kingston a0776ac73a Fix types in table migration tests 2022-11-29 16:27:06 +00:00
Andrew Kingston 0b6c459fbd Add basic component type 2022-11-29 16:21:59 +00:00
Dean 3c59a0da56 Fix to ensure only the budibase datasource type is altered on save 2022-11-29 16:08:31 +00:00
Michael Drury a656c6e678 Adding test case for char encoding and being explicit about utf8 export. 2022-11-29 16:03:22 +00:00
Michael Drury 31fbc937b0 Removing old JS file. 2022-11-29 15:23:01 +00:00
Dean dc001bc27f Merge remote-tracking branch 'origin/develop' into fix/sample-data-edit-removed-delete-fixed 2022-11-29 12:54:22 +00:00
Andrew Kingston 8567ae70af Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-29 12:22:56 +00:00
Andrew Kingston 894a6b93e8 Update table migration test to use imports, and update TestConfiguration to work with type parameters 2022-11-29 12:19:37 +00:00
Michael Drury bcf2aadbaa Merge branch 'develop' of github.com:Budibase/budibase into fix/charset-encoding 2022-11-29 11:57:45 +00:00
Michael Drury 4f4eb4da26 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-29 11:13:54 +00:00
mike12345567 a02e9017ec Final fixes after re-running all test suites. 2022-11-28 19:12:23 +00:00
mike12345567 3aeb6653c6 Some fixes after re-running server tests. 2022-11-28 18:14:10 +00:00
mike12345567 d6e9380c06 General work after running some tests in CI - general refactoring as well. 2022-11-28 17:54:04 +00:00
Dean 7d0e2c289d Disabled the ability to rename the Sample Data datasource. Updated the backend to ensure that renaming doesn't alter its structure and block deletion 2022-11-28 17:25:10 +00:00
mike12345567 e62ebc8fbb Updates to fix build. 2022-11-28 13:24:39 +00:00
Andrew Kingston b042c9ed2e Add tests for table settings migration 2022-11-28 12:20:49 +00:00
Mel O'Hagan 11ae382af0 lint 2022-11-28 12:05:19 +00:00
Mel O'Hagan ba10756119 Don't parse number arrays as date 2022-11-28 12:04:44 +00:00
mike12345567 06d8d19aaa Final typescript conversions for server. 2022-11-26 16:24:37 +00:00
mike12345567 12d6e60525 One file left in the server, some fixes after converting the internal row controller. 2022-11-26 15:42:53 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567 a3bb2e0d77 Automation overhaul to Typescript, plus type updates. 2022-11-25 19:57:07 +00:00
mike12345567 eeebd0fe70 Typescript conversion of linked row controller. 2022-11-25 18:54:57 +00:00
mike12345567 7eac8fafd6 Some server typescript re-writes, only automations left and some controllers. 2022-11-25 15:01:46 +00:00
Andrew Kingston abedb5d9eb Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-25 11:24:57 +00:00
mike12345567 d3c4c99e16 Complete conversion of backend-core to Typescript. 2022-11-24 18:48:51 +00:00
Andrew Kingston 9000349360 Refactor table settings migration slightly and add missing await keyword 2022-11-24 14:23:27 +00:00
Andrew Kingston 3480f6741c Rename table settings migration and only run on dev apps 2022-11-24 14:23:04 +00:00
deanhannigan 3c716a059c Merge pull request #8795 from Budibase/fix/pass-request-context-to-dynamic-var-retry
User/Auth context now being passed to dynamic variable request updates
2022-11-24 13:42:51 +00:00
Mel O'Hagan 4b05cd2d2d Allow tables to be created even if no fetch 2022-11-24 11:45:58 +00:00
Dean f4c027c25b User/Auth context now being passed to dynamic variable request updates 2022-11-24 10:16:05 +00:00
mike12345567 514f9a1210 Some fixes based on test runs. 2022-11-23 11:44:15 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 8c2d9ebec8 Updating all of the route files to typescript, as well as some controllers. 2022-11-22 18:49:19 +00:00
mike12345567 92210144ff More controller typescript conversions. 2022-11-22 16:52:25 +00:00
Andrew Kingston c01b9af1f0 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-22 16:52:09 +00:00
mike12345567 8a4da7d4ce Typescript conversion of the table controllers. 2022-11-22 13:56:01 +00:00
mike12345567 4cdcafac36 More Typescript conversion, as part of backend-core importing improvements. 2022-11-22 12:41:36 +00:00
mike12345567 8f94664ddd Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-22 12:03:31 +00:00
mike12345567 de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
Dean 192c9b56e2 Import refactoring and some review updates. 2022-11-21 15:53:47 +00:00
Dean 64e7239d42 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 15:40:11 +00:00
mike12345567 cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
Dean 0441704c57 Import fixes for backend core constants. Minor name change for default data source from Test DB to Sample Data 2022-11-21 12:47:36 +00:00
Dean 02a902ebd3 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 11:10:29 +00:00
Andrew Kingston c58067a589 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-21 10:30:25 +00:00
Rory Powell e6589fd4c1 Require params on db.remove 2022-11-21 10:07:51 +00:00
Mel O'Hagan 2d28bb4005 Break if any column is static formula 2022-11-18 12:32:04 +00:00
mike12345567 0d13a77409 Some minor updates after running qa-core tests, found some issues that likely exists before context update. 2022-11-17 16:30:38 +00:00
Dean e932aa105b Shifted the budibase datasource constant to backend-core 2022-11-17 16:28:48 +00:00
Dean 8657aaf922 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-17 15:39:40 +00:00
mike12345567 31c198888a Updating some enums, plural to single. 2022-11-17 14:59:18 +00:00
mike12345567 58e59bfacc Updating PouchLike to be an interface in types, with its impl stored in backend-core, now called Database. 2022-11-17 14:35:03 +00:00
mike12345567 bc857d7bb8 PR comments - still experiencing build issues. 2022-11-17 13:31:54 +00:00
Andrew Kingston 102d6084f1 Update table settings migration to handle new behaviour settings for table blocks 2022-11-17 10:11:25 +00:00
mike12345567 29dd98a7fc Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-16 18:12:31 +00:00
mike12345567 4328ed1b67 Updating middlewares to Typescript, as well as some fixes based on running tests. 2022-11-16 17:24:13 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
mike12345567 c6366c573a Final server test fixes, after all updates to context/removal of context faking. 2022-11-15 19:04:39 +00:00
mike12345567 5f658a0398 Converting further DB layers to TS - fixing mocks. 2022-11-15 18:33:24 +00:00
mike12345567 b5472f882b Some updates for currentapp.spec.js test case. 2022-11-15 17:35:17 +00:00
Dean 2599748918 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-15 17:11:19 +00:00
Dean f73b4f8b01 Review updates 2022-11-15 17:03:35 +00:00
mike12345567 e7e2d91fef Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-15 16:45:25 +00:00
Rory Powell 1612044dc1 Merge branch 'develop' into subdomain-tenancy 2022-11-15 16:18:59 +00:00
Rory Powell f48ff01045 ensure fetch and aws are always mocked 2022-11-15 15:50:15 +00:00
Andrew Kingston 2b42b21b3a Add migration to automatically convert legacy table settings into new action setting 2022-11-15 11:54:45 +00:00
Rory Powell 9973f2e161 Bump jest and ts-jest to be consistent across backend packages to fix CI issue, test config updates 2022-11-14 22:55:47 +00:00
mike12345567 72c9aadae0 Updating test cases - trying to get everything in order for merge. 2022-11-14 20:25:05 +00:00
Dean ebccc21e7f Fixed imports 2022-11-13 22:34:01 +00:00
Dean ff7a3b8cef Default Datasource and sample row data 2022-11-13 21:37:50 +00:00
Dean 8f058e222b Fix for attachment cleanup on internal row delete. 2022-11-13 18:08:48 +00:00
mike12345567 bc94f20794 Typescript conversions - trying to get all of context/db layer into TS. 2022-11-11 11:57:50 +00:00
mike12345567 c63c3b48c5 Typescript conversions, as well as updating context to just use an object map. 2022-11-10 17:38:26 +00:00
mike12345567 45e7ef61ef Re-building the context module to use a single object, meaning we can create new context frames and copy over whatever exists, then update. 2022-11-10 16:38:32 +00:00
melohagan c7b19a9cec Merge pull request #8635 from Budibase/bug/sev3/app-import-automations
App import automations - null pointer fix
2022-11-10 15:35:24 +00:00
melohagan b6ff581d5e Merge pull request #8593 from Budibase/bug/sev2/mongodb-aggregate-readable
MongoDB aggregate readable
2022-11-10 15:27:08 +00:00
Mel O'Hagan 6d1449431e Null pointer fix 2022-11-10 15:22:05 +00:00
mike12345567 c744d23832 Major update - removing the use of context for PouchDB instances, swapping knowledge of PouchDB to the PouchLike structure that replaces it. 2022-11-09 16:53:42 +00:00
Rory Powell 6783fd713e Update tenancy detection to honour any subdomain pattern according to platform url 2022-11-09 16:35:16 +00:00
mike12345567 ecb398bf98 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-09 13:41:51 +00:00
Michael Drury 2f6330db4f Removing timeout for export apps - #8589. 2022-11-08 20:12:32 +00:00
Mel O'Hagan 5aba8e4a65 Added readable prop to aggregate function 2022-11-08 14:31:36 +00:00
Rory Powell 6f995f3065 Configurable CDN 2022-11-07 15:27:03 +00:00
Rory Powell 998beddc30 Configurable CDN 2022-11-07 09:45:00 +00:00
mike12345567 b9caf0aef5 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-02 20:12:01 +00:00
melohagan a9575db549 Merge pull request #8472 from Budibase/bug/sev3/validation-error-attachments
Validation error attachments
2022-11-02 09:56:28 +00:00
Rory Powell 496ba57655 Fix attachments upload path 2022-11-01 21:17:39 +00:00
Mel O'Hagan 702e7fe184 Map attachment string to array if needed 2022-11-01 15:59:04 +00:00
mike12345567 19669575e4 Fixing issue with self host build - import of backend-core changes mean that loading the public API files can require setup of backend-core, making it so that the JWT Strategy doesn't need to be setup to load backend-core. 2022-11-01 12:59:10 +00:00
Mel O'Hagan a57dc85b60 Remove ! from error message 2022-11-01 12:37:42 +00:00
Mel O'Hagan f51599f2a8 Merge branch 'develop' into bug/sev3/automation-mysql-id-relationship-uri-decode 2022-11-01 12:36:27 +00:00
melohagan cc44430638 Merge pull request #7521 from Budibase/feature/s3-bucket-connector
S3 bucket connector improvements
2022-11-01 09:56:47 +00:00
Rory Powell bf35717449 Merge pull request #8386 from chaoticefx/elasticsearch-rejectUnauthorized
Custom ssl config for Elasticsearch datasource
2022-11-01 08:47:27 +00:00
Mel O'Hagan 64eff3bab5 Merge branch 'develop' into bug/sev3/automation-mysql-id-relationship-uri-decode 2022-11-01 08:10:03 +00:00
chaoticefx a45c16bc42 Cleaned up config declaration in constructor 2022-11-01 09:08:17 +08:00
Martin McKeaveney 87717ebdf5 merge with master 2022-10-31 13:44:23 +00:00
Martin McKeaveney b498941e1a Merge pull request #8382 from Budibase/feature/meta-tag
adding opengraph metatags for better shareable links
2022-10-31 10:36:50 +00:00
Martin McKeaveney 5fd4f29c61 Merge pull request #8422 from Budibase/bug/sev5/public-api-404
Public rows API: Return correct status codes
2022-10-31 10:36:32 +00:00
mike12345567 eab9806ee3 Fixing an issue with some browsers sending the gzip type as x-gzip rather than gzip, which caused the processing to fail. 2022-10-27 19:14:31 +01:00
Mel O'Hagan ea34856896 Check for string type before decode 2022-10-27 17:55:46 +01:00
Mel O'Hagan ee6a5bffd5 Patch: Throw 404 if row not found 2022-10-27 17:52:28 +01:00
Mel O'Hagan f8fab8d51b Merge branch 'develop' into bug/sev3/automation-mysql-id-relationship-uri-decode 2022-10-27 17:35:47 +01:00
mike12345567 a9b406ea66 Fixing issue with pro import. 2022-10-27 17:31:39 +01:00
Mel O'Hagan 73f54c8133 Decode id if needed 2022-10-27 16:28:26 +01:00
mike12345567 3d98acc28a Minor test rework after improving startup, a lot of mocks weren't being used correctly. 2022-10-27 15:15:08 +01:00
Mel O'Hagan a809700ec2 Throw 400 when validation fails 2022-10-27 15:10:22 +01:00
Mel O'Hagan efc73caf44 lint 2022-10-27 13:49:59 +01:00
Mel O'Hagan 5aa98fcbac Remove try catch from rows. Correct status codes. 2022-10-27 13:49:19 +01:00
chaoticefx 46a0197cd6 Ran npx prettier against elasticsearch.ts 2022-10-27 16:24:01 +08:00
chaoticefx ac9c52e70f Fixed code styling 2022-10-27 15:52:49 +08:00
mike12345567 51251b1fe2 Adding backup queue to bullboard if enabled. 2022-10-26 18:50:40 +01:00
Mel O'Hagan 86fef02567 lint 2022-10-26 16:44:25 +01:00
Mel O'Hagan d69abc4569 Merge branch 'develop' into feature/s3-bucket-connector 2022-10-26 16:37:11 +01:00
Martin McKeaveney 3e348908f5 merge 2022-10-26 11:47:25 +01:00
Martin McKeaveney 37d76cd39d fix typo 2022-10-26 11:45:52 +01:00
mike12345567 a24694a4ea Refactoring a lot of content around webhooks to Typescript, as well as fixing webhooks and automation app IDs on import of new app. 2022-10-25 18:19:18 +01:00
Mel O'Hagan 7166a48382 Unused import 2022-10-25 15:19:46 +01:00
Mel O'Hagan e11f4932d3 Handle multiple automation loop bindings 2022-10-25 15:19:07 +01:00
Rory Powell 56456f3f6d Startup fixes 2022-10-25 13:37:26 +01:00
Rory Powell 9face50a07 Fix build failure around PouchDB type 2022-10-25 09:02:55 +01:00
chaoticefx 1ac362f90c Implemented custom ssl config in elasticsearch.ts 2022-10-25 11:59:34 +08:00
Martin McKeaveney 17205052b7 update OG title 2022-10-24 18:04:14 +01:00
Martin McKeaveney 4c7d6cf2af adding opengraph metatags for better shareable links 2022-10-24 17:53:18 +01:00
Rory Powell 39c83d8fb1 Move backup processing into pro 2022-10-24 15:28:43 +01:00
Rory Powell d746c42503 Remove pro mock and invert if condition on backups enabled 2022-10-24 14:23:16 +01:00
mike12345567 a25cc7fbaf Merge branch 'feature/app-backups' of github.com:Budibase/budibase into feature/app-backups 2022-10-24 13:37:53 +01:00
mike12345567 bc2d499625 Adding a check to see if app backups feature is enabled. 2022-10-24 13:33:36 +01:00
Rory Powell 5614c5db61 Replace isTest check with mock for triggering app backup 2022-10-24 13:05:40 +01:00
mike12345567 fbed8923dc Moving statistics under backups sdk subfolder. 2022-10-24 10:14:35 +01:00
mike12345567 4daf9c2615 Addressing majority of PR comments. 2022-10-24 10:04:14 +01:00
mike12345567 e1dca87507 Fixing test case. 2022-10-21 18:52:39 +01:00
mike12345567 74484fc054 Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-21 18:41:25 +01:00
mike12345567 fe5d11232f Update with PR comments. 2022-10-21 18:25:35 +01:00
mike12345567 2a2f41a861 Fixing issue discovered by tests. 2022-10-21 16:02:13 +01:00
Martin McKeaveney 975134caea Merge pull request #8295 from weslien/patch-8294
Fix arangoDB connector
2022-10-20 22:01:07 +01:00
mike12345567 854cb23947 Getting the import system to carry out a backup of the app before the restore. 2022-10-20 19:07:10 +01:00
mike12345567 f5557fd805 Fetching a list of backup/restore events includes the full user object. 2022-10-20 15:05:50 +01:00
mike12345567 f11c0bbfd7 Some type updates and processor handling for backup document being created before backup/restore occurs. 2022-10-19 19:19:36 +01:00
mike12345567 10c81c1adc Fixing issue with using templates. 2022-10-19 16:57:14 +01:00
mike12345567 113a23ba3d Adding statistics output for backups. 2022-10-19 16:48:32 +01:00
mike12345567 59bf052b70 Fixing issue with metadata name not being provided for uploaded backup on publish. 2022-10-19 13:52:56 +01:00
mike12345567 f5845a8a6e Protection for real app IDs. 2022-10-19 11:47:07 +01:00
mike12345567 bdc4e29b2d Finishing import processor - download backup, delete dev DB and then import over the top of this. Also includes a rollback feature if the backup fails to restore for whatever reason. 2022-10-18 19:43:19 +01:00
mike12345567 b52f413aa5 Removing attachment dir constant - no longer needed. 2022-10-18 17:04:18 +01:00
mike12345567 caa4954d8e Updating export/import to include the budibase client and manifest. 2022-10-18 16:42:25 +01:00