Commit Graph

5913 Commits

Author SHA1 Message Date
mike12345567 7ca5c877a1 Updating datasources to use new onlyFound option. 2023-01-27 15:21:04 +00:00
mike12345567 dd67f106ed Adding a onlyFound option to our handlebars system so that we can enrich only the parts we have and leave other components for further enrichment. 2023-01-27 15:15:07 +00:00
mike12345567 abe17e6c0e Fixing issue with apps not being created correctly due to the recent update to context. 2023-01-27 13:37:36 +00:00
Rory Powell be5b8347ef Merge branch 'develop' into feature/environment-variables 2023-01-27 11:27:11 +00:00
adrinr 79c48bf6bc Remove wrong createApp 2023-01-26 18:24:20 +00:00
adrinr e11f1d1d44 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
mike12345567 d189fc82f8 Adding test cases as per PR comments. 2023-01-26 18:20:21 +00:00
mike12345567 2e099a7029 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-26 18:20:21 +00:00
Adria Navarro Redo bf0f7d5bab Fix user test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 48ee427178 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 5933422a79 Fix date related tests 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 4ac3102f2a Fix automation test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 498d1776e0 Fix snapshots test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 7b935d8476 Set expected id 2023-01-26 18:20:21 +00:00
Adria Navarro Redo d46ef8e68c Fix application delete tests 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 5abb095f58 Use multitenancy for tests 2023-01-26 18:20:21 +00:00
adrinr 9bcb33285c Fix timespan issues 2023-01-26 18:20:05 +00:00
mike12345567 c99b4ae3a3 Adding test cases as per PR comments. 2023-01-25 18:27:58 +00:00
Adria Navarro be24db0a9b Don't create the apps on test 2023-01-25 10:13:35 +00:00
mike12345567 b138d86318 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-24 19:09:36 +00:00
mike12345567 f82e8f1f20 Don't check whether or not a datasource uses env vars when the function specifically includes the env vars, always fetch them so that they can be returned and put into context for queries to use. 2023-01-24 18:56:19 +00:00
Adria Navarro 1b3c7bb6f8 Wipe db before tests 2023-01-24 18:51:15 +00:00
Adria Navarro 9bdc54f0aa Remove mocks 2023-01-24 17:48:49 +00:00
Adria Navarro 730c40e6b9 tweak tests 2023-01-24 15:46:50 +00:00
Peter Clement 8cf63278d8 ensure object is passed to processObjectSync 2023-01-24 15:44:34 +00:00
Adria Navarro dbdc3e89d9 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:43:36 +00:00
Adria Navarro 286e6f4123 Merge branch 'develop' into feature/test-image
# Conflicts:
#	packages/worker/yarn.lock
2023-01-23 18:40:44 +00:00
Adria Navarro b0ffdc079d Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:08:19 +00:00
Adria Navarro 359e2d1d1f Move more stuff to .env.test 2023-01-23 18:02:28 +00:00
Adria Navarro e9cd0984d9 Dry, moving env variables to a .env.test file 2023-01-23 17:41:32 +00:00
Adria Navarro 30830503c9 Set parameters 2023-01-23 16:53:34 +00:00
melohagan c72bce9e4a
Add fields for MongoDB SSL cert file paths (#8260)
* Added fields for tls certificate files

* lint

* Only include cert fields if SELF_HOSTED

* lint

* Refactor getSchema function

* Add datasource field group with accordion

* Handle no display column on fieldGroup field

* Override text transform accordian header

* Renamed from TLS to SSL in UI config

* readable flag

* Add accordion component

* Refactor
2023-01-23 16:46:02 +00:00
Adria Navarro 9225b658ae Use couchdb from docker container 2023-01-23 16:45:06 +00:00
Dean a1faeece3c Merge remote-tracking branch 'origin/develop' into feature/configurable-data-export 2023-01-23 11:43:15 +00:00
melohagan cdcd00ac20
Treat bigint as string (#8877)
* Make bigint string type

* Handle BigInt relationships

* remove unused var

* Revert CreateEditRelationship modal changes
2023-01-22 19:19:16 +00:00
mike12345567 8a7922110d Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-20 19:55:11 +00:00
melohagan d274f3af1e
SQL filtering: Always escape key in LIKE statements (#9278)
* Always escape key in like statements

* lint
2023-01-20 14:03:14 +00:00
mike12345567 e7e6e3419e Some minor updates after reviewing. 2023-01-19 19:10:41 +00:00
Mateus Badan de Pieri 6e5c126d5a adding validation for envvar bindings
adding validation for envvar bindings
2023-01-19 15:07:56 +00:00
melohagan e35bb2db3d
Do not set sort column if display is formula (#9378)
* Unset sort column if it is formula

* Null safety
2023-01-19 13:32:45 +00:00
mike12345567 f8a2c9e169 Updating datasource API to remove secrets when returning datasources. 2023-01-18 19:16:19 +00:00
Andrew Kingston c3f5e33b29
Portal redesign (#9336)
* Update BB logo to black

* Update top nav bar and core layout

* Add redesign for apps pages

* Update user and groups pages

* More WIP portal redesign!

* Fix top nav colours and fix selected tab not updating

* Remove log

* Update copy on settings pages

* Update and standardise page headers and subtitles, and remove side nav titles

* Update font styles to allow for easy customisation

* Update button styles to always use newStyles, update auth page styles

* Update settings pages to new designs

* Update structure for account pages

* Add initial rewrite of app overview section

* Update config checklist to properly center

* Update app overview version and name/url screens

* Add tooltip to explain why URL cannot be changed until unpublishing

* Update overview automation history tab

* Update overview backups page

* Rewrite app overview access tab

* Update table hover colours

* Remove scrolling from tables when not required and stop selects from updating their own state locally

* Update table styles to support flexible column widths much better

* Fix extremely long strings in breadcrumbs not wrapping

* Fix multiple issues with long text overflow

* Fix flashing in version settings page

* Fix loading bugs in app backups page

* Add sidebar for portal and use it for automation history. Fix multiple overflow and scrolling issues

* Tidy up

* Update user details page to use tables and match designs

* Update users detail page

* Update user and group details pages with new tables

* Fix automation error linking from apps page and improve automation fetching logic in automation history

* Move theme and API key into user profile dropdown instead of settings

* Move settings before account and show plugins for devs

* Convert plugins page to table and update components and modals

* Update links when going back from the builder

* Update plugin search placeholder

* Fix URLs in app overview

* Properly handle text overflow in plugins table

* Remove getting started checklist

* Fix checklist removal and fix profile modal

* Update email details page to match new designs

* Cleanup

* Add licensing and env logic to determine which account links to show

* Update upgrade button URL for cloud accounts

* Update app list to use a more compact style

* Make core page layout responsive and update apps list to be responsive

* Update mobile design of apps page

* Update more pages to be responsive and add mobile specific components

* Refactor main portal page into multiple components

* Update multiple pages to be responsive and improve loading experience

* Make automation history page responsive

* Update backups page to be responsive

* Update pickers to use absolutely positioned root popover so that overflow does not matter

* Fix some responsive styles

* Fix update link in app overview

* Improve dropdown logic

* Lint

* Update click outside handler to handle modals properly

* Remove log

* Fix mobile menu upgrade button not closing menu

* Hide groups page if disabled at tenant level

* Centralise menu logic and show full menu on mobile

* Update app access assignment and fix backups table

* Ensure avatars cannot be squished

* Standardise disabled field text colour

* Allow developer users to access users, groups and usage pages

* Allow readonly access to users and groups for developer users

* Remove logs

* Improve users page loading experience

* Improve responsiveness on apps list page and fix discussions link styles

* Update spacing on user and group detail page and fix usage page showing wrong copy

* Fix logo override not working

* Pin minio version to an old one that supports the fs backend in dev

* Shrink upgrade button

* Shrink user dropdown

* Update assignment modal text

* Remove clickable visual styles from plugins

* Always show groups section in app access page

* Update app overview button styles to include more CTAs

* Hide edit and view links in more menu on overview page unless on mobile

* Make usage stats responsive and fix layout issues

* Add comment to docker-compose config
2023-01-18 13:56:53 +00:00
mike12345567 20a677e510 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns 36f9bd8d71
JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
mike12345567 4bc47c1563 Minor updates to the context system and also adding env vars to automation context. 2023-01-16 16:47:59 +00:00
mike12345567 94203b3a2c Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-16 14:26:26 +00:00
Martin McKeaveney 47b6dc86da
allow all user bindings in SQL queries (#9354) 2023-01-16 12:24:32 +00:00
Adria Navarro 2ebabbe0e7
Merge pull request #9337 from Budibase/bug/#7220-removing-user-from-auth-does-not-remove-from-app
Bug - #7220 removing user from auth does not remove from app
2023-01-16 10:49:27 +00:00
Adria Navarro 46e8986566 Add test 2023-01-16 10:19:05 +00:00
Adria Navarro 17b7e18fe6 Type request and body 2023-01-16 10:15:00 +00:00
mike12345567 186aeeec2d Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
Adria Navarro ce104b2bc9 Fix undefineds 2023-01-13 14:48:01 +00:00
Adria Navarro a183c85f8c Unify endpoints 2023-01-13 14:45:04 +00:00
Adria Navarro 8e8b0f9b4e Fix copy on reponse message 2023-01-13 13:33:40 +00:00
Adria Navarro fe0b70d843 Replace BBContext for Ctx 2023-01-13 13:31:48 +00:00
Adria Navarro bc833ecf71 Delete instead of deactivating 2023-01-13 10:26:05 +00:00
Adria Navarro f8a0c0d446 Add endpoint to deactivate user from app on delete 2023-01-12 16:26:46 +00:00
Peter Clement 5561f73c69 Merge remote-tracking branch 'origin/cheeks-lab-day-portal-redesign' into feature/environment-variables 2023-01-12 16:00:07 +00:00
Adria Navarro e1870f74bd Fix currentapp middleware to allow app_ parameters 2023-01-12 15:38:22 +00:00
Peter Clement 410a4ac3b2 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Andrew Kingston cf57a511f4 Lint 2023-01-12 14:48:05 +00:00
mike12345567 2c87844e93 Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID. 2023-01-12 14:38:12 +00:00
Rory Powell 6b2b46cc4a
Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567 da2b921156 Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
mike12345567 b6a750a678 Fixing minor Typescript issue, some old requires. 2023-01-11 18:16:30 +00:00
mike12345567 73884a9a6f Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 a7bcfe387c Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567 9482870d21 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-11 10:31:57 +00:00
Rory Powell 0b2a445a9a
Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
mike12345567 a0dfe50fcc Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-10 18:49:07 +00:00
deanhannigan 79fa4e42c2
Render view groupBy array options as tags (#8764)
* Fix to properly render groupBy options as tags

* Fixes for viewBuilder function definition and some typescript updates
2023-01-10 16:25:23 +00:00
Dean b4c5a70d3c Updated cleanExportRows import 2023-01-10 09:50:32 +00:00
Dean b349f1b0cf Merge remote-tracking branch 'origin/develop' into feature/configurable-data-export 2023-01-10 09:39:11 +00:00
mike12345567 8f3e841a75 Licensing updates for environment variables. 2023-01-09 15:42:09 +00:00
mike12345567 894c128358 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-06 17:29:35 +00:00
mike12345567 aca98f7c6d Adding test cases for the attachment re-write feature, mocking the direct couch find functionality. 2023-01-06 13:33:22 +00:00
mike12345567 6595e1c122 Moving some stuff around to make more testable. 2023-01-06 12:47:12 +00:00
mike12345567 7084989896 Fix for #9249 - there was an issue with the updating of attachment URLs when importing an app/backup, this resolves it by utilising pagination in the CouchDB find API, making sure to iterate through all documents when there is a larger number. 2023-01-05 18:03:36 +00:00
mike12345567 72fb4160ac Merge branch 'develop' of github.com:Budibase/budibase into develop 2023-01-05 17:09:02 +00:00
mike12345567 3b7760b53a Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-05 17:04:24 +00:00
Peter Clement 38ccf20357 assign wasLoopStep correctly 2023-01-05 12:16:45 +00:00
Peter Clement 7083b00f97 fix for looping issue wher output was incorrect 2023-01-05 10:52:50 +00:00
mike12345567 6518dfbe3b Playing around with getting tests working. 2023-01-04 19:47:56 +00:00
Mel O'Hagan 01f4820514 Cast bit buffer as boolean 2023-01-04 15:18:53 +00:00
Andrew Kingston 911f37572a
Ensure view names are properly encoded to handle certain special characters (#9145) 2022-12-22 13:09:07 +00:00
Rory Powell a13cfd98f9
Fix docker build (#9116) 2022-12-19 22:05:47 +00:00
Martin McKeaveney c6c721298c pulling from master 2022-12-19 18:54:58 +00:00
melohagan 033094cf30
SQL server relationship fix for tables in schema (#9103)
* Add schema to LEFT JOIN

* lint
2022-12-19 18:12:05 +00:00
Martin McKeaveney 8a2a5a1f76
fixes for google sheets, admin checklist, and deleting an app from API (#8846)
* fixes for google sheets, admin checklist, and deleting an app from API

* code review

* splitting unpublish endpoint, moving deploy endpoint to applications controller. Still to do public API work and move deployment controller into application controller

* updating REST method for unpublish in API test

* unpublish and publish endpoint on public API, delete endpoint unpublishes and deletes app

* removing skip_setup from prodAppDb call

* removing commented code

* unit tests and open API spec updates

* unpublish, publish unit tests - delete still in progress

* remove line updating app name in API test

* unit tests

* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

* v2.2.4

* Update pro version to 2.2.4

* lock changes (#9047)

* v2.2.5

* Update pro version to 2.2.5

* Make looping arrow point in right direction (#9053)

* v2.2.6

* Update pro version to 2.2.6

* Types/attaching license to account (#9065)

* adding license type to account

* removing planDuration

* v2.2.7

* Update pro version to 2.2.7

* Environment variable type coercion fix (#9074)

* Environment variable type coercion fix

* Update .gitignore

* v2.2.8

* Update pro version to 2.2.8

* tests passing

* all tests passing, updates to public API response

* update unpublish call to return 204, openAPI spec and unit

* fixing API tests

Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-19 13:18:00 +00:00
Rory Powell 8b01297973
Environment variable type coercion fix (#9074)
* Environment variable type coercion fix

* Update .gitignore
2022-12-16 13:16:37 +00:00
Andrew Kingston 20ff5dcb70
Master => Develop (#9049)
* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2022-12-15 12:13:42 +00:00
Rory Powell 7ef9e9dc51
File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Andrew Kingston 4188754bbe
Fix SQL table `_id` filtering (#9030)
* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules
2022-12-15 09:22:28 +00:00
Rory Powell 56dfba9b4a
Offline license POC (#9046) 2022-12-14 21:48:48 +00:00
Dean c523d8361a Filtering and sort on data row export 2022-12-13 10:13:17 +00:00
Peter Clement 9bf37b34ae
Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
Michael Drury 45984e4c3f
Merge pull request #8968 from Budibase/fix/user-self-update
Minor update - stop users updating their own admin/global flags
2022-12-08 09:01:41 +00:00
mike12345567 6243186db5 Fixing repl options. 2022-12-07 18:22:02 +00:00
mike12345567 5f49d71b8b Adding back compaction. 2022-12-07 18:09:17 +00:00
mike12345567 4b211b6587 Linting. 2022-12-07 14:43:27 +00:00