Commit Graph

903 Commits

Author SHA1 Message Date
mike12345567 ef30c03fa6 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-21 17:26:24 +00:00
adrinr e0b3976ee4 Add return select statement back on update 2023-02-21 15:57:04 +00:00
adrinr 1ada790d50 Fix postgres update for relationships 2023-02-21 15:21:00 +00:00
Rory Powell cacf275a99 Prevent SSO users from setting / resetting a password (#9672)
* Prevent SSO users from setting / resetting a password

* Add support for ENABLE_SSO_MAINTENANCE_MODE

* Add typing to self api and build out user update sdk

* Integrate sso checks with user sdk. Integrate user sdk with self api

* Test fixes

* Move self update into SDK

* Lock down maintenance mode to admin user

* Fix typo

* Add health status response and return type signature to accounts.getStatus

* Remove some unnecessary comments

* Make sso save user function non optional

* Remove redundant check on sso auth details provider

* Update syncProfilePicture function name to getProfilePictureUrl

* Update packages/worker/src/sdk/users/events.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Add ENABLE_EMAIL_TEST_MODE flag

* Fix for logging in as sso user when existing user has password already

* Hide password update and force reset from ui for sso users

* Always disable sso maintenance mode in cloud

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-02-21 08:23:53 +00:00
Rory Powell bb1faac62a Merge master into develop 2023-02-15 15:10:02 +00:00
mike12345567 05ceee1cfe Moving lucene handling to backend-core so that it can be used for other databases (outside row indexes). 2023-02-13 17:13:59 +00:00
mike12345567 0c80ea2083 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-10 17:42:56 +00:00
mike12345567 4acfae6af6 Updating so that datasources always have correct types after environment variable enrichment. 2023-02-10 12:47:23 +00:00
mike12345567 f8ef06c849 Fix issue with MS-SQL, port needs to be a number for the node-mssql package, with env vars it isn't anymore. 2023-02-10 11:54:16 +00:00
adrinr 2cdc2f3fec Fix select statement when no resource 2023-02-07 12:29:58 +00:00
adrinr 3d917bfe22 Fix conflicting columns issue 2023-02-07 12:25:02 +00:00
adrinr bc0208bc83 Clean describes 2023-02-07 11:27:46 +00:00
adrinr 79e42abc1e Tidy tests 2023-02-07 10:46:34 +00:00
Adria Navarro afa282ecbf Fix sql when no resource 2023-02-06 20:47:49 +00:00
adrinr c87efb7866 Don't return foreign keys on updates and deletes 2023-02-06 17:37:00 +00:00
adrinr 29503d1244 Fix tests 2023-02-06 17:30:33 +00:00
adrinr 9bb1a2fa18 Merge remote-tracking branch 'origin/develop' into test/9339-sqlpostgres-row-api-test-suite 2023-02-06 09:12:13 +00:00
Martin McKeaveney d4a0e44b31 merge 2023-02-05 22:11:37 +00:00
adrinr 4eb0c07953 Merge branch 'feature/dependencies-image' into test/9339-sqlpostgres-row-api-test-suite 2023-02-02 10:12:33 +00:00
Rory Powell 71292d3786 Fix server build by removing unused dependency on file path in backend-core 2023-02-02 09:26:39 +00:00
Michael Drury dfeb41ee53 Merge pull request #9493 from Budibase/fix/8236
CouchDB integration fixes
2023-02-01 13:55:03 +00:00
mike12345567 048cf8f188 PR comments. 2023-02-01 13:01:38 +00:00
melohagan 7ce31d64cb Fix/elastic search delete (#9492)
* Make sure json param isn't included in delete

* lint
2023-02-01 12:47:38 +00:00
mike12345567 f4379fcb4f Updates to use our new Nano layer for CouchDB integration rather than PouchDB. 2023-01-31 19:49:31 +00:00
mike12345567 c2eb8fb976 Update to cover the authentication for REST, replacing it with secret value and converting to password field, as well as minor update to env dropdown to only be a password field when not containing an environment variable - #9480. 2023-01-30 18:50:35 +00:00
Rory Powell da2c809a09 Merge branch 'develop' into feature/environment-variables 2023-01-27 11:27:11 +00:00
melohagan 0daacf3425 Add fields for MongoDB SSL cert file paths (#8260)
* Added fields for tls certificate files

* lint

* Only include cert fields if SELF_HOSTED

* lint

* Refactor getSchema function

* Add datasource field group with accordion

* Handle no display column on fieldGroup field

* Override text transform accordian header

* Renamed from TLS to SSL in UI config

* readable flag

* Add accordion component

* Refactor
2023-01-23 16:46:02 +00:00
melohagan 19696fb1fe Treat bigint as string (#8877)
* Make bigint string type

* Handle BigInt relationships

* remove unused var

* Revert CreateEditRelationship modal changes
2023-01-22 19:19:16 +00:00
melohagan 458ab7dadc SQL filtering: Always escape key in LIKE statements (#9278)
* Always escape key in like statements

* lint
2023-01-20 14:03:14 +00:00
Adria Navarro 6bc658c1ff Fix types 2023-01-18 11:50:00 +00:00
mike12345567 fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
Peter Clement 117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
mike12345567 d27674de5c Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
mike12345567 c479a7da2f Fixing minor Typescript issue, some old requires. 2023-01-11 18:16:30 +00:00
mike12345567 69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
mike12345567 3cd097a7f1 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-05 17:04:24 +00:00
Mel O'Hagan b70fdf907a Cast bit buffer as boolean 2023-01-04 15:18:53 +00:00
Martin McKeaveney 72573c818b pulling from master 2022-12-19 18:54:58 +00:00
melohagan 1b74895abc SQL server relationship fix for tables in schema (#9103)
* Add schema to LEFT JOIN

* lint
2022-12-19 18:12:05 +00:00
Martin McKeaveney 84ab7862d1 fixes for google sheets, admin checklist, and deleting an app from API (#8846)
* fixes for google sheets, admin checklist, and deleting an app from API

* code review

* splitting unpublish endpoint, moving deploy endpoint to applications controller. Still to do public API work and move deployment controller into application controller

* updating REST method for unpublish in API test

* unpublish and publish endpoint on public API, delete endpoint unpublishes and deletes app

* removing skip_setup from prodAppDb call

* removing commented code

* unit tests and open API spec updates

* unpublish, publish unit tests - delete still in progress

* remove line updating app name in API test

* unit tests

* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

* v2.2.4

* Update pro version to 2.2.4

* lock changes (#9047)

* v2.2.5

* Update pro version to 2.2.5

* Make looping arrow point in right direction (#9053)

* v2.2.6

* Update pro version to 2.2.6

* Types/attaching license to account (#9065)

* adding license type to account

* removing planDuration

* v2.2.7

* Update pro version to 2.2.7

* Environment variable type coercion fix (#9074)

* Environment variable type coercion fix

* Update .gitignore

* v2.2.8

* Update pro version to 2.2.8

* tests passing

* all tests passing, updates to public API response

* update unpublish call to return 204, openAPI spec and unit

* fixing API tests

Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-19 13:18:00 +00:00
Rory Powell 786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
mike12345567 0ca1c359a5 Final fix for #8882 - adding text to show the error - as well as fixing an issue with many to many updating correctly. 2022-12-02 17:28:37 +00:00
mike12345567 2a51091ffb Adding some null controls. 2022-12-02 16:17:56 +00:00
Michael Drury 4f4eb4da26 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-29 11:13:54 +00:00
Mel O'Hagan 11ae382af0 lint 2022-11-28 12:05:19 +00:00
Mel O'Hagan ba10756119 Don't parse number arrays as date 2022-11-28 12:04:44 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
Mel O'Hagan 5aba8e4a65 Added readable prop to aggregate function 2022-11-08 14:31:36 +00:00
melohagan cc44430638 Merge pull request #7521 from Budibase/feature/s3-bucket-connector
S3 bucket connector improvements
2022-11-01 09:56:47 +00:00
chaoticefx a45c16bc42 Cleaned up config declaration in constructor 2022-11-01 09:08:17 +08:00
chaoticefx 46a0197cd6 Ran npx prettier against elasticsearch.ts 2022-10-27 16:24:01 +08:00
chaoticefx ac9c52e70f Fixed code styling 2022-10-27 15:52:49 +08:00
Mel O'Hagan 86fef02567 lint 2022-10-26 16:44:25 +01:00
Mel O'Hagan d69abc4569 Merge branch 'develop' into feature/s3-bucket-connector 2022-10-26 16:37:11 +01:00
chaoticefx 1ac362f90c Implemented custom ssl config in elasticsearch.ts 2022-10-25 11:59:34 +08:00
Martin McKeaveney 975134caea Merge pull request #8295 from weslien/patch-8294
Fix arangoDB connector
2022-10-20 22:01:07 +01:00
Gustav Weslien e8b9b196d0 Fix arangoDB connector :
https://github.com/Budibase/budibase/issues/8294#issue-1412041907
2022-10-17 20:56:30 +02:00
deanhannigan aa1293f15a Merge pull request #8153 from Budibase/feature/qr-barcode-reader
Feature/qr barcode reader
2022-10-13 16:43:54 +01:00
melohagan 9c8aa0dd84 Merge pull request #8117 from Budibase/lab/mongodb
Add aggregate method to MongoDB
2022-10-13 16:32:30 +01:00
Dean 7125e3f6e3 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-13 16:16:28 +01:00
Mel O'Hagan 10367dfb43 Rename flow to pipeline 2022-10-13 13:05:45 +01:00
Mel O'Hagan 10e6c61081 lint 2022-10-12 18:55:22 +01:00
Mel O'Hagan 436cbed74b Add support for ObjectId in aggregations 2022-10-12 18:54:53 +01:00
Mel O'Hagan 9f60a6c485 Allow template to be used when changed body blank 2022-10-12 16:20:11 +01:00
Mel O'Hagan 53475f1312 Add all the stage templates 2022-10-12 16:03:51 +01:00
Mel O'Hagan 33c36c1112 Include stage templates 2022-10-12 15:31:53 +01:00
Mel O'Hagan 4c781eb667 Merge branch 'develop' into lab/mongodb 2022-10-12 11:19:50 +01:00
Rory Powell e29330093b Fix tests 2022-10-12 11:18:57 +01:00
Rory Powell c7dac5f417 Deprecate legacyHttpParser, fix rest tests 2022-10-12 11:05:16 +01:00
Mel O'Hagan c67c784e15 Merge branch 'develop' into lab/mongodb 2022-10-12 10:29:27 +01:00
Rory Powell 6e083c85a4 Fix linting 2022-10-12 10:25:02 +01:00
Rory Powell 7c9767e186 Merge pull request #7716 from adamkingsbury/rejectUnauthorized
Reject unauthorized
2022-10-12 10:22:01 +01:00
Rory Powell d2882a3779 Merge branch 'develop' into rejectUnauthorized 2022-10-12 10:06:50 +01:00
Martin McKeaveney 5838eb70b4 turn on gsheets 2022-10-10 09:02:17 +01:00
Dean c09154b03e Renamed the 'Scanned Code' field type to 'Barcode/QR'. The component is also now listed as 'Barcode/QR Scanner'. Minor fix to include longform text columns in the table csv import list 2022-10-07 11:00:25 +01:00
Dean e251c914ff Review feedback changes. Changed 'Code' labelling to 'Scanned Code' 2022-10-06 13:02:17 +01:00
Dean 2ec21741d1 Initial commit of QR Reader field 2022-10-05 09:28:07 +01:00
Mel O'Hagan a95f32c5de Rename actionTypes to actionType 2022-10-04 11:29:13 +01:00
Mel O'Hagan 9580e83ae3 lint 2022-10-04 11:03:54 +01:00
Mel O'Hagan 55c112677e Added support for JSON array stages 2022-10-04 11:03:24 +01:00
Mel O'Hagan b3d549a170 Add aggregate method. Push results. 2022-10-03 20:08:47 +01:00
Mel O'Hagan b6eebad75f Fix types 2022-10-03 19:10:01 +01:00
Mel O'Hagan a9212a56ed lint 2022-10-03 17:18:16 +01:00
Mel O'Hagan 0d08eb60c5 Merge branch 'develop' into lab/mongodb 2022-10-03 17:10:21 +01:00
mike12345567 476bb79c29 Quick fix for development machines, when running Budibase development stack on systems that are not oracle compatiable it would fail to start due to the lack of dependency. 2022-09-30 15:19:34 +01:00
mike12345567 38f49dad2a Merge branch 'master' of github.com:Budibase/budibase into feature/plugin-icons 2022-09-30 11:17:43 +01:00
mike12345567 a3b7d7f8a9 Fix for #8023 - moving Oracle integration to ESM import rather than CJS. 2022-09-30 10:52:00 +01:00
mike12345567 95136a54f2 Adding ability for datasource plugins to have a custom icon svg. 2022-09-29 19:30:53 +01:00
Mel O'Hagan 1afc0fbdf8 Support multiple statements 2022-09-22 16:36:19 +01:00
mike12345567 416a2c999f Fixing issue with plugin import for datasources - extract the integration correctly. 2022-09-13 12:16:00 +01:00
Michael Drury 99e9bdea6b Merge pull request #7574 from Budibase/bug/sev4/delete-formula-column
Exclude formula columns from Sql drop column
2022-09-13 11:27:59 +02:00
Rory Powell 45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
Martin McKeaveney 35274583c6 Merge pull request #7734 from Budibase/fix/cr-header
Fix/cr header
2022-09-12 12:22:35 +01:00
Martin McKeaveney 37fa940661 adding friendlyname for legacy HTTP support 2022-09-12 10:18:18 +01:00
Martin McKeaveney 6bdf103e11 provide fix for CR header and backwards compatibility with legacy servers 2022-09-12 10:00:05 +01:00
Martin McKeaveney 6983d94d90 adding insecure HTTP parser 2022-09-12 09:27:16 +01:00
adamkingsbury 2eca405559 lint fix 2022-09-10 00:25:35 +01:00
adamkingsbury 4cd182844a Fix issue with query string on sensitive APIs 2022-09-10 00:14:57 +01:00
adamkingsbury e33ea75ee0 Implement rejectUnauthorised logic 2022-09-10 00:10:09 +01:00
mike12345567 2686d50523 Fixing test cases. 2022-09-09 17:18:19 +01:00
mike12345567 2fb96b29c9 Encoding query string URI parameters for REST requests - #7683. 2022-09-07 17:31:15 +01:00
mike12345567 ca749aed86 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-09-07 12:40:45 +01:00
Mel O'Hagan 2cdd47042c lint 2022-09-05 18:31:20 +01:00
Mel O'Hagan 00f12698d7 type check 2022-09-05 18:31:12 +01:00
Mel O'Hagan 67f123d60f Parse incoming row as JSON 2022-09-05 18:31:03 +01:00
mike12345567 a5f475872d Updating plugins to not think about versions, only ever one version of each plugin by name, making plugins self host only and adding error checking for datasource implementations. 2022-09-02 19:32:15 +01:00
Martin McKeaveney 151d70ef43 improvements to redis connector - multi line pipelines and lowercase commands 2022-09-02 18:35:06 +01:00
Mel O'Hagan b29e9be026 Exclude formula columns from Sql drop column 2022-09-01 17:21:42 +01:00
mike12345567 f49d61bc5c Updating test cases to TS to get them working properly with the full TS implementations. 2022-08-31 19:21:45 +01:00
mike12345567 320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Mel O'Hagan b11b3c11fb lint 2022-08-30 19:56:38 +01:00
Mel O'Hagan 0e44703e95 Delete method S3 Bucket 2022-08-30 19:56:08 +01:00
Mel O'Hagan 088cf26b46 Create Bucket 2022-08-30 19:17:10 +01:00
Mel O'Hagan 3443e2cd48 Create WIP 2022-08-30 16:56:56 +01:00
Mel O'Hagan 0e219e1545 remove async 2022-08-30 15:19:18 +01:00
Mel O'Hagan 8c40394d35 Handle non-csv file error 2022-08-30 15:18:44 +01:00
Mel O'Hagan 1e70f6afb4 Promisify stream 2022-08-30 13:55:55 +01:00
Mel O'Hagan 9e864e07a9 WIP 2022-08-30 13:42:49 +01:00
Mel O'Hagan e2033898b0 Add additional params to listObjects 2022-08-30 11:17:11 +01:00
Martin McKeaveney 02c93071ee merge 2022-08-30 10:33:37 +01:00
Mel O'Hagan f2881fc714 Add delete button 2022-08-25 17:40:09 +01:00
Mel O'Hagan 52c8fda064 Add mongodb aggregate method 2022-08-25 17:30:47 +01:00
Martin McKeaveney 2470d711b0 fixing s3 outage errors and scoping AWS configuration to service level 2022-08-25 17:01:12 +01:00
Mel O'Hagan 8738beb907 Upgrade to mongodb@4.9 2022-08-25 11:02:46 +01:00
Mel O'Hagan 1e9234da8e lint 2022-08-23 15:33:30 +01:00
Mel O'Hagan bbc40b2d2c Generic handle objectid 2022-08-23 15:33:04 +01:00
mike12345567 2bb32253d8 Adding in hash handling for datasource plugins. 2022-08-18 15:21:55 +01:00
mike12345567 2aaff7576b Adding full flow for creating custom datasource. 2022-08-17 10:05:13 +01:00
mike12345567 51e06a9c7a Adding custom datasources to UI. 2022-08-15 18:38:09 +01:00
mike12345567 4683c57e02 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-15 16:17:54 +01:00
mike12345567 ae9ae26bd4 Merge branch 'develop' of github.com:Budibase/budibase into feature/multiselect-filters 2022-08-15 12:24:41 +01:00
mike12345567 970e7ee3e7 Making integrations more like what custom integrations look like (to simplify integration). 2022-08-12 17:03:06 +01:00
mike12345567 1c7f860184 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-11 16:28:46 +01:00
mike12345567 b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
mike12345567 1134b01f39 Moving all datasource types around - this is needed to make the SDK/Document types more accesible for the development datasource plugins. 2022-08-11 11:48:58 +01:00
Rory Powell c656b79e9b Merge branch 'develop' into merge-master 2022-08-10 15:29:46 +01:00
melohagan 964e1a2d5e Merge pull request #6895 from Budibase/bug/sev2/mongodb-fixes
Support ObjectId in MongoDB operators
2022-08-10 14:54:47 +01:00
Rory Powell 664cb2b0b0 Merge branch 'master' into develop 2022-08-10 14:36:49 +01:00
Mel O'Hagan ec28bb8c63 Fix unit test 2022-08-10 13:56:15 +01:00
Mel O'Hagan 785cdea396 Use display field 2022-08-10 13:54:56 +01:00
Mel O'Hagan 1109f1162c lint 2022-08-10 10:58:11 +01:00
Mel O'Hagan dc7566308e Ignore escaped double quotes within strings 2022-08-10 10:57:42 +01:00
Mel O'Hagan 9a10590414 lint 2022-08-09 17:28:21 +01:00
Mel O'Hagan 415f57e0ef Handle braces within quotes 2022-08-09 17:27:51 +01:00
Mel O'Hagan 55f53de412 Fix unit test 2022-08-09 15:54:08 +01:00
Mel O'Hagan 860880baf2 Rename to recordID 2022-08-09 14:59:05 +01:00
Mel O'Hagan 3323388b03 Add table field to Airtable update 2022-08-09 14:55:45 +01:00
Michael Drury f8e978f321 Merge pull request #7049 from Budibase/fix/2585
Updating filters to allow multiple uses of the same property and exposing allOr option
2022-08-09 11:00:38 +01:00
Mel O'Hagan 051779b013 lint 2022-08-08 21:57:36 +01:00
Mel O'Hagan 09a3052aa2 Nested braces parse fix added for MongoDB 2022-08-08 21:56:55 +01:00
Mel O'Hagan fe0163ac29 Bug fix findOneAndUpdate 2022-08-08 17:53:17 +01:00
Mel O'Hagan c289d72816 Add unit tests for ObjectId 2022-08-08 17:01:56 +01:00
Mel O'Hagan 4d217bfc04 Merge branch 'develop' into bug/sev2/mongodb-fixes 2022-08-08 15:15:03 +01:00
mike12345567 d14051bd62 Fixing test cases. 2022-08-03 18:20:07 +01:00
mike12345567 129c966226 Updating the filter system to allow adding multiple filter properties of the same name at once, as well as enabling the use of the allOr property from within the UI - resolves an old issue #2585. 2022-08-02 18:34:58 +01:00
mike12345567 4f01a7fb80 Merge branch 'master' of github.com:Budibase/budibase into fix/6737 2022-08-01 19:00:17 +01:00
mike12345567 de3ceeb119 Adding mechanism to allow displaying an error on data retrieval for tables. 2022-08-01 18:56:59 +01:00
mike12345567 87b583e51e Fix for #6737 - making it so that if a column is deleted externally tables can be re-fetched and this will be fixed. 2022-08-01 17:40:35 +01:00
Mel O'Hagan 2356d09022 Has any support SQL Server 2022-07-28 09:20:00 +01:00
Mel O'Hagan 26c8af3c1e SQL Server containsAny unit test 2022-07-27 16:40:07 +01:00
Mel O'Hagan 4abd984d99 Has any of filter Postgres 2022-07-27 16:37:29 +01:00
Mel O'Hagan 17bb56a772 Has any of MySQL filter 2022-07-27 13:19:47 +01:00
Mel O'Hagan 413bd55b94 Not Contains for SQL Server 2022-07-27 11:56:57 +01:00
Mel O'Hagan 69135d34a7 Not Contains Postgres filter 2022-07-27 11:49:45 +01:00
Mel O'Hagan ce9a6a7141 Not Contains filter for MySQL 2022-07-27 11:40:46 +01:00
Mel O'Hagan 47955b9b31 Fix unit tests 2022-07-26 16:58:01 +01:00
Mel O'Hagan 74d6687a95 Has all of SQLServer 2022-07-26 16:45:05 +01:00
Mel O'Hagan a85ad2ced6 MySQL has all of 2022-07-26 16:16:46 +01:00
Mel O'Hagan 76e4ffc04d Postgres has all of 2022-07-26 15:59:49 +01:00
Mel O'Hagan 4cc0a327a0 lint 2022-07-26 11:38:34 +01:00
Mel O'Hagan 71a55eb288 Support ObjectId in operator blocks 2022-07-26 10:53:53 +01:00
Mel O'Hagan 3ba1ce80dd Added unit tests for contains filter 2022-07-21 10:28:54 +01:00
Mel O'Hagan 0c88195ab0 Handle numeric types Postgres 2022-07-19 18:34:30 +01:00
Mel O'Hagan 58c02ee05d Prettier 2022-07-19 18:04:27 +01:00
Mel O'Hagan ed0bd07732 Added contains support for datasource pluses 2022-07-19 17:25:41 +01:00
mike12345567 cff42331bc Fix for ARM processors. 2022-07-13 12:37:55 +01:00
Mel O'Hagan 73e2eac2c2 Don't try to check externalType of related tables 2022-07-05 16:59:32 +01:00
Dean ac1df878d4 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-29 18:50:14 +01:00
mike12345567 a625fa573d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-24 17:50:55 +01:00
Andrew Kingston a429c16521 Merge pull request #6443 from Budibase/datasource-labels
Datasource labels
2022-06-23 15:32:28 +01:00
Mel O'Hagan 633a701b0c Added Knex.Raw to return type 2022-06-23 13:09:22 +01:00
Andrew Kingston 8bfd54bd80 Add types to datasources 2022-06-23 11:35:57 +01:00
Mel O'Hagan ece1e7533d Refactor - simplify regex and use enum 2022-06-23 09:41:43 +01:00
Mel O'Hagan 9603a92c2c Only cast money as numeric for Postgres 2022-06-22 16:13:02 +01:00
Mel O'Hagan 8154fe3445 Use raw sql to get money type as numeric 2022-06-22 15:58:15 +01:00
Mel O'Hagan a888d9a273 Added external types to ds+ schemas 2022-06-20 18:08:30 +01:00
Mel O'Hagan eca2fe0b50 Include external SQL server type in schema 2022-06-20 16:49:58 +01:00
Dean 5196fde134 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-20 09:09:21 +01:00
Mel O'Hagan fcf9ed6df7 Add empty options if missing for delete 2022-06-17 16:54:23 +01:00
Dean 28f722cf4b Fixes for Rest API request UI. Rest test fixes for XML API request body. Fix for raw XML api request body parsing issue. General fixes for query testing. 2022-06-17 12:00:42 +01:00
mike12345567 7050ffc2cb Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-17 11:41:34 +01:00
Dean 42cd5e2c63 Fix to ignore global rest query headers when they are not configured. 2022-06-15 10:09:47 +01:00
Rory Powell af8b1ff908 Merge branch 'release' into merge-release 2022-06-13 11:58:14 +01:00
Rory Powell 4dc5cfc5a7 Merge branch 'release' into merge-release 2022-06-13 11:45:18 +01:00
Mel O'Hagan 23ae0df4df Remove duplicate equals 2022-06-10 15:52:28 +01:00
Mel O'Hagan 1155b9acdf Fix for privatekey newline 2022-06-10 14:15:25 +01:00
Mel O'Hagan dc28d685a8 Removed ServiceAccount to reduce confusion 2022-06-10 14:04:34 +01:00
Mel O'Hagan 9d58b951d8 Rename Firebase to Firestore 2022-06-08 12:05:29 +01:00
Andrew Kingston 0c50b82248 Account for types being undefined when running in a test env 2022-06-07 08:41:45 +01:00
Andrew Kingston 72397530ec Apply timezones patch from existing ignore-timezones branch 2022-06-07 08:31:00 +01:00
Martin McKeaveney d5540bbd57 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Mel O'Hagan 8893806c44 Using snowflake-promise 2022-06-01 11:41:41 +01:00
Mel O'Hagan a217d04d6a Revert "Datasource plus - build schema"
This reverts commit 11a9138bdb.
2022-06-01 09:36:42 +01:00
Mel O'Hagan 192663c94a Revert "primaryKey name fix"
This reverts commit 9c408fda9c.
2022-06-01 09:36:28 +01:00
Mel O'Hagan 9c408fda9c primaryKey name fix 2022-05-31 14:47:27 +01:00
Mel O'Hagan 11a9138bdb Datasource plus - build schema 2022-05-31 14:39:53 +01:00
Mel O'Hagan 534cc9e6c8 CRUD added for snowflake 2022-05-31 13:10:16 +01:00
Mel O'Hagan fe3a774db3 Added types and error handling 2022-05-31 11:58:03 +01:00
Mel O'Hagan 570aeecdc3 Added Snowflake integration 2022-05-30 21:13:45 +01:00
mike12345567 152f0bb0af Opening connection for building schema. 2022-05-20 17:43:47 +01:00
mike12345567 50445f6990 Fix for Postgres connections, seemed to be some issues with out of order, connections not opening in time. 2022-05-20 17:41:27 +01:00
Mel O'Hagan 986ab1d35a Improve parseQueryParams regex 2022-05-17 12:11:43 +01:00
Mel O'Hagan 0f4aaa4779 Parse params if needed 2022-05-16 22:44:38 +01:00
Mel O'Hagan 0da9ee0a56 Using mongodb types 2022-05-16 09:50:47 +01:00
Mel O'Hagan 7b570fea22 Removed unused aws Object import 2022-05-16 08:43:27 +01:00
Mel O'Hagan e3883d480d Lowercase the object typo 2022-05-16 08:42:09 +01:00
Mel O'Hagan 81f16aa7ce Check type is string before match 2022-05-13 21:25:41 +01:00
Mel O'Hagan 0d3ab9ae33 Fix test for update 2022-05-13 15:57:37 +01:00
Mel O'Hagan c2fc1598fa Null pointer fix 2022-05-13 15:57:15 +01:00
Mel O'Hagan 035a7ee625 MongoDb Delete fix 2022-05-13 15:56:57 +01:00
Mel O'Hagan f40967784f Fixed update 2022-05-13 15:56:49 +01:00
Mel O'Hagan dd6093a7ae Create ObjectIds from matching string 2022-05-13 15:56:32 +01:00
Michael Drury e7bb4a1fb7 Merge pull request #5707 from Budibase/fix/mike-fixes-04-05
SQL columns with spaces LIKE fix and dynamic REST variable UI change
2022-05-11 10:34:36 +01:00
Martin McKeaveney db0ffe4ac7 more strategic connection closing in pg 2022-05-10 11:13:40 +01:00
Martin McKeaveney 8899527da8 merge 2022-05-05 12:45:09 +01:00
mike12345567 b4b65362f9 Fix for #5669 comment, when using SQL tables with spaces in names, we use a raw knex function for like to achieve lower case searching, this needs to handle spaces in columns and delimiting. 2022-05-04 16:13:54 +01:00
mike12345567 d090f2a8aa Fix for #5553 - when importing for SQL databases attempt to manage date and time only column times, handle these when displaying in tables and when filtering. 2022-05-03 14:11:06 +01:00
mike12345567 6b4377c932 Fix for #5612 - stop some formats of string being in-correctly parsed as dates by MySQL - disable type coercion for data source plus mysql tables (knex converts). 2022-04-29 16:47:43 +01:00
mike12345567 9ea6199eba Fixing issue #5594 - allowing use of double underscores in table names for SQL. 2022-04-29 16:22:11 +01:00
Martin McKeaveney e5df157927 adding close to buildSchema 2022-04-29 10:47:42 +01:00
Martin McKeaveney 2a7fa4d8f7 merge 2022-04-29 00:05:43 +01:00
Martin McKeaveney 6bc6000a14 remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney 97db271fce firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567 6d6e83f7c8 Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567 6556a41a5a Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney a91cf354b6 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney 25703889a3 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney a3970d6f45 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney bbce5a9c7f Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 31412cb83b moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney 84d2bb3cf5 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury 141f9ed9dc Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury 94419024a4 Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 d36fc9c7ba Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney 79a8a63ede use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567 345bbf603c Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567 5180603374 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567 94720c10aa Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567 2accebec7f Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney deeaf88f45 Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567 39182cfbc0 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney 417ba977fa redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney 6e5bcb224c redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney 6c878e71f3 Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney 034408b3c2 merge with master 2022-03-30 15:44:22 +01:00
mike12345567 258434b3ed Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney 457a4812cf re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney aed9bfc728 fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell 69b2b38aea Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 25192bad3b ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston 2242044f3b Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567 5d9a34963a Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney dd1863d4c9 Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens 19ec76c49d Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 1c104d6fa5 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston 20fe6c35ba Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 84f1325320 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury ffbf3a2eca Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 07bcaf2d0a Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 0b7919cd3d Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens b987dc345f finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens 792021616c fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens c2d48bebd7 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 8185227ff1 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 7f9334ae5e Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a4ed8fe5e8 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 e9ff42bf76 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 bf63ea29f6 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 63bb4f34c4 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 64e65e25ec Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 ba3940f825 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 9f6635045a Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 546bbc2ff6 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 1b45a9190d Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 7109b34ea3 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 f77b596a07 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney d1cebc61a9 merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney a495050871 merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney d3c515eb8b only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 f61e15594b Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 aa204a9292 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 168a126e2a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney c11e26cb2e merge 2022-02-01 11:22:14 +01:00