Commit Graph

903 Commits

Author SHA1 Message Date
mike12345567 cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
Mel O'Hagan 5aba8e4a65 Added readable prop to aggregate function 2022-11-08 14:31:36 +00:00
melohagan cc44430638 Merge pull request #7521 from Budibase/feature/s3-bucket-connector
S3 bucket connector improvements
2022-11-01 09:56:47 +00:00
chaoticefx a45c16bc42 Cleaned up config declaration in constructor 2022-11-01 09:08:17 +08:00
chaoticefx 46a0197cd6 Ran npx prettier against elasticsearch.ts 2022-10-27 16:24:01 +08:00
chaoticefx ac9c52e70f Fixed code styling 2022-10-27 15:52:49 +08:00
Mel O'Hagan 86fef02567 lint 2022-10-26 16:44:25 +01:00
Mel O'Hagan d69abc4569 Merge branch 'develop' into feature/s3-bucket-connector 2022-10-26 16:37:11 +01:00
chaoticefx 1ac362f90c Implemented custom ssl config in elasticsearch.ts 2022-10-25 11:59:34 +08:00
Martin McKeaveney 975134caea Merge pull request #8295 from weslien/patch-8294
Fix arangoDB connector
2022-10-20 22:01:07 +01:00
Gustav Weslien e8b9b196d0 Fix arangoDB connector :
https://github.com/Budibase/budibase/issues/8294#issue-1412041907
2022-10-17 20:56:30 +02:00
deanhannigan aa1293f15a Merge pull request #8153 from Budibase/feature/qr-barcode-reader
Feature/qr barcode reader
2022-10-13 16:43:54 +01:00
melohagan 9c8aa0dd84 Merge pull request #8117 from Budibase/lab/mongodb
Add aggregate method to MongoDB
2022-10-13 16:32:30 +01:00
Dean 7125e3f6e3 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-13 16:16:28 +01:00
Mel O'Hagan 10367dfb43 Rename flow to pipeline 2022-10-13 13:05:45 +01:00
Mel O'Hagan 10e6c61081 lint 2022-10-12 18:55:22 +01:00
Mel O'Hagan 436cbed74b Add support for ObjectId in aggregations 2022-10-12 18:54:53 +01:00
Mel O'Hagan 9f60a6c485 Allow template to be used when changed body blank 2022-10-12 16:20:11 +01:00
Mel O'Hagan 53475f1312 Add all the stage templates 2022-10-12 16:03:51 +01:00
Mel O'Hagan 33c36c1112 Include stage templates 2022-10-12 15:31:53 +01:00
Mel O'Hagan 4c781eb667 Merge branch 'develop' into lab/mongodb 2022-10-12 11:19:50 +01:00
Rory Powell e29330093b Fix tests 2022-10-12 11:18:57 +01:00
Rory Powell c7dac5f417 Deprecate legacyHttpParser, fix rest tests 2022-10-12 11:05:16 +01:00
Mel O'Hagan c67c784e15 Merge branch 'develop' into lab/mongodb 2022-10-12 10:29:27 +01:00
Rory Powell 6e083c85a4 Fix linting 2022-10-12 10:25:02 +01:00
Rory Powell 7c9767e186 Merge pull request #7716 from adamkingsbury/rejectUnauthorized
Reject unauthorized
2022-10-12 10:22:01 +01:00
Rory Powell d2882a3779 Merge branch 'develop' into rejectUnauthorized 2022-10-12 10:06:50 +01:00
Martin McKeaveney 5838eb70b4 turn on gsheets 2022-10-10 09:02:17 +01:00
Dean c09154b03e Renamed the 'Scanned Code' field type to 'Barcode/QR'. The component is also now listed as 'Barcode/QR Scanner'. Minor fix to include longform text columns in the table csv import list 2022-10-07 11:00:25 +01:00
Dean e251c914ff Review feedback changes. Changed 'Code' labelling to 'Scanned Code' 2022-10-06 13:02:17 +01:00
Dean 2ec21741d1 Initial commit of QR Reader field 2022-10-05 09:28:07 +01:00
Mel O'Hagan a95f32c5de Rename actionTypes to actionType 2022-10-04 11:29:13 +01:00
Mel O'Hagan 9580e83ae3 lint 2022-10-04 11:03:54 +01:00
Mel O'Hagan 55c112677e Added support for JSON array stages 2022-10-04 11:03:24 +01:00
Mel O'Hagan b3d549a170 Add aggregate method. Push results. 2022-10-03 20:08:47 +01:00
Mel O'Hagan b6eebad75f Fix types 2022-10-03 19:10:01 +01:00
Mel O'Hagan a9212a56ed lint 2022-10-03 17:18:16 +01:00
Mel O'Hagan 0d08eb60c5 Merge branch 'develop' into lab/mongodb 2022-10-03 17:10:21 +01:00
mike12345567 476bb79c29 Quick fix for development machines, when running Budibase development stack on systems that are not oracle compatiable it would fail to start due to the lack of dependency. 2022-09-30 15:19:34 +01:00
mike12345567 38f49dad2a Merge branch 'master' of github.com:Budibase/budibase into feature/plugin-icons 2022-09-30 11:17:43 +01:00
mike12345567 a3b7d7f8a9 Fix for #8023 - moving Oracle integration to ESM import rather than CJS. 2022-09-30 10:52:00 +01:00
mike12345567 95136a54f2 Adding ability for datasource plugins to have a custom icon svg. 2022-09-29 19:30:53 +01:00
Mel O'Hagan 1afc0fbdf8 Support multiple statements 2022-09-22 16:36:19 +01:00
mike12345567 416a2c999f Fixing issue with plugin import for datasources - extract the integration correctly. 2022-09-13 12:16:00 +01:00
Michael Drury 99e9bdea6b Merge pull request #7574 from Budibase/bug/sev4/delete-formula-column
Exclude formula columns from Sql drop column
2022-09-13 11:27:59 +02:00
Rory Powell 45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
Martin McKeaveney 35274583c6 Merge pull request #7734 from Budibase/fix/cr-header
Fix/cr header
2022-09-12 12:22:35 +01:00
Martin McKeaveney 37fa940661 adding friendlyname for legacy HTTP support 2022-09-12 10:18:18 +01:00
Martin McKeaveney 6bdf103e11 provide fix for CR header and backwards compatibility with legacy servers 2022-09-12 10:00:05 +01:00
Martin McKeaveney 6983d94d90 adding insecure HTTP parser 2022-09-12 09:27:16 +01:00
adamkingsbury 2eca405559 lint fix 2022-09-10 00:25:35 +01:00
adamkingsbury 4cd182844a Fix issue with query string on sensitive APIs 2022-09-10 00:14:57 +01:00
adamkingsbury e33ea75ee0 Implement rejectUnauthorised logic 2022-09-10 00:10:09 +01:00
mike12345567 2686d50523 Fixing test cases. 2022-09-09 17:18:19 +01:00
mike12345567 2fb96b29c9 Encoding query string URI parameters for REST requests - #7683. 2022-09-07 17:31:15 +01:00
mike12345567 ca749aed86 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-09-07 12:40:45 +01:00
Mel O'Hagan 2cdd47042c lint 2022-09-05 18:31:20 +01:00
Mel O'Hagan 00f12698d7 type check 2022-09-05 18:31:12 +01:00
Mel O'Hagan 67f123d60f Parse incoming row as JSON 2022-09-05 18:31:03 +01:00
mike12345567 a5f475872d Updating plugins to not think about versions, only ever one version of each plugin by name, making plugins self host only and adding error checking for datasource implementations. 2022-09-02 19:32:15 +01:00
Martin McKeaveney 151d70ef43 improvements to redis connector - multi line pipelines and lowercase commands 2022-09-02 18:35:06 +01:00
Mel O'Hagan b29e9be026 Exclude formula columns from Sql drop column 2022-09-01 17:21:42 +01:00
mike12345567 f49d61bc5c Updating test cases to TS to get them working properly with the full TS implementations. 2022-08-31 19:21:45 +01:00
mike12345567 320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Mel O'Hagan b11b3c11fb lint 2022-08-30 19:56:38 +01:00
Mel O'Hagan 0e44703e95 Delete method S3 Bucket 2022-08-30 19:56:08 +01:00
Mel O'Hagan 088cf26b46 Create Bucket 2022-08-30 19:17:10 +01:00
Mel O'Hagan 3443e2cd48 Create WIP 2022-08-30 16:56:56 +01:00
Mel O'Hagan 0e219e1545 remove async 2022-08-30 15:19:18 +01:00
Mel O'Hagan 8c40394d35 Handle non-csv file error 2022-08-30 15:18:44 +01:00
Mel O'Hagan 1e70f6afb4 Promisify stream 2022-08-30 13:55:55 +01:00
Mel O'Hagan 9e864e07a9 WIP 2022-08-30 13:42:49 +01:00
Mel O'Hagan e2033898b0 Add additional params to listObjects 2022-08-30 11:17:11 +01:00
Martin McKeaveney 02c93071ee merge 2022-08-30 10:33:37 +01:00
Mel O'Hagan f2881fc714 Add delete button 2022-08-25 17:40:09 +01:00
Mel O'Hagan 52c8fda064 Add mongodb aggregate method 2022-08-25 17:30:47 +01:00
Martin McKeaveney 2470d711b0 fixing s3 outage errors and scoping AWS configuration to service level 2022-08-25 17:01:12 +01:00
Mel O'Hagan 8738beb907 Upgrade to mongodb@4.9 2022-08-25 11:02:46 +01:00
Mel O'Hagan 1e9234da8e lint 2022-08-23 15:33:30 +01:00
Mel O'Hagan bbc40b2d2c Generic handle objectid 2022-08-23 15:33:04 +01:00
mike12345567 2bb32253d8 Adding in hash handling for datasource plugins. 2022-08-18 15:21:55 +01:00
mike12345567 2aaff7576b Adding full flow for creating custom datasource. 2022-08-17 10:05:13 +01:00
mike12345567 51e06a9c7a Adding custom datasources to UI. 2022-08-15 18:38:09 +01:00
mike12345567 4683c57e02 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-15 16:17:54 +01:00
mike12345567 ae9ae26bd4 Merge branch 'develop' of github.com:Budibase/budibase into feature/multiselect-filters 2022-08-15 12:24:41 +01:00
mike12345567 970e7ee3e7 Making integrations more like what custom integrations look like (to simplify integration). 2022-08-12 17:03:06 +01:00
mike12345567 1c7f860184 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-11 16:28:46 +01:00
mike12345567 b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
mike12345567 1134b01f39 Moving all datasource types around - this is needed to make the SDK/Document types more accesible for the development datasource plugins. 2022-08-11 11:48:58 +01:00
Rory Powell c656b79e9b Merge branch 'develop' into merge-master 2022-08-10 15:29:46 +01:00
melohagan 964e1a2d5e Merge pull request #6895 from Budibase/bug/sev2/mongodb-fixes
Support ObjectId in MongoDB operators
2022-08-10 14:54:47 +01:00
Rory Powell 664cb2b0b0 Merge branch 'master' into develop 2022-08-10 14:36:49 +01:00
Mel O'Hagan ec28bb8c63 Fix unit test 2022-08-10 13:56:15 +01:00
Mel O'Hagan 785cdea396 Use display field 2022-08-10 13:54:56 +01:00
Mel O'Hagan 1109f1162c lint 2022-08-10 10:58:11 +01:00
Mel O'Hagan dc7566308e Ignore escaped double quotes within strings 2022-08-10 10:57:42 +01:00
Mel O'Hagan 9a10590414 lint 2022-08-09 17:28:21 +01:00
Mel O'Hagan 415f57e0ef Handle braces within quotes 2022-08-09 17:27:51 +01:00
Mel O'Hagan 55f53de412 Fix unit test 2022-08-09 15:54:08 +01:00
Mel O'Hagan 860880baf2 Rename to recordID 2022-08-09 14:59:05 +01:00
Mel O'Hagan 3323388b03 Add table field to Airtable update 2022-08-09 14:55:45 +01:00
Michael Drury f8e978f321 Merge pull request #7049 from Budibase/fix/2585
Updating filters to allow multiple uses of the same property and exposing allOr option
2022-08-09 11:00:38 +01:00
Mel O'Hagan 051779b013 lint 2022-08-08 21:57:36 +01:00
Mel O'Hagan 09a3052aa2 Nested braces parse fix added for MongoDB 2022-08-08 21:56:55 +01:00
Mel O'Hagan fe0163ac29 Bug fix findOneAndUpdate 2022-08-08 17:53:17 +01:00
Mel O'Hagan c289d72816 Add unit tests for ObjectId 2022-08-08 17:01:56 +01:00
Mel O'Hagan 4d217bfc04 Merge branch 'develop' into bug/sev2/mongodb-fixes 2022-08-08 15:15:03 +01:00
mike12345567 d14051bd62 Fixing test cases. 2022-08-03 18:20:07 +01:00
mike12345567 129c966226 Updating the filter system to allow adding multiple filter properties of the same name at once, as well as enabling the use of the allOr property from within the UI - resolves an old issue #2585. 2022-08-02 18:34:58 +01:00
mike12345567 4f01a7fb80 Merge branch 'master' of github.com:Budibase/budibase into fix/6737 2022-08-01 19:00:17 +01:00
mike12345567 de3ceeb119 Adding mechanism to allow displaying an error on data retrieval for tables. 2022-08-01 18:56:59 +01:00
mike12345567 87b583e51e Fix for #6737 - making it so that if a column is deleted externally tables can be re-fetched and this will be fixed. 2022-08-01 17:40:35 +01:00
Mel O'Hagan 2356d09022 Has any support SQL Server 2022-07-28 09:20:00 +01:00
Mel O'Hagan 26c8af3c1e SQL Server containsAny unit test 2022-07-27 16:40:07 +01:00
Mel O'Hagan 4abd984d99 Has any of filter Postgres 2022-07-27 16:37:29 +01:00
Mel O'Hagan 17bb56a772 Has any of MySQL filter 2022-07-27 13:19:47 +01:00
Mel O'Hagan 413bd55b94 Not Contains for SQL Server 2022-07-27 11:56:57 +01:00
Mel O'Hagan 69135d34a7 Not Contains Postgres filter 2022-07-27 11:49:45 +01:00
Mel O'Hagan ce9a6a7141 Not Contains filter for MySQL 2022-07-27 11:40:46 +01:00
Mel O'Hagan 47955b9b31 Fix unit tests 2022-07-26 16:58:01 +01:00
Mel O'Hagan 74d6687a95 Has all of SQLServer 2022-07-26 16:45:05 +01:00
Mel O'Hagan a85ad2ced6 MySQL has all of 2022-07-26 16:16:46 +01:00
Mel O'Hagan 76e4ffc04d Postgres has all of 2022-07-26 15:59:49 +01:00
Mel O'Hagan 4cc0a327a0 lint 2022-07-26 11:38:34 +01:00
Mel O'Hagan 71a55eb288 Support ObjectId in operator blocks 2022-07-26 10:53:53 +01:00
Mel O'Hagan 3ba1ce80dd Added unit tests for contains filter 2022-07-21 10:28:54 +01:00
Mel O'Hagan 0c88195ab0 Handle numeric types Postgres 2022-07-19 18:34:30 +01:00
Mel O'Hagan 58c02ee05d Prettier 2022-07-19 18:04:27 +01:00
Mel O'Hagan ed0bd07732 Added contains support for datasource pluses 2022-07-19 17:25:41 +01:00
mike12345567 cff42331bc Fix for ARM processors. 2022-07-13 12:37:55 +01:00
Mel O'Hagan 73e2eac2c2 Don't try to check externalType of related tables 2022-07-05 16:59:32 +01:00
Dean ac1df878d4 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-29 18:50:14 +01:00
mike12345567 a625fa573d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-24 17:50:55 +01:00
Andrew Kingston a429c16521 Merge pull request #6443 from Budibase/datasource-labels
Datasource labels
2022-06-23 15:32:28 +01:00
Mel O'Hagan 633a701b0c Added Knex.Raw to return type 2022-06-23 13:09:22 +01:00
Andrew Kingston 8bfd54bd80 Add types to datasources 2022-06-23 11:35:57 +01:00
Mel O'Hagan ece1e7533d Refactor - simplify regex and use enum 2022-06-23 09:41:43 +01:00
Mel O'Hagan 9603a92c2c Only cast money as numeric for Postgres 2022-06-22 16:13:02 +01:00
Mel O'Hagan 8154fe3445 Use raw sql to get money type as numeric 2022-06-22 15:58:15 +01:00
Mel O'Hagan a888d9a273 Added external types to ds+ schemas 2022-06-20 18:08:30 +01:00
Mel O'Hagan eca2fe0b50 Include external SQL server type in schema 2022-06-20 16:49:58 +01:00
Dean 5196fde134 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-20 09:09:21 +01:00
Mel O'Hagan fcf9ed6df7 Add empty options if missing for delete 2022-06-17 16:54:23 +01:00
Dean 28f722cf4b Fixes for Rest API request UI. Rest test fixes for XML API request body. Fix for raw XML api request body parsing issue. General fixes for query testing. 2022-06-17 12:00:42 +01:00
mike12345567 7050ffc2cb Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-17 11:41:34 +01:00
Dean 42cd5e2c63 Fix to ignore global rest query headers when they are not configured. 2022-06-15 10:09:47 +01:00
Rory Powell af8b1ff908 Merge branch 'release' into merge-release 2022-06-13 11:58:14 +01:00
Rory Powell 4dc5cfc5a7 Merge branch 'release' into merge-release 2022-06-13 11:45:18 +01:00
Mel O'Hagan 23ae0df4df Remove duplicate equals 2022-06-10 15:52:28 +01:00
Mel O'Hagan 1155b9acdf Fix for privatekey newline 2022-06-10 14:15:25 +01:00
Mel O'Hagan dc28d685a8 Removed ServiceAccount to reduce confusion 2022-06-10 14:04:34 +01:00
Mel O'Hagan 9d58b951d8 Rename Firebase to Firestore 2022-06-08 12:05:29 +01:00
Andrew Kingston 0c50b82248 Account for types being undefined when running in a test env 2022-06-07 08:41:45 +01:00
Andrew Kingston 72397530ec Apply timezones patch from existing ignore-timezones branch 2022-06-07 08:31:00 +01:00
Martin McKeaveney d5540bbd57 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Mel O'Hagan 8893806c44 Using snowflake-promise 2022-06-01 11:41:41 +01:00
Mel O'Hagan a217d04d6a Revert "Datasource plus - build schema"
This reverts commit 11a9138bdb.
2022-06-01 09:36:42 +01:00
Mel O'Hagan 192663c94a Revert "primaryKey name fix"
This reverts commit 9c408fda9c.
2022-06-01 09:36:28 +01:00
Mel O'Hagan 9c408fda9c primaryKey name fix 2022-05-31 14:47:27 +01:00
Mel O'Hagan 11a9138bdb Datasource plus - build schema 2022-05-31 14:39:53 +01:00
Mel O'Hagan 534cc9e6c8 CRUD added for snowflake 2022-05-31 13:10:16 +01:00
Mel O'Hagan fe3a774db3 Added types and error handling 2022-05-31 11:58:03 +01:00
Mel O'Hagan 570aeecdc3 Added Snowflake integration 2022-05-30 21:13:45 +01:00
mike12345567 152f0bb0af Opening connection for building schema. 2022-05-20 17:43:47 +01:00
mike12345567 50445f6990 Fix for Postgres connections, seemed to be some issues with out of order, connections not opening in time. 2022-05-20 17:41:27 +01:00
Mel O'Hagan 986ab1d35a Improve parseQueryParams regex 2022-05-17 12:11:43 +01:00
Mel O'Hagan 0f4aaa4779 Parse params if needed 2022-05-16 22:44:38 +01:00
Mel O'Hagan 0da9ee0a56 Using mongodb types 2022-05-16 09:50:47 +01:00
Mel O'Hagan 7b570fea22 Removed unused aws Object import 2022-05-16 08:43:27 +01:00
Mel O'Hagan e3883d480d Lowercase the object typo 2022-05-16 08:42:09 +01:00
Mel O'Hagan 81f16aa7ce Check type is string before match 2022-05-13 21:25:41 +01:00
Mel O'Hagan 0d3ab9ae33 Fix test for update 2022-05-13 15:57:37 +01:00
Mel O'Hagan c2fc1598fa Null pointer fix 2022-05-13 15:57:15 +01:00
Mel O'Hagan 035a7ee625 MongoDb Delete fix 2022-05-13 15:56:57 +01:00
Mel O'Hagan f40967784f Fixed update 2022-05-13 15:56:49 +01:00
Mel O'Hagan dd6093a7ae Create ObjectIds from matching string 2022-05-13 15:56:32 +01:00
Michael Drury e7bb4a1fb7 Merge pull request #5707 from Budibase/fix/mike-fixes-04-05
SQL columns with spaces LIKE fix and dynamic REST variable UI change
2022-05-11 10:34:36 +01:00
Martin McKeaveney db0ffe4ac7 more strategic connection closing in pg 2022-05-10 11:13:40 +01:00
Martin McKeaveney 8899527da8 merge 2022-05-05 12:45:09 +01:00
mike12345567 b4b65362f9 Fix for #5669 comment, when using SQL tables with spaces in names, we use a raw knex function for like to achieve lower case searching, this needs to handle spaces in columns and delimiting. 2022-05-04 16:13:54 +01:00
mike12345567 d090f2a8aa Fix for #5553 - when importing for SQL databases attempt to manage date and time only column times, handle these when displaying in tables and when filtering. 2022-05-03 14:11:06 +01:00
mike12345567 6b4377c932 Fix for #5612 - stop some formats of string being in-correctly parsed as dates by MySQL - disable type coercion for data source plus mysql tables (knex converts). 2022-04-29 16:47:43 +01:00
mike12345567 9ea6199eba Fixing issue #5594 - allowing use of double underscores in table names for SQL. 2022-04-29 16:22:11 +01:00
Martin McKeaveney e5df157927 adding close to buildSchema 2022-04-29 10:47:42 +01:00
Martin McKeaveney 2a7fa4d8f7 merge 2022-04-29 00:05:43 +01:00
Martin McKeaveney 6bc6000a14 remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney 97db271fce firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567 6d6e83f7c8 Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567 6556a41a5a Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney a91cf354b6 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney 25703889a3 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney a3970d6f45 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney bbce5a9c7f Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 31412cb83b moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney 84d2bb3cf5 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury 141f9ed9dc Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury 94419024a4 Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 d36fc9c7ba Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney 79a8a63ede use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567 345bbf603c Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567 5180603374 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567 94720c10aa Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567 2accebec7f Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney deeaf88f45 Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567 39182cfbc0 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney 417ba977fa redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney 6e5bcb224c redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney 6c878e71f3 Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney 034408b3c2 merge with master 2022-03-30 15:44:22 +01:00
mike12345567 258434b3ed Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney 457a4812cf re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney aed9bfc728 fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell 69b2b38aea Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 25192bad3b ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston 2242044f3b Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567 5d9a34963a Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney dd1863d4c9 Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens 19ec76c49d Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 1c104d6fa5 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston 20fe6c35ba Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 84f1325320 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury ffbf3a2eca Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 07bcaf2d0a Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 0b7919cd3d Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens b987dc345f finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens 792021616c fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens c2d48bebd7 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 8185227ff1 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 7f9334ae5e Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a4ed8fe5e8 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 e9ff42bf76 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 bf63ea29f6 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 63bb4f34c4 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 64e65e25ec Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 ba3940f825 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 9f6635045a Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 546bbc2ff6 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 1b45a9190d Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 7109b34ea3 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 f77b596a07 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney d1cebc61a9 merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney a495050871 merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney d3c515eb8b only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 f61e15594b Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 aa204a9292 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 168a126e2a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney c11e26cb2e merge 2022-02-01 11:22:14 +01:00
mike12345567 d0bd9d2d62 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567 d55005d327 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567 d2fe119d90 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00
mike12345567 9b55ba8b13 Fixing #4192 - allowing switching between JSON and multi-select types, as well as not switching multi-select to JSON when fetching SQL tables. 2022-01-26 18:50:13 +00:00
Martin McKeaveney 19d27c97a4 code review and merge with develop 2022-01-26 17:45:28 +01:00
Martin McKeaveney efde072e70 code review 2022-01-26 17:14:47 +01:00
Rory Powell 716a693552 Merge pull request #4137 from Budibase/feature/app-urls
Custom App URLs
2022-01-26 14:55:36 +00:00
Martin McKeaveney 1e179fec76 remove need for index from dynamo connector 2022-01-26 15:25:11 +01:00
Rory Powell 0b9bb42817 Revert "Fix dev app preview return url"
This reverts commit 13d0bfb190.
2022-01-26 09:33:14 +00:00
Rory Powell fe374c0439 Merge fix and linting 2022-01-20 16:17:09 +00:00
mike12345567 7d4bea8f22 Adding comments to a few SQL table schema building functions to explain their function. 2022-01-19 10:24:15 +00:00
mike12345567 e0949b4ac3 Fix for #3721 - deleting invalid relationships if tables have been removed external to budibase - otherwise these could not be removed without deleting the datasource. 2022-01-18 17:21:29 +00:00
Martin McKeaveney 328aef00e1 tidy up 2022-01-18 17:41:38 +01:00
Martin McKeaveney 85d672c5d7 table management functions 2022-01-18 17:15:29 +01:00
mike12345567 332e5b2672 Adding SQL test case for SQL relationship filtering. 2022-01-17 18:20:37 +00:00
Martin McKeaveney a70b96a21a gsheets E2E 2022-01-15 19:28:04 +01:00
mike12345567 479220652e Adjusting SQL system to handle relationship filtering. 2022-01-13 17:40:11 +00:00
Rory Powell 4433ebc1f2 Handle 403 when loading templates 2022-01-13 17:24:52 +00:00
mike12345567 41b9c94237 Quick fix, only allow using SQL. 2022-01-13 16:48:19 +00:00
mike12345567 7e73d4bfd2 Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 15:10:55 +00:00
Martin McKeaveney 8da0fa4124 Merge pull request #4019 from Budibase/fix/4010
Maintaining options and boolean types when fetching SQL schemas
2022-01-13 15:51:13 +01:00
mike12345567 3f8af725d1 Fixing issue #4010 - options and boolean types can be maintained. 2022-01-13 14:36:47 +00:00
Martin McKeaveney 4b6e88075d merge with master 2022-01-13 14:58:17 +01:00
mike12345567 65998d87ce Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 11:38:47 +00:00
Andrew Kingston 9a7cc4113d Merge branch 'develop' of github.com:Budibase/budibase into rest-pagination 2022-01-13 09:44:09 +00:00
mike12345567 f1b9490f22 Adding method for client/builder to detect that a table supports SQL filtering. 2022-01-12 17:55:28 +00:00
Michael Drury 904906e364 Merge pull request #3970 from Budibase/fix/jan-various-fixes
Various fixes
2022-01-11 09:36:12 +00:00
mike12345567 e93d347ad6 Fixing issue #3740 - using text rather than string for mysql/postgres table column creation. 2022-01-07 14:10:26 +00:00
Andrew Kingston bf22c5130f Add tests for REST pagination 2022-01-07 10:49:31 +00:00
Martin McKeaveney c2d97b9449 google auth working 2022-01-06 08:08:54 +00:00
Rory Powell 6d5d301adb Support variables in URL 2022-01-05 14:33:14 -05:00
Andrew Kingston 4ab06c200d Add support for cursor and page based pagination inside REST query request body 2022-01-05 18:10:22 +00:00
Andrew Kingston f5649b48d1 Add support for cursor based pagination in query params 2022-01-05 17:28:57 +00:00
Andrew Kingston abc02d812a Merge branch 'feature/query-variables' of github.com:Budibase/budibase into rest-pagination 2022-01-05 09:21:25 +00:00
Andrew Kingston e2478e478e Add support for query param based pagination in REST queries 2022-01-05 09:16:10 +00:00
Martin McKeaveney e87a348fb8 enabling minio support for S3 connector 2021-12-31 16:19:46 +00:00
Martin McKeaveney a09fabc54b merge with master 2021-12-30 23:10:46 +00:00
Martin McKeaveney 18ad8ac1e5 configurable query timeout, s3 options for minIO, safety on cloud deploy job 2021-12-30 17:44:27 +00:00
Martin McKeaveney b57b0f1c7b adding dynamoDB describe call to dynamo integration 2021-12-29 15:46:33 +00:00
Rory Powell 6904e6a1df Prevent escaping in query parameter bindings 2021-12-21 13:48:54 -05:00
mike12345567 1f97ae259e Adding unit tests for REST bodies and response parsing. 2021-12-15 13:09:03 +00:00
mike12345567 5c00960ac0 Fixing issue detected by test case. 2021-12-15 12:23:00 +00:00
mike12345567 12b11ed3d9 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-bodies 2021-12-14 18:03:49 +00:00
mike12345567 da7153dd64 Removing outgoing webhook functionality from automations and adding XML response/sending, as well as form data/encoded data. 2021-12-14 17:59:02 +00:00
Rory Powell 17ba5d7c88 Merge branch 'develop' into feature/query-auth 2021-12-14 09:52:16 +00:00
mike12345567 64fa8055ce Linting and adding JSON header. 2021-12-13 18:20:02 +00:00
mike12345567 17f083e586 Stopping get requests from having bodies (Node fetch doesn't allow this) and allow text body type. 2021-12-13 18:17:20 +00:00
mike12345567 b11e4bd2df Moving Typescript definitions around a bit. 2021-12-13 13:50:15 +00:00
mike12345567 1948c867cc Fixing some issues around deleting datasources/queries and managing the full URL for migrating queries. 2021-12-13 12:41:47 +00:00
mike12345567 a7743c8481 Fixing bug in tabs where double clicks cause tab switching, new headers enabled by default, disabled headers rather than enabled, get requests can have bodies. 2021-12-13 11:24:13 +00:00
mike12345567 740ffae8c8 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-13 10:14:28 +00:00
Rory Powell 077c9ef434 Integrate query with datasource auth 2021-12-11 23:34:30 +00:00
Rory Powell 9fa4fe6c76 Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-11 21:43:03 +00:00
Rory Powell 9a0af5ba0a Add _id field 2021-12-11 10:40:57 +00:00
Rory Powell eeb6614823 Merge branch 'master' into merge-master 2021-12-10 10:14:43 +00:00
mike12345567 b48c30a7c0 Updating mocks. 2021-12-09 14:12:01 +00:00
mike12345567 cade92cc63 Measuring length if no content length supplied. 2021-12-09 13:40:39 +00:00
mike12345567 ad1007ffdc Adding in the ability to retrieve and view the headers from a rest response. 2021-12-09 12:30:05 +00:00
Rory Powell 4a3f596415 Escape mysql describe to handle non standard table names 2021-12-09 11:40:59 +00:00
mike12345567 e1ae7c603d Adding placeholder and making sure query urls have a protocol. 2021-12-09 10:02:47 +00:00
mike12345567 4dd8dbc253 Fixing server rest test case. 2021-12-08 19:38:03 +00:00
mike12345567 bbb5501d41 Adding in enabled headers, making way for different body types. 2021-12-08 19:11:19 +00:00
Rory Powell 720b828bee Render table of auth configs and linting 2021-12-08 15:27:58 +00:00
Rory Powell 2256b366ef Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-08 12:45:47 +00:00
Rory Powell 8df37dae85 Merge branch 'develop' into feature/rest-redesign 2021-12-08 12:36:12 +00:00
Rory Powell 6b7f94a358 Merge branch 'develop' into rest-import 2021-12-08 11:08:32 +00:00
Rory Powell a237d31424 Tidy 2021-12-08 10:52:08 +00:00
Rory Powell 9cbe03fd66 Add backend for query / datasource auth 2021-12-07 22:33:26 +00:00
mike12345567 b31cd5b6f7 Adding in raw functionality. 2021-12-06 18:35:44 +00:00
mike12345567 99e2cd52e8 Adding stats, code, timings and size of request. 2021-12-06 18:23:18 +00:00
mike12345567 e064237981 Adding in last components of UI that were missing. 2021-12-03 18:39:05 +00:00
mike12345567 7c7b7584fa Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-03 12:45:32 +00:00
Rory Powell 6118b7ba36 Fix oracle password config 2021-12-03 10:52:03 +00:00
Rory Powell 36218ccea9 Fix oracle password config 2021-12-03 10:48:47 +00:00
mike12345567 740abf8445 Adding radio group of body types. 2021-12-02 17:53:14 +00:00
Rory Powell 224516787d Merge + Linting 2021-12-02 14:54:47 +00:00
mike12345567 4a0ce14f04 Adding the ability to set a display name for any datasource/query parameter. 2021-12-01 13:11:35 +00:00
mike12345567 cd7ef481bd Some UI tweaks. 2021-11-30 18:11:29 +00:00
mike12345567 76ce9a3017 Disabling save button when no changes made. 2021-11-30 17:56:15 +00:00
mike12345567 3e5f9b9505 Updating REST creation, removing the modal step, updating the config page to move things around as per designs. 2021-11-30 16:21:16 +00:00
Rory Powell 301938eaa0 Merge pull request #3555 from Budibase/oracle/returning
Improve returning logic for oracle
2021-11-26 18:54:19 +00:00
mike12345567 d06ab10c1d Fixing issue found with enriching rows in SQL - the system was assuming the array of entries contained a row ID that needed to be broken down. 2021-11-26 17:08:56 +00:00
Rory Powell f75928a9c9 Deletion support for returning rows 2021-11-26 16:50:15 +00:00
Rory Powell 115fc08aa4 Improve returning logic for oracle 2021-11-26 15:02:03 +00:00
Martin McKeaveney 9ac60079c7 datasource plus support for google sheets 2021-11-25 20:12:32 +01:00
Rory Powell 71ba024974 WIP: Rest API import 2021-11-25 17:14:07 +00:00
Martin McKeaveney f9b2a3c5e1 Google sheets integration CRUD E2E 2021-11-25 18:12:12 +01:00
mike12345567 f6ecd423ce Fixing some issues discovered with many to many relationships in SQL, as well as problems uncovered by #3531. 2021-11-24 20:55:03 +00:00
mike12345567 bf44c15b74 Fixing issue with datasource deletion not navigating if was on data source plus table and fixing #3523 where relationships would cause sorting to breaking postgres/oracle. 2021-11-24 18:20:52 +00:00
mike12345567 116bccfd73 Fix for issue #3327 - may not solve issue with mariaDB but works for MySQL. 2021-11-24 17:03:34 +00:00
Rory Powell 7135599295 Add returning 2021-11-23 13:27:38 +00:00
Rory Powell 4acfc668ef Update locks, ignore oracle imports on m1 2021-11-22 15:26:31 +00:00
Rory Powell ac7137c4a0 Use global sql type map, update base integration type defs 2021-11-22 11:38:17 +00:00
Rory Powell 154a5cab26 Merge branch 'develop' into oracle-datasource 2021-11-22 11:07:11 +00:00
Rory Powell d58b90cac1 Merge branch 'oracle-datasource' into oracle-datatasource-plus 2021-11-22 10:50:34 +00:00
Rory Powell f94a0eadbe Merge branch 'develop' into oracle-datasource 2021-11-22 10:47:48 +00:00
mike12345567 38c7f3ab90 Fix for #2420 - don't allow columns which are considered invalid/not allowed. 2021-11-18 18:33:35 +00:00
Rory Powell b0df7fb28f Boolean support and linting 2021-11-18 13:35:22 +00:00
Rory Powell 345490fed3 Tests 2021-11-18 12:05:30 +00:00
Rory Powell 5d8c90c5f2 Detect auto columns 2021-11-18 10:49:53 +00:00