Commit Graph

600 Commits

Author SHA1 Message Date
Mel O'Hagan 051779b013 lint 2022-08-08 21:57:36 +01:00
Mel O'Hagan 09a3052aa2 Nested braces parse fix added for MongoDB 2022-08-08 21:56:55 +01:00
Mel O'Hagan fe0163ac29 Bug fix findOneAndUpdate 2022-08-08 17:53:17 +01:00
Mel O'Hagan c289d72816 Add unit tests for ObjectId 2022-08-08 17:01:56 +01:00
Mel O'Hagan 4d217bfc04 Merge branch 'develop' into bug/sev2/mongodb-fixes 2022-08-08 15:15:03 +01:00
mike12345567 d14051bd62 Fixing test cases. 2022-08-03 18:20:07 +01:00
mike12345567 129c966226 Updating the filter system to allow adding multiple filter properties of the same name at once, as well as enabling the use of the allOr property from within the UI - resolves an old issue #2585. 2022-08-02 18:34:58 +01:00
mike12345567 4f01a7fb80 Merge branch 'master' of github.com:Budibase/budibase into fix/6737 2022-08-01 19:00:17 +01:00
mike12345567 de3ceeb119 Adding mechanism to allow displaying an error on data retrieval for tables. 2022-08-01 18:56:59 +01:00
mike12345567 87b583e51e Fix for #6737 - making it so that if a column is deleted externally tables can be re-fetched and this will be fixed. 2022-08-01 17:40:35 +01:00
Mel O'Hagan 2356d09022 Has any support SQL Server 2022-07-28 09:20:00 +01:00
Mel O'Hagan 26c8af3c1e SQL Server containsAny unit test 2022-07-27 16:40:07 +01:00
Mel O'Hagan 4abd984d99 Has any of filter Postgres 2022-07-27 16:37:29 +01:00
Mel O'Hagan 17bb56a772 Has any of MySQL filter 2022-07-27 13:19:47 +01:00
Mel O'Hagan 413bd55b94 Not Contains for SQL Server 2022-07-27 11:56:57 +01:00
Mel O'Hagan 69135d34a7 Not Contains Postgres filter 2022-07-27 11:49:45 +01:00
Mel O'Hagan ce9a6a7141 Not Contains filter for MySQL 2022-07-27 11:40:46 +01:00
Mel O'Hagan 47955b9b31 Fix unit tests 2022-07-26 16:58:01 +01:00
Mel O'Hagan 74d6687a95 Has all of SQLServer 2022-07-26 16:45:05 +01:00
Mel O'Hagan a85ad2ced6 MySQL has all of 2022-07-26 16:16:46 +01:00
Mel O'Hagan 76e4ffc04d Postgres has all of 2022-07-26 15:59:49 +01:00
Mel O'Hagan 4cc0a327a0 lint 2022-07-26 11:38:34 +01:00
Mel O'Hagan 71a55eb288 Support ObjectId in operator blocks 2022-07-26 10:53:53 +01:00
Mel O'Hagan 3ba1ce80dd Added unit tests for contains filter 2022-07-21 10:28:54 +01:00
Mel O'Hagan 0c88195ab0 Handle numeric types Postgres 2022-07-19 18:34:30 +01:00
Mel O'Hagan 58c02ee05d Prettier 2022-07-19 18:04:27 +01:00
Mel O'Hagan ed0bd07732 Added contains support for datasource pluses 2022-07-19 17:25:41 +01:00
mike12345567 cff42331bc Fix for ARM processors. 2022-07-13 12:37:55 +01:00
Mel O'Hagan 73e2eac2c2 Don't try to check externalType of related tables 2022-07-05 16:59:32 +01:00
Dean ac1df878d4 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-29 18:50:14 +01:00
mike12345567 a625fa573d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-24 17:50:55 +01:00
Andrew Kingston a429c16521 Merge pull request #6443 from Budibase/datasource-labels
Datasource labels
2022-06-23 15:32:28 +01:00
Mel O'Hagan 633a701b0c Added Knex.Raw to return type 2022-06-23 13:09:22 +01:00
Andrew Kingston 8bfd54bd80 Add types to datasources 2022-06-23 11:35:57 +01:00
Mel O'Hagan ece1e7533d Refactor - simplify regex and use enum 2022-06-23 09:41:43 +01:00
Mel O'Hagan 9603a92c2c Only cast money as numeric for Postgres 2022-06-22 16:13:02 +01:00
Mel O'Hagan 8154fe3445 Use raw sql to get money type as numeric 2022-06-22 15:58:15 +01:00
Mel O'Hagan a888d9a273 Added external types to ds+ schemas 2022-06-20 18:08:30 +01:00
Mel O'Hagan eca2fe0b50 Include external SQL server type in schema 2022-06-20 16:49:58 +01:00
Dean 5196fde134 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-20 09:09:21 +01:00
Mel O'Hagan fcf9ed6df7 Add empty options if missing for delete 2022-06-17 16:54:23 +01:00
Dean 28f722cf4b Fixes for Rest API request UI. Rest test fixes for XML API request body. Fix for raw XML api request body parsing issue. General fixes for query testing. 2022-06-17 12:00:42 +01:00
mike12345567 7050ffc2cb Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-17 11:41:34 +01:00
Dean 42cd5e2c63 Fix to ignore global rest query headers when they are not configured. 2022-06-15 10:09:47 +01:00
Rory Powell af8b1ff908 Merge branch 'release' into merge-release 2022-06-13 11:58:14 +01:00
Rory Powell 4dc5cfc5a7 Merge branch 'release' into merge-release 2022-06-13 11:45:18 +01:00
Mel O'Hagan 23ae0df4df Remove duplicate equals 2022-06-10 15:52:28 +01:00
Mel O'Hagan 1155b9acdf Fix for privatekey newline 2022-06-10 14:15:25 +01:00
Mel O'Hagan dc28d685a8 Removed ServiceAccount to reduce confusion 2022-06-10 14:04:34 +01:00
Mel O'Hagan 9d58b951d8 Rename Firebase to Firestore 2022-06-08 12:05:29 +01:00
Andrew Kingston 0c50b82248 Account for types being undefined when running in a test env 2022-06-07 08:41:45 +01:00
Andrew Kingston 72397530ec Apply timezones patch from existing ignore-timezones branch 2022-06-07 08:31:00 +01:00
Martin McKeaveney d5540bbd57 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Mel O'Hagan 8893806c44 Using snowflake-promise 2022-06-01 11:41:41 +01:00
Mel O'Hagan a217d04d6a Revert "Datasource plus - build schema"
This reverts commit 11a9138bdb.
2022-06-01 09:36:42 +01:00
Mel O'Hagan 192663c94a Revert "primaryKey name fix"
This reverts commit 9c408fda9c.
2022-06-01 09:36:28 +01:00
Mel O'Hagan 9c408fda9c primaryKey name fix 2022-05-31 14:47:27 +01:00
Mel O'Hagan 11a9138bdb Datasource plus - build schema 2022-05-31 14:39:53 +01:00
Mel O'Hagan 534cc9e6c8 CRUD added for snowflake 2022-05-31 13:10:16 +01:00
Mel O'Hagan fe3a774db3 Added types and error handling 2022-05-31 11:58:03 +01:00
Mel O'Hagan 570aeecdc3 Added Snowflake integration 2022-05-30 21:13:45 +01:00
mike12345567 152f0bb0af Opening connection for building schema. 2022-05-20 17:43:47 +01:00
mike12345567 50445f6990 Fix for Postgres connections, seemed to be some issues with out of order, connections not opening in time. 2022-05-20 17:41:27 +01:00
Mel O'Hagan 986ab1d35a Improve parseQueryParams regex 2022-05-17 12:11:43 +01:00
Mel O'Hagan 0f4aaa4779 Parse params if needed 2022-05-16 22:44:38 +01:00
Mel O'Hagan 0da9ee0a56 Using mongodb types 2022-05-16 09:50:47 +01:00
Mel O'Hagan 7b570fea22 Removed unused aws Object import 2022-05-16 08:43:27 +01:00
Mel O'Hagan e3883d480d Lowercase the object typo 2022-05-16 08:42:09 +01:00
Mel O'Hagan 81f16aa7ce Check type is string before match 2022-05-13 21:25:41 +01:00
Mel O'Hagan 0d3ab9ae33 Fix test for update 2022-05-13 15:57:37 +01:00
Mel O'Hagan c2fc1598fa Null pointer fix 2022-05-13 15:57:15 +01:00
Mel O'Hagan 035a7ee625 MongoDb Delete fix 2022-05-13 15:56:57 +01:00
Mel O'Hagan f40967784f Fixed update 2022-05-13 15:56:49 +01:00
Mel O'Hagan dd6093a7ae Create ObjectIds from matching string 2022-05-13 15:56:32 +01:00
Michael Drury e7bb4a1fb7 Merge pull request #5707 from Budibase/fix/mike-fixes-04-05
SQL columns with spaces LIKE fix and dynamic REST variable UI change
2022-05-11 10:34:36 +01:00
Martin McKeaveney db0ffe4ac7 more strategic connection closing in pg 2022-05-10 11:13:40 +01:00
Martin McKeaveney 8899527da8 merge 2022-05-05 12:45:09 +01:00
mike12345567 b4b65362f9 Fix for #5669 comment, when using SQL tables with spaces in names, we use a raw knex function for like to achieve lower case searching, this needs to handle spaces in columns and delimiting. 2022-05-04 16:13:54 +01:00
mike12345567 d090f2a8aa Fix for #5553 - when importing for SQL databases attempt to manage date and time only column times, handle these when displaying in tables and when filtering. 2022-05-03 14:11:06 +01:00
mike12345567 6b4377c932 Fix for #5612 - stop some formats of string being in-correctly parsed as dates by MySQL - disable type coercion for data source plus mysql tables (knex converts). 2022-04-29 16:47:43 +01:00
mike12345567 9ea6199eba Fixing issue #5594 - allowing use of double underscores in table names for SQL. 2022-04-29 16:22:11 +01:00
Martin McKeaveney e5df157927 adding close to buildSchema 2022-04-29 10:47:42 +01:00
Martin McKeaveney 2a7fa4d8f7 merge 2022-04-29 00:05:43 +01:00
Martin McKeaveney 6bc6000a14 remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney 97db271fce firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567 6d6e83f7c8 Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567 6556a41a5a Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney a91cf354b6 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney 25703889a3 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney a3970d6f45 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney bbce5a9c7f Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 31412cb83b moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney 84d2bb3cf5 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury 141f9ed9dc Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury 94419024a4 Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 d36fc9c7ba Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney 79a8a63ede use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567 345bbf603c Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567 5180603374 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567 94720c10aa Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567 2accebec7f Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney deeaf88f45 Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567 39182cfbc0 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney 417ba977fa redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney 6e5bcb224c redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney 6c878e71f3 Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney 034408b3c2 merge with master 2022-03-30 15:44:22 +01:00
mike12345567 258434b3ed Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney 457a4812cf re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney aed9bfc728 fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell 69b2b38aea Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 25192bad3b ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston 2242044f3b Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567 5d9a34963a Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney dd1863d4c9 Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens 19ec76c49d Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 1c104d6fa5 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston 20fe6c35ba Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 84f1325320 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury ffbf3a2eca Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 07bcaf2d0a Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 0b7919cd3d Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens b987dc345f finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens 792021616c fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens c2d48bebd7 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 8185227ff1 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 7f9334ae5e Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a4ed8fe5e8 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 e9ff42bf76 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 bf63ea29f6 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 63bb4f34c4 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 64e65e25ec Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 ba3940f825 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 9f6635045a Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 546bbc2ff6 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 1b45a9190d Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 7109b34ea3 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 f77b596a07 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney d1cebc61a9 merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney a495050871 merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney d3c515eb8b only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 f61e15594b Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 aa204a9292 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 168a126e2a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney c11e26cb2e merge 2022-02-01 11:22:14 +01:00
mike12345567 d0bd9d2d62 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567 d55005d327 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567 d2fe119d90 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00