Commit Graph

471 Commits

Author SHA1 Message Date
mike12345567 6b4377c932 Fix for #5612 - stop some formats of string being in-correctly parsed as dates by MySQL - disable type coercion for data source plus mysql tables (knex converts). 2022-04-29 16:47:43 +01:00
mike12345567 9ea6199eba Fixing issue #5594 - allowing use of double underscores in table names for SQL. 2022-04-29 16:22:11 +01:00
Martin McKeaveney e5df157927 adding close to buildSchema 2022-04-29 10:47:42 +01:00
Martin McKeaveney 2a7fa4d8f7 merge 2022-04-29 00:05:43 +01:00
Martin McKeaveney 6bc6000a14 remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney 97db271fce firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567 6d6e83f7c8 Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567 6556a41a5a Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney a91cf354b6 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney 25703889a3 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney a3970d6f45 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney bbce5a9c7f Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 31412cb83b moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney 84d2bb3cf5 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury 141f9ed9dc Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury 94419024a4 Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 d36fc9c7ba Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney 79a8a63ede use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567 345bbf603c Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567 5180603374 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567 94720c10aa Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567 2accebec7f Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney deeaf88f45 Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567 39182cfbc0 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney 417ba977fa redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney 6e5bcb224c redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney 6c878e71f3 Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney 034408b3c2 merge with master 2022-03-30 15:44:22 +01:00
mike12345567 258434b3ed Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney 457a4812cf re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney aed9bfc728 fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell 69b2b38aea Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 25192bad3b ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston 2242044f3b Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567 5d9a34963a Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney dd1863d4c9 Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens 19ec76c49d Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 1c104d6fa5 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston 20fe6c35ba Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 84f1325320 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury ffbf3a2eca Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 07bcaf2d0a Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 0b7919cd3d Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens b987dc345f finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens 792021616c fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens c2d48bebd7 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 8185227ff1 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 7f9334ae5e Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a4ed8fe5e8 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 e9ff42bf76 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 bf63ea29f6 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 63bb4f34c4 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 64e65e25ec Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 ba3940f825 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 9f6635045a Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 546bbc2ff6 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 1b45a9190d Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 7109b34ea3 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 f77b596a07 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney d1cebc61a9 merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney a495050871 merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney d3c515eb8b only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 f61e15594b Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 aa204a9292 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 168a126e2a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney c11e26cb2e merge 2022-02-01 11:22:14 +01:00
mike12345567 d0bd9d2d62 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567 d55005d327 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567 d2fe119d90 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00
mike12345567 9b55ba8b13 Fixing #4192 - allowing switching between JSON and multi-select types, as well as not switching multi-select to JSON when fetching SQL tables. 2022-01-26 18:50:13 +00:00
Martin McKeaveney 19d27c97a4 code review and merge with develop 2022-01-26 17:45:28 +01:00
Martin McKeaveney efde072e70 code review 2022-01-26 17:14:47 +01:00
Rory Powell 716a693552 Merge pull request #4137 from Budibase/feature/app-urls
Custom App URLs
2022-01-26 14:55:36 +00:00
Martin McKeaveney 1e179fec76 remove need for index from dynamo connector 2022-01-26 15:25:11 +01:00
Rory Powell 0b9bb42817 Revert "Fix dev app preview return url"
This reverts commit 13d0bfb190.
2022-01-26 09:33:14 +00:00
Rory Powell fe374c0439 Merge fix and linting 2022-01-20 16:17:09 +00:00
mike12345567 7d4bea8f22 Adding comments to a few SQL table schema building functions to explain their function. 2022-01-19 10:24:15 +00:00
mike12345567 e0949b4ac3 Fix for #3721 - deleting invalid relationships if tables have been removed external to budibase - otherwise these could not be removed without deleting the datasource. 2022-01-18 17:21:29 +00:00
Martin McKeaveney 328aef00e1 tidy up 2022-01-18 17:41:38 +01:00
Martin McKeaveney 85d672c5d7 table management functions 2022-01-18 17:15:29 +01:00
mike12345567 332e5b2672 Adding SQL test case for SQL relationship filtering. 2022-01-17 18:20:37 +00:00
Martin McKeaveney a70b96a21a gsheets E2E 2022-01-15 19:28:04 +01:00
mike12345567 479220652e Adjusting SQL system to handle relationship filtering. 2022-01-13 17:40:11 +00:00
Rory Powell 4433ebc1f2 Handle 403 when loading templates 2022-01-13 17:24:52 +00:00
mike12345567 41b9c94237 Quick fix, only allow using SQL. 2022-01-13 16:48:19 +00:00
mike12345567 7e73d4bfd2 Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 15:10:55 +00:00
Martin McKeaveney 8da0fa4124 Merge pull request #4019 from Budibase/fix/4010
Maintaining options and boolean types when fetching SQL schemas
2022-01-13 15:51:13 +01:00
mike12345567 3f8af725d1 Fixing issue #4010 - options and boolean types can be maintained. 2022-01-13 14:36:47 +00:00
Martin McKeaveney 4b6e88075d merge with master 2022-01-13 14:58:17 +01:00
mike12345567 65998d87ce Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 11:38:47 +00:00
Andrew Kingston 9a7cc4113d Merge branch 'develop' of github.com:Budibase/budibase into rest-pagination 2022-01-13 09:44:09 +00:00
mike12345567 f1b9490f22 Adding method for client/builder to detect that a table supports SQL filtering. 2022-01-12 17:55:28 +00:00
Michael Drury 904906e364 Merge pull request #3970 from Budibase/fix/jan-various-fixes
Various fixes
2022-01-11 09:36:12 +00:00
mike12345567 e93d347ad6 Fixing issue #3740 - using text rather than string for mysql/postgres table column creation. 2022-01-07 14:10:26 +00:00
Andrew Kingston bf22c5130f Add tests for REST pagination 2022-01-07 10:49:31 +00:00
Martin McKeaveney c2d97b9449 google auth working 2022-01-06 08:08:54 +00:00
Rory Powell 6d5d301adb Support variables in URL 2022-01-05 14:33:14 -05:00
Andrew Kingston 4ab06c200d Add support for cursor and page based pagination inside REST query request body 2022-01-05 18:10:22 +00:00