Commit Graph

752 Commits

Author SHA1 Message Date
Mel O'Hagan a58f35a6cd Null pointer fix 2022-05-13 15:57:15 +01:00
Mel O'Hagan 094a548e38 MongoDb Delete fix 2022-05-13 15:56:57 +01:00
Mel O'Hagan 4b7f1391f8 Fixed update 2022-05-13 15:56:49 +01:00
Mel O'Hagan 2a98872296 Create ObjectIds from matching string 2022-05-13 15:56:32 +01:00
Michael Drury cb95b419a7
Merge pull request #5707 from Budibase/fix/mike-fixes-04-05
SQL columns with spaces LIKE fix and dynamic REST variable UI change
2022-05-11 10:34:36 +01:00
Martin McKeaveney 8c5efd0a61 more strategic connection closing in pg 2022-05-10 11:13:40 +01:00
Martin McKeaveney 6cddc3f8f9 merge 2022-05-05 12:45:09 +01:00
mike12345567 13ec670295 Fix for #5669 comment, when using SQL tables with spaces in names, we use a raw knex function for like to achieve lower case searching, this needs to handle spaces in columns and delimiting. 2022-05-04 16:13:54 +01:00
mike12345567 107c9e2dfc Fix for #5553 - when importing for SQL databases attempt to manage date and time only column times, handle these when displaying in tables and when filtering. 2022-05-03 14:11:06 +01:00
mike12345567 be4b930c8a Fix for #5612 - stop some formats of string being in-correctly parsed as dates by MySQL - disable type coercion for data source plus mysql tables (knex converts). 2022-04-29 16:47:43 +01:00
mike12345567 a7fe15244b Fixing issue #5594 - allowing use of double underscores in table names for SQL. 2022-04-29 16:22:11 +01:00
Martin McKeaveney bfb6e20bb8 adding close to buildSchema 2022-04-29 10:47:42 +01:00
Martin McKeaveney 06774c1452 merge 2022-04-29 00:05:43 +01:00
Martin McKeaveney 4bab24f1ac remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney 62f2cff42e firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567 8d5931f94c Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567 056d9defe4 Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney a5bdf70cf7 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney e01ef9bdfb merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney b05d1d9708 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney 8f26196191 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney 9f0cb41f49
Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 877dfb0e5d moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney 33717ceb30 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury ae385ffd16
Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury a3321246e0
Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 7e6eaf65d8 Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney 690ba4f81f use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567 fe846f86a5 Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 ea6f580501 Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567 5396a8d8e0 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567 00bcdd317f Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567 c4a42cc181 Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney cf1e378b6e
Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567 62f4ecf3e1 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney 6d8254d5f0 redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney 81c662f0ca redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney 6432ca102a
Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney e263cc31bb merge with master 2022-03-30 15:44:22 +01:00
mike12345567 5dcbef58a8 Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney 04b17fb634 re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney ee6a16827a fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell 0ee41ea10c Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 33506bebb4 ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston 8e361afcda Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567 d52f6dea05 Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney fd0a916564
Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens 0f5d4733d6 Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 72f6bc8930 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston bf29fa43b4 Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 0d7db82c71 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury 7f36cc97c9 Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 05836272dd Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 7a1b362515 Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens 70c5574e75 finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens bdb5b127dd fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens e9405a1802 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 1357c53ff8 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 0f1b7b18d5 Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a7e3389790 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 2123fca557 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 b054c2a198 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 5d7f4b6ab7 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 7179cf978a Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 07551c54c1 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 3f150c4a1f Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 94041ced55 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 8ce1b471fd Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 407aa2d49b Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 03822c7223 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney 20b4f5aadc merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney 9144fdef6e merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney e1bc104715 only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 b9de2c1897 Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 b5993f4aa9 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 fa94ea7b3a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney 394eb44b5f merge 2022-02-01 11:22:14 +01:00
mike12345567 c9d2de8344 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567 712382af07 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567 40c6eb2007 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00
mike12345567 3567e7ddb6 Fixing #4192 - allowing switching between JSON and multi-select types, as well as not switching multi-select to JSON when fetching SQL tables. 2022-01-26 18:50:13 +00:00
Martin McKeaveney 203c892f33 code review and merge with develop 2022-01-26 17:45:28 +01:00
Martin McKeaveney 5d59db8fd2 code review 2022-01-26 17:14:47 +01:00
Rory Powell e1ca44442b
Merge pull request #4137 from Budibase/feature/app-urls
Custom App URLs
2022-01-26 14:55:36 +00:00
Martin McKeaveney c316306078 remove need for index from dynamo connector 2022-01-26 15:25:11 +01:00
Rory Powell 716e254bdd Revert "Fix dev app preview return url"
This reverts commit e76ea10fc2.
2022-01-26 09:33:14 +00:00
Rory Powell a61e1afdc3 Merge fix and linting 2022-01-20 16:17:09 +00:00
mike12345567 a417aa43c9 Adding comments to a few SQL table schema building functions to explain their function. 2022-01-19 10:24:15 +00:00
mike12345567 93ecd44db1 Fix for #3721 - deleting invalid relationships if tables have been removed external to budibase - otherwise these could not be removed without deleting the datasource. 2022-01-18 17:21:29 +00:00
Martin McKeaveney 7b39f46507 tidy up 2022-01-18 17:41:38 +01:00
Martin McKeaveney 5538f5ff6f table management functions 2022-01-18 17:15:29 +01:00
mike12345567 662a0cdd39 Adding SQL test case for SQL relationship filtering. 2022-01-17 18:20:37 +00:00
Martin McKeaveney 857d1f7c0b gsheets E2E 2022-01-15 19:28:04 +01:00
mike12345567 ee29245b6a Adjusting SQL system to handle relationship filtering. 2022-01-13 17:40:11 +00:00
Rory Powell d07852bcf2 Handle 403 when loading templates 2022-01-13 17:24:52 +00:00
mike12345567 13629a1204 Quick fix, only allow using SQL. 2022-01-13 16:48:19 +00:00
mike12345567 69105afffb Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 15:10:55 +00:00
Martin McKeaveney 5931cfbafb
Merge pull request #4019 from Budibase/fix/4010
Maintaining options and boolean types when fetching SQL schemas
2022-01-13 15:51:13 +01:00
mike12345567 5ede1e23a9 Fixing issue #4010 - options and boolean types can be maintained. 2022-01-13 14:36:47 +00:00
Martin McKeaveney 6d3ebe6eb9 merge with master 2022-01-13 14:58:17 +01:00