Commit Graph

517 Commits

Author SHA1 Message Date
Martin McKeaveney 6bc6000a14 remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney 97db271fce firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567 6d6e83f7c8 Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567 6556a41a5a Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney a91cf354b6 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney 25703889a3 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney a3970d6f45 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney bbce5a9c7f Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 31412cb83b moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney 84d2bb3cf5 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury 141f9ed9dc Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury 94419024a4 Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 d36fc9c7ba Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney 79a8a63ede use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567 345bbf603c Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567 5180603374 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567 94720c10aa Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567 2accebec7f Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney deeaf88f45 Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567 39182cfbc0 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney 417ba977fa redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney 6e5bcb224c redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney 6c878e71f3 Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney 034408b3c2 merge with master 2022-03-30 15:44:22 +01:00
mike12345567 258434b3ed Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney 457a4812cf re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney aed9bfc728 fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell 69b2b38aea Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 25192bad3b ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston 2242044f3b Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567 5d9a34963a Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney dd1863d4c9 Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens 19ec76c49d Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 1c104d6fa5 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston 20fe6c35ba Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 84f1325320 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury ffbf3a2eca Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 07bcaf2d0a Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 0b7919cd3d Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens b987dc345f finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens 792021616c fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens c2d48bebd7 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 8185227ff1 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 7f9334ae5e Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a4ed8fe5e8 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 e9ff42bf76 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 bf63ea29f6 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 63bb4f34c4 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 64e65e25ec Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 ba3940f825 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 9f6635045a Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 546bbc2ff6 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 1b45a9190d Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 7109b34ea3 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 f77b596a07 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney d1cebc61a9 merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney a495050871 merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney d3c515eb8b only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 f61e15594b Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 aa204a9292 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 168a126e2a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney c11e26cb2e merge 2022-02-01 11:22:14 +01:00
mike12345567 d0bd9d2d62 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567 d55005d327 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567 d2fe119d90 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00
mike12345567 9b55ba8b13 Fixing #4192 - allowing switching between JSON and multi-select types, as well as not switching multi-select to JSON when fetching SQL tables. 2022-01-26 18:50:13 +00:00
Martin McKeaveney 19d27c97a4 code review and merge with develop 2022-01-26 17:45:28 +01:00
Martin McKeaveney efde072e70 code review 2022-01-26 17:14:47 +01:00
Rory Powell 716a693552 Merge pull request #4137 from Budibase/feature/app-urls
Custom App URLs
2022-01-26 14:55:36 +00:00
Martin McKeaveney 1e179fec76 remove need for index from dynamo connector 2022-01-26 15:25:11 +01:00
Rory Powell 0b9bb42817 Revert "Fix dev app preview return url"
This reverts commit 13d0bfb190.
2022-01-26 09:33:14 +00:00
Rory Powell fe374c0439 Merge fix and linting 2022-01-20 16:17:09 +00:00
mike12345567 7d4bea8f22 Adding comments to a few SQL table schema building functions to explain their function. 2022-01-19 10:24:15 +00:00
mike12345567 e0949b4ac3 Fix for #3721 - deleting invalid relationships if tables have been removed external to budibase - otherwise these could not be removed without deleting the datasource. 2022-01-18 17:21:29 +00:00
Martin McKeaveney 328aef00e1 tidy up 2022-01-18 17:41:38 +01:00
Martin McKeaveney 85d672c5d7 table management functions 2022-01-18 17:15:29 +01:00
mike12345567 332e5b2672 Adding SQL test case for SQL relationship filtering. 2022-01-17 18:20:37 +00:00
Martin McKeaveney a70b96a21a gsheets E2E 2022-01-15 19:28:04 +01:00
mike12345567 479220652e Adjusting SQL system to handle relationship filtering. 2022-01-13 17:40:11 +00:00
Rory Powell 4433ebc1f2 Handle 403 when loading templates 2022-01-13 17:24:52 +00:00
mike12345567 41b9c94237 Quick fix, only allow using SQL. 2022-01-13 16:48:19 +00:00
mike12345567 7e73d4bfd2 Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 15:10:55 +00:00
Martin McKeaveney 8da0fa4124 Merge pull request #4019 from Budibase/fix/4010
Maintaining options and boolean types when fetching SQL schemas
2022-01-13 15:51:13 +01:00
mike12345567 3f8af725d1 Fixing issue #4010 - options and boolean types can be maintained. 2022-01-13 14:36:47 +00:00
Martin McKeaveney 4b6e88075d merge with master 2022-01-13 14:58:17 +01:00
mike12345567 65998d87ce Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 11:38:47 +00:00
Andrew Kingston 9a7cc4113d Merge branch 'develop' of github.com:Budibase/budibase into rest-pagination 2022-01-13 09:44:09 +00:00
mike12345567 f1b9490f22 Adding method for client/builder to detect that a table supports SQL filtering. 2022-01-12 17:55:28 +00:00
Michael Drury 904906e364 Merge pull request #3970 from Budibase/fix/jan-various-fixes
Various fixes
2022-01-11 09:36:12 +00:00
mike12345567 e93d347ad6 Fixing issue #3740 - using text rather than string for mysql/postgres table column creation. 2022-01-07 14:10:26 +00:00
Andrew Kingston bf22c5130f Add tests for REST pagination 2022-01-07 10:49:31 +00:00
Martin McKeaveney c2d97b9449 google auth working 2022-01-06 08:08:54 +00:00
Rory Powell 6d5d301adb Support variables in URL 2022-01-05 14:33:14 -05:00
Andrew Kingston 4ab06c200d Add support for cursor and page based pagination inside REST query request body 2022-01-05 18:10:22 +00:00
Andrew Kingston f5649b48d1 Add support for cursor based pagination in query params 2022-01-05 17:28:57 +00:00
Andrew Kingston abc02d812a Merge branch 'feature/query-variables' of github.com:Budibase/budibase into rest-pagination 2022-01-05 09:21:25 +00:00
Andrew Kingston e2478e478e Add support for query param based pagination in REST queries 2022-01-05 09:16:10 +00:00
Martin McKeaveney e87a348fb8 enabling minio support for S3 connector 2021-12-31 16:19:46 +00:00
Martin McKeaveney a09fabc54b merge with master 2021-12-30 23:10:46 +00:00
Martin McKeaveney 18ad8ac1e5 configurable query timeout, s3 options for minIO, safety on cloud deploy job 2021-12-30 17:44:27 +00:00
Martin McKeaveney b57b0f1c7b adding dynamoDB describe call to dynamo integration 2021-12-29 15:46:33 +00:00
Rory Powell 6904e6a1df Prevent escaping in query parameter bindings 2021-12-21 13:48:54 -05:00
mike12345567 1f97ae259e Adding unit tests for REST bodies and response parsing. 2021-12-15 13:09:03 +00:00
mike12345567 5c00960ac0 Fixing issue detected by test case. 2021-12-15 12:23:00 +00:00
mike12345567 12b11ed3d9 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-bodies 2021-12-14 18:03:49 +00:00
mike12345567 da7153dd64 Removing outgoing webhook functionality from automations and adding XML response/sending, as well as form data/encoded data. 2021-12-14 17:59:02 +00:00
Rory Powell 17ba5d7c88 Merge branch 'develop' into feature/query-auth 2021-12-14 09:52:16 +00:00
mike12345567 64fa8055ce Linting and adding JSON header. 2021-12-13 18:20:02 +00:00
mike12345567 17f083e586 Stopping get requests from having bodies (Node fetch doesn't allow this) and allow text body type. 2021-12-13 18:17:20 +00:00
mike12345567 b11e4bd2df Moving Typescript definitions around a bit. 2021-12-13 13:50:15 +00:00
mike12345567 1948c867cc Fixing some issues around deleting datasources/queries and managing the full URL for migrating queries. 2021-12-13 12:41:47 +00:00
mike12345567 a7743c8481 Fixing bug in tabs where double clicks cause tab switching, new headers enabled by default, disabled headers rather than enabled, get requests can have bodies. 2021-12-13 11:24:13 +00:00
mike12345567 740ffae8c8 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-13 10:14:28 +00:00
Rory Powell 077c9ef434 Integrate query with datasource auth 2021-12-11 23:34:30 +00:00
Rory Powell 9fa4fe6c76 Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-11 21:43:03 +00:00
Rory Powell 9a0af5ba0a Add _id field 2021-12-11 10:40:57 +00:00
Rory Powell eeb6614823 Merge branch 'master' into merge-master 2021-12-10 10:14:43 +00:00
mike12345567 b48c30a7c0 Updating mocks. 2021-12-09 14:12:01 +00:00
mike12345567 cade92cc63 Measuring length if no content length supplied. 2021-12-09 13:40:39 +00:00
mike12345567 ad1007ffdc Adding in the ability to retrieve and view the headers from a rest response. 2021-12-09 12:30:05 +00:00
Rory Powell 4a3f596415 Escape mysql describe to handle non standard table names 2021-12-09 11:40:59 +00:00
mike12345567 e1ae7c603d Adding placeholder and making sure query urls have a protocol. 2021-12-09 10:02:47 +00:00
mike12345567 4dd8dbc253 Fixing server rest test case. 2021-12-08 19:38:03 +00:00
mike12345567 bbb5501d41 Adding in enabled headers, making way for different body types. 2021-12-08 19:11:19 +00:00
Rory Powell 720b828bee Render table of auth configs and linting 2021-12-08 15:27:58 +00:00
Rory Powell 2256b366ef Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-08 12:45:47 +00:00
Rory Powell 8df37dae85 Merge branch 'develop' into feature/rest-redesign 2021-12-08 12:36:12 +00:00
Rory Powell 6b7f94a358 Merge branch 'develop' into rest-import 2021-12-08 11:08:32 +00:00
Rory Powell a237d31424 Tidy 2021-12-08 10:52:08 +00:00
Rory Powell 9cbe03fd66 Add backend for query / datasource auth 2021-12-07 22:33:26 +00:00
mike12345567 b31cd5b6f7 Adding in raw functionality. 2021-12-06 18:35:44 +00:00
mike12345567 99e2cd52e8 Adding stats, code, timings and size of request. 2021-12-06 18:23:18 +00:00
mike12345567 e064237981 Adding in last components of UI that were missing. 2021-12-03 18:39:05 +00:00
mike12345567 7c7b7584fa Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-03 12:45:32 +00:00
Rory Powell 6118b7ba36 Fix oracle password config 2021-12-03 10:52:03 +00:00
Rory Powell 36218ccea9 Fix oracle password config 2021-12-03 10:48:47 +00:00
mike12345567 740abf8445 Adding radio group of body types. 2021-12-02 17:53:14 +00:00
Rory Powell 224516787d Merge + Linting 2021-12-02 14:54:47 +00:00
mike12345567 4a0ce14f04 Adding the ability to set a display name for any datasource/query parameter. 2021-12-01 13:11:35 +00:00
mike12345567 cd7ef481bd Some UI tweaks. 2021-11-30 18:11:29 +00:00
mike12345567 76ce9a3017 Disabling save button when no changes made. 2021-11-30 17:56:15 +00:00
mike12345567 3e5f9b9505 Updating REST creation, removing the modal step, updating the config page to move things around as per designs. 2021-11-30 16:21:16 +00:00
Rory Powell 301938eaa0 Merge pull request #3555 from Budibase/oracle/returning
Improve returning logic for oracle
2021-11-26 18:54:19 +00:00
mike12345567 d06ab10c1d Fixing issue found with enriching rows in SQL - the system was assuming the array of entries contained a row ID that needed to be broken down. 2021-11-26 17:08:56 +00:00
Rory Powell f75928a9c9 Deletion support for returning rows 2021-11-26 16:50:15 +00:00
Rory Powell 115fc08aa4 Improve returning logic for oracle 2021-11-26 15:02:03 +00:00
Martin McKeaveney 9ac60079c7 datasource plus support for google sheets 2021-11-25 20:12:32 +01:00
Rory Powell 71ba024974 WIP: Rest API import 2021-11-25 17:14:07 +00:00