Commit Graph

683 Commits

Author SHA1 Message Date
Maurits Lourens 19ec76c49d Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 1c104d6fa5 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston 20fe6c35ba Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 84f1325320 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury ffbf3a2eca Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 07bcaf2d0a Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 0b7919cd3d Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens b987dc345f finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens 792021616c fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens c2d48bebd7 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 8185227ff1 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 7f9334ae5e Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a4ed8fe5e8 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 e9ff42bf76 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 bf63ea29f6 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 63bb4f34c4 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 64e65e25ec Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 ba3940f825 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 9f6635045a Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 546bbc2ff6 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 1b45a9190d Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 7109b34ea3 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 f77b596a07 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney d1cebc61a9 merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney a495050871 merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney d3c515eb8b only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 f61e15594b Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 aa204a9292 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 168a126e2a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney c11e26cb2e merge 2022-02-01 11:22:14 +01:00
mike12345567 d0bd9d2d62 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567 d55005d327 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567 d2fe119d90 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00
mike12345567 9b55ba8b13 Fixing #4192 - allowing switching between JSON and multi-select types, as well as not switching multi-select to JSON when fetching SQL tables. 2022-01-26 18:50:13 +00:00
Martin McKeaveney 19d27c97a4 code review and merge with develop 2022-01-26 17:45:28 +01:00
Martin McKeaveney efde072e70 code review 2022-01-26 17:14:47 +01:00
Rory Powell 716a693552 Merge pull request #4137 from Budibase/feature/app-urls
Custom App URLs
2022-01-26 14:55:36 +00:00
Martin McKeaveney 1e179fec76 remove need for index from dynamo connector 2022-01-26 15:25:11 +01:00
Rory Powell 0b9bb42817 Revert "Fix dev app preview return url"
This reverts commit 13d0bfb190.
2022-01-26 09:33:14 +00:00
Rory Powell fe374c0439 Merge fix and linting 2022-01-20 16:17:09 +00:00
mike12345567 7d4bea8f22 Adding comments to a few SQL table schema building functions to explain their function. 2022-01-19 10:24:15 +00:00
mike12345567 e0949b4ac3 Fix for #3721 - deleting invalid relationships if tables have been removed external to budibase - otherwise these could not be removed without deleting the datasource. 2022-01-18 17:21:29 +00:00
Martin McKeaveney 328aef00e1 tidy up 2022-01-18 17:41:38 +01:00
Martin McKeaveney 85d672c5d7 table management functions 2022-01-18 17:15:29 +01:00
mike12345567 332e5b2672 Adding SQL test case for SQL relationship filtering. 2022-01-17 18:20:37 +00:00
Martin McKeaveney a70b96a21a gsheets E2E 2022-01-15 19:28:04 +01:00
mike12345567 479220652e Adjusting SQL system to handle relationship filtering. 2022-01-13 17:40:11 +00:00
Rory Powell 4433ebc1f2 Handle 403 when loading templates 2022-01-13 17:24:52 +00:00
mike12345567 41b9c94237 Quick fix, only allow using SQL. 2022-01-13 16:48:19 +00:00
mike12345567 7e73d4bfd2 Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 15:10:55 +00:00
Martin McKeaveney 8da0fa4124 Merge pull request #4019 from Budibase/fix/4010
Maintaining options and boolean types when fetching SQL schemas
2022-01-13 15:51:13 +01:00
mike12345567 3f8af725d1 Fixing issue #4010 - options and boolean types can be maintained. 2022-01-13 14:36:47 +00:00
Martin McKeaveney 4b6e88075d merge with master 2022-01-13 14:58:17 +01:00
mike12345567 65998d87ce Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationship-filtering 2022-01-13 11:38:47 +00:00
Andrew Kingston 9a7cc4113d Merge branch 'develop' of github.com:Budibase/budibase into rest-pagination 2022-01-13 09:44:09 +00:00
mike12345567 f1b9490f22 Adding method for client/builder to detect that a table supports SQL filtering. 2022-01-12 17:55:28 +00:00
Michael Drury 904906e364 Merge pull request #3970 from Budibase/fix/jan-various-fixes
Various fixes
2022-01-11 09:36:12 +00:00
mike12345567 e93d347ad6 Fixing issue #3740 - using text rather than string for mysql/postgres table column creation. 2022-01-07 14:10:26 +00:00
Andrew Kingston bf22c5130f Add tests for REST pagination 2022-01-07 10:49:31 +00:00
Martin McKeaveney c2d97b9449 google auth working 2022-01-06 08:08:54 +00:00
Rory Powell 6d5d301adb Support variables in URL 2022-01-05 14:33:14 -05:00
Andrew Kingston 4ab06c200d Add support for cursor and page based pagination inside REST query request body 2022-01-05 18:10:22 +00:00
Andrew Kingston f5649b48d1 Add support for cursor based pagination in query params 2022-01-05 17:28:57 +00:00
Andrew Kingston abc02d812a Merge branch 'feature/query-variables' of github.com:Budibase/budibase into rest-pagination 2022-01-05 09:21:25 +00:00
Andrew Kingston e2478e478e Add support for query param based pagination in REST queries 2022-01-05 09:16:10 +00:00
Martin McKeaveney e87a348fb8 enabling minio support for S3 connector 2021-12-31 16:19:46 +00:00
Martin McKeaveney a09fabc54b merge with master 2021-12-30 23:10:46 +00:00
Martin McKeaveney 18ad8ac1e5 configurable query timeout, s3 options for minIO, safety on cloud deploy job 2021-12-30 17:44:27 +00:00
Martin McKeaveney b57b0f1c7b adding dynamoDB describe call to dynamo integration 2021-12-29 15:46:33 +00:00
Rory Powell 6904e6a1df Prevent escaping in query parameter bindings 2021-12-21 13:48:54 -05:00
mike12345567 1f97ae259e Adding unit tests for REST bodies and response parsing. 2021-12-15 13:09:03 +00:00
mike12345567 5c00960ac0 Fixing issue detected by test case. 2021-12-15 12:23:00 +00:00
mike12345567 12b11ed3d9 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-bodies 2021-12-14 18:03:49 +00:00
mike12345567 da7153dd64 Removing outgoing webhook functionality from automations and adding XML response/sending, as well as form data/encoded data. 2021-12-14 17:59:02 +00:00
Rory Powell 17ba5d7c88 Merge branch 'develop' into feature/query-auth 2021-12-14 09:52:16 +00:00
mike12345567 64fa8055ce Linting and adding JSON header. 2021-12-13 18:20:02 +00:00
mike12345567 17f083e586 Stopping get requests from having bodies (Node fetch doesn't allow this) and allow text body type. 2021-12-13 18:17:20 +00:00
mike12345567 b11e4bd2df Moving Typescript definitions around a bit. 2021-12-13 13:50:15 +00:00
mike12345567 1948c867cc Fixing some issues around deleting datasources/queries and managing the full URL for migrating queries. 2021-12-13 12:41:47 +00:00
mike12345567 a7743c8481 Fixing bug in tabs where double clicks cause tab switching, new headers enabled by default, disabled headers rather than enabled, get requests can have bodies. 2021-12-13 11:24:13 +00:00
mike12345567 740ffae8c8 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-13 10:14:28 +00:00
Rory Powell 077c9ef434 Integrate query with datasource auth 2021-12-11 23:34:30 +00:00
Rory Powell 9fa4fe6c76 Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-11 21:43:03 +00:00
Rory Powell 9a0af5ba0a Add _id field 2021-12-11 10:40:57 +00:00
Rory Powell eeb6614823 Merge branch 'master' into merge-master 2021-12-10 10:14:43 +00:00
mike12345567 b48c30a7c0 Updating mocks. 2021-12-09 14:12:01 +00:00
mike12345567 cade92cc63 Measuring length if no content length supplied. 2021-12-09 13:40:39 +00:00
mike12345567 ad1007ffdc Adding in the ability to retrieve and view the headers from a rest response. 2021-12-09 12:30:05 +00:00
Rory Powell 4a3f596415 Escape mysql describe to handle non standard table names 2021-12-09 11:40:59 +00:00
mike12345567 e1ae7c603d Adding placeholder and making sure query urls have a protocol. 2021-12-09 10:02:47 +00:00
mike12345567 4dd8dbc253 Fixing server rest test case. 2021-12-08 19:38:03 +00:00
mike12345567 bbb5501d41 Adding in enabled headers, making way for different body types. 2021-12-08 19:11:19 +00:00
Rory Powell 720b828bee Render table of auth configs and linting 2021-12-08 15:27:58 +00:00
Rory Powell 2256b366ef Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-08 12:45:47 +00:00
Rory Powell 8df37dae85 Merge branch 'develop' into feature/rest-redesign 2021-12-08 12:36:12 +00:00
Rory Powell 6b7f94a358 Merge branch 'develop' into rest-import 2021-12-08 11:08:32 +00:00
Rory Powell a237d31424 Tidy 2021-12-08 10:52:08 +00:00
Rory Powell 9cbe03fd66 Add backend for query / datasource auth 2021-12-07 22:33:26 +00:00
mike12345567 b31cd5b6f7 Adding in raw functionality. 2021-12-06 18:35:44 +00:00
mike12345567 99e2cd52e8 Adding stats, code, timings and size of request. 2021-12-06 18:23:18 +00:00
mike12345567 e064237981 Adding in last components of UI that were missing. 2021-12-03 18:39:05 +00:00
mike12345567 7c7b7584fa Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-03 12:45:32 +00:00
Rory Powell 6118b7ba36 Fix oracle password config 2021-12-03 10:52:03 +00:00
Rory Powell 36218ccea9 Fix oracle password config 2021-12-03 10:48:47 +00:00
mike12345567 740abf8445 Adding radio group of body types. 2021-12-02 17:53:14 +00:00
Rory Powell 224516787d Merge + Linting 2021-12-02 14:54:47 +00:00
mike12345567 4a0ce14f04 Adding the ability to set a display name for any datasource/query parameter. 2021-12-01 13:11:35 +00:00
mike12345567 cd7ef481bd Some UI tweaks. 2021-11-30 18:11:29 +00:00
mike12345567 76ce9a3017 Disabling save button when no changes made. 2021-11-30 17:56:15 +00:00
mike12345567 3e5f9b9505 Updating REST creation, removing the modal step, updating the config page to move things around as per designs. 2021-11-30 16:21:16 +00:00
Rory Powell 301938eaa0 Merge pull request #3555 from Budibase/oracle/returning
Improve returning logic for oracle
2021-11-26 18:54:19 +00:00
mike12345567 d06ab10c1d Fixing issue found with enriching rows in SQL - the system was assuming the array of entries contained a row ID that needed to be broken down. 2021-11-26 17:08:56 +00:00
Rory Powell f75928a9c9 Deletion support for returning rows 2021-11-26 16:50:15 +00:00
Rory Powell 115fc08aa4 Improve returning logic for oracle 2021-11-26 15:02:03 +00:00
Martin McKeaveney 9ac60079c7 datasource plus support for google sheets 2021-11-25 20:12:32 +01:00
Rory Powell 71ba024974 WIP: Rest API import 2021-11-25 17:14:07 +00:00
Martin McKeaveney f9b2a3c5e1 Google sheets integration CRUD E2E 2021-11-25 18:12:12 +01:00
mike12345567 f6ecd423ce Fixing some issues discovered with many to many relationships in SQL, as well as problems uncovered by #3531. 2021-11-24 20:55:03 +00:00
mike12345567 bf44c15b74 Fixing issue with datasource deletion not navigating if was on data source plus table and fixing #3523 where relationships would cause sorting to breaking postgres/oracle. 2021-11-24 18:20:52 +00:00
mike12345567 116bccfd73 Fix for issue #3327 - may not solve issue with mariaDB but works for MySQL. 2021-11-24 17:03:34 +00:00
Rory Powell 7135599295 Add returning 2021-11-23 13:27:38 +00:00
Rory Powell 4acfc668ef Update locks, ignore oracle imports on m1 2021-11-22 15:26:31 +00:00
Rory Powell ac7137c4a0 Use global sql type map, update base integration type defs 2021-11-22 11:38:17 +00:00
Rory Powell 154a5cab26 Merge branch 'develop' into oracle-datasource 2021-11-22 11:07:11 +00:00
Rory Powell d58b90cac1 Merge branch 'oracle-datasource' into oracle-datatasource-plus 2021-11-22 10:50:34 +00:00
Rory Powell f94a0eadbe Merge branch 'develop' into oracle-datasource 2021-11-22 10:47:48 +00:00
mike12345567 38c7f3ab90 Fix for #2420 - don't allow columns which are considered invalid/not allowed. 2021-11-18 18:33:35 +00:00
Rory Powell b0df7fb28f Boolean support and linting 2021-11-18 13:35:22 +00:00
Rory Powell 345490fed3 Tests 2021-11-18 12:05:30 +00:00
Rory Powell 5d8c90c5f2 Detect auto columns 2021-11-18 10:49:53 +00:00
Rory Powell c810bacaf9 Datatypes working 2021-11-17 16:41:00 +00:00
Rory Powell 0cedd1d57b First pass end-to-end working 2021-11-17 14:34:16 +00:00
Michael Drury a726d158b8 Merge pull request #3338 from Budibase/feature/query-rbac-timeouts
Query RBAC, query and automation threading/timeouts
2021-11-17 11:39:09 +00:00
mike12345567 1d7fe369c6 Linting and updating csv parser test case to match new functionality. 2021-11-12 19:39:12 +00:00
mike12345567 d9d5391a40 Some UI work, as well as moving SQL to using a proper bulk insert method and fixing an issue found with csv parsing and removing of invalid columns. 2021-11-12 19:24:56 +00:00
mike12345567 9f4ff190c3 Fixing issues dsicovered by automation test cases, as well as disabling threading for test scenarios. 2021-11-11 16:20:30 +00:00
mike12345567 de8a91da83 Fixing an issue with filtering by dates in SQL, where the lucene dates provided don't convert cleanly to JS dates. 2021-11-11 15:36:21 +00:00
mike12345567 5c8670c7f4 Merge branch 'develop' of github.com:Budibase/budibase into feature/query-rbac-timeouts 2021-11-11 13:50:42 +00:00
mike12345567 781e8359a1 Adding worker-farm back to have a mechanism to run queries within which we can timeout. 2021-11-10 19:35:09 +00:00
mike12345567 7f055ed8dc Adding a way to switch between string and options, as well as number and boolean types, this is very useful for SQL tables. 2021-11-10 15:01:44 +00:00
Rory Powell 6ac31e0854 Merge pull request #3178 from Budibase/postgres-schema
Postgres: Use another schema other than 'public'
2021-11-10 10:03:25 +00:00
Rory Powell 2caa530ff0 Tidy imports 2021-11-09 17:55:10 +00:00
Rory Powell 231ddda4e7 Tidy and remove unused fields 2021-11-09 17:52:26 +00:00
Rory Powell 9bcfa0af70 Remove comments 2021-11-09 17:33:29 +00:00
mike12345567 a78230e23b Reworking MS-SQL test case to be able to get the sql now with a request being made for each internal query, rather than just at connection. 2021-11-09 11:16:12 +00:00
Rory Powell 9273edc794 Integrate with UI 2021-11-08 22:08:47 +00:00
mike12345567 9d800484f2 Some refactoring to make it easier to find specific edge cases of sql clients. 2021-11-08 18:12:40 +00:00
mike12345567 b310918ec4 Fixing #3182 so that sorting is disabled for certain column types that we cannot use, as well as fixing some issues with MS-SQL plus tables. 2021-11-08 17:25:05 +00:00
mike12345567 e6d05f1e90 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-08 14:43:28 +00:00
mike12345567 6455f51d4f Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-08 14:00:47 +00:00
mike12345567 b34cef26c3 Fixing an issue with relationship modal breaking when multiple data sources available to relate to, also fixing an pile of issues with creating and reading rows from SQL server plus. 2021-11-05 18:55:36 +00:00
Rory Powell 2b6c6d7aaa Merge branch 'develop' into postgres-schema 2021-11-05 14:07:39 +00:00
Rory Powell cb661eab34 Add oracledb package, readme, and config 2021-11-05 13:56:54 +00:00
mike12345567 3474f3ae8e Updating underlying sql to not use ilike unless in postgres client. 2021-11-05 13:48:13 +00:00
mike12345567 5ec0d803af Cleaning up repeated work in sql server building of schema. 2021-11-05 12:41:26 +00:00
mike12345567 9c933b629f Linting and updating SQL Server schema generation to include auto column and primary key recognition. 2021-11-05 12:33:48 +00:00
mike12345567 515ed75680 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-05 10:58:04 +00:00
Martin McKeaveney b7c5778409 Merge pull request #3187 from Budibase/fix/safari-bug
Fix budibase builder preview on safari
2021-11-04 17:22:02 +01:00
Martin McKeaveney 193d40bbf3 refactor switch into a key value handler object
tidy up - remove logs and comments

update windowed modals to use postMessage
2021-11-04 17:21:17 +01:00
Rory Powell b5b191361d Add stub integration file and docker compose config 2021-11-04 14:54:35 +00:00
mike12345567 b2bf5056b5 Fixing rest test mocking. 2021-11-03 15:45:19 +00:00
mike12345567 f8b2429bd0 Fixing REST PUT using POST as per #3227. 2021-11-03 13:12:20 +00:00
mike12345567 953c90c8d4 Fixing some issues with MySQL and dropping foreign key constrained columns. 2021-11-02 13:36:23 +00:00
mike12345567 835b0efe74 Adding mysql support. 2021-10-29 18:43:50 +01:00
mike12345567 f071cc5219 Adding many to many support, generating junction table and setting up constraints. 2021-10-29 18:37:29 +01:00
mike12345567 a94376ce43 Fixing a lot of issues around dropping columns, updating columns, relationships and bi-directionality, display columns now default to something for SQL tables as well. 2021-10-29 13:34:10 +01:00
mike12345567 329156d6cc SQL table building. 2021-10-28 19:39:42 +01:00
mike12345567 5e846ac64d First version of schema generation for ms-sql, able to retrieve basic tables and rows. 2021-10-27 18:36:27 +01:00
Rory Powell c210802b4c Remove whitespace 2021-10-27 17:23:52 +01:00
Rory Powell 8b8c923541 Update tests 2021-10-27 17:21:29 +01:00
Rory Powell 0ddd689b89 Postgres: Use another schema other than 'public' 2021-10-27 16:21:19 +01:00
mike12345567 ac1d6ee23e Fixing #2820 - SQL system no longer includes tables without a primary key constraint and it displays an error to handle this. 2021-10-26 20:03:54 +01:00
Martin McKeaveney 9301406bcd enable collapsible nodes in component tree 2021-10-21 16:24:58 +01:00
Martin McKeaveney 3b3862bd01 Merge branch 'develop' into fix/postreleasefixes2 2021-10-21 16:00:48 +01:00
Martin McKeaveney d573eb464a upgrade to mysql2 package 2021-10-21 14:47:35 +01:00
mike12345567 dd75d236c0 Fixes issue #2417 in the backend, looks for fields which could contain a key value and if they do it will resolve them down to the ID field value. 2021-10-18 17:54:34 +01:00
Michael Drury 7a33a666b4 Merge pull request #3025 from Budibase/fix/quick-fixes
Fixing refresh on wrong password and setting hard SQL limits
2021-10-18 09:20:29 +01:00
mike12345567 fd894897ca Setting a hard limit on how many rows can be returned by the SQL plus queries. 2021-10-15 17:52:06 +01:00
mike12345567 a366e8a568 Fixing an issue with mongo test failing in Node 16 due to unhandled promise rejections. 2021-10-14 16:37:11 +01:00
Martin McKeaveney 11e64b0ffe tidy up 2021-10-12 20:19:32 +01:00
Martin McKeaveney b38704978a Merge branch 'develop' of github.com:Budibase/budibase into fix/postrelease 2021-10-12 16:50:37 +01:00
Martin McKeaveney 03ba725fbc remove random files 2021-10-12 16:14:49 +01:00
Martin McKeaveney ec26d5c738 SSL support for digitalocean, started utility function for BB logout, bunch of minor bug fixes 2021-10-12 16:13:54 +01:00
Martin McKeaveney e66dd5933a Merge pull request #2894 from mslourens/update_rest_url_with_slash_questionmark
add a slash before the path and a questionmark before the querystring
2021-10-11 22:05:45 +01:00
mike12345567 ab03435c84 Making sure creation of SQL rows don't pass down null columns (no point). 2021-10-06 17:55:03 +01:00
mike12345567 3cea3dd510 Fixing issue #2788 - making client side queries and SQL queries consistent with internal table ones. 2021-10-06 17:38:32 +01:00
Maurits Lourens dbf747f749 fix tests 2021-10-05 13:38:03 +02:00
Maurits Lourens 8709fb2f0b add a slash before the path and a questionmark before the querystring 2021-10-05 12:20:09 +02:00
mike12345567 80e7671444 Fix for many to many relationships where the union table has arbituarily named foreign key constraint columns, an example has been provided in the scripts directory. 2021-10-01 17:16:43 +01:00
Mike Shanks 0c0ac7ed05 added awaits to all mongo querys 2021-09-30 15:05:15 +01:00
Martin McKeaveney b4b90de2d6 Merge pull request #2716 from mslourens/custom_schema_support
Retrieve all columns from all not internal tables
2021-09-29 09:19:33 +01:00
Martin McKeaveney bd1f6752ff merge with develop 2021-09-27 16:37:55 +01:00
Martin McKeaveney 35d4eac78a fallback SMTP configuration for cloud 2021-09-27 14:57:22 +01:00
mike12345567 704c889151 Fixing issue discovered by test case. 2021-09-27 13:17:31 +01:00
Martin McKeaveney 3b49866825 Merge branch 'develop' of github.com:Budibase/budibase into cloud-limits 2021-09-27 12:53:15 +01:00
mike12345567 32bdc4a991 Minimal fix for issue involving JSON views and newlines with postgres, this fix couldn't be more over-arching as it risked breaking new lines across the board. Have included a script for setting up the test scenario as well. This fixes issue #2612. 2021-09-24 18:10:30 +01:00
Martin McKeaveney c49b88b57a automation runs quotas 2021-09-23 23:25:25 +01:00
mike12345567 5d8f348fc2 Fixing SQL test cases. 2021-09-23 16:56:13 +01:00
mike12345567 67212e5c5b Fixes issue #2616 - this is a slightly complex fix and handles a few other issues with mysql (around returning on creation of a row and relationships) - a new mechanism is now used for pagination and limiting which makes sure the limits are applied to the outer table rather than the combination of the outer and the joined. 2021-09-23 16:35:09 +01:00
Martin McKeaveney ec30a0b0b0 Merge pull request #2715 from mslourens/extend_postgres_data_types
Extend Postgres data type map
2021-09-23 12:25:03 +01:00
Maurits Lourens 99644b0cd8 Retrieve all columns from all not internal tables 2021-09-23 11:11:00 +02:00
Maurits Lourens 27cdde679c Extend Postgres data type map 2021-09-23 09:54:58 +02:00
mike12345567 e92b0e0c94 Fixing issue #2673 - discovered issues with some column types not being worked out to be auto-columns in postgres. 2021-09-22 17:46:54 +01:00
Martin McKeaveney 8b4861f27c Merge pull request #2551 from mslourens/fix_uppercase_database_name
fix fetching tables from database with uppercase name
2021-09-15 09:53:40 +01:00
Martin McKeaveney bcb5cb1d77 merge with master 2021-09-06 16:13:17 +01:00
Maurits Lourens 4d4d6aa27b fix fetching tables from database with uppercase name 2021-09-06 12:33:03 +02:00
mike12345567 0b0da47778 Fixing issues discovered by test cases. 2021-09-03 11:06:44 +01:00
mike12345567 8c3eb30ab1 Fixing issues after upgrading to node 14 and circular dependencies causing issues. 2021-09-02 18:33:41 +01:00
mike12345567 a9e2336036 Fixing issues with SQL many relationship updates. 2021-09-01 19:40:47 +01:00
Martin McKeaveney 83db9754d5 prevent relationships getting overridden in mySQL connector 2021-08-31 14:44:33 +01:00
Maurits Lourens 3e7369b1cb add patch method to the rest api interface 2021-08-30 22:55:12 +02:00
Martin McKeaveney b8d10a2b6d merge package updates 2021-08-26 14:13:30 +01:00
Martin McKeaveney e7f8454ad7 make SQL startsWith queries case insensitive 2021-08-20 15:20:52 +01:00
mike12345567 bc84bab52c Merge branch 'master' of github.com:Budibase/budibase into develop 2021-08-06 13:04:54 +01:00
Michael Drury ae18e3408e Merge pull request #2286 from Budibase/fix/relationships-2167
Some fixes for internal and external relationships
2021-08-06 12:51:44 +01:00
mike12345567 29817892a8 Fixing test cases. 2021-08-06 12:33:04 +01:00
Martin McKeaveney 9751e84bed fix sql server integration 2021-08-05 22:15:40 +01:00
mike12345567 5a0ef45c29 Fixing issues with many to many relationships in SQL, sometimes not creating right relationships. 2021-08-05 19:49:30 +01:00
mike12345567 7624390f0b Fixing a variety of issues with internal relationships and external SQL relationships. 2021-08-05 19:24:29 +01:00
mike12345567 57f46bfdb4 Merge branch 'master' of github.com:Budibase/budibase into develop 2021-08-04 15:00:50 +01:00
mike12345567 f4a3d2ff3b Fix for #2250, strings were being parsed for numbers which was causing the issue for strings starting with numbers, using the table schema to determine is parsing necessary. 2021-08-04 14:46:21 +01:00
Martin McKeaveney 0f1bb2ccff fix mongo code review comment 2021-07-29 10:11:52 +01:00
Martin McKeaveney 7ba17204c5 Merge pull request #1963 from faroutchris/feature/query-mongo-collection
Feature/query mongo collection
2021-07-29 10:10:52 +01:00
mike12345567 3eb82b5a63 Merge branch 'master' of github.com:Budibase/budibase into develop 2021-07-14 13:54:39 +01:00
Martin McKeaveney 7e5c4be14f fix postgres query array value 2021-07-13 17:11:11 +01:00
mike12345567 7aca56f019 Adding float type to MySQL. 2021-07-12 11:10:11 +01:00
mike12345567 184df6c685 Fixing some issues discovered with the new SQL connectors were the input type would always be string (causing some SQL types to break) - parsing these before input to attempt to fix this problem - issue referenced in #1943. 2021-07-12 10:51:30 +01:00
Christo 8579d1872c Test: Add some basic tests for mongodb queries 2021-07-09 20:08:26 +02:00
Christo 4096f4857c Feat: Add collection fields as "extra" query config for MongoDB 2021-07-09 19:28:46 +02:00
mike12345567 ede0a5ec9b Making sure that keys cannot be duplicated for primary keys, this wouldn't have any function. 2021-07-06 15:45:14 +01:00
mike12345567 6648e548c5 Quick fix, make sure auto-columns never sent to DB. 2021-07-06 13:55:05 +01:00
mike12345567 b216c03e44 Linting. 2021-07-05 18:16:04 +01:00
mike12345567 8550d00751 Giving the system the ability to make auto increment columns auto-columns in postgres or mysql. 2021-07-05 18:11:23 +01:00
mike12345567 eaf808b190 Fixing issue with TS definitions. 2021-07-05 17:33:36 +01:00
mike12345567 e7d6298647 Merge branch 'master' of github.com:Budibase/budibase into develop 2021-07-05 17:17:32 +01:00
mike12345567 ca1c48232b Linting. 2021-07-05 15:16:32 +01:00
mike12345567 16581552cb Fixing issue with single quotes in strings breaking JSON parsing. 2021-07-05 15:14:45 +01:00
mike12345567 11f6abee0a Re-writing a bit so that it is aware some functionality is SQL only, makes future plus endpoints easier. 2021-07-03 11:15:01 +01:00
mike12345567 71f96f9601 Fixing little UI bugs. 2021-07-03 10:26:37 +01:00
mike12345567 fcf4dbc7a1 Updating server test cases. 2021-07-02 14:49:47 +01:00
mike12345567 10730d8053 Implementing UI to support the backend put in place. 2021-07-02 14:33:05 +01:00
Martin McKeaveney 3eb8f3c445 bidirectional relationships, many to one 2021-07-01 22:23:47 +01:00
Martin McKeaveney cae1a20411 preventing relationship overrides 2021-07-01 21:24:23 +01:00
mike12345567 7fb1e80196 Re-writing external layer in typescript. 2021-07-01 19:20:41 +01:00
mike12345567 b3eea4e4d1 Removing PG hack and handling the updating of relationships from the one side, e.g. one person is linked to many tasks, allow updating the person and having FK in tasks get updated with that persons ID. 2021-07-01 18:23:15 +01:00
mike12345567 bb396ebff0 First version of enrichment. 2021-07-01 14:10:44 +01:00
mike12345567 3ed5cff945 First attempt at solving the enrichment call, as well as various fixes. 2021-06-30 18:31:16 +01:00
mike12345567 9780f2a788 Getting writing of one and many rows working. 2021-06-30 14:46:44 +01:00
mike12345567 9ca36893ad Managing the scenario where columns can overlap in SQL relationships which most JSON based libraries cannot manage, instead of trying to manage this just don't return the overlapping columns which are not of interest. 2021-06-29 18:38:27 +01:00
mike12345567 98b7bff678 Implementing all return possibilities, now to implement creation. 2021-06-29 17:42:46 +01:00
mike12345567 2d162fda31 Linting. 2021-06-28 10:21:37 +01:00
mike12345567 5389878801 Moving definitions to central location and adding a few more definitions. 2021-06-26 23:09:46 +01:00
mike12345567 84ea655fd9 Linting. 2021-06-25 18:34:21 +01:00
mike12345567 856be36d9e Merge branch 'develop' of github.com:Budibase/budibase into feature/sql-relationships 2021-06-25 18:13:11 +01:00
mike12345567 96fd8ed947 Updating tests to use latest version of jest, which broke a lot of things, but was necessary to get proper ts-jest support. 2021-06-25 13:46:02 +01:00
mike12345567 aea08af49c Formatting. 2021-06-24 18:17:26 +01:00
mike12345567 ffc54c3720 First attempt and re-writing a portion of the server in typescript. 2021-06-24 18:16:48 +01:00
Martin McKeaveney 1a6b46e678 strip double quotes and use single in ID 2021-06-23 23:35:53 +01:00
Martin McKeaveney 852691f75d fix external data sources key parsing with double quote strings 2021-06-23 23:19:41 +01:00
Martin McKeaveney 6857dc08e7 string based keyProps not being parsed properly by handlebars 2021-06-23 23:15:16 +01:00
mike12345567 fd4403037d WIP - basic override of foreign keys. 2021-06-23 19:05:32 +01:00
mike12345567 b3f3826aa6 Fixing an issue I found with postgres schema generator, it was applying all primary keys to all tables. 2021-06-23 12:44:54 +01:00
Martin McKeaveney f57e10c01a fix condition in layout 2021-06-18 17:57:01 +01:00
mike12345567 de1ad05c7a Linting. 2021-06-18 13:33:44 +01:00
mike12345567 eb2cf1afa6 Quick updates to make sure mySQL works with automations. 2021-06-18 13:24:29 +01:00
mike12345567 40e06cc5d1 Formatting and fixing an issue with mysql not being able to return a row that it has created, updated or deleted. 2021-06-18 13:14:45 +01:00
mike12345567 21b591954f Adding a mySQL plus integration, as well as fixing some issues with running queries directly. 2021-06-18 12:29:25 +01:00
Martin McKeaveney 35942d27b4 fix up datasources and server tests 2021-06-17 15:24:52 +01:00
mike12345567 1014260ad5 Merge branch 'feature/opinionated-sql' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-17 14:42:41 +01:00
mike12345567 09bc70cc3d Fixing a bunch of issues around automations. 2021-06-17 14:42:30 +01:00
Martin McKeaveney 08b74d2cec lint 2021-06-17 14:06:31 +01:00
Martin McKeaveney 2737949602 Merge branch 'feature/opinionated-sql' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-16 23:27:47 +01:00
Martin McKeaveney 9841a74e39 datasource selection logic - unselect other entities when choosing datasource 2021-06-16 23:27:38 +01:00
mike12345567 615b207fbb Formatting. 2021-06-16 18:39:59 +01:00
mike12345567 7b8d448d78 Merge branch 'feature/opinionated-sql' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-16 18:39:15 +01:00
mike12345567 295c3ef1a3 Fixing automation integration and various components around forms. 2021-06-16 18:38:00 +01:00
Martin McKeaveney 9e41068a5d end to end data providers and opinionated sql 2021-06-16 17:50:22 +01:00
mike12345567 efafe5d243 Fixing issues with inability to search. 2021-06-16 16:27:33 +01:00
mike12345567 a930a05eb6 Fixing issue with base postgres integration. 2021-06-16 15:51:33 +01:00
Martin McKeaveney ba09f2df4b consolidate postgres datas sources 2021-06-16 15:45:57 +01:00
mike12345567 6733b61b78 Merge branch 'master' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-16 14:13:57 +01:00
Martin McKeaveney ceed5e0c07 Merge branch 'feature/opinionated-sql' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-15 19:58:34 +01:00
mike12345567 1f818cf42f Quick fixes for types. 2021-06-15 19:57:41 +01:00
Martin McKeaveney e3cced9d97 consolidate data sources and queries together in one UI 2021-06-15 19:48:05 +01:00
Andrew Kingston 32a3c2bbb6 Lint with prettier 2021-06-15 19:39:40 +01:00
mike12345567 d93c4b02ae Merge branch 'feature/opinionated-sql' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-15 13:50:49 +01:00
mike12345567 0cf316d2d6 Some quick updates after testing. 2021-06-15 13:50:41 +01:00
Martin McKeaveney 759347c48b merge 2021-06-15 13:37:21 +01:00
Martin McKeaveney de279fa6a9 removing _all concept for tables, more work on plus datasource 2021-06-15 13:32:11 +01:00
mike12345567 7e9b9f2180 Some quick work to make it function as required. 2021-06-15 13:20:25 +01:00
mike12345567 0a69ea02ee Adding some work towards supporting full data source integration. 2021-06-15 13:03:55 +01:00
Martin McKeaveney 760dc88ef3 SQL for fetching primary keys, needs merged into column SQL 2021-06-14 20:05:18 +01:00
mike12345567 4950db460c Formatting. 2021-06-14 19:07:13 +01:00
mike12345567 6b40f15318 Merge branch 'feature/opinionated-sql' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-11 18:56:44 +01:00
mike12345567 20f7056d8a Updating rows API so that it has been broken into an internal and external API - this is breaking as it breaks out how bulk deletion is handled. 2021-06-11 18:56:30 +01:00
Martin McKeaveney 114eac4134 external/internal tables and datasources merged, removed autocapture, re-added logout action 2021-06-11 17:52:08 +01:00
Martin McKeaveney a44d59541d merge 2021-06-10 14:15:03 +01:00
Martin McKeaveney ca4d976a76 plus datasource schema 2021-06-09 16:55:58 +01:00
mike12345567 4fdbeafca5 Adding test case for data source opinionated query endpoint. 2021-06-04 15:16:15 +01:00
mike12345567 c00f1ea0bc Adding schema validation and API endpoint to data sources for query. 2021-06-04 14:53:49 +01:00
mike12345567 2fe6efaed3 Updating test cases. 2021-06-03 18:48:04 +01:00
mike12345567 01fabba959 Merge branch 'plus-datasources' of github.com:Budibase/budibase into feature/opinionated-sql 2021-06-03 18:19:33 +01:00
Martin McKeaveney de4051da45 endpoint for plus datasources 2021-06-03 17:56:04 +01:00
mike12345567 738b5af4c0 Switching from .toString to .toSQL().toNative() for sql injection protection. 2021-06-03 17:45:19 +01:00
mike12345567 20d7d36a16 Using all lowercase 'query' function name for the builder. 2021-06-03 16:47:31 +01:00
mike12345567 f507daa46a Linking up to existing SQL integrations. 2021-06-03 16:45:43 +01:00
mike12345567 0fba3cc8fd Adding base SQL class which processes defined JSON structure into SQL. 2021-06-03 16:31:24 +01:00
Martin McKeaveney 36b39ef4df merge google accounts, improve connection pooling for RDBMS 2021-06-01 15:00:28 +01:00
Martin McKeaveney 03a9af0369 making HTTP POST and PUT readable, more robust app import to avoid document conflicts 2021-05-29 13:52:31 +01:00
Martin McKeaveney 09ce58aa95 fix mssql encryption option 2021-05-28 11:55:28 +01:00
mike12345567 c9a352bee7 Fixing server test cases. 2021-05-27 15:40:55 +01:00
Martin McKeaveney b830265b89 SSL fixes, update boolean in lucene 2021-05-26 22:48:55 +01:00
Martin McKeaveney b328875ebd fix tests 2021-05-24 12:14:04 +01:00
Martin McKeaveney f58ad3a12c allow deletion of relationships 2021-05-23 15:06:33 +01:00
mike12345567 b119ae19c6 Fixing broken server test cases. 2021-05-21 16:02:21 +01:00
Martin McKeaveney 237642e4af merge 2021-05-20 12:41:54 +01:00
Martin McKeaveney 7ab24fed2b merge with master 2021-05-20 10:40:15 +01:00
Martin McKeaveney 6cb1380770 postgres connection pooling 2021-05-19 20:58:59 +01:00
Andrew Kingston 797e8a8b67 Add explicit prettier options 2021-05-04 11:32:22 +01:00
Keviin Åberg Kultalahti 0afbf1649e lint:fix 2021-05-03 09:31:09 +02:00
mike12345567 2ef1586d4d Adding cleanup operation to dynamo client. 2021-04-19 22:36:14 +01:00
mike12345567 806bd4e06b Fixing an issue with the DynamoDB integration, didn't specify the correct terms for the AWS credentials. 2021-04-19 22:24:13 +01:00
mike12345567 3a6cc28df0 Merge branch 'master' of github.com:Budibase/budibase into next 2021-04-16 17:01:35 +01:00
Martin McKeaveney f5c31f73b3 lint 2021-04-12 16:51:07 +01:00
Martin McKeaveney 947da97d62 Update microsoftSqlServer.js 2021-04-12 15:01:52 +01:00
Martin McKeaveney cd1b35a77a more branch cov 2021-03-16 19:27:18 +00:00
Martin McKeaveney c0e9ee282a mysql tests 2021-03-16 19:01:51 +00:00
Martin McKeaveney 172db5f255 airtable tests 2021-03-16 18:43:56 +00:00
Martin McKeaveney d2699a2755 REST integration tests 2021-03-16 14:51:14 +00:00
Martin McKeaveney a16c05ecb0 arangodb tests 2021-03-16 13:54:39 +00:00
Martin McKeaveney 2150a47af4 elasticsearch tests 2021-03-16 11:46:13 +00:00
Martin McKeaveney d5ae0fa2a9 dynamoDB tests 2021-03-15 19:45:39 +00:00
Martin McKeaveney e7b0564ca3 couchDB tests 2021-03-15 16:26:46 +00:00
Martin McKeaveney de68ba23dd postgres integration tests 2021-03-15 16:07:04 +00:00
Martin McKeaveney c31e04eb73 airtable tests 2021-03-12 09:29:27 +00:00
Martin McKeaveney 31c0905ade merge 2021-03-11 15:28:43 +00:00
Martin McKeaveney 4b5a1d6177 allowing airtable query to send down the number of records you want from your table 2021-03-10 10:39:58 +00:00
Martin McKeaveney ed6a77a55d mysql key length 2021-02-24 21:58:38 +00:00
Martin McKeaveney a17a1fb07b SSL config for mysql, remove rickroll 2021-02-24 16:31:47 +00:00
Martin McKeaveney 89c2ae0692 read all columns for schema rather than just the first 2021-02-22 17:41:02 +00:00
Martin McKeaveney e08c917080 adding description blurbs to datasources 2021-02-19 15:07:43 +00:00
Martin McKeaveney f53463ec0c response parsing 2021-02-18 19:24:42 +00:00
Martin McKeaveney a834f17a80 more design updates 2021-02-18 18:55:08 +00:00
Martin McKeaveney 6e121b6045 design updates, changing query verb names to HTTP verbs 2021-02-18 16:58:10 +00:00
Martin McKeaveney 13c51f61d9 ensure JSON parsed correctly 2021-02-15 19:57:49 +00:00
Martin McKeaveney 55f98e82d8 REST integration complete 2021-02-15 18:41:56 +00:00
Martin McKeaveney 5787dd3f93 REST integration end to end 2021-02-15 17:05:53 +00:00
Martin McKeaveney befb94aaa9 fixes for mySQL and MSSQL non default ports 2021-02-03 08:20:21 +00:00
mike12345567 ec21fcbc4d Some quick fixes to allow custom verbs. 2021-02-02 17:28:11 +00:00
mike12345567 6a41875556 Some fixes for integrations, making Dynamo work correctly and allow local usage as well as using the API to try and make responses that are objects work better. 2021-02-02 16:26:15 +00:00