Commit Graph

417 Commits

Author SHA1 Message Date
Martin McKeaveney a09fabc54b merge with master 2021-12-30 23:10:46 +00:00
Martin McKeaveney 18ad8ac1e5 configurable query timeout, s3 options for minIO, safety on cloud deploy job 2021-12-30 17:44:27 +00:00
Martin McKeaveney b57b0f1c7b adding dynamoDB describe call to dynamo integration 2021-12-29 15:46:33 +00:00
Rory Powell 6904e6a1df Prevent escaping in query parameter bindings 2021-12-21 13:48:54 -05:00
mike12345567 1f97ae259e Adding unit tests for REST bodies and response parsing. 2021-12-15 13:09:03 +00:00
mike12345567 5c00960ac0 Fixing issue detected by test case. 2021-12-15 12:23:00 +00:00
mike12345567 12b11ed3d9 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-bodies 2021-12-14 18:03:49 +00:00
mike12345567 da7153dd64 Removing outgoing webhook functionality from automations and adding XML response/sending, as well as form data/encoded data. 2021-12-14 17:59:02 +00:00
Rory Powell 17ba5d7c88 Merge branch 'develop' into feature/query-auth 2021-12-14 09:52:16 +00:00
mike12345567 64fa8055ce Linting and adding JSON header. 2021-12-13 18:20:02 +00:00
mike12345567 17f083e586 Stopping get requests from having bodies (Node fetch doesn't allow this) and allow text body type. 2021-12-13 18:17:20 +00:00
mike12345567 b11e4bd2df Moving Typescript definitions around a bit. 2021-12-13 13:50:15 +00:00
mike12345567 1948c867cc Fixing some issues around deleting datasources/queries and managing the full URL for migrating queries. 2021-12-13 12:41:47 +00:00
mike12345567 a7743c8481 Fixing bug in tabs where double clicks cause tab switching, new headers enabled by default, disabled headers rather than enabled, get requests can have bodies. 2021-12-13 11:24:13 +00:00
mike12345567 740ffae8c8 Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-13 10:14:28 +00:00
Rory Powell 077c9ef434 Integrate query with datasource auth 2021-12-11 23:34:30 +00:00
Rory Powell 9fa4fe6c76 Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-11 21:43:03 +00:00
Rory Powell 9a0af5ba0a Add _id field 2021-12-11 10:40:57 +00:00
Rory Powell eeb6614823 Merge branch 'master' into merge-master 2021-12-10 10:14:43 +00:00
mike12345567 b48c30a7c0 Updating mocks. 2021-12-09 14:12:01 +00:00
mike12345567 cade92cc63 Measuring length if no content length supplied. 2021-12-09 13:40:39 +00:00
mike12345567 ad1007ffdc Adding in the ability to retrieve and view the headers from a rest response. 2021-12-09 12:30:05 +00:00
Rory Powell 4a3f596415 Escape mysql describe to handle non standard table names 2021-12-09 11:40:59 +00:00
mike12345567 e1ae7c603d Adding placeholder and making sure query urls have a protocol. 2021-12-09 10:02:47 +00:00
mike12345567 4dd8dbc253 Fixing server rest test case. 2021-12-08 19:38:03 +00:00
mike12345567 bbb5501d41 Adding in enabled headers, making way for different body types. 2021-12-08 19:11:19 +00:00
Rory Powell 720b828bee Render table of auth configs and linting 2021-12-08 15:27:58 +00:00
Rory Powell 2256b366ef Merge branch 'feature/rest-redesign' into feature/query-auth 2021-12-08 12:45:47 +00:00
Rory Powell 8df37dae85 Merge branch 'develop' into feature/rest-redesign 2021-12-08 12:36:12 +00:00
Rory Powell 6b7f94a358 Merge branch 'develop' into rest-import 2021-12-08 11:08:32 +00:00
Rory Powell a237d31424 Tidy 2021-12-08 10:52:08 +00:00
Rory Powell 9cbe03fd66 Add backend for query / datasource auth 2021-12-07 22:33:26 +00:00
mike12345567 b31cd5b6f7 Adding in raw functionality. 2021-12-06 18:35:44 +00:00
mike12345567 99e2cd52e8 Adding stats, code, timings and size of request. 2021-12-06 18:23:18 +00:00
mike12345567 e064237981 Adding in last components of UI that were missing. 2021-12-03 18:39:05 +00:00
mike12345567 7c7b7584fa Merge branch 'develop' of github.com:Budibase/budibase into feature/rest-redesign 2021-12-03 12:45:32 +00:00
Rory Powell 6118b7ba36 Fix oracle password config 2021-12-03 10:52:03 +00:00
Rory Powell 36218ccea9 Fix oracle password config 2021-12-03 10:48:47 +00:00
mike12345567 740abf8445 Adding radio group of body types. 2021-12-02 17:53:14 +00:00
Rory Powell 224516787d Merge + Linting 2021-12-02 14:54:47 +00:00
mike12345567 4a0ce14f04 Adding the ability to set a display name for any datasource/query parameter. 2021-12-01 13:11:35 +00:00
mike12345567 cd7ef481bd Some UI tweaks. 2021-11-30 18:11:29 +00:00
mike12345567 76ce9a3017 Disabling save button when no changes made. 2021-11-30 17:56:15 +00:00
mike12345567 3e5f9b9505 Updating REST creation, removing the modal step, updating the config page to move things around as per designs. 2021-11-30 16:21:16 +00:00
Rory Powell 301938eaa0 Merge pull request #3555 from Budibase/oracle/returning
Improve returning logic for oracle
2021-11-26 18:54:19 +00:00
mike12345567 d06ab10c1d Fixing issue found with enriching rows in SQL - the system was assuming the array of entries contained a row ID that needed to be broken down. 2021-11-26 17:08:56 +00:00
Rory Powell f75928a9c9 Deletion support for returning rows 2021-11-26 16:50:15 +00:00
Rory Powell 115fc08aa4 Improve returning logic for oracle 2021-11-26 15:02:03 +00:00
Martin McKeaveney 9ac60079c7 datasource plus support for google sheets 2021-11-25 20:12:32 +01:00
Rory Powell 71ba024974 WIP: Rest API import 2021-11-25 17:14:07 +00:00
Martin McKeaveney f9b2a3c5e1 Google sheets integration CRUD E2E 2021-11-25 18:12:12 +01:00
mike12345567 f6ecd423ce Fixing some issues discovered with many to many relationships in SQL, as well as problems uncovered by #3531. 2021-11-24 20:55:03 +00:00
mike12345567 bf44c15b74 Fixing issue with datasource deletion not navigating if was on data source plus table and fixing #3523 where relationships would cause sorting to breaking postgres/oracle. 2021-11-24 18:20:52 +00:00
mike12345567 116bccfd73 Fix for issue #3327 - may not solve issue with mariaDB but works for MySQL. 2021-11-24 17:03:34 +00:00
Rory Powell 7135599295 Add returning 2021-11-23 13:27:38 +00:00
Rory Powell 4acfc668ef Update locks, ignore oracle imports on m1 2021-11-22 15:26:31 +00:00
Rory Powell ac7137c4a0 Use global sql type map, update base integration type defs 2021-11-22 11:38:17 +00:00
Rory Powell 154a5cab26 Merge branch 'develop' into oracle-datasource 2021-11-22 11:07:11 +00:00
Rory Powell d58b90cac1 Merge branch 'oracle-datasource' into oracle-datatasource-plus 2021-11-22 10:50:34 +00:00
Rory Powell f94a0eadbe Merge branch 'develop' into oracle-datasource 2021-11-22 10:47:48 +00:00
mike12345567 38c7f3ab90 Fix for #2420 - don't allow columns which are considered invalid/not allowed. 2021-11-18 18:33:35 +00:00
Rory Powell b0df7fb28f Boolean support and linting 2021-11-18 13:35:22 +00:00
Rory Powell 345490fed3 Tests 2021-11-18 12:05:30 +00:00
Rory Powell 5d8c90c5f2 Detect auto columns 2021-11-18 10:49:53 +00:00
Rory Powell c810bacaf9 Datatypes working 2021-11-17 16:41:00 +00:00
Rory Powell 0cedd1d57b First pass end-to-end working 2021-11-17 14:34:16 +00:00
Michael Drury a726d158b8 Merge pull request #3338 from Budibase/feature/query-rbac-timeouts
Query RBAC, query and automation threading/timeouts
2021-11-17 11:39:09 +00:00
mike12345567 1d7fe369c6 Linting and updating csv parser test case to match new functionality. 2021-11-12 19:39:12 +00:00
mike12345567 d9d5391a40 Some UI work, as well as moving SQL to using a proper bulk insert method and fixing an issue found with csv parsing and removing of invalid columns. 2021-11-12 19:24:56 +00:00
mike12345567 9f4ff190c3 Fixing issues dsicovered by automation test cases, as well as disabling threading for test scenarios. 2021-11-11 16:20:30 +00:00
mike12345567 de8a91da83 Fixing an issue with filtering by dates in SQL, where the lucene dates provided don't convert cleanly to JS dates. 2021-11-11 15:36:21 +00:00
mike12345567 5c8670c7f4 Merge branch 'develop' of github.com:Budibase/budibase into feature/query-rbac-timeouts 2021-11-11 13:50:42 +00:00
mike12345567 781e8359a1 Adding worker-farm back to have a mechanism to run queries within which we can timeout. 2021-11-10 19:35:09 +00:00
mike12345567 7f055ed8dc Adding a way to switch between string and options, as well as number and boolean types, this is very useful for SQL tables. 2021-11-10 15:01:44 +00:00
Rory Powell 6ac31e0854 Merge pull request #3178 from Budibase/postgres-schema
Postgres: Use another schema other than 'public'
2021-11-10 10:03:25 +00:00
Rory Powell 2caa530ff0 Tidy imports 2021-11-09 17:55:10 +00:00
Rory Powell 231ddda4e7 Tidy and remove unused fields 2021-11-09 17:52:26 +00:00
Rory Powell 9bcfa0af70 Remove comments 2021-11-09 17:33:29 +00:00
mike12345567 a78230e23b Reworking MS-SQL test case to be able to get the sql now with a request being made for each internal query, rather than just at connection. 2021-11-09 11:16:12 +00:00
Rory Powell 9273edc794 Integrate with UI 2021-11-08 22:08:47 +00:00
mike12345567 9d800484f2 Some refactoring to make it easier to find specific edge cases of sql clients. 2021-11-08 18:12:40 +00:00
mike12345567 b310918ec4 Fixing #3182 so that sorting is disabled for certain column types that we cannot use, as well as fixing some issues with MS-SQL plus tables. 2021-11-08 17:25:05 +00:00
mike12345567 e6d05f1e90 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-08 14:43:28 +00:00
mike12345567 6455f51d4f Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-08 14:00:47 +00:00
mike12345567 b34cef26c3 Fixing an issue with relationship modal breaking when multiple data sources available to relate to, also fixing an pile of issues with creating and reading rows from SQL server plus. 2021-11-05 18:55:36 +00:00
Rory Powell 2b6c6d7aaa Merge branch 'develop' into postgres-schema 2021-11-05 14:07:39 +00:00
Rory Powell cb661eab34 Add oracledb package, readme, and config 2021-11-05 13:56:54 +00:00
mike12345567 3474f3ae8e Updating underlying sql to not use ilike unless in postgres client. 2021-11-05 13:48:13 +00:00
mike12345567 5ec0d803af Cleaning up repeated work in sql server building of schema. 2021-11-05 12:41:26 +00:00
mike12345567 9c933b629f Linting and updating SQL Server schema generation to include auto column and primary key recognition. 2021-11-05 12:33:48 +00:00
mike12345567 515ed75680 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-05 10:58:04 +00:00
Martin McKeaveney b7c5778409 Merge pull request #3187 from Budibase/fix/safari-bug
Fix budibase builder preview on safari
2021-11-04 17:22:02 +01:00
Martin McKeaveney 193d40bbf3 refactor switch into a key value handler object
tidy up - remove logs and comments

update windowed modals to use postMessage
2021-11-04 17:21:17 +01:00
Rory Powell b5b191361d Add stub integration file and docker compose config 2021-11-04 14:54:35 +00:00
mike12345567 b2bf5056b5 Fixing rest test mocking. 2021-11-03 15:45:19 +00:00
mike12345567 f8b2429bd0 Fixing REST PUT using POST as per #3227. 2021-11-03 13:12:20 +00:00
mike12345567 953c90c8d4 Fixing some issues with MySQL and dropping foreign key constrained columns. 2021-11-02 13:36:23 +00:00
mike12345567 835b0efe74 Adding mysql support. 2021-10-29 18:43:50 +01:00
mike12345567 f071cc5219 Adding many to many support, generating junction table and setting up constraints. 2021-10-29 18:37:29 +01:00
mike12345567 a94376ce43 Fixing a lot of issues around dropping columns, updating columns, relationships and bi-directionality, display columns now default to something for SQL tables as well. 2021-10-29 13:34:10 +01:00
mike12345567 329156d6cc SQL table building. 2021-10-28 19:39:42 +01:00
mike12345567 5e846ac64d First version of schema generation for ms-sql, able to retrieve basic tables and rows. 2021-10-27 18:36:27 +01:00
Rory Powell c210802b4c Remove whitespace 2021-10-27 17:23:52 +01:00
Rory Powell 8b8c923541 Update tests 2021-10-27 17:21:29 +01:00
Rory Powell 0ddd689b89 Postgres: Use another schema other than 'public' 2021-10-27 16:21:19 +01:00
mike12345567 ac1d6ee23e Fixing #2820 - SQL system no longer includes tables without a primary key constraint and it displays an error to handle this. 2021-10-26 20:03:54 +01:00
Martin McKeaveney 9301406bcd enable collapsible nodes in component tree 2021-10-21 16:24:58 +01:00
Martin McKeaveney 3b3862bd01 Merge branch 'develop' into fix/postreleasefixes2 2021-10-21 16:00:48 +01:00
Martin McKeaveney d573eb464a upgrade to mysql2 package 2021-10-21 14:47:35 +01:00
mike12345567 dd75d236c0 Fixes issue #2417 in the backend, looks for fields which could contain a key value and if they do it will resolve them down to the ID field value. 2021-10-18 17:54:34 +01:00
Michael Drury 7a33a666b4 Merge pull request #3025 from Budibase/fix/quick-fixes
Fixing refresh on wrong password and setting hard SQL limits
2021-10-18 09:20:29 +01:00
mike12345567 fd894897ca Setting a hard limit on how many rows can be returned by the SQL plus queries. 2021-10-15 17:52:06 +01:00
mike12345567 a366e8a568 Fixing an issue with mongo test failing in Node 16 due to unhandled promise rejections. 2021-10-14 16:37:11 +01:00
Martin McKeaveney 11e64b0ffe tidy up 2021-10-12 20:19:32 +01:00
Martin McKeaveney b38704978a Merge branch 'develop' of github.com:Budibase/budibase into fix/postrelease 2021-10-12 16:50:37 +01:00
Martin McKeaveney 03ba725fbc remove random files 2021-10-12 16:14:49 +01:00
Martin McKeaveney ec26d5c738 SSL support for digitalocean, started utility function for BB logout, bunch of minor bug fixes 2021-10-12 16:13:54 +01:00
Martin McKeaveney e66dd5933a Merge pull request #2894 from mslourens/update_rest_url_with_slash_questionmark
add a slash before the path and a questionmark before the querystring
2021-10-11 22:05:45 +01:00
mike12345567 ab03435c84 Making sure creation of SQL rows don't pass down null columns (no point). 2021-10-06 17:55:03 +01:00
mike12345567 3cea3dd510 Fixing issue #2788 - making client side queries and SQL queries consistent with internal table ones. 2021-10-06 17:38:32 +01:00
Maurits Lourens dbf747f749 fix tests 2021-10-05 13:38:03 +02:00
Maurits Lourens 8709fb2f0b add a slash before the path and a questionmark before the querystring 2021-10-05 12:20:09 +02:00
mike12345567 80e7671444 Fix for many to many relationships where the union table has arbituarily named foreign key constraint columns, an example has been provided in the scripts directory. 2021-10-01 17:16:43 +01:00
Mike Shanks 0c0ac7ed05 added awaits to all mongo querys 2021-09-30 15:05:15 +01:00
Martin McKeaveney b4b90de2d6 Merge pull request #2716 from mslourens/custom_schema_support
Retrieve all columns from all not internal tables
2021-09-29 09:19:33 +01:00
Martin McKeaveney bd1f6752ff merge with develop 2021-09-27 16:37:55 +01:00
Martin McKeaveney 35d4eac78a fallback SMTP configuration for cloud 2021-09-27 14:57:22 +01:00
mike12345567 704c889151 Fixing issue discovered by test case. 2021-09-27 13:17:31 +01:00
Martin McKeaveney 3b49866825 Merge branch 'develop' of github.com:Budibase/budibase into cloud-limits 2021-09-27 12:53:15 +01:00
mike12345567 32bdc4a991 Minimal fix for issue involving JSON views and newlines with postgres, this fix couldn't be more over-arching as it risked breaking new lines across the board. Have included a script for setting up the test scenario as well. This fixes issue #2612. 2021-09-24 18:10:30 +01:00
Martin McKeaveney c49b88b57a automation runs quotas 2021-09-23 23:25:25 +01:00
mike12345567 5d8f348fc2 Fixing SQL test cases. 2021-09-23 16:56:13 +01:00
mike12345567 67212e5c5b Fixes issue #2616 - this is a slightly complex fix and handles a few other issues with mysql (around returning on creation of a row and relationships) - a new mechanism is now used for pagination and limiting which makes sure the limits are applied to the outer table rather than the combination of the outer and the joined. 2021-09-23 16:35:09 +01:00
Martin McKeaveney ec30a0b0b0 Merge pull request #2715 from mslourens/extend_postgres_data_types
Extend Postgres data type map
2021-09-23 12:25:03 +01:00
Maurits Lourens 99644b0cd8 Retrieve all columns from all not internal tables 2021-09-23 11:11:00 +02:00
Maurits Lourens 27cdde679c Extend Postgres data type map 2021-09-23 09:54:58 +02:00
mike12345567 e92b0e0c94 Fixing issue #2673 - discovered issues with some column types not being worked out to be auto-columns in postgres. 2021-09-22 17:46:54 +01:00
Martin McKeaveney 8b4861f27c Merge pull request #2551 from mslourens/fix_uppercase_database_name
fix fetching tables from database with uppercase name
2021-09-15 09:53:40 +01:00
Martin McKeaveney bcb5cb1d77 merge with master 2021-09-06 16:13:17 +01:00
Maurits Lourens 4d4d6aa27b fix fetching tables from database with uppercase name 2021-09-06 12:33:03 +02:00
mike12345567 0b0da47778 Fixing issues discovered by test cases. 2021-09-03 11:06:44 +01:00
mike12345567 8c3eb30ab1 Fixing issues after upgrading to node 14 and circular dependencies causing issues. 2021-09-02 18:33:41 +01:00
mike12345567 a9e2336036 Fixing issues with SQL many relationship updates. 2021-09-01 19:40:47 +01:00
Martin McKeaveney 83db9754d5 prevent relationships getting overridden in mySQL connector 2021-08-31 14:44:33 +01:00
Maurits Lourens 3e7369b1cb add patch method to the rest api interface 2021-08-30 22:55:12 +02:00
Martin McKeaveney b8d10a2b6d merge package updates 2021-08-26 14:13:30 +01:00
Martin McKeaveney e7f8454ad7 make SQL startsWith queries case insensitive 2021-08-20 15:20:52 +01:00
mike12345567 bc84bab52c Merge branch 'master' of github.com:Budibase/budibase into develop 2021-08-06 13:04:54 +01:00
Michael Drury ae18e3408e Merge pull request #2286 from Budibase/fix/relationships-2167
Some fixes for internal and external relationships
2021-08-06 12:51:44 +01:00
mike12345567 29817892a8 Fixing test cases. 2021-08-06 12:33:04 +01:00