Commit Graph

2223 Commits

Author SHA1 Message Date
mike12345567 193014fc83 Adding validation around invalid JSON inputs and allowing input via a code mirror editor in data UI. 2021-11-29 18:16:44 +00:00
mike12345567 003b6424a2 Fixing issue with updating row validation to allow empty objects. 2021-11-29 17:54:09 +00:00
Rory Powell c421499a46 cURL import working 2021-11-29 17:21:30 +00:00
mike12345567 05e2baa0d3 Moving generation to builder because it reduces API calls and has no reason to be carried out server-side, handling array/object schema generation correctly. 2021-11-29 17:11:08 +00:00
Rory Powell c53f5e3d2b Update backend to be extensible for different import sources 2021-11-29 10:37:31 +00:00
Rory Powell 301938eaa0 Merge pull request #3555 from Budibase/oracle/returning
Improve returning logic for oracle
2021-11-26 18:54:19 +00:00
mike12345567 5ff8716080 Adding server functionality to determine schema for JSON data type, some basic UI around an editor for getting JSON to determine schema from and the key/value mechanism for flat structures. 2021-11-26 17:39:18 +00:00
mike12345567 d06ab10c1d Fixing issue found with enriching rows in SQL - the system was assuming the array of entries contained a row ID that needed to be broken down. 2021-11-26 17:08:56 +00:00
Rory Powell f75928a9c9 Deletion support for returning rows 2021-11-26 16:50:15 +00:00
Michael Drury cba41d8e9d Merge pull request #3554 from Budibase/labday/docs
API Docs, generation, tables and rows and Swagger definitions
2021-11-26 15:20:23 +00:00
Rory Powell 115fc08aa4 Improve returning logic for oracle 2021-11-26 15:02:03 +00:00
mike12345567 5e9f3969c9 Fixing a few issues that became obvious when I was looking at examples of what gets sent to the API for table saving. 2021-11-26 14:14:53 +00:00
mike12345567 4697b21ef1 Updating docs for tables, adding a swagger generation tool and a README describing how to use it. 2021-11-26 14:13:53 +00:00
Andrew Kingston 11142335ff Merge pull request #3542 from Budibase/ak-fixes
Query schema fixes + card fixes
2021-11-26 11:27:28 +00:00
Rory Powell 41fa958c78 File upload working 2021-11-26 09:51:56 +00:00
Peter Clement 0b9cc02023 Merge pull request #3544 from Budibase/feature/auto-screen-ui
Remove initial screen defintion so user can see the new screen creation button
2021-11-25 22:13:07 +00:00
mike12345567 5b2e6bddf8 Updating docs. 2021-11-25 17:44:47 +00:00
Rory Powell 71ba024974 WIP: Rest API import 2021-11-25 17:14:07 +00:00
mike12345567 88f31bcf34 Basic work for generating. 2021-11-25 16:13:19 +00:00
Peter Clement d42df03f25 fix appPackage unit tests 2021-11-25 15:29:35 +00:00
Peter Clement 0c60a56a3a remove initial screen creation 2021-11-25 14:45:36 +00:00
Andrew Kingston 0b239a5bec Add test to ensure query schema is correctly cleared for prod app IDs 2021-11-25 13:00:43 +00:00
Michael Drury a02ec65661 Merge pull request #3541 from Budibase/fix/sql-issues
Fixing various SQL issues
2021-11-25 12:42:38 +00:00
mike12345567 0f0770af32 Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-25 12:21:58 +00:00
Andrew Kingston 3abaded20a Update tests 2021-11-25 11:52:02 +00:00
Andrew Kingston aea0a9082b Lint 2021-11-25 11:42:46 +00:00
Andrew Kingston 38219f0ea3 Fix issue with determining when to hide sensitive fields from query definitions and never delete the query schema 2021-11-25 11:21:54 +00:00
mike12345567 f6ecd423ce Fixing some issues discovered with many to many relationships in SQL, as well as problems uncovered by #3531. 2021-11-24 20:55:03 +00:00
mike12345567 bf44c15b74 Fixing issue with datasource deletion not navigating if was on data source plus table and fixing #3523 where relationships would cause sorting to breaking postgres/oracle. 2021-11-24 18:20:52 +00:00
mike12345567 116bccfd73 Fix for issue #3327 - may not solve issue with mariaDB but works for MySQL. 2021-11-24 17:03:34 +00:00
Rory Powell 7135599295 Add returning 2021-11-23 13:27:38 +00:00
Rory Powell 1a0c66beb6 Merge branch 'develop' into oracle-datasource 2021-11-23 09:27:55 +00:00
mike12345567 0335b1cee3 Fixing issue from review, values weren't wiped when delete modals closed, also adding a fix for threading to disable it in development as node-ts was causing memory leaks on low memory systems (doesn't apply to production built version). 2021-11-22 17:42:41 +00:00
Rory Powell 4acfc668ef Update locks, ignore oracle imports on m1 2021-11-22 15:26:31 +00:00
mike12345567 ea0000df51 Updating UI to have a table/column deletion check which makes sure the user understands what they are doing, also disabling external table deletion. 2021-11-22 15:26:24 +00:00
Rory Powell ac7137c4a0 Use global sql type map, update base integration type defs 2021-11-22 11:38:17 +00:00
Rory Powell 154a5cab26 Merge branch 'develop' into oracle-datasource 2021-11-22 11:07:11 +00:00
Rory Powell d58b90cac1 Merge branch 'oracle-datasource' into oracle-datatasource-plus 2021-11-22 10:50:34 +00:00
Rory Powell f94a0eadbe Merge branch 'develop' into oracle-datasource 2021-11-22 10:47:48 +00:00
mike12345567 9be833d5e1 Updating inline alert component to handle newlines as different elements, putting out error with new lines. 2021-11-22 10:37:58 +00:00
mike12345567 38c7f3ab90 Fix for #2420 - don't allow columns which are considered invalid/not allowed. 2021-11-18 18:33:35 +00:00
Michael Drury 773bc06f7f Merge pull request #3440 from Budibase/fix/export-sql
Fixing some issues with exporting CSV/JSON
2021-11-18 15:26:23 +00:00
mike12345567 1d9b4be249 Fixing issue with exporting CSV/JSON, also saving as right file type. 2021-11-18 14:57:17 +00:00
Rory Powell b0df7fb28f Boolean support and linting 2021-11-18 13:35:22 +00:00
Rory Powell 345490fed3 Tests 2021-11-18 12:05:30 +00:00
Rory Powell 5d8c90c5f2 Detect auto columns 2021-11-18 10:49:53 +00:00
Michael Drury 0623dc2981 Fixing issue discovered by test case. 2021-11-17 21:33:35 +00:00
Rory Powell c810bacaf9 Datatypes working 2021-11-17 16:41:00 +00:00
mike12345567 047318fdf7 Updating bullboard to use the new koa version (supported). 2021-11-17 16:30:06 +00:00
mike12345567 bb8fe8e941 Adding a mechanism for disabling cron jobs when an app is unpublished. 2021-11-17 16:28:52 +00:00
Rory Powell 0cedd1d57b First pass end-to-end working 2021-11-17 14:34:16 +00:00
Michael Drury a726d158b8 Merge pull request #3338 from Budibase/feature/query-rbac-timeouts
Query RBAC, query and automation threading/timeouts
2021-11-17 11:39:09 +00:00
mike12345567 7170c00a4f Fix for cypress test issues, when metadata is updated rapidly it could get into a bad state - this should resolve it. 2021-11-16 20:56:24 +00:00
mike12345567 e75a9d3d1d Quick update, just to cover both queue add functions. 2021-11-16 19:02:55 +00:00
mike12345567 11debac115 Updating to manage completed events piling up, this will periodically clear out all events - repeats cannot be removed with the removeOnCompleted job option. 2021-11-16 18:58:24 +00:00
mike12345567 f13257bebe Updating the getAllApps function to use a cached version of the app metadata, rather than retrieving it individually everytime. Also invalidating the results everytime they are updated (at least in the important locations). 2021-11-15 17:40:45 +00:00
mike12345567 0f54787072 Adding role, as it wasn't being set in metadata. 2021-11-15 16:46:56 +00:00
mike12345567 ce47eb6cff Fixing issue found by Mitch, with syncing not functioning for singular role updates. 2021-11-15 16:42:17 +00:00
mike12345567 9b8df32c52 Fixing issue where database wasn't accessible in authorized test. 2021-11-15 15:57:02 +00:00
mike12345567 bf4a8737f0 Updating to allow a list of roles to be retrieved, allowing resources to have multiple levels of role that they can be accessed via. 2021-11-15 15:26:09 +00:00
mike12345567 e918efe8c2 Fixing an issue discovered in #3385 - RBAC roles worked for applying lower levels of roles, but they didn't revoke access correctly, it would always fallback to the base permissions if higher permissions were set. 2021-11-15 13:48:26 +00:00
Michael Drury 0ac5c4713a Fixing test case (didn't provide a schema). 2021-11-12 20:23:00 +00:00
mike12345567 1d7fe369c6 Linting and updating csv parser test case to match new functionality. 2021-11-12 19:39:12 +00:00
mike12345567 d9d5391a40 Some UI work, as well as moving SQL to using a proper bulk insert method and fixing an issue found with csv parsing and removing of invalid columns. 2021-11-12 19:24:56 +00:00
mike12345567 0095f470e3 Adding in existing external table import. 2021-11-12 18:39:33 +00:00
mike12345567 af5e196b4c Adding all required controls for data import to internal tables, just need to implement external table data import. 2021-11-12 18:26:57 +00:00
mike12345567 b34ca5b4a2 Quick fix for #3343 - error message did not make the problem obvious, so made sure error handler always outputs something useful. 2021-11-12 11:21:06 +00:00
mike12345567 599702bfe9 Fixing issue where deleted datasources wouldn't clear out queries. 2021-11-11 17:13:35 +00:00
mike12345567 9f4ff190c3 Fixing issues dsicovered by automation test cases, as well as disabling threading for test scenarios. 2021-11-11 16:20:30 +00:00
mike12345567 de8a91da83 Fixing an issue with filtering by dates in SQL, where the lucene dates provided don't convert cleanly to JS dates. 2021-11-11 15:36:21 +00:00
mike12345567 5c8670c7f4 Merge branch 'develop' of github.com:Budibase/budibase into feature/query-rbac-timeouts 2021-11-11 13:50:42 +00:00
mike12345567 dc8d0aa533 Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-11 13:48:07 +00:00
mike12345567 cca28ce255 Adding worker controls to both automations and queries. 2021-11-11 12:11:09 +00:00
Martin McKeaveney 125610f5a1 update clientLibraryPath call in application.js 2021-11-11 12:29:52 +01:00
Martin McKeaveney 2a2963dac4 bust cache when app versions are different 2021-11-11 12:21:45 +01:00
mike12345567 781e8359a1 Adding worker-farm back to have a mechanism to run queries within which we can timeout. 2021-11-10 19:35:09 +00:00
mike12345567 7f055ed8dc Adding a way to switch between string and options, as well as number and boolean types, this is very useful for SQL tables. 2021-11-10 15:01:44 +00:00
Michael Drury 100311fb93 Merge pull request #3251 from Budibase/fix/user-metadata
Syncing user metadata - allow builder to interact with user metadata in app
2021-11-10 13:41:57 +00:00
mike12345567 47122f76fd Updating per review comments. 2021-11-10 12:03:43 +00:00
mike12345567 935fc06edc Updating per review comments. 2021-11-10 12:00:29 +00:00
Rory Powell 6ac31e0854 Merge pull request #3178 from Budibase/postgres-schema
Postgres: Use another schema other than 'public'
2021-11-10 10:03:25 +00:00
Rory Powell 2caa530ff0 Tidy imports 2021-11-09 17:55:10 +00:00
Rory Powell 231ddda4e7 Tidy and remove unused fields 2021-11-09 17:52:26 +00:00
Rory Powell 9bcfa0af70 Remove comments 2021-11-09 17:33:29 +00:00
Martin McKeaveney 0cc2069929 fixes for templates, ensured iframetemplate fires ready event 2021-11-09 17:40:31 +01:00
mike12345567 b3590537ba Adding the ability to set a permission for data source queries. 2021-11-09 16:25:23 +00:00
mike12345567 a11f7e7081 Merge branch 'fix/user-metadata' of github.com:Budibase/budibase into feature/query-rbac-timeouts 2021-11-09 12:49:42 +00:00
mike12345567 f8e790bd2f Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-09 11:20:17 +00:00
mike12345567 a78230e23b Reworking MS-SQL test case to be able to get the sql now with a request being made for each internal query, rather than just at connection. 2021-11-09 11:16:12 +00:00
Rory Powell 9273edc794 Integrate with UI 2021-11-08 22:08:47 +00:00
Andrew Kingston 8e0b265815 Merge pull request #3249 from Budibase/blocks
Core blocks implementation + table with search block
2021-11-08 20:46:21 +00:00
mike12345567 069769a5a6 Linting. 2021-11-08 18:27:18 +00:00
mike12345567 b1c55be1b7 Fixing some issues with multi-select coming back as string. 2021-11-08 18:23:48 +00:00
mike12345567 9d800484f2 Some refactoring to make it easier to find specific edge cases of sql clients. 2021-11-08 18:12:40 +00:00
mike12345567 99c47ab264 Merge branch 'develop' of github.com:Budibase/budibase into fix/user-metadata 2021-11-08 17:28:32 +00:00
mike12345567 b310918ec4 Fixing #3182 so that sorting is disabled for certain column types that we cannot use, as well as fixing some issues with MS-SQL plus tables. 2021-11-08 17:25:05 +00:00
mike12345567 e6d05f1e90 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-08 14:43:28 +00:00
Martin McKeaveney 08ea3ca3bc Merge pull request #3289 from Budibase/fix/prevent-revert
fix revert on unpublished app
2021-11-08 15:28:20 +01:00
Martin McKeaveney 9fb811a8da change message when app not deployed 2021-11-08 15:26:44 +01:00
Martin McKeaveney 035879d515 adding check to make sure production db isn't created on sync 2021-11-08 15:26:07 +01:00
mike12345567 6455f51d4f Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-08 14:00:47 +00:00
Martin McKeaveney 7c21645799 fix revert on unpublished app 2021-11-08 13:06:25 +01:00
mike12345567 b34cef26c3 Fixing an issue with relationship modal breaking when multiple data sources available to relate to, also fixing an pile of issues with creating and reading rows from SQL server plus. 2021-11-05 18:55:36 +00:00
mike12345567 61a4a240f1 Updating usage quota middleware to fix issue presented in #3258 where anything with an _id and a _rev is considered to exist in CouchDB, which won't always be the case. Handle the scenario of an external database ID and don't error. 2021-11-05 14:59:28 +00:00
Rory Powell 2b6c6d7aaa Merge branch 'develop' into postgres-schema 2021-11-05 14:07:39 +00:00
Rory Powell cb661eab34 Add oracledb package, readme, and config 2021-11-05 13:56:54 +00:00
mike12345567 3474f3ae8e Updating underlying sql to not use ilike unless in postgres client. 2021-11-05 13:48:13 +00:00
mike12345567 5ec0d803af Cleaning up repeated work in sql server building of schema. 2021-11-05 12:41:26 +00:00
Andrew Kingston 1f1786c2b3 Fix issue saving a doc with a multi-options datatype that was not defined 2021-11-05 12:37:16 +00:00
mike12345567 9c933b629f Linting and updating SQL Server schema generation to include auto column and primary key recognition. 2021-11-05 12:33:48 +00:00
mike12345567 515ed75680 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-05 10:58:04 +00:00
Martin McKeaveney b7c5778409 Merge pull request #3187 from Budibase/fix/safari-bug
Fix budibase builder preview on safari
2021-11-04 17:22:02 +01:00
Martin McKeaveney 193d40bbf3 refactor switch into a key value handler object
tidy up - remove logs and comments

update windowed modals to use postMessage
2021-11-04 17:21:17 +01:00
Rory Powell b5b191361d Add stub integration file and docker compose config 2021-11-04 14:54:35 +00:00
mike12345567 94ee13ffc4 Adding the sync call from the worker for creation, updating and deletion of users. Making sure that production and development apps are always up to date with user metadata. 2021-11-04 14:53:03 +00:00
Michael Drury 3a5e004f36 Adding sync user endpoint to server which can be used by the worker. 2021-11-03 23:15:38 +00:00
Michael Drury 311fe5f2eb Syncing user metadata when builder opened as well as including all global user props for filtering/searching. 2021-11-03 22:23:00 +00:00
mike12345567 b2bf5056b5 Fixing rest test mocking. 2021-11-03 15:45:19 +00:00
mike12345567 88a729913c Fixing an issue with webhooks, couldn't use them in development (like getting schema) and making sure trigger will always use production app #3143. 2021-11-03 14:08:47 +00:00
mike12345567 ea6646f055 Fixing #3237 and #3235 - always apply headers on out going webhooks if they are specified and handle a range of response codes. 2021-11-03 13:13:22 +00:00
mike12345567 f8b2429bd0 Fixing REST PUT using POST as per #3227. 2021-11-03 13:12:20 +00:00
mike12345567 953c90c8d4 Fixing some issues with MySQL and dropping foreign key constrained columns. 2021-11-02 13:36:23 +00:00
mike12345567 835b0efe74 Adding mysql support. 2021-10-29 18:43:50 +01:00
mike12345567 f071cc5219 Adding many to many support, generating junction table and setting up constraints. 2021-10-29 18:37:29 +01:00
mike12345567 a94376ce43 Fixing a lot of issues around dropping columns, updating columns, relationships and bi-directionality, display columns now default to something for SQL tables as well. 2021-10-29 13:34:10 +01:00
mike12345567 949c6b8653 Adding SQL relationship building. 2021-10-28 22:44:31 +01:00
mike12345567 329156d6cc SQL table building. 2021-10-28 19:39:42 +01:00
mike12345567 5e846ac64d First version of schema generation for ms-sql, able to retrieve basic tables and rows. 2021-10-27 18:36:27 +01:00
Rory Powell c210802b4c Remove whitespace 2021-10-27 17:23:52 +01:00
Rory Powell 8b8c923541 Update tests 2021-10-27 17:21:29 +01:00
mike12345567 49d2796f8e Fixing an issue with data source saving. 2021-10-27 16:35:53 +01:00
Rory Powell 0ddd689b89 Postgres: Use another schema other than 'public' 2021-10-27 16:21:19 +01:00
mike12345567 89d04d5cc7 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2021-10-27 14:51:43 +01:00
mike12345567 fa38a4b37e Fixing test cases. 2021-10-27 13:10:46 +01:00
Rory Powell 54ddfb32e0 Merge pull request #3145 from Budibase/prevent-dev-app-access
Prevent non builder from accessing dev apps
2021-10-27 09:50:50 +01:00
mike12345567 eb411cd0b0 Fixing #2718 - disabling handlebars helpers for queries. 2021-10-26 20:04:36 +01:00
mike12345567 ac1d6ee23e Fixing #2820 - SQL system no longer includes tables without a primary key constraint and it displays an error to handle this. 2021-10-26 20:03:54 +01:00
Rory Powell 67f851b68c Update app id check in tests 2021-10-26 16:21:26 +01:00
Rory Powell 081e38e5ea Merge branch 'develop' into prevent-dev-app-access 2021-10-26 14:55:59 +01:00
Rory Powell 59c44eafd3 Merge branch 'develop' into scope-or-view 2021-10-26 14:55:45 +01:00
Rory Powell 21da900567 Update snapshot 2021-10-26 09:43:00 +01:00
Rory Powell 46a886f83d Linting 2021-10-26 09:42:19 +01:00
Rory Powell ad61f2af3b Prevent non builder from accessing dev apps 2021-10-25 16:59:09 +01:00
Michael Drury 7ee3029dfe Merge pull request #3122 from Budibase/fix/mike-d-various-fixes
Various fixes, including replacing live replication from prod -> dev
2021-10-25 14:41:08 +01:00
Rory Powell 54c5ae1441 Scope view filters to table always 2021-10-25 13:34:48 +01:00
Rory Powell 547bb8ba80 Merge pull request #3104 from Budibase/view-not-set
Handle nulls / empty in views and tables
2021-10-25 10:16:23 +01:00
Rory Powell 99b42c7083 Feedback: Rename set/not set to not empty/empty, remove cell rendering 2021-10-25 09:58:05 +01:00
mike12345567 bd59c28081 Removing live replication between deployed and development app, instead it is replicated when the app is opened in the builder. Live replication was not working and only actually pulled back the data on deploy which was a little confusing, this way it can easily be controlled. 2021-10-22 14:34:20 +01:00
mike12345567 23071993c6 Fixing an issue with user metadata not always being present when user accessing app, causing weird issues. 2021-10-21 17:23:10 +01:00
Martin McKeaveney 9301406bcd enable collapsible nodes in component tree 2021-10-21 16:24:58 +01:00