Commit Graph

2181 Commits

Author SHA1 Message Date
mike12345567 1d9b4be249 Fixing issue with exporting CSV/JSON, also saving as right file type. 2021-11-18 14:57:17 +00:00
Rory Powell b0df7fb28f Boolean support and linting 2021-11-18 13:35:22 +00:00
Rory Powell 345490fed3 Tests 2021-11-18 12:05:30 +00:00
Rory Powell 5d8c90c5f2 Detect auto columns 2021-11-18 10:49:53 +00:00
Michael Drury 0623dc2981 Fixing issue discovered by test case. 2021-11-17 21:33:35 +00:00
Rory Powell c810bacaf9 Datatypes working 2021-11-17 16:41:00 +00:00
mike12345567 047318fdf7 Updating bullboard to use the new koa version (supported). 2021-11-17 16:30:06 +00:00
mike12345567 bb8fe8e941 Adding a mechanism for disabling cron jobs when an app is unpublished. 2021-11-17 16:28:52 +00:00
Rory Powell 0cedd1d57b First pass end-to-end working 2021-11-17 14:34:16 +00:00
Michael Drury a726d158b8 Merge pull request #3338 from Budibase/feature/query-rbac-timeouts
Query RBAC, query and automation threading/timeouts
2021-11-17 11:39:09 +00:00
mike12345567 7170c00a4f Fix for cypress test issues, when metadata is updated rapidly it could get into a bad state - this should resolve it. 2021-11-16 20:56:24 +00:00
mike12345567 e75a9d3d1d Quick update, just to cover both queue add functions. 2021-11-16 19:02:55 +00:00
mike12345567 11debac115 Updating to manage completed events piling up, this will periodically clear out all events - repeats cannot be removed with the removeOnCompleted job option. 2021-11-16 18:58:24 +00:00
mike12345567 f13257bebe Updating the getAllApps function to use a cached version of the app metadata, rather than retrieving it individually everytime. Also invalidating the results everytime they are updated (at least in the important locations). 2021-11-15 17:40:45 +00:00
mike12345567 0f54787072 Adding role, as it wasn't being set in metadata. 2021-11-15 16:46:56 +00:00
mike12345567 ce47eb6cff Fixing issue found by Mitch, with syncing not functioning for singular role updates. 2021-11-15 16:42:17 +00:00
mike12345567 9b8df32c52 Fixing issue where database wasn't accessible in authorized test. 2021-11-15 15:57:02 +00:00
mike12345567 bf4a8737f0 Updating to allow a list of roles to be retrieved, allowing resources to have multiple levels of role that they can be accessed via. 2021-11-15 15:26:09 +00:00
mike12345567 e918efe8c2 Fixing an issue discovered in #3385 - RBAC roles worked for applying lower levels of roles, but they didn't revoke access correctly, it would always fallback to the base permissions if higher permissions were set. 2021-11-15 13:48:26 +00:00
Michael Drury 0ac5c4713a Fixing test case (didn't provide a schema). 2021-11-12 20:23:00 +00:00
mike12345567 1d7fe369c6 Linting and updating csv parser test case to match new functionality. 2021-11-12 19:39:12 +00:00
mike12345567 d9d5391a40 Some UI work, as well as moving SQL to using a proper bulk insert method and fixing an issue found with csv parsing and removing of invalid columns. 2021-11-12 19:24:56 +00:00
mike12345567 0095f470e3 Adding in existing external table import. 2021-11-12 18:39:33 +00:00
mike12345567 af5e196b4c Adding all required controls for data import to internal tables, just need to implement external table data import. 2021-11-12 18:26:57 +00:00
mike12345567 b34ca5b4a2 Quick fix for #3343 - error message did not make the problem obvious, so made sure error handler always outputs something useful. 2021-11-12 11:21:06 +00:00
mike12345567 599702bfe9 Fixing issue where deleted datasources wouldn't clear out queries. 2021-11-11 17:13:35 +00:00
mike12345567 9f4ff190c3 Fixing issues dsicovered by automation test cases, as well as disabling threading for test scenarios. 2021-11-11 16:20:30 +00:00
mike12345567 de8a91da83 Fixing an issue with filtering by dates in SQL, where the lucene dates provided don't convert cleanly to JS dates. 2021-11-11 15:36:21 +00:00
mike12345567 5c8670c7f4 Merge branch 'develop' of github.com:Budibase/budibase into feature/query-rbac-timeouts 2021-11-11 13:50:42 +00:00
mike12345567 dc8d0aa533 Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-11 13:48:07 +00:00
mike12345567 cca28ce255 Adding worker controls to both automations and queries. 2021-11-11 12:11:09 +00:00
Martin McKeaveney 125610f5a1 update clientLibraryPath call in application.js 2021-11-11 12:29:52 +01:00
Martin McKeaveney 2a2963dac4 bust cache when app versions are different 2021-11-11 12:21:45 +01:00
mike12345567 781e8359a1 Adding worker-farm back to have a mechanism to run queries within which we can timeout. 2021-11-10 19:35:09 +00:00
mike12345567 7f055ed8dc Adding a way to switch between string and options, as well as number and boolean types, this is very useful for SQL tables. 2021-11-10 15:01:44 +00:00
Michael Drury 100311fb93 Merge pull request #3251 from Budibase/fix/user-metadata
Syncing user metadata - allow builder to interact with user metadata in app
2021-11-10 13:41:57 +00:00
mike12345567 47122f76fd Updating per review comments. 2021-11-10 12:03:43 +00:00
mike12345567 935fc06edc Updating per review comments. 2021-11-10 12:00:29 +00:00
Rory Powell 6ac31e0854 Merge pull request #3178 from Budibase/postgres-schema
Postgres: Use another schema other than 'public'
2021-11-10 10:03:25 +00:00
Rory Powell 2caa530ff0 Tidy imports 2021-11-09 17:55:10 +00:00
Rory Powell 231ddda4e7 Tidy and remove unused fields 2021-11-09 17:52:26 +00:00
Rory Powell 9bcfa0af70 Remove comments 2021-11-09 17:33:29 +00:00
Martin McKeaveney 0cc2069929 fixes for templates, ensured iframetemplate fires ready event 2021-11-09 17:40:31 +01:00
mike12345567 b3590537ba Adding the ability to set a permission for data source queries. 2021-11-09 16:25:23 +00:00
mike12345567 a11f7e7081 Merge branch 'fix/user-metadata' of github.com:Budibase/budibase into feature/query-rbac-timeouts 2021-11-09 12:49:42 +00:00
mike12345567 f8e790bd2f Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-09 11:20:17 +00:00
mike12345567 a78230e23b Reworking MS-SQL test case to be able to get the sql now with a request being made for each internal query, rather than just at connection. 2021-11-09 11:16:12 +00:00
Rory Powell 9273edc794 Integrate with UI 2021-11-08 22:08:47 +00:00
Andrew Kingston 8e0b265815 Merge pull request #3249 from Budibase/blocks
Core blocks implementation + table with search block
2021-11-08 20:46:21 +00:00
mike12345567 069769a5a6 Linting. 2021-11-08 18:27:18 +00:00
mike12345567 b1c55be1b7 Fixing some issues with multi-select coming back as string. 2021-11-08 18:23:48 +00:00
mike12345567 9d800484f2 Some refactoring to make it easier to find specific edge cases of sql clients. 2021-11-08 18:12:40 +00:00
mike12345567 99c47ab264 Merge branch 'develop' of github.com:Budibase/budibase into fix/user-metadata 2021-11-08 17:28:32 +00:00
mike12345567 b310918ec4 Fixing #3182 so that sorting is disabled for certain column types that we cannot use, as well as fixing some issues with MS-SQL plus tables. 2021-11-08 17:25:05 +00:00
mike12345567 e6d05f1e90 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-08 14:43:28 +00:00
Martin McKeaveney 08ea3ca3bc Merge pull request #3289 from Budibase/fix/prevent-revert
fix revert on unpublished app
2021-11-08 15:28:20 +01:00
Martin McKeaveney 9fb811a8da change message when app not deployed 2021-11-08 15:26:44 +01:00
Martin McKeaveney 035879d515 adding check to make sure production db isn't created on sync 2021-11-08 15:26:07 +01:00
mike12345567 6455f51d4f Merge branch 'master' of github.com:Budibase/budibase into develop 2021-11-08 14:00:47 +00:00
Martin McKeaveney 7c21645799 fix revert on unpublished app 2021-11-08 13:06:25 +01:00
mike12345567 b34cef26c3 Fixing an issue with relationship modal breaking when multiple data sources available to relate to, also fixing an pile of issues with creating and reading rows from SQL server plus. 2021-11-05 18:55:36 +00:00
mike12345567 61a4a240f1 Updating usage quota middleware to fix issue presented in #3258 where anything with an _id and a _rev is considered to exist in CouchDB, which won't always be the case. Handle the scenario of an external database ID and don't error. 2021-11-05 14:59:28 +00:00
Rory Powell 2b6c6d7aaa Merge branch 'develop' into postgres-schema 2021-11-05 14:07:39 +00:00
Rory Powell cb661eab34 Add oracledb package, readme, and config 2021-11-05 13:56:54 +00:00
mike12345567 3474f3ae8e Updating underlying sql to not use ilike unless in postgres client. 2021-11-05 13:48:13 +00:00
mike12345567 5ec0d803af Cleaning up repeated work in sql server building of schema. 2021-11-05 12:41:26 +00:00
Andrew Kingston 1f1786c2b3 Fix issue saving a doc with a multi-options datatype that was not defined 2021-11-05 12:37:16 +00:00
mike12345567 9c933b629f Linting and updating SQL Server schema generation to include auto column and primary key recognition. 2021-11-05 12:33:48 +00:00
mike12345567 515ed75680 Merge branch 'develop' of github.com:Budibase/budibase into feature/mssql-plus 2021-11-05 10:58:04 +00:00
Martin McKeaveney b7c5778409 Merge pull request #3187 from Budibase/fix/safari-bug
Fix budibase builder preview on safari
2021-11-04 17:22:02 +01:00
Martin McKeaveney 193d40bbf3 refactor switch into a key value handler object
tidy up - remove logs and comments

update windowed modals to use postMessage
2021-11-04 17:21:17 +01:00
Rory Powell b5b191361d Add stub integration file and docker compose config 2021-11-04 14:54:35 +00:00
mike12345567 94ee13ffc4 Adding the sync call from the worker for creation, updating and deletion of users. Making sure that production and development apps are always up to date with user metadata. 2021-11-04 14:53:03 +00:00
Michael Drury 3a5e004f36 Adding sync user endpoint to server which can be used by the worker. 2021-11-03 23:15:38 +00:00
Michael Drury 311fe5f2eb Syncing user metadata when builder opened as well as including all global user props for filtering/searching. 2021-11-03 22:23:00 +00:00
mike12345567 b2bf5056b5 Fixing rest test mocking. 2021-11-03 15:45:19 +00:00
mike12345567 88a729913c Fixing an issue with webhooks, couldn't use them in development (like getting schema) and making sure trigger will always use production app #3143. 2021-11-03 14:08:47 +00:00
mike12345567 ea6646f055 Fixing #3237 and #3235 - always apply headers on out going webhooks if they are specified and handle a range of response codes. 2021-11-03 13:13:22 +00:00
mike12345567 f8b2429bd0 Fixing REST PUT using POST as per #3227. 2021-11-03 13:12:20 +00:00
mike12345567 953c90c8d4 Fixing some issues with MySQL and dropping foreign key constrained columns. 2021-11-02 13:36:23 +00:00
mike12345567 835b0efe74 Adding mysql support. 2021-10-29 18:43:50 +01:00
mike12345567 f071cc5219 Adding many to many support, generating junction table and setting up constraints. 2021-10-29 18:37:29 +01:00
mike12345567 a94376ce43 Fixing a lot of issues around dropping columns, updating columns, relationships and bi-directionality, display columns now default to something for SQL tables as well. 2021-10-29 13:34:10 +01:00
mike12345567 949c6b8653 Adding SQL relationship building. 2021-10-28 22:44:31 +01:00
mike12345567 329156d6cc SQL table building. 2021-10-28 19:39:42 +01:00
mike12345567 5e846ac64d First version of schema generation for ms-sql, able to retrieve basic tables and rows. 2021-10-27 18:36:27 +01:00
Rory Powell c210802b4c Remove whitespace 2021-10-27 17:23:52 +01:00
Rory Powell 8b8c923541 Update tests 2021-10-27 17:21:29 +01:00
mike12345567 49d2796f8e Fixing an issue with data source saving. 2021-10-27 16:35:53 +01:00
Rory Powell 0ddd689b89 Postgres: Use another schema other than 'public' 2021-10-27 16:21:19 +01:00
mike12345567 89d04d5cc7 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2021-10-27 14:51:43 +01:00
mike12345567 fa38a4b37e Fixing test cases. 2021-10-27 13:10:46 +01:00
Rory Powell 54ddfb32e0 Merge pull request #3145 from Budibase/prevent-dev-app-access
Prevent non builder from accessing dev apps
2021-10-27 09:50:50 +01:00
mike12345567 eb411cd0b0 Fixing #2718 - disabling handlebars helpers for queries. 2021-10-26 20:04:36 +01:00
mike12345567 ac1d6ee23e Fixing #2820 - SQL system no longer includes tables without a primary key constraint and it displays an error to handle this. 2021-10-26 20:03:54 +01:00
Rory Powell 67f851b68c Update app id check in tests 2021-10-26 16:21:26 +01:00
Rory Powell 081e38e5ea Merge branch 'develop' into prevent-dev-app-access 2021-10-26 14:55:59 +01:00
Rory Powell 59c44eafd3 Merge branch 'develop' into scope-or-view 2021-10-26 14:55:45 +01:00
Rory Powell 21da900567 Update snapshot 2021-10-26 09:43:00 +01:00
Rory Powell 46a886f83d Linting 2021-10-26 09:42:19 +01:00
Rory Powell ad61f2af3b Prevent non builder from accessing dev apps 2021-10-25 16:59:09 +01:00
Michael Drury 7ee3029dfe Merge pull request #3122 from Budibase/fix/mike-d-various-fixes
Various fixes, including replacing live replication from prod -> dev
2021-10-25 14:41:08 +01:00
Rory Powell 54c5ae1441 Scope view filters to table always 2021-10-25 13:34:48 +01:00
Rory Powell 547bb8ba80 Merge pull request #3104 from Budibase/view-not-set
Handle nulls / empty in views and tables
2021-10-25 10:16:23 +01:00
Rory Powell 99b42c7083 Feedback: Rename set/not set to not empty/empty, remove cell rendering 2021-10-25 09:58:05 +01:00
mike12345567 bd59c28081 Removing live replication between deployed and development app, instead it is replicated when the app is opened in the builder. Live replication was not working and only actually pulled back the data on deploy which was a little confusing, this way it can easily be controlled. 2021-10-22 14:34:20 +01:00
mike12345567 23071993c6 Fixing an issue with user metadata not always being present when user accessing app, causing weird issues. 2021-10-21 17:23:10 +01:00
Martin McKeaveney 9301406bcd enable collapsible nodes in component tree 2021-10-21 16:24:58 +01:00
Martin McKeaveney 3b3862bd01 Merge branch 'develop' into fix/postreleasefixes2 2021-10-21 16:00:48 +01:00
Martin McKeaveney d573eb464a upgrade to mysql2 package 2021-10-21 14:47:35 +01:00
Rory Powell ca4b252abc Merge branch 'develop' into view-not-set 2021-10-21 14:17:04 +01:00
Rory Powell 0fb4613b5a Handle nulls / empty in views and tables 2021-10-21 14:15:55 +01:00
Andrew Kingston 2b7f393626 Remove optional chaining from server 2021-10-21 10:24:41 +01:00
Andrew Kingston 5caafed0f8 Keep views up to date with table schema changes 2021-10-20 20:01:49 +01:00
Michael Drury 0c678d1cce Merge pull request #3094 from Budibase/fix/sql-auto-update
Fixing issue with SQL tables and automation update row action
2021-10-20 13:48:53 +01:00
Andrew Kingston 029b447ce7 Merge pull request #3042 from Budibase/fix/app-export-performance
Improve app export experience
2021-10-20 10:25:59 +01:00
mike12345567 bdaf56fac7 Fixing issue with SQL tables and automations updating a row, also making error handling better across automations to make sure some sort of error message is always returned. 2021-10-19 17:00:54 +01:00
Martin McKeaveney a174de7f28 error message fixes 2021-10-19 16:52:55 +01:00
Michael Drury 93c0b5ddd4 Merge pull request #3091 from Budibase/fix/table-perms
Fixing table permissions issue
2021-10-19 16:45:41 +01:00
mike12345567 6539feb6d7 Fixing issue with permissions, if some permissions have already been set for a role an error would be thrown which would break the UI and make it impossible to setup permissions for other tables. 2021-10-19 16:19:48 +01:00
mike12345567 dd75d236c0 Fixes issue #2417 in the backend, looks for fields which could contain a key value and if they do it will resolve them down to the ID field value. 2021-10-18 17:54:34 +01:00
Andrew Kingston d00f3f27fe Refactor app exports to allow a streaming realtime backup, and tidy up 2021-10-18 12:08:12 +01:00
Rory Powell a94becac9c Merge pull request #2975 from Budibase/no-access-role
No access role / public by default
2021-10-18 11:08:45 +01:00
Peter Clement a0c2e9c427 Merge pull request #3038 from Budibase/fix/data-section-issues
Add check for missing _rev
2021-10-18 10:13:40 +01:00
Peter Clement 5cfaa17798 add check for missing _rev 2021-10-18 09:51:13 +01:00
Peter Clement fc53e3e8b8 Merge pull request #3032 from Budibase/fix/data-section-issues
Potential fix for issues with updating and saving rows and columns
2021-10-18 09:34:49 +01:00
Michael Drury 7a33a666b4 Merge pull request #3025 from Budibase/fix/quick-fixes
Fixing refresh on wrong password and setting hard SQL limits
2021-10-18 09:20:29 +01:00
Peter Clement eb957bc94f Potential fix for issues with updating and saving rows and columns 2021-10-17 21:23:30 +01:00
mike12345567 fd894897ca Setting a hard limit on how many rows can be returned by the SQL plus queries. 2021-10-15 17:52:06 +01:00
Andrew Kingston 9b1da162d6 Merge pull request #3019 from Budibase/fix/large-csv-import
Fix performance of importing large CSVs
2021-10-15 15:49:11 +01:00
Andrew Kingston 4c1451178c Lint 2021-10-15 14:57:01 +01:00
Andrew Kingston 18c88ac101 Remove linkRows processing when importing CSVs 2021-10-15 14:31:45 +01:00
Michael Drury ec82053d88 Merge pull request #3007 from Budibase/fix/3005
Fixing issues with filter step in automations breaking test flow
2021-10-15 14:03:52 +01:00
Andrew Kingston 642d105326 Merge pull request #3002 from Budibase/js-binding-drawer
JavaScript bindings
2021-10-15 11:37:25 +01:00
mike12345567 a366e8a568 Fixing an issue with mongo test failing in Node 16 due to unhandled promise rejections. 2021-10-14 16:37:11 +01:00
mike12345567 5b81d25d1a Fixing some issues which were causing errors during the cypress test runs, such as not redirect /api/system/ requests to the worker. 2021-10-14 16:25:07 +01:00
mike12345567 1e318ea267 Fixing some issues which were causing errors during the cypress test runs, such as not redirect /api/system/ requests to the worker. 2021-10-14 16:17:20 +01:00
mike12345567 b73fc93cdc Fixing some issues which were causing errors during the cypress test runs, such as not redirect /api/system/ requests to the worker. 2021-10-14 16:16:20 +01:00
mike12345567 11b06b717e Fixing issue #3005 - when a filter step is executed it now will fill in the history with a status describing that it stopped, this stops any errors from occurring. 2021-10-14 15:26:38 +01:00
mike12345567 c5ed99939c Fixes #2998 the templates API call will no longer fail if no internet, will simply return an empty array. 2021-10-14 14:18:41 +01:00
mike12345567 9cece8b79e Removing the ability to use the bash scripting action in automations in cloud. 2021-10-13 17:03:19 +01:00
mike12345567 e548ec3978 Merge branch 'develop' of github.com:Budibase/budibase into feature/query-transformers 2021-10-13 16:47:41 +01:00
Peter Clement a746869418 Merge pull request #2984 from Budibase/bug/misc-automation-issues
Fixes for automation issues
2021-10-13 14:56:44 +01:00
Martin McKeaveney 5457096370 merge 2021-10-13 14:18:56 +01:00
mike12345567 dcb334b564 Fixing some issues found with query while testing. 2021-10-13 13:22:13 +01:00
Peter Clement 12cf3730d9 Merge remote-tracking branch 'origin/develop' into bug/misc-automation-issues 2021-10-13 12:39:05 +01:00
Peter Clement 194eddbda4 some tidy up 2021-10-13 09:29:01 +01:00
Martin McKeaveney 11e64b0ffe tidy up 2021-10-12 20:19:32 +01:00
mike12345567 b46a945fc4 Adding the basics of the query transformers to the frontend and to the backend, as well as switching to vm2 for script running. 2021-10-12 18:45:13 +01:00
Martin McKeaveney b38704978a Merge branch 'develop' of github.com:Budibase/budibase into fix/postrelease 2021-10-12 16:50:37 +01:00