Commit Graph

5174 Commits

Author SHA1 Message Date
Adria Navarro 758b4f8254 Allow open by default for field groups 2023-06-28 14:33:52 +01:00
Adria Navarro 352ea72c53 Select and conditional fields 2023-06-28 14:33:52 +01:00
Adria Navarro 8a7d610faf Move creation pool on the connect step 2023-06-28 14:33:51 +01:00
Adria Navarro c9bee9e423 Display errors 2023-06-28 14:33:51 +01:00
Adria Navarro 1e5492b18d Type mssql 2023-06-28 14:33:51 +01:00
mike12345567 25d0f3f518 Adding settings tab for SQL datasources. 2023-06-28 11:59:53 +01:00
Peter Clement 87768fd577 update error messages: 2023-06-28 09:28:40 +01:00
Peter Clement fed6a83bca remove incorrect psql codes 2023-06-28 09:18:41 +01:00
Andrew Kingston ee74900abb Update comments 2023-06-27 17:45:24 +01:00
Andrew Kingston f0c8cb82b2 Remove unused tenantId 2023-06-27 17:43:52 +01:00
Andrew Kingston 801f5655ac Merge branch 'develop' of github.com:Budibase/budibase into cheeks-fixes 2023-06-27 16:50:51 +01:00
Michael Drury f7cdf5f2bc Merge pull request #11001 from Budibase/feature/custom-role-readable-ids
Custom roles - readable IDs
2023-06-27 16:17:08 +01:00
Michael Drury 5e8cf41feb Merge pull request #11013 from Budibase/fix/sql-relationship-fixes
Further SQL relationship fixes
2023-06-27 16:16:53 +01:00
Andrew Kingston 8c9d4a9126 Merge branch 'develop' of github.com:Budibase/budibase into cheeks-fixes 2023-06-27 16:09:59 +01:00
Peter Clement cf0300973a add error mapping system 2023-06-27 15:28:10 +01:00
Peter Clement 46a9142676 propagate errors coreectly for datasource plus 2023-06-27 15:27:56 +01:00
mike12345567 fc537a0aab Further PR comments. 2023-06-27 14:56:24 +01:00
Michael Drury a3ebcb2896 Merge pull request #11033 from Budibase/fix/BUDI-7188
Don't sync automation logs from prod to dev app
2023-06-27 12:52:07 +01:00
mike12345567 4d2aa2a67b PR comments. 2023-06-27 12:45:00 +01:00
mike12345567 1d5bc39282 PR comments. 2023-06-27 12:24:50 +01:00
Andrew Kingston cfdd6bafb7 Rewrite how middlewares are ran inside sockets, and fix collaboration 2023-06-27 11:33:23 +01:00
mike12345567 47260f23bf PR comments. 2023-06-27 10:01:06 +01:00
Mel O'Hagan 6f75c5df53 Use any type to fix TypeScript check 2023-06-27 09:59:02 +01:00
Dean eaecd3ab68 Merge remote-tracking branch 'origin/develop' into merge-master 2023-06-27 09:31:35 +01:00
mike12345567 7e79c827a7 Test fixes, as well as issue discovered by test around _id generation and event triggering. 2023-06-26 19:10:04 +01:00
mike12345567 3eff4d85d0 Adding a test case for the removal of automation logs from app sync, as well as adding to the publish/sync filter a check to not carry over automation logs. 2023-06-26 18:52:15 +01:00
Andrew Kingston b7603f8bf1 Merge branch 'develop' of github.com:Budibase/budibase into cheeks-fixes 2023-06-26 17:56:11 +01:00
mike12345567 ced1dd95c7 Updating roles tests to make sure ID always valid. 2023-06-26 16:35:16 +01:00
Dean b6caebe431 Merge remote-tracking branch 'origin/develop' into feature/app-settings-section 2023-06-26 15:51:31 +01:00
melohagan 0ecda93ea9 Fix for $in on ObjectIds (#11014) 2023-06-26 15:07:29 +01:00
mike12345567 1c09913d33 Fix for foreign keys being unsettlable after update, breaking Postgres test. 2023-06-26 15:05:10 +01:00
mike12345567 b94801d10a Merge branch 'develop' of github.com:Budibase/budibase into feature/custom-role-readable-ids 2023-06-26 12:39:41 +01:00
Andrew Kingston 6d38bdcd64 Merge branch 'develop' of github.com:Budibase/budibase into cheeks-fixes 2023-06-26 11:32:54 +01:00
Andrew Kingston 5f407259dc Enable component nesting validation for new apps 2023-06-26 10:39:38 +01:00
Andrew Kingston aebc3b2bb8 Merge branch 'develop' of github.com:Budibase/budibase into grid-block 2023-06-26 09:05:06 +01:00
mike12345567 e022da5bc8 Adding test case for foreign key autocolumn enrichment. 2023-06-23 18:31:02 +01:00
mike12345567 c2b4dec88f Fix to make foreign keys auto-columns when used in relationships as well as making sure that when fetching tables that they can be removed, using the old fetch mechanism (to be replaced, but needs to work for now). 2023-06-23 18:09:52 +01:00
mike12345567 3d3efadb37 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-06-23 15:19:49 +01:00
melohagan 3aca0c0ed3 Null safety (#11007) 2023-06-23 14:48:07 +01:00
Dean fd8400bee5 PR feedback and removed some comments 2023-06-23 11:56:59 +01:00
Andrew Kingston 007b6d605b Merge pull request #10917 from Budibase/fix/datasource-409
Fix datasource conflicts
2023-06-23 11:54:15 +01:00
mike12345567 baecab785d Handling the removal of the role_ prefix where applicable so that new role IDs present in the exact same way as built in roles. 2023-06-22 18:02:35 +01:00
melohagan 0860a5b248 Exclude entities from datasource env processing (#11000) 2023-06-22 17:35:47 +01:00
mike12345567 58d7293798 PR suggestion. 2023-06-22 13:25:37 +01:00
mike12345567 5373b867e1 Fix for #10949 - the relationship types were always locked to be the same, which means that the foreign key wasn't being updated correctly as the backend was not aware of which side was the one-to-many side. 2023-06-22 12:32:39 +01:00
mike12345567 45120c60ba Getting basic regex in place to make sure role names can be IDs. 2023-06-21 17:08:54 +01:00
Michael Drury e1741937ae Removing logging of error in coercion - this was creating noise in errors channel. 2023-06-21 12:08:39 +01:00
Andrew Kingston 1403ee59ce Use app ID as part of room key for grid websocket to fix issues with dev/prod tables having the same table ID but being different tables 2023-06-21 08:51:43 +01:00
Andrew Kingston 3f20a3a439 Enable collaboration for public users and fix collaboration for non-devs 2023-06-21 08:33:58 +01:00
mike12345567 cbfeea121c Merge branch 'master' of github.com:Budibase/budibase into develop 2023-06-20 18:09:23 +01:00
melohagan 9e9cece59e Clone user (#10974) 2023-06-20 17:07:34 +01:00
melohagan b0debf17ef Table disappears from side bar when changing display name (#10909)
* Pass sourceId on fetch tables

* Use ExternalTable type
2023-06-20 17:07:12 +01:00
Dean 998f1806aa Updated analytics tests to account for the embedded 2023-06-20 16:29:09 +01:00
Michael Drury 958cabee52 Merge pull request #10921 from Budibase/fix/airgap-templates-call
update airgap script and enable support for offline mode
2023-06-20 13:51:10 +01:00
Dean f04f42546a Merge remote-tracking branch 'origin/develop' into feature/app-settings-section 2023-06-20 12:33:48 +01:00
Dean 602ea9bc4e General tidying and refactoring. Updated the publish button behaviour to also take into account revert and version update behaviours. 2023-06-20 12:33:18 +01:00
Adria Navarro cdd15fd75f Merge pull request #10953 from Budibase/budi-7115-sql-schema-export
BUDI-7115 - Sql schema export
2023-06-20 11:57:46 +01:00
Adria Navarro 8ab5913eb9 Change url 2023-06-20 11:33:38 +01:00
Adria Navarro 6ed5894441 Type 2023-06-20 11:14:23 +01:00
Dean c1248eed12 Merge remote-tracking branch 'origin/develop' into feature/app-settings-section 2023-06-20 10:08:18 +01:00
mike12345567 3955b00bbc Merge branch 'develop' of github.com:Budibase/budibase into fix/airgap-templates-call 2023-06-19 18:57:17 +01:00
Michael Drury c5270ee323 Merge pull request #10959 from Budibase/fix/integration-tests
Integration test updates and improved logging
2023-06-19 18:52:24 +01:00
mike12345567 289a75fc9a Few minor updates to the integration suite to make it easier to decipher what is happening under the hood, as well as making it easier to log from these (where there is no pino logging available, importing backend-core breaks things). Also added a new script which can be used to get local environment setup as needed to run qa-core tests. Finally, xdescribe for the failing test until can work out what is wrong with MongoDB installation in QA environment. 2023-06-19 18:28:38 +01:00
Adria Navarro 718fe1efc6 Implement mssql and tests 2023-06-19 17:56:12 +01:00
Adria Navarro c44b10eadf Lint 2023-06-19 17:56:12 +01:00
Adria Navarro e21dca5582 Implement and test mysql sql dump 2023-06-19 17:56:12 +01:00
Adria Navarro ab5b8716c0 Get mysql schema 2023-06-19 17:56:12 +01:00
Adria Navarro d337c52adf Add feature flags 2023-06-19 17:56:11 +01:00
Adria Navarro 7a4eb3113d Add external schema endpoint 2023-06-19 17:56:11 +01:00
Adria Navarro dbcf7814a8 Support ssl 2023-06-19 17:56:11 +01:00
Adria Navarro e7026d4aed Get schema function 2023-06-19 17:56:11 +01:00
Adria Navarro 7bd0078210 Clean code 2023-06-19 17:55:47 +01:00
Adria Navarro a0bfebf53d Merge pull request #10894 from Budibase/budi-7010/frontend-encrypt-app-imports
BUDI-7010 - Frontend decrypt app imports
2023-06-19 11:18:38 +01:00
Dean 2304032423 Added embed state, behaviours and event tracking to client app. UI/UX Refactoring 2023-06-16 12:30:08 +01:00
Rory Powell 5f716a62a4 Revert "Merge branch 'develop' into master"
This reverts commit 67fb9de7f4, reversing
changes made to ebec885b0a.
2023-06-16 10:13:43 +01:00
Michael Drury 58c26d563e Fixing where getCachedLicense is retrieved from. 2023-06-15 23:29:34 +01:00
Michael Drury a1d8ad047a Quick fix suggested by Rory to make use of the cached license when fetching the app package. 2023-06-15 22:51:33 +01:00
mike12345567 d84051ccfd Merge branch 'master' of github.com:Budibase/budibase into develop 2023-06-15 17:08:08 +01:00
mike12345567 67e2ce86ce Adding a license mechanism to the app package call so that public apps can still return what license the app utilises. This is retrieved based on the tenant of the app - we only attach the license type so as to not expose further information than is necessary. 2023-06-15 16:33:07 +01:00
Martin McKeaveney dd8e54c5e1 update airgap script and enable support for offline mode 2023-06-15 15:20:14 +01:00
Adria Navarro df3afe2a7c Merge pull request #10918 from Budibase/budi-5262/support_pg_client_cert
Budi 5262 - Support pg client cert
2023-06-15 12:40:16 +01:00
Adria Navarro b7f0387577 Merge branch 'develop' into budi-5262/support_pg_client_cert 2023-06-15 11:13:52 +01:00
Adria Navarro 4d3ab040bf Support postgres client certificates 2023-06-15 11:06:01 +01:00
Adria Navarro f446bd96dd Merge branch 'master' into backmerge-master 2023-06-15 10:16:21 +01:00
Andrew Kingston 3cbebaf40d Restore original comment 2023-06-15 09:29:46 +01:00
Andrew Kingston 99a8fc7c12 Revert websocket changes and just fetch datasources constantly 2023-06-15 09:27:45 +01:00
Andrew Kingston 5e5dc902d1 Broadcast datasource change via websocket when making changes to tables 2023-06-15 09:04:21 +01:00
Martin McKeaveney 0545eda29d Merge pull request #10905 from Budibase/feature/airgap-assets-support
removing need for external internet assets and self hosting our own f…
2023-06-14 17:37:43 +01:00
Adria Navarro e6ad3a4719 Type pg 2023-06-14 17:17:29 +01:00
Jonny McCullagh 757ca6a166 Merge master develop (#10897)
* Binding drawer fixes

* Added missing headless flag for the bindable combobox

* Fix for QueryEditor width

* Fix svelte transitions in grid new row component breaking routify

* Bump version to 2.7.7

* fix REST connector failure to save

* Bump version to 2.7.8

* Bump version to 2.7.9

* Unexpected token when export data (#10721)

* Tidy ID string for JSON parse

* Display error for composite keys

* Unit test WIP

* directly assign the mock function on the datasource

* Unit tests for exportRows ID handling

---------

Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>

* Return all rows if oneOf value is falsey (#10638)

* Bump version to 2.7.10

* Make sure divider fields are left-most (#10627)

* Make sure divider fields are left most

* Refactor

* Bump version to 2.7.11

* Temporarily remove the focus store update as it triggers a full redraw of the component settings

* Linting

* Removed commented out code

* Bump version to 2.7.12

* Bump version to 2.7.13

* Do not show Business tag for Email action (#10867)

* Bump version to 2.7.14

* new deploy trigger (#10892)

* point the deploys at the new env

* Bump version to 2.7.15

---------

Co-authored-by: Dean <deanhannigan@gmail.com>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: Budibase Staging Release Bot <>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Adria Navarro <adria@budibase.com>
2023-06-14 16:18:09 +01:00
Adria Navarro f31c615e18 Merge branch 'develop' into backmerge-master 2023-06-14 15:45:47 +01:00
Martin McKeaveney 307e6dde02 update bblogoimgur to bblogo 2023-06-14 15:21:46 +01:00
Martin McKeaveney 0f02b31ba7 lint 2023-06-14 15:12:39 +01:00
Michael Drury 6776f3d78c Merge pull request #10881 from Budibase/fix/budi-7026
Custom roles breaking app access when not published
2023-06-14 15:10:30 +01:00
Michael Drury fdad2e6bf3 Merge pull request #10895 from Budibase/fix/budi-7099
MySQL cyclic JSON conversion issue with primary display columns
2023-06-14 15:09:17 +01:00
Martin McKeaveney 6fcdcf947e update budibaseapp url 2023-06-14 15:05:08 +01:00
Martin McKeaveney cd1675098f removing need for external internet assets and self hosting our own fonts 2023-06-14 14:54:27 +01:00
Adria Navarro 9832da4067 Merge branch 'develop' into budi-7010-encrypt-app-exports 2023-06-14 14:40:10 +01:00
Adria Navarro 672804c150 Merge pull request #10900 from Budibase/budi-7010/export_controller_as_post
BUDI-7010 - Export controller as post
2023-06-14 14:38:01 +01:00
mike12345567 3f63a81c01 PR comments. 2023-06-14 14:34:12 +01:00
Adria Navarro 052ecbb59a Merge branch 'budi-7010/export_controller_as_post' into budi-7010-encrypt-app-exports 2023-06-14 14:28:26 +01:00
Adria Navarro fe1a64964a Fix and improve tests 2023-06-14 14:20:20 +01:00
Adria Navarro 4b065dda8b Fix exports/imports 2023-06-14 12:32:26 +01:00
Adria Navarro 9a5f67b7d8 Merge branch 'budi-7010/frontend-encrypt-app-exports' into budi-7010/frontend-encrypt-app-imports 2023-06-14 11:21:19 +01:00
Adria Navarro a4f0b45d5e Fix merge 2023-06-14 11:17:32 +01:00
Adria Navarro a9bf6967dc Merge branch 'budi-7010/export_controller_as_post' into budi-7010-encrypt-app-exports 2023-06-14 11:17:26 +01:00
Adria Navarro a68dc7c965 Remove excludeRows and appName from the querystrings 2023-06-14 11:06:46 +01:00
Adria Navarro bfd444dbaa Change the download to be a post 2023-06-14 10:47:46 +01:00
mike12345567 68082eecf9 Fix for circular issue with primary display fields on SQL tables introduced in most recent update - if somehow the primary display field is set to a relationship field there was a chance of cyclic structure occurring which Koa could not convert to JSON. 2023-06-13 18:21:22 +01:00
Adria Navarro 3d01775b89 Handle errors 2023-06-13 17:08:33 +01:00
Adria Navarro f3b461a62c Handle password on creation 2023-06-13 16:50:56 +01:00
mike12345567 60d58034dd Fixes #6346 - issue with date parsing, adding in some testing around it. 2023-06-13 16:11:22 +01:00
mike12345567 1bdf55e966 Some type updates and fixes for test case. 2023-06-13 14:45:33 +01:00
Adria Navarro c1e09d0305 Close client on testconnection 2023-06-13 10:49:09 +01:00
mike12345567 bedc8e5cce Fix for custom roles that have not been published causing users to be unable to access an app completely. They should instead be treated as public users as their role isn't valid. 2023-06-12 18:39:30 +01:00
Adria Navarro 81522d0784 Clean defaults 2023-06-12 17:51:21 +01:00
Adria Navarro 551ca404b4 Decrypt file 2023-06-12 16:27:19 +01:00
mike12345567 2486937c43 Merge branch 'develop' of github.com:Budibase/budibase into feature/table-fetching-frontend 2023-06-12 16:16:12 +01:00
Adria Navarro 1f4cdf348f Encrypt files 2023-06-12 11:49:38 +01:00
Martin McKeaveney 59b33e6867 code review 2023-06-11 18:51:08 +01:00
Martin McKeaveney 7e45773d02 diagnostics panel 2023-06-10 16:16:52 +01:00
Adria Navarro 978591e2ba Enable encrypting 2023-06-09 16:26:48 +01:00
Adria Navarro 4acfc623b4 Use import for tar 2023-06-09 14:52:19 +01:00
Michael Drury deffe9d3d4 Merge branch 'develop' of github.com:Budibase/budibase into feature/table-fetching-frontend 2023-06-09 13:21:30 +01:00
melohagan 24a00c66bb Unexpected token when export data (#10721)
* Tidy ID string for JSON parse

* Display error for composite keys

* Unit test WIP

* directly assign the mock function on the datasource

* Unit tests for exportRows ID handling

---------

Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2023-06-09 13:01:55 +01:00
Adria Navarro 8492ef18fa Ignore 409 errors on user syncs 2023-06-09 12:36:09 +01:00
Martin McKeaveney 746afaf573 initial work on debug panel 2023-06-08 19:50:29 +01:00
melohagan c0578d4cc2 Send meeting invite via automation email smtp (#10787)
* Pass calendar props into sendSmtpEmail

* Add calendar event to message

* Add Checkbox and DatePicker automation field UI

* Add URL prop

* Add url to sendSmtpEmail unit test

* Refactor

* Code review comments

* Make location optional

* Add EmailInvite type

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-06-08 14:25:35 +01:00
Martin McKeaveney fa64ca3d6b lint 2023-06-08 12:44:41 +01:00
Martin McKeaveney a9787ff608 fix REST connector failure to save 2023-06-08 12:00:34 +01:00
mike12345567 9ee06e8e42 Updating fetch within main datasource UI to mimic that of the onboarding. 2023-06-07 18:34:32 +01:00
mike12345567 dd8f7fdb91 Merge branch 'develop' of github.com:Budibase/budibase into feature/table-fetching-frontend 2023-06-07 18:06:27 +01:00
mike12345567 e07dfab98c Merge branch 'master' of github.com:Budibase/budibase into develop 2023-06-07 18:05:29 +01:00
mike12345567 8d7119a363 Make sure top level path is resolved correctly. 2023-06-07 16:37:42 +01:00
mike12345567 9ebd90a07d Don't resolve anymore given we have an absolute top level path 2023-06-07 16:36:43 +01:00
mike12345567 70e4795349 Fix top level path within the single image to make sure it can find builder assets correctly. 2023-06-07 16:35:36 +01:00
Adria Navarro 4eac5f93ca Fix test 2023-06-07 14:10:02 +01:00
Adria Navarro d8fc37a760 Revert "Merge pull request #10808 from Budibase/undo_wrong_merge_from_develop"
This reverts commit 4ccc98103c, reversing
changes made to 500424c651.
2023-06-07 14:08:47 +01:00
Adria Navarro fdd4492830 Merge branch 'develop' into master-backmerge 2023-06-07 14:07:16 +01:00
melohagan 91acb1b3eb Set sourceId (#10769) 2023-06-07 14:01:24 +01:00
Adria Navarro a14b29efac Improve fetch performance 2023-06-07 12:29:36 +01:00
Adria Navarro dd58aaf5cb Use fancycheckboxgroup 2023-06-07 11:44:32 +01:00
Adria Navarro bb901d94d2 Clean code 2023-06-07 11:32:42 +01:00
Adria Navarro 5135ac36b7 Fix fetching tables 2023-06-07 11:31:10 +01:00
Adria Navarro 95c66edb65 Clean code 2023-06-07 11:31:10 +01:00
Adria Navarro c47656d423 Save datasource 2023-06-07 11:31:10 +01:00
Adria Navarro deeba8bae3 Revert "Merge branch 'develop' into master"
This reverts commit 6f29c978e0, reversing
changes made to 1c6ff73c19.
2023-06-06 22:06:34 +01:00
mike12345567 dab1db2271 Updating datasource save API to allow specifying a filter for which tables to fetch and then linking this up with the new frontend. 2023-06-06 18:27:03 +01:00
mike12345567 cc60baa3d1 Some fixes for BBUI and updating postgres table name fetching to get uniques. 2023-06-06 17:40:14 +01:00
Adria Navarro 1f428bd5c2 Fix test 2023-06-06 12:17:56 +01:00
Rory Powell ad7f6cf5e2 Merge branch 'develop' into merge-master 2023-06-06 11:49:49 +01:00
Adria Navarro 21e870109c Save datasource 2023-06-06 11:29:50 +01:00
Adria Navarro 25c921e340 Validate url 2023-06-06 11:29:49 +01:00
Adria Navarro 1e238ce693 Validate google sheets url 2023-06-06 11:29:49 +01:00
Andrew Kingston d70e49d74f Add event for tracking user collaboration 2023-06-06 10:11:51 +01:00
Rory Powell abbd8c5c8b Merge branch 'master' into develop 2023-06-05 23:19:43 +01:00
Andrew Kingston 4a0e23a171 Transfer lock to next oldest session when disconnecting from the builder 2023-06-05 13:54:17 +01:00
Andrew Kingston f7e21c3348 Remove log from websocket heartbeat 2023-06-05 11:55:45 +01:00
mike12345567 0506096e72 Fixing filtering plus pagination in googlesheets, the pagination previously was first which broke the filtering. 2023-06-05 10:03:47 +01:00
mike12345567 770f7c1dc6 Merge branch 'develop' of github.com:Budibase/budibase into fix/google-sheets-issues 2023-06-05 09:36:45 +01:00
mike12345567 e7649374d2 Fixing googlesheets filtering by _id - there was an issue with the response API giving _rowNumber rather than the expected primary key of rowNumber, need to update the filters accordingly. 2023-06-02 18:25:35 +01:00
mike12345567 213315e14f Fixing issue with row deletion not returning the _id of the row which was deleted in googlesheets. 2023-06-02 18:03:43 +01:00
Andrew Kingston 6f51843875 Fix TS issue 2023-06-02 16:22:07 +01:00
Michael Drury adbdaf394a Small update to make sure that save/patch calls to the rows API (all DS+) return the squashed relationships, not the whole structure. 2023-06-01 18:18:12 +01:00
Andrew Kingston d8d3d71523 Update websocket logic to ignore events trigger by API requests originating from the same session 2023-06-01 17:14:32 +01:00
Michael Drury 8e4f0e531c Merge pull request #10755 from Budibase/fix/datasource-info-endpoint
Datasource info endpoint update
2023-06-01 12:29:46 +01:00
Michael Drury 67588f1051 Adding a JSON parse incase the input is actually an array in the form of a string (HBS). 2023-06-01 12:14:34 +01:00
Michael Drury cde4dabe42 Fixing some redis type errors. 2023-06-01 11:10:39 +01:00
deanhannigan a782a8b9b1 Merge pull request #10758 from Budibase/fix/reduce-array-row-parse-log-level
Reduced log level of array parsing on row import
2023-06-01 10:41:19 +01:00
Dean 6ee83e2da8 Reduced log level of parse array attempt 2023-06-01 09:05:22 +01:00
Michael Drury a3f9759a47 Reverting ioredis-mock removal for test cases - will come back to this in future as it currently breaks pro tests. 2023-06-01 00:02:55 +01:00
mike12345567 16e929bd81 Removing checks around websockets as redis properly available in testing now. 2023-05-31 18:09:15 +01:00
mike12345567 969ee52c29 Fixing merge conflict. 2023-05-31 18:08:29 +01:00
mike12345567 039e78379f Fixing lint issue. 2023-05-31 17:48:18 +01:00
mike12345567 fba3ec987e Merge branch 'develop' of github.com:Budibase/budibase into fix/datasource-info-endpoint 2023-05-31 17:37:17 +01:00
mike12345567 249625ad1a Updating backend tests to actually utilise the redis container which is spun up as part of the tests, doing away with the somewhat problematic ioredis-mock which was breaking some tests due to the addition of the changes for multi-dev collab. 2023-05-31 17:18:01 +01:00
mike12345567 651d50a064 Updating datasource information endpoint to POST which allows sending up an unfinished/unsaved datasource for fetching information with. Also changing how verification and information endpoints work so that enrichment is used and therefore env vars can also be used. 2023-05-31 17:04:29 +01:00
Andrew Kingston 680e609b52 Remove plural forms of enums and use TS enum rather than JS const 2023-05-31 17:03:14 +01:00
Andrew Kingston 8a2d4b7052 Merge branch 'develop' of github.com:Budibase/budibase into websocket-redis-integration 2023-05-31 16:28:14 +01:00
Andrew Kingston ffbbf04e86 Lint 2023-05-31 16:08:35 +01:00
Andrew Kingston a7c6298d1f Ensure socket pruning due to redis TTL expiry works as expected 2023-05-31 15:37:39 +01:00
Dean bb44c9f07f Added console log 2023-05-31 15:20:25 +01:00
Andrew Kingston 05e34076f7 Fully rewrite websocket redis integration to use individual keys per session, enable TTLs on sesisons, prune sessions when users connect and add a heartbeat to sockets 2023-05-31 15:13:22 +01:00
Peter Clement c6d0da33f4 add import for performance lib 2023-05-31 11:33:52 +01:00
Andrew Kingston d926650232 Add back in functionality to select different redis DB's per client 2023-05-31 10:52:39 +01:00
Peter Clement 162ea5d969 update log formatting 2023-05-31 10:51:54 +01:00
Andrew Kingston d3fdb52bf5 Store all socket users in redis to allow all server instances to be aware of all users 2023-05-31 10:21:50 +01:00
Peter Clement 702c908ae8 remove logging 2023-05-31 09:42:44 +01:00
Michael Drury 1547280514 Merge pull request #10739 from Budibase/fix/multi-dev-conflicts
Multidev lock and conflict management
2023-05-30 22:57:00 +01:00
Rory Powell a1dbd67535 Remove debug log 2023-05-30 19:23:19 +01:00
Rory Powell b0783d373a Lint 2023-05-30 19:16:36 +01:00
mike12345567 7c7bd4d5cb Fix for debugging with webstorm the old way (if desired), updating the builder middleware to be more multi-dev capable, ignoring 409s when attempting to update the last updated at for apps (if multiple devs hit at same time, only use one) also updating writethrough cache to retry once, with the extended TTL on locks, plus the multi-dev collab it can take a minute to update usage quota doc when a lot of updates occur at once. 2023-05-30 17:41:20 +01:00
Peter Clement ef9fc94728 Merge branch 'fix/looping-performance-bug' of github.com:Budibase/budibase into fix/looping-performance-bug 2023-05-30 16:52:34 +01:00
Peter Clement ed6cd8144b lint 2023-05-30 16:52:22 +01:00
Rory Powell 207512396a Merge pull request #10738 from Budibase/automation-investigation
Automation investigation logging + max doc size fix for automation log
2023-05-30 16:45:27 +01:00
Rory Powell df5654a7e7 Merge branch 'develop' into fix/looping-performance-bug 2023-05-30 16:41:11 +01:00
Rory Powell 6230e62b9b Automation investigation logging + max doc size fix for automation log 2023-05-30 16:37:39 +01:00
Peter Clement 3119ba5a8d remove log 2023-05-30 14:41:04 +01:00
Peter Clement 0a91e5bed1 update let to const 2023-05-30 14:26:49 +01:00
Peter Clement 5a7f0ba586 Fix performance issue with looping and context 2023-05-30 14:25:28 +01:00
Gerard Burns 23ee9f4af8 Post Sign Up Onboarding Changes (#10701)
* wip

* PR Feedback

* Fixes

* PR Feedback

* PR Feedback

* PR Feedback
2023-05-30 12:54:57 +01:00
Andrew Kingston be40d72f55 Merge pull request #10712 from Budibase/data-section-multidev
Multiple user collaboration for data section
2023-05-30 09:08:14 +01:00
Peter Clement 55e56e2c1f Merge branch 'feature/sync-automations' of github.com:Budibase/budibase into feature/sync-automations 2023-05-26 16:58:12 +01:00
Peter Clement 2ae960e2ee fix broken test 2023-05-26 16:58:00 +01:00
mike12345567 7ba21d836b Merge branch 'develop' of github.com:Budibase/budibase into feature/sync-automations 2023-05-26 16:42:01 +01:00
Peter Clement 66e1f57a3d one more feature check for safety on the trigger 2023-05-26 16:06:16 +01:00
deanhannigan bd50f32f0d Merge pull request #10713 from Budibase/fix/internal-view-eval-fn
Fix for fetching Internal DB Views in QA cloud
2023-05-26 11:51:07 +01:00
Peter Clement 5a73b02827 update feature array to be an object 2023-05-26 11:02:47 +01:00
Dean e1a87f2072 Reverted eval call to direct. Indirect appears to cause issues in cloud 2023-05-26 10:22:28 +01:00
Adria Navarro 77a619945b Merge pull request #10680 from Budibase/budi-6933-verify-data-source-connection-during
Verify data source connection before saves
2023-05-26 10:47:42 +02:00
Andrew Kingston 520158c8f9 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-26 09:39:06 +01:00
Peter Clement 70dfd9e8e5 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-26 09:26:51 +01:00
Andrew Kingston cc7df474c9 Standardise usage of user avatars and colours across the entire platform 2023-05-26 09:24:53 +01:00
deanhannigan 567ee451dd Merge pull request #10702 from Budibase/fix/data-export-rows
Fixes and updates for export internal rows
2023-05-26 09:08:35 +01:00
melohagan b5c98871ad Update table data via CSV import (#10313)
* Add identifierFields select for import

* Update rows on import (Internal DB)

* Only allow internal DB to upsert import CSV

* Clear identifierFields when turning off update

* Passing table instead of tableId

* Pass table

* Pass tableType
2023-05-25 18:05:07 +01:00
Dean 146940f6ae Added error handling for export row front end and fixed row export backend behaviour 2023-05-25 17:50:52 +01:00
Peter Clement b0a32f03b4 remove log 2023-05-25 09:14:09 +01:00
Andrew Kingston 5e480a1527 Use socker.io redis adapter to broadcast events to all server instances 2023-05-25 08:48:56 +01:00
Martin McKeaveney 77c2e309dd merge 2023-05-24 17:35:04 +01:00
Martin McKeaveney f86d321e2e restrict openai just to self host 2023-05-24 17:17:23 +01:00
Martin McKeaveney db5d051755 GPT4 support 2023-05-24 15:26:27 +01:00
Andrew Kingston 5cf4753853 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-24 15:14:32 +01:00
Peter Clement 4d5a922684 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-24 15:05:58 +01:00
Peter Clement a9bb534cdf set flag in automation orchestrator 2023-05-24 14:41:58 +01:00
Adria Navarro b264708af6 Merge remote-tracking branch 'origin/develop' into chore/esbuild 2023-05-24 14:17:32 +02:00
Martin McKeaveney bbab2a9adc merge 2023-05-24 11:25:49 +01:00
Adria Navarro 237cda064c Simplify integration features 2023-05-24 10:50:51 +02:00
Peter Clement 6818e4debb check collection actually exists 2023-05-23 16:12:20 +01:00
Peter Clement 8d3a5307ed sync automation webhooks tests 2023-05-23 15:55:52 +01:00
Peter Clement 986348f511 sync automation tests 2023-05-23 15:55:25 +01:00
Adria Navarro c3036af072 Merge pull request #10659 from Budibase/feature/table-fetching
Datasource+ table fetching API
2023-05-23 15:39:18 +02:00
andz-bb 7b9d56ac25 add role field to snowflake datasource connection 2023-05-23 12:38:50 +01:00
mike12345567 590844c8a9 PR comments. 2023-05-23 12:22:22 +01:00
Adria Navarro aa58a24a6d Change query for retrieving postgres primary keys 2023-05-23 11:20:18 +02:00
Adria Navarro e838a90d3e Add small unit test 2023-05-23 10:22:26 +02:00
Adria Navarro 023373bb25 Remove unnecessary load info 2023-05-23 10:18:37 +02:00
Adria Navarro b7b604ca00 Improve test 2023-05-23 10:17:42 +02:00
Adria Navarro 5ea19986b1 Add basic test 2023-05-23 10:14:06 +02:00
Adria Navarro 74ea851fa3 Fetch google sheets 2023-05-23 09:55:46 +02:00
mike12345567 76eef8d3d4 Fixing some test issues. 2023-05-22 16:25:50 +01:00
Andrew Kingston 9ab5c8792a Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-22 16:01:50 +01:00
Andrew Kingston cfa07a68ae Handle table, query and datasource events using builder socket 2023-05-22 15:59:44 +01:00
Peter Clement a8e40d711b uneeded input value 2023-05-22 15:53:20 +01:00
Peter Clement 754b30dd5c add features property to automation defintions 2023-05-22 15:46:42 +01:00
mike12345567 83ddb9c8dd Adding feature to denote fetch table names function. 2023-05-22 14:28:18 +01:00
mike12345567 d6c07f47b6 Adding base implementation for googlesheets integration. 2023-05-22 13:57:56 +01:00
Andrew Kingston 15ff635c6e Merge pull request #10591 from Budibase/fix/automation-filtering
Fix automation filtering on number fields
2023-05-22 13:12:35 +01:00
mike12345567 ad358fe1ca Merge branch 'develop' of github.com:Budibase/budibase into feature/table-fetching 2023-05-22 12:56:10 +01:00
Adria Navarro 3d7af9b2a3 Fix manifest ref 2023-05-22 09:42:43 +02:00
Adria Navarro 986d4c4740 Merge branch 'develop' into chore/esbuild 2023-05-19 17:26:47 +02:00
Adria Navarro 82f53483b2 Fix server docker 2023-05-19 16:44:09 +02:00
Peter Clement d7ae338bc5 fix import 2023-05-19 15:14:01 +01:00
Peter Clement 9b7972fdfd remove middleware but check if prod in controller 2023-05-19 15:12:08 +01:00
Michael Drury 38e39cf2f2 Adding negative test case for connections and adding test of table name fetching for postgres. 2023-05-19 13:36:05 +01:00
Michael Drury d85bcbc7e5 Adding test for postgres verify. 2023-05-19 12:19:55 +01:00
Adria Navarro 0a2335a047 Merge pull request #10622 from Budibase/chore/improve_pipeline_times
Chore - Improve pipeline run time
2023-05-19 13:18:21 +02:00
Peter Clement d271bbdadb rename syncWebHooks to syncAutomations 2023-05-19 10:07:02 +01:00
Michael Drury 2223027d28 Adding API for retrieving table names. 2023-05-18 23:22:52 +01:00
Michael Drury 732ebb4f87 Adding function to fetch table names. 2023-05-18 22:09:44 +01:00
Peter Clement e1eda14204 move sync automations away from bull and call directly 2023-05-18 17:01:53 +01:00
Peter Clement f680fbd822 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-18 11:35:25 +01:00
Michael Drury 62e9777407 Merge pull request #10633 from Budibase/fix/live-app-user-updates
Production app user updates
2023-05-18 10:46:31 +01:00
Adria Navarro 2d2d50a5df Merge branch 'develop' into chore/esbuild 2023-05-18 11:34:11 +02:00
Rory Powell a685f181da Merge branch 'master' into develop 2023-05-18 09:10:51 +01:00
Andrew Kingston 3794d8e204 Simplify websocket comms for grid and improve builder socket 2023-05-18 08:57:20 +01:00
Rory Powell 55ee94892a Support setting object name for logged json objects 2023-05-17 22:18:50 +01:00
mike12345567 cf7107d19a Updating sync to cover both prod and dev apps. 2023-05-17 19:35:00 +01:00
Andrew Kingston 0bebacc741 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-17 16:38:01 +01:00
Rory Powell 0aff89a479 Merge pull request #10626 from Budibase/chore/automation-logging-updates
Automation logging updates
2023-05-17 14:58:16 +01:00
Rory Powell f41b134d31 Refactor to use param for doInAutomationContext 2023-05-17 14:57:29 +01:00
Rory Powell 578b599428 Lint 2023-05-17 14:10:22 +01:00
Rory Powell ad37186665 Logging updates for automations 2023-05-17 13:54:20 +01:00
mike12345567 f3785892a9 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-05-17 12:45:28 +01:00
Rory Powell 42f472b038 Type updates for automation jobs 2023-05-17 12:26:07 +01:00
Adria Navarro 60109ebcda Fix manifest usage 2023-05-17 12:55:04 +02:00
Adria Navarro 4f3139a47b Merge branch 'develop' into feature/datasource-conns 2023-05-17 12:00:56 +02:00
Adria Navarro 8e95038671 Merge pull request #10620 from Budibase/feature/oracle-conn-checking
Oracle connection checking
2023-05-17 10:52:31 +02:00
mike12345567 e09550f7e3 PR comments. 2023-05-17 09:45:25 +01:00
Adria Navarro a2e22bda71 Merge pull request #10618 from Budibase/budi-6932/check_elastic
Check elastic search connection settings
2023-05-17 10:16:16 +02:00
mike12345567 ee5f0ec641 Remove unused type. 2023-05-17 09:15:06 +01:00
Adria Navarro 896bc61934 Check elastic connection 2023-05-17 09:38:37 +02:00
mike12345567 9f57d7c33a Fixes after testing against actual Oracle service. 2023-05-16 19:31:12 +01:00
mike12345567 832f8b3aa8 Adding Oracle connection checking. 2023-05-16 19:04:46 +01:00
Peter Clement e3d867611b use correct sdk import 2023-05-16 16:05:37 +01:00
Andrew Kingston 1e48020001 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-16 15:23:30 +01:00
mike12345567 14806809e8 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-05-16 14:54:44 +01:00
Andrew Kingston 6ed691be1d Improve builder socket 2023-05-16 14:18:31 +01:00
Adria Navarro e465422031 Implement connection 2023-05-16 15:08:34 +02:00
Adria Navarro ce357ecac8 Setup CONNECTION_CHECKING feature 2023-05-16 13:37:30 +02:00
Adria Navarro d285c2aeb2 Merge pull request #10601 from Budibase/budi-6932/verify_google_sheets
Verify google sheets connection
2023-05-16 13:33:08 +02:00
Adria Navarro 87497fee73 Comments 2023-05-16 13:24:16 +02:00
Adria Navarro 419e2de602 Test airtable connection 2023-05-16 13:24:16 +02:00
Adria Navarro be6c398f53 Remove bool ref 2023-05-16 13:23:35 +02:00
Adria Navarro 2176ac8da7 Clean code 2023-05-16 11:49:51 +02:00
Adria Navarro 062127b1f1 Fix types 2023-05-16 11:48:40 +02:00
Adria Navarro b3b962534f Test snowflake connection 2023-05-16 11:47:38 +02:00
Adria Navarro d6473aab87 Append auth on verification 2023-05-16 11:47:38 +02:00
Adria Navarro 911a072069 Update types 2023-05-16 11:44:58 +02:00
Adria Navarro a21039d5b4 Fix auth checks when specified auth 2023-05-16 11:43:13 +02:00
Adria Navarro 5e7d839cb1 Use existing merge 2023-05-16 11:43:13 +02:00
Adria Navarro a676e42b1f Handle config 2023-05-16 11:43:13 +02:00
Adria Navarro cd93d327a5 Test google sheets 2023-05-16 11:43:13 +02:00
Adria Navarro b5890b788f Append auth on verification 2023-05-16 11:43:13 +02:00
Peter Clement d43fc819c7 refactor check for collect step into sdk 2023-05-16 09:29:40 +01:00
Dean 728eb3bb09 Fix for autoid issue on create row 2023-05-15 19:22:22 +01:00
Andrew Kingston 1bfe823bce Fix filtering in automations not accounting for number prefixes in filter expression 2023-05-15 17:45:09 +01:00
mike12345567 6b7269b954 Refactoring response from integrations to a simple type. 2023-05-15 17:36:16 +01:00
Michael Drury 18d2c33839 Merge pull request #10583 from Budibase/budi-6932/verify_redis
Implement redis connection verification
2023-05-15 17:22:32 +01:00
Michael Drury fbc3697c8c Merge pull request #10546 from Budibase/budi-6932/verify_mysql
Implement mysql connection verification
2023-05-15 17:13:32 +01:00
Michael Drury 9e6f22653b Merge pull request #10550 from Budibase/budi-6932/verify_couchdb
Implement couchdb connection verification
2023-05-15 17:12:54 +01:00
Michael Drury 3ef204cf7b Merge pull request #10553 from Budibase/budi-6932/verify_mssql
Implement MSSQL connection verification
2023-05-15 17:12:05 +01:00
Michael Drury f9fd3d942a Merge pull request #10554 from Budibase/budi-6932/verify_mongo
Implement mongo connection verification
2023-05-15 17:11:37 +01:00
Michael Drury 001e8757e8 Merge pull request #10555 from Budibase/budi-6932/verify_arango
Implement arango connection verification
2023-05-15 17:11:12 +01:00
Michael Drury 328514afdd Merge pull request #10588 from Budibase/budi-6932/verify_s3
Implement S3 connection verification
2023-05-15 17:10:38 +01:00
Michael Drury d77107f540 Merge pull request #10589 from Budibase/budi-6932/verify_dynamodb
Implement dynamodb connection verification
2023-05-15 17:10:10 +01:00
mike12345567 bd74f8eef7 Updating testConnection usage. 2023-05-15 17:08:23 +01:00
mike12345567 571987a2ce Merge branch 'feature/datasource-connections' of github.com:Budibase/budibase into feature/datasource-conns 2023-05-15 17:00:30 +01:00
Adria Navarro 3933a3881b Test dynamodb connection 2023-05-15 17:58:09 +02:00
Adria Navarro f2f0c2e708 Typing 2023-05-15 17:56:48 +02:00
Adria Navarro 1e505791c0 Implement s3 checks 2023-05-15 17:37:28 +02:00
Adria Navarro 47d8701578 Move files 2023-05-15 16:53:32 +02:00
Adria Navarro 058ac416ea Test redis 2023-05-15 16:50:37 +02:00
Adria Navarro fad57db634 Implement the check as part of the integration 2023-05-15 16:48:40 +02:00
Adria Navarro 901bff5399 Validate arango 2023-05-15 16:47:41 +02:00
Adria Navarro 2f9b076381 Implement the check as part of the integration 2023-05-15 16:38:42 +02:00
Adria Navarro e8fa690566 Add mongo checks 2023-05-15 16:37:20 +02:00
Adria Navarro d98bc11a20 Clean 2023-05-15 16:30:43 +02:00
Adria Navarro 2641a8c135 Clean code 2023-05-15 16:30:43 +02:00
Adria Navarro 0418e90a37 Implement the check as part of the integration 2023-05-15 16:30:43 +02:00
Adria Navarro 32695018bf Validate and test microsoft sql 2023-05-15 16:30:43 +02:00
Peter Clement 007f5ca8a9 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-15 15:19:44 +01:00
Andrew Kingston 46d8ad2864 Restore proper functionality for showing other users inside grids 2023-05-15 14:51:54 +01:00
Peter Clement 266465c8df convert timeout seconds to milliseconds 2023-05-15 14:48:34 +01:00
Adria Navarro bd736836f0 Remove export 2023-05-15 13:55:22 +02:00
Adria Navarro d656edad40 Implement the check as part of the integration 2023-05-15 13:54:32 +02:00
Adria Navarro 209ada0c38 Validate couchdb 2023-05-15 13:54:32 +02:00
Adria Navarro 8a1564ef07 Implement the check as part of the integration 2023-05-15 13:48:09 +02:00
Adria Navarro 721492e76d Validate mysql 2023-05-15 13:47:48 +02:00
Adria Navarro f10a66cc42 Type mysql configs 2023-05-15 13:47:48 +02:00
Adria Navarro 99d525ad79 Move tests to qa-core 2023-05-15 13:16:56 +02:00
Adria Navarro c3856a48aa Fix types 2023-05-15 13:16:56 +02:00
Adria Navarro eaf7e399e7 Remove unnecessary export 2023-05-15 13:16:56 +02:00
Adria Navarro ffef2499cc Implement the check as part of the integration 2023-05-15 13:16:56 +02:00
Adria Navarro f5fb4f8850 Clean 2023-05-15 13:16:56 +02:00
Adria Navarro b022dcba77 Types 2023-05-15 13:16:56 +02:00
Adria Navarro 25233c5c9b Add message response 2023-05-15 13:16:56 +02:00
Adria Navarro f022a43065 Test pg connection 2023-05-15 13:16:56 +02:00
Adria Navarro 239a51a2c0 Typings 2023-05-15 13:16:56 +02:00
Adria Navarro 20aa0f50ab Clean code 2023-05-15 13:16:56 +02:00
Andrew Kingston f8f970bf7e Update grid websocket to send actual changes down to reduce API load 2023-05-12 16:13:32 +01:00
Peter Clement c86c2b4096 add synchronous webhook functionality 2023-05-12 15:57:34 +01:00
Peter Clement dcfb65b92d sync / async automations go through one endpoint 2023-05-12 15:56:24 +01:00
Andrew Kingston 7f96fbf741 Remove single user restriction and notify users if they are the primary builder or not 2023-05-12 13:55:08 +01:00
melohagan 395cf4a667 Add JSON payload support for Make and Zapier (#10529)
* Rename Integromat to Make. Update logo.

* Add JSON type for automations

* Support deprecated values in JSON

* Fix json query editor width bug

* Push body to schema if missing

* Support JSON body

* Add JSON payload support for Zapier

* Update packages/server/src/automations/steps/make.ts

Co-authored-by: Martin McKeaveney <martin@budibase.com>

* July -> November

* Add unit tests

---------

Co-authored-by: Martin McKeaveney <martin@budibase.com>
2023-05-11 17:49:33 +01:00
Peter Clement 1626571081 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-11 11:53:12 +01:00
Dean 77d1f9250c Updated import row test to evaluate the name and _id fields on the table instead of the entire object. 2023-05-10 12:52:54 +01:00
Dean 1e6652dc39 Fix for importing exported array/option fields. Fix to ensure lastid and inclusion updates persisted as a result of an import. Test updates for array and option fields 2023-05-10 12:36:01 +01:00
Peter Clement 1539bf234b add ability to trigger synchronous automation from button action 2023-05-09 12:10:20 +01:00
melohagan fb54b6de60 Add pagination to Google Sheets (#10525)
* Add pagination to Google Sheets

* Default limit to 100
2023-05-09 12:05:12 +01:00
Peter Clement ac57a849ce add collect bloc definition 2023-05-09 12:04:32 +01:00
Peter Clement 9b66b30969 add property to denote if step can be looped 2023-05-09 12:04:16 +01:00
Dean 8fcb7d880a Merge remote-tracking branch 'origin/master' into fix/inclusion-row-parsing 2023-05-09 09:46:37 +01:00
Martin McKeaveney eb37dacc73 lint 2023-05-08 16:23:49 +01:00
Martin McKeaveney b387f969d9 allow passwordless redis 2023-05-08 15:59:12 +01:00
mike12345567 57a633b926 Implementing main body of connection verification endpoint. 2023-05-05 17:40:39 +01:00
mike12345567 ce6c5bfa68 Base connection work - extending the base integration to include the option of a connection check function. 2023-05-05 15:47:55 +01:00
Dean 03c048f978 Merge remote-tracking branch 'origin/master' into fix/inclusion-row-parsing 2023-05-05 15:22:49 +01:00
Dean 0aeb06bb2b Merge commit 2023-05-05 13:39:59 +01:00
melohagan 25b42f0a28 Rename Integromat to Make. Update logo. (#10492) 2023-05-05 12:41:24 +01:00
Martin McKeaveney 1c81cc4b4d Merge pull request #10483 from Budibase/fix/empty-attachment-row-import
Fix for row import failure caused by empty attachment parsing.
2023-05-05 12:01:04 +01:00
Michael Drury cfae0f6811 Merge pull request #10487 from Budibase/fix/automation-log-issue
Potential fix for automation log issue
2023-05-05 11:59:25 +01:00
Dean b0ff61c9ec Feedback update. Console.error to logging.logalert 2023-05-05 09:24:57 +01:00
melohagan b790a1177e Don't validate empty options picker (#10302) 2023-05-05 07:50:01 +01:00
mike12345567 0d7959f720 Fixing some un-identified listeners, queue messages not being correctly printed, also improving the mechanism for detecting if in the main thread or not. 2023-05-04 17:20:21 +01:00
Martin McKeaveney 50de32a8a0 Merge pull request #10452 from Budibase/feature/clustering-support
attaching clustered mode to an env var
2023-05-04 14:25:23 +01:00
Martin McKeaveney 41c131050c lint 2023-05-04 13:43:53 +01:00
Martin McKeaveney 167dfd39d7 fix ts build 2023-05-04 13:32:17 +01:00
Dean 5498cc86bd Refactor to fix tests and added an extra empty scenario 2023-05-04 12:58:45 +01:00
Dean a1fdff8df8 Linting 2023-05-04 12:25:30 +01:00
Dean f8da7a9f28 Linting 2023-05-04 12:12:47 +01:00
Dean 56a1b068cc Added json parse option for row import attachment values 2023-05-04 11:52:20 +01:00
Dean 98963c1505 Fix for inclusion parsing for arrays and options. View table fix to hide edit button 2023-05-04 11:21:24 +01:00
Adria Navarro fa6e6b53f8 Merge pull request #10462 from Budibase/fix/budi-6789-import-data-empty-date-is-not-allowed
Fix - Budi 6789 import data empty date is not allowed
2023-05-03 19:22:06 +02:00
Adria Navarro efaf2adf05 Fix build 2023-05-03 18:05:32 +01:00
Adria Navarro cec2f88c25 Fix svelte issues 2023-05-03 18:05:32 +01:00
Adria Navarro a7f69231d9 Merge branch 'chore/npmless-builds' into chore/esbuild 2023-05-03 18:01:04 +01:00
Rory Powell e1a147e823 Merge branch 'master' into develop 2023-05-03 16:06:42 +01:00
Adria Navarro f426ba1ac3 Merge branch 'chore/npmless-builds' into chore/esbuild 2023-05-02 14:56:34 +01:00
Adria Navarro 1d041a3dd5 Support nulls when optional 2023-05-02 12:48:05 +01:00
Adria Navarro 6e7c78362e Return null instead of undefined 2023-05-02 12:46:53 +01:00
Adria Navarro 650cbc1f01 Handle cast as undefineds 2023-05-02 11:57:18 +01:00
Adria Navarro c87cc39cea Add basic tests 2023-05-02 10:44:25 +01:00
Adria Navarro 29df12c247 Add csvutils 2023-05-02 10:34:45 +01:00
Martin McKeaveney 36397bb77d enabling cluster support for ratelimit cache 2023-04-28 20:23:39 +01:00
melohagan 8742fb39d3 is empty lucene query with OR fix (#10451)
* empty lucene query with OR fix

* Fix unit test
2023-04-28 17:17:32 +01:00
mike12345567 4f7e56fed9 Making build script into a module, so that it can be used in a specialised server build which also builds the thread scripts as required for worker-farm. 2023-04-27 19:00:01 +01:00
mike12345567 de51364303 Some updates to Dockerfiles. 2023-04-27 17:00:15 +01:00
mike12345567 5363693ac3 Removing automation logs from app exports as they are not useful - they take up space and the imported app won't have ran any automations yet. I have added it as a flag so that this does not affect backups (as you would want to maintain logs for backups). 2023-04-27 11:36:52 +01:00
mike12345567 5066d20c9d Updating Dockerfiles and dockerignore to clear out any un-needed assets. 2023-04-26 17:59:18 +01:00
Pedro Silva 6e79506445 Fix failing test 2023-04-26 16:45:00 +01:00
Martin McKeaveney e70e3ae662 rename 2023-04-26 15:58:21 +01:00
Martin McKeaveney 4f020a4db4 lint 2023-04-26 15:56:46 +01:00
Martin McKeaveney 84f52683b2 chatgpt automation block 2023-04-26 15:55:44 +01:00
Pedro Silva 796c50d3e0 Merge branch 'develop' into qa-core-datasource-api-tests 2023-04-26 15:51:47 +01:00
mike12345567 49b45f5e67 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-25 17:37:56 +01:00
Adria Navarro 608a38489f Export undefineds as empty values in csv, instead of empty strings 2023-04-25 12:34:50 +01:00
Dean 72c72fc48a Lint fix 2023-04-25 12:31:52 +01:00
Dean f3be917da1 Enrich the upgradable version property when fetching the app package 2023-04-25 12:16:02 +01:00
Adria Navarro 640bb2004b Merge pull request #10324 from Budibase/chore/remove_package.json_dependency
Chore - Remove package.json dependency
2023-04-24 19:34:15 +02:00
adrinr 128802ebf3 Fix build 2023-04-24 18:05:53 +01:00
Michael Drury 9c93bf91c0 Merge pull request #10352 from Budibase/fix/10349
Allow SQL formulas using related row information to be used as display columns
2023-04-24 17:50:49 +01:00
Adria Navarro c47ff6ccfb Merge branch 'develop' into chore/remove_package.json_dependency 2023-04-24 18:42:55 +02:00
melohagan 5e76a50b0b Add info to query result payload (#10291) 2023-04-24 12:03:02 +01:00
Rory Powell ec06f13aa6 Per user pricing (#10378)
* Update pro version to 2.4.44-alpha.9 (#10231)

Co-authored-by: Budibase Staging Release Bot <>

* Track installation and unique tenant id on licence activate (#10146)

* changes and exports

* removing the extend

* Lint + tidy

* Update account.ts

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>

* Type updates for loading new plans (#10245)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS` (#10247)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete + migration (#10250)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Lint

* Types and structures for user subscription quantity sync (#10280)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing for licensing (#10346)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing

* Lint

* Pricing/billing page (#10353)

* bbui updates for billing page

* Require all PlanTypes in PlanMinimums for compile time safety

* fix test package utils

* Incoming user limits warnings (#10379)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* Types and test updates for subscription quantity changes in account-portal (#10372)

* Add chance extensions for `arrayOf`. Update events spies with license events

* Add generics to doInTenant response

* Update account structure with quota usage

* User count limits (#10385)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* user limit messaging on add users modal

* user limit messaging on import users modal

* update licensing store to be more generic

* some styling updates

* remove console log

* Store tweaks

* Add startDate to Quota type

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>

* Lint

* Support custom lock options

* Reactivity fixes for add user modals

* Update ethereal email creds

* Add warn for getting invite from code error

* Extract disabling user import condition

* Handling unlimited users in modals logic and adding start date processing to store

* Lint

* Integration testing fixes (#10389)

* lint

---------

Co-authored-by: Mateus Badan de Pieri <mateuspieri@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Peter Clement <PClmnt@users.noreply.github.com>
2023-04-24 09:31:48 +01:00
mike12345567 c5e1457b25 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6900 2023-04-21 12:06:18 +01:00
Andrew Kingston aefb48e363 Fix options inclusion constraint regression 2023-04-20 20:10:30 +01:00
mike12345567 060dc05afa Removing export all apps functionality from cloud - this was a very niche feature and often confusing, now there is a consistent flow for starting out in self host. 2023-04-20 17:19:17 +01:00
Andrew Kingston 55ce83c444 Grid UI in data section (#10329)
* Add WIP spreadsheet

* Add footer and improve styles

* Refactor to use IDs and support changing text values inline

* Add inline editing of options fields

* Add row deletion and fix sizing

* Add ability to add new rows

* Fix z-index issue with option cells

* Remove deletion notification and fix selection

* Add gap between items in an options cell

* Tweak options cell to be pixel perfect

* Fix padding around sheet not working when scrolling

* Add resizable columns and add support for all themes

* Allow multiselect component and field to support text values

* Generate inclusion schema when importing multiselect columns

* Add support for multiselect type

* Add number cell

* Add functional date cell

* Disable editing autocolumns

* Make sticky column the primary display and fix opening options cells

* Improve display of relationship cell and options cell

* Support empty dates and use CSS variables for easier styling

* Use more CSS variables and add utils to spreadsheets

* Add drag and drop column reordering

* Break out reordering logic into new stores

* Rename reordering to reorder

* Break out other components from spreadsheet for cleaner code

* Break out spreadsheet body into its own component

* Split into more modular components and try virtual rendering

* Test absolute positioning

* Optimise virtual rendering for both columns and rows to handle infinitely large datasets

* Optimise scrolling and virtual rendering performance

* Fix columnn reordering

* Migrate sheet to data section, improve reordering and reszing

* Clean up more sheet state and increase performance

* Fix multiple issues with z-index, reordering and resizing

* Fix date cells in sheets

* Separate data fetching logic from main sheet and tidy up

* Add infinite scroll, improve row fetching, add error handling, fix svelte store updates

* Fix overly thin scrollbars in firefox

* Use nicer checkboxes and fix some hover styles

* Fix issue reordering columns in firefox and increase performance

* Tidy up

* Use search endpoint instead of get endpoint to fetch individual rows so that relationship enrichment occurs

* Tidy up

* Fix relationship issues when creating rows

* Optimise resetting data to smoothly transition when changing datasource

* Add WIP virtual dom implementation to massively increase performance

* Refactor spreadsheet into more discreet components

* Fix multiple issues, clean up rendering, improve performance

* Tune cell sizes

* Fix some scroll issues and add shadow to sticky column

* Fix issue when no primary display is set

* Add padding to sheet

* Improve styles

* Allow reordering columns to be the first column after sticky column

* Fix row hover state not being removed

* Update hovered row on wheel

* Update scroll styles and z-index

* Improve scroll logic and handle horizontal wheel events

* Simplify and improve z index styles

* Fix styles when using no sticky columns

* Improve rendering performance

* Improve performance by removing keyed each blocks and fix reorder target styling

* Ensure scroll top is always properly reset and add config store

* Allow configuring selecting rows and adding rows

* Integrate sheet into data section better

* Add back in functional delete row button

* Refactor stores and make state more modular

* Lint and remove unused deps

* Remove add column button

* Fix options cells being unable to scroll

* Add WIP initial multi-user websocket implementation for sheets

* Add WIP multi-user UI for sheet interface

* Fix issues with not disconnecting users when swapping datasource and improve multi-user UI

* Update layout and remove logging

* WIP column popovers for dataspace sheets

* Add popovers to sheet column headers, improve mouse UX

* Tidy reordering stuff

* Refactor resizing logic into store and improve UX around hover events when resizing/reordering

* Add column sorting and reordering via popover

* Handle context menu events in header cells

* Fully integrates sheets with datasection and remove lots of old stuff

* Fix buttons being highlighted when filters are set

* Add flags for controlling editing and adding rows in sheets

* Count context menu clicks when considering the click outside handler

* Prevent adding rows to users table and remove log

* Expose loading state of sheet and improve column highlighting logic

* Small style updates

* Update delete button and allow horizontal scrolling

* Add context menu to sheets with deletion and duplication features

* Improve UX around selecting rows and cells

* Add basic keyboard interactions to dataspaces

* Improve keyboard navigation in sheets

* Remove unnecessary searching through large rows array

* Fix issue with deleting rows and fix relationship cells displaying undefined

* Improve loading state

* Update menu width

* Merge with new shared-core and moved lucene utils

* Improve rendering performance and simplify component props

* Remove new row component and improve mouse interactions

* Tidy up buttons above sheets and add FAB for adding rows

* Optimise sheet data loading and add sort button

* Update sorting and remove logs

* Add sheet button to control column visibilty, improve sorting, improve disabled states

* Fix bug with select placeholders and fix sorting loops causing endless refreshes

* Update filter button to look consistent and add double click to resize columns to default width

* Ensure all derived stores have default values

* Reset scrolling when datasource changes and fix wasted pagination calls

* Improve performance by removing searches through the full row array

* Add advanced key handling for spreadsheets and improve blur and focus UX

* Ensure the selected cell is always visible

* Add icons for all data types

* Add new long form text cell

* Add boolean cell

* Add ability to focus first cell via tab

* Add cells for formulae and JSON

* Remove console logs

* Add attachment cell

* Increase padding to account for attachment dropdown

* Prevent deleting autocolumns via keyboard

* Fix attachments overflowing

* Improve sort button, remove header more icons unless hovered and highlight sorted column

* Add functional relationship cell

* Improve relationship cell

* Fix race conditions and edge cases in relationship cell

* Update user avatar colours

* Improve preservation of column widths in sheets when making schema changes

* Remove redundant sheet schema context and fix issues with mutating table schema

* Disable websocket in sheets

* Rollback state changes when row saving fails

* Fix one-to-many relationships allowing selecting multiple rows on both sides

* Remove log

* Make sheet gutter width customisable

* Allow expanding rows using existing edit row modal

* Fix text cell not using full width

* Sort columns to put autocolumns last

* Add new footer for adding rows, improve store memoization, support inverting all data types

* Improve animations for adding rows and handle add row failure

* Ensure all sheet feature flags work as expected and fix multi row deletion

* Fix options ordering

* Fix add row button not appearing when horizontal scrollbar is hidden

* Fix selecting newly created rows

* Remove log and add notification when creating or editing columns

* Move new row component to top, automatically invert cell renderers when required

* Add resizable rows

* Fix overlapping long form text borders

* Fix scroll not working in new row

* Update new row component, fix z-index issues, improve UX

* Large refactors to row creation, naming and sheet APIs

* Refactor stores to fix dependency issues, use modals for adding rows, simplify sheet

* Fix resize overlays

* Add custom colors for drop shadows and blue-100 to all themes, fix sticky column shadow

* Increase horizontal padding when scrolling to a selected cell

* Add multiple validation improvements

* Add validation to duplicating rows

* Remove log

* Restore missing event handler

* Improve data fetch reset logic, fix issues with stale cache in spreadsheets

* Fix issue with cell colors, improve row API interactions to avoid relationship issues due to API response differences

* Fix filters not working

* Simplify logic for reordering and add new overlay. Simplify sheet cells

* Fix importing and exporting with sheets

* Fix reorder overlay z-index issue

* Fix issue when no display column exists

* Fix issue with display column not being able to be unset

* Add persitence to column size and order in sheets

* Improve sheet integration with data section and add horizontal cell inversion

* Fix double click resizing of sticky column

* Make column visibility persistent and refactor column updating

* Improve sheet loading states

* Add beta button to sheet, tidy up constants

* Work around table API inconsistencies to handle table schema updates

* Add additional reorder options and improve beta button

* Improve sorting

* Add copy and paste to spreadsheet and add immediate editing of cells without additional click

* Remove copy/paste rows, remove move to start/end, improve copy/paste for cell values

* Fix dependency ordering

* Refactor other sheet stores to improve dependency ordering

* Fix errors not showing in sticky column and clear cell value on backspace press

* Rewrite relationship cell and update default column widths

* Ensure dynamic row height is properly accounted for

* Update text cells, number cells, long form field cells and relationship cells to respect row height

* Fix row heights with sticky column

* Update JSON, boolean and date cells to respect row height

* Update attachment cell to respect row height

* Use unique background for focused cell

* Standardise shadows across cell types

* Persist row height as table metadata

* Improve a few design issues

* Clean up

* Fix relationship cells not being readonly

* Lint

* Fix icon padding in relationship picker

* Improve styles in relationship dropdown

* Update shadow

* Update relationship icons

* Update relationship icons

* Update error label max size and position

* Prevent using invalid data types as display columns

* Add menu option to edit rows in modal

* Prevent sheet handling key events sourcing from modals

* Standardise menu overlay shadow and add count to relationship cells when hovering

* Improve relationship cell performance

* Remove spellcheck from text fields

* Fix resize overlay handler height

* Fix reorder overlay height

* Remove unused code and change selected table faster in data section

* Fix table selection not working when on datasource page

* Improve sheet loading state

* Add rowHeight property to table types

* Restore builder middleware

* Remove any naming of dataspaces

* Lint

* Disable row import button for users table and add optional chaining to spreadsheetsocket invocations to fix tests

* Use unique user edit modal for editing users in sheets

* Add schemaOverrides prop to sheet and use it to customise user table schema

* Update number icon

* Fix primary display column not properly disabling certain menu options

* Merge

* Update beta button position slightly

* Update beta button text

* Fix HMR for custom plugins which was broken due to signed minio links

* Add maze link to grid

* Update koa <> socket.io integation to improve fake koa context and allow current app middleware

* Rename sheet to grid

* Fix menu postiion, fix copy and paste in menu not working

* Remove commented out usages of websocket emissions for grid
2023-04-20 15:56:24 +01:00
Andrew Kingston 84da11a475 Remove commented out usages of websocket emissions for grid 2023-04-20 15:23:57 +01:00
mike12345567 46b1180cd2 Fixing test case. 2023-04-20 11:06:16 +01:00
Andrew Kingston c82451f888 Update koa <> socket.io integation to improve fake koa context and allow current app middleware 2023-04-20 08:02:49 +01:00
mike12345567 1aca5d6407 Fixing an issue with creating relationships between existing tables, not using the correct type for the primary key in the foreign key relationship. 2023-04-19 17:17:37 +01:00
mike12345567 401d64b074 Fixing issue with SQL tables and using formulas that contain relationships as display columns. Also cleaning up imports in ExternalRequests a bit. 2023-04-19 16:16:22 +01:00
mike12345567 67de033683 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-19 15:01:26 +01:00
Andrew Kingston 1aed6f89d5 Merge 2023-04-18 21:06:04 +01:00
Andrew Kingston 9b2b071b88 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-18 21:00:42 +01:00
Michael Drury 42c37eea46 Merge pull request #10276 from Budibase/labday/automation-plugins
Automation step plugins
2023-04-18 17:33:25 +01:00
Andrew Kingston 91ee5be7c5 Disable row import button for users table and add optional chaining to spreadsheetsocket invocations to fix tests 2023-04-18 11:31:19 +01:00
Andrew Kingston 083836a87b Remove any naming of dataspaces 2023-04-18 10:46:35 +01:00
Andrew Kingston f9ab2a239f Restore builder middleware 2023-04-18 10:41:00 +01:00
Andrew Kingston a4515e1162 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-18 08:29:27 +01:00
mike12345567 9a36377d6e Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-17 18:10:29 +01:00
Andrew Kingston 208e481bbc Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-17 17:00:56 +01:00
mike12345567 b4e6cbce7a Some final updates to get tests passing again, issue with publisher tenant ID being the 'unique' format which cannot actually be used. 2023-04-17 15:59:59 +01:00
mike12345567 b6f14a3f55 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-17 14:58:40 +01:00
mike12345567 453d5cc0e6 Further PR comments. 2023-04-17 14:03:54 +01:00
adrinr e5227febd8 Use version from environment 2023-04-17 14:02:50 +01:00
Michael Drury ef5bcc4b66 Main body of PR comments, switching event handling to be a publisher of async events, a generic event; then adding a new async document update processor, which can later be converted to be part of the event processing pipeline. 2023-04-15 00:37:22 +01:00
mike12345567 c552913737 Fixing defaults in MS-SQL as well. 2023-04-14 18:10:10 +01:00
Pedro Silva 3147eb2892 Merge branch 'develop' into qa-core-datasource-api-tests 2023-04-14 17:59:40 +01:00
mike12345567 09ccac12ae Fix for default values with NOT NULL requirements being intepreted as requiring values in the frontend, presence check is now ignored if a default or auto value is found. 2023-04-14 17:56:17 +01:00
mike12345567 361005b521 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-13 17:23:58 +01:00
mike12345567 f87974caf1 Removing duplicate test case. 2023-04-13 13:10:51 +01:00
mike12345567 8f8843aece Updating test cases based on new user sync and removing old endpoint testcases (endpoint removed). 2023-04-13 12:53:25 +01:00
mike12345567 7da330624f Fixing build (again). 2023-04-13 12:17:29 +01:00
mike12345567 727aba9177 Fixing build. 2023-04-13 11:19:28 +01:00
Pedro Silva 695f77fd1d Add types for datasources endpoints 2023-04-13 11:13:21 +01:00
mike12345567 b2d7f24ff3 Adding builder test case. 2023-04-12 20:02:37 +01:00
mike12345567 23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567 1129d19412 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 17:09:29 +01:00
mike12345567 cb73e3b1c3 Fixing build issue. 2023-04-12 16:22:30 +01:00
mike12345567 a9fb09424b Merge branch 'develop' of github.com:Budibase/budibase into labday/automation-plugins 2023-04-12 14:27:50 +01:00
melohagan 3a5e31710c Add db prop to redis integration (#10210)
* Add db prop to redis integration

* Add DB display

* Default DB value to 0
2023-04-12 13:51:40 +01:00
mike12345567 3eb718ea6d Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 13:42:46 +01:00
mike12345567 ada052e043 Merging in develop - fixing some test cases which broke in the process. 2023-04-12 10:56:21 +01:00
Andrew Kingston 0ee63417c1 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-11 17:36:28 +01:00
mike12345567 e623820478 Adding test cases. 2023-04-11 17:33:52 +01:00
mike12345567 1aafdbe9a7 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-11 17:28:14 +01:00
mike12345567 ac37d00f69 Updating plugins to have a SDK, which can be used for automation action retrieval as well as datasources. 2023-04-11 16:37:26 +01:00
adrinr 9a330b85f8 Fix timeouts 2023-04-11 14:20:15 +01:00
Michael Drury 1c7c06e983 Bulk of the automation plugin system, supporting custom plugins. 2023-04-10 23:48:54 +01:00
Michael Drury 4badd04e33 Some automation fixes and adding option to disable logging for CLI. 2023-04-10 22:33:53 +01:00
mike12345567 400a112a4b Refactoring automation steps to be better defined in Typescript, which allows writing the validator for automations. 2023-04-06 18:11:44 +01:00
Michael Drury 58d0a82108 First sync test, checking that a user is created correctly. 2023-04-05 22:35:01 +01:00
Michael Drury 0771ec55fb Small change to make sure no duplicates ever occur. 2023-04-05 21:22:50 +01:00
Michael Drury 70c9d06832 Adding group management to background user/group sync. 2023-04-05 20:51:47 +01:00
mike12345567 0803b08217 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-05 17:59:18 +01:00
Rory Powell 77ffb8d86d Run integration suite in CI again / auto detect tenancy / refactors (#10209)
* qa-core-ci-fixes

* global setup and teardown wip

* Updates to logs and setup

* Remove date and console mocking

* Update CI to spin up minimal dev env

* Update readme

* Fix scopeBackend.sh

* Ensure docker services are initialised before starting worker

* Lint

* Fix admin user being created on startup (#10219)

* use regular bootstrap and build

* Lint

* Temp: re-use global setup to get around app limit in QA
2023-04-05 15:33:56 +01:00
adrinr 38535e8ef4 Format 2023-04-05 12:17:32 +01:00
adrinr ae9f91885f Fix flaky tests 2023-04-05 12:17:02 +01:00
mike12345567 e699f4684a Updating the global user sync to be more accurate and also remove old user metadata from apps that users don't have access to anymore. 2023-04-04 18:03:56 +01:00
Rory Powell 976b3a55ca Update logging to support dd trace attributes (#10086)
* Update logging middleware to integrate with pino for console logging

* Remove elastic apm references, use updated core middlewares

* Remove redundant LOG_LEVEL definitions

* Remove no longer needed jest logging overrides

* lint

* Backwards compat between console log helpers and pino

* Configurable DISABLE_HTTP_LOGGING

* Don't log 4xx as errors

* Remove redundant ENABLE_4XX_HTTP_LOGGING

* Cleanup migrations and event logging

* Improve bb-alert logging

* Add DISABLE_HTTP_LOGGING to helm chart

* Add ops endpoints for testing

* Disable http logging in dev

* Backwards compatible tracing implementation

* Naming update on http logging env var

* lint

* Update packages/backend-core/src/environment.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Merge

* Lint

* Fix console.warn failing mock by replacing with alerts mock instead

* Lint

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-04-04 15:08:46 +01:00
Michael Drury ff98ba5a0a Adding a document update queue based on the events which can be used to track when certain documents have changed, using this for users and groups to detect when a re-sync is needed. 2023-04-04 00:25:15 +01:00
mike12345567 29def1408a Fixing syntax error and linting. 2023-04-03 15:36:34 +01:00
Michael Drury 2f57b3b16d Merge pull request #10077 from robert4dt/develop
Handle application/pdf content type in rest integration
2023-04-03 15:30:03 +01:00
Peter Clement f2eced6ea4 Merge pull request #10180 from Budibase/fix/no-iterations-loop
Add new status to handle no iterations during loop
2023-04-03 12:00:15 +01:00
Michael Drury d3e749d2de Fix for 409 conflict which occurs in one of the user test cases - should stop it occurring in future. 2023-03-31 23:32:33 +01:00
Michael Drury 09a48a1d21 Merge branch 'develop' of github.com:Budibase/budibase into fix/no-iterations-loop 2023-03-31 23:29:21 +01:00
mike12345567 2e80bab7ad Removing requirement for built client library in component test case. 2023-03-31 17:13:25 +01:00
mike12345567 906d614c64 Merge branch 'merge-master-develop' of github.com:Budibase/budibase into merge-master-develop 2023-03-31 13:51:20 +01:00
Adria Navarro 7d794f005e Merge pull request #10162 from Budibase/bug/budi-6782-internal-table-all-row-ids-for
Bug - BUDI-6782 - Internal table all row ids for
2023-03-31 14:21:15 +02:00
Michael Drury 1c6465edcb Merge pull request #10172 from Budibase/fix/budi-6797
Googlesheets onboarding - fix in cloud, disable self host
2023-03-31 13:19:29 +01:00
Rory Powell e9322be28f Merge branch 'develop' into merge-master-develop 2023-03-31 12:39:22 +01:00
adrinr e8e77cc140 Use esbuild for server 2023-03-31 12:32:41 +01:00
Rory Powell 44aa19a99a Merge branch 'master' into merge-master-develop 2023-03-31 12:26:04 +01:00
Peter Clement 0a567a3302 add new status to handle no iterations during loop 2023-03-31 12:23:10 +01:00
Adria Navarro cfb93063b2 Merge pull request #10153 from Budibase/budi-6803-delete-users-when-group-removed
BUDI-6803 - Remove users that should not be there anymore when syncGlobalUsers
2023-03-31 13:15:11 +02:00
Andrew Kingston b2d2cf3989 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-03-31 12:08:58 +01:00
adrinr 4ca6982d27 Prevent double deletions 2023-03-31 11:25:51 +01:00
Rory Powell 79bec7d86d Add force exit, -e flag and streaming to tests (#10151)
* Add force exit, -e flag and streaming to tests

* Temp remove script usage from worker tests

* Revert "Temp remove script usage from worker tests"

This reverts commit 5e0ed2e92d.

* Always fail test

* Ignore server test package from coverage report

* Unscope server only

* Run all server tests again

* Update backend core test script to fail when any command fails and force exit

* Don't try to require client in test

* Port memory limit fix from develop

* Remove always failing test and commented out block for client require

* Fixing some issues with test cases.

* Revert assertions in internalSearch.spec.js

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-31 10:32:13 +01:00
adrinr 6a257bf9c3 Tweak tests 2023-03-31 09:01:40 +01:00
adrinr 48b964378b Remove all app cookie references (not really needed anymore) 2023-03-31 09:01:40 +01:00
mike12345567 42320b1d95 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6797 2023-03-30 17:29:58 +01:00
mike12345567 b19df9da22 Some final updates to get event spyOn working again. 2023-03-30 17:15:49 +01:00
adrinr 8e8f4ac02d Add extra assertion 2023-03-30 15:16:45 +01:00
adrinr 2dd8b078e5 Test removing users from group 2023-03-30 15:14:16 +01:00
adrinr b8fe9671b1 Rename test 2023-03-30 15:12:40 +01:00
Dean 3cba6109f6 First for meta card title override behaviour 2023-03-30 13:08:40 +01:00
Martin McKeaveney 586a31e4b9 Merge pull request #10141 from Budibase/fix/sample-data-auto-ids
fix auto columns in sample data
2023-03-30 12:25:54 +01:00
adrinr 8d45e44e2f Fix types 2023-03-30 11:30:35 +01:00
adrinr eb0d445295 Add test for autoid when importing 2023-03-30 10:37:38 +01:00
adrinr 6c610a3181 Types (with forced checks!) 2023-03-30 10:21:50 +01:00
adrinr 420cfd0f96 Fix autoids when importing internal data 2023-03-30 10:12:50 +01:00
mike12345567 32c78ec9bf This makes it so that Googlesheets works correctly as part of onboarding in the Cloud, in self host the googlesheets onboarding option has been hidden as it is too complex to get the user to setup the correct integrations with their google account while doing the first time onboarding to an app. 2023-03-29 19:58:24 +01:00
adrinr 301ad598ad Test user group deletion 2023-03-29 17:05:32 +01:00
adrinr efff31e181 Test user groups 2023-03-29 17:02:56 +01:00
adrinr 4cb6b99982 Types 2023-03-29 16:42:55 +01:00
adrinr 8783f0123d Add tests for admins vs app users 2023-03-29 16:42:31 +01:00
adrinr b368c14308 Add unit tests to test new users 2023-03-29 16:18:32 +01:00
adrinr e25429632b Remove users that should not be there anymore when syncGlobalUsers 2023-03-29 15:35:55 +01:00
mike12345567 7a18d19aa6 Merge branch 'master' of github.com:Budibase/budibase into merge-master-develop 2023-03-29 12:41:06 +01:00
mike12345567 e5ba70e7b4 Removing validation endpoint for external tables, always valid. 2023-03-29 12:16:14 +01:00
mike12345567 e10943e6f8 Removing external table validation - will have to come up with a best way to do this and a test suite for it. 2023-03-29 12:13:23 +01:00
mike12345567 25fd16f753 Revert "Revert "Merge pull request #10038 from Budibase/fix/budi-6723" (#10143)"
This reverts commit 89d19a87a7.
2023-03-29 12:12:38 +01:00
Rory Powell d6992bbf94 Merge branch 'master' into merge-master-develop 2023-03-29 11:52:09 +01:00
Rory Powell 89d19a87a7 Revert "Merge pull request #10038 from Budibase/fix/budi-6723" (#10143)
This reverts commit b1b18bef18, reversing
changes made to e841ccd0ed.
2023-03-29 08:48:06 +01:00
Andrew Kingston e0e5ca7a3c Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-03-28 15:47:53 +01:00
Martin McKeaveney fa30769ddb fix auto columns in sample data 2023-03-28 14:58:22 +01:00
melohagan 9e8ab55e18 Lowercase values for Oracle LIKE (#10134) 2023-03-28 11:46:29 +01:00
Dean 8557c307dd Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-28 11:19:08 +01:00
Rory Powell cd3b2ba199 Lint 2023-03-27 22:39:35 +01:00
Rory Powell 60650b031b Move branding read behind pro 2023-03-27 22:28:25 +01:00
mike12345567 2e0e5a0aa8 Merge branch 'fix/budi-6657' of github.com:Budibase/budibase into fix/budi-6657 2023-03-27 19:39:08 +01:00
mike12345567 cf5316ec8d General fixes for open handles, attempting to find and close all issues in server which are stopping shutdown of Jest suite. 2023-03-27 19:38:49 +01:00
Michael Drury 669c4ebd5c Fix for currentapp build issue. 2023-03-22 17:46:37 +00:00
mike12345567 926ee18703 Updating Jest to latest 29.5.0 and then fixing snapshots to work with this - also setting worker memory limits for Node 16.10+ - where a leak can occur. 2023-03-21 19:52:06 +00:00
mike12345567 82286d519f Fixing some issues with test cases. 2023-03-21 17:27:31 +00:00
mike12345567 1c73b92595 Fix for app sync, base it on group roles, not just user roles - stops app sync from pulling in group users which do not actually have access to the app. 2023-03-21 13:55:28 +00:00
Dean bfd7e49c72 Template fixes and updates to the file picker. Error handling added to display a warning when navigating to an unpublished or invalid app url. 2023-03-21 09:20:43 +00:00
Michael Drury 34e8009f08 Merge pull request #9949 from Budibase/fix/blacklist
Blacklisting
2023-03-20 10:33:11 +00:00
T4DT GmbH 9a4ab17c53 Update rest.ts 2023-03-20 11:31:45 +01:00
Dean ce33afdeae Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-16 09:07:58 +00:00
Dean 253ee413a2 Working commit 2023-03-16 09:07:21 +00:00
Rory Powell de89b9112a Simplify errors framework (#10042)
* Simplify errors framework

* Use enum for ErrorCode

* Lint

* Update base BudibaseError type to use enum

* For for public error on UsageLimitError

* Build fix

* Build fix
2023-03-16 08:42:02 +00:00
mike12345567 6174b6ae18 Squashing #10024 for master merge. 2023-03-15 14:16:45 +00:00
Dean c7e54947a8 Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 10:28:08 +00:00
Dean f3b58923cf Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 09:13:36 +00:00
mike12345567 79f2e9d970 Fixing build issue. 2023-03-14 17:04:25 +00:00
mike12345567 859ec85fe9 Fix for schema endpoint, needed secrets removed as well. 2023-03-14 16:13:28 +00:00
mike12345567 f2484eafec Fix for spaces in table names (external). 2023-03-14 16:13:14 +00:00
Peter Clement cc4a911505 Merge pull request #9984 from Budibase/fix/automation-saving-fix
Fix issue with saving of automation fields
2023-03-14 14:39:24 +00:00
mike12345567 c2de0ade7d Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6723 2023-03-14 14:25:46 +00:00
mike12345567 63cf91218d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-03-14 14:12:32 +00:00
mike12345567 da9e1bed64 Fix for googlesheets issue - when table initially created doesn't have the correct schema, adding a function to handle static schemas like Gsheets. 2023-03-14 12:11:01 +00:00
melohagan 878bc65eb2 Add missing readable flag (#10016) 2023-03-14 10:06:01 +00:00
mike12345567 3d84409a58 Making sure created flag gets carried across for external tables. 2023-03-13 18:18:04 +00:00
mike12345567 65ada7f8b2 Adding back a base column for sheet creation. 2023-03-13 18:10:35 +00:00
mike12345567 2a1f215351 Removing relationship option from Googlesheets as it doesn't add value, as well as multi-select as it can't really be supported. Also fixing issues with re-fetching after adding some special column types./ 2023-03-13 18:04:29 +00:00
mike12345567 d3464ce166 Adding mechanism for bulk creation of rows in gsheets, used for CSV imports. 2023-03-13 17:21:04 +00:00
mike12345567 6b8d0ca9dd Adding mechanism for verifying the Budibase properties, such as required and min/max as part of the external API. 2023-03-13 16:21:22 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
Dean 5ce52cad06 Working commit 2023-03-13 12:33:16 +00:00
Andrew Kingston 909118d398 Merge branch 'develop' of github.com:Budibase/budibase into just-dataspace-things 2023-03-13 11:30:18 +00:00
mike12345567 9037ab86d5 Adding an error for XLSX type sheets not working, adding the sheets URL as an option for google config (should be added to redirect URL) and fixing some error states. 2023-03-10 18:46:48 +00:00
Michael Drury c553f053fe Merge pull request #9965 from Budibase/budi-6667-change-oracle-db-name-to-service-name
Change Database to Service Name in Oracle config
2023-03-10 16:38:06 +00:00
mike12345567 ddaafe6379 Merge branch 'master' of github.com:Budibase/budibase into fix/9886 2023-03-10 14:49:41 +00:00
Peter Clement bd7c91b1bd Fix automation saving issue 2023-03-10 14:47:26 +00:00
Michael Drury 5eabe9db22 Merge pull request #9779 from Budibase/jonny/api-metrics
metrics api endpoint
2023-03-10 12:12:51 +00:00
Andrew Kingston c4e3667b6c Merge branch 'develop' of github.com:Budibase/budibase into just-dataspace-things 2023-03-09 17:54:58 +00:00
Rory Powell c33ea4dcfe Update deployment templates to remove unused cdn url and fix empty env vars (#9967) 2023-03-09 16:13:26 +00:00
Mel O'Hagan ad7bda17bb Change database to Service Name in oracle 2023-03-09 15:52:16 +00:00
Adria Navarro 63afd34eb2 Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 12:25:12 +00:00
Adria Navarro 158703daef Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 08:50:26 +00:00
mike12345567 564c724be1 Provides the option for blacklisting IPs. 2023-03-08 16:30:26 +00:00
melohagan a8f873fff3 Try/catch automation Create Row relationship (#9924)
* Try/catch

* Increase height of automation test output

* Unit tests

* lint
2023-03-08 13:39:18 +00:00
Peter Clement 1abab9421e Merge pull request #9915 from Budibase/fix/9441-group-roles
fix roleId being undefined leading to group role overriding incorrectly
2023-03-07 16:01:53 +00:00
mike12345567 0342d409c3 Fix for #9790 - formulas never exist in the database and so were always being considered deleted, handling this. 2023-03-07 15:29:58 +00:00
Peter Clement 1cb03c7603 fix roleId being undefined leading to groups override 2023-03-07 13:30:24 +00:00
mike12345567 0026f86cc6 Fixing operation ID. 2023-03-06 17:41:24 +00:00
mike12345567 36683459b8 Updating metrics endpoint to have examples of expected data format - show OpenMetrics response. 2023-03-06 15:55:55 +00:00
mike12345567 13ae950101 Updating test case. 2023-03-06 15:31:27 +00:00
mike12345567 c51b9fb4b3 Merge branch 'develop' of github.com:Budibase/budibase into jonny/api-metrics 2023-03-06 15:23:35 +00:00
Andrew Kingston b93f575bca Add popovers to sheet column headers, improve mouse UX 2023-03-06 15:09:42 +00:00
Jonny McCullagh cbc377b0f4 unit tests 2023-03-06 11:51:49 +00:00
Andrew Kingston 4647e1bc07 Fix issues with not disconnecting users when swapping datasource and improve multi-user UI 2023-03-06 11:20:47 +00:00
Martin McKeaveney 26660b12fb PR comments 2023-03-06 10:33:49 +00:00
Martin McKeaveney edac525424 remove import 2023-03-06 10:24:45 +00:00
Martin McKeaveney e8c73cdee0 return gsheets config in test regardless 2023-03-06 10:22:32 +00:00
Andrew Kingston 3e907af8b5 Add WIP multi-user UI for sheet interface 2023-03-06 07:43:45 +00:00
Andrew Kingston 36c953443f Add WIP initial multi-user websocket implementation for sheets 2023-03-05 18:57:05 +00:00
mike12345567 5b150e7748 Removing migration change and fixing #9738 - making sure that exports with excludeRows enabled don't include attachments. 2023-03-01 19:43:40 +00:00
mike12345567 eba18a4159 Fix for #9739 - there was an issue with the mango syntax, when working with multi attachment columns it was using an AND comparator instead of OR, it should be searching for rows that contain any attachment column, not all attachment columns. 2023-03-01 19:01:13 +00:00
Michael Drury 4abb2801f0 Merge pull request #9828 from Budibase/fix/9778
Fix for operationId in OpenAPI specs
2023-03-01 13:09:16 +00:00
mike12345567 cb39053b12 Fix for #9778 - there was an issue with operationId in the OpenAPI spec, these need to be unique to be compliant with the spec as brought up in the issue. Also re-writing the spec generation to Typescript to be compliant with how backend code is now written. 2023-02-28 18:10:56 +00:00
Andrew Kingston a28148d9f8 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-abs 2023-02-28 13:59:37 +00:00
Michael Drury fcb9f3e116 Merge pull request #9815 from Budibase/bug/budi-6076-cannot-delete-columns-in-google-sheet
Bug - budi-6076 cannot delete columns in google sheet
2023-02-28 13:56:32 +00:00
Rory Powell 312c01a879 Prefer default config for google sheets in cloud, don't use env vars for regular auth 2023-02-28 10:36:29 +00:00
adrinr b05d568518 Merge remote-tracking branch 'origin/develop' into bug/budi-6076-cannot-delete-columns-in-google-sheet 2023-02-27 17:45:37 +01:00
adrinr f017f0d54e Catch issue on test 2023-02-27 17:41:42 +01:00
adrinr f85ea527bd Add tests for adding/removing columns in a google spreadsheet 2023-02-27 17:25:48 +01:00
adrinr abe06a127a Types 2023-02-27 17:25:26 +01:00
mike12345567 2fb33e2cf3 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-27 14:51:33 +00:00
Rory Powell 2e829ce8a6 Merge pull request #9785 from Budibase/configs-refactor-and-server-test-fixes
Configs /  Server tests / Failing real email tests updates
2023-02-27 14:00:21 +00:00
adrinr 30fde61d4d Handle deletes 2023-02-27 13:33:19 +01:00
mike12345567 65646ba01b Further PR comments. 2023-02-27 11:00:13 +00:00
mike12345567 8853776c79 Moving around processors to separate audit logs out of central event handling. 2023-02-24 13:52:54 +00:00
mike12345567 58fab29fb4 Main body of PR comments. 2023-02-24 13:32:45 +00:00
mike12345567 f070be5f65 Moving search index to an enum. 2023-02-24 13:15:14 +00:00
mike12345567 42fc004212 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-24 12:46:58 +00:00
adrinr d5fd635d6c Remove @ts-ignore 2023-02-24 11:26:05 +01:00
adrinr 045822d65e Dry 2023-02-24 11:24:29 +01:00
adrinr 2fc97189e5 Merge remote-tracking branch 'origin/develop' into bug/budi-6619/cannot_update_relationships_in_postgresql_many_to_one 2023-02-24 11:12:07 +01:00
adrinr d6363f07b3 Renamings 2023-02-24 10:51:55 +01:00
adrinr 2e45f94d79 Improve verbosity 2023-02-24 10:47:32 +01:00
Andrew Kingston b8e7e0b701 Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-spreadsheet 2023-02-23 16:41:08 +00:00
Andrew Kingston 8cd7ba1fdf Undo/Redo for Design and Automate sections + automations refactor (#9714)
* Add full undo/redo support for screens

* Add loading states to disable spamming undo/redo

* Add keyboard shortcuts for undo and redo

* Fix modals not closing in design section when escape is pressed

* Remove log

* Add smart metadata saving to undo/redo

* Add error handling to undo/redo

* Add active state to hoverable icons

* Fix screen deletion

* Always attempt to get latest doc version before deleting in case rev has changed

* Move undo listener top level, hide controls when on certain tabs, and improve selection state

* Add tooltips to undo/redo control

* Update automation section nav to match other sections

* Fix automation list padding

* Fix some styles in create automation modal

* Improve automation section styles and add undo/redo

* Update styles in add action modal

* Fix button size when creating admin user

* Fix styles in add automation step modal

* Fix issue selecting disabled automation steps

* Reset automation history store when changing app

* Reduce spammy unnecessary API calls when editing cron trigger

* WIP automation refactor

* Rewrite most automation state

* Rewrite most of the rest of automation state

* Finish refactor of automation state

* Fix selection state when selecting new doc after history recreates it

* Prune nullish or empty block inputs from automations and avoid sending API requests when no changes have been made

* Fix animation issues with automations

* Sort automations and refetch list when adding or deleting

* Fix formatting

* Add back in ability to swap between values and bindings for block inputs

* Lint

* Format

* Fix potential issue in design section when selected screen is unset

* Fix automation arrow directions everywhere, tidy up logic and fix crash when using invalid looping

* Lint

* Fix more cases of automation errors

* Fix implicity any TS error

* Respect _id specified when creating automations

* Fix crash in history store when reverting a change on a doc whose ID has changed

* Lint

* Ensure cloneDeep helper doesn't crash when a nullish value is passed in

* Remove deprecated frontend automation test

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-02-23 13:55:18 +00:00
Rory Powell 4e1bebe897 Server flaky tests fixes - improving tenancy config 2023-02-23 13:43:27 +00:00
Rory Powell d3a7286711 Configs updates: remove circular deps, dedicated module, typing improvements, reduce db reads 2023-02-23 13:41:35 +00:00
adrinr 5207f51080 Test enrich for all relationship types 2023-02-23 10:50:18 +01:00
adrinr 7868fc657d Fix many-to-one tests 2023-02-23 10:39:16 +01:00
adrinr 9e0d003038 Fix creation 2023-02-23 10:28:24 +01:00
adrinr 70689c0369 Fix tests 2023-02-23 00:06:57 +01:00
adrinr 83649f1959 Setup o2m and m2m relationships 2023-02-22 22:40:50 +01:00
Jonny McCullagh dde1237ed2 allUsers function & more metrics 2023-02-22 21:10:35 +00:00
adrinr f00994af7f Fix wrong relationship mapping 2023-02-22 17:18:05 +01:00
adrinr 8c906c1681 Merge remote-tracking branch 'origin/develop' into bug/budi-6619/cannot_update_relationships_in_postgresql_many_to_one 2023-02-22 15:00:41 +01:00
adrinr 63af59a5b0 Handle link fields 2023-02-22 14:59:42 +01:00
Rory Powell 4b85583f5f Update builder and authorized middleware to be more strict towards unauthenticated (#9774)
* Update builder and authorized middleware to be more strict towards unauthenticated

* Remove unnecessary variable
2023-02-22 13:39:31 +00:00
adrinr e350f6b166 Undo literal changes 2023-02-22 11:02:32 +00:00
adrinr b9c54b6fe6 Update many to many 2023-02-22 10:54:55 +00:00
mike12345567 22f42ef898 Adding new mechanism to get the ipAddress and userAgent of call for audit logs. 2023-02-21 19:14:57 +00:00
mike12345567 ef30c03fa6 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-21 17:26:24 +00:00
mike12345567 41eb0c3964 Updating worker db config to have replication available (for audit logs). 2023-02-21 17:22:23 +00:00
Rory Powell 940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
mike12345567 f7f9e63fe8 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-21 16:53:28 +00:00
adrinr e0242d0883 Fix the many to one updates 2023-02-21 16:29:18 +00:00
adrinr be81767a46 Replace maps for foreach 2023-02-21 15:57:56 +00:00
adrinr e0b3976ee4 Add return select statement back on update 2023-02-21 15:57:04 +00:00
adrinr 1ada790d50 Fix postgres update for relationships 2023-02-21 15:21:00 +00:00
adrinr ea8e779d10 Merge remote-tracking branch 'origin/develop' into test/fix_foreigndata_pg_test 2023-02-21 11:37:16 +00:00
adrinr 483f15a5d6 Add explicit check for the foreign field 2023-02-21 09:51:07 +00:00
adrinr 3c5d5f4c25 Fix relation get test to test expected behaviour 2023-02-21 09:42:56 +00:00
Rory Powell cacf275a99 Prevent SSO users from setting / resetting a password (#9672)
* Prevent SSO users from setting / resetting a password

* Add support for ENABLE_SSO_MAINTENANCE_MODE

* Add typing to self api and build out user update sdk

* Integrate sso checks with user sdk. Integrate user sdk with self api

* Test fixes

* Move self update into SDK

* Lock down maintenance mode to admin user

* Fix typo

* Add health status response and return type signature to accounts.getStatus

* Remove some unnecessary comments

* Make sso save user function non optional

* Remove redundant check on sso auth details provider

* Update syncProfilePicture function name to getProfilePictureUrl

* Update packages/worker/src/sdk/users/events.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Add ENABLE_EMAIL_TEST_MODE flag

* Fix for logging in as sso user when existing user has password already

* Hide password update and force reset from ui for sso users

* Always disable sso maintenance mode in cloud

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-02-21 08:23:53 +00:00
Jonny McCullagh a908125ea3 add metrics endpoint to api 2023-02-20 19:56:04 +00:00
Andrew Kingston 654c348e4e Generate inclusion schema when importing multiselect columns 2023-02-20 18:46:06 +00:00
mike12345567 1eb2307fed Fix for #9749 - static formulas would sometimes attempt to update the same row multiple times, filter down to just the unique row list which requires updating. 2023-02-20 15:35:14 +00:00
mike12345567 b60013cbb8 switching metadataSearch to fullSearch. 2023-02-20 11:29:43 +00:00
Rory Powell a57f0c9dea Merge branch 'develop' into rory/february 2023-02-20 09:57:17 +00:00
mike12345567 6ec5e97ce9 Required work to support the new lucene audit logs search indexing. 2023-02-17 16:26:55 +00:00
melohagan 8fe0cdf89f Handle webhook errors (#9715) 2023-02-16 16:23:44 +00:00
mike12345567 6d83ea9bec Adding in event auditing to server/worker. 2023-02-15 18:03:55 +00:00
Jonny McCullagh c5bc0d4ffb add datadog apm (#9693)
* add datadog apm

* datadog init not start

* extra env vars for DD APM

* add datadog apm

* datadog init not start

* extra env vars for DD APM

* add datadog apm

* remove space

* Enable typescript integration with apm agents

* Fix typo

---------

Co-authored-by: Jonny <Jonny McCullagh>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-02-15 16:28:20 +00:00
Rory Powell bb1faac62a Merge master into develop 2023-02-15 15:10:02 +00:00
mike12345567 1ed4f4b8fe Update on audit logs, getting the full write flow from events configured. 2023-02-15 12:37:32 +00:00
mike12345567 6977502d01 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-15 11:29:04 +00:00
melohagan fb74956c93 Date filter freeze fix (#9635)
* Filter with enrichedSchemaFields

* Handle empty object values in date range
2023-02-15 09:27:44 +00:00
mike12345567 3f7f66257d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-14 17:57:23 +00:00
mike12345567 015f95aa6d Quick fix to add the ability to update the app-service HTTP MB max limits. 2023-02-14 16:40:57 +00:00
mike12345567 05ceee1cfe Moving lucene handling to backend-core so that it can be used for other databases (outside row indexes). 2023-02-13 17:13:59 +00:00
Rory Powell cc7eb64a3b Rename LOG_4XX to ENABLE_4XX_HTTP_LOGGING and enable by default 2023-02-13 14:39:24 +00:00
Rory Powell 0e3a17ab18 Merge pull request #9669 from Budibase/budi-6558-configurable-test-log-levels-and-common
Configurable test log levels and common error handling
2023-02-13 14:31:43 +00:00
Rory Powell ae9979929a Enable higher concurrency and resiliency in worker tests 2023-02-13 11:57:30 +00:00
Rory Powell 5cd6cb166a Configurable test log levels and common error handling 2023-02-13 11:53:01 +00:00
mike12345567 7def2059f7 Updating test case which has been occasionally throwing 409 issues. 2023-02-10 18:29:29 +00:00
mike12345567 0c80ea2083 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-10 17:42:56 +00:00
mike12345567 3859a4159f Minor fix for automations, the wrong function had the environment variables being added to environment, this is very minor, it simply makes sure that environment variables are in context for the whole of the automation runner - e.g. if utilising many datasources each of them doesn't need to re-retrieve the environment variables, instead they will be available based on the env vars retrieved at the start of the execution. 2023-02-10 14:14:43 +00:00
mike12345567 4acfae6af6 Updating so that datasources always have correct types after environment variable enrichment. 2023-02-10 12:47:23 +00:00
mike12345567 f8ef06c849 Fix issue with MS-SQL, port needs to be a number for the node-mssql package, with env vars it isn't anymore. 2023-02-10 11:54:16 +00:00
Andrew Kingston cadadca048 Generate option inclusion constraint (#9647)
* Fix options inclusion constrant not being generated when creating a table from file upload

* Fix 0 being treated as null when specifying min and max constraints for number fields

* Sort newly generated option field inclusion constraints

* Revert previous solution and fix problem by removing incorrect local assignment statement
2023-02-10 11:00:20 +00:00
melohagan e33aaff312 Replace ts-ignore with 400 if needed (#9621) 2023-02-09 11:46:41 +00:00
Rory Powell c05b063f10 Bump CI default unit test timeout to 10s 2023-02-09 09:19:31 +00:00
mike12345567 0d21801ece Fix based on testing. 2023-02-08 19:44:17 +00:00
mike12345567 68912f8030 Minor fix for the plugin datasource error that occurred when opening apps in an environment where the datasource no longer exists. 2023-02-08 19:17:15 +00:00
mike12345567 ced811fc23 Another quick fix. 2023-02-07 18:35:22 +00:00
mike12345567 1a52bd8a50 Fixes based on test runs. 2023-02-07 18:11:33 +00:00
Mateus Badan de Pieri 89bad2d45a Merge branch 'develop' into tests/environment-variables 2023-02-07 16:15:57 +00:00
Mateus Badan de Pieri 7c702cd0ac update tests
remove comments
2023-02-07 15:47:11 +00:00
Michael Drury a353848152 Merge pull request #9368 from Budibase/test/9339-sqlpostgres-row-api-test-suite
Test - #9339 sqlpostgres row api test suite
2023-02-07 15:38:09 +00:00
adrinr 452147c308 Cleanup tests 2023-02-07 12:45:41 +00:00
adrinr 2cdc2f3fec Fix select statement when no resource 2023-02-07 12:29:58 +00:00
adrinr 3d917bfe22 Fix conflicting columns issue 2023-02-07 12:25:02 +00:00
adrinr bc0208bc83 Clean describes 2023-02-07 11:27:46 +00:00
mike12345567 ee05ea959a Adding longer timeout. 2023-02-07 10:50:11 +00:00
adrinr 79e42abc1e Tidy tests 2023-02-07 10:46:34 +00:00
mike12345567 173f62f8f3 Test fix. 2023-02-07 10:16:40 +00:00
adrinr 7474099bac Fix pg test 2023-02-07 10:12:42 +00:00
mike12345567 464ab7a1bb Merge branch 'develop' of github.com:Budibase/budibase into fix/cli-memory-issues 2023-02-07 09:56:49 +00:00
Adria Navarro afa282ecbf Fix sql when no resource 2023-02-06 20:47:49 +00:00
Adria Navarro 015a91c183 Increase timeout 2023-02-06 20:12:08 +00:00
Adria Navarro 71199c06ec Stop container after tests 2023-02-06 19:49:30 +00:00
Adria Navarro 4908cc5387 Spin up postgres only on the postgres test 2023-02-06 19:43:08 +00:00
mike12345567 9339213910 Merge. 2023-02-06 18:00:42 +00:00
mike12345567 4d86df057b Some fixes for #8770 - the CLI was very memory intensive when working with large databases, that contained many revisions. We don't need the revisions for app exports/backups, therefore I've updated our export systems to drop the revision history as it compacts the database significantly and speeds up exports/reduces memory usage. 2023-02-06 17:54:40 +00:00
adrinr c87efb7866 Don't return foreign keys on updates and deletes 2023-02-06 17:37:00 +00:00
adrinr 29503d1244 Fix tests 2023-02-06 17:30:33 +00:00
adrinr 3d9a208bfb Fix tests 2023-02-06 14:54:49 +00:00
adrinr 9bb1a2fa18 Merge remote-tracking branch 'origin/develop' into test/9339-sqlpostgres-row-api-test-suite 2023-02-06 09:12:13 +00:00
Adria Navarro 5ee9073d9b Merge pull request #9419 from Budibase/feature/dependencies-image
Chore - use testcontainers
2023-02-06 09:09:07 +00:00
Martin McKeaveney 8b133b97fb fix build 2023-02-05 23:12:08 +00:00
Martin McKeaveney d4a0e44b31 merge 2023-02-05 22:11:37 +00:00
Adria Navarro 774b50232c Increase timeouts 2023-02-05 10:34:42 +00:00
Adria Navarro 2f2c8a50cc Flaky test 2023-02-05 10:33:21 +00:00
Adria Navarro 0a47b35285 Flaky test 2023-02-05 10:00:27 +00:00
Adria Navarro 4522d6c906 Fix flaky test 2023-02-05 09:04:47 +00:00
Adria Navarro 9703564283 Add onClose back in tests 2023-02-04 20:30:12 +00:00
Adria Navarro c78038f059 Dont close server on tests 2023-02-04 18:51:10 +00:00
mike12345567 3b43943f1f Some quick scripts for loading a lot of rows and apps. 2023-02-03 19:29:28 +00:00
adrinr 11a7742d90 Cleanup 2023-02-03 19:23:36 +00:00
adrinr 420cb36ca7 Replace beforeeach for before alls 2023-02-03 19:02:40 +00:00
adrinr fe8853580e Tweak tests 2023-02-03 18:40:25 +00:00