Commit Graph

5583 Commits

Author SHA1 Message Date
Adria Navarro dd58aaf5cb Use fancycheckboxgroup 2023-06-07 11:44:32 +01:00
Adria Navarro bb901d94d2 Clean code 2023-06-07 11:32:42 +01:00
Adria Navarro 5135ac36b7 Fix fetching tables 2023-06-07 11:31:10 +01:00
Adria Navarro 95c66edb65 Clean code 2023-06-07 11:31:10 +01:00
Adria Navarro c47656d423 Save datasource 2023-06-07 11:31:10 +01:00
Adria Navarro deeba8bae3 Revert "Merge branch 'develop' into master"
This reverts commit 6f29c978e0, reversing
changes made to 1c6ff73c19.
2023-06-06 22:06:34 +01:00
mike12345567 dab1db2271 Updating datasource save API to allow specifying a filter for which tables to fetch and then linking this up with the new frontend. 2023-06-06 18:27:03 +01:00
mike12345567 cc60baa3d1 Some fixes for BBUI and updating postgres table name fetching to get uniques. 2023-06-06 17:40:14 +01:00
Adria Navarro 1f428bd5c2 Fix test 2023-06-06 12:17:56 +01:00
Rory Powell ad7f6cf5e2 Merge branch 'develop' into merge-master 2023-06-06 11:49:49 +01:00
Adria Navarro 21e870109c Save datasource 2023-06-06 11:29:50 +01:00
Adria Navarro 25c921e340 Validate url 2023-06-06 11:29:49 +01:00
Adria Navarro 1e238ce693 Validate google sheets url 2023-06-06 11:29:49 +01:00
Andrew Kingston d70e49d74f Add event for tracking user collaboration 2023-06-06 10:11:51 +01:00
Rory Powell abbd8c5c8b Merge branch 'master' into develop 2023-06-05 23:19:43 +01:00
Andrew Kingston 4a0e23a171 Transfer lock to next oldest session when disconnecting from the builder 2023-06-05 13:54:17 +01:00
Andrew Kingston f7e21c3348 Remove log from websocket heartbeat 2023-06-05 11:55:45 +01:00
mike12345567 0506096e72 Fixing filtering plus pagination in googlesheets, the pagination previously was first which broke the filtering. 2023-06-05 10:03:47 +01:00
mike12345567 770f7c1dc6 Merge branch 'develop' of github.com:Budibase/budibase into fix/google-sheets-issues 2023-06-05 09:36:45 +01:00
mike12345567 e7649374d2 Fixing googlesheets filtering by _id - there was an issue with the response API giving _rowNumber rather than the expected primary key of rowNumber, need to update the filters accordingly. 2023-06-02 18:25:35 +01:00
mike12345567 213315e14f Fixing issue with row deletion not returning the _id of the row which was deleted in googlesheets. 2023-06-02 18:03:43 +01:00
Andrew Kingston 6f51843875 Fix TS issue 2023-06-02 16:22:07 +01:00
Michael Drury adbdaf394a Small update to make sure that save/patch calls to the rows API (all DS+) return the squashed relationships, not the whole structure. 2023-06-01 18:18:12 +01:00
Andrew Kingston d8d3d71523 Update websocket logic to ignore events trigger by API requests originating from the same session 2023-06-01 17:14:32 +01:00
Michael Drury 8e4f0e531c Merge pull request #10755 from Budibase/fix/datasource-info-endpoint
Datasource info endpoint update
2023-06-01 12:29:46 +01:00
Michael Drury 67588f1051 Adding a JSON parse incase the input is actually an array in the form of a string (HBS). 2023-06-01 12:14:34 +01:00
Michael Drury cde4dabe42 Fixing some redis type errors. 2023-06-01 11:10:39 +01:00
deanhannigan a782a8b9b1 Merge pull request #10758 from Budibase/fix/reduce-array-row-parse-log-level
Reduced log level of array parsing on row import
2023-06-01 10:41:19 +01:00
Dean 6ee83e2da8 Reduced log level of parse array attempt 2023-06-01 09:05:22 +01:00
Michael Drury a3f9759a47 Reverting ioredis-mock removal for test cases - will come back to this in future as it currently breaks pro tests. 2023-06-01 00:02:55 +01:00
mike12345567 16e929bd81 Removing checks around websockets as redis properly available in testing now. 2023-05-31 18:09:15 +01:00
mike12345567 969ee52c29 Fixing merge conflict. 2023-05-31 18:08:29 +01:00
mike12345567 039e78379f Fixing lint issue. 2023-05-31 17:48:18 +01:00
mike12345567 fba3ec987e Merge branch 'develop' of github.com:Budibase/budibase into fix/datasource-info-endpoint 2023-05-31 17:37:17 +01:00
mike12345567 249625ad1a Updating backend tests to actually utilise the redis container which is spun up as part of the tests, doing away with the somewhat problematic ioredis-mock which was breaking some tests due to the addition of the changes for multi-dev collab. 2023-05-31 17:18:01 +01:00
mike12345567 651d50a064 Updating datasource information endpoint to POST which allows sending up an unfinished/unsaved datasource for fetching information with. Also changing how verification and information endpoints work so that enrichment is used and therefore env vars can also be used. 2023-05-31 17:04:29 +01:00
Andrew Kingston 680e609b52 Remove plural forms of enums and use TS enum rather than JS const 2023-05-31 17:03:14 +01:00
Andrew Kingston 8a2d4b7052 Merge branch 'develop' of github.com:Budibase/budibase into websocket-redis-integration 2023-05-31 16:28:14 +01:00
Andrew Kingston ffbbf04e86 Lint 2023-05-31 16:08:35 +01:00
Andrew Kingston a7c6298d1f Ensure socket pruning due to redis TTL expiry works as expected 2023-05-31 15:37:39 +01:00
Dean bb44c9f07f Added console log 2023-05-31 15:20:25 +01:00
Andrew Kingston 05e34076f7 Fully rewrite websocket redis integration to use individual keys per session, enable TTLs on sesisons, prune sessions when users connect and add a heartbeat to sockets 2023-05-31 15:13:22 +01:00
Peter Clement c6d0da33f4 add import for performance lib 2023-05-31 11:33:52 +01:00
Andrew Kingston d926650232 Add back in functionality to select different redis DB's per client 2023-05-31 10:52:39 +01:00
Peter Clement 162ea5d969 update log formatting 2023-05-31 10:51:54 +01:00
Andrew Kingston d3fdb52bf5 Store all socket users in redis to allow all server instances to be aware of all users 2023-05-31 10:21:50 +01:00
Peter Clement 702c908ae8 remove logging 2023-05-31 09:42:44 +01:00
Michael Drury 1547280514 Merge pull request #10739 from Budibase/fix/multi-dev-conflicts
Multidev lock and conflict management
2023-05-30 22:57:00 +01:00
Rory Powell a1dbd67535 Remove debug log 2023-05-30 19:23:19 +01:00
Rory Powell b0783d373a Lint 2023-05-30 19:16:36 +01:00
mike12345567 7c7bd4d5cb Fix for debugging with webstorm the old way (if desired), updating the builder middleware to be more multi-dev capable, ignoring 409s when attempting to update the last updated at for apps (if multiple devs hit at same time, only use one) also updating writethrough cache to retry once, with the extended TTL on locks, plus the multi-dev collab it can take a minute to update usage quota doc when a lot of updates occur at once. 2023-05-30 17:41:20 +01:00
Peter Clement ef9fc94728 Merge branch 'fix/looping-performance-bug' of github.com:Budibase/budibase into fix/looping-performance-bug 2023-05-30 16:52:34 +01:00
Peter Clement ed6cd8144b lint 2023-05-30 16:52:22 +01:00
Rory Powell 207512396a Merge pull request #10738 from Budibase/automation-investigation
Automation investigation logging + max doc size fix for automation log
2023-05-30 16:45:27 +01:00
Rory Powell df5654a7e7 Merge branch 'develop' into fix/looping-performance-bug 2023-05-30 16:41:11 +01:00
Rory Powell 6230e62b9b Automation investigation logging + max doc size fix for automation log 2023-05-30 16:37:39 +01:00
Peter Clement 3119ba5a8d remove log 2023-05-30 14:41:04 +01:00
Peter Clement 0a91e5bed1 update let to const 2023-05-30 14:26:49 +01:00
Peter Clement 5a7f0ba586 Fix performance issue with looping and context 2023-05-30 14:25:28 +01:00
Gerard Burns 23ee9f4af8 Post Sign Up Onboarding Changes (#10701)
* wip

* PR Feedback

* Fixes

* PR Feedback

* PR Feedback

* PR Feedback
2023-05-30 12:54:57 +01:00
Andrew Kingston be40d72f55 Merge pull request #10712 from Budibase/data-section-multidev
Multiple user collaboration for data section
2023-05-30 09:08:14 +01:00
Peter Clement 55e56e2c1f Merge branch 'feature/sync-automations' of github.com:Budibase/budibase into feature/sync-automations 2023-05-26 16:58:12 +01:00
Peter Clement 2ae960e2ee fix broken test 2023-05-26 16:58:00 +01:00
mike12345567 7ba21d836b Merge branch 'develop' of github.com:Budibase/budibase into feature/sync-automations 2023-05-26 16:42:01 +01:00
Peter Clement 66e1f57a3d one more feature check for safety on the trigger 2023-05-26 16:06:16 +01:00
deanhannigan bd50f32f0d Merge pull request #10713 from Budibase/fix/internal-view-eval-fn
Fix for fetching Internal DB Views in QA cloud
2023-05-26 11:51:07 +01:00
Peter Clement 5a73b02827 update feature array to be an object 2023-05-26 11:02:47 +01:00
Dean e1a87f2072 Reverted eval call to direct. Indirect appears to cause issues in cloud 2023-05-26 10:22:28 +01:00
Adria Navarro 77a619945b Merge pull request #10680 from Budibase/budi-6933-verify-data-source-connection-during
Verify data source connection before saves
2023-05-26 10:47:42 +02:00
Andrew Kingston 520158c8f9 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-26 09:39:06 +01:00
Peter Clement 70dfd9e8e5 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-26 09:26:51 +01:00
Andrew Kingston cc7df474c9 Standardise usage of user avatars and colours across the entire platform 2023-05-26 09:24:53 +01:00
deanhannigan 567ee451dd Merge pull request #10702 from Budibase/fix/data-export-rows
Fixes and updates for export internal rows
2023-05-26 09:08:35 +01:00
melohagan b5c98871ad Update table data via CSV import (#10313)
* Add identifierFields select for import

* Update rows on import (Internal DB)

* Only allow internal DB to upsert import CSV

* Clear identifierFields when turning off update

* Passing table instead of tableId

* Pass table

* Pass tableType
2023-05-25 18:05:07 +01:00
Dean 146940f6ae Added error handling for export row front end and fixed row export backend behaviour 2023-05-25 17:50:52 +01:00
Peter Clement b0a32f03b4 remove log 2023-05-25 09:14:09 +01:00
Andrew Kingston 5e480a1527 Use socker.io redis adapter to broadcast events to all server instances 2023-05-25 08:48:56 +01:00
Martin McKeaveney 77c2e309dd merge 2023-05-24 17:35:04 +01:00
Martin McKeaveney f86d321e2e restrict openai just to self host 2023-05-24 17:17:23 +01:00
Martin McKeaveney db5d051755 GPT4 support 2023-05-24 15:26:27 +01:00
Andrew Kingston 5cf4753853 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-24 15:14:32 +01:00
Peter Clement 4d5a922684 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-24 15:05:58 +01:00
Peter Clement a9bb534cdf set flag in automation orchestrator 2023-05-24 14:41:58 +01:00
Adria Navarro b264708af6 Merge remote-tracking branch 'origin/develop' into chore/esbuild 2023-05-24 14:17:32 +02:00
Martin McKeaveney bbab2a9adc merge 2023-05-24 11:25:49 +01:00
Adria Navarro 237cda064c Simplify integration features 2023-05-24 10:50:51 +02:00
Peter Clement 6818e4debb check collection actually exists 2023-05-23 16:12:20 +01:00
Peter Clement 8d3a5307ed sync automation webhooks tests 2023-05-23 15:55:52 +01:00
Peter Clement 986348f511 sync automation tests 2023-05-23 15:55:25 +01:00
Adria Navarro c3036af072 Merge pull request #10659 from Budibase/feature/table-fetching
Datasource+ table fetching API
2023-05-23 15:39:18 +02:00
andz-bb 7b9d56ac25 add role field to snowflake datasource connection 2023-05-23 12:38:50 +01:00
mike12345567 590844c8a9 PR comments. 2023-05-23 12:22:22 +01:00
Adria Navarro aa58a24a6d Change query for retrieving postgres primary keys 2023-05-23 11:20:18 +02:00
Adria Navarro e838a90d3e Add small unit test 2023-05-23 10:22:26 +02:00
Adria Navarro 023373bb25 Remove unnecessary load info 2023-05-23 10:18:37 +02:00
Adria Navarro b7b604ca00 Improve test 2023-05-23 10:17:42 +02:00
Adria Navarro 5ea19986b1 Add basic test 2023-05-23 10:14:06 +02:00
Adria Navarro 74ea851fa3 Fetch google sheets 2023-05-23 09:55:46 +02:00
mike12345567 76eef8d3d4 Fixing some test issues. 2023-05-22 16:25:50 +01:00
Andrew Kingston 9ab5c8792a Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-22 16:01:50 +01:00
Andrew Kingston cfa07a68ae Handle table, query and datasource events using builder socket 2023-05-22 15:59:44 +01:00
Peter Clement a8e40d711b uneeded input value 2023-05-22 15:53:20 +01:00
Peter Clement 754b30dd5c add features property to automation defintions 2023-05-22 15:46:42 +01:00
mike12345567 83ddb9c8dd Adding feature to denote fetch table names function. 2023-05-22 14:28:18 +01:00
mike12345567 d6c07f47b6 Adding base implementation for googlesheets integration. 2023-05-22 13:57:56 +01:00
Andrew Kingston 15ff635c6e Merge pull request #10591 from Budibase/fix/automation-filtering
Fix automation filtering on number fields
2023-05-22 13:12:35 +01:00
mike12345567 ad358fe1ca Merge branch 'develop' of github.com:Budibase/budibase into feature/table-fetching 2023-05-22 12:56:10 +01:00
Adria Navarro 3d7af9b2a3 Fix manifest ref 2023-05-22 09:42:43 +02:00
Adria Navarro 986d4c4740 Merge branch 'develop' into chore/esbuild 2023-05-19 17:26:47 +02:00
Adria Navarro 82f53483b2 Fix server docker 2023-05-19 16:44:09 +02:00
Peter Clement d7ae338bc5 fix import 2023-05-19 15:14:01 +01:00
Peter Clement 9b7972fdfd remove middleware but check if prod in controller 2023-05-19 15:12:08 +01:00
Michael Drury 38e39cf2f2 Adding negative test case for connections and adding test of table name fetching for postgres. 2023-05-19 13:36:05 +01:00
Michael Drury d85bcbc7e5 Adding test for postgres verify. 2023-05-19 12:19:55 +01:00
Adria Navarro 0a2335a047 Merge pull request #10622 from Budibase/chore/improve_pipeline_times
Chore - Improve pipeline run time
2023-05-19 13:18:21 +02:00
Peter Clement d271bbdadb rename syncWebHooks to syncAutomations 2023-05-19 10:07:02 +01:00
Michael Drury 2223027d28 Adding API for retrieving table names. 2023-05-18 23:22:52 +01:00
Michael Drury 732ebb4f87 Adding function to fetch table names. 2023-05-18 22:09:44 +01:00
Peter Clement e1eda14204 move sync automations away from bull and call directly 2023-05-18 17:01:53 +01:00
Peter Clement f680fbd822 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-18 11:35:25 +01:00
Michael Drury 62e9777407 Merge pull request #10633 from Budibase/fix/live-app-user-updates
Production app user updates
2023-05-18 10:46:31 +01:00
Adria Navarro 2d2d50a5df Merge branch 'develop' into chore/esbuild 2023-05-18 11:34:11 +02:00
Rory Powell a685f181da Merge branch 'master' into develop 2023-05-18 09:10:51 +01:00
Andrew Kingston 3794d8e204 Simplify websocket comms for grid and improve builder socket 2023-05-18 08:57:20 +01:00
Rory Powell 55ee94892a Support setting object name for logged json objects 2023-05-17 22:18:50 +01:00
mike12345567 cf7107d19a Updating sync to cover both prod and dev apps. 2023-05-17 19:35:00 +01:00
Andrew Kingston 0bebacc741 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-17 16:38:01 +01:00
Rory Powell 0aff89a479 Merge pull request #10626 from Budibase/chore/automation-logging-updates
Automation logging updates
2023-05-17 14:58:16 +01:00
Rory Powell f41b134d31 Refactor to use param for doInAutomationContext 2023-05-17 14:57:29 +01:00
Rory Powell 578b599428 Lint 2023-05-17 14:10:22 +01:00
Rory Powell ad37186665 Logging updates for automations 2023-05-17 13:54:20 +01:00
mike12345567 f3785892a9 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-05-17 12:45:28 +01:00
Rory Powell 42f472b038 Type updates for automation jobs 2023-05-17 12:26:07 +01:00
Adria Navarro 60109ebcda Fix manifest usage 2023-05-17 12:55:04 +02:00
Adria Navarro 4f3139a47b Merge branch 'develop' into feature/datasource-conns 2023-05-17 12:00:56 +02:00
Adria Navarro 8e95038671 Merge pull request #10620 from Budibase/feature/oracle-conn-checking
Oracle connection checking
2023-05-17 10:52:31 +02:00
mike12345567 e09550f7e3 PR comments. 2023-05-17 09:45:25 +01:00
Adria Navarro a2e22bda71 Merge pull request #10618 from Budibase/budi-6932/check_elastic
Check elastic search connection settings
2023-05-17 10:16:16 +02:00
mike12345567 ee5f0ec641 Remove unused type. 2023-05-17 09:15:06 +01:00
Adria Navarro 896bc61934 Check elastic connection 2023-05-17 09:38:37 +02:00
mike12345567 9f57d7c33a Fixes after testing against actual Oracle service. 2023-05-16 19:31:12 +01:00
mike12345567 832f8b3aa8 Adding Oracle connection checking. 2023-05-16 19:04:46 +01:00
Peter Clement e3d867611b use correct sdk import 2023-05-16 16:05:37 +01:00
Andrew Kingston 1e48020001 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-16 15:23:30 +01:00
mike12345567 14806809e8 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-05-16 14:54:44 +01:00
Andrew Kingston 6ed691be1d Improve builder socket 2023-05-16 14:18:31 +01:00
Adria Navarro e465422031 Implement connection 2023-05-16 15:08:34 +02:00
Adria Navarro ce357ecac8 Setup CONNECTION_CHECKING feature 2023-05-16 13:37:30 +02:00
Adria Navarro d285c2aeb2 Merge pull request #10601 from Budibase/budi-6932/verify_google_sheets
Verify google sheets connection
2023-05-16 13:33:08 +02:00
Adria Navarro 87497fee73 Comments 2023-05-16 13:24:16 +02:00
Adria Navarro 419e2de602 Test airtable connection 2023-05-16 13:24:16 +02:00
Adria Navarro be6c398f53 Remove bool ref 2023-05-16 13:23:35 +02:00
Adria Navarro 2176ac8da7 Clean code 2023-05-16 11:49:51 +02:00
Adria Navarro 062127b1f1 Fix types 2023-05-16 11:48:40 +02:00
Adria Navarro b3b962534f Test snowflake connection 2023-05-16 11:47:38 +02:00
Adria Navarro d6473aab87 Append auth on verification 2023-05-16 11:47:38 +02:00
Adria Navarro 911a072069 Update types 2023-05-16 11:44:58 +02:00
Adria Navarro a21039d5b4 Fix auth checks when specified auth 2023-05-16 11:43:13 +02:00
Adria Navarro 5e7d839cb1 Use existing merge 2023-05-16 11:43:13 +02:00
Adria Navarro a676e42b1f Handle config 2023-05-16 11:43:13 +02:00
Adria Navarro cd93d327a5 Test google sheets 2023-05-16 11:43:13 +02:00
Adria Navarro b5890b788f Append auth on verification 2023-05-16 11:43:13 +02:00
Peter Clement d43fc819c7 refactor check for collect step into sdk 2023-05-16 09:29:40 +01:00
Dean 728eb3bb09 Fix for autoid issue on create row 2023-05-15 19:22:22 +01:00
Andrew Kingston 1bfe823bce Fix filtering in automations not accounting for number prefixes in filter expression 2023-05-15 17:45:09 +01:00
mike12345567 6b7269b954 Refactoring response from integrations to a simple type. 2023-05-15 17:36:16 +01:00
Michael Drury 18d2c33839 Merge pull request #10583 from Budibase/budi-6932/verify_redis
Implement redis connection verification
2023-05-15 17:22:32 +01:00
Michael Drury fbc3697c8c Merge pull request #10546 from Budibase/budi-6932/verify_mysql
Implement mysql connection verification
2023-05-15 17:13:32 +01:00
Michael Drury 9e6f22653b Merge pull request #10550 from Budibase/budi-6932/verify_couchdb
Implement couchdb connection verification
2023-05-15 17:12:54 +01:00
Michael Drury 3ef204cf7b Merge pull request #10553 from Budibase/budi-6932/verify_mssql
Implement MSSQL connection verification
2023-05-15 17:12:05 +01:00
Michael Drury f9fd3d942a Merge pull request #10554 from Budibase/budi-6932/verify_mongo
Implement mongo connection verification
2023-05-15 17:11:37 +01:00
Michael Drury 001e8757e8 Merge pull request #10555 from Budibase/budi-6932/verify_arango
Implement arango connection verification
2023-05-15 17:11:12 +01:00
Michael Drury 328514afdd Merge pull request #10588 from Budibase/budi-6932/verify_s3
Implement S3 connection verification
2023-05-15 17:10:38 +01:00
Michael Drury d77107f540 Merge pull request #10589 from Budibase/budi-6932/verify_dynamodb
Implement dynamodb connection verification
2023-05-15 17:10:10 +01:00
mike12345567 bd74f8eef7 Updating testConnection usage. 2023-05-15 17:08:23 +01:00
mike12345567 571987a2ce Merge branch 'feature/datasource-connections' of github.com:Budibase/budibase into feature/datasource-conns 2023-05-15 17:00:30 +01:00
Adria Navarro 3933a3881b Test dynamodb connection 2023-05-15 17:58:09 +02:00
Adria Navarro f2f0c2e708 Typing 2023-05-15 17:56:48 +02:00
Adria Navarro 1e505791c0 Implement s3 checks 2023-05-15 17:37:28 +02:00
Adria Navarro 47d8701578 Move files 2023-05-15 16:53:32 +02:00
Adria Navarro 058ac416ea Test redis 2023-05-15 16:50:37 +02:00
Adria Navarro fad57db634 Implement the check as part of the integration 2023-05-15 16:48:40 +02:00
Adria Navarro 901bff5399 Validate arango 2023-05-15 16:47:41 +02:00
Adria Navarro 2f9b076381 Implement the check as part of the integration 2023-05-15 16:38:42 +02:00
Adria Navarro e8fa690566 Add mongo checks 2023-05-15 16:37:20 +02:00
Adria Navarro d98bc11a20 Clean 2023-05-15 16:30:43 +02:00
Adria Navarro 2641a8c135 Clean code 2023-05-15 16:30:43 +02:00
Adria Navarro 0418e90a37 Implement the check as part of the integration 2023-05-15 16:30:43 +02:00
Adria Navarro 32695018bf Validate and test microsoft sql 2023-05-15 16:30:43 +02:00
Peter Clement 007f5ca8a9 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-15 15:19:44 +01:00
Andrew Kingston 46d8ad2864 Restore proper functionality for showing other users inside grids 2023-05-15 14:51:54 +01:00
Peter Clement 266465c8df convert timeout seconds to milliseconds 2023-05-15 14:48:34 +01:00
Adria Navarro bd736836f0 Remove export 2023-05-15 13:55:22 +02:00
Adria Navarro d656edad40 Implement the check as part of the integration 2023-05-15 13:54:32 +02:00
Adria Navarro 209ada0c38 Validate couchdb 2023-05-15 13:54:32 +02:00
Adria Navarro 8a1564ef07 Implement the check as part of the integration 2023-05-15 13:48:09 +02:00
Adria Navarro 721492e76d Validate mysql 2023-05-15 13:47:48 +02:00
Adria Navarro f10a66cc42 Type mysql configs 2023-05-15 13:47:48 +02:00
Adria Navarro 99d525ad79 Move tests to qa-core 2023-05-15 13:16:56 +02:00
Adria Navarro c3856a48aa Fix types 2023-05-15 13:16:56 +02:00
Adria Navarro eaf7e399e7 Remove unnecessary export 2023-05-15 13:16:56 +02:00
Adria Navarro ffef2499cc Implement the check as part of the integration 2023-05-15 13:16:56 +02:00
Adria Navarro f5fb4f8850 Clean 2023-05-15 13:16:56 +02:00
Adria Navarro b022dcba77 Types 2023-05-15 13:16:56 +02:00
Adria Navarro 25233c5c9b Add message response 2023-05-15 13:16:56 +02:00
Adria Navarro f022a43065 Test pg connection 2023-05-15 13:16:56 +02:00
Adria Navarro 239a51a2c0 Typings 2023-05-15 13:16:56 +02:00
Adria Navarro 20aa0f50ab Clean code 2023-05-15 13:16:56 +02:00
Andrew Kingston f8f970bf7e Update grid websocket to send actual changes down to reduce API load 2023-05-12 16:13:32 +01:00
Peter Clement c86c2b4096 add synchronous webhook functionality 2023-05-12 15:57:34 +01:00
Peter Clement dcfb65b92d sync / async automations go through one endpoint 2023-05-12 15:56:24 +01:00
Andrew Kingston 7f96fbf741 Remove single user restriction and notify users if they are the primary builder or not 2023-05-12 13:55:08 +01:00
melohagan 395cf4a667 Add JSON payload support for Make and Zapier (#10529)
* Rename Integromat to Make. Update logo.

* Add JSON type for automations

* Support deprecated values in JSON

* Fix json query editor width bug

* Push body to schema if missing

* Support JSON body

* Add JSON payload support for Zapier

* Update packages/server/src/automations/steps/make.ts

Co-authored-by: Martin McKeaveney <martin@budibase.com>

* July -> November

* Add unit tests

---------

Co-authored-by: Martin McKeaveney <martin@budibase.com>
2023-05-11 17:49:33 +01:00
Peter Clement 1626571081 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-11 11:53:12 +01:00
Dean 77d1f9250c Updated import row test to evaluate the name and _id fields on the table instead of the entire object. 2023-05-10 12:52:54 +01:00
Dean 1e6652dc39 Fix for importing exported array/option fields. Fix to ensure lastid and inclusion updates persisted as a result of an import. Test updates for array and option fields 2023-05-10 12:36:01 +01:00
Peter Clement 1539bf234b add ability to trigger synchronous automation from button action 2023-05-09 12:10:20 +01:00
melohagan fb54b6de60 Add pagination to Google Sheets (#10525)
* Add pagination to Google Sheets

* Default limit to 100
2023-05-09 12:05:12 +01:00
Peter Clement ac57a849ce add collect bloc definition 2023-05-09 12:04:32 +01:00
Peter Clement 9b66b30969 add property to denote if step can be looped 2023-05-09 12:04:16 +01:00
Dean 8fcb7d880a Merge remote-tracking branch 'origin/master' into fix/inclusion-row-parsing 2023-05-09 09:46:37 +01:00
Martin McKeaveney eb37dacc73 lint 2023-05-08 16:23:49 +01:00
Martin McKeaveney b387f969d9 allow passwordless redis 2023-05-08 15:59:12 +01:00
mike12345567 57a633b926 Implementing main body of connection verification endpoint. 2023-05-05 17:40:39 +01:00
mike12345567 ce6c5bfa68 Base connection work - extending the base integration to include the option of a connection check function. 2023-05-05 15:47:55 +01:00
Dean 03c048f978 Merge remote-tracking branch 'origin/master' into fix/inclusion-row-parsing 2023-05-05 15:22:49 +01:00
Dean 0aeb06bb2b Merge commit 2023-05-05 13:39:59 +01:00
melohagan 25b42f0a28 Rename Integromat to Make. Update logo. (#10492) 2023-05-05 12:41:24 +01:00
Martin McKeaveney 1c81cc4b4d Merge pull request #10483 from Budibase/fix/empty-attachment-row-import
Fix for row import failure caused by empty attachment parsing.
2023-05-05 12:01:04 +01:00
Michael Drury cfae0f6811 Merge pull request #10487 from Budibase/fix/automation-log-issue
Potential fix for automation log issue
2023-05-05 11:59:25 +01:00
Dean b0ff61c9ec Feedback update. Console.error to logging.logalert 2023-05-05 09:24:57 +01:00
melohagan b790a1177e Don't validate empty options picker (#10302) 2023-05-05 07:50:01 +01:00
mike12345567 0d7959f720 Fixing some un-identified listeners, queue messages not being correctly printed, also improving the mechanism for detecting if in the main thread or not. 2023-05-04 17:20:21 +01:00
Martin McKeaveney 50de32a8a0 Merge pull request #10452 from Budibase/feature/clustering-support
attaching clustered mode to an env var
2023-05-04 14:25:23 +01:00
Martin McKeaveney 41c131050c lint 2023-05-04 13:43:53 +01:00
Martin McKeaveney 167dfd39d7 fix ts build 2023-05-04 13:32:17 +01:00
Dean 5498cc86bd Refactor to fix tests and added an extra empty scenario 2023-05-04 12:58:45 +01:00
Dean a1fdff8df8 Linting 2023-05-04 12:25:30 +01:00
Dean f8da7a9f28 Linting 2023-05-04 12:12:47 +01:00
Dean 56a1b068cc Added json parse option for row import attachment values 2023-05-04 11:52:20 +01:00
Dean 98963c1505 Fix for inclusion parsing for arrays and options. View table fix to hide edit button 2023-05-04 11:21:24 +01:00
Adria Navarro fa6e6b53f8 Merge pull request #10462 from Budibase/fix/budi-6789-import-data-empty-date-is-not-allowed
Fix - Budi 6789 import data empty date is not allowed
2023-05-03 19:22:06 +02:00
Adria Navarro efaf2adf05 Fix build 2023-05-03 18:05:32 +01:00
Adria Navarro cec2f88c25 Fix svelte issues 2023-05-03 18:05:32 +01:00
Adria Navarro a7f69231d9 Merge branch 'chore/npmless-builds' into chore/esbuild 2023-05-03 18:01:04 +01:00
Rory Powell e1a147e823 Merge branch 'master' into develop 2023-05-03 16:06:42 +01:00
Adria Navarro f426ba1ac3 Merge branch 'chore/npmless-builds' into chore/esbuild 2023-05-02 14:56:34 +01:00
Adria Navarro 1d041a3dd5 Support nulls when optional 2023-05-02 12:48:05 +01:00
Adria Navarro 6e7c78362e Return null instead of undefined 2023-05-02 12:46:53 +01:00
Adria Navarro 650cbc1f01 Handle cast as undefineds 2023-05-02 11:57:18 +01:00
Adria Navarro c87cc39cea Add basic tests 2023-05-02 10:44:25 +01:00
Adria Navarro 29df12c247 Add csvutils 2023-05-02 10:34:45 +01:00
Martin McKeaveney 36397bb77d enabling cluster support for ratelimit cache 2023-04-28 20:23:39 +01:00
melohagan 8742fb39d3 is empty lucene query with OR fix (#10451)
* empty lucene query with OR fix

* Fix unit test
2023-04-28 17:17:32 +01:00
mike12345567 4f7e56fed9 Making build script into a module, so that it can be used in a specialised server build which also builds the thread scripts as required for worker-farm. 2023-04-27 19:00:01 +01:00
mike12345567 de51364303 Some updates to Dockerfiles. 2023-04-27 17:00:15 +01:00
mike12345567 5363693ac3 Removing automation logs from app exports as they are not useful - they take up space and the imported app won't have ran any automations yet. I have added it as a flag so that this does not affect backups (as you would want to maintain logs for backups). 2023-04-27 11:36:52 +01:00
mike12345567 5066d20c9d Updating Dockerfiles and dockerignore to clear out any un-needed assets. 2023-04-26 17:59:18 +01:00
Pedro Silva 6e79506445 Fix failing test 2023-04-26 16:45:00 +01:00
Martin McKeaveney e70e3ae662 rename 2023-04-26 15:58:21 +01:00
Martin McKeaveney 4f020a4db4 lint 2023-04-26 15:56:46 +01:00
Martin McKeaveney 84f52683b2 chatgpt automation block 2023-04-26 15:55:44 +01:00
Pedro Silva 796c50d3e0 Merge branch 'develop' into qa-core-datasource-api-tests 2023-04-26 15:51:47 +01:00
mike12345567 49b45f5e67 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-25 17:37:56 +01:00
Adria Navarro 608a38489f Export undefineds as empty values in csv, instead of empty strings 2023-04-25 12:34:50 +01:00
Dean 72c72fc48a Lint fix 2023-04-25 12:31:52 +01:00
Dean f3be917da1 Enrich the upgradable version property when fetching the app package 2023-04-25 12:16:02 +01:00
Adria Navarro 640bb2004b Merge pull request #10324 from Budibase/chore/remove_package.json_dependency
Chore - Remove package.json dependency
2023-04-24 19:34:15 +02:00
adrinr 128802ebf3 Fix build 2023-04-24 18:05:53 +01:00
Michael Drury 9c93bf91c0 Merge pull request #10352 from Budibase/fix/10349
Allow SQL formulas using related row information to be used as display columns
2023-04-24 17:50:49 +01:00
Adria Navarro c47ff6ccfb Merge branch 'develop' into chore/remove_package.json_dependency 2023-04-24 18:42:55 +02:00
melohagan 5e76a50b0b Add info to query result payload (#10291) 2023-04-24 12:03:02 +01:00
Rory Powell ec06f13aa6 Per user pricing (#10378)
* Update pro version to 2.4.44-alpha.9 (#10231)

Co-authored-by: Budibase Staging Release Bot <>

* Track installation and unique tenant id on licence activate (#10146)

* changes and exports

* removing the extend

* Lint + tidy

* Update account.ts

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>

* Type updates for loading new plans (#10245)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS` (#10247)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete + migration (#10250)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Lint

* Types and structures for user subscription quantity sync (#10280)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing for licensing (#10346)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing

* Lint

* Pricing/billing page (#10353)

* bbui updates for billing page

* Require all PlanTypes in PlanMinimums for compile time safety

* fix test package utils

* Incoming user limits warnings (#10379)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* Types and test updates for subscription quantity changes in account-portal (#10372)

* Add chance extensions for `arrayOf`. Update events spies with license events

* Add generics to doInTenant response

* Update account structure with quota usage

* User count limits (#10385)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* user limit messaging on add users modal

* user limit messaging on import users modal

* update licensing store to be more generic

* some styling updates

* remove console log

* Store tweaks

* Add startDate to Quota type

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>

* Lint

* Support custom lock options

* Reactivity fixes for add user modals

* Update ethereal email creds

* Add warn for getting invite from code error

* Extract disabling user import condition

* Handling unlimited users in modals logic and adding start date processing to store

* Lint

* Integration testing fixes (#10389)

* lint

---------

Co-authored-by: Mateus Badan de Pieri <mateuspieri@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Peter Clement <PClmnt@users.noreply.github.com>
2023-04-24 09:31:48 +01:00
mike12345567 c5e1457b25 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6900 2023-04-21 12:06:18 +01:00
Andrew Kingston aefb48e363 Fix options inclusion constraint regression 2023-04-20 20:10:30 +01:00
mike12345567 060dc05afa Removing export all apps functionality from cloud - this was a very niche feature and often confusing, now there is a consistent flow for starting out in self host. 2023-04-20 17:19:17 +01:00
Andrew Kingston 55ce83c444 Grid UI in data section (#10329)
* Add WIP spreadsheet

* Add footer and improve styles

* Refactor to use IDs and support changing text values inline

* Add inline editing of options fields

* Add row deletion and fix sizing

* Add ability to add new rows

* Fix z-index issue with option cells

* Remove deletion notification and fix selection

* Add gap between items in an options cell

* Tweak options cell to be pixel perfect

* Fix padding around sheet not working when scrolling

* Add resizable columns and add support for all themes

* Allow multiselect component and field to support text values

* Generate inclusion schema when importing multiselect columns

* Add support for multiselect type

* Add number cell

* Add functional date cell

* Disable editing autocolumns

* Make sticky column the primary display and fix opening options cells

* Improve display of relationship cell and options cell

* Support empty dates and use CSS variables for easier styling

* Use more CSS variables and add utils to spreadsheets

* Add drag and drop column reordering

* Break out reordering logic into new stores

* Rename reordering to reorder

* Break out other components from spreadsheet for cleaner code

* Break out spreadsheet body into its own component

* Split into more modular components and try virtual rendering

* Test absolute positioning

* Optimise virtual rendering for both columns and rows to handle infinitely large datasets

* Optimise scrolling and virtual rendering performance

* Fix columnn reordering

* Migrate sheet to data section, improve reordering and reszing

* Clean up more sheet state and increase performance

* Fix multiple issues with z-index, reordering and resizing

* Fix date cells in sheets

* Separate data fetching logic from main sheet and tidy up

* Add infinite scroll, improve row fetching, add error handling, fix svelte store updates

* Fix overly thin scrollbars in firefox

* Use nicer checkboxes and fix some hover styles

* Fix issue reordering columns in firefox and increase performance

* Tidy up

* Use search endpoint instead of get endpoint to fetch individual rows so that relationship enrichment occurs

* Tidy up

* Fix relationship issues when creating rows

* Optimise resetting data to smoothly transition when changing datasource

* Add WIP virtual dom implementation to massively increase performance

* Refactor spreadsheet into more discreet components

* Fix multiple issues, clean up rendering, improve performance

* Tune cell sizes

* Fix some scroll issues and add shadow to sticky column

* Fix issue when no primary display is set

* Add padding to sheet

* Improve styles

* Allow reordering columns to be the first column after sticky column

* Fix row hover state not being removed

* Update hovered row on wheel

* Update scroll styles and z-index

* Improve scroll logic and handle horizontal wheel events

* Simplify and improve z index styles

* Fix styles when using no sticky columns

* Improve rendering performance

* Improve performance by removing keyed each blocks and fix reorder target styling

* Ensure scroll top is always properly reset and add config store

* Allow configuring selecting rows and adding rows

* Integrate sheet into data section better

* Add back in functional delete row button

* Refactor stores and make state more modular

* Lint and remove unused deps

* Remove add column button

* Fix options cells being unable to scroll

* Add WIP initial multi-user websocket implementation for sheets

* Add WIP multi-user UI for sheet interface

* Fix issues with not disconnecting users when swapping datasource and improve multi-user UI

* Update layout and remove logging

* WIP column popovers for dataspace sheets

* Add popovers to sheet column headers, improve mouse UX

* Tidy reordering stuff

* Refactor resizing logic into store and improve UX around hover events when resizing/reordering

* Add column sorting and reordering via popover

* Handle context menu events in header cells

* Fully integrates sheets with datasection and remove lots of old stuff

* Fix buttons being highlighted when filters are set

* Add flags for controlling editing and adding rows in sheets

* Count context menu clicks when considering the click outside handler

* Prevent adding rows to users table and remove log

* Expose loading state of sheet and improve column highlighting logic

* Small style updates

* Update delete button and allow horizontal scrolling

* Add context menu to sheets with deletion and duplication features

* Improve UX around selecting rows and cells

* Add basic keyboard interactions to dataspaces

* Improve keyboard navigation in sheets

* Remove unnecessary searching through large rows array

* Fix issue with deleting rows and fix relationship cells displaying undefined

* Improve loading state

* Update menu width

* Merge with new shared-core and moved lucene utils

* Improve rendering performance and simplify component props

* Remove new row component and improve mouse interactions

* Tidy up buttons above sheets and add FAB for adding rows

* Optimise sheet data loading and add sort button

* Update sorting and remove logs

* Add sheet button to control column visibilty, improve sorting, improve disabled states

* Fix bug with select placeholders and fix sorting loops causing endless refreshes

* Update filter button to look consistent and add double click to resize columns to default width

* Ensure all derived stores have default values

* Reset scrolling when datasource changes and fix wasted pagination calls

* Improve performance by removing searches through the full row array

* Add advanced key handling for spreadsheets and improve blur and focus UX

* Ensure the selected cell is always visible

* Add icons for all data types

* Add new long form text cell

* Add boolean cell

* Add ability to focus first cell via tab

* Add cells for formulae and JSON

* Remove console logs

* Add attachment cell

* Increase padding to account for attachment dropdown

* Prevent deleting autocolumns via keyboard

* Fix attachments overflowing

* Improve sort button, remove header more icons unless hovered and highlight sorted column

* Add functional relationship cell

* Improve relationship cell

* Fix race conditions and edge cases in relationship cell

* Update user avatar colours

* Improve preservation of column widths in sheets when making schema changes

* Remove redundant sheet schema context and fix issues with mutating table schema

* Disable websocket in sheets

* Rollback state changes when row saving fails

* Fix one-to-many relationships allowing selecting multiple rows on both sides

* Remove log

* Make sheet gutter width customisable

* Allow expanding rows using existing edit row modal

* Fix text cell not using full width

* Sort columns to put autocolumns last

* Add new footer for adding rows, improve store memoization, support inverting all data types

* Improve animations for adding rows and handle add row failure

* Ensure all sheet feature flags work as expected and fix multi row deletion

* Fix options ordering

* Fix add row button not appearing when horizontal scrollbar is hidden

* Fix selecting newly created rows

* Remove log and add notification when creating or editing columns

* Move new row component to top, automatically invert cell renderers when required

* Add resizable rows

* Fix overlapping long form text borders

* Fix scroll not working in new row

* Update new row component, fix z-index issues, improve UX

* Large refactors to row creation, naming and sheet APIs

* Refactor stores to fix dependency issues, use modals for adding rows, simplify sheet

* Fix resize overlays

* Add custom colors for drop shadows and blue-100 to all themes, fix sticky column shadow

* Increase horizontal padding when scrolling to a selected cell

* Add multiple validation improvements

* Add validation to duplicating rows

* Remove log

* Restore missing event handler

* Improve data fetch reset logic, fix issues with stale cache in spreadsheets

* Fix issue with cell colors, improve row API interactions to avoid relationship issues due to API response differences

* Fix filters not working

* Simplify logic for reordering and add new overlay. Simplify sheet cells

* Fix importing and exporting with sheets

* Fix reorder overlay z-index issue

* Fix issue when no display column exists

* Fix issue with display column not being able to be unset

* Add persitence to column size and order in sheets

* Improve sheet integration with data section and add horizontal cell inversion

* Fix double click resizing of sticky column

* Make column visibility persistent and refactor column updating

* Improve sheet loading states

* Add beta button to sheet, tidy up constants

* Work around table API inconsistencies to handle table schema updates

* Add additional reorder options and improve beta button

* Improve sorting

* Add copy and paste to spreadsheet and add immediate editing of cells without additional click

* Remove copy/paste rows, remove move to start/end, improve copy/paste for cell values

* Fix dependency ordering

* Refactor other sheet stores to improve dependency ordering

* Fix errors not showing in sticky column and clear cell value on backspace press

* Rewrite relationship cell and update default column widths

* Ensure dynamic row height is properly accounted for

* Update text cells, number cells, long form field cells and relationship cells to respect row height

* Fix row heights with sticky column

* Update JSON, boolean and date cells to respect row height

* Update attachment cell to respect row height

* Use unique background for focused cell

* Standardise shadows across cell types

* Persist row height as table metadata

* Improve a few design issues

* Clean up

* Fix relationship cells not being readonly

* Lint

* Fix icon padding in relationship picker

* Improve styles in relationship dropdown

* Update shadow

* Update relationship icons

* Update relationship icons

* Update error label max size and position

* Prevent using invalid data types as display columns

* Add menu option to edit rows in modal

* Prevent sheet handling key events sourcing from modals

* Standardise menu overlay shadow and add count to relationship cells when hovering

* Improve relationship cell performance

* Remove spellcheck from text fields

* Fix resize overlay handler height

* Fix reorder overlay height

* Remove unused code and change selected table faster in data section

* Fix table selection not working when on datasource page

* Improve sheet loading state

* Add rowHeight property to table types

* Restore builder middleware

* Remove any naming of dataspaces

* Lint

* Disable row import button for users table and add optional chaining to spreadsheetsocket invocations to fix tests

* Use unique user edit modal for editing users in sheets

* Add schemaOverrides prop to sheet and use it to customise user table schema

* Update number icon

* Fix primary display column not properly disabling certain menu options

* Merge

* Update beta button position slightly

* Update beta button text

* Fix HMR for custom plugins which was broken due to signed minio links

* Add maze link to grid

* Update koa <> socket.io integation to improve fake koa context and allow current app middleware

* Rename sheet to grid

* Fix menu postiion, fix copy and paste in menu not working

* Remove commented out usages of websocket emissions for grid
2023-04-20 15:56:24 +01:00
Andrew Kingston 84da11a475 Remove commented out usages of websocket emissions for grid 2023-04-20 15:23:57 +01:00
mike12345567 46b1180cd2 Fixing test case. 2023-04-20 11:06:16 +01:00
Andrew Kingston c82451f888 Update koa <> socket.io integation to improve fake koa context and allow current app middleware 2023-04-20 08:02:49 +01:00
mike12345567 1aca5d6407 Fixing an issue with creating relationships between existing tables, not using the correct type for the primary key in the foreign key relationship. 2023-04-19 17:17:37 +01:00
mike12345567 401d64b074 Fixing issue with SQL tables and using formulas that contain relationships as display columns. Also cleaning up imports in ExternalRequests a bit. 2023-04-19 16:16:22 +01:00
mike12345567 67de033683 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-19 15:01:26 +01:00
Andrew Kingston 1aed6f89d5 Merge 2023-04-18 21:06:04 +01:00
Andrew Kingston 9b2b071b88 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-18 21:00:42 +01:00
Michael Drury 42c37eea46 Merge pull request #10276 from Budibase/labday/automation-plugins
Automation step plugins
2023-04-18 17:33:25 +01:00
Andrew Kingston 91ee5be7c5 Disable row import button for users table and add optional chaining to spreadsheetsocket invocations to fix tests 2023-04-18 11:31:19 +01:00
Andrew Kingston 083836a87b Remove any naming of dataspaces 2023-04-18 10:46:35 +01:00
Andrew Kingston f9ab2a239f Restore builder middleware 2023-04-18 10:41:00 +01:00
Andrew Kingston a4515e1162 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-18 08:29:27 +01:00
mike12345567 9a36377d6e Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-17 18:10:29 +01:00
Andrew Kingston 208e481bbc Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-17 17:00:56 +01:00
mike12345567 b4e6cbce7a Some final updates to get tests passing again, issue with publisher tenant ID being the 'unique' format which cannot actually be used. 2023-04-17 15:59:59 +01:00
mike12345567 b6f14a3f55 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-17 14:58:40 +01:00
mike12345567 453d5cc0e6 Further PR comments. 2023-04-17 14:03:54 +01:00
adrinr e5227febd8 Use version from environment 2023-04-17 14:02:50 +01:00
Michael Drury ef5bcc4b66 Main body of PR comments, switching event handling to be a publisher of async events, a generic event; then adding a new async document update processor, which can later be converted to be part of the event processing pipeline. 2023-04-15 00:37:22 +01:00
mike12345567 c552913737 Fixing defaults in MS-SQL as well. 2023-04-14 18:10:10 +01:00
Pedro Silva 3147eb2892 Merge branch 'develop' into qa-core-datasource-api-tests 2023-04-14 17:59:40 +01:00
mike12345567 09ccac12ae Fix for default values with NOT NULL requirements being intepreted as requiring values in the frontend, presence check is now ignored if a default or auto value is found. 2023-04-14 17:56:17 +01:00
mike12345567 361005b521 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-13 17:23:58 +01:00
mike12345567 f87974caf1 Removing duplicate test case. 2023-04-13 13:10:51 +01:00
mike12345567 8f8843aece Updating test cases based on new user sync and removing old endpoint testcases (endpoint removed). 2023-04-13 12:53:25 +01:00
mike12345567 7da330624f Fixing build (again). 2023-04-13 12:17:29 +01:00
mike12345567 727aba9177 Fixing build. 2023-04-13 11:19:28 +01:00
Pedro Silva 695f77fd1d Add types for datasources endpoints 2023-04-13 11:13:21 +01:00
mike12345567 b2d7f24ff3 Adding builder test case. 2023-04-12 20:02:37 +01:00
mike12345567 23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567 1129d19412 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 17:09:29 +01:00
mike12345567 cb73e3b1c3 Fixing build issue. 2023-04-12 16:22:30 +01:00
mike12345567 a9fb09424b Merge branch 'develop' of github.com:Budibase/budibase into labday/automation-plugins 2023-04-12 14:27:50 +01:00
melohagan 3a5e31710c Add db prop to redis integration (#10210)
* Add db prop to redis integration

* Add DB display

* Default DB value to 0
2023-04-12 13:51:40 +01:00
mike12345567 3eb718ea6d Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 13:42:46 +01:00
mike12345567 ada052e043 Merging in develop - fixing some test cases which broke in the process. 2023-04-12 10:56:21 +01:00
Andrew Kingston 0ee63417c1 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-11 17:36:28 +01:00
mike12345567 e623820478 Adding test cases. 2023-04-11 17:33:52 +01:00
mike12345567 1aafdbe9a7 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-11 17:28:14 +01:00
mike12345567 ac37d00f69 Updating plugins to have a SDK, which can be used for automation action retrieval as well as datasources. 2023-04-11 16:37:26 +01:00
adrinr 9a330b85f8 Fix timeouts 2023-04-11 14:20:15 +01:00
Michael Drury 1c7c06e983 Bulk of the automation plugin system, supporting custom plugins. 2023-04-10 23:48:54 +01:00
Michael Drury 4badd04e33 Some automation fixes and adding option to disable logging for CLI. 2023-04-10 22:33:53 +01:00
mike12345567 400a112a4b Refactoring automation steps to be better defined in Typescript, which allows writing the validator for automations. 2023-04-06 18:11:44 +01:00
Michael Drury 58d0a82108 First sync test, checking that a user is created correctly. 2023-04-05 22:35:01 +01:00
Michael Drury 0771ec55fb Small change to make sure no duplicates ever occur. 2023-04-05 21:22:50 +01:00
Michael Drury 70c9d06832 Adding group management to background user/group sync. 2023-04-05 20:51:47 +01:00
mike12345567 0803b08217 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-05 17:59:18 +01:00
Rory Powell 77ffb8d86d Run integration suite in CI again / auto detect tenancy / refactors (#10209)
* qa-core-ci-fixes

* global setup and teardown wip

* Updates to logs and setup

* Remove date and console mocking

* Update CI to spin up minimal dev env

* Update readme

* Fix scopeBackend.sh

* Ensure docker services are initialised before starting worker

* Lint

* Fix admin user being created on startup (#10219)

* use regular bootstrap and build

* Lint

* Temp: re-use global setup to get around app limit in QA
2023-04-05 15:33:56 +01:00
adrinr 38535e8ef4 Format 2023-04-05 12:17:32 +01:00
adrinr ae9f91885f Fix flaky tests 2023-04-05 12:17:02 +01:00
mike12345567 e699f4684a Updating the global user sync to be more accurate and also remove old user metadata from apps that users don't have access to anymore. 2023-04-04 18:03:56 +01:00
Rory Powell 976b3a55ca Update logging to support dd trace attributes (#10086)
* Update logging middleware to integrate with pino for console logging

* Remove elastic apm references, use updated core middlewares

* Remove redundant LOG_LEVEL definitions

* Remove no longer needed jest logging overrides

* lint

* Backwards compat between console log helpers and pino

* Configurable DISABLE_HTTP_LOGGING

* Don't log 4xx as errors

* Remove redundant ENABLE_4XX_HTTP_LOGGING

* Cleanup migrations and event logging

* Improve bb-alert logging

* Add DISABLE_HTTP_LOGGING to helm chart

* Add ops endpoints for testing

* Disable http logging in dev

* Backwards compatible tracing implementation

* Naming update on http logging env var

* lint

* Update packages/backend-core/src/environment.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Merge

* Lint

* Fix console.warn failing mock by replacing with alerts mock instead

* Lint

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-04-04 15:08:46 +01:00
Michael Drury ff98ba5a0a Adding a document update queue based on the events which can be used to track when certain documents have changed, using this for users and groups to detect when a re-sync is needed. 2023-04-04 00:25:15 +01:00
mike12345567 29def1408a Fixing syntax error and linting. 2023-04-03 15:36:34 +01:00
Michael Drury 2f57b3b16d Merge pull request #10077 from robert4dt/develop
Handle application/pdf content type in rest integration
2023-04-03 15:30:03 +01:00
Peter Clement f2eced6ea4 Merge pull request #10180 from Budibase/fix/no-iterations-loop
Add new status to handle no iterations during loop
2023-04-03 12:00:15 +01:00
Michael Drury d3e749d2de Fix for 409 conflict which occurs in one of the user test cases - should stop it occurring in future. 2023-03-31 23:32:33 +01:00
Michael Drury 09a48a1d21 Merge branch 'develop' of github.com:Budibase/budibase into fix/no-iterations-loop 2023-03-31 23:29:21 +01:00
mike12345567 2e80bab7ad Removing requirement for built client library in component test case. 2023-03-31 17:13:25 +01:00
mike12345567 906d614c64 Merge branch 'merge-master-develop' of github.com:Budibase/budibase into merge-master-develop 2023-03-31 13:51:20 +01:00
Adria Navarro 7d794f005e Merge pull request #10162 from Budibase/bug/budi-6782-internal-table-all-row-ids-for
Bug - BUDI-6782 - Internal table all row ids for
2023-03-31 14:21:15 +02:00
Michael Drury 1c6465edcb Merge pull request #10172 from Budibase/fix/budi-6797
Googlesheets onboarding - fix in cloud, disable self host
2023-03-31 13:19:29 +01:00
Rory Powell e9322be28f Merge branch 'develop' into merge-master-develop 2023-03-31 12:39:22 +01:00
adrinr e8e77cc140 Use esbuild for server 2023-03-31 12:32:41 +01:00
Rory Powell 44aa19a99a Merge branch 'master' into merge-master-develop 2023-03-31 12:26:04 +01:00
Peter Clement 0a567a3302 add new status to handle no iterations during loop 2023-03-31 12:23:10 +01:00
Adria Navarro cfb93063b2 Merge pull request #10153 from Budibase/budi-6803-delete-users-when-group-removed
BUDI-6803 - Remove users that should not be there anymore when syncGlobalUsers
2023-03-31 13:15:11 +02:00
Andrew Kingston b2d2cf3989 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-03-31 12:08:58 +01:00
adrinr 4ca6982d27 Prevent double deletions 2023-03-31 11:25:51 +01:00
Rory Powell 79bec7d86d Add force exit, -e flag and streaming to tests (#10151)
* Add force exit, -e flag and streaming to tests

* Temp remove script usage from worker tests

* Revert "Temp remove script usage from worker tests"

This reverts commit 5e0ed2e92d.

* Always fail test

* Ignore server test package from coverage report

* Unscope server only

* Run all server tests again

* Update backend core test script to fail when any command fails and force exit

* Don't try to require client in test

* Port memory limit fix from develop

* Remove always failing test and commented out block for client require

* Fixing some issues with test cases.

* Revert assertions in internalSearch.spec.js

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-31 10:32:13 +01:00
adrinr 6a257bf9c3 Tweak tests 2023-03-31 09:01:40 +01:00
adrinr 48b964378b Remove all app cookie references (not really needed anymore) 2023-03-31 09:01:40 +01:00
mike12345567 42320b1d95 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6797 2023-03-30 17:29:58 +01:00
mike12345567 b19df9da22 Some final updates to get event spyOn working again. 2023-03-30 17:15:49 +01:00
adrinr 8e8f4ac02d Add extra assertion 2023-03-30 15:16:45 +01:00
adrinr 2dd8b078e5 Test removing users from group 2023-03-30 15:14:16 +01:00
adrinr b8fe9671b1 Rename test 2023-03-30 15:12:40 +01:00
Dean 3cba6109f6 First for meta card title override behaviour 2023-03-30 13:08:40 +01:00
Martin McKeaveney 586a31e4b9 Merge pull request #10141 from Budibase/fix/sample-data-auto-ids
fix auto columns in sample data
2023-03-30 12:25:54 +01:00
adrinr 8d45e44e2f Fix types 2023-03-30 11:30:35 +01:00
adrinr eb0d445295 Add test for autoid when importing 2023-03-30 10:37:38 +01:00
adrinr 6c610a3181 Types (with forced checks!) 2023-03-30 10:21:50 +01:00
adrinr 420cfd0f96 Fix autoids when importing internal data 2023-03-30 10:12:50 +01:00
mike12345567 32c78ec9bf This makes it so that Googlesheets works correctly as part of onboarding in the Cloud, in self host the googlesheets onboarding option has been hidden as it is too complex to get the user to setup the correct integrations with their google account while doing the first time onboarding to an app. 2023-03-29 19:58:24 +01:00
adrinr 301ad598ad Test user group deletion 2023-03-29 17:05:32 +01:00
adrinr efff31e181 Test user groups 2023-03-29 17:02:56 +01:00
adrinr 4cb6b99982 Types 2023-03-29 16:42:55 +01:00
adrinr 8783f0123d Add tests for admins vs app users 2023-03-29 16:42:31 +01:00
adrinr b368c14308 Add unit tests to test new users 2023-03-29 16:18:32 +01:00
adrinr e25429632b Remove users that should not be there anymore when syncGlobalUsers 2023-03-29 15:35:55 +01:00
mike12345567 7a18d19aa6 Merge branch 'master' of github.com:Budibase/budibase into merge-master-develop 2023-03-29 12:41:06 +01:00
mike12345567 e5ba70e7b4 Removing validation endpoint for external tables, always valid. 2023-03-29 12:16:14 +01:00
mike12345567 e10943e6f8 Removing external table validation - will have to come up with a best way to do this and a test suite for it. 2023-03-29 12:13:23 +01:00
mike12345567 25fd16f753 Revert "Revert "Merge pull request #10038 from Budibase/fix/budi-6723" (#10143)"
This reverts commit 89d19a87a7.
2023-03-29 12:12:38 +01:00
Rory Powell d6992bbf94 Merge branch 'master' into merge-master-develop 2023-03-29 11:52:09 +01:00
Rory Powell 89d19a87a7 Revert "Merge pull request #10038 from Budibase/fix/budi-6723" (#10143)
This reverts commit b1b18bef18, reversing
changes made to e841ccd0ed.
2023-03-29 08:48:06 +01:00
Andrew Kingston e0e5ca7a3c Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-03-28 15:47:53 +01:00
Martin McKeaveney fa30769ddb fix auto columns in sample data 2023-03-28 14:58:22 +01:00
melohagan 9e8ab55e18 Lowercase values for Oracle LIKE (#10134) 2023-03-28 11:46:29 +01:00
Dean 8557c307dd Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-28 11:19:08 +01:00
Rory Powell cd3b2ba199 Lint 2023-03-27 22:39:35 +01:00
Rory Powell 60650b031b Move branding read behind pro 2023-03-27 22:28:25 +01:00
mike12345567 2e0e5a0aa8 Merge branch 'fix/budi-6657' of github.com:Budibase/budibase into fix/budi-6657 2023-03-27 19:39:08 +01:00
mike12345567 cf5316ec8d General fixes for open handles, attempting to find and close all issues in server which are stopping shutdown of Jest suite. 2023-03-27 19:38:49 +01:00
Michael Drury 669c4ebd5c Fix for currentapp build issue. 2023-03-22 17:46:37 +00:00
mike12345567 926ee18703 Updating Jest to latest 29.5.0 and then fixing snapshots to work with this - also setting worker memory limits for Node 16.10+ - where a leak can occur. 2023-03-21 19:52:06 +00:00
mike12345567 82286d519f Fixing some issues with test cases. 2023-03-21 17:27:31 +00:00
mike12345567 1c73b92595 Fix for app sync, base it on group roles, not just user roles - stops app sync from pulling in group users which do not actually have access to the app. 2023-03-21 13:55:28 +00:00
Dean bfd7e49c72 Template fixes and updates to the file picker. Error handling added to display a warning when navigating to an unpublished or invalid app url. 2023-03-21 09:20:43 +00:00
Michael Drury 34e8009f08 Merge pull request #9949 from Budibase/fix/blacklist
Blacklisting
2023-03-20 10:33:11 +00:00
T4DT GmbH 9a4ab17c53 Update rest.ts 2023-03-20 11:31:45 +01:00
Dean ce33afdeae Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-16 09:07:58 +00:00
Dean 253ee413a2 Working commit 2023-03-16 09:07:21 +00:00
Rory Powell de89b9112a Simplify errors framework (#10042)
* Simplify errors framework

* Use enum for ErrorCode

* Lint

* Update base BudibaseError type to use enum

* For for public error on UsageLimitError

* Build fix

* Build fix
2023-03-16 08:42:02 +00:00
mike12345567 6174b6ae18 Squashing #10024 for master merge. 2023-03-15 14:16:45 +00:00
Dean c7e54947a8 Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 10:28:08 +00:00
Dean f3b58923cf Merge remote-tracking branch 'origin/develop' into feature/whitelabelling 2023-03-15 09:13:36 +00:00
mike12345567 79f2e9d970 Fixing build issue. 2023-03-14 17:04:25 +00:00
mike12345567 859ec85fe9 Fix for schema endpoint, needed secrets removed as well. 2023-03-14 16:13:28 +00:00
mike12345567 f2484eafec Fix for spaces in table names (external). 2023-03-14 16:13:14 +00:00
Peter Clement cc4a911505 Merge pull request #9984 from Budibase/fix/automation-saving-fix
Fix issue with saving of automation fields
2023-03-14 14:39:24 +00:00
mike12345567 c2de0ade7d Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6723 2023-03-14 14:25:46 +00:00
mike12345567 63cf91218d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-03-14 14:12:32 +00:00
mike12345567 da9e1bed64 Fix for googlesheets issue - when table initially created doesn't have the correct schema, adding a function to handle static schemas like Gsheets. 2023-03-14 12:11:01 +00:00
melohagan 878bc65eb2 Add missing readable flag (#10016) 2023-03-14 10:06:01 +00:00
mike12345567 3d84409a58 Making sure created flag gets carried across for external tables. 2023-03-13 18:18:04 +00:00
mike12345567 65ada7f8b2 Adding back a base column for sheet creation. 2023-03-13 18:10:35 +00:00
mike12345567 2a1f215351 Removing relationship option from Googlesheets as it doesn't add value, as well as multi-select as it can't really be supported. Also fixing issues with re-fetching after adding some special column types./ 2023-03-13 18:04:29 +00:00
mike12345567 d3464ce166 Adding mechanism for bulk creation of rows in gsheets, used for CSV imports. 2023-03-13 17:21:04 +00:00
mike12345567 6b8d0ca9dd Adding mechanism for verifying the Budibase properties, such as required and min/max as part of the external API. 2023-03-13 16:21:22 +00:00
Rory Powell e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
Dean 5ce52cad06 Working commit 2023-03-13 12:33:16 +00:00
Andrew Kingston 909118d398 Merge branch 'develop' of github.com:Budibase/budibase into just-dataspace-things 2023-03-13 11:30:18 +00:00
mike12345567 9037ab86d5 Adding an error for XLSX type sheets not working, adding the sheets URL as an option for google config (should be added to redirect URL) and fixing some error states. 2023-03-10 18:46:48 +00:00
Michael Drury c553f053fe Merge pull request #9965 from Budibase/budi-6667-change-oracle-db-name-to-service-name
Change Database to Service Name in Oracle config
2023-03-10 16:38:06 +00:00
mike12345567 ddaafe6379 Merge branch 'master' of github.com:Budibase/budibase into fix/9886 2023-03-10 14:49:41 +00:00
Peter Clement bd7c91b1bd Fix automation saving issue 2023-03-10 14:47:26 +00:00
Michael Drury 5eabe9db22 Merge pull request #9779 from Budibase/jonny/api-metrics
metrics api endpoint
2023-03-10 12:12:51 +00:00
Andrew Kingston c4e3667b6c Merge branch 'develop' of github.com:Budibase/budibase into just-dataspace-things 2023-03-09 17:54:58 +00:00
Rory Powell c33ea4dcfe Update deployment templates to remove unused cdn url and fix empty env vars (#9967) 2023-03-09 16:13:26 +00:00
Mel O'Hagan ad7bda17bb Change database to Service Name in oracle 2023-03-09 15:52:16 +00:00
Adria Navarro 63afd34eb2 Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 12:25:12 +00:00
Adria Navarro 158703daef Bug - BUDI-6068 filters do not work for google sheets (#9886)
* Add data-utils with filters

* Create data-utils

* Add data-utils to compiled code

* Reuse constants

* Fix tests

* Rename package to shared-core

* Namespace export shared-core

* Rely on rollup to bundle shared-core

* Revert "Rely on rollup to bundle shared-core"

This reverts commit e8b5a2bb9a.

* Updating version and removing private.

* Update version

* Increment versions.

* Implement sort

* Enabling sort

* v2.3.21-alpha.2

* Fix build

* Improve readability

* Move deepGet to shared helper

* Better type usage

* Fix types

* Configure types

* Fix vite refs

* Add dep

* Fixing depencencies on client

* Add missing dev command

* Fix loading issues

* Update versions to latest

* Multiple es6 and commonjs configs

* Config

* Use local packages on rollup for client

* Change shared-core and types entry points

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-09 08:50:26 +00:00
mike12345567 564c724be1 Provides the option for blacklisting IPs. 2023-03-08 16:30:26 +00:00
melohagan a8f873fff3 Try/catch automation Create Row relationship (#9924)
* Try/catch

* Increase height of automation test output

* Unit tests

* lint
2023-03-08 13:39:18 +00:00
Peter Clement 1abab9421e Merge pull request #9915 from Budibase/fix/9441-group-roles
fix roleId being undefined leading to group role overriding incorrectly
2023-03-07 16:01:53 +00:00
mike12345567 0342d409c3 Fix for #9790 - formulas never exist in the database and so were always being considered deleted, handling this. 2023-03-07 15:29:58 +00:00
Peter Clement 1cb03c7603 fix roleId being undefined leading to groups override 2023-03-07 13:30:24 +00:00
mike12345567 0026f86cc6 Fixing operation ID. 2023-03-06 17:41:24 +00:00
mike12345567 36683459b8 Updating metrics endpoint to have examples of expected data format - show OpenMetrics response. 2023-03-06 15:55:55 +00:00
mike12345567 13ae950101 Updating test case. 2023-03-06 15:31:27 +00:00
mike12345567 c51b9fb4b3 Merge branch 'develop' of github.com:Budibase/budibase into jonny/api-metrics 2023-03-06 15:23:35 +00:00
Andrew Kingston b93f575bca Add popovers to sheet column headers, improve mouse UX 2023-03-06 15:09:42 +00:00
Jonny McCullagh cbc377b0f4 unit tests 2023-03-06 11:51:49 +00:00
Andrew Kingston 4647e1bc07 Fix issues with not disconnecting users when swapping datasource and improve multi-user UI 2023-03-06 11:20:47 +00:00
Martin McKeaveney 26660b12fb PR comments 2023-03-06 10:33:49 +00:00
Martin McKeaveney edac525424 remove import 2023-03-06 10:24:45 +00:00
Martin McKeaveney e8c73cdee0 return gsheets config in test regardless 2023-03-06 10:22:32 +00:00
Andrew Kingston 3e907af8b5 Add WIP multi-user UI for sheet interface 2023-03-06 07:43:45 +00:00
Andrew Kingston 36c953443f Add WIP initial multi-user websocket implementation for sheets 2023-03-05 18:57:05 +00:00
mike12345567 5b150e7748 Removing migration change and fixing #9738 - making sure that exports with excludeRows enabled don't include attachments. 2023-03-01 19:43:40 +00:00
mike12345567 eba18a4159 Fix for #9739 - there was an issue with the mango syntax, when working with multi attachment columns it was using an AND comparator instead of OR, it should be searching for rows that contain any attachment column, not all attachment columns. 2023-03-01 19:01:13 +00:00
Michael Drury 4abb2801f0 Merge pull request #9828 from Budibase/fix/9778
Fix for operationId in OpenAPI specs
2023-03-01 13:09:16 +00:00
mike12345567 cb39053b12 Fix for #9778 - there was an issue with operationId in the OpenAPI spec, these need to be unique to be compliant with the spec as brought up in the issue. Also re-writing the spec generation to Typescript to be compliant with how backend code is now written. 2023-02-28 18:10:56 +00:00
Andrew Kingston a28148d9f8 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-abs 2023-02-28 13:59:37 +00:00
Michael Drury fcb9f3e116 Merge pull request #9815 from Budibase/bug/budi-6076-cannot-delete-columns-in-google-sheet
Bug - budi-6076 cannot delete columns in google sheet
2023-02-28 13:56:32 +00:00
Rory Powell 312c01a879 Prefer default config for google sheets in cloud, don't use env vars for regular auth 2023-02-28 10:36:29 +00:00
adrinr b05d568518 Merge remote-tracking branch 'origin/develop' into bug/budi-6076-cannot-delete-columns-in-google-sheet 2023-02-27 17:45:37 +01:00
adrinr f017f0d54e Catch issue on test 2023-02-27 17:41:42 +01:00
adrinr f85ea527bd Add tests for adding/removing columns in a google spreadsheet 2023-02-27 17:25:48 +01:00
adrinr abe06a127a Types 2023-02-27 17:25:26 +01:00
mike12345567 2fb33e2cf3 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-27 14:51:33 +00:00
Rory Powell 2e829ce8a6 Merge pull request #9785 from Budibase/configs-refactor-and-server-test-fixes
Configs /  Server tests / Failing real email tests updates
2023-02-27 14:00:21 +00:00
adrinr 30fde61d4d Handle deletes 2023-02-27 13:33:19 +01:00
mike12345567 65646ba01b Further PR comments. 2023-02-27 11:00:13 +00:00
mike12345567 8853776c79 Moving around processors to separate audit logs out of central event handling. 2023-02-24 13:52:54 +00:00
mike12345567 58fab29fb4 Main body of PR comments. 2023-02-24 13:32:45 +00:00
mike12345567 f070be5f65 Moving search index to an enum. 2023-02-24 13:15:14 +00:00
mike12345567 42fc004212 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-24 12:46:58 +00:00
adrinr d5fd635d6c Remove @ts-ignore 2023-02-24 11:26:05 +01:00
adrinr 045822d65e Dry 2023-02-24 11:24:29 +01:00
adrinr 2fc97189e5 Merge remote-tracking branch 'origin/develop' into bug/budi-6619/cannot_update_relationships_in_postgresql_many_to_one 2023-02-24 11:12:07 +01:00
adrinr d6363f07b3 Renamings 2023-02-24 10:51:55 +01:00
adrinr 2e45f94d79 Improve verbosity 2023-02-24 10:47:32 +01:00
Andrew Kingston b8e7e0b701 Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-spreadsheet 2023-02-23 16:41:08 +00:00
Andrew Kingston 8cd7ba1fdf Undo/Redo for Design and Automate sections + automations refactor (#9714)
* Add full undo/redo support for screens

* Add loading states to disable spamming undo/redo

* Add keyboard shortcuts for undo and redo

* Fix modals not closing in design section when escape is pressed

* Remove log

* Add smart metadata saving to undo/redo

* Add error handling to undo/redo

* Add active state to hoverable icons

* Fix screen deletion

* Always attempt to get latest doc version before deleting in case rev has changed

* Move undo listener top level, hide controls when on certain tabs, and improve selection state

* Add tooltips to undo/redo control

* Update automation section nav to match other sections

* Fix automation list padding

* Fix some styles in create automation modal

* Improve automation section styles and add undo/redo

* Update styles in add action modal

* Fix button size when creating admin user

* Fix styles in add automation step modal

* Fix issue selecting disabled automation steps

* Reset automation history store when changing app

* Reduce spammy unnecessary API calls when editing cron trigger

* WIP automation refactor

* Rewrite most automation state

* Rewrite most of the rest of automation state

* Finish refactor of automation state

* Fix selection state when selecting new doc after history recreates it

* Prune nullish or empty block inputs from automations and avoid sending API requests when no changes have been made

* Fix animation issues with automations

* Sort automations and refetch list when adding or deleting

* Fix formatting

* Add back in ability to swap between values and bindings for block inputs

* Lint

* Format

* Fix potential issue in design section when selected screen is unset

* Fix automation arrow directions everywhere, tidy up logic and fix crash when using invalid looping

* Lint

* Fix more cases of automation errors

* Fix implicity any TS error

* Respect _id specified when creating automations

* Fix crash in history store when reverting a change on a doc whose ID has changed

* Lint

* Ensure cloneDeep helper doesn't crash when a nullish value is passed in

* Remove deprecated frontend automation test

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-02-23 13:55:18 +00:00
Rory Powell 4e1bebe897 Server flaky tests fixes - improving tenancy config 2023-02-23 13:43:27 +00:00
Rory Powell d3a7286711 Configs updates: remove circular deps, dedicated module, typing improvements, reduce db reads 2023-02-23 13:41:35 +00:00
adrinr 5207f51080 Test enrich for all relationship types 2023-02-23 10:50:18 +01:00
adrinr 7868fc657d Fix many-to-one tests 2023-02-23 10:39:16 +01:00
adrinr 9e0d003038 Fix creation 2023-02-23 10:28:24 +01:00
adrinr 70689c0369 Fix tests 2023-02-23 00:06:57 +01:00
adrinr 83649f1959 Setup o2m and m2m relationships 2023-02-22 22:40:50 +01:00
Jonny McCullagh dde1237ed2 allUsers function & more metrics 2023-02-22 21:10:35 +00:00
adrinr f00994af7f Fix wrong relationship mapping 2023-02-22 17:18:05 +01:00
adrinr 8c906c1681 Merge remote-tracking branch 'origin/develop' into bug/budi-6619/cannot_update_relationships_in_postgresql_many_to_one 2023-02-22 15:00:41 +01:00
adrinr 63af59a5b0 Handle link fields 2023-02-22 14:59:42 +01:00
Rory Powell 4b85583f5f Update builder and authorized middleware to be more strict towards unauthenticated (#9774)
* Update builder and authorized middleware to be more strict towards unauthenticated

* Remove unnecessary variable
2023-02-22 13:39:31 +00:00
adrinr e350f6b166 Undo literal changes 2023-02-22 11:02:32 +00:00
adrinr b9c54b6fe6 Update many to many 2023-02-22 10:54:55 +00:00
mike12345567 22f42ef898 Adding new mechanism to get the ipAddress and userAgent of call for audit logs. 2023-02-21 19:14:57 +00:00
mike12345567 ef30c03fa6 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-21 17:26:24 +00:00
mike12345567 41eb0c3964 Updating worker db config to have replication available (for audit logs). 2023-02-21 17:22:23 +00:00
Rory Powell 940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
mike12345567 f7f9e63fe8 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-21 16:53:28 +00:00
adrinr e0242d0883 Fix the many to one updates 2023-02-21 16:29:18 +00:00
adrinr be81767a46 Replace maps for foreach 2023-02-21 15:57:56 +00:00
adrinr e0b3976ee4 Add return select statement back on update 2023-02-21 15:57:04 +00:00
adrinr 1ada790d50 Fix postgres update for relationships 2023-02-21 15:21:00 +00:00
adrinr ea8e779d10 Merge remote-tracking branch 'origin/develop' into test/fix_foreigndata_pg_test 2023-02-21 11:37:16 +00:00
adrinr 483f15a5d6 Add explicit check for the foreign field 2023-02-21 09:51:07 +00:00
adrinr 3c5d5f4c25 Fix relation get test to test expected behaviour 2023-02-21 09:42:56 +00:00
Rory Powell cacf275a99 Prevent SSO users from setting / resetting a password (#9672)
* Prevent SSO users from setting / resetting a password

* Add support for ENABLE_SSO_MAINTENANCE_MODE

* Add typing to self api and build out user update sdk

* Integrate sso checks with user sdk. Integrate user sdk with self api

* Test fixes

* Move self update into SDK

* Lock down maintenance mode to admin user

* Fix typo

* Add health status response and return type signature to accounts.getStatus

* Remove some unnecessary comments

* Make sso save user function non optional

* Remove redundant check on sso auth details provider

* Update syncProfilePicture function name to getProfilePictureUrl

* Update packages/worker/src/sdk/users/events.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Add ENABLE_EMAIL_TEST_MODE flag

* Fix for logging in as sso user when existing user has password already

* Hide password update and force reset from ui for sso users

* Always disable sso maintenance mode in cloud

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-02-21 08:23:53 +00:00
Jonny McCullagh a908125ea3 add metrics endpoint to api 2023-02-20 19:56:04 +00:00
Andrew Kingston 654c348e4e Generate inclusion schema when importing multiselect columns 2023-02-20 18:46:06 +00:00
mike12345567 1eb2307fed Fix for #9749 - static formulas would sometimes attempt to update the same row multiple times, filter down to just the unique row list which requires updating. 2023-02-20 15:35:14 +00:00
mike12345567 b60013cbb8 switching metadataSearch to fullSearch. 2023-02-20 11:29:43 +00:00
Rory Powell a57f0c9dea Merge branch 'develop' into rory/february 2023-02-20 09:57:17 +00:00
mike12345567 6ec5e97ce9 Required work to support the new lucene audit logs search indexing. 2023-02-17 16:26:55 +00:00
melohagan 8fe0cdf89f Handle webhook errors (#9715) 2023-02-16 16:23:44 +00:00
mike12345567 6d83ea9bec Adding in event auditing to server/worker. 2023-02-15 18:03:55 +00:00
Jonny McCullagh c5bc0d4ffb add datadog apm (#9693)
* add datadog apm

* datadog init not start

* extra env vars for DD APM

* add datadog apm

* datadog init not start

* extra env vars for DD APM

* add datadog apm

* remove space

* Enable typescript integration with apm agents

* Fix typo

---------

Co-authored-by: Jonny <Jonny McCullagh>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2023-02-15 16:28:20 +00:00
Rory Powell bb1faac62a Merge master into develop 2023-02-15 15:10:02 +00:00
mike12345567 1ed4f4b8fe Update on audit logs, getting the full write flow from events configured. 2023-02-15 12:37:32 +00:00
mike12345567 6977502d01 Merge branch 'develop' of github.com:Budibase/budibase into feature/audit-logs 2023-02-15 11:29:04 +00:00
melohagan fb74956c93 Date filter freeze fix (#9635)
* Filter with enrichedSchemaFields

* Handle empty object values in date range
2023-02-15 09:27:44 +00:00
mike12345567 3f7f66257d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-14 17:57:23 +00:00
mike12345567 015f95aa6d Quick fix to add the ability to update the app-service HTTP MB max limits. 2023-02-14 16:40:57 +00:00
mike12345567 05ceee1cfe Moving lucene handling to backend-core so that it can be used for other databases (outside row indexes). 2023-02-13 17:13:59 +00:00
Rory Powell cc7eb64a3b Rename LOG_4XX to ENABLE_4XX_HTTP_LOGGING and enable by default 2023-02-13 14:39:24 +00:00
Rory Powell 0e3a17ab18 Merge pull request #9669 from Budibase/budi-6558-configurable-test-log-levels-and-common
Configurable test log levels and common error handling
2023-02-13 14:31:43 +00:00
Rory Powell ae9979929a Enable higher concurrency and resiliency in worker tests 2023-02-13 11:57:30 +00:00
Rory Powell 5cd6cb166a Configurable test log levels and common error handling 2023-02-13 11:53:01 +00:00
mike12345567 7def2059f7 Updating test case which has been occasionally throwing 409 issues. 2023-02-10 18:29:29 +00:00
mike12345567 0c80ea2083 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-10 17:42:56 +00:00
mike12345567 3859a4159f Minor fix for automations, the wrong function had the environment variables being added to environment, this is very minor, it simply makes sure that environment variables are in context for the whole of the automation runner - e.g. if utilising many datasources each of them doesn't need to re-retrieve the environment variables, instead they will be available based on the env vars retrieved at the start of the execution. 2023-02-10 14:14:43 +00:00
mike12345567 4acfae6af6 Updating so that datasources always have correct types after environment variable enrichment. 2023-02-10 12:47:23 +00:00
mike12345567 f8ef06c849 Fix issue with MS-SQL, port needs to be a number for the node-mssql package, with env vars it isn't anymore. 2023-02-10 11:54:16 +00:00
Andrew Kingston cadadca048 Generate option inclusion constraint (#9647)
* Fix options inclusion constrant not being generated when creating a table from file upload

* Fix 0 being treated as null when specifying min and max constraints for number fields

* Sort newly generated option field inclusion constraints

* Revert previous solution and fix problem by removing incorrect local assignment statement
2023-02-10 11:00:20 +00:00
melohagan e33aaff312 Replace ts-ignore with 400 if needed (#9621) 2023-02-09 11:46:41 +00:00
Rory Powell c05b063f10 Bump CI default unit test timeout to 10s 2023-02-09 09:19:31 +00:00
mike12345567 0d21801ece Fix based on testing. 2023-02-08 19:44:17 +00:00
mike12345567 68912f8030 Minor fix for the plugin datasource error that occurred when opening apps in an environment where the datasource no longer exists. 2023-02-08 19:17:15 +00:00
mike12345567 ced811fc23 Another quick fix. 2023-02-07 18:35:22 +00:00
mike12345567 1a52bd8a50 Fixes based on test runs. 2023-02-07 18:11:33 +00:00
Mateus Badan de Pieri 89bad2d45a Merge branch 'develop' into tests/environment-variables 2023-02-07 16:15:57 +00:00
Mateus Badan de Pieri 7c702cd0ac update tests
remove comments
2023-02-07 15:47:11 +00:00
Michael Drury a353848152 Merge pull request #9368 from Budibase/test/9339-sqlpostgres-row-api-test-suite
Test - #9339 sqlpostgres row api test suite
2023-02-07 15:38:09 +00:00
adrinr 452147c308 Cleanup tests 2023-02-07 12:45:41 +00:00
adrinr 2cdc2f3fec Fix select statement when no resource 2023-02-07 12:29:58 +00:00
adrinr 3d917bfe22 Fix conflicting columns issue 2023-02-07 12:25:02 +00:00
adrinr bc0208bc83 Clean describes 2023-02-07 11:27:46 +00:00
mike12345567 ee05ea959a Adding longer timeout. 2023-02-07 10:50:11 +00:00
adrinr 79e42abc1e Tidy tests 2023-02-07 10:46:34 +00:00
mike12345567 173f62f8f3 Test fix. 2023-02-07 10:16:40 +00:00
adrinr 7474099bac Fix pg test 2023-02-07 10:12:42 +00:00
mike12345567 464ab7a1bb Merge branch 'develop' of github.com:Budibase/budibase into fix/cli-memory-issues 2023-02-07 09:56:49 +00:00
Adria Navarro afa282ecbf Fix sql when no resource 2023-02-06 20:47:49 +00:00
Adria Navarro 015a91c183 Increase timeout 2023-02-06 20:12:08 +00:00
Adria Navarro 71199c06ec Stop container after tests 2023-02-06 19:49:30 +00:00
Adria Navarro 4908cc5387 Spin up postgres only on the postgres test 2023-02-06 19:43:08 +00:00
mike12345567 9339213910 Merge. 2023-02-06 18:00:42 +00:00
mike12345567 4d86df057b Some fixes for #8770 - the CLI was very memory intensive when working with large databases, that contained many revisions. We don't need the revisions for app exports/backups, therefore I've updated our export systems to drop the revision history as it compacts the database significantly and speeds up exports/reduces memory usage. 2023-02-06 17:54:40 +00:00
adrinr c87efb7866 Don't return foreign keys on updates and deletes 2023-02-06 17:37:00 +00:00
adrinr 29503d1244 Fix tests 2023-02-06 17:30:33 +00:00
adrinr 3d9a208bfb Fix tests 2023-02-06 14:54:49 +00:00
adrinr 9bb1a2fa18 Merge remote-tracking branch 'origin/develop' into test/9339-sqlpostgres-row-api-test-suite 2023-02-06 09:12:13 +00:00
Adria Navarro 5ee9073d9b Merge pull request #9419 from Budibase/feature/dependencies-image
Chore - use testcontainers
2023-02-06 09:09:07 +00:00
Martin McKeaveney 8b133b97fb fix build 2023-02-05 23:12:08 +00:00
Martin McKeaveney d4a0e44b31 merge 2023-02-05 22:11:37 +00:00
Adria Navarro 774b50232c Increase timeouts 2023-02-05 10:34:42 +00:00
Adria Navarro 2f2c8a50cc Flaky test 2023-02-05 10:33:21 +00:00
Adria Navarro 0a47b35285 Flaky test 2023-02-05 10:00:27 +00:00
Adria Navarro 4522d6c906 Fix flaky test 2023-02-05 09:04:47 +00:00
Adria Navarro 9703564283 Add onClose back in tests 2023-02-04 20:30:12 +00:00
Adria Navarro c78038f059 Dont close server on tests 2023-02-04 18:51:10 +00:00
mike12345567 3b43943f1f Some quick scripts for loading a lot of rows and apps. 2023-02-03 19:29:28 +00:00
adrinr 11a7742d90 Cleanup 2023-02-03 19:23:36 +00:00
adrinr 420cb36ca7 Replace beforeeach for before alls 2023-02-03 19:02:40 +00:00
adrinr fe8853580e Tweak tests 2023-02-03 18:40:25 +00:00
adrinr da656f54fe Change before each for before all 2023-02-03 18:08:29 +00:00
adrinr 9f8522a901 Improve link controller tests 2023-02-03 17:59:15 +00:00
adrinr bc09cb76f1 Improve row tests 2023-02-03 17:55:40 +00:00
adrinr 4cab97b8ab Improve automation tests 2023-02-03 17:49:21 +00:00
adrinr 4a8db61b6b Fix automation timeouts 2023-02-03 16:28:29 +00:00
adrinr 83f8e6ef2c Remove long timeout 2023-02-03 14:51:50 +00:00
adrinr 2e29ac9ec7 Rename name for id 2023-02-03 12:09:56 +00:00
adrinr 4b4b9cce08 Fix ts 2023-02-03 11:30:30 +00:00
adrinr 5d58fc5948 Dry 2023-02-03 11:28:27 +00:00
Peter Clement 8e480ac884 check postgres has been called 2023-02-03 09:19:27 +00:00
Peter Clement cdc55a0c32 use correct postgres mock 2023-02-03 09:15:40 +00:00
Mateus Badan de Pieri 126b475c32 updated 2023-02-02 15:14:54 +00:00
Mateus Badan de Pieri b2d18d13f5 updated tests 2023-02-02 14:39:33 +00:00
adrinr 60beb4f982 Merge branch 'develop' into feature/dependencies-image 2023-02-02 13:49:45 +00:00
adrinr a80fc4aaa8 Remove isDockerisedTest 2023-02-02 10:50:20 +00:00
adrinr 3328c908ff Fix tests after merge 2023-02-02 10:43:18 +00:00
adrinr 4eb0c07953 Merge branch 'feature/dependencies-image' into test/9339-sqlpostgres-row-api-test-suite 2023-02-02 10:12:33 +00:00
Rory Powell 71292d3786 Fix server build by removing unused dependency on file path in backend-core 2023-02-02 09:26:39 +00:00
adrinr c7d0a077be Replace faker for chance 2023-02-01 17:11:50 +00:00
Adria Navarro b125b5478b Merge branch 'develop' into feature/dependencies-image 2023-02-01 16:32:00 +00:00
Michael Drury dfeb41ee53 Merge pull request #9493 from Budibase/fix/8236
CouchDB integration fixes
2023-02-01 13:55:03 +00:00
mike12345567 048cf8f188 PR comments. 2023-02-01 13:01:38 +00:00
melohagan 7ce31d64cb Fix/elastic search delete (#9492)
* Make sure json param isn't included in delete

* lint
2023-02-01 12:47:38 +00:00
adrinr 1d8c27bdc4 Increase timeout 2023-02-01 12:29:03 +00:00
adrinr 34278349c3 Merge branch 'develop' into feature/dependencies-image 2023-02-01 10:56:22 +00:00
adrinr abe3e2921f Race conditions 2023-01-31 22:50:52 +00:00
mike12345567 f4379fcb4f Updates to use our new Nano layer for CouchDB integration rather than PouchDB. 2023-01-31 19:49:31 +00:00
adrinr 2ab3680538 Fix installation race conditions 2023-01-31 17:27:25 +00:00
adrinr abdd658012 Prepopulate dbs 2023-01-31 16:51:08 +00:00
adrinr b2813db5db Handle db creation race conditions 2023-01-31 16:15:11 +00:00
deanhannigan 7540cad45c Merge pull request #9467 from Budibase/feature/auth-screens-redesign
Selfhost onboarding UX/UI updates
2023-01-31 16:13:46 +00:00
deanhannigan fb472b0f42 Merge pull request #9025 from Budibase/feature/configurable-data-export
Filtering and sort on data row export
2023-01-31 15:35:12 +00:00
mike12345567 263d588191 Environment variable test base. 2023-01-31 15:27:16 +00:00
Dean 680a9acb4f Merge remote-tracking branch 'origin/develop' into feature/configurable-data-export 2023-01-31 15:08:46 +00:00
adrinr dd2a05fdcb Looking for testcontainer config 2023-01-31 11:23:26 +00:00
adrinr 2b8190418c Log as error 2023-01-31 10:30:57 +00:00
adrinr 9536111811 Add more logs 2023-01-31 10:21:19 +00:00
melohagan 919323b500 Fix/automation update deletes relationship (#9468)
* Add padding to text field input

* Apply padding to modal binding input

* Support relationships in automation bindings

* Trim automation field keys

* Trim automation field name

* Empty string check

* Add checkbox for clearing relationships update row

* Added state for automation field metadata

* clearRelationships updateRow check

* Padding tweak
2023-01-31 10:11:56 +00:00
Adria Navarro 16e53957bc Merge branch 'develop' into feature/dependencies-image 2023-01-30 18:54:05 +00:00
adrinr d160430ac8 Start race condition 2023-01-30 18:51:22 +00:00
mike12345567 c2eb8fb976 Update to cover the authentication for REST, replacing it with secret value and converting to password field, as well as minor update to env dropdown to only be a password field when not containing an environment variable - #9480. 2023-01-30 18:50:35 +00:00
adrinr 08a2e77871 Fix jest.setup 2023-01-30 18:18:23 +00:00
mike12345567 49da99c8ac Adding context update to test case since it used to rely on the context update functionality. 2023-01-30 10:59:54 +00:00
mike12345567 ec719b251c Adding test case for secret-value replacement, to confirm that datasources API correctly replaces secret values with the actual secret. 2023-01-27 18:27:03 +00:00
mike12345567 fec16e23a0 Fixes for tests, allow any handlebars for datasources (dynamic vars). 2023-01-27 18:06:39 +00:00
Dean 4745b6d2bd Expanding mime check for cloud tarball import 2023-01-27 18:01:12 +00:00
mike12345567 3a40a64d15 Updating datasources to use new onlyFound option. 2023-01-27 15:21:04 +00:00
mike12345567 d667276fa1 Adding a onlyFound option to our handlebars system so that we can enrich only the parts we have and leave other components for further enrichment. 2023-01-27 15:15:07 +00:00
mike12345567 6e3f87c798 Fixing issue with apps not being created correctly due to the recent update to context. 2023-01-27 13:37:36 +00:00
Rory Powell da2c809a09 Merge branch 'develop' into feature/environment-variables 2023-01-27 11:27:11 +00:00
adrinr cae83684ea Remove wrong createApp 2023-01-26 18:24:20 +00:00
adrinr 7027abeaa2 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
mike12345567 b38399cb74 Adding test cases as per PR comments. 2023-01-26 18:20:21 +00:00
mike12345567 27b472b662 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-26 18:20:21 +00:00
Adria Navarro Redo b94546b1a1 Fix user test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 33f1628000 Fix issues with parallel tests and self/cloud modes 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 8c1e539fc7 Fix date related tests 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 6a4fe1d5e6 Fix automation test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 9242470f6f Fix snapshots test 2023-01-26 18:20:21 +00:00
Adria Navarro Redo a54c1a1647 Set expected id 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 8c68741f98 Fix application delete tests 2023-01-26 18:20:21 +00:00
Adria Navarro Redo 067462f458 Use multitenancy for tests 2023-01-26 18:20:21 +00:00
adrinr 74269dbb27 Fix timespan issues 2023-01-26 18:20:05 +00:00
mike12345567 697cd8b4ea Adding test cases as per PR comments. 2023-01-25 18:27:58 +00:00
Adria Navarro 8f186041ac Don't create the apps on test 2023-01-25 10:13:35 +00:00
mike12345567 fe7b632727 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-24 19:09:36 +00:00
mike12345567 6349b08888 Don't check whether or not a datasource uses env vars when the function specifically includes the env vars, always fetch them so that they can be returned and put into context for queries to use. 2023-01-24 18:56:19 +00:00
Adria Navarro 6259ffad3b Wipe db before tests 2023-01-24 18:51:15 +00:00
Adria Navarro 9371f19419 Remove mocks 2023-01-24 17:48:49 +00:00
Adria Navarro 26fa3bd484 tweak tests 2023-01-24 15:46:50 +00:00
Peter Clement 22e1c1cccf ensure object is passed to processObjectSync 2023-01-24 15:44:34 +00:00
Adria Navarro 4df4494d00 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:43:36 +00:00
Adria Navarro 17f6c505e0 Merge branch 'develop' into feature/test-image
# Conflicts:
#	packages/worker/yarn.lock
2023-01-23 18:40:44 +00:00
Adria Navarro 6806404465 Merge branch 'feature/test-image' into feature/dependencies-image 2023-01-23 18:08:19 +00:00
Adria Navarro d1d8ce3611 Move more stuff to .env.test 2023-01-23 18:02:28 +00:00
Adria Navarro d6f0e5b1ec Dry, moving env variables to a .env.test file 2023-01-23 17:41:32 +00:00
Adria Navarro 98aa60879f Set parameters 2023-01-23 16:53:34 +00:00
melohagan 0daacf3425 Add fields for MongoDB SSL cert file paths (#8260)
* Added fields for tls certificate files

* lint

* Only include cert fields if SELF_HOSTED

* lint

* Refactor getSchema function

* Add datasource field group with accordion

* Handle no display column on fieldGroup field

* Override text transform accordian header

* Renamed from TLS to SSL in UI config

* readable flag

* Add accordion component

* Refactor
2023-01-23 16:46:02 +00:00
Adria Navarro 106563c449 Use couchdb from docker container 2023-01-23 16:45:06 +00:00
Dean 45b907cfde Merge remote-tracking branch 'origin/develop' into feature/configurable-data-export 2023-01-23 11:43:15 +00:00
melohagan 19696fb1fe Treat bigint as string (#8877)
* Make bigint string type

* Handle BigInt relationships

* remove unused var

* Revert CreateEditRelationship modal changes
2023-01-22 19:19:16 +00:00
mike12345567 0f33fd8d48 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-20 19:55:11 +00:00
melohagan 458ab7dadc SQL filtering: Always escape key in LIKE statements (#9278)
* Always escape key in like statements

* lint
2023-01-20 14:03:14 +00:00
Adria Navarro 46994a45f9 Update openapi specs 2023-01-20 12:12:59 +00:00
Adria Navarro dec7e69391 Fix types 2023-01-20 12:03:00 +00:00
Adria Navarro 27171e7680 Extra typings 2023-01-20 11:48:11 +00:00
Adria Navarro 62b372ce59 Fix broken tests 2023-01-20 10:29:11 +00:00
Adria Navarro 12118fd028 Fix old tests 2023-01-20 10:12:52 +00:00
Adria Navarro 7f53cbeca7 Fix types 2023-01-20 09:58:59 +00:00
Adria Navarro 5fb20abcfd Add enrich test 2023-01-19 20:09:39 +00:00
mike12345567 f4d389797c Some minor updates after reviewing. 2023-01-19 19:10:41 +00:00
Adria Navarro af42e789ff Test delete multiple 2023-01-19 17:28:42 +00:00
Adria Navarro bcfb0f3727 Change tests to use internal apis 2023-01-19 17:23:48 +00:00
Adria Navarro f8a3c12608 Add get all rows tests 2023-01-19 16:46:05 +00:00
Adria Navarro bf8e65fa3e Fix validate schema 2023-01-19 16:43:39 +00:00
Adria Navarro 959b4fb2b3 Rename file 2023-01-19 16:21:37 +00:00
Adria Navarro 2bc45336fc Use right tableid 2023-01-19 16:10:29 +00:00
Adria Navarro 2e240508c7 Merge remote-tracking branch 'origin/develop' into test/9339-sqlpostgres-row-api-test-suite 2023-01-19 15:25:46 +00:00
Mateus Badan de Pieri eae7b529a7 adding validation for envvar bindings
adding validation for envvar bindings
2023-01-19 15:07:56 +00:00
melohagan a193d7fcaa Do not set sort column if display is formula (#9378)
* Unset sort column if it is formula

* Null safety
2023-01-19 13:32:45 +00:00
Adria Navarro f4553bca7c Add "get" tests 2023-01-19 11:44:48 +00:00
Adria Navarro 86c2f6dce7 Add pagination and sort tests 2023-01-19 11:35:00 +00:00
Adria Navarro 2a6d921521 Add search query tests 2023-01-19 11:20:20 +00:00
Adria Navarro e6dcc47240 Improve tests 2023-01-19 11:06:41 +00:00
Adria Navarro e13433557a Add search test 2023-01-19 11:00:51 +00:00
Adria Navarro e5509d86de Merge branch 'develop' into test/9339-sqlpostgres-row-api-test-suite 2023-01-19 10:05:58 +00:00
mike12345567 b659060beb Updating datasource API to remove secrets when returning datasources. 2023-01-18 19:16:19 +00:00
Adria Navarro 38e718b6f1 Test delete 2023-01-18 17:21:17 +00:00
Adria Navarro 233f54f036 Add update test 2023-01-18 17:11:52 +00:00
Adria Navarro ac9ad71a11 Dry tests 2023-01-18 17:07:09 +00:00
Adria Navarro 6a1589ba64 Adding more tests 2023-01-18 16:48:18 +00:00
Adria Navarro 4ae43f1a96 Retrieve row test 2023-01-18 16:46:40 +00:00
Adria Navarro 5313c51e0f Create an app before each test 2023-01-18 16:06:45 +00:00
Andrew Kingston d92f1a7097 Portal redesign (#9336)
* Update BB logo to black

* Update top nav bar and core layout

* Add redesign for apps pages

* Update user and groups pages

* More WIP portal redesign!

* Fix top nav colours and fix selected tab not updating

* Remove log

* Update copy on settings pages

* Update and standardise page headers and subtitles, and remove side nav titles

* Update font styles to allow for easy customisation

* Update button styles to always use newStyles, update auth page styles

* Update settings pages to new designs

* Update structure for account pages

* Add initial rewrite of app overview section

* Update config checklist to properly center

* Update app overview version and name/url screens

* Add tooltip to explain why URL cannot be changed until unpublishing

* Update overview automation history tab

* Update overview backups page

* Rewrite app overview access tab

* Update table hover colours

* Remove scrolling from tables when not required and stop selects from updating their own state locally

* Update table styles to support flexible column widths much better

* Fix extremely long strings in breadcrumbs not wrapping

* Fix multiple issues with long text overflow

* Fix flashing in version settings page

* Fix loading bugs in app backups page

* Add sidebar for portal and use it for automation history. Fix multiple overflow and scrolling issues

* Tidy up

* Update user details page to use tables and match designs

* Update users detail page

* Update user and group details pages with new tables

* Fix automation error linking from apps page and improve automation fetching logic in automation history

* Move theme and API key into user profile dropdown instead of settings

* Move settings before account and show plugins for devs

* Convert plugins page to table and update components and modals

* Update links when going back from the builder

* Update plugin search placeholder

* Fix URLs in app overview

* Properly handle text overflow in plugins table

* Remove getting started checklist

* Fix checklist removal and fix profile modal

* Update email details page to match new designs

* Cleanup

* Add licensing and env logic to determine which account links to show

* Update upgrade button URL for cloud accounts

* Update app list to use a more compact style

* Make core page layout responsive and update apps list to be responsive

* Update mobile design of apps page

* Update more pages to be responsive and add mobile specific components

* Refactor main portal page into multiple components

* Update multiple pages to be responsive and improve loading experience

* Make automation history page responsive

* Update backups page to be responsive

* Update pickers to use absolutely positioned root popover so that overflow does not matter

* Fix some responsive styles

* Fix update link in app overview

* Improve dropdown logic

* Lint

* Update click outside handler to handle modals properly

* Remove log

* Fix mobile menu upgrade button not closing menu

* Hide groups page if disabled at tenant level

* Centralise menu logic and show full menu on mobile

* Update app access assignment and fix backups table

* Ensure avatars cannot be squished

* Standardise disabled field text colour

* Allow developer users to access users, groups and usage pages

* Allow readonly access to users and groups for developer users

* Remove logs

* Improve users page loading experience

* Improve responsiveness on apps list page and fix discussions link styles

* Update spacing on user and group detail page and fix usage page showing wrong copy

* Fix logo override not working

* Pin minio version to an old one that supports the fs backend in dev

* Shrink upgrade button

* Shrink user dropdown

* Update assignment modal text

* Remove clickable visual styles from plugins

* Always show groups section in app access page

* Update app overview button styles to include more CTAs

* Hide edit and view links in more menu on overview page unless on mobile

* Make usage stats responsive and fix layout issues

* Add comment to docker-compose config
2023-01-18 13:56:53 +00:00
Adria Navarro 3bb85f6e46 Clean code 2023-01-18 13:55:24 +00:00
Adria Navarro 8e73814675 Add test for multiple rows 2023-01-18 12:26:26 +00:00
Adria Navarro e9361a5819 Use postgres as datasource 2023-01-18 12:19:40 +00:00
Adria Navarro 6bc658c1ff Fix types 2023-01-18 11:50:00 +00:00
Adria Navarro 1d66110d01 More typings 2023-01-18 10:45:42 +00:00
Adria Navarro cc930097a8 Implement test 2023-01-17 17:39:59 +00:00
Adria Navarro 89e0610600 Add basic test 2023-01-17 17:22:31 +00:00
Adria Navarro 6412da730c Type tests utils 2023-01-17 17:19:39 +00:00
Adria Navarro 70168a20fa Prevent killing tests when stopping the server 2023-01-17 16:07:26 +00:00
Adria Navarro ffc322da88 Treat new tests are "no tests" 2023-01-17 16:05:02 +00:00
Adria Navarro 7c05b45408 Merge remote-tracking branch 'origin/develop' into test/9339-sqlpostgres-row-api-test-suite 2023-01-17 15:25:25 +00:00
mike12345567 3659768c42 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns 48e1695318 JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
Adria Navarro da8f7eff6c Delete apps on end 2023-01-17 10:28:51 +00:00
mike12345567 5e68a4d814 Minor updates to the context system and also adding env vars to automation context. 2023-01-16 16:47:59 +00:00
Adria Navarro 343a19250b Typing supertest parameters 2023-01-16 15:35:41 +00:00
mike12345567 10d1455b35 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-16 14:26:26 +00:00
Martin McKeaveney fbf8230a3d allow all user bindings in SQL queries (#9354) 2023-01-16 12:24:32 +00:00
Adria Navarro 70a01c48f1 Merge pull request #9337 from Budibase/bug/#7220-removing-user-from-auth-does-not-remove-from-app
Bug - #7220 removing user from auth does not remove from app
2023-01-16 10:49:27 +00:00
Adria Navarro dc8e54cd84 Add test 2023-01-16 10:19:05 +00:00
Adria Navarro 946cc35ff7 Type request and body 2023-01-16 10:15:00 +00:00
mike12345567 fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
Adria Navarro 748b55c732 Fix undefineds 2023-01-13 14:48:01 +00:00
Adria Navarro ff10fa422b Unify endpoints 2023-01-13 14:45:04 +00:00
Adria Navarro 50565dc226 Fix copy on reponse message 2023-01-13 13:33:40 +00:00
Adria Navarro a5c145d9f6 Replace BBContext for Ctx 2023-01-13 13:31:48 +00:00
Adria Navarro 34cd26781b Delete instead of deactivating 2023-01-13 10:26:05 +00:00
Adria Navarro 09b4533cc8 Add endpoint to deactivate user from app on delete 2023-01-12 16:26:46 +00:00
Peter Clement e8e29ddc8c Merge remote-tracking branch 'origin/cheeks-lab-day-portal-redesign' into feature/environment-variables 2023-01-12 16:00:07 +00:00
Adria Navarro 24f8f3a7cb Fix currentapp middleware to allow app_ parameters 2023-01-12 15:38:22 +00:00
Peter Clement 117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Andrew Kingston b21f0b3925 Lint 2023-01-12 14:48:05 +00:00
mike12345567 87cf52192d Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID. 2023-01-12 14:38:12 +00:00
Rory Powell e5e767f18d Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567 d27674de5c Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
mike12345567 c479a7da2f Fixing minor Typescript issue, some old requires. 2023-01-11 18:16:30 +00:00
mike12345567 69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567 03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567 75df57c3d1 Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-11 10:31:57 +00:00
Rory Powell fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
mike12345567 d347b8015b Merge branch 'develop' of github.com:Budibase/budibase into feature/test-image 2023-01-10 18:49:07 +00:00
deanhannigan 94e76864bf Render view groupBy array options as tags (#8764)
* Fix to properly render groupBy options as tags

* Fixes for viewBuilder function definition and some typescript updates
2023-01-10 16:25:23 +00:00
Dean 2bf724b9b3 Updated cleanExportRows import 2023-01-10 09:50:32 +00:00
Dean 4479c2477c Merge remote-tracking branch 'origin/develop' into feature/configurable-data-export 2023-01-10 09:39:11 +00:00
mike12345567 c9d8668062 Licensing updates for environment variables. 2023-01-09 15:42:09 +00:00
mike12345567 f4f730aae2 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-06 17:29:35 +00:00
mike12345567 76825c38b9 Adding test cases for the attachment re-write feature, mocking the direct couch find functionality. 2023-01-06 13:33:22 +00:00
mike12345567 cf90282303 Moving some stuff around to make more testable. 2023-01-06 12:47:12 +00:00
mike12345567 0c37c57a4b Fix for #9249 - there was an issue with the updating of attachment URLs when importing an app/backup, this resolves it by utilising pagination in the CouchDB find API, making sure to iterate through all documents when there is a larger number. 2023-01-05 18:03:36 +00:00
mike12345567 a079cb6fec Merge branch 'develop' of github.com:Budibase/budibase into develop 2023-01-05 17:09:02 +00:00
mike12345567 3cd097a7f1 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-05 17:04:24 +00:00
Peter Clement 57a5d8505d assign wasLoopStep correctly 2023-01-05 12:16:45 +00:00
Peter Clement 90f3d28bb5 fix for looping issue wher output was incorrect 2023-01-05 10:52:50 +00:00
mike12345567 ea5b515783 Playing around with getting tests working. 2023-01-04 19:47:56 +00:00
Mel O'Hagan b70fdf907a Cast bit buffer as boolean 2023-01-04 15:18:53 +00:00
Andrew Kingston 66674c7277 Ensure view names are properly encoded to handle certain special characters (#9145) 2022-12-22 13:09:07 +00:00
Rory Powell 5f36a84470 Fix docker build (#9116) 2022-12-19 22:05:47 +00:00
Martin McKeaveney 72573c818b pulling from master 2022-12-19 18:54:58 +00:00
melohagan 1b74895abc SQL server relationship fix for tables in schema (#9103)
* Add schema to LEFT JOIN

* lint
2022-12-19 18:12:05 +00:00
Martin McKeaveney 84ab7862d1 fixes for google sheets, admin checklist, and deleting an app from API (#8846)
* fixes for google sheets, admin checklist, and deleting an app from API

* code review

* splitting unpublish endpoint, moving deploy endpoint to applications controller. Still to do public API work and move deployment controller into application controller

* updating REST method for unpublish in API test

* unpublish and publish endpoint on public API, delete endpoint unpublishes and deletes app

* removing skip_setup from prodAppDb call

* removing commented code

* unit tests and open API spec updates

* unpublish, publish unit tests - delete still in progress

* remove line updating app name in API test

* unit tests

* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

* v2.2.4

* Update pro version to 2.2.4

* lock changes (#9047)

* v2.2.5

* Update pro version to 2.2.5

* Make looping arrow point in right direction (#9053)

* v2.2.6

* Update pro version to 2.2.6

* Types/attaching license to account (#9065)

* adding license type to account

* removing planDuration

* v2.2.7

* Update pro version to 2.2.7

* Environment variable type coercion fix (#9074)

* Environment variable type coercion fix

* Update .gitignore

* v2.2.8

* Update pro version to 2.2.8

* tests passing

* all tests passing, updates to public API response

* update unpublish call to return 204, openAPI spec and unit

* fixing API tests

Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-19 13:18:00 +00:00
Rory Powell 712f1d1fc1 Environment variable type coercion fix (#9074)
* Environment variable type coercion fix

* Update .gitignore
2022-12-16 13:16:37 +00:00
Andrew Kingston 090ae5df49 Master => Develop (#9049)
* v2.1.46

* Update pro version to 2.1.46

* v2.2.0

* Update pro version to 2.2.0

* Fix for budibase plugin skeleton, which utilises the old import style.

* Fix side nav styles

* v2.2.1

* Update pro version to 2.2.1

* using dist folder to allow importing constants for openAPI specs

* v2.2.2

* Update pro version to 2.2.2

* Fix for user enrichment call (updating to @budibase/nano fork) (#9038)

* Fix for #9029 - this should fix the issue users have been experiencing with user enrichment calls in apps, essentially it utilises a fork of the nano library we use to interact with CouchDB, which has been updated to use a POST request rather than a GET request as it supports a larger set of data being sent as query parameters.

* Incrementing Nano version to attempt to fix yarn registry issues.

* v2.2.3

* Update pro version to 2.2.3

* Fix SQL table `_id` filtering (#9030)

* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules

Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: Budibase Release Bot <>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2022-12-15 12:13:42 +00:00
Rory Powell 786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Andrew Kingston c3b6afbb6f Fix SQL table `_id` filtering (#9030)
* Re-add support for filtering on _id using external SQL tables and fix filter key prefixes not working with _id field

* Remove like operator from internal tables and only allow basic operators on SQL table _id column

* Update data section filtering to respect new rules

* Update automation section filtering to respect new rules

* Update dynamic filter component to respect new rules
2022-12-15 09:22:28 +00:00
Rory Powell f935f05509 Offline license POC (#9046) 2022-12-14 21:48:48 +00:00
Dean cdcefa16bb Filtering and sort on data row export 2022-12-13 10:13:17 +00:00
Peter Clement 9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
Michael Drury d4f89ad315 Merge pull request #8968 from Budibase/fix/user-self-update
Minor update - stop users updating their own admin/global flags
2022-12-08 09:01:41 +00:00
mike12345567 a120ba0c8d Fixing repl options. 2022-12-07 18:22:02 +00:00
mike12345567 b3e5483eca Adding back compaction. 2022-12-07 18:09:17 +00:00
mike12345567 be0b15428b Linting. 2022-12-07 14:43:27 +00:00
mike12345567 617863ddd1 Fix for #7865 - if you deleted a cron automation immediately after creating/publishing it there was a scenario where prod automations would be out of sync with dev automations and it wouldn't really delete. To get around this, we do an automation sync back to dev DB - meaning that the cron ID is known and can be disabled. 2022-12-07 14:32:29 +00:00
mike12345567 85dd6f2880 Extension on fix for user self assignment, don't allow users to change their admin/builder status. 2022-12-07 12:42:14 +00:00
mike12345567 4300e5c733 Fix for CI build failure. 2022-12-06 18:23:55 +00:00
mike12345567 b9ce140d95 Fix for #7732 - as well as some tests for it, make sure that it is working as expected. 2022-12-06 17:20:26 +00:00
mike12345567 dbde23a4de Fixes based on test failures. 2022-12-06 12:47:48 +00:00
mike12345567 2ba9088faa PR comments, moving more stuff into SDK. 2022-12-06 12:22:41 +00:00
mike12345567 53a6c0e74b Fix for #8896 - the automation logs were already being sync'd to the dev database, but when unpublished they are in-accessible. Some minor updates to make sure that before unpublishing there is a sync, and then most of the changes are in pro. 2022-12-05 18:24:25 +00:00
mike12345567 0ca1c359a5 Final fix for #8882 - adding text to show the error - as well as fixing an issue with many to many updating correctly. 2022-12-02 17:28:37 +00:00
mike12345567 2a51091ffb Adding some null controls. 2022-12-02 16:17:56 +00:00
Andrew Kingston b336a916c7 Merge pull request #8788 from Budibase/side-panel
Side panels
2022-11-30 16:04:35 +00:00
deanhannigan 67f06c8eb9 Merge pull request #8857 from Budibase/fix/sample-data-edit-removed-delete-fixed
Remove ability to edit the 'Sample Data' datasource name
2022-11-30 09:08:54 +00:00
Andrew Kingston a0776ac73a Fix types in table migration tests 2022-11-29 16:27:06 +00:00
Andrew Kingston 0b6c459fbd Add basic component type 2022-11-29 16:21:59 +00:00
Dean 3c59a0da56 Fix to ensure only the budibase datasource type is altered on save 2022-11-29 16:08:31 +00:00
Michael Drury a656c6e678 Adding test case for char encoding and being explicit about utf8 export. 2022-11-29 16:03:22 +00:00
Michael Drury 31fbc937b0 Removing old JS file. 2022-11-29 15:23:01 +00:00
Dean dc001bc27f Merge remote-tracking branch 'origin/develop' into fix/sample-data-edit-removed-delete-fixed 2022-11-29 12:54:22 +00:00
Andrew Kingston 8567ae70af Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-29 12:22:56 +00:00
Andrew Kingston 894a6b93e8 Update table migration test to use imports, and update TestConfiguration to work with type parameters 2022-11-29 12:19:37 +00:00
Michael Drury bcf2aadbaa Merge branch 'develop' of github.com:Budibase/budibase into fix/charset-encoding 2022-11-29 11:57:45 +00:00
Michael Drury 4f4eb4da26 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-29 11:13:54 +00:00
mike12345567 a02e9017ec Final fixes after re-running all test suites. 2022-11-28 19:12:23 +00:00
mike12345567 3aeb6653c6 Some fixes after re-running server tests. 2022-11-28 18:14:10 +00:00
mike12345567 d6e9380c06 General work after running some tests in CI - general refactoring as well. 2022-11-28 17:54:04 +00:00
Dean 7d0e2c289d Disabled the ability to rename the Sample Data datasource. Updated the backend to ensure that renaming doesn't alter its structure and block deletion 2022-11-28 17:25:10 +00:00
mike12345567 e62ebc8fbb Updates to fix build. 2022-11-28 13:24:39 +00:00
Andrew Kingston b042c9ed2e Add tests for table settings migration 2022-11-28 12:20:49 +00:00
Mel O'Hagan 11ae382af0 lint 2022-11-28 12:05:19 +00:00
Mel O'Hagan ba10756119 Don't parse number arrays as date 2022-11-28 12:04:44 +00:00
mike12345567 06d8d19aaa Final typescript conversions for server. 2022-11-26 16:24:37 +00:00
mike12345567 12d6e60525 One file left in the server, some fixes after converting the internal row controller. 2022-11-26 15:42:53 +00:00
mike12345567 658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567 a3bb2e0d77 Automation overhaul to Typescript, plus type updates. 2022-11-25 19:57:07 +00:00
mike12345567 eeebd0fe70 Typescript conversion of linked row controller. 2022-11-25 18:54:57 +00:00
mike12345567 7eac8fafd6 Some server typescript re-writes, only automations left and some controllers. 2022-11-25 15:01:46 +00:00
Andrew Kingston abedb5d9eb Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-25 11:24:57 +00:00
mike12345567 d3c4c99e16 Complete conversion of backend-core to Typescript. 2022-11-24 18:48:51 +00:00
Andrew Kingston 9000349360 Refactor table settings migration slightly and add missing await keyword 2022-11-24 14:23:27 +00:00
Andrew Kingston 3480f6741c Rename table settings migration and only run on dev apps 2022-11-24 14:23:04 +00:00
deanhannigan 3c716a059c Merge pull request #8795 from Budibase/fix/pass-request-context-to-dynamic-var-retry
User/Auth context now being passed to dynamic variable request updates
2022-11-24 13:42:51 +00:00
Mel O'Hagan 4b05cd2d2d Allow tables to be created even if no fetch 2022-11-24 11:45:58 +00:00
Dean f4c027c25b User/Auth context now being passed to dynamic variable request updates 2022-11-24 10:16:05 +00:00
mike12345567 514f9a1210 Some fixes based on test runs. 2022-11-23 11:44:15 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567 8c2d9ebec8 Updating all of the route files to typescript, as well as some controllers. 2022-11-22 18:49:19 +00:00
mike12345567 92210144ff More controller typescript conversions. 2022-11-22 16:52:25 +00:00
Andrew Kingston c01b9af1f0 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-22 16:52:09 +00:00
mike12345567 8a4da7d4ce Typescript conversion of the table controllers. 2022-11-22 13:56:01 +00:00
mike12345567 4cdcafac36 More Typescript conversion, as part of backend-core importing improvements. 2022-11-22 12:41:36 +00:00
mike12345567 8f94664ddd Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-22 12:03:31 +00:00
mike12345567 de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
Dean 192c9b56e2 Import refactoring and some review updates. 2022-11-21 15:53:47 +00:00
Dean 64e7239d42 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 15:40:11 +00:00
mike12345567 cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
Dean 0441704c57 Import fixes for backend core constants. Minor name change for default data source from Test DB to Sample Data 2022-11-21 12:47:36 +00:00
Dean 02a902ebd3 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 11:10:29 +00:00
Andrew Kingston c58067a589 Merge branch 'develop' of github.com:Budibase/budibase into side-panel 2022-11-21 10:30:25 +00:00
Rory Powell e6589fd4c1 Require params on db.remove 2022-11-21 10:07:51 +00:00
Mel O'Hagan 2d28bb4005 Break if any column is static formula 2022-11-18 12:32:04 +00:00
mike12345567 0d13a77409 Some minor updates after running qa-core tests, found some issues that likely exists before context update. 2022-11-17 16:30:38 +00:00
Dean e932aa105b Shifted the budibase datasource constant to backend-core 2022-11-17 16:28:48 +00:00
Dean 8657aaf922 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-17 15:39:40 +00:00
mike12345567 31c198888a Updating some enums, plural to single. 2022-11-17 14:59:18 +00:00
mike12345567 58e59bfacc Updating PouchLike to be an interface in types, with its impl stored in backend-core, now called Database. 2022-11-17 14:35:03 +00:00
mike12345567 bc857d7bb8 PR comments - still experiencing build issues. 2022-11-17 13:31:54 +00:00
Andrew Kingston 102d6084f1 Update table settings migration to handle new behaviour settings for table blocks 2022-11-17 10:11:25 +00:00
mike12345567 29dd98a7fc Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-16 18:12:31 +00:00
mike12345567 4328ed1b67 Updating middlewares to Typescript, as well as some fixes based on running tests. 2022-11-16 17:24:13 +00:00
mike12345567 535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
mike12345567 c6366c573a Final server test fixes, after all updates to context/removal of context faking. 2022-11-15 19:04:39 +00:00
mike12345567 5f658a0398 Converting further DB layers to TS - fixing mocks. 2022-11-15 18:33:24 +00:00
mike12345567 b5472f882b Some updates for currentapp.spec.js test case. 2022-11-15 17:35:17 +00:00
Dean 2599748918 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-15 17:11:19 +00:00
Dean f73b4f8b01 Review updates 2022-11-15 17:03:35 +00:00
mike12345567 e7e2d91fef Merge branch 'develop' of github.com:Budibase/budibase into feature/replace-pouch 2022-11-15 16:45:25 +00:00
Rory Powell 1612044dc1 Merge branch 'develop' into subdomain-tenancy 2022-11-15 16:18:59 +00:00
Rory Powell f48ff01045 ensure fetch and aws are always mocked 2022-11-15 15:50:15 +00:00
Andrew Kingston 2b42b21b3a Add migration to automatically convert legacy table settings into new action setting 2022-11-15 11:54:45 +00:00
Rory Powell 9973f2e161 Bump jest and ts-jest to be consistent across backend packages to fix CI issue, test config updates 2022-11-14 22:55:47 +00:00
mike12345567 72c9aadae0 Updating test cases - trying to get everything in order for merge. 2022-11-14 20:25:05 +00:00
Dean ebccc21e7f Fixed imports 2022-11-13 22:34:01 +00:00
Dean ff7a3b8cef Default Datasource and sample row data 2022-11-13 21:37:50 +00:00
Dean 8f058e222b Fix for attachment cleanup on internal row delete. 2022-11-13 18:08:48 +00:00
mike12345567 bc94f20794 Typescript conversions - trying to get all of context/db layer into TS. 2022-11-11 11:57:50 +00:00
mike12345567 c63c3b48c5 Typescript conversions, as well as updating context to just use an object map. 2022-11-10 17:38:26 +00:00
mike12345567 45e7ef61ef Re-building the context module to use a single object, meaning we can create new context frames and copy over whatever exists, then update. 2022-11-10 16:38:32 +00:00
melohagan c7b19a9cec Merge pull request #8635 from Budibase/bug/sev3/app-import-automations
App import automations - null pointer fix
2022-11-10 15:35:24 +00:00
melohagan b6ff581d5e Merge pull request #8593 from Budibase/bug/sev2/mongodb-aggregate-readable
MongoDB aggregate readable
2022-11-10 15:27:08 +00:00
Mel O'Hagan 6d1449431e Null pointer fix 2022-11-10 15:22:05 +00:00
mike12345567 c744d23832 Major update - removing the use of context for PouchDB instances, swapping knowledge of PouchDB to the PouchLike structure that replaces it. 2022-11-09 16:53:42 +00:00
Rory Powell 6783fd713e Update tenancy detection to honour any subdomain pattern according to platform url 2022-11-09 16:35:16 +00:00
mike12345567 ecb398bf98 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-09 13:41:51 +00:00
Michael Drury 2f6330db4f Removing timeout for export apps - #8589. 2022-11-08 20:12:32 +00:00
Mel O'Hagan 5aba8e4a65 Added readable prop to aggregate function 2022-11-08 14:31:36 +00:00
Rory Powell 6f995f3065 Configurable CDN 2022-11-07 15:27:03 +00:00
Rory Powell 998beddc30 Configurable CDN 2022-11-07 09:45:00 +00:00
mike12345567 b9caf0aef5 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-02 20:12:01 +00:00
melohagan a9575db549 Merge pull request #8472 from Budibase/bug/sev3/validation-error-attachments
Validation error attachments
2022-11-02 09:56:28 +00:00
Rory Powell 496ba57655 Fix attachments upload path 2022-11-01 21:17:39 +00:00
Mel O'Hagan 702e7fe184 Map attachment string to array if needed 2022-11-01 15:59:04 +00:00
mike12345567 19669575e4 Fixing issue with self host build - import of backend-core changes mean that loading the public API files can require setup of backend-core, making it so that the JWT Strategy doesn't need to be setup to load backend-core. 2022-11-01 12:59:10 +00:00
Mel O'Hagan a57dc85b60 Remove ! from error message 2022-11-01 12:37:42 +00:00
Mel O'Hagan f51599f2a8 Merge branch 'develop' into bug/sev3/automation-mysql-id-relationship-uri-decode 2022-11-01 12:36:27 +00:00
melohagan cc44430638 Merge pull request #7521 from Budibase/feature/s3-bucket-connector
S3 bucket connector improvements
2022-11-01 09:56:47 +00:00
Rory Powell bf35717449 Merge pull request #8386 from chaoticefx/elasticsearch-rejectUnauthorized
Custom ssl config for Elasticsearch datasource
2022-11-01 08:47:27 +00:00
Mel O'Hagan 64eff3bab5 Merge branch 'develop' into bug/sev3/automation-mysql-id-relationship-uri-decode 2022-11-01 08:10:03 +00:00
chaoticefx a45c16bc42 Cleaned up config declaration in constructor 2022-11-01 09:08:17 +08:00
Martin McKeaveney 87717ebdf5 merge with master 2022-10-31 13:44:23 +00:00
Martin McKeaveney b498941e1a Merge pull request #8382 from Budibase/feature/meta-tag
adding opengraph metatags for better shareable links
2022-10-31 10:36:50 +00:00
Martin McKeaveney 5fd4f29c61 Merge pull request #8422 from Budibase/bug/sev5/public-api-404
Public rows API: Return correct status codes
2022-10-31 10:36:32 +00:00
mike12345567 eab9806ee3 Fixing an issue with some browsers sending the gzip type as x-gzip rather than gzip, which caused the processing to fail. 2022-10-27 19:14:31 +01:00
Mel O'Hagan ea34856896 Check for string type before decode 2022-10-27 17:55:46 +01:00
Mel O'Hagan ee6a5bffd5 Patch: Throw 404 if row not found 2022-10-27 17:52:28 +01:00
Mel O'Hagan f8fab8d51b Merge branch 'develop' into bug/sev3/automation-mysql-id-relationship-uri-decode 2022-10-27 17:35:47 +01:00
mike12345567 a9b406ea66 Fixing issue with pro import. 2022-10-27 17:31:39 +01:00
Mel O'Hagan 73f54c8133 Decode id if needed 2022-10-27 16:28:26 +01:00
mike12345567 3d98acc28a Minor test rework after improving startup, a lot of mocks weren't being used correctly. 2022-10-27 15:15:08 +01:00
Mel O'Hagan a809700ec2 Throw 400 when validation fails 2022-10-27 15:10:22 +01:00
Mel O'Hagan efc73caf44 lint 2022-10-27 13:49:59 +01:00
Mel O'Hagan 5aa98fcbac Remove try catch from rows. Correct status codes. 2022-10-27 13:49:19 +01:00
chaoticefx 46a0197cd6 Ran npx prettier against elasticsearch.ts 2022-10-27 16:24:01 +08:00
chaoticefx ac9c52e70f Fixed code styling 2022-10-27 15:52:49 +08:00
mike12345567 51251b1fe2 Adding backup queue to bullboard if enabled. 2022-10-26 18:50:40 +01:00
Mel O'Hagan 86fef02567 lint 2022-10-26 16:44:25 +01:00
Mel O'Hagan d69abc4569 Merge branch 'develop' into feature/s3-bucket-connector 2022-10-26 16:37:11 +01:00
Martin McKeaveney 3e348908f5 merge 2022-10-26 11:47:25 +01:00
Martin McKeaveney 37d76cd39d fix typo 2022-10-26 11:45:52 +01:00
mike12345567 a24694a4ea Refactoring a lot of content around webhooks to Typescript, as well as fixing webhooks and automation app IDs on import of new app. 2022-10-25 18:19:18 +01:00
Mel O'Hagan 7166a48382 Unused import 2022-10-25 15:19:46 +01:00
Mel O'Hagan e11f4932d3 Handle multiple automation loop bindings 2022-10-25 15:19:07 +01:00
Rory Powell 56456f3f6d Startup fixes 2022-10-25 13:37:26 +01:00
Rory Powell 9face50a07 Fix build failure around PouchDB type 2022-10-25 09:02:55 +01:00
chaoticefx 1ac362f90c Implemented custom ssl config in elasticsearch.ts 2022-10-25 11:59:34 +08:00
Martin McKeaveney 17205052b7 update OG title 2022-10-24 18:04:14 +01:00
Martin McKeaveney 4c7d6cf2af adding opengraph metatags for better shareable links 2022-10-24 17:53:18 +01:00
Rory Powell 39c83d8fb1 Move backup processing into pro 2022-10-24 15:28:43 +01:00
Rory Powell d746c42503 Remove pro mock and invert if condition on backups enabled 2022-10-24 14:23:16 +01:00
mike12345567 a25cc7fbaf Merge branch 'feature/app-backups' of github.com:Budibase/budibase into feature/app-backups 2022-10-24 13:37:53 +01:00
mike12345567 bc2d499625 Adding a check to see if app backups feature is enabled. 2022-10-24 13:33:36 +01:00
Rory Powell 5614c5db61 Replace isTest check with mock for triggering app backup 2022-10-24 13:05:40 +01:00
mike12345567 fbed8923dc Moving statistics under backups sdk subfolder. 2022-10-24 10:14:35 +01:00
mike12345567 4daf9c2615 Addressing majority of PR comments. 2022-10-24 10:04:14 +01:00
mike12345567 e1dca87507 Fixing test case. 2022-10-21 18:52:39 +01:00
mike12345567 74484fc054 Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-21 18:41:25 +01:00
mike12345567 fe5d11232f Update with PR comments. 2022-10-21 18:25:35 +01:00
mike12345567 2a2f41a861 Fixing issue discovered by tests. 2022-10-21 16:02:13 +01:00
Martin McKeaveney 975134caea Merge pull request #8295 from weslien/patch-8294
Fix arangoDB connector
2022-10-20 22:01:07 +01:00
mike12345567 854cb23947 Getting the import system to carry out a backup of the app before the restore. 2022-10-20 19:07:10 +01:00
mike12345567 f5557fd805 Fetching a list of backup/restore events includes the full user object. 2022-10-20 15:05:50 +01:00
mike12345567 f11c0bbfd7 Some type updates and processor handling for backup document being created before backup/restore occurs. 2022-10-19 19:19:36 +01:00
mike12345567 10c81c1adc Fixing issue with using templates. 2022-10-19 16:57:14 +01:00
mike12345567 113a23ba3d Adding statistics output for backups. 2022-10-19 16:48:32 +01:00
mike12345567 59bf052b70 Fixing issue with metadata name not being provided for uploaded backup on publish. 2022-10-19 13:52:56 +01:00
mike12345567 f5845a8a6e Protection for real app IDs. 2022-10-19 11:47:07 +01:00
mike12345567 bdc4e29b2d Finishing import processor - download backup, delete dev DB and then import over the top of this. Also includes a rollback feature if the backup fails to restore for whatever reason. 2022-10-18 19:43:19 +01:00
mike12345567 b52f413aa5 Removing attachment dir constant - no longer needed. 2022-10-18 17:04:18 +01:00
mike12345567 caa4954d8e Updating export/import to include the budibase client and manifest. 2022-10-18 16:42:25 +01:00
Gustav Weslien e8b9b196d0 Fix arangoDB connector :
https://github.com/Budibase/budibase/issues/8294#issue-1412041907
2022-10-17 20:56:30 +02:00
mike12345567 f795cb0e33 Reformatting types to allow queue to be used for import and export. 2022-10-17 19:42:36 +01:00
mike12345567 11115aab56 Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-17 14:49:31 +01:00
mike12345567 1373630b33 Minor fixes after testing manual backup system. 2022-10-14 20:10:44 +01:00
mike12345567 0bd2a18e46 Main types and work for the CRUD operations of app backup backend in pro + the listeners to handle exporting apps from the server. 2022-10-14 19:24:03 +01:00
mike12345567 b702c7482a Fixes for cronjob stop - correctly handle this without stalled job handle. 2022-10-14 13:26:42 +01:00
mike12345567 d620e54fdb Handling listeners as part of queue creation, rather than external part. 2022-10-13 17:55:05 +01:00
mike12345567 b6ca14aa85 Renaming some queue to automationQueue, getting build working. 2022-10-13 17:39:26 +01:00
mike12345567 35525bfedd Moving queue implementation into backend-core - so that pro can access. 2022-10-13 17:27:04 +01:00
deanhannigan aa1293f15a Merge pull request #8153 from Budibase/feature/qr-barcode-reader
Feature/qr barcode reader
2022-10-13 16:43:54 +01:00
melohagan 9c8aa0dd84 Merge pull request #8117 from Budibase/lab/mongodb
Add aggregate method to MongoDB
2022-10-13 16:32:30 +01:00
Dean 7125e3f6e3 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-13 16:16:28 +01:00
mike12345567 8fdba78bde Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-13 15:59:31 +01:00
mike12345567 907b838db3 Fixing multi-app import from cloud. 2022-10-13 15:46:53 +01:00
Mel O'Hagan 10367dfb43 Rename flow to pipeline 2022-10-13 13:05:45 +01:00
Rory Powell 807182b9e2 Merge pull request #8227
Deprecate legacyHttpParser, fix rest tests
2022-10-12 19:56:02 +01:00
mike12345567 d1c9a56e9a Full import implementation - needs further testing, untars the file with all apps, then adds each of them individually. 2022-10-12 19:15:28 +01:00
Mel O'Hagan 10e6c61081 lint 2022-10-12 18:55:22 +01:00
Mel O'Hagan 436cbed74b Add support for ObjectId in aggregations 2022-10-12 18:54:53 +01:00
mike12345567 2eae3f2a6c Fixes for find functionality after testing. 2022-10-12 17:57:31 +01:00
Mel O'Hagan 29f995256e Merge branch 'develop' into lab/mongodb 2022-10-12 17:53:09 +01:00
mike12345567 f5dd87f8f9 Adding first pass of attachments updating. 2022-10-12 17:34:17 +01:00
mike12345567 8d7f40e443 Refactoring more to Typescript, adding the ability to use the _find API of CouchDB. 2022-10-12 17:02:23 +01:00
Mel O'Hagan 9f60a6c485 Allow template to be used when changed body blank 2022-10-12 16:20:11 +01:00
Mel O'Hagan 53475f1312 Add all the stage templates 2022-10-12 16:03:51 +01:00
Mel O'Hagan 33c36c1112 Include stage templates 2022-10-12 15:31:53 +01:00
Rory Powell 281eb151e2 Merge pull request #8164 from Budibase/feature/quota-emails
Approaching and Exceeded Usage Limit Notifications
2022-10-12 12:31:17 +01:00
mike12345567 9d34ccfaca Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-12 11:59:00 +01:00
Mel O'Hagan 4c781eb667 Merge branch 'develop' into lab/mongodb 2022-10-12 11:19:50 +01:00
Rory Powell e29330093b Fix tests 2022-10-12 11:18:57 +01:00
Rory Powell c7dac5f417 Deprecate legacyHttpParser, fix rest tests 2022-10-12 11:05:16 +01:00
Mel O'Hagan c67c784e15 Merge branch 'develop' into lab/mongodb 2022-10-12 10:29:27 +01:00
Rory Powell 6e083c85a4 Fix linting 2022-10-12 10:25:02 +01:00
Rory Powell 7c9767e186 Merge pull request #7716 from adamkingsbury/rejectUnauthorized
Reject unauthorized
2022-10-12 10:22:01 +01:00
Rory Powell 2f0f36e635 Merge branch 'master' into merge-master 2022-10-12 10:19:46 +01:00
Rory Powell d2882a3779 Merge branch 'develop' into rejectUnauthorized 2022-10-12 10:06:50 +01:00
Dean f5edeb5ddc Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-12 09:12:09 +01:00
Rory Powell 80915c6105 Merge pull request #8212 from Budibase/fix/user-metadata-update
Fix user metadata update
2022-10-12 08:20:36 +01:00
mike12345567 19133f08e6 Adding import functionality - still need to update the attachments URL. 2022-10-11 20:25:22 +01:00
mike12345567 f237befbce Some fixes + cleanup of tmp directory. 2022-10-11 19:28:13 +01:00
mike12345567 7c71f76b70 Export to tarball through tmp. 2022-10-11 18:21:58 +01:00
Rory Powell ef4b1dd32b Fix user metadata update 2022-10-11 12:42:35 +01:00
mike12345567 1f36eec89a Some updates towards supporting attachments in app exports. 2022-10-10 20:08:59 +01:00
Dean 07be0208e5 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-10 09:08:48 +01:00
Martin McKeaveney 5838eb70b4 turn on gsheets 2022-10-10 09:02:17 +01:00
Rory Powell 84685d3340 Add locking framework 2022-10-10 08:21:17 +01:00
Martin McKeaveney 052bc0aeed ensure correct revert endpoint being hit, update call to revert 2022-10-09 19:31:35 +01:00
mike12345567 9efb8f98bc Updating koa versions to align with pro - types were inaccurate and couldn't be imported correctly. 2022-10-07 21:08:20 +01:00
mike12345567 2d4eb10aba Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-07 20:48:28 +01:00
mike12345567 d80c966cf1 Fixing test mocks. 2022-10-07 18:05:26 +01:00
mike12345567 197d195cb4 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 18:05:18 +01:00
Martin McKeaveney 4e04fc84b2 only prevent rollback in cypress env 2022-10-07 18:04:18 +01:00
Michael Drury 060b2aba3c Merge pull request #8175 from Budibase/fix/remove-app-scans
Removing Redis SCAN operation from app services
2022-10-07 17:35:05 +01:00
mike12345567 39410a07af Fixing test mocks. 2022-10-07 16:24:04 +01:00
mike12345567 0c4a40c795 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 16:05:01 +01:00
Andrew Kingston bdce3fc9fc Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-eject-blocks 2022-10-07 11:31:32 +01:00
Dean c09154b03e Renamed the 'Scanned Code' field type to 'Barcode/QR'. The component is also now listed as 'Barcode/QR Scanner'. Minor fix to include longform text columns in the table csv import list 2022-10-07 11:00:25 +01:00
mike12345567 ef52bde670 Building out initial SDK work - converting some existing exporting work to typescript. 2022-10-06 19:10:45 +01:00
mike12345567 ea2fb6de1b Merge branch 'master' of github.com:Budibase/budibase into develop 2022-10-06 16:54:25 +01:00
Rory Powell aff6e5cbbb Process quota emails in account-portal 2022-10-06 16:03:47 +01:00
Dean e251c914ff Review feedback changes. Changed 'Code' labelling to 'Scanned Code' 2022-10-06 13:02:17 +01:00
Peter Clement 32b54f9b33 Merge pull request #8133 from Budibase/fix/automation-looping-issues
Fix issues with looping in automations
2022-10-05 12:51:37 +01:00
Michael Drury 3f4bdece64 Merge pull request #8125 from Budibase/fix/table-options-csv
Fixing options type import with CSV
2022-10-05 10:06:06 +01:00
Peter Clement bd47c948c5 one more log 2022-10-05 10:01:11 +01:00
Andrew Kingston 84626294fd Merge pull request #8124 from Budibase/plugin-url-updates
Plugin url updates
2022-10-05 09:57:22 +01:00
Peter Clement f4c9fc6897 remove logs 2022-10-05 09:53:47 +01:00
Dean 2ec21741d1 Initial commit of QR Reader field 2022-10-05 09:28:07 +01:00
Peter Clement 2f220d668b fix looping issues in automations 2022-10-05 09:20:59 +01:00
Andrew Kingston f2f842444a Update plugin URL utility export to use CJS syntax 2022-10-05 08:57:26 +01:00
Andrew Kingston 788dac0f8d Use CJS style imports in plugin URL helper to work in jest, and respect plugin bucket env var 2022-10-05 08:25:50 +01:00
mike12345567 1dabc59ff5 Fixing a regression of CSV table creation - normally if a CSV was used to create a table with an options column all of the options would be filled in but this had been broken. 2022-10-04 17:54:33 +01:00
Andrew Kingston 021316c73f Lint 2022-10-04 16:43:20 +01:00
Mel O'Hagan 3490996c5a Add unit test and fix 2022-10-04 16:28:29 +01:00
Andrew Kingston b487855348 Update plugin JS URL handling 2022-10-04 16:28:21 +01:00
Andrew Kingston d5cde049a7 Enrich plugin JS URLs when SSR'ing apps 2022-10-04 16:28:01 +01:00
Andrew Kingston b148b7d004 Enrich plugin JS URLs when fetching appPackage 2022-10-04 16:27:42 +01:00
Andrew Kingston de9b2c44cb Add utility for generating plugin JS URLs 2022-10-04 16:27:04 +01:00
Mel O'Hagan 91d00ecdb4 Fix table block search 2022-10-04 13:55:43 +01:00
Michael Drury ec02dda877 Merge pull request #8097 from Budibase/bug/sev3/public-api-equals-number
Public api equals query - support for number strings
2022-10-04 12:48:17 +01:00
melohagan 1db2481024 Merge pull request #7868 from Budibase/bug/sev3/display-column-relationship-bug
Ensure display columns are set when relationships are defined
2022-10-04 11:53:31 +01:00
Mel O'Hagan a95f32c5de Rename actionTypes to actionType 2022-10-04 11:29:13 +01:00
Mel O'Hagan 9580e83ae3 lint 2022-10-04 11:03:54 +01:00
Mel O'Hagan 55c112677e Added support for JSON array stages 2022-10-04 11:03:24 +01:00
mike12345567 a3348e3c8a Fix for #6880 - allow SQL table rows to be updated/deleted by their _id field from the public API. 2022-10-03 20:31:11 +01:00
Mel O'Hagan b3d549a170 Add aggregate method. Push results. 2022-10-03 20:08:47 +01:00
Mel O'Hagan b6eebad75f Fix types 2022-10-03 19:10:01 +01:00
Mel O'Hagan a9212a56ed lint 2022-10-03 17:18:16 +01:00
Mel O'Hagan 0d08eb60c5 Merge branch 'develop' into lab/mongodb 2022-10-03 17:10:21 +01:00
Mel O'Hagan fae4c9586a Wrap number in quotes if string search 2022-10-03 11:30:57 +01:00
Michael Drury 603dfbd530 Merge pull request #8061 from Budibase/fix/8056
Don't return raw query from query execution endpoint - only from preview
2022-10-03 09:51:26 +01:00
Shumpei Kishi 2f563f108a Adding a validation check for undefined 2022-10-03 17:34:06 +09:00
Shumpei Kishi 8aee6c95d8 Fixing the validation logic to accept boolean false value. 2022-10-03 15:55:11 +09:00
Michael Drury af603afbc3 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-10-01 15:44:11 +01:00
mike12345567 476bb79c29 Quick fix for development machines, when running Budibase development stack on systems that are not oracle compatiable it would fail to start due to the lack of dependency. 2022-09-30 15:19:34 +01:00
mike12345567 f9269faf08 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-09-30 14:55:00 +01:00
mike12345567 b484f29098 Minor fix for #8056 - don't return the raw data for the main query execution - but still return for the builder preview. 2022-09-30 12:30:26 +01:00
mike12345567 38f49dad2a Merge branch 'master' of github.com:Budibase/budibase into feature/plugin-icons 2022-09-30 11:17:43 +01:00
mike12345567 a3b7d7f8a9 Fix for #8023 - moving Oracle integration to ESM import rather than CJS. 2022-09-30 10:52:00 +01:00
mike12345567 95136a54f2 Adding ability for datasource plugins to have a custom icon svg. 2022-09-29 19:30:53 +01:00
Rory Powell e85e3828fd Test fix 2022-09-28 14:03:05 +01:00
Rory Powell d87e3904ae Create generic quota sync migration 2022-09-28 13:13:37 +01:00
Rory Powell 98168aee29 Merge branch 'develop' into feature/app-quotas 2022-09-28 12:33:39 +01:00
Rory Powell b230f16369 minor renaming 2022-09-28 11:57:58 +01:00
Rory Powell 79226777b1 Merge develop 2022-09-28 08:56:45 +01:00
Martin McKeaveney f789f364d3 make sure rows call goes to real couch 2022-09-26 18:46:09 +01:00
Martin McKeaveney 57bbf28119 merge with master 2022-09-26 17:57:23 +01:00
Mel O'Hagan f3d723c435 Merge branch 'master' into bug/sev3/display-column-relationship-bug 2022-09-26 16:14:14 +01:00
Martin McKeaveney 7884d60ed3 Merge pull request #7914 from Budibase/bug/sev4/mysql-multiple-statements
Mysql multiple statements
2022-09-26 15:33:39 +01:00
Andrew Kingston 02156387c7 Update delete endpoints to be called destroy 2022-09-26 14:18:31 +01:00
Andrew Kingston e3bb57b97a Merge branch 'develop' of github.com:Budibase/budibase into public-api-sdk 2022-09-26 14:15:25 +01:00
Andrew Kingston aeb0fd7356 Always try to migrate navigation settings when importing apps 2022-09-26 13:59:00 +01:00
Martin McKeaveney d9cdfd9357 Merge pull request #7964 from Budibase/qa/real-couch-integration-tests 2022-09-26 11:10:15 +01:00
Martin McKeaveney 886a90d1fd only run in test mode if couch url is not passed 2022-09-26 10:40:37 +01:00
Peter Clement f6d7b5dc8e Merge pull request #7944 from Budibase/pc/automation-fix
Automate fixes
2022-09-26 08:39:47 +01:00
Martin McKeaveney c309d25b16 Merge pull request #7881 from Budibase/feature/email-cc
Add CC and BCC (with multiple email support) to Send Email automation action step
2022-09-25 13:40:33 +01:00
Michael Drury e12a03d05f PR comments. 2022-09-24 16:55:22 +01:00
Martin McKeaveney 25ce82fa4b using real couch in integration tests 2022-09-24 13:17:21 +01:00
mike12345567 e460864091 Adding a migration for the plugin quotas to make sure they are always accurate in self host at startup. 2022-09-24 12:10:09 +01:00
Michael Drury c7fb092294 Fixing issue discovered by test. 2022-09-23 22:24:31 +01:00
mike12345567 e0b6ef66ac Fixing a few issues with roles being correctly reverted. 2022-09-23 17:45:26 +01:00
Peter Clement f069ddb27e Automation fixes 2022-09-23 13:35:27 +01:00
mike12345567 a1b1798e13 Minor update to feature flag name. 2022-09-23 13:08:18 +01:00
mike12345567 9b29bd6709 Merge branch 'develop' of github.com:Budibase/budibase into group-fixes 2022-09-22 18:44:16 +01:00
mike12345567 e3f054470a Updating a few core endpoints to better integrate the groups system and make sure users always have the correct role ID updated onto them. 2022-09-22 18:27:43 +01:00
Mel O'Hagan 1afc0fbdf8 Support multiple statements 2022-09-22 16:36:19 +01:00
mike12345567 429a89159c Fixing issue that refactoring file caused (some strings renamed to ts rather than js). 2022-09-22 15:18:10 +01:00
mike12345567 67d9495481 Some updates, typescripting some more APIs, as well as fixing a lot of Router creation which did not specify the 'new' operator. 2022-09-22 14:59:28 +01:00
mike12345567 6247f686e8 Adding group app cleanup. 2022-09-21 23:12:38 +01:00
Rory Powell c3ee8b0e56 Merge pull request #7859 from Budibase/feature/enterprise
Enterprise / license override support
2022-09-21 20:18:54 +01:00
Andrew Kingston 3b4ca9e5b3 Update public API operation IDs to be shorter 2022-09-21 19:11:47 +01:00
Mel O'Hagan 1b49f02092 CC and BCC interface 2022-09-21 15:58:04 +01:00
Rory Powell a8782c4629 License analytics 2022-09-21 15:45:29 +01:00
Mel O'Hagan 23fd67b5b9 Ensure display columns are set 2022-09-21 11:53:18 +01:00
Andrew Kingston 41d6c8c093 Fix incorrect event name being sent down websocket when hot reloading component plugins 2022-09-21 09:11:23 +01:00
Rory Powell 6cd872d7d2 Merge branch 'develop' into feature/enterprise 2022-09-20 16:01:28 +01:00
Andrew Kingston 3fd54967d9 Merge branch 'develop' of github.com:Budibase/budibase into public-api-sdk 2022-09-20 15:29:39 +01:00
Andrew Kingston ce1c801ff0 Merge branch 'develop' of github.com:Budibase/budibase into public-api-sdk 2022-09-20 11:25:54 +01:00
Andrew Kingston fadb1e498e Add operationIds to public API 2022-09-20 11:24:54 +01:00
Rory Powell f7ec431a45 Move tenancy/utils to db/tenancy to resolve circular imports between tenancy and db package. This should remove all reliance on the tenancy package from the db package 2022-09-20 10:20:36 +01:00
Rory Powell fca1dd72cd Add enterprise types and change from @budibase/pro to @budibase/types for licensing types 2022-09-20 08:02:14 +01:00
Martin McKeaveney 92221fe115 re-add missing reference to name variable in plugins 2022-09-18 16:00:51 +01:00
Martin McKeaveney 9b5ed59f34 Merge pull request #7792 from Budibase/feature/plugin-pro
Plugin pro integration
2022-09-18 10:34:06 +01:00
mike12345567 6bad41e3ce Minor fix - datasource hot reloading was working apart from the the CJS require caching, need to clear down the cache entry before reloading. 2022-09-16 11:25:28 +01:00
Martin McKeaveney c86bdffc52 Merge pull request #7646 from Budibase/qa/qa-core-jest
QA Core repo, and Jest API tests running end to end
2022-09-15 21:12:45 +01:00
Martin McKeaveney bc090f5f9d better tests and cleaner import for server 2022-09-15 19:51:11 +01:00
mike12345567 5b9c3a5608 Some minor fixes, plus typescript conversion to avoid issue in future. 2022-09-15 18:43:07 +01:00
mike12345567 b9321701b8 Merge branch 'develop' of github.com:Budibase/budibase into feature/plugin-pro 2022-09-15 15:14:18 +01:00
mike12345567 40688f6783 Adding budibase/pro integration for plugins, controlling quota limits. 2022-09-15 14:57:27 +01:00
Rory Powell a8747a0b6d Ignore empty name validation on app update and change free logo text 2022-09-15 14:23:25 +01:00
Rory Powell 060251ab03 Merge pull request #7782 from Budibase/feature/day-pass-pricing
Day pass pricing
2022-09-15 13:36:10 +01:00
Rory Powell a691f4035f Merge branch 'feature/day-pass-pricing' into feature/bb-logo 2022-09-15 13:03:53 +01:00
Michael Drury b8462eea0c Merge pull request #7774 from Budibase/events/plugins
Plugin init, imported and deleted events
2022-09-15 12:55:40 +02:00
Rory Powell 4787f9ccab Pre-review tidy, add new badge to plugins 2022-09-15 11:23:51 +01:00
Rory Powell 086d9ebdf9 Merge branch 'develop' into feature/day-pass-pricing 2022-09-15 10:56:50 +01:00
Rory Powell 0f98f2fcaa Merge branch 'master' into develop 2022-09-15 10:19:56 +01:00
Rory Powell 8cfd6a9faa Merge branch 'develop' into feature/day-pass-pricing 2022-09-15 08:55:33 +01:00
Martin McKeaveney ddc585fad3 Merge branch 'develop' into qa/qa-core-jest 2022-09-15 01:18:58 +01:00
Martin McKeaveney fdbe429581 complete refactor and total type safety of test suite - making use of OpenAPI types throughout 2022-09-15 00:58:08 +01:00
mike12345567 274e34044e Merge branch 'develop' of github.com:Budibase/budibase into events/plugins 2022-09-14 17:48:25 +01:00
Michael Drury f18a865d53 Merge pull request #7770 from Budibase/fix/datasource-rename
Data source -> datasource throughout code - plus friendly plugin name displayed
2022-09-14 18:47:54 +02:00
mike12345567 46c1590c83 Adding types for plugin events, specifically for plugin init, import and deletion, this is across the CLI and the server. 2022-09-14 17:35:46 +01:00
Peter Clement 3304f11560 Merge pull request #7766 from Budibase/fix/pc-fixes
Bug fixes #6836 and #7242
2022-09-14 14:39:10 +01:00
Andrew Kingston 1fa2bc193c Lint 2022-09-14 14:35:08 +01:00
mike12345567 70f2130cfc Fixing linting issue. 2022-09-14 14:07:00 +01:00
mike12345567 632d0e6e1a Merge branch 'develop' of github.com:Budibase/budibase into fix/datasource-rename 2022-09-14 14:06:38 +01:00
mike12345567 8744d0a86c Renaming data source -> datasource as per Mel's request. 2022-09-14 12:11:20 +01:00
Andrew Kingston c1b0e126af Allow custom components in cloud 2022-09-14 12:01:49 +01:00
Andrew Kingston 64ee1677e6 Add validation to plugins uploaded using file upload and allow component uploads via non-file sources in cloud 2022-09-14 11:58:59 +01:00
Andrew Kingston d2a91bcbeb Allow component plugins in cloud 2022-09-14 10:14:17 +01:00
mike12345567 416a2c999f Fixing issue with plugin import for datasources - extract the integration correctly. 2022-09-13 12:16:00 +01:00
Peter Clement 3059e00c77 add backend name validation for app creation / update 2022-09-13 11:44:33 +01:00
Andrew Kingston 3283a0ab5a Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-eject-blocks 2022-09-13 11:31:45 +01:00
melohagan abdb156559 Merge pull request #7333 from Budibase/feature/select-tables-to-fetch
Allow list of named tables to be fetched
2022-09-13 11:19:49 +01:00
Mel O'Hagan 6e29e0a757 Case insensitive table fetch 2022-09-13 10:55:38 +01:00
Michael Drury 99e9bdea6b Merge pull request #7574 from Budibase/bug/sev4/delete-formula-column
Exclude formula columns from Sql drop column
2022-09-13 11:27:59 +02:00
Andrew Kingston 4c301e962f Refactor server websocket dependency tree to fix jest tests 2022-09-13 09:54:25 +01:00
melohagan 9be2f517ca Merge pull request #7737 from Budibase/bug/sev3/foreign-key-bigint-smallint
Postgres (and other external DBs) support foreign key bigint -> smallint
2022-09-13 08:26:02 +01:00
Andrew Kingston be15aff40f Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience-websocket 2022-09-12 20:00:32 +01:00
mike12345567 30817751ad Updating plugin backend, refactoring a bit, correctly allowing a set of headers to be used for a URL. 2022-09-12 19:12:05 +01:00
mike12345567 e7cfdd4fde Updating add/delete process to have better notifications, removing some errors. 2022-09-12 17:43:13 +01:00
mike12345567 f6e5524b07 Refactoring some plugin adding work - changing how source is specified to remove lower casing. 2022-09-12 17:04:27 +01:00
mike12345567 722a087af5 Reverting organisation page changes. 2022-09-12 16:21:47 +01:00
mike12345567 828066de46 Merge branch 'develop' of github.com:Budibase/budibase into feature/plugin-management-ui 2022-09-12 15:34:34 +01:00
mike12345567 82ed2d2cb7 Prefer worker/app port to generic port env variable - #7736. 2022-09-12 15:17:39 +01:00
mike12345567 bbed4cce74 Fixing an intermettient test issue. 2022-09-12 15:16:31 +01:00
Mel O'Hagan f782375e12 lint 2022-09-12 14:22:07 +01:00
Mel O'Hagan 32f004a890 Compare string versions of relationship columns 2022-09-12 14:21:32 +01:00
Rory Powell 45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
Martin McKeaveney 35274583c6 Merge pull request #7734 from Budibase/fix/cr-header
Fix/cr header
2022-09-12 12:22:35 +01:00
Rory Powell 884f446671 Merge branch 'develop' into feature/day-pass-pricing-temp 2022-09-12 11:33:02 +01:00
Martin McKeaveney 37fa940661 adding friendlyname for legacy HTTP support 2022-09-12 10:18:18 +01:00
Martin McKeaveney 6bdf103e11 provide fix for CR header and backwards compatibility with legacy servers 2022-09-12 10:00:05 +01:00
Martin McKeaveney 6983d94d90 adding insecure HTTP parser 2022-09-12 09:27:16 +01:00
adamkingsbury 2eca405559 lint fix 2022-09-10 00:25:35 +01:00
adamkingsbury 18050936d8 don't enforce global agent for reject unauthorized 2022-09-10 00:14:57 +01:00
adamkingsbury 4cd182844a Fix issue with query string on sensitive APIs 2022-09-10 00:14:57 +01:00
adamkingsbury e33ea75ee0 Implement rejectUnauthorised logic 2022-09-10 00:10:09 +01:00
mike12345567 3d66e71d7d Fixing an issue with deleting large apps with a lot of internal table data and adding back the export modal which allows picking whether an export includes internal table rows - #7583. 2022-09-09 20:06:29 +01:00
mike12345567 2686d50523 Fixing test cases. 2022-09-09 17:18:19 +01:00
NEOLPAR 945665448d fixing node exports 2022-09-09 12:15:38 +01:00
NEOLPAR 171970108e fix build error exporting and declaring plugins 2022-09-09 12:01:04 +01:00
NEOLPAR 8261549131 added plugin validation 2022-09-09 11:13:18 +01:00
NEOLPAR 28e8ce329b fixed building issue 2022-09-09 11:10:48 +01:00
mike12345567 7c9d0594f8 Fixing #6980 - fixing choice of relational foreign key field name when working with fields named differently to the primary key. 2022-09-07 18:30:17 +01:00
Peter Clement 3ef877f886 fix build again 2022-09-07 18:11:17 +01:00
mike12345567 8e56a7a4d9 Fixing an issue with external tables containing time only fields. 2022-09-07 17:57:02 +01:00
Peter Clement ac0443a876 fix build 2022-09-07 17:49:29 +01:00
mike12345567 2fb96b29c9 Encoding query string URI parameters for REST requests - #7683. 2022-09-07 17:31:15 +01:00
mike12345567 86c8618e8f Fix for #7431 - reboot didn't work at all previously which is why apps couldn't be published with it enabled, this is now a self host only feature, I've removed the ability to enable a reboot cron in the Cloud and it will not run the lookup/execution. 2022-09-07 17:05:17 +01:00
Peter Clement 0ebe0b8275 remove verify and fix deletion bug 2022-09-07 16:08:29 +01:00
Peter Clement 43dbf96f47 add update modal 2022-09-07 13:51:14 +01:00
mike12345567 9f00e75207 Merge branch 'master' of github.com:Budibase/budibase into fix/sept-various-fixes 2022-09-07 13:42:30 +01:00
mike12345567 ca749aed86 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-09-07 12:40:45 +01:00
Andrew Kingston 2e72eb4f2e Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience-websocket 2022-09-07 12:07:25 +01:00
Andrew Kingston ac8dffcdaa Fix version being referenced in app plugin metadata 2022-09-07 12:06:05 +01:00
Andrew Kingston 0bc7ffe0a1 Update preview endpoint to be prefixed with /app to not require an updated proxy config 2022-09-07 10:40:00 +01:00
mike12345567 2d183e0c6c Adding compaction before each replication to try to reduce size of database, as well as removing the possibility of app metadata being in conflict as per issue #7494. 2022-09-06 18:07:18 +01:00
NEOLPAR c4bcee1d60 returning 400 error with message to be handled by frontend 2022-09-06 16:37:37 +01:00
NEOLPAR c2bca8a025 uploading plugin for github, npm and url 2022-09-06 16:28:35 +01:00
Rory Powell 165194658b Move day pass middleware from authenticated to licensing, sent activity to account portal 2022-09-06 16:24:36 +01:00
NEOLPAR b8dc676120 Merge branch 'feature/plugin-management-ui' of https://github.com/Budibase/budibase into feature/plugin-management-ui 2022-09-06 12:50:48 +01:00
Rory Powell 818e7fd5f4 Day pass middleware 2022-09-06 12:25:57 +01:00
Peter Clement e6f127c33f update upload request to handle source correctly 2022-09-06 10:37:49 +01:00
Andrew Kingston 3088616c47 Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-eject-blocks 2022-09-06 08:53:10 +01:00
Mel O'Hagan 2cdd47042c lint 2022-09-05 18:31:20 +01:00
Mel O'Hagan 00f12698d7 type check 2022-09-05 18:31:12 +01:00
Mel O'Hagan 67f123d60f Parse incoming row as JSON 2022-09-05 18:31:03 +01:00
Martin McKeaveney c3f15b5af2 QA Core repo, and Jest API tests running end to end 2022-09-05 18:28:53 +01:00
NEOLPAR 4c47c3a418 sorting npm stuff out 2022-09-05 15:04:26 +01:00
Peter Clement 5ad21ad333 improve responsiveness of plugins ui 2022-09-05 14:39:19 +01:00
NEOLPAR a03d007821 random name in case it is needed 2022-09-05 10:28:09 +01:00
NEOLPAR 32b336cc2d cleaning minio folder when deleting plugin 2022-09-05 10:13:55 +01:00
NEOLPAR 7d8940f0cb Merge branch 'plugins-dev-experience' into feature/plugin-management-ui 2022-09-05 09:38:24 +01:00
mike12345567 1239c053e3 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-09-02 20:00:35 +01:00
mike12345567 9725cb732b Fixing test case. 2022-09-02 19:59:19 +01:00
Andrew Kingston 5100ecb48d Remove version from component name when considering used plugins in screen docs 2022-09-02 19:58:54 +01:00
Andrew Kingston 1f1f482f9d Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience-websocket 2022-09-02 19:53:49 +01:00
Andrew Kingston 881024ca60 Remove further usages of plugin versions 2022-09-02 19:52:52 +01:00
mike12345567 a5f475872d Updating plugins to not think about versions, only ever one version of each plugin by name, making plugins self host only and adding error checking for datasource implementations. 2022-09-02 19:32:15 +01:00
Martin McKeaveney 151d70ef43 improvements to redis connector - multi line pipelines and lowercase commands 2022-09-02 18:35:06 +01:00
NEOLPAR 54eed13541 create plugin github public and private 2022-09-01 20:04:45 +01:00
Mel O'Hagan b29e9be026 Exclude formula columns from Sql drop column 2022-09-01 17:21:42 +01:00
Rory Powell 276c455a11 Merge branch 'develop' into feature/day-pass-pricing 2022-09-01 15:26:16 +01:00
Andrew Kingston d989e346ca Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience-websocket 2022-09-01 14:39:30 +01:00
Andrew Kingston 0e6bf7a79c Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-09-01 12:54:21 +01:00
Andrew Kingston 3336dcdaa1 Update watch params to use polling and improve speed 2022-09-01 12:51:28 +01:00
mike12345567 f49d61bc5c Updating test cases to TS to get them working properly with the full TS implementations. 2022-08-31 19:21:45 +01:00
NEOLPAR 6daa49927e plugins npm and url working 2022-08-31 17:53:00 +01:00
mike12345567 e149b3d807 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 16:24:10 +01:00
NEOLPAR 0e2a86460c uploading npm and url plugins 2022-08-31 16:09:47 +01:00
mike12345567 320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Andrew Kingston 512d225389 Merge pull request #7450 from Budibase/cheeks-fixes
App navigation and screen migration for imports and templates
2022-08-31 15:27:18 +01:00
Andrew Kingston 34723260a8 Add test case for migrating navigation settings from old apps 2022-08-31 14:27:22 +01:00
Rory Powell 7c2c4a0f94 Add conditional around joiValidator schema.append 2022-08-31 12:24:12 +01:00
Rory Powell 5f022e04a3 Merge branch 'develop' into user-fixes 2022-08-31 11:39:41 +01:00
Rory Powell 32c26709fc Merge branch 'master' into develop 2022-08-31 11:35:07 +01:00
Rory Powell 435465f93a Update shutdown logging 2022-08-31 11:05:49 +01:00
Rory Powell dd86875ea2 Update shutdown logging 2022-08-31 10:47:41 +01:00
NEOLPAR e5446d2f8a plugin create npm 2022-08-30 21:37:08 +01:00
Mel O'Hagan b11b3c11fb lint 2022-08-30 19:56:38 +01:00
Mel O'Hagan 0e44703e95 Delete method S3 Bucket 2022-08-30 19:56:08 +01:00
Andrew Kingston f2ce59e36c Update chokidar params to use polling to avoid problems with file watching 2022-08-30 19:23:34 +01:00
Mel O'Hagan 088cf26b46 Create Bucket 2022-08-30 19:17:10 +01:00
Mel O'Hagan 3443e2cd48 Create WIP 2022-08-30 16:56:56 +01:00
Mel O'Hagan 0e219e1545 remove async 2022-08-30 15:19:18 +01:00
Mel O'Hagan 8c40394d35 Handle non-csv file error 2022-08-30 15:18:44 +01:00
Mel O'Hagan 1e70f6afb4 Promisify stream 2022-08-30 13:55:55 +01:00
Mel O'Hagan 9e864e07a9 WIP 2022-08-30 13:42:49 +01:00
Mel O'Hagan e2033898b0 Add additional params to listObjects 2022-08-30 11:17:11 +01:00
Rory Powell 368b48719c Conditionally enable elastic apm 2022-08-30 10:59:27 +01:00
Peter Clement a8eb172953 lint 2022-08-30 10:50:25 +01:00
Peter Clement b9b8d59005 add plugins ui 2022-08-30 10:49:19 +01:00
Martin McKeaveney 02c93071ee merge 2022-08-30 10:33:37 +01:00
Mel O'Hagan f2881fc714 Add delete button 2022-08-25 17:40:09 +01:00
Mel O'Hagan 52c8fda064 Add mongodb aggregate method 2022-08-25 17:30:47 +01:00
Martin McKeaveney 2470d711b0 fixing s3 outage errors and scoping AWS configuration to service level 2022-08-25 17:01:12 +01:00
Martin McKeaveney 4aa99336d7 adding path variable 2022-08-25 11:07:35 +01:00
Mel O'Hagan 8738beb907 Upgrade to mongodb@4.9 2022-08-25 11:02:46 +01:00
Martin McKeaveney d5c2f32df3 additional logging around component definitions 2022-08-25 10:57:30 +01:00
Andrew Kingston f8c005631d Merge branch 'develop' of github.com:Budibase/budibase into cheeks-lab-day-eject-blocks 2022-08-25 09:37:26 +01:00
Andrew Kingston 62f1a07887 Remove commented out migrations 2022-08-25 08:37:52 +01:00
Andrew Kingston c0f26819dc Update types 2022-08-25 08:10:11 +01:00
Andrew Kingston 452eba8635 Automatically migrate old apps server-side when importing or using templates 2022-08-24 21:35:24 +01:00
Andrew Kingston 06eee0d386 Make block ejection work properly via the builder rather than client app button hack 2022-08-23 19:05:38 +01:00
Mel O'Hagan 1e9234da8e lint 2022-08-23 15:33:30 +01:00
Mel O'Hagan bbc40b2d2c Generic handle objectid 2022-08-23 15:33:04 +01:00
Rory Powell 6cdcfe18c8 Disable automation chaining in cloud 2022-08-23 12:35:53 +01:00
Rory Powell 7275ec5f99 Disable recursive row update on cloud automations 2022-08-23 11:41:58 +01:00
melohagan f56e72dffd Merge pull request #7364 from Budibase/bug/sev2/app-action-no-field-crash
Null safety for App Action no fields
2022-08-23 11:28:29 +01:00
Andrew Kingston f0e158cc81 Improve websocket types 2022-08-23 08:48:16 +01:00
Andrew Kingston c1822ecac6 Clean up websocket initialisation 2022-08-22 18:24:34 +01:00
Andrew Kingston 36b067a600 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience-websocket 2022-08-22 17:54:14 +01:00
Andrew Kingston 975afc29d2 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-22 11:27:18 +01:00
Andrew Kingston 23a91b89a7 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-22 11:27:04 +01:00
Andrew Kingston 1a29554997 Remove log 2022-08-20 13:51:32 +01:00
Andrew Kingston d19a0f171e Serve builder preview via server to fix dependency on third party cookies 2022-08-20 13:47:57 +01:00
Rory Powell 917bb96ae6 add on() to mock queue 2022-08-20 11:42:51 +01:00
Rory Powell 28cdb16e08 enable stalled job disabling 2022-08-20 11:02:22 +01:00
Rory Powell f273a6f779 Add logging to all event listeners for automations + stalled handling stub 2022-08-19 23:14:19 +01:00
Rory Powell ad79aba93b Merge pull request #7367 from Budibase/enable-node-debug
Add support for NODE_DEBUG to app-service in kubernetes
2022-08-19 15:26:29 +01:00
Rory Powell 97cafac46c Add support for NODE_DEBUG to app-service in kubernetes 2022-08-19 15:21:53 +01:00
Mel O'Hagan ef7b7079b0 tableId null safety 2022-08-19 14:57:15 +01:00
Rory Powell 8fc8308530 Merge branch 'develop' into feature/day-pass-pricing 2022-08-19 14:08:03 +01:00
Andrew Kingston abd732fa52 Add tests for exporting data 2022-08-19 13:54:08 +01:00
Andrew Kingston 2c87d6e340 Initial work on websockets 2022-08-19 11:09:20 +01:00
Rory Powell af7c64255b usage page updates 2022-08-19 09:28:26 +01:00
mike12345567 f329f9868c Adding management of the new README.md file that is retrieved with the plugin skeletons. 2022-08-18 18:23:07 +01:00
mike12345567 2bb32253d8 Adding in hash handling for datasource plugins. 2022-08-18 15:21:55 +01:00
mike12345567 38e97c7cdb Adding check to make sure build/watch occurs inside a plugin directory. 2022-08-18 13:29:49 +01:00
Andrew Kingston 2d5d22c914 Add sanity checks to plugin watcher 2022-08-18 12:22:32 +01:00
Andrew Kingston c561156670 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-18 11:23:41 +01:00
Andrew Kingston 249b960ff6 Treat any tarball as plugins when watching plugins directory 2022-08-18 11:23:24 +01:00
mike12345567 7dfe049ae6 Adding full builder integration of custom components - splitting into own section properly - fixing some issues with SVG class overlap. 2022-08-17 23:13:51 +01:00
Mel O'Hagan fb51090752 Allow list of named tables to be fetched 2022-08-17 18:16:11 +01:00
melohagan 5b9b071f62 Merge pull request #7243 from Budibase/bug/sev2/orphaned-minio-attachment
Delete attachments on field clear from minio bucket
2022-08-17 16:48:27 +01:00
mike12345567 b6a5ccbf10 Adding some controls around datasource config creation and updating minio fetch. 2022-08-17 11:01:25 +01:00
mike12345567 2aaff7576b Adding full flow for creating custom datasource. 2022-08-17 10:05:13 +01:00
Andrew Kingston e07327bd4e Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-16 15:18:58 +00:00
Andrew Kingston 50c0e9ca69 Default plugins dir to /plugins 2022-08-16 15:16:46 +00:00
Michael Drury a19790e93e Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-16 15:44:05 +01:00
Michael Drury 6ddf6c58d2 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-16 15:42:47 +01:00
Andrew Kingston 3518642b15 Add missing declaration of objectstore module 2022-08-16 14:42:32 +00:00
Michael Drury cfbc9b043c Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-16 15:39:40 +01:00
Andrew Kingston 468e840a0c Only watch plugins in single tenant envs 2022-08-16 14:02:51 +00:00
Andrew Kingston 12ac9caeb9 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-15 22:24:41 +01:00
Andrew Kingston 6093da79d6 Add hot reloading for component plugins via watched plugin directory 2022-08-15 22:23:45 +01:00
mike12345567 51e06a9c7a Adding custom datasources to UI. 2022-08-15 18:38:09 +01:00
mike12345567 4683c57e02 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-15 16:17:54 +01:00
Mel O'Hagan 1200f4d2a0 Allow delete attachments from builder data section 2022-08-15 15:46:55 +01:00
Mel O'Hagan 9aacc7cccb lint 2022-08-15 14:11:42 +01:00
Mel O'Hagan f810d1f134 Added unit tests for internalSearch 2022-08-15 14:11:15 +01:00
mike12345567 ae9ae26bd4 Merge branch 'develop' of github.com:Budibase/budibase into feature/multiselect-filters 2022-08-15 12:24:41 +01:00
Andrew Kingston 3a7c92e202 Support filtering data exports to only certain columns with internal tables 2022-08-13 15:38:21 +01:00
mike12345567 e5881e1f24 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-12 17:04:05 +01:00
mike12345567 970e7ee3e7 Making integrations more like what custom integrations look like (to simplify integration). 2022-08-12 17:03:06 +01:00
Andrew Kingston 6c7a7648d9 Fix rev when uploading a new plugin 2022-08-12 16:19:29 +01:00
Andrew Kingston 8eb6400252 Overwrite existing plugins of the same name and version 2022-08-12 14:41:37 +01:00
NEOLPAR e5e8f5ed7f Merge branch 'master' into fix/datasource-not-exporting 2022-08-12 14:37:44 +01:00
Andrew Kingston f1d5691fb7 Update name of types constant 2022-08-12 14:01:56 +01:00
NEOLPAR 53a01941eb code styles 2022-08-12 13:50:35 +01:00
Mel O'Hagan 5171fc09fb Delete attachments on field clear 2022-08-12 11:29:57 +01:00
Andrew Kingston f0d17b2039 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 17:05:58 +01:00
Andrew Kingston 846b58364f Notify client when plugins are added when saving screens 2022-08-11 17:04:47 +01:00
mike12345567 c9c468a424 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:36:07 +01:00
mike12345567 76d427001a Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:34:01 +01:00
mike12345567 1c7f860184 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-08-11 16:28:46 +01:00
Andrew Kingston 106cfe6687 Detect custom component usages in screens and save metadata in app doc 2022-08-11 15:31:21 +01:00
Andrew Kingston 58c9965bd9 Enrich component definitions with custom components 2022-08-11 15:30:59 +01:00
Andrew Kingston f6e67e3519 Export updateAppPackage function to be used elsewhere 2022-08-11 15:30:27 +01:00