Commit Graph

4446 Commits

Author SHA1 Message Date
Andrew Kingston 8a2d4b7052 Merge branch 'develop' of github.com:Budibase/budibase into websocket-redis-integration 2023-05-31 16:28:14 +01:00
Andrew Kingston ffbbf04e86 Lint 2023-05-31 16:08:35 +01:00
Andrew Kingston a7c6298d1f Ensure socket pruning due to redis TTL expiry works as expected 2023-05-31 15:37:39 +01:00
Dean bb44c9f07f Added console log 2023-05-31 15:20:25 +01:00
Andrew Kingston 05e34076f7 Fully rewrite websocket redis integration to use individual keys per session, enable TTLs on sesisons, prune sessions when users connect and add a heartbeat to sockets 2023-05-31 15:13:22 +01:00
Peter Clement c6d0da33f4 add import for performance lib 2023-05-31 11:33:52 +01:00
Andrew Kingston d926650232 Add back in functionality to select different redis DB's per client 2023-05-31 10:52:39 +01:00
Peter Clement 162ea5d969 update log formatting 2023-05-31 10:51:54 +01:00
Andrew Kingston d3fdb52bf5 Store all socket users in redis to allow all server instances to be aware of all users 2023-05-31 10:21:50 +01:00
Peter Clement 702c908ae8 remove logging 2023-05-31 09:42:44 +01:00
Michael Drury 1547280514 Merge pull request #10739 from Budibase/fix/multi-dev-conflicts
Multidev lock and conflict management
2023-05-30 22:57:00 +01:00
Rory Powell a1dbd67535 Remove debug log 2023-05-30 19:23:19 +01:00
Rory Powell b0783d373a Lint 2023-05-30 19:16:36 +01:00
mike12345567 7c7bd4d5cb Fix for debugging with webstorm the old way (if desired), updating the builder middleware to be more multi-dev capable, ignoring 409s when attempting to update the last updated at for apps (if multiple devs hit at same time, only use one) also updating writethrough cache to retry once, with the extended TTL on locks, plus the multi-dev collab it can take a minute to update usage quota doc when a lot of updates occur at once. 2023-05-30 17:41:20 +01:00
Peter Clement ef9fc94728 Merge branch 'fix/looping-performance-bug' of github.com:Budibase/budibase into fix/looping-performance-bug 2023-05-30 16:52:34 +01:00
Peter Clement ed6cd8144b lint 2023-05-30 16:52:22 +01:00
Rory Powell 207512396a Merge pull request #10738 from Budibase/automation-investigation
Automation investigation logging + max doc size fix for automation log
2023-05-30 16:45:27 +01:00
Rory Powell df5654a7e7 Merge branch 'develop' into fix/looping-performance-bug 2023-05-30 16:41:11 +01:00
Rory Powell 6230e62b9b Automation investigation logging + max doc size fix for automation log 2023-05-30 16:37:39 +01:00
Peter Clement 3119ba5a8d remove log 2023-05-30 14:41:04 +01:00
Peter Clement 0a91e5bed1 update let to const 2023-05-30 14:26:49 +01:00
Peter Clement 5a7f0ba586 Fix performance issue with looping and context 2023-05-30 14:25:28 +01:00
Gerard Burns 23ee9f4af8 Post Sign Up Onboarding Changes (#10701)
* wip

* PR Feedback

* Fixes

* PR Feedback

* PR Feedback

* PR Feedback
2023-05-30 12:54:57 +01:00
Andrew Kingston be40d72f55 Merge pull request #10712 from Budibase/data-section-multidev
Multiple user collaboration for data section
2023-05-30 09:08:14 +01:00
Peter Clement 55e56e2c1f Merge branch 'feature/sync-automations' of github.com:Budibase/budibase into feature/sync-automations 2023-05-26 16:58:12 +01:00
Peter Clement 2ae960e2ee fix broken test 2023-05-26 16:58:00 +01:00
mike12345567 7ba21d836b Merge branch 'develop' of github.com:Budibase/budibase into feature/sync-automations 2023-05-26 16:42:01 +01:00
Peter Clement 66e1f57a3d one more feature check for safety on the trigger 2023-05-26 16:06:16 +01:00
deanhannigan bd50f32f0d Merge pull request #10713 from Budibase/fix/internal-view-eval-fn
Fix for fetching Internal DB Views in QA cloud
2023-05-26 11:51:07 +01:00
Peter Clement 5a73b02827 update feature array to be an object 2023-05-26 11:02:47 +01:00
Dean e1a87f2072 Reverted eval call to direct. Indirect appears to cause issues in cloud 2023-05-26 10:22:28 +01:00
Adria Navarro 77a619945b Merge pull request #10680 from Budibase/budi-6933-verify-data-source-connection-during
Verify data source connection before saves
2023-05-26 10:47:42 +02:00
Andrew Kingston 520158c8f9 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-26 09:39:06 +01:00
Peter Clement 70dfd9e8e5 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-26 09:26:51 +01:00
Andrew Kingston cc7df474c9 Standardise usage of user avatars and colours across the entire platform 2023-05-26 09:24:53 +01:00
deanhannigan 567ee451dd Merge pull request #10702 from Budibase/fix/data-export-rows
Fixes and updates for export internal rows
2023-05-26 09:08:35 +01:00
melohagan b5c98871ad Update table data via CSV import (#10313)
* Add identifierFields select for import

* Update rows on import (Internal DB)

* Only allow internal DB to upsert import CSV

* Clear identifierFields when turning off update

* Passing table instead of tableId

* Pass table

* Pass tableType
2023-05-25 18:05:07 +01:00
Dean 146940f6ae Added error handling for export row front end and fixed row export backend behaviour 2023-05-25 17:50:52 +01:00
Peter Clement b0a32f03b4 remove log 2023-05-25 09:14:09 +01:00
Andrew Kingston 5e480a1527 Use socker.io redis adapter to broadcast events to all server instances 2023-05-25 08:48:56 +01:00
Martin McKeaveney 77c2e309dd merge 2023-05-24 17:35:04 +01:00
Martin McKeaveney f86d321e2e restrict openai just to self host 2023-05-24 17:17:23 +01:00
Martin McKeaveney db5d051755 GPT4 support 2023-05-24 15:26:27 +01:00
Andrew Kingston 5cf4753853 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-24 15:14:32 +01:00
Peter Clement 4d5a922684 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-24 15:05:58 +01:00
Peter Clement a9bb534cdf set flag in automation orchestrator 2023-05-24 14:41:58 +01:00
Adria Navarro b264708af6 Merge remote-tracking branch 'origin/develop' into chore/esbuild 2023-05-24 14:17:32 +02:00
Martin McKeaveney bbab2a9adc merge 2023-05-24 11:25:49 +01:00
Adria Navarro 237cda064c Simplify integration features 2023-05-24 10:50:51 +02:00
Peter Clement 6818e4debb check collection actually exists 2023-05-23 16:12:20 +01:00
Peter Clement 8d3a5307ed sync automation webhooks tests 2023-05-23 15:55:52 +01:00
Peter Clement 986348f511 sync automation tests 2023-05-23 15:55:25 +01:00
Adria Navarro c3036af072 Merge pull request #10659 from Budibase/feature/table-fetching
Datasource+ table fetching API
2023-05-23 15:39:18 +02:00
andz-bb 7b9d56ac25 add role field to snowflake datasource connection 2023-05-23 12:38:50 +01:00
mike12345567 590844c8a9 PR comments. 2023-05-23 12:22:22 +01:00
Adria Navarro aa58a24a6d Change query for retrieving postgres primary keys 2023-05-23 11:20:18 +02:00
Adria Navarro e838a90d3e Add small unit test 2023-05-23 10:22:26 +02:00
Adria Navarro 023373bb25 Remove unnecessary load info 2023-05-23 10:18:37 +02:00
Adria Navarro b7b604ca00 Improve test 2023-05-23 10:17:42 +02:00
Adria Navarro 5ea19986b1 Add basic test 2023-05-23 10:14:06 +02:00
Adria Navarro 74ea851fa3 Fetch google sheets 2023-05-23 09:55:46 +02:00
mike12345567 76eef8d3d4 Fixing some test issues. 2023-05-22 16:25:50 +01:00
Andrew Kingston 9ab5c8792a Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-22 16:01:50 +01:00
Andrew Kingston cfa07a68ae Handle table, query and datasource events using builder socket 2023-05-22 15:59:44 +01:00
Peter Clement a8e40d711b uneeded input value 2023-05-22 15:53:20 +01:00
Peter Clement 754b30dd5c add features property to automation defintions 2023-05-22 15:46:42 +01:00
mike12345567 83ddb9c8dd Adding feature to denote fetch table names function. 2023-05-22 14:28:18 +01:00
mike12345567 d6c07f47b6 Adding base implementation for googlesheets integration. 2023-05-22 13:57:56 +01:00
Andrew Kingston 15ff635c6e Merge pull request #10591 from Budibase/fix/automation-filtering
Fix automation filtering on number fields
2023-05-22 13:12:35 +01:00
mike12345567 ad358fe1ca Merge branch 'develop' of github.com:Budibase/budibase into feature/table-fetching 2023-05-22 12:56:10 +01:00
Adria Navarro 3d7af9b2a3 Fix manifest ref 2023-05-22 09:42:43 +02:00
Adria Navarro 986d4c4740 Merge branch 'develop' into chore/esbuild 2023-05-19 17:26:47 +02:00
Adria Navarro 82f53483b2 Fix server docker 2023-05-19 16:44:09 +02:00
Peter Clement d7ae338bc5 fix import 2023-05-19 15:14:01 +01:00
Peter Clement 9b7972fdfd remove middleware but check if prod in controller 2023-05-19 15:12:08 +01:00
Michael Drury 38e39cf2f2 Adding negative test case for connections and adding test of table name fetching for postgres. 2023-05-19 13:36:05 +01:00
Michael Drury d85bcbc7e5 Adding test for postgres verify. 2023-05-19 12:19:55 +01:00
Adria Navarro 0a2335a047 Merge pull request #10622 from Budibase/chore/improve_pipeline_times
Chore - Improve pipeline run time
2023-05-19 13:18:21 +02:00
Peter Clement d271bbdadb rename syncWebHooks to syncAutomations 2023-05-19 10:07:02 +01:00
Michael Drury 2223027d28 Adding API for retrieving table names. 2023-05-18 23:22:52 +01:00
Michael Drury 732ebb4f87 Adding function to fetch table names. 2023-05-18 22:09:44 +01:00
Peter Clement e1eda14204 move sync automations away from bull and call directly 2023-05-18 17:01:53 +01:00
Peter Clement f680fbd822 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-18 11:35:25 +01:00
Michael Drury 62e9777407 Merge pull request #10633 from Budibase/fix/live-app-user-updates
Production app user updates
2023-05-18 10:46:31 +01:00
Adria Navarro 2d2d50a5df Merge branch 'develop' into chore/esbuild 2023-05-18 11:34:11 +02:00
Rory Powell a685f181da Merge branch 'master' into develop 2023-05-18 09:10:51 +01:00
Andrew Kingston 3794d8e204 Simplify websocket comms for grid and improve builder socket 2023-05-18 08:57:20 +01:00
Rory Powell 55ee94892a Support setting object name for logged json objects 2023-05-17 22:18:50 +01:00
mike12345567 cf7107d19a Updating sync to cover both prod and dev apps. 2023-05-17 19:35:00 +01:00
Andrew Kingston 0bebacc741 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-17 16:38:01 +01:00
Rory Powell 0aff89a479 Merge pull request #10626 from Budibase/chore/automation-logging-updates
Automation logging updates
2023-05-17 14:58:16 +01:00
Rory Powell f41b134d31 Refactor to use param for doInAutomationContext 2023-05-17 14:57:29 +01:00
Rory Powell 578b599428 Lint 2023-05-17 14:10:22 +01:00
Rory Powell ad37186665 Logging updates for automations 2023-05-17 13:54:20 +01:00
mike12345567 f3785892a9 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-05-17 12:45:28 +01:00
Rory Powell 42f472b038 Type updates for automation jobs 2023-05-17 12:26:07 +01:00
Adria Navarro 60109ebcda Fix manifest usage 2023-05-17 12:55:04 +02:00
Adria Navarro 4f3139a47b Merge branch 'develop' into feature/datasource-conns 2023-05-17 12:00:56 +02:00
Adria Navarro 8e95038671 Merge pull request #10620 from Budibase/feature/oracle-conn-checking
Oracle connection checking
2023-05-17 10:52:31 +02:00
mike12345567 e09550f7e3 PR comments. 2023-05-17 09:45:25 +01:00
Adria Navarro a2e22bda71 Merge pull request #10618 from Budibase/budi-6932/check_elastic
Check elastic search connection settings
2023-05-17 10:16:16 +02:00
mike12345567 ee5f0ec641 Remove unused type. 2023-05-17 09:15:06 +01:00
Adria Navarro 896bc61934 Check elastic connection 2023-05-17 09:38:37 +02:00
mike12345567 9f57d7c33a Fixes after testing against actual Oracle service. 2023-05-16 19:31:12 +01:00
mike12345567 832f8b3aa8 Adding Oracle connection checking. 2023-05-16 19:04:46 +01:00
Peter Clement e3d867611b use correct sdk import 2023-05-16 16:05:37 +01:00
Andrew Kingston 1e48020001 Merge branch 'develop' of github.com:Budibase/budibase into data-section-multidev 2023-05-16 15:23:30 +01:00
mike12345567 14806809e8 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-05-16 14:54:44 +01:00
Andrew Kingston 6ed691be1d Improve builder socket 2023-05-16 14:18:31 +01:00
Adria Navarro e465422031 Implement connection 2023-05-16 15:08:34 +02:00
Adria Navarro ce357ecac8 Setup CONNECTION_CHECKING feature 2023-05-16 13:37:30 +02:00
Adria Navarro d285c2aeb2 Merge pull request #10601 from Budibase/budi-6932/verify_google_sheets
Verify google sheets connection
2023-05-16 13:33:08 +02:00
Adria Navarro 87497fee73 Comments 2023-05-16 13:24:16 +02:00
Adria Navarro 419e2de602 Test airtable connection 2023-05-16 13:24:16 +02:00
Adria Navarro be6c398f53 Remove bool ref 2023-05-16 13:23:35 +02:00
Adria Navarro 2176ac8da7 Clean code 2023-05-16 11:49:51 +02:00
Adria Navarro 062127b1f1 Fix types 2023-05-16 11:48:40 +02:00
Adria Navarro b3b962534f Test snowflake connection 2023-05-16 11:47:38 +02:00
Adria Navarro d6473aab87 Append auth on verification 2023-05-16 11:47:38 +02:00
Adria Navarro 911a072069 Update types 2023-05-16 11:44:58 +02:00
Adria Navarro a21039d5b4 Fix auth checks when specified auth 2023-05-16 11:43:13 +02:00
Adria Navarro 5e7d839cb1 Use existing merge 2023-05-16 11:43:13 +02:00
Adria Navarro a676e42b1f Handle config 2023-05-16 11:43:13 +02:00
Adria Navarro cd93d327a5 Test google sheets 2023-05-16 11:43:13 +02:00
Adria Navarro b5890b788f Append auth on verification 2023-05-16 11:43:13 +02:00
Peter Clement d43fc819c7 refactor check for collect step into sdk 2023-05-16 09:29:40 +01:00
Dean 728eb3bb09 Fix for autoid issue on create row 2023-05-15 19:22:22 +01:00
Andrew Kingston 1bfe823bce Fix filtering in automations not accounting for number prefixes in filter expression 2023-05-15 17:45:09 +01:00
mike12345567 6b7269b954 Refactoring response from integrations to a simple type. 2023-05-15 17:36:16 +01:00
Michael Drury 18d2c33839 Merge pull request #10583 from Budibase/budi-6932/verify_redis
Implement redis connection verification
2023-05-15 17:22:32 +01:00
Michael Drury fbc3697c8c Merge pull request #10546 from Budibase/budi-6932/verify_mysql
Implement mysql connection verification
2023-05-15 17:13:32 +01:00
Michael Drury 9e6f22653b Merge pull request #10550 from Budibase/budi-6932/verify_couchdb
Implement couchdb connection verification
2023-05-15 17:12:54 +01:00
Michael Drury 3ef204cf7b Merge pull request #10553 from Budibase/budi-6932/verify_mssql
Implement MSSQL connection verification
2023-05-15 17:12:05 +01:00
Michael Drury f9fd3d942a Merge pull request #10554 from Budibase/budi-6932/verify_mongo
Implement mongo connection verification
2023-05-15 17:11:37 +01:00
Michael Drury 001e8757e8 Merge pull request #10555 from Budibase/budi-6932/verify_arango
Implement arango connection verification
2023-05-15 17:11:12 +01:00
Michael Drury 328514afdd Merge pull request #10588 from Budibase/budi-6932/verify_s3
Implement S3 connection verification
2023-05-15 17:10:38 +01:00
Michael Drury d77107f540 Merge pull request #10589 from Budibase/budi-6932/verify_dynamodb
Implement dynamodb connection verification
2023-05-15 17:10:10 +01:00
mike12345567 bd74f8eef7 Updating testConnection usage. 2023-05-15 17:08:23 +01:00
mike12345567 571987a2ce Merge branch 'feature/datasource-connections' of github.com:Budibase/budibase into feature/datasource-conns 2023-05-15 17:00:30 +01:00
Adria Navarro 3933a3881b Test dynamodb connection 2023-05-15 17:58:09 +02:00
Adria Navarro f2f0c2e708 Typing 2023-05-15 17:56:48 +02:00
Adria Navarro 1e505791c0 Implement s3 checks 2023-05-15 17:37:28 +02:00
Adria Navarro 47d8701578 Move files 2023-05-15 16:53:32 +02:00
Adria Navarro 058ac416ea Test redis 2023-05-15 16:50:37 +02:00
Adria Navarro fad57db634 Implement the check as part of the integration 2023-05-15 16:48:40 +02:00
Adria Navarro 901bff5399 Validate arango 2023-05-15 16:47:41 +02:00
Adria Navarro 2f9b076381 Implement the check as part of the integration 2023-05-15 16:38:42 +02:00
Adria Navarro e8fa690566 Add mongo checks 2023-05-15 16:37:20 +02:00
Adria Navarro d98bc11a20 Clean 2023-05-15 16:30:43 +02:00
Adria Navarro 2641a8c135 Clean code 2023-05-15 16:30:43 +02:00