Commit Graph

4382 Commits

Author SHA1 Message Date
Adria Navarro be6c398f53 Remove bool ref 2023-05-16 13:23:35 +02:00
Adria Navarro 2176ac8da7 Clean code 2023-05-16 11:49:51 +02:00
Adria Navarro 062127b1f1 Fix types 2023-05-16 11:48:40 +02:00
Adria Navarro b3b962534f Test snowflake connection 2023-05-16 11:47:38 +02:00
Adria Navarro d6473aab87 Append auth on verification 2023-05-16 11:47:38 +02:00
Adria Navarro 911a072069 Update types 2023-05-16 11:44:58 +02:00
Adria Navarro a21039d5b4 Fix auth checks when specified auth 2023-05-16 11:43:13 +02:00
Adria Navarro 5e7d839cb1 Use existing merge 2023-05-16 11:43:13 +02:00
Adria Navarro a676e42b1f Handle config 2023-05-16 11:43:13 +02:00
Adria Navarro cd93d327a5 Test google sheets 2023-05-16 11:43:13 +02:00
Adria Navarro b5890b788f Append auth on verification 2023-05-16 11:43:13 +02:00
Peter Clement d43fc819c7 refactor check for collect step into sdk 2023-05-16 09:29:40 +01:00
Dean 728eb3bb09 Fix for autoid issue on create row 2023-05-15 19:22:22 +01:00
Andrew Kingston 1bfe823bce Fix filtering in automations not accounting for number prefixes in filter expression 2023-05-15 17:45:09 +01:00
mike12345567 6b7269b954 Refactoring response from integrations to a simple type. 2023-05-15 17:36:16 +01:00
Michael Drury 18d2c33839 Merge pull request #10583 from Budibase/budi-6932/verify_redis
Implement redis connection verification
2023-05-15 17:22:32 +01:00
Michael Drury fbc3697c8c Merge pull request #10546 from Budibase/budi-6932/verify_mysql
Implement mysql connection verification
2023-05-15 17:13:32 +01:00
Michael Drury 9e6f22653b Merge pull request #10550 from Budibase/budi-6932/verify_couchdb
Implement couchdb connection verification
2023-05-15 17:12:54 +01:00
Michael Drury 3ef204cf7b Merge pull request #10553 from Budibase/budi-6932/verify_mssql
Implement MSSQL connection verification
2023-05-15 17:12:05 +01:00
Michael Drury f9fd3d942a Merge pull request #10554 from Budibase/budi-6932/verify_mongo
Implement mongo connection verification
2023-05-15 17:11:37 +01:00
Michael Drury 001e8757e8 Merge pull request #10555 from Budibase/budi-6932/verify_arango
Implement arango connection verification
2023-05-15 17:11:12 +01:00
Michael Drury 328514afdd Merge pull request #10588 from Budibase/budi-6932/verify_s3
Implement S3 connection verification
2023-05-15 17:10:38 +01:00
Michael Drury d77107f540 Merge pull request #10589 from Budibase/budi-6932/verify_dynamodb
Implement dynamodb connection verification
2023-05-15 17:10:10 +01:00
mike12345567 bd74f8eef7 Updating testConnection usage. 2023-05-15 17:08:23 +01:00
mike12345567 571987a2ce Merge branch 'feature/datasource-connections' of github.com:Budibase/budibase into feature/datasource-conns 2023-05-15 17:00:30 +01:00
Adria Navarro 3933a3881b Test dynamodb connection 2023-05-15 17:58:09 +02:00
Adria Navarro f2f0c2e708 Typing 2023-05-15 17:56:48 +02:00
Adria Navarro 1e505791c0 Implement s3 checks 2023-05-15 17:37:28 +02:00
Adria Navarro 47d8701578 Move files 2023-05-15 16:53:32 +02:00
Adria Navarro 058ac416ea Test redis 2023-05-15 16:50:37 +02:00
Adria Navarro fad57db634 Implement the check as part of the integration 2023-05-15 16:48:40 +02:00
Adria Navarro 901bff5399 Validate arango 2023-05-15 16:47:41 +02:00
Adria Navarro 2f9b076381 Implement the check as part of the integration 2023-05-15 16:38:42 +02:00
Adria Navarro e8fa690566 Add mongo checks 2023-05-15 16:37:20 +02:00
Adria Navarro d98bc11a20 Clean 2023-05-15 16:30:43 +02:00
Adria Navarro 2641a8c135 Clean code 2023-05-15 16:30:43 +02:00
Adria Navarro 0418e90a37 Implement the check as part of the integration 2023-05-15 16:30:43 +02:00
Adria Navarro 32695018bf Validate and test microsoft sql 2023-05-15 16:30:43 +02:00
Peter Clement 007f5ca8a9 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-15 15:19:44 +01:00
Andrew Kingston 46d8ad2864 Restore proper functionality for showing other users inside grids 2023-05-15 14:51:54 +01:00
Peter Clement 266465c8df convert timeout seconds to milliseconds 2023-05-15 14:48:34 +01:00
Adria Navarro bd736836f0 Remove export 2023-05-15 13:55:22 +02:00
Adria Navarro d656edad40 Implement the check as part of the integration 2023-05-15 13:54:32 +02:00
Adria Navarro 209ada0c38 Validate couchdb 2023-05-15 13:54:32 +02:00
Adria Navarro 8a1564ef07 Implement the check as part of the integration 2023-05-15 13:48:09 +02:00
Adria Navarro 721492e76d Validate mysql 2023-05-15 13:47:48 +02:00
Adria Navarro f10a66cc42 Type mysql configs 2023-05-15 13:47:48 +02:00
Adria Navarro 99d525ad79 Move tests to qa-core 2023-05-15 13:16:56 +02:00
Adria Navarro c3856a48aa Fix types 2023-05-15 13:16:56 +02:00
Adria Navarro eaf7e399e7 Remove unnecessary export 2023-05-15 13:16:56 +02:00
Adria Navarro ffef2499cc Implement the check as part of the integration 2023-05-15 13:16:56 +02:00
Adria Navarro f5fb4f8850 Clean 2023-05-15 13:16:56 +02:00
Adria Navarro b022dcba77 Types 2023-05-15 13:16:56 +02:00
Adria Navarro 25233c5c9b Add message response 2023-05-15 13:16:56 +02:00
Adria Navarro f022a43065 Test pg connection 2023-05-15 13:16:56 +02:00
Adria Navarro 239a51a2c0 Typings 2023-05-15 13:16:56 +02:00
Adria Navarro 20aa0f50ab Clean code 2023-05-15 13:16:56 +02:00
Andrew Kingston f8f970bf7e Update grid websocket to send actual changes down to reduce API load 2023-05-12 16:13:32 +01:00
Peter Clement c86c2b4096 add synchronous webhook functionality 2023-05-12 15:57:34 +01:00
Peter Clement dcfb65b92d sync / async automations go through one endpoint 2023-05-12 15:56:24 +01:00
Andrew Kingston 7f96fbf741 Remove single user restriction and notify users if they are the primary builder or not 2023-05-12 13:55:08 +01:00
melohagan 395cf4a667 Add JSON payload support for Make and Zapier (#10529)
* Rename Integromat to Make. Update logo.

* Add JSON type for automations

* Support deprecated values in JSON

* Fix json query editor width bug

* Push body to schema if missing

* Support JSON body

* Add JSON payload support for Zapier

* Update packages/server/src/automations/steps/make.ts

Co-authored-by: Martin McKeaveney <martin@budibase.com>

* July -> November

* Add unit tests

---------

Co-authored-by: Martin McKeaveney <martin@budibase.com>
2023-05-11 17:49:33 +01:00
Peter Clement 1626571081 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-11 11:53:12 +01:00
Dean 77d1f9250c Updated import row test to evaluate the name and _id fields on the table instead of the entire object. 2023-05-10 12:52:54 +01:00
Dean 1e6652dc39 Fix for importing exported array/option fields. Fix to ensure lastid and inclusion updates persisted as a result of an import. Test updates for array and option fields 2023-05-10 12:36:01 +01:00
Peter Clement 1539bf234b add ability to trigger synchronous automation from button action 2023-05-09 12:10:20 +01:00
melohagan fb54b6de60 Add pagination to Google Sheets (#10525)
* Add pagination to Google Sheets

* Default limit to 100
2023-05-09 12:05:12 +01:00
Peter Clement ac57a849ce add collect bloc definition 2023-05-09 12:04:32 +01:00
Peter Clement 9b66b30969 add property to denote if step can be looped 2023-05-09 12:04:16 +01:00
Dean 8fcb7d880a Merge remote-tracking branch 'origin/master' into fix/inclusion-row-parsing 2023-05-09 09:46:37 +01:00
Martin McKeaveney eb37dacc73 lint 2023-05-08 16:23:49 +01:00
Martin McKeaveney b387f969d9 allow passwordless redis 2023-05-08 15:59:12 +01:00
mike12345567 57a633b926 Implementing main body of connection verification endpoint. 2023-05-05 17:40:39 +01:00
mike12345567 ce6c5bfa68 Base connection work - extending the base integration to include the option of a connection check function. 2023-05-05 15:47:55 +01:00
Dean 03c048f978 Merge remote-tracking branch 'origin/master' into fix/inclusion-row-parsing 2023-05-05 15:22:49 +01:00
Dean 0aeb06bb2b Merge commit 2023-05-05 13:39:59 +01:00
melohagan 25b42f0a28 Rename Integromat to Make. Update logo. (#10492) 2023-05-05 12:41:24 +01:00
Martin McKeaveney 1c81cc4b4d Merge pull request #10483 from Budibase/fix/empty-attachment-row-import
Fix for row import failure caused by empty attachment parsing.
2023-05-05 12:01:04 +01:00
Michael Drury cfae0f6811 Merge pull request #10487 from Budibase/fix/automation-log-issue
Potential fix for automation log issue
2023-05-05 11:59:25 +01:00
Dean b0ff61c9ec Feedback update. Console.error to logging.logalert 2023-05-05 09:24:57 +01:00
melohagan b790a1177e Don't validate empty options picker (#10302) 2023-05-05 07:50:01 +01:00
mike12345567 0d7959f720 Fixing some un-identified listeners, queue messages not being correctly printed, also improving the mechanism for detecting if in the main thread or not. 2023-05-04 17:20:21 +01:00
Martin McKeaveney 50de32a8a0 Merge pull request #10452 from Budibase/feature/clustering-support
attaching clustered mode to an env var
2023-05-04 14:25:23 +01:00
Martin McKeaveney 41c131050c lint 2023-05-04 13:43:53 +01:00
Martin McKeaveney 167dfd39d7 fix ts build 2023-05-04 13:32:17 +01:00
Dean 5498cc86bd Refactor to fix tests and added an extra empty scenario 2023-05-04 12:58:45 +01:00
Dean a1fdff8df8 Linting 2023-05-04 12:25:30 +01:00
Dean f8da7a9f28 Linting 2023-05-04 12:12:47 +01:00
Dean 56a1b068cc Added json parse option for row import attachment values 2023-05-04 11:52:20 +01:00
Dean 98963c1505 Fix for inclusion parsing for arrays and options. View table fix to hide edit button 2023-05-04 11:21:24 +01:00
Adria Navarro fa6e6b53f8 Merge pull request #10462 from Budibase/fix/budi-6789-import-data-empty-date-is-not-allowed
Fix - Budi 6789 import data empty date is not allowed
2023-05-03 19:22:06 +02:00
Adria Navarro efaf2adf05 Fix build 2023-05-03 18:05:32 +01:00
Adria Navarro cec2f88c25 Fix svelte issues 2023-05-03 18:05:32 +01:00
Adria Navarro a7f69231d9 Merge branch 'chore/npmless-builds' into chore/esbuild 2023-05-03 18:01:04 +01:00
Rory Powell e1a147e823 Merge branch 'master' into develop 2023-05-03 16:06:42 +01:00
Adria Navarro f426ba1ac3 Merge branch 'chore/npmless-builds' into chore/esbuild 2023-05-02 14:56:34 +01:00
Adria Navarro 1d041a3dd5 Support nulls when optional 2023-05-02 12:48:05 +01:00
Adria Navarro 6e7c78362e Return null instead of undefined 2023-05-02 12:46:53 +01:00
Adria Navarro 650cbc1f01 Handle cast as undefineds 2023-05-02 11:57:18 +01:00
Adria Navarro c87cc39cea Add basic tests 2023-05-02 10:44:25 +01:00
Adria Navarro 29df12c247 Add csvutils 2023-05-02 10:34:45 +01:00
Martin McKeaveney 36397bb77d enabling cluster support for ratelimit cache 2023-04-28 20:23:39 +01:00
melohagan 8742fb39d3 is empty lucene query with OR fix (#10451)
* empty lucene query with OR fix

* Fix unit test
2023-04-28 17:17:32 +01:00
mike12345567 4f7e56fed9 Making build script into a module, so that it can be used in a specialised server build which also builds the thread scripts as required for worker-farm. 2023-04-27 19:00:01 +01:00
mike12345567 de51364303 Some updates to Dockerfiles. 2023-04-27 17:00:15 +01:00
mike12345567 5363693ac3 Removing automation logs from app exports as they are not useful - they take up space and the imported app won't have ran any automations yet. I have added it as a flag so that this does not affect backups (as you would want to maintain logs for backups). 2023-04-27 11:36:52 +01:00
mike12345567 5066d20c9d Updating Dockerfiles and dockerignore to clear out any un-needed assets. 2023-04-26 17:59:18 +01:00
Pedro Silva 6e79506445 Fix failing test 2023-04-26 16:45:00 +01:00
Martin McKeaveney e70e3ae662 rename 2023-04-26 15:58:21 +01:00
Martin McKeaveney 4f020a4db4 lint 2023-04-26 15:56:46 +01:00
Martin McKeaveney 84f52683b2 chatgpt automation block 2023-04-26 15:55:44 +01:00
Pedro Silva 796c50d3e0 Merge branch 'develop' into qa-core-datasource-api-tests 2023-04-26 15:51:47 +01:00
mike12345567 49b45f5e67 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-25 17:37:56 +01:00
Adria Navarro 608a38489f Export undefineds as empty values in csv, instead of empty strings 2023-04-25 12:34:50 +01:00
Dean 72c72fc48a Lint fix 2023-04-25 12:31:52 +01:00
Dean f3be917da1 Enrich the upgradable version property when fetching the app package 2023-04-25 12:16:02 +01:00
Adria Navarro 640bb2004b Merge pull request #10324 from Budibase/chore/remove_package.json_dependency
Chore - Remove package.json dependency
2023-04-24 19:34:15 +02:00
adrinr 128802ebf3 Fix build 2023-04-24 18:05:53 +01:00
Michael Drury 9c93bf91c0 Merge pull request #10352 from Budibase/fix/10349
Allow SQL formulas using related row information to be used as display columns
2023-04-24 17:50:49 +01:00
Adria Navarro c47ff6ccfb Merge branch 'develop' into chore/remove_package.json_dependency 2023-04-24 18:42:55 +02:00
melohagan 5e76a50b0b Add info to query result payload (#10291) 2023-04-24 12:03:02 +01:00
Rory Powell ec06f13aa6 Per user pricing (#10378)
* Update pro version to 2.4.44-alpha.9 (#10231)

Co-authored-by: Budibase Staging Release Bot <>

* Track installation and unique tenant id on licence activate (#10146)

* changes and exports

* removing the extend

* Lint + tidy

* Update account.ts

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>

* Type updates for loading new plans (#10245)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS` (#10247)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete + migration (#10250)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Lint

* Types and structures for user subscription quantity sync (#10280)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing for licensing (#10346)

* Add new quota for max users on free plan

* Split available vs purchased plan & price type definitions. Update usages of available prices and plans

* Type fixes

* Add types for minimums

* New `PlanModel` type for `PER_USER` and `DAY_PASS`

* Add loadEnvFiles to lerna config for run command to prevent local test failures

* Fix types in license test structure

* Add quotas integration to user create / delete

* Always sync user count from view total_rows value for accuracy

* Add migration to sync users

* Add syncUsers.spec.ts

* Prevent old installs from activating, track install info via get license request instead of on activation.

* Add usesInvoicing to PurchasedPlan

* Add min/max users to PurchasedPlan

* Additional test structures for generating a license, remove maxUsers from PurchasedPlan - this is already present in the license quotas

* Stripe integration for monthly prorations on annual plans

* Integrate annual prorations with test clocks

* Updated types, test utils and date processing

* Lint

* Pricing/billing page (#10353)

* bbui updates for billing page

* Require all PlanTypes in PlanMinimums for compile time safety

* fix test package utils

* Incoming user limits warnings (#10379)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* Types and test updates for subscription quantity changes in account-portal (#10372)

* Add chance extensions for `arrayOf`. Update events spies with license events

* Add generics to doInTenant response

* Update account structure with quota usage

* User count limits (#10385)

* incoming user limits warning

* fix inlinealert button

* add corretc button link and text to user alert

* pr comments

* simplify limit check

* user limit messaging on add users modal

* user limit messaging on import users modal

* update licensing store to be more generic

* some styling updates

* remove console log

* Store tweaks

* Add startDate to Quota type

---------

Co-authored-by: Rory Powell <rory.codes@gmail.com>

* Lint

* Support custom lock options

* Reactivity fixes for add user modals

* Update ethereal email creds

* Add warn for getting invite from code error

* Extract disabling user import condition

* Handling unlimited users in modals logic and adding start date processing to store

* Lint

* Integration testing fixes (#10389)

* lint

---------

Co-authored-by: Mateus Badan de Pieri <mateuspieri@gmail.com>
Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Peter Clement <PClmnt@users.noreply.github.com>
2023-04-24 09:31:48 +01:00
mike12345567 c5e1457b25 Merge branch 'develop' of github.com:Budibase/budibase into fix/budi-6900 2023-04-21 12:06:18 +01:00
Andrew Kingston aefb48e363 Fix options inclusion constraint regression 2023-04-20 20:10:30 +01:00
mike12345567 060dc05afa Removing export all apps functionality from cloud - this was a very niche feature and often confusing, now there is a consistent flow for starting out in self host. 2023-04-20 17:19:17 +01:00
Andrew Kingston 55ce83c444 Grid UI in data section (#10329)
* Add WIP spreadsheet

* Add footer and improve styles

* Refactor to use IDs and support changing text values inline

* Add inline editing of options fields

* Add row deletion and fix sizing

* Add ability to add new rows

* Fix z-index issue with option cells

* Remove deletion notification and fix selection

* Add gap between items in an options cell

* Tweak options cell to be pixel perfect

* Fix padding around sheet not working when scrolling

* Add resizable columns and add support for all themes

* Allow multiselect component and field to support text values

* Generate inclusion schema when importing multiselect columns

* Add support for multiselect type

* Add number cell

* Add functional date cell

* Disable editing autocolumns

* Make sticky column the primary display and fix opening options cells

* Improve display of relationship cell and options cell

* Support empty dates and use CSS variables for easier styling

* Use more CSS variables and add utils to spreadsheets

* Add drag and drop column reordering

* Break out reordering logic into new stores

* Rename reordering to reorder

* Break out other components from spreadsheet for cleaner code

* Break out spreadsheet body into its own component

* Split into more modular components and try virtual rendering

* Test absolute positioning

* Optimise virtual rendering for both columns and rows to handle infinitely large datasets

* Optimise scrolling and virtual rendering performance

* Fix columnn reordering

* Migrate sheet to data section, improve reordering and reszing

* Clean up more sheet state and increase performance

* Fix multiple issues with z-index, reordering and resizing

* Fix date cells in sheets

* Separate data fetching logic from main sheet and tidy up

* Add infinite scroll, improve row fetching, add error handling, fix svelte store updates

* Fix overly thin scrollbars in firefox

* Use nicer checkboxes and fix some hover styles

* Fix issue reordering columns in firefox and increase performance

* Tidy up

* Use search endpoint instead of get endpoint to fetch individual rows so that relationship enrichment occurs

* Tidy up

* Fix relationship issues when creating rows

* Optimise resetting data to smoothly transition when changing datasource

* Add WIP virtual dom implementation to massively increase performance

* Refactor spreadsheet into more discreet components

* Fix multiple issues, clean up rendering, improve performance

* Tune cell sizes

* Fix some scroll issues and add shadow to sticky column

* Fix issue when no primary display is set

* Add padding to sheet

* Improve styles

* Allow reordering columns to be the first column after sticky column

* Fix row hover state not being removed

* Update hovered row on wheel

* Update scroll styles and z-index

* Improve scroll logic and handle horizontal wheel events

* Simplify and improve z index styles

* Fix styles when using no sticky columns

* Improve rendering performance

* Improve performance by removing keyed each blocks and fix reorder target styling

* Ensure scroll top is always properly reset and add config store

* Allow configuring selecting rows and adding rows

* Integrate sheet into data section better

* Add back in functional delete row button

* Refactor stores and make state more modular

* Lint and remove unused deps

* Remove add column button

* Fix options cells being unable to scroll

* Add WIP initial multi-user websocket implementation for sheets

* Add WIP multi-user UI for sheet interface

* Fix issues with not disconnecting users when swapping datasource and improve multi-user UI

* Update layout and remove logging

* WIP column popovers for dataspace sheets

* Add popovers to sheet column headers, improve mouse UX

* Tidy reordering stuff

* Refactor resizing logic into store and improve UX around hover events when resizing/reordering

* Add column sorting and reordering via popover

* Handle context menu events in header cells

* Fully integrates sheets with datasection and remove lots of old stuff

* Fix buttons being highlighted when filters are set

* Add flags for controlling editing and adding rows in sheets

* Count context menu clicks when considering the click outside handler

* Prevent adding rows to users table and remove log

* Expose loading state of sheet and improve column highlighting logic

* Small style updates

* Update delete button and allow horizontal scrolling

* Add context menu to sheets with deletion and duplication features

* Improve UX around selecting rows and cells

* Add basic keyboard interactions to dataspaces

* Improve keyboard navigation in sheets

* Remove unnecessary searching through large rows array

* Fix issue with deleting rows and fix relationship cells displaying undefined

* Improve loading state

* Update menu width

* Merge with new shared-core and moved lucene utils

* Improve rendering performance and simplify component props

* Remove new row component and improve mouse interactions

* Tidy up buttons above sheets and add FAB for adding rows

* Optimise sheet data loading and add sort button

* Update sorting and remove logs

* Add sheet button to control column visibilty, improve sorting, improve disabled states

* Fix bug with select placeholders and fix sorting loops causing endless refreshes

* Update filter button to look consistent and add double click to resize columns to default width

* Ensure all derived stores have default values

* Reset scrolling when datasource changes and fix wasted pagination calls

* Improve performance by removing searches through the full row array

* Add advanced key handling for spreadsheets and improve blur and focus UX

* Ensure the selected cell is always visible

* Add icons for all data types

* Add new long form text cell

* Add boolean cell

* Add ability to focus first cell via tab

* Add cells for formulae and JSON

* Remove console logs

* Add attachment cell

* Increase padding to account for attachment dropdown

* Prevent deleting autocolumns via keyboard

* Fix attachments overflowing

* Improve sort button, remove header more icons unless hovered and highlight sorted column

* Add functional relationship cell

* Improve relationship cell

* Fix race conditions and edge cases in relationship cell

* Update user avatar colours

* Improve preservation of column widths in sheets when making schema changes

* Remove redundant sheet schema context and fix issues with mutating table schema

* Disable websocket in sheets

* Rollback state changes when row saving fails

* Fix one-to-many relationships allowing selecting multiple rows on both sides

* Remove log

* Make sheet gutter width customisable

* Allow expanding rows using existing edit row modal

* Fix text cell not using full width

* Sort columns to put autocolumns last

* Add new footer for adding rows, improve store memoization, support inverting all data types

* Improve animations for adding rows and handle add row failure

* Ensure all sheet feature flags work as expected and fix multi row deletion

* Fix options ordering

* Fix add row button not appearing when horizontal scrollbar is hidden

* Fix selecting newly created rows

* Remove log and add notification when creating or editing columns

* Move new row component to top, automatically invert cell renderers when required

* Add resizable rows

* Fix overlapping long form text borders

* Fix scroll not working in new row

* Update new row component, fix z-index issues, improve UX

* Large refactors to row creation, naming and sheet APIs

* Refactor stores to fix dependency issues, use modals for adding rows, simplify sheet

* Fix resize overlays

* Add custom colors for drop shadows and blue-100 to all themes, fix sticky column shadow

* Increase horizontal padding when scrolling to a selected cell

* Add multiple validation improvements

* Add validation to duplicating rows

* Remove log

* Restore missing event handler

* Improve data fetch reset logic, fix issues with stale cache in spreadsheets

* Fix issue with cell colors, improve row API interactions to avoid relationship issues due to API response differences

* Fix filters not working

* Simplify logic for reordering and add new overlay. Simplify sheet cells

* Fix importing and exporting with sheets

* Fix reorder overlay z-index issue

* Fix issue when no display column exists

* Fix issue with display column not being able to be unset

* Add persitence to column size and order in sheets

* Improve sheet integration with data section and add horizontal cell inversion

* Fix double click resizing of sticky column

* Make column visibility persistent and refactor column updating

* Improve sheet loading states

* Add beta button to sheet, tidy up constants

* Work around table API inconsistencies to handle table schema updates

* Add additional reorder options and improve beta button

* Improve sorting

* Add copy and paste to spreadsheet and add immediate editing of cells without additional click

* Remove copy/paste rows, remove move to start/end, improve copy/paste for cell values

* Fix dependency ordering

* Refactor other sheet stores to improve dependency ordering

* Fix errors not showing in sticky column and clear cell value on backspace press

* Rewrite relationship cell and update default column widths

* Ensure dynamic row height is properly accounted for

* Update text cells, number cells, long form field cells and relationship cells to respect row height

* Fix row heights with sticky column

* Update JSON, boolean and date cells to respect row height

* Update attachment cell to respect row height

* Use unique background for focused cell

* Standardise shadows across cell types

* Persist row height as table metadata

* Improve a few design issues

* Clean up

* Fix relationship cells not being readonly

* Lint

* Fix icon padding in relationship picker

* Improve styles in relationship dropdown

* Update shadow

* Update relationship icons

* Update relationship icons

* Update error label max size and position

* Prevent using invalid data types as display columns

* Add menu option to edit rows in modal

* Prevent sheet handling key events sourcing from modals

* Standardise menu overlay shadow and add count to relationship cells when hovering

* Improve relationship cell performance

* Remove spellcheck from text fields

* Fix resize overlay handler height

* Fix reorder overlay height

* Remove unused code and change selected table faster in data section

* Fix table selection not working when on datasource page

* Improve sheet loading state

* Add rowHeight property to table types

* Restore builder middleware

* Remove any naming of dataspaces

* Lint

* Disable row import button for users table and add optional chaining to spreadsheetsocket invocations to fix tests

* Use unique user edit modal for editing users in sheets

* Add schemaOverrides prop to sheet and use it to customise user table schema

* Update number icon

* Fix primary display column not properly disabling certain menu options

* Merge

* Update beta button position slightly

* Update beta button text

* Fix HMR for custom plugins which was broken due to signed minio links

* Add maze link to grid

* Update koa <> socket.io integation to improve fake koa context and allow current app middleware

* Rename sheet to grid

* Fix menu postiion, fix copy and paste in menu not working

* Remove commented out usages of websocket emissions for grid
2023-04-20 15:56:24 +01:00
Andrew Kingston 84da11a475 Remove commented out usages of websocket emissions for grid 2023-04-20 15:23:57 +01:00
mike12345567 46b1180cd2 Fixing test case. 2023-04-20 11:06:16 +01:00
Andrew Kingston c82451f888 Update koa <> socket.io integation to improve fake koa context and allow current app middleware 2023-04-20 08:02:49 +01:00
mike12345567 1aca5d6407 Fixing an issue with creating relationships between existing tables, not using the correct type for the primary key in the foreign key relationship. 2023-04-19 17:17:37 +01:00
mike12345567 401d64b074 Fixing issue with SQL tables and using formulas that contain relationships as display columns. Also cleaning up imports in ExternalRequests a bit. 2023-04-19 16:16:22 +01:00
mike12345567 67de033683 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-19 15:01:26 +01:00
Andrew Kingston 1aed6f89d5 Merge 2023-04-18 21:06:04 +01:00
Andrew Kingston 9b2b071b88 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-18 21:00:42 +01:00
Michael Drury 42c37eea46 Merge pull request #10276 from Budibase/labday/automation-plugins
Automation step plugins
2023-04-18 17:33:25 +01:00
Andrew Kingston 91ee5be7c5 Disable row import button for users table and add optional chaining to spreadsheetsocket invocations to fix tests 2023-04-18 11:31:19 +01:00
Andrew Kingston 083836a87b Remove any naming of dataspaces 2023-04-18 10:46:35 +01:00
Andrew Kingston f9ab2a239f Restore builder middleware 2023-04-18 10:41:00 +01:00
Andrew Kingston a4515e1162 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-18 08:29:27 +01:00
mike12345567 9a36377d6e Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-17 18:10:29 +01:00
Andrew Kingston 208e481bbc Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-17 17:00:56 +01:00
mike12345567 b4e6cbce7a Some final updates to get tests passing again, issue with publisher tenant ID being the 'unique' format which cannot actually be used. 2023-04-17 15:59:59 +01:00
mike12345567 b6f14a3f55 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-17 14:58:40 +01:00
mike12345567 453d5cc0e6 Further PR comments. 2023-04-17 14:03:54 +01:00
adrinr e5227febd8 Use version from environment 2023-04-17 14:02:50 +01:00
Michael Drury ef5bcc4b66 Main body of PR comments, switching event handling to be a publisher of async events, a generic event; then adding a new async document update processor, which can later be converted to be part of the event processing pipeline. 2023-04-15 00:37:22 +01:00
mike12345567 c552913737 Fixing defaults in MS-SQL as well. 2023-04-14 18:10:10 +01:00
Pedro Silva 3147eb2892 Merge branch 'develop' into qa-core-datasource-api-tests 2023-04-14 17:59:40 +01:00
mike12345567 09ccac12ae Fix for default values with NOT NULL requirements being intepreted as requiring values in the frontend, presence check is now ignored if a default or auto value is found. 2023-04-14 17:56:17 +01:00
mike12345567 361005b521 Merge branch 'develop' of github.com:Budibase/budibase into chore/esbuild 2023-04-13 17:23:58 +01:00
mike12345567 f87974caf1 Removing duplicate test case. 2023-04-13 13:10:51 +01:00
mike12345567 8f8843aece Updating test cases based on new user sync and removing old endpoint testcases (endpoint removed). 2023-04-13 12:53:25 +01:00
mike12345567 7da330624f Fixing build (again). 2023-04-13 12:17:29 +01:00
mike12345567 727aba9177 Fixing build. 2023-04-13 11:19:28 +01:00
Pedro Silva 695f77fd1d Add types for datasources endpoints 2023-04-13 11:13:21 +01:00
mike12345567 b2d7f24ff3 Adding builder test case. 2023-04-12 20:02:37 +01:00
mike12345567 23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567 1129d19412 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 17:09:29 +01:00
mike12345567 cb73e3b1c3 Fixing build issue. 2023-04-12 16:22:30 +01:00
mike12345567 a9fb09424b Merge branch 'develop' of github.com:Budibase/budibase into labday/automation-plugins 2023-04-12 14:27:50 +01:00
melohagan 3a5e31710c Add db prop to redis integration (#10210)
* Add db prop to redis integration

* Add DB display

* Default DB value to 0
2023-04-12 13:51:40 +01:00
mike12345567 3eb718ea6d Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-12 13:42:46 +01:00
mike12345567 ada052e043 Merging in develop - fixing some test cases which broke in the process. 2023-04-12 10:56:21 +01:00
Andrew Kingston 0ee63417c1 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-04-11 17:36:28 +01:00
mike12345567 e623820478 Adding test cases. 2023-04-11 17:33:52 +01:00
mike12345567 1aafdbe9a7 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-11 17:28:14 +01:00
mike12345567 ac37d00f69 Updating plugins to have a SDK, which can be used for automation action retrieval as well as datasources. 2023-04-11 16:37:26 +01:00
adrinr 9a330b85f8 Fix timeouts 2023-04-11 14:20:15 +01:00
Michael Drury 1c7c06e983 Bulk of the automation plugin system, supporting custom plugins. 2023-04-10 23:48:54 +01:00
Michael Drury 4badd04e33 Some automation fixes and adding option to disable logging for CLI. 2023-04-10 22:33:53 +01:00
mike12345567 400a112a4b Refactoring automation steps to be better defined in Typescript, which allows writing the validator for automations. 2023-04-06 18:11:44 +01:00
Michael Drury 58d0a82108 First sync test, checking that a user is created correctly. 2023-04-05 22:35:01 +01:00
Michael Drury 0771ec55fb Small change to make sure no duplicates ever occur. 2023-04-05 21:22:50 +01:00
Michael Drury 70c9d06832 Adding group management to background user/group sync. 2023-04-05 20:51:47 +01:00
mike12345567 0803b08217 Merge branch 'develop' of github.com:Budibase/budibase into fix/BUDI-6754 2023-04-05 17:59:18 +01:00
Rory Powell 77ffb8d86d Run integration suite in CI again / auto detect tenancy / refactors (#10209)
* qa-core-ci-fixes

* global setup and teardown wip

* Updates to logs and setup

* Remove date and console mocking

* Update CI to spin up minimal dev env

* Update readme

* Fix scopeBackend.sh

* Ensure docker services are initialised before starting worker

* Lint

* Fix admin user being created on startup (#10219)

* use regular bootstrap and build

* Lint

* Temp: re-use global setup to get around app limit in QA
2023-04-05 15:33:56 +01:00
adrinr 38535e8ef4 Format 2023-04-05 12:17:32 +01:00
adrinr ae9f91885f Fix flaky tests 2023-04-05 12:17:02 +01:00
mike12345567 e699f4684a Updating the global user sync to be more accurate and also remove old user metadata from apps that users don't have access to anymore. 2023-04-04 18:03:56 +01:00
Rory Powell 976b3a55ca Update logging to support dd trace attributes (#10086)
* Update logging middleware to integrate with pino for console logging

* Remove elastic apm references, use updated core middlewares

* Remove redundant LOG_LEVEL definitions

* Remove no longer needed jest logging overrides

* lint

* Backwards compat between console log helpers and pino

* Configurable DISABLE_HTTP_LOGGING

* Don't log 4xx as errors

* Remove redundant ENABLE_4XX_HTTP_LOGGING

* Cleanup migrations and event logging

* Improve bb-alert logging

* Add DISABLE_HTTP_LOGGING to helm chart

* Add ops endpoints for testing

* Disable http logging in dev

* Backwards compatible tracing implementation

* Naming update on http logging env var

* lint

* Update packages/backend-core/src/environment.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Merge

* Lint

* Fix console.warn failing mock by replacing with alerts mock instead

* Lint

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-04-04 15:08:46 +01:00
Michael Drury ff98ba5a0a Adding a document update queue based on the events which can be used to track when certain documents have changed, using this for users and groups to detect when a re-sync is needed. 2023-04-04 00:25:15 +01:00
mike12345567 29def1408a Fixing syntax error and linting. 2023-04-03 15:36:34 +01:00
Michael Drury 2f57b3b16d Merge pull request #10077 from robert4dt/develop
Handle application/pdf content type in rest integration
2023-04-03 15:30:03 +01:00
Peter Clement f2eced6ea4 Merge pull request #10180 from Budibase/fix/no-iterations-loop
Add new status to handle no iterations during loop
2023-04-03 12:00:15 +01:00
Michael Drury d3e749d2de Fix for 409 conflict which occurs in one of the user test cases - should stop it occurring in future. 2023-03-31 23:32:33 +01:00
Michael Drury 09a48a1d21 Merge branch 'develop' of github.com:Budibase/budibase into fix/no-iterations-loop 2023-03-31 23:29:21 +01:00
mike12345567 2e80bab7ad Removing requirement for built client library in component test case. 2023-03-31 17:13:25 +01:00
mike12345567 906d614c64 Merge branch 'merge-master-develop' of github.com:Budibase/budibase into merge-master-develop 2023-03-31 13:51:20 +01:00
Adria Navarro 7d794f005e Merge pull request #10162 from Budibase/bug/budi-6782-internal-table-all-row-ids-for
Bug - BUDI-6782 - Internal table all row ids for
2023-03-31 14:21:15 +02:00
Michael Drury 1c6465edcb Merge pull request #10172 from Budibase/fix/budi-6797
Googlesheets onboarding - fix in cloud, disable self host
2023-03-31 13:19:29 +01:00
Rory Powell e9322be28f Merge branch 'develop' into merge-master-develop 2023-03-31 12:39:22 +01:00
adrinr e8e77cc140 Use esbuild for server 2023-03-31 12:32:41 +01:00
Rory Powell 44aa19a99a Merge branch 'master' into merge-master-develop 2023-03-31 12:26:04 +01:00
Peter Clement 0a567a3302 add new status to handle no iterations during loop 2023-03-31 12:23:10 +01:00
Adria Navarro cfb93063b2 Merge pull request #10153 from Budibase/budi-6803-delete-users-when-group-removed
BUDI-6803 - Remove users that should not be there anymore when syncGlobalUsers
2023-03-31 13:15:11 +02:00
Andrew Kingston b2d2cf3989 Merge branch 'develop' of github.com:Budibase/budibase into spreadsheet-integration 2023-03-31 12:08:58 +01:00
adrinr 4ca6982d27 Prevent double deletions 2023-03-31 11:25:51 +01:00
Rory Powell 79bec7d86d Add force exit, -e flag and streaming to tests (#10151)
* Add force exit, -e flag and streaming to tests

* Temp remove script usage from worker tests

* Revert "Temp remove script usage from worker tests"

This reverts commit 5e0ed2e92d.

* Always fail test

* Ignore server test package from coverage report

* Unscope server only

* Run all server tests again

* Update backend core test script to fail when any command fails and force exit

* Don't try to require client in test

* Port memory limit fix from develop

* Remove always failing test and commented out block for client require

* Fixing some issues with test cases.

* Revert assertions in internalSearch.spec.js

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-31 10:32:13 +01:00
adrinr 6a257bf9c3 Tweak tests 2023-03-31 09:01:40 +01:00
adrinr 48b964378b Remove all app cookie references (not really needed anymore) 2023-03-31 09:01:40 +01:00