Adria Navarro
e19c9bd66a
Remove protobufjs critical vulnerability
2024-07-02 15:21:11 +02:00
Adria Navarro
07d538f6fc
Don't trim fields on view enrich schema
2024-07-02 14:02:49 +02:00
Adria Navarro
53af94f971
Fix search returning non visible columns
2024-07-02 14:02:16 +02:00
Adria Navarro
882a056cd9
Don't trim any fields on view crud endpoints
2024-07-02 13:58:16 +02:00
Dean
1177139237
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-07-02 11:49:51 +01:00
mike12345567
5ac9fe43fc
PR comments.
2024-07-01 17:50:34 +01:00
Dean
c5b702ab69
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-07-01 16:48:41 +01:00
mike12345567
c4ffd37caa
Adding fix for backwards compat, removing columns (but still filtering on) returns no rows, rather than an error.
2024-07-01 16:37:38 +01:00
Dean
dd4519067e
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-07-01 14:15:24 +01:00
Michael Drury
f3d8afcc5b
Merge branch 'master' into fix/sqs-internal-columns
2024-07-01 14:07:27 +01:00
Michael Drury
6e57a7b821
Merge branch 'master' into fix/sqs-internal-columns
2024-07-01 13:37:57 +01:00
Michael Drury
0bccfd3e15
Merge branch 'master' into budi-8404-filtering-with-the-contains-operator-throws-an-error-when
2024-07-01 13:37:37 +01:00
mike12345567
c2d5011576
Fixing an issue with a JS testcase that depended on dates, when the month changed to July this broke - making the dates fixed to avoid this in future.
2024-07-01 13:12:20 +01:00
Sam Rose
5c09d6f41f
Fix type error.
2024-07-01 11:46:35 +01:00
Sam Rose
6eb37df92d
Respond to PR feedback.
2024-07-01 11:41:21 +01:00
Sam Rose
11f49c95dc
Fix contains search on multi-user column.
2024-07-01 09:47:58 +01:00
mike12345567
b3d07aa228
Adding parameterised tests.
2024-06-28 15:21:39 +01:00
mike12345567
13ac273c83
Updating how search filters are converted, needs full column metadata to work it out this way.
2024-06-28 14:59:00 +01:00
mike12345567
510baf4f6e
Adding test case and updating how prefix updates in filters work.
2024-06-28 14:19:11 +01:00
mike12345567
2d31e327e7
Resolving PR comments.
2024-06-28 13:49:52 +01:00
mike12345567
048d15956b
Updating environments which need to re-sync definitions.
2024-06-28 12:47:57 +01:00
Dean
77ca85f140
Attachment single does require a mapping. Clearing it to an empty string is invalid. It has been changed to null
2024-06-28 11:07:06 +01:00
Dean
7d274e5a84
Remove unnecessary row mappings. Updated input processing tests to accommodate clearing BB_REFERENCE types by defaulting to an empty array
2024-06-28 10:42:58 +01:00
Dean
a85fd8c393
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-06-27 20:18:02 +01:00
mike12345567
ade514b96f
Merge branch 'fix/sqs-internal-columns' of github.com:Budibase/budibase into fix/sqs-internal-columns
2024-06-27 18:30:40 +01:00
mike12345567
6b4852bf3e
Updating migration test case.
2024-06-27 18:30:22 +01:00
Michael Drury
c1f7561839
Merge branch 'master' into fix/sqs-internal-columns
2024-06-27 18:19:03 +01:00
mike12345567
3394e974d3
Getting casting working again, have to pass down prefix for checking against fields.
2024-06-27 18:18:41 +01:00
mike12345567
b0e6d3e72c
Correctly handling overlapping column names.
2024-06-27 17:55:09 +01:00
Dean
23b0f3dfe4
Added missing rowProcessor mapping config for BB_Reference, BB_Reference_Single and Attachment_Single
2024-06-27 14:25:32 +01:00
Michael Drury
f092bf46cf
Merge branch 'master' into revert-14020-revert-13993-fix/disallow-prohibited-columns
2024-06-27 13:30:00 +01:00
Dean
b6d7715831
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-06-27 12:49:26 +01:00
Peter Clement
cf11009e24
Update OpenAI dependency to fix 400 errors ( #14033 )
...
* Update OpenAI dependency to fix 400 errors
* add some optional chaining for safety
* add caret
* fix tests
2024-06-27 12:17:48 +01:00
Dean
2243314314
Defaulting to null in the updateRow step causes issues in row mapping. Switching back to empty string
2024-06-27 09:10:28 +01:00
mike12345567
1b9211ee6c
Initial implementation of solving SQS issue with case insensitivity.
2024-06-26 16:40:20 +01:00
Dean
d10ef7b795
Alter logic for field config checks causing test issues
2024-06-26 15:34:00 +01:00
Dean
ca44220bd3
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-06-26 14:30:08 +01:00
Dean
21c335caab
Lint and tidying up
2024-06-26 14:29:42 +01:00
mike12345567
41f045d8a6
Allow constant internal columns to be duplicated based on being case sensitive.
2024-06-26 13:36:20 +01:00
Michael Drury
cfeab17ed8
Revert "Revert "Disallow prohibited columns""
2024-06-26 12:40:16 +01:00
Dean
9adae8a9fd
If a relationship value is set to null, the row processor will set it to an empty to array an ensure its properly cleared. Previously the empty value would be an empty string, which was then set to an empty array in the rowProcessor
2024-06-26 11:12:25 +01:00
Dean
ed0f60d5d7
Added an app trigger update parser that will clean the testdata for the automation on save. Old values were not cleaned out. Added some padding to the PropField labels. General fixes
2024-06-26 11:10:15 +01:00
Michael Drury
9c92b8eff9
Merge branch 'master' into sustaining/typescript-5.5.2
2024-06-26 11:03:01 +01:00
Dean
1db1b638e6
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-06-26 09:08:11 +01:00
Sam Rose
314d62bea0
Revert "Disallow prohibited columns"
2024-06-25 14:29:56 +01:00
Dean
5ff8b03378
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-06-25 12:05:31 +01:00
Dean
e9985adcd4
Updates and refactoring of Automation flows
2024-06-25 11:52:11 +01:00
Peter Clement
1fa18ccfce
Some automation fixes and refactoring ( #13870 )
...
* fix issue where booleans were being parsed to null
* refactor looping out of automations
* clean out execute function in orchestrator of looping code
* re-add accidentally deleted file
* remove spec file
* remove log
* move code back into main automation thread
* account portal update
---------
Co-authored-by: Adria Navarro <adria@budibase.com>
Co-authored-by: Michael Drury <me@michaeldrury.co.uk>
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-06-25 11:17:14 +01:00
Peter Clement
f3d466f255
fix issue where schema wasn't updating types when a query was run ( #14004 )
...
* fix issue where schema wasn't updating types when a query was run
* add tests for schema matching
2024-06-25 08:51:35 +01:00
mike12345567
a7b995e2ad
Merge branch 'master' of github.com:Budibase/budibase into sustaining/typescript-5.5.2
2024-06-24 18:05:32 +01:00
Sam Rose
bb91849976
Merge branch 'master' into budi-8390-receiving-a-column-has-been-specified-more-than-once-in-the
2024-06-24 17:32:26 +01:00
Sam Rose
da1eb6f6ac
Fix primary key appearing twice in the SQL ORDER BY clause.
2024-06-24 17:09:27 +01:00
mike12345567
ebf8f54bb7
Upgrading to Typescript 5.5.2
2024-06-24 16:41:28 +01:00
Sam Rose
01b2f69b74
Merge branch 'master' of github.com:budibase/budibase into budi-8220-support-updating-existing-rows-for-external-databases-using-2
2024-06-24 15:51:03 +01:00
Sam Rose
2458259093
Respond to PR feedback.
2024-06-24 15:50:09 +01:00
mike12345567
b597bd3dbe
Fixing an issue detected by tests.
2024-06-24 13:30:18 +01:00
mike12345567
75cee3c4fd
Quick type improvement.
2024-06-24 13:28:13 +01:00
mike12345567
1402716f5c
Some type updates.
2024-06-24 13:10:30 +01:00
mike12345567
965725d022
First PR comments.
2024-06-24 12:43:26 +01:00
mike12345567
05ea231d20
Adding back missing comments.
2024-06-24 11:53:02 +01:00
mike12345567
fcf67f7297
Fixing an issue raised by Poirazis around empty relationships coming back as related to themselves.
2024-06-21 19:29:30 +01:00
mike12345567
337584f5b2
Updating the regex to correctly find within the filter keys.
2024-06-21 17:51:02 +01:00
mike12345567
28d0d627ce
Getting functions in place which make it easy to update pats of a filter list by their keys - getting this to work for SQS and external.
2024-06-21 17:00:12 +01:00
mike12345567
6812c21076
Updating test cases.
2024-06-21 16:58:40 +01:00
mike12345567
e5c40c7ecd
Moving some stuff around inside ExternalRequests to make it easier to access parts of the full context.
2024-06-21 16:58:27 +01:00
Sam Rose
d5481312d0
Fix lint, add new update test.
2024-06-21 15:31:34 +01:00
Sam Rose
c9fecbaa77
Fix updating rows in external tables where the primary key is an autocolumn.
2024-06-21 15:12:02 +01:00
Sam Rose
f4378bd561
Merge branch 'master' of github.com:budibase/budibase into budi-8220-support-updating-existing-rows-for-external-databases-using-2
2024-06-21 13:08:39 +01:00
mike12345567
b4910043c6
Addressing PR comments.
2024-06-21 11:27:47 +01:00
mike12345567
fead1f436a
test case is only for internal.
2024-06-20 18:53:01 +01:00
mike12345567
ae68c561f4
Test case.
2024-06-20 18:51:04 +01:00
mike12345567
def3b0260e
Disallowing prohibited columns consistently, no matter the case, and backend validation for this as well.
2024-06-20 18:48:22 +01:00
mike12345567
86bae92ada
Refactoring search test to make it easier to find promises which aren't handled.
2024-06-20 17:13:42 +01:00
mike12345567
df56371ab6
Reverting change to promises.
2024-06-20 16:36:18 +01:00
mike12345567
295961edb1
Attempting without promise.all in external.
2024-06-20 16:18:32 +01:00
mike12345567
66ef0cb79a
Adding back SQS - wasn't causing a problem.
2024-06-20 16:05:03 +01:00
mike12345567
b6b05e08b1
Removing SQS from view test to check.
2024-06-20 15:52:56 +01:00
mike12345567
3345364675
Updating test case - not exactly sure what it was testing before, but now it definitely confirms paginated results are stable.
2024-06-20 14:36:08 +01:00
Michael Drury
763c04048c
Merge branch 'master' into feature/count-rows-to-return
2024-06-20 11:26:00 +01:00
mike12345567
580e36f301
Updating test case.
2024-06-20 10:46:52 +01:00
Dean
d50a8e0746
Merge remote-tracking branch 'origin/master' into feature/automation-row-ux-update
2024-06-20 10:43:33 +01:00
mike12345567
86d9de5a2d
Fixing view test cases, adding SQS to it and correcting the default sort order.
2024-06-19 18:57:37 +01:00
dependabot[bot]
7ef46092d0
Bump socket.io from 4.6.1 to 4.6.2 in /packages/server
...
Bumps [socket.io](https://github.com/socketio/socket.io ) from 4.6.1 to 4.6.2.
- [Release notes](https://github.com/socketio/socket.io/releases )
- [Changelog](https://github.com/socketio/socket.io/blob/main/CHANGELOG.md )
- [Commits](https://github.com/socketio/socket.io/compare/4.6.1...4.6.2 )
---
updated-dependencies:
- dependency-name: socket.io
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-06-19 17:52:38 +00:00
mike12345567
67c00c9e4c
Addressing PR comments.
2024-06-19 18:46:48 +01:00
Sam Rose
602faf1c67
Add test for composite primary keys for external datasource imports.
2024-06-19 17:52:48 +01:00
mike12345567
58ec7a50b0
Implementing row counting for in-memory, also updating the in memory search function.
2024-06-19 17:51:11 +01:00
mike12345567
d121633d8e
Updating queries to be a bit more flexible to updates in the SQL layers.
2024-06-19 17:29:33 +01:00
mike12345567
a97b24658f
Fixing test case, it didn't provide a primary field.
2024-06-19 15:08:22 +01:00
mike12345567
aab100b130
Changing how counting is processed.
2024-06-19 14:28:22 +01:00
Michael Drury
223df424fc
Merge branch 'master' into feature/count-rows-to-return
2024-06-19 14:20:31 +01:00
mike12345567
bc80841554
Promise.all for both counts (SQS and SQL).
2024-06-19 13:39:00 +01:00
mike12345567
0e5de7f16d
Test updates.
2024-06-19 13:36:34 +01:00
mike12345567
abfab054d7
Addressing comment about datasource being optional.
2024-06-19 12:03:20 +01:00
mike12345567
c973562398
Merge branch 'feature/count-rows-to-return' of github.com:Budibase/budibase into feature/count-rows-to-return
2024-06-19 11:53:11 +01:00
mike12345567
0de94d3535
Addressing some PR comments.
2024-06-19 11:52:50 +01:00
Sam Rose
80642100fa
Merge branch 'master' into feature/count-rows-to-return
2024-06-19 09:05:56 +01:00
mike12345567
cf75a8a1f3
Updating function name.
2024-06-18 18:49:59 +01:00
mike12345567
e0d8a66fd8
Adding test cases for counting as well as some small fixes.
2024-06-18 18:44:17 +01:00
Sam Rose
e288fc8795
Disable upserting for MSSQL in bulkImport for now.
2024-06-18 18:02:20 +01:00
Sam Rose
5ac8a7d514
bulkImport upsert working everywhere excpet mssql
2024-06-18 17:43:25 +01:00
Sam Rose
335c174643
Create a failing test.
2024-06-18 16:39:35 +01:00
mike12345567
0caff1a404
Fixing an issue with sorting in SQS.
2024-06-18 13:53:51 +01:00
Peter Clement
2b96cbcad7
Expose old row binding in automations ( #13931 )
...
* expose old row through the emitter
* accidentally added oldRow to step
* fix row fetch in external datasources
* add test for new / old row comparison
* add testing for old row update event
* allow function overloading in test files
* update tests per comments
* handle event race condition
* update test data modal to account for old row output
* switch icon positioning
2024-06-18 13:45:58 +01:00
mike12345567
5c45370722
Fixing an issue with the sort order not being deterministic consistently.
2024-06-18 13:39:10 +01:00
mike12345567
bda83205ee
Making sure to measure whether we have paged forward in the query based on raw results.
2024-06-18 12:48:36 +01:00
mike12345567
73013332ae
Adding countRows to search validators.
2024-06-18 11:16:21 +01:00
mike12345567
75bf3c78e6
Merge branch 'master' of github.com:Budibase/budibase into feature/count-rows-to-return
2024-06-18 11:07:34 +01:00
Sam Rose
75e79156f7
Merge branch 'master' into budi-8238-rewrite-postgresspects-to-use-knex
2024-06-17 16:45:33 +01:00
Michael Drury
785b7e8136
Merge branch 'master' into uncomment-search-test-todos
2024-06-17 16:27:25 +01:00
Sam Rose
903c3cf84d
Fix flake in generic-sql.spec.ts.
2024-06-17 16:17:00 +01:00
Sam Rose
c107ab937d
Remove rawQuery entirely.
2024-06-17 16:15:51 +01:00
Sam Rose
16cacb3de7
Convert mysql.spec.ts away from rawQuery.
2024-06-17 15:48:58 +01:00
Sam Rose
42437d8e71
Merge branch 'master' of github.com:budibase/budibase into budi-8238-rewrite-postgresspects-to-use-knex
2024-06-17 14:39:55 +01:00
Sam Rose
84118f9e8c
Remove makeRequest from mysql.spec.ts
2024-06-17 14:39:45 +01:00
dependabot[bot]
c8c0dfb84d
Bump tar from 6.1.15 to 6.2.1 in /packages/server
...
Bumps [tar](https://github.com/isaacs/node-tar ) from 6.1.15 to 6.2.1.
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v6.1.15...v6.2.1 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 09:23:30 +00:00
mike12345567
c34c219e8f
Tidying up one of the weirder things knex can do.
2024-06-14 19:10:52 +01:00
mike12345567
654a417d66
Type checking.
2024-06-14 19:07:50 +01:00
mike12345567
cd1e7c0bad
Small re-jig make things easier to read.
2024-06-14 19:04:02 +01:00
mike12345567
f3ca1d0b1e
Adding countRows parameter to external API for counting.
2024-06-14 19:01:20 +01:00
mike12345567
1b36d8af51
Getting counting flow working correctly for external datasources.
2024-06-14 19:00:59 +01:00
mike12345567
908b77fd9b
Fixing some issues with using offsets.
2024-06-14 18:27:23 +01:00
mike12345567
e402f9c571
Merge branch 'uncomment-search-test-todos' of github.com:Budibase/budibase into feature/count-rows-to-return
2024-06-14 18:16:47 +01:00
mike12345567
77556820bf
Bit more work towards row counting, as well as moving external SQL to use row + 1 for working out pagination.
2024-06-14 18:12:36 +01:00
Sam Rose
c2320e4f5b
Convert postgres.spec.ts to use Knex instead of rawQuery.
2024-06-14 17:20:08 +01:00
Sam Rose
a54048e308
Solve all remaining TODOs in search.spec.ts.
2024-06-14 14:57:31 +01:00
mike12345567
7491021ca0
Base implementation of counting (plumbing).
2024-06-14 14:35:14 +01:00
Sam Rose
520f900708
Merge branch 'master' of github.com:budibase/budibase into budi-8349-in-memory-search-parity-testing
2024-06-14 13:59:06 +01:00
Sam Rose
f3c82cbf38
Ensure that sort order is always lowercased.
2024-06-14 11:00:34 +01:00
Sam Rose
c27e9c266c
Replace SortDirection with SortOrder, SortDirection is being removed.
2024-06-14 09:45:30 +01:00
mike12345567
82af6deab3
Making sure we return the correct thing when passing back the cached migration version.
2024-06-13 17:50:35 +01:00
mike12345567
3dcce65c9c
revert.
2024-06-13 17:50:07 +01:00
mike12345567
8970705b39
Adding a minimum time to the app migration screen and adding a link to documentation.
2024-06-13 17:49:41 +01:00
Sam Rose
1161c185e2
Down to 0 failures.
2024-06-13 17:46:03 +01:00
Dean
3a10c57651
Merge commit
2024-06-13 16:56:25 +01:00
Sam Rose
c01c2c7cc3
Down to 4 failures.
2024-06-13 16:23:16 +01:00
Sam Rose
746ee711ae
Down to 19 failures.
2024-06-13 14:45:43 +01:00
Sam Rose
f352c5efc1
Merge branch 'master' of github.com:budibase/budibase into budi-8349-in-memory-search-parity-testing
2024-06-13 12:24:40 +01:00
Sam Rose
cb6acd8c0b
Down to 71 failures.
2024-06-13 12:24:27 +01:00
Sam Rose
7e69f85e77
More progress.
2024-06-12 18:07:46 +01:00
Sam Rose
22bf0d05ad
Making progress.
2024-06-12 17:58:13 +01:00
Sam Rose
ae6539161f
Get rid of negation in predicate.
2024-06-12 17:28:03 +01:00
Michael Drury
c4e305e0a0
Merge branch 'master' into fix/app-migrations-automation-service
2024-06-12 15:33:52 +01:00
Sam Rose
7e4f571eb3
wip
2024-06-12 15:24:46 +01:00
Sam Rose
95f5844a44
Get in-memory searching into the search tests.
2024-06-12 15:24:46 +01:00
mike12345567
bf75d9da80
Fix lint.
2024-06-12 15:21:00 +01:00
Sam Rose
c759d7b63a
Remove more instances of the work lucene.
2024-06-12 15:13:50 +01:00
Sam Rose
781f3bd64a
Merge branch 'master' of github.com:budibase/budibase into budi-8338-refactor-in-memory-filter-naming
2024-06-12 15:06:22 +01:00
mike12345567
585bbefb90
Moving app migrations back to the automation service now that its getting updated in QA - also making sure that the app migration is always cached, disabling it in dev/QA may hide issues with caching, making sure it always runs the same as it does in prod is safest.
2024-06-12 15:04:18 +01:00
melohagan
f8765fb254
Don't add or remove quotas for external DB rows ( #13926 )
...
* Don't add or remove quotas for external DB rows
* update account-portal
* fix unit test
2024-06-12 13:49:37 +00:00
Sam Rose
bc8791e91e
Remove the word 'lucene' from runLuceneQuery and buildLuceneQuery.
2024-06-12 14:44:20 +01:00