Commit Graph

5075 Commits

Author SHA1 Message Date
Martin McKeaveney 29ab9bef7d fix lint 2024-10-22 18:31:07 +01:00
Martin McKeaveney 807ecf6039 BB AI QA testing fixes 2024-10-22 18:24:10 +01:00
Adria Navarro e7d4f90f1b Cleanup sqs flags from tests 2024-10-21 15:31:33 +02:00
Adria Navarro 9e501b4e65 Cleanup SQS feature usages 2024-10-21 15:19:55 +02:00
mike12345567 87bdd68afa Updating to use enum for feature flags across the board. 2024-10-18 17:07:35 +01:00
Adria Navarro 4c688b9734 Add more tests 2024-10-17 16:40:26 +02:00
Adria Navarro 7bb69d7ffd Add tests 2024-10-17 12:17:01 +02:00
Sam Rose 26f2deb234
Set proxy setting on Koa application. 2024-10-09 13:34:43 +01:00
Sam Rose eee2991b09
Rejib IP fetching. 2024-10-09 12:57:14 +01:00
Adria Navarro bf62153b8b Add test with conditions 2024-10-09 10:16:32 +02:00
Sam Rose 11804f6ddd
Create a feature flag helper for tests. 2024-10-07 18:18:04 +01:00
andz-bb 696b2c38db persist app sort method selection by saving it against the user 2024-10-04 10:54:14 +01:00
Sam Rose c0cc2a9e3d
Move isSupportedUserSearch from backend-core to shared-core. 2024-09-30 15:16:24 +01:00
Martin McKeaveney b45017dd5a lint 2024-09-19 17:06:09 +01:00
Martin McKeaveney 6a5f001977 remove tests that are no longer relevant in worker 2024-09-19 10:54:25 +01:00
Martin McKeaveney e0fb44f63f lint 2024-09-19 10:21:49 +01:00
Martin McKeaveney 8a399bfbdf set custom configs quotas to right number 2024-09-18 17:42:55 +01:00
Martin McKeaveney 8e2d21c85f call right sdk method on ai module for enriching AI config 2024-09-17 18:27:49 +01:00
Martin McKeaveney e40f397c25 move check for OpenAI config variable to legacy path 2024-09-17 16:29:44 +01:00
Martin McKeaveney 224be10b6c support for overriding models 2024-09-17 16:08:59 +01:00
Andrew Kingston 663c0f20af
Don't use display names as role names, and restore usual names for built in roles 2024-09-13 14:14:36 +01:00
mike12345567 b644dd47b9 build fix. 2024-09-12 16:27:18 +01:00
melohagan 49a4e252c6
Allow an account holder to login to account-portal if the tenant has been deleted. (#14547)
* Add email to session for populate user

* Add email param

* use param object

* Type fix for tests

* Fix test

* Temporarily remove account-portal tests
2024-09-12 08:38:11 +00:00
Martin McKeaveney a27be54b69 make mocks async 2024-09-10 22:38:45 +01:00
Martin McKeaveney 38fc65c541 fix tests 2024-09-10 22:25:47 +01:00
Martin McKeaveney 304b2a5c61
Update packages/worker/src/api/controllers/global/configs.ts
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-09-10 16:45:32 +01:00
Martin McKeaveney c6907eb09e fix types 2024-09-10 16:41:44 +01:00
Martin McKeaveney 1ee8a12e29 use real data instead of mocks 2024-09-10 16:01:00 +01:00
Martin McKeaveney 933ca952d2 lint 2024-09-10 14:50:17 +01:00
Martin McKeaveney 0cf626be91 Merge 2024-09-10 11:00:33 +01:00
Martin McKeaveney 08669793d7 Merge branch 'budi-8608-ai-platform-level-config' of github.com:Budibase/budibase into budi-8608-ai-platform-level-config 2024-09-10 10:55:25 +01:00
Martin McKeaveney 4fed5787ac review comments 2024-09-10 10:54:50 +01:00
Martin McKeaveney 7a376d9629
Update packages/worker/src/api/controllers/global/configs.ts
Co-authored-by: Sam Rose <hello@samwho.dev>
2024-09-10 10:26:18 +01:00
Martin McKeaveney 96fbc8fff0 feature flag support 2024-09-09 18:07:47 +01:00
Martin McKeaveney b4a4f81308 linting 2024-09-09 16:52:56 +01:00
Martin McKeaveney 57698170a8 lint 2024-09-09 13:55:26 +01:00
Martin McKeaveney 073017a0d6 remove todo comment 2024-09-06 15:43:34 +01:00
Martin McKeaveney 6bf4f47110 further tests around default BB AI config 2024-09-06 15:42:37 +01:00
Martin McKeaveney 891f736815 unit tests for secrets mapping 2024-09-06 15:37:09 +01:00
Martin McKeaveney d3b90a0253 initial impl of default Budibase AI config through env vars 2024-09-03 19:47:36 +01:00
Martin McKeaveney 0d5e776424 preserve apikeys on save 2024-09-03 19:12:13 +01:00
Martin McKeaveney 43135e4274 AI Config CRUD complete 2024-09-03 17:18:46 +01:00
Martin McKeaveney ca4b17bc9b icons, styling of AI configs and further simplification 2024-09-03 15:11:52 +01:00
Peter Clement 66fdf03398
Refactor automation orchestrator to support branching (#14461)
* refactor automation thread

* fix infinite loop in branching

* remove try catch

* remove spacing

* remove unecessary addition of branch outputs

* pr comments

* remove loopstep instance variable

* add test to cover failure scenario

* add tests for other automationf ailure conditions

* update test name

* use private keyword instead of underscore

* parse int / string safely

* fix refs

* add condition support for branching and tests

* create helper function for recursing all search filters

* move helper func

* fix import
2024-09-03 08:33:41 +00:00
Martin McKeaveney f328ae4bf9 account for arrays 2024-09-02 20:45:32 +01:00
Martin McKeaveney 99035ad8ae rough pass on AI platform CRUD 2024-09-02 20:16:58 +01:00
Michael Drury 9b84d959dc
Merge branch 'master' into fix/sqs-default-dev-on 2024-08-30 18:07:51 +01:00
mike12345567 6249f41bbb Make sure Lucene correctly sets environment variables in development tests. 2024-08-30 17:34:10 +01:00
melohagan 3f357561d0
The UI should indicate who the account holder is (#14470)
* Get tenantInfo in user fetch

* Add account holder label in users table

* Don't allow account holder to be selected in users table

* Sort account holder to top of list

* Only use account holder role in users table

* lint

* Remove joi validation from tenant-info endpoint

* Remove dayPasses

* Catch CouchDB 404 and return undefined

* Don't allow account holder role to be changed UI

* Don't offer delete option for tenant owner

* Backend validation to ensure account holder role cannot be updated

* Don't allow account holder role to be changed UI

* Get tenantOwner in separate call

* Pass data into SelectEditRenderer

* Rename var to __selectable

* setEnrichedUsers

* Update pro reference

* Only load tenantOwner once
2024-08-30 16:29:38 +00:00
mike12345567 b622df2683 Defaulting SQS to on in development environments, this removes the need for setting it in the management scripts. 2024-08-30 15:10:55 +01:00
Sam Rose 43560b3269
Fix environment test. 2024-08-27 14:40:15 +01:00
Sam Rose 71000ea967
Fix lint. 2024-08-15 16:11:06 +01:00
Sam Rose 06a7801d8c
Remove global audit logs SQS flag. 2024-08-15 15:37:51 +01:00
Sam Rose 86717b536b
Use new feature flag API for SQS. 2024-08-15 14:58:11 +01:00
Sam Rose 4a1fd6481f
Remove old, unused feature flags. 2024-08-15 10:53:43 +01:00
melohagan 151fff51c5
Make generated passwords longer (#14362)
* Make generated passwords longer

* Use crypto for generating passwords

* Remove comments

* Generate password with length 12
2024-08-12 20:37:59 +00:00
Sam Rose 1b556f29fe
Rebase on posthog-feature-flags 2024-08-09 14:00:16 +01:00
Sam Rose 4887ca261e
Improve testing of feature flags by not polluting production flags with test ones. 2024-08-09 11:27:43 +01:00
Sam Rose 079dcdcc6e
Merge branch 'master' into posthog-feature-flags 2024-08-08 17:59:57 +01:00
melohagan c86b1d7ca5
Auto login the user after password is set (#14344)
* login after creating super admin user

* Allow keyboard enter key in create account from invite

* Allow enter key to submit password reset

* Min length for password validation should be 12

* Default PASSWORD_MIN_LENGTH to 12

* fix unit tests

* Fix unit tests

* Add passwordMinLength to admin store
2024-08-08 17:45:04 +01:00
Sam Rose d7e07bb44a
Fix worker tests. 2024-08-07 17:33:47 +01:00
Sam Rose edb3b685b5
Remove node-fetch mock from backend-core and replace with nock. 2024-08-07 15:26:04 +01:00
Sam Rose da74441c1c
Merge branch 'master' of github.com:budibase/budibase into budi-8483-consolidate-feature-flags-into-a-single-endpoint 2024-08-05 17:11:23 +01:00
melohagan f07ebc18db
Make sure to delete SSO ID doc as well (#14307) 2024-08-05 12:54:36 +01:00
melohagan 60f7c03e17
Fix/verify sso bug (#14253)
* Delete associated SSO user

* Update reset password screen

* Partial type removed

* lint

* Split getFirstPlatformUser from getPlatformUsers

* lint

* Use correct method

* Code review comments

* lint
2024-07-29 13:25:46 +01:00
Sam Rose f3c73fe4a8
Support primitives in feature flags, make flag types flow, remove some obsolete feature flag systems. 2024-07-22 17:43:53 +01:00
mike12345567 73881e9895 Only default the CouchDB SQL URL if we are in dev, otherwise attempt to work out what it is based on the main CouchDB URL (as this should work in all default production environments). 2024-07-11 11:11:28 +01:00
Sam Rose 69d54b523d
Finish implementation, fix tests. 2024-07-08 14:21:07 +01:00
Adria Navarro 8da83dac58 Merge branch 'master' into chore/fix-npm-vulnerabilities 2024-07-04 11:08:51 +02:00
Adria Navarro 3a0af98b32 Update @techpass/passport-openidconnect 2024-07-04 10:58:00 +02:00
Adria Navarro 418e4adb04 Remove undici 2024-07-04 10:52:47 +02:00
Adria Navarro 427ccbbb65 Test 2024-07-03 16:58:56 +02:00
Adria Navarro 3ba3b18c2d Add scim test 2024-07-03 16:57:22 +02:00
Sam Rose 9dacc5ea38
Make the SQS environment check work off the SQS_SEARCH_ENABLE env var. 2024-07-02 14:45:19 +01:00
mike12345567 ebf8f54bb7 Upgrading to Typescript 5.5.2 2024-06-24 16:41:28 +01:00
melohagan 9ecf82e0f6
Add endpoint to GET tenant info from tenant global DB. (#13923)
* Add GET tenant info endpoint

* Add GET global tenant to endpoint list.

* Use correct not found code

* Fix unit test

* Code review comments

* Ignore account portal check types

* remove account-portal-ui from type check ignore

* Remove ignore account-portal-ui from type check
2024-06-17 09:22:44 +00:00
melohagan 34855e0b3e
Remove deprecated unused endpoints (#13924)
* Remove deprecated unused endpoints

* lint
2024-06-12 12:38:14 +00:00
Sam Rose a140a002e2
Merge branch 'master' of github.com:budibase/budibase into fix/aws-session-token-s3-ver2 2024-06-11 18:04:40 +01:00
Michael Drury 869c7e546a
Merge branch 'master' into disable-app-migration-cache 2024-06-11 13:17:16 +01:00
melohagan 115737c46c
Create Tenant endpoint + tenant_info doc (#13902)
* Create Tenant endpoint + tenant_info doc

* Don't catch on tenant_info put

* PR comments

* unit test
2024-06-11 12:16:15 +01:00
mike12345567 334334bbcd Adding a check for QA. 2024-06-11 12:13:18 +01:00
Michael Drury cede6a8a0b
Merge branch 'master' into fix/aws-session-token-s3-ver2 2024-06-10 21:56:50 +01:00
mike12345567 d4d3537f41 Updating test. 2024-06-10 19:02:30 +01:00
mike12345567 3a95aa6aeb Adding the version to the status to help understand what version the service is using. 2024-06-10 18:56:24 +01:00
Hector Valcarcel 65c2039d0c Chore: Allow using an AWS_SESSION_TOKEN for object storage with AWS S3 2024-06-10 11:48:54 +01:00
mike12345567 243ccee645 Enables SQS in dev! 2024-06-06 16:10:58 +01:00
melohagan cbb3c9aa93
Allow a user invite to be revoked (#13805)
* Add free_trial to deploy camunda script

* Allow user invites to be deleted

* Refactor to pass invite codes

* lint

* update account-portal

* yarn lock

* users terminology instead of rows and invites
2024-05-31 14:34:08 +00:00
melohagan b4645d8494
If a user starts the onboarding process, make sure they can still accept an invite (#13794)
* Add free_trial to deploy camunda script

* Getting invite details should not require tenancy

* make sure onboarding cookie is complete

* Make sure password is atleast 8 characters

* yarn lock

* update pro and account-portal

* update account-portal
2024-05-29 16:40:53 +01:00
mike12345567 77d049722f Updating pro and updating test cases to try both lucene and SQS. 2024-05-22 17:37:56 +01:00
mike12345567 ffcd9e498d Some work to allow toggling between lucene search and SQL search for audit logs. 2024-05-21 18:13:54 +01:00
mike12345567 540cd2f2f5 Setting knex as dependency for worker (audit logs). 2024-05-21 13:15:27 +01:00
mike12345567 906e7686d6 Removing messaging check - not important. 2024-05-15 12:14:21 +01:00
mike12345567 19e2c0220a Fixing test cases which were asserting on 404 messaging. 2024-05-15 12:07:39 +01:00
Peter Clement db273bcd36
Support attachment columns in Automations (#13567)
* base work to support attachments in create / update row

* handle single attachment column

* fix tests

* pro

* fix some types

* handle case where file exists in storage

* improve attacment processing

* refactor slightly and ensure correct url is used for existing attachments

* add test

* Fixing a build issue.

* update tests

* some lint

* remove cursed backend-core test util

* addressing pr comments

* refactoring nasty automationUtils upload code

* remove uneeded check

* use basneeame for fallback filename

* add a test to ensure coverage of single attachment column type

* fail early when fetching object metadata

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2024-05-09 14:30:56 +01:00
Sam Rose 033c642c12
Remove unnecessary jest.unmock calls. 2024-05-09 10:15:05 +01:00
Peter Clement 1d300c2577
Remove aws sdk global mock and update tests (#13637)
* Remove aws sdk global mock and update tests

* add awaits

* Minio healthcheck in tests.

* Bind to 127.0.0.1 instead of 0.0.0.0

* Fix port fetching for minio container.

* Actually fix port mapping this time.

* Pull minio container before running tests.

* Enable testcontainers debug logging.

* Promote minio container to always running in tests, like CouchDB.

* Remove testcontainers debug logging.

---------

Co-authored-by: Sam Rose <hello@samwho.dev>
2024-05-08 14:08:34 +01:00
melohagan cfc2ea9117
Add free trial modal (#13609)
* Add free_trial to deploy camunda script

* WIP FreeTrial modal

* Handle free trial modal via self endpoint

* Set correct plan title for trial

* Remove catch

* lint

* Refactor

* Remove unnecessary code

* Rename to EnterpriseBasicTrialModal
2024-05-07 12:44:57 +01:00
Peter Clement a4c0328c53
REST file handling and SMTP automation block attachments (#13403)
* handle files in rest connector

* fetch presigned url and return

* further updates to handle files in rest connector

* remove unused important and fix extension bug

* wrong expiry param

* tests

* add const for temp bucket

* handle ttl on bucket

* more bucket ttl work

* split out fileresponse and xmlresponse into utils

* lint

* remove log

* fix tests

* some pr comments

* update function naming and lint

* adding back needed response for frontend

* use fsp

* handle different content-disposition and potential path traversal

* add test container for s3 / minio

* add test case for filename* and ascii filenames

* move tests into separate describe

* remove log

* up timeout

* switch to minio image instead of localstack

* use minio image instead of s3 for testing

* stream file upload instead

* use streamUpload and update signatures

* update bucketcreate return

* throw real error

* tidy up

* pro

* pro ref fix?

* pro fix

* pro fix?

* move minio test provider to backend-core

* update email builder to allow attachments

* testing for sending files via smtp

* use backend-core minio test container in server

* handle different types of url

* fix minio test provider

* test with container host

* lint

* try different hostname?

* Revert "try different hostname?"

This reverts commit cfefdb8ded.

* fix issue with fetching of signed url with test minio

* update autoamtion attachments to take filename and url

* fix tests

* pro ref

* fix parsing of url object

* pr comments and linting

* pro ref

* fix pro again

* fix pro

* account-portal

* fix null issue

* fix ref

* ref

* When sending a file attachment in email fetch it directly from our object store

* add more checks to ensure we're working with a signed url

* update test to account for direct object store read

* formatting

* fix time issues within test

* update bucket and path extraction to regex

* use const in regex

* pro

* Updating TTL handling in upload functions (#13539)

* Updating TTL handling in upload functions

* describe ttl type

* account for ttl creation in existing buckets and update types

* fix tests

* pro

* pro
2024-04-22 15:30:57 +00:00
mike12345567 8bb6956925 Merge branch 'master' of github.com:Budibase/budibase into fix-oidc-error-logging 2024-04-19 13:29:21 +01:00
melohagan 6bdc726d55
Allow a displayName to be passed when creating admin user (#13516)
* Allow a displayName to be passed when creating admin user

* Set the first and last names

* Don't format handlebars files on save

* Use familyName and givenName
2024-04-18 12:52:00 +00:00