Commit Graph

65 Commits

Author SHA1 Message Date
mike12345567 82e065b99c Updating so that datasources always have correct types after environment variable enrichment. 2023-02-10 12:47:23 +00:00
mike12345567 fa51f67fc3 Update to cover the authentication for REST, replacing it with secret value and converting to password field, as well as minor update to env dropdown to only be a password field when not containing an environment variable - #9480. 2023-01-30 18:50:35 +00:00
mike12345567 86f670fabe Adding test case for secret-value replacement, to confirm that datasources API correctly replaces secret values with the actual secret. 2023-01-27 18:27:03 +00:00
mike12345567 93a8b0583c Fixes for tests, allow any handlebars for datasources (dynamic vars). 2023-01-27 18:06:39 +00:00
mike12345567 7ca5c877a1 Updating datasources to use new onlyFound option. 2023-01-27 15:21:04 +00:00
mike12345567 dd67f106ed Adding a onlyFound option to our handlebars system so that we can enrich only the parts we have and leave other components for further enrichment. 2023-01-27 15:15:07 +00:00
mike12345567 f82e8f1f20 Don't check whether or not a datasource uses env vars when the function specifically includes the env vars, always fetch them so that they can be returned and put into context for queries to use. 2023-01-24 18:56:19 +00:00
Peter Clement 8cf63278d8 ensure object is passed to processObjectSync 2023-01-24 15:44:34 +00:00
mike12345567 e7e6e3419e Some minor updates after reviewing. 2023-01-19 19:10:41 +00:00
Mateus Badan de Pieri 6e5c126d5a adding validation for envvar bindings
adding validation for envvar bindings
2023-01-19 15:07:56 +00:00
mike12345567 f8a2c9e169 Updating datasource API to remove secrets when returning datasources. 2023-01-18 19:16:19 +00:00
mike12345567 4bc47c1563 Minor updates to the context system and also adding env vars to automation context. 2023-01-16 16:47:59 +00:00
mike12345567 186aeeec2d Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
mike12345567 2c87844e93 Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID. 2023-01-12 14:38:12 +00:00
mike12345567 a7bcfe387c Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567 894c128358 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-06 17:29:35 +00:00
mike12345567 aca98f7c6d Adding test cases for the attachment re-write feature, mocking the direct couch find functionality. 2023-01-06 13:33:22 +00:00
mike12345567 6595e1c122 Moving some stuff around to make more testable. 2023-01-06 12:47:12 +00:00
mike12345567 7084989896 Fix for #9249 - there was an issue with the updating of attachment URLs when importing an app/backup, this resolves it by utilising pagination in the CouchDB find API, making sure to iterate through all documents when there is a larger number. 2023-01-05 18:03:36 +00:00
Rory Powell 7ef9e9dc51
File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
mike12345567 6243186db5 Fixing repl options. 2022-12-07 18:22:02 +00:00
mike12345567 4b211b6587 Linting. 2022-12-07 14:43:27 +00:00
mike12345567 bffb41490b Fix for #7865 - if you deleted a cron automation immediately after creating/publishing it there was a scenario where prod automations would be out of sync with dev automations and it wouldn't really delete. To get around this, we do an automation sync back to dev DB - meaning that the cron ID is known and can be disabled. 2022-12-07 14:32:29 +00:00
mike12345567 bc77b924c0 Fixes based on test failures. 2022-12-06 12:47:48 +00:00
mike12345567 329a51d010 PR comments, moving more stuff into SDK. 2022-12-06 12:22:41 +00:00
mike12345567 95a515ec3d Fix for #8896 - the automation logs were already being sync'd to the dev database, but when unpublished they are in-accessible. Some minor updates to make sure that before unpublishing there is a sync, and then most of the changes are in pro. 2022-12-05 18:24:25 +00:00
mike12345567 51471449fc Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-22 12:03:31 +00:00
mike12345567 ee4ebbfb56 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
Dean 7fe99448f7 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 15:40:11 +00:00
mike12345567 5aa1f94cfe Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
Dean 4a94ef8bf9 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 11:10:29 +00:00
mike12345567 c4f041e511 Updating PouchLike to be an interface in types, with its impl stored in backend-core, now called Database. 2022-11-17 14:35:03 +00:00
Dean 00545ee884 Default Datasource and sample row data 2022-11-13 21:37:50 +00:00
Mel O'Hagan 531e30fa3d Null pointer fix 2022-11-10 15:22:05 +00:00
mike12345567 bbc8965d55 Major update - removing the use of context for PouchDB instances, swapping knowledge of PouchDB to the PouchLike structure that replaces it. 2022-11-09 16:53:42 +00:00
mike12345567 1c012ee7f7 Fixing an issue with some browsers sending the gzip type as x-gzip rather than gzip, which caused the processing to fail. 2022-10-27 19:14:31 +01:00
mike12345567 d32e4586c2 Refactoring a lot of content around webhooks to Typescript, as well as fixing webhooks and automation app IDs on import of new app. 2022-10-25 18:19:18 +01:00
Rory Powell 0b7ca49418 Fix build failure around PouchDB type 2022-10-25 09:02:55 +01:00
Rory Powell 27cde2c3cf Move backup processing into pro 2022-10-24 15:28:43 +01:00
mike12345567 147799ba0a Moving statistics under backups sdk subfolder. 2022-10-24 10:14:35 +01:00
mike12345567 6edffb0d5e Addressing majority of PR comments. 2022-10-24 10:04:14 +01:00
mike12345567 49e103e8ef Fixing test case. 2022-10-21 18:52:39 +01:00
mike12345567 ba2c387d9c Update with PR comments. 2022-10-21 18:25:35 +01:00
mike12345567 4716eaaab5 Getting the import system to carry out a backup of the app before the restore. 2022-10-20 19:07:10 +01:00
mike12345567 6112d097af Some type updates and processor handling for backup document being created before backup/restore occurs. 2022-10-19 19:19:36 +01:00
mike12345567 e5ebd97ecc Fixing issue with using templates. 2022-10-19 16:57:14 +01:00
mike12345567 0ca72f99d1 Adding statistics output for backups. 2022-10-19 16:48:32 +01:00
mike12345567 2eebd077e7 Fixing issue with metadata name not being provided for uploaded backup on publish. 2022-10-19 13:52:56 +01:00
mike12345567 a1065cc143 Protection for real app IDs. 2022-10-19 11:47:07 +01:00
mike12345567 0cf5bf26a0 Finishing import processor - download backup, delete dev DB and then import over the top of this. Also includes a rollback feature if the backup fails to restore for whatever reason. 2022-10-18 19:43:19 +01:00