Commit Graph

280 Commits

Author SHA1 Message Date
Adria Navarro bd221f2727 Prevent locks 2023-12-22 14:37:55 +01:00
Adria Navarro c5a50a911f Allow reusing app 2023-12-22 14:37:55 +01:00
Adria Navarro 3e991cc2f1 Use yargs 2023-12-22 14:37:55 +01:00
Adria Navarro 31c01e0a6b Display errors 2023-12-22 14:37:55 +01:00
Adria Navarro abf025b3f7 Use inflight max instead of batch wait 2023-12-22 14:37:54 +01:00
Adria Navarro 494a2ff91f Errors 2023-12-22 14:37:54 +01:00
Adria Navarro 92f1107e6c Prevent one single request to stop the process 2023-12-22 14:37:54 +01:00
Adria Navarro c518d8a7fa Add logs 2023-12-22 14:37:54 +01:00
Adria Navarro 3eee77c549 Create 500 students 2023-12-22 14:37:54 +01:00
Adria Navarro dbf4d6dbdd Create grades in batch 2023-12-22 14:37:54 +01:00
Adria Navarro c46509d6cb Use batches 2023-12-22 14:37:54 +01:00
Adria Navarro b034542536 Fix 2023-12-22 14:37:54 +01:00
Adria Navarro 69527cd4b9 Parallel creations 2023-12-22 14:37:54 +01:00
Adria Navarro 3824156ca5 Add delete all apps script 2023-12-22 14:37:54 +01:00
Adria Navarro 57a7be7a26 Run creation in parallel 2023-12-22 14:37:54 +01:00
Adria Navarro 5240b04a3a Remove 429 in dev 2023-12-22 14:37:54 +01:00
Adria Navarro 192d980e53 Log timings 2023-12-22 14:37:54 +01:00
Adria Navarro 6d6100eaf4 Add grades 2023-12-22 14:37:54 +01:00
Adria Navarro e4acd91237 Populate rows 2023-12-22 14:37:54 +01:00
Adria Navarro e986374c23 Check fetched table 2023-12-22 14:37:54 +01:00
Adria Navarro 1b6c7f2729 Add content to subjects 2023-12-22 14:37:54 +01:00
Adria Navarro 1b0c551602 Create create-many script 2023-12-22 14:37:54 +01:00
Adria Navarro 116b1ce909 Ensure .env is created properly 2023-12-13 13:14:13 +01:00
Adria Navarro 46e72a9ac3 Add missing dev settings 2023-11-07 19:43:43 +01:00
mike12345567 e12cef305a Fixing export. 2023-10-26 18:34:21 +01:00
Adria Navarro 56ae857d49 Add version to dev .env 2023-10-20 16:21:48 +02:00
mike12345567 d1b7ccd86f Updating docs and removing old documentation pathway. 2023-10-11 17:49:25 +01:00
Adria Navarro 28d5fe37de Fix postgres docker-compose integration to 15 2023-10-03 15:26:41 +02:00
Adria Navarro f600ad7711 Editing scripts 2023-09-26 18:08:37 +02:00
mike12345567 bd197bee9e Frontend work and basic API work for app update support. 2023-09-18 18:06:03 +01:00
mike12345567 aeac7aaa0c Making sure that not all falsy values are considered invalid filter inputs. 2023-09-12 13:54:39 +01:00
mike12345567 7110351bdc Revert "revert develop into master"
This reverts commit fd099658a0.
2023-08-18 14:33:21 +01:00
Martin McKeaveney fd099658a0 revert develop into master 2023-08-17 10:28:15 +01:00
Adria Navarro 516e2ff09a Merge branch 'develop' into BUDI-6785-update-to-node-18 2023-08-07 12:32:20 +01:00
Adria Navarro 14e0396857 Merge branch 'develop' into chore/fix_build_issues 2023-08-02 13:35:03 +01:00
Adria Navarro fcba916f0c Add bail in jest 2023-08-02 11:25:52 +02:00
mike12345567 8c2d0f594c Quick fix for utilising a hyphen in a Postgres schema - this needed to be escaped correctly. 2023-08-01 18:18:53 +01:00
Adria Navarro d5533c00d6 Fix workerIdleMemoryLimit usage 2023-07-28 18:03:03 +02:00
Adria Navarro 51a1d1c183 Add force exists 2023-07-28 18:03:03 +02:00
Adria Navarro 712732f795 Run in band? 2023-07-28 18:03:03 +02:00
Adria Navarro 2e1903f955 Log 2023-07-28 18:03:03 +02:00
Adria Navarro f82c10782f Log heap usage 2023-07-28 18:03:03 +02:00
Adria Navarro 0f75660808 Attempt different commands 2023-07-28 18:03:03 +02:00
mike12345567 f2abcf581f Fixing issue with falsey composite keys, if one of the values used for a composite key is say an empty string, or a zero it would not be added to the _id field, stopping the field from being retrievable. 2023-07-26 12:31:46 +01:00
mike12345567 5039e63bfb PR comments. 2023-05-23 16:07:45 +01:00
Adria Navarro 1be822398f Undo run in band 2023-05-23 12:46:24 +02:00
Adria Navarro 9f9c2d66e0 Remove runinband for actions 2023-05-22 17:02:44 +02:00
mike12345567 4f7e56fed9 Making build script into a module, so that it can be used in a specialised server build which also builds the thread scripts as required for worker-farm. 2023-04-27 19:00:01 +01:00
mike12345567 c552913737 Fixing defaults in MS-SQL as well. 2023-04-14 18:10:10 +01:00
mike12345567 09ccac12ae Fix for default values with NOT NULL requirements being intepreted as requiring values in the frontend, presence check is now ignored if a default or auto value is found. 2023-04-14 17:56:17 +01:00
Rory Powell 77ffb8d86d Run integration suite in CI again / auto detect tenancy / refactors (#10209)
* qa-core-ci-fixes

* global setup and teardown wip

* Updates to logs and setup

* Remove date and console mocking

* Update CI to spin up minimal dev env

* Update readme

* Fix scopeBackend.sh

* Ensure docker services are initialised before starting worker

* Lint

* Fix admin user being created on startup (#10219)

* use regular bootstrap and build

* Lint

* Temp: re-use global setup to get around app limit in QA
2023-04-05 15:33:56 +01:00
Rory Powell 976b3a55ca Update logging to support dd trace attributes (#10086)
* Update logging middleware to integrate with pino for console logging

* Remove elastic apm references, use updated core middlewares

* Remove redundant LOG_LEVEL definitions

* Remove no longer needed jest logging overrides

* lint

* Backwards compat between console log helpers and pino

* Configurable DISABLE_HTTP_LOGGING

* Don't log 4xx as errors

* Remove redundant ENABLE_4XX_HTTP_LOGGING

* Cleanup migrations and event logging

* Improve bb-alert logging

* Add DISABLE_HTTP_LOGGING to helm chart

* Add ops endpoints for testing

* Disable http logging in dev

* Backwards compatible tracing implementation

* Naming update on http logging env var

* lint

* Update packages/backend-core/src/environment.ts

Co-authored-by: Adria Navarro <adria@revityapp.com>

* Merge

* Lint

* Fix console.warn failing mock by replacing with alerts mock instead

* Lint

---------

Co-authored-by: Adria Navarro <adria@revityapp.com>
2023-04-04 15:08:46 +01:00
Rory Powell 79bec7d86d Add force exit, -e flag and streaming to tests (#10151)
* Add force exit, -e flag and streaming to tests

* Temp remove script usage from worker tests

* Revert "Temp remove script usage from worker tests"

This reverts commit 5e0ed2e92d.

* Always fail test

* Ignore server test package from coverage report

* Unscope server only

* Run all server tests again

* Update backend core test script to fail when any command fails and force exit

* Don't try to require client in test

* Port memory limit fix from develop

* Remove always failing test and commented out block for client require

* Fixing some issues with test cases.

* Revert assertions in internalSearch.spec.js

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-31 10:32:13 +01:00
Rory Powell 9d6d781244 Use `--runInBand` in CI only (#9771)
* Use  in CI only

* Use scripts instead of ternary to pick up correct bash syntax
2023-02-22 13:04:16 +00:00
mike12345567 3f7f66257d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-14 17:57:23 +00:00
mike12345567 488b542ac1 Fix for #9654 - the error checking was looking at the through fields flipped, which caused many to many relationships to throw an error. Also I've updated the dev compose file on master so that switching between develop and master is smoother. 2023-02-14 14:38:55 +00:00
mike12345567 3b43943f1f Some quick scripts for loading a lot of rows and apps. 2023-02-03 19:29:28 +00:00
Rory Powell 905de31cd6 Merge pull request #9525 from Budibase/chore/default-local-dev-accounts-disabled
Set DISABLE_ACCOUNT_PORTAL=1 by default in local dev
2023-02-03 09:54:21 +00:00
Rory Powell f28b1dc79a Set DISABLE_ACCOUNT_PORTAL=1 by default in local dev 2023-02-02 16:38:23 +00:00
Dean 0eed617866 Updated default feature flags to include onboarding by default. Added tenant overrides to allow exclusion from global features 2023-02-01 14:12:43 +00:00
mike12345567 95e8371b1d Adding encryption key to manage of server. 2023-01-16 18:51:48 +00:00
Martin McKeaveney 1dcd3445ce adding host.docker.internal mapping to PROXY_ADDRESS 2022-12-21 10:58:39 +00:00
Rory Powell b635614f77 Allow proxy upstream URLs to be configured at runtime (#7413)
* allow proxy upstream urls to be configured at runtime

* make dynamic upstream urls in proxy the default behaviour

* reorder env directives

* Use appVersion for proxy image

* Update couch upstream for proxy

* proxy ci updates - WIP

* allowing custom resolvers in proxy service deployment

* remove generateProxyConf script for prod and remove from builds

* remove generateProxyConfig script

* removing nginx dev conf

* delete generated nginx conf

Co-authored-by: Thomas Weiß <panos@unbunt.org>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
2022-12-20 16:28:13 +00:00
mike12345567 2a51091ffb Adding some null controls. 2022-12-02 16:17:56 +00:00
mike12345567 32488bee88 Adding broken SQL configuration. 2022-12-02 10:50:52 +00:00
mike12345567 02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
Rory Powell 1612044dc1 Merge branch 'develop' into subdomain-tenancy 2022-11-15 16:18:59 +00:00
Rory Powell 9973f2e161 Bump jest and ts-jest to be consistent across backend packages to fix CI issue, test config updates 2022-11-14 22:55:47 +00:00
Rory Powell 5da699e27c Fail pro scripts on error, unify TS versions, update test and coverage configs, use pro source mappings 2022-11-14 13:29:46 +00:00
Rory Powell 6783fd713e Update tenancy detection to honour any subdomain pattern according to platform url 2022-11-09 16:35:16 +00:00
Rory Powell 5d973de503 Add TENANT_FEATURE_FLAGS to default dev environment 2022-09-23 13:48:19 +01:00
Andrew Kingston 5bcb4c5393 Move restart of proxy container to after the compose stack has been brought up to ensure container exists 2022-09-16 09:25:14 +01:00
Andrew Kingston 206714869d Always restart the proxy service when spinning up the dev stack to account for nginx conf changes 2022-09-15 16:31:29 +01:00
Rory Powell a551532e73 Navigation updates, cookie constant, update link-dependencies and localdomain scripts 2022-09-14 10:53:14 +01:00
Andrew Kingston 6093da79d6 Add hot reloading for component plugins via watched plugin directory 2022-08-15 22:23:45 +01:00
Andrew Kingston 467cc27f47 Add env vars to automatically create initial admin user on first run 2022-06-30 11:28:52 +01:00
mike12345567 e32de3b850 Updating install script to work from any directory. 2022-06-21 20:01:50 +01:00
mike12345567 9ad9860a9c Fixing cleanup script, adding ARM support to dockerfile, as well as adding ARM client. 2022-06-21 17:56:55 +01:00
Rory Powell 12aa9fa1ce Dev improvements - remove need to rebuilds of backend-core/dist and enable debugging when running tests and backend services, use source directly using typescript and jest path mappings 2022-06-10 22:57:12 +01:00
Rory Powell 0cf777a0cd Build fixes 2022-06-09 12:33:10 +01:00
Rory Powell a4eef3daab Add awareness of deployment environment 2022-06-01 14:10:00 +01:00
Rory Powell a9ab8b2629 Lots of failure handling and caching 2022-05-30 21:46:08 +01:00
Rory Powell 28b48a88fe Event identification 2022-05-23 22:14:44 +01:00
Rory Powell 70fff5c7b9 Merge branch 'develop' into feature/posthog-v2 2022-05-23 09:04:00 +01:00
mike12345567 c528896e2d Finishing off UI, expanding settings menus from 80ch to 90ch as they were quite restricted and made the usage UI a bit difficult to view. Added a DISABLE_DEVELOPER_LICENSE env variable for testing. 2022-05-17 17:44:40 +01:00
Rory Powell 1caf4b1965 Merge branch 'develop' into feature/posthog-v2 2022-04-27 16:32:00 +01:00
Martin McKeaveney 9ca4dacbaa merge with master 2022-04-26 10:21:45 +01:00
Michael Drury 94419024a4 Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 9899781fc5 Some updates, making sure databases will always close directly using finally checks around the actual tasks, updating how replication works to have a close statement (to make sure it is controlled correctly) and then updating to PouchDB 7.3.0 for one of the memory leak fixes. 2022-04-20 17:33:42 +01:00
mike12345567 192fb1307e Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
Rory Powell 41144db055 Remove remaining direct usage of CouchDB. Add common pouch config to backend-core 2022-04-19 16:45:27 +01:00
mike12345567 5180603374 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
Rory Powell 33719fcb09 Merge branch 'feature/licensing' into feature/posthog-v2 2022-04-12 17:12:46 +01:00
Rory Powell 03ba6d914f Merge branch 'develop' into feature/licensing 2022-04-12 16:18:41 +01:00
Rory Powell 5ab9f1a9c5 Table CRUD events + add timekeeper for tests 2022-04-11 14:39:31 +01:00
mike12345567 39182cfbc0 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Rory Powell 15b676ce1c Remove remaining direct usage of CouchDB. Add common pouch config to backend-core 2022-03-29 16:03:44 +01:00
Rory Powell 75d5c0c0b9 Merge branch 'feature/licensing' into feature/posthog-v2 2022-03-28 09:47:34 +01:00
Rory Powell 69b2b38aea Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 14c75b2907 update always to unless-stopped 2022-03-24 17:35:35 +00:00