Commit Graph

280 Commits

Author SHA1 Message Date
mike12345567 fe66c3535c Fixing a collection of issues, specifically users being exported/imported and issues with database import causing weirdness (metadata doc being wrong). 2021-06-08 18:06:16 +01:00
mike12345567 b05c67e8b5 Formatting. 2021-06-08 16:11:46 +01:00
mike12345567 33184be064 Re-writing how global users are handled in server, specifically how they are retrieved, so that for relationships it can handle the global user. 2021-06-08 16:06:30 +01:00
mike12345567 4fdbeafca5 Adding test case for data source opinionated query endpoint. 2021-06-04 15:16:15 +01:00
Martin McKeaveney dd69d5480b Joi schema validation for plus datasources 2021-06-04 10:50:02 +01:00
Andrew Kingston b904bba4c7 Merge branch 'master' of github.com:Budibase/budibase into enhanced-app-list 2021-05-21 11:11:43 +01:00
Michael Drury f76c7d9684 Merge pull request #1514 from Budibase/fix/per-app-login
Removing per app login screens
2021-05-21 11:11:21 +01:00
Andrew Kingston c174602704 Merge branch 'master' of github.com:Budibase/budibase into enhanced-app-list 2021-05-21 11:00:26 +01:00
Andrew Kingston f63f9a7c51 Update app list screen to show unified app list with publish status 2021-05-21 10:32:16 +01:00
Martin McKeaveney e83f600b9e removing skip_setup as it was preventing init 2021-05-20 21:42:27 +01:00
mike12345567 4d6e4475d3 Fixing some issues found when testing. 2021-05-20 20:48:24 +01:00
Martin McKeaveney 7ab24fed2b merge with master 2021-05-20 10:40:15 +01:00
mike12345567 0bbd45b413 Adding the ability to get all apps, with the status attached. 2021-05-19 15:09:57 +01:00
Martin McKeaveney d9ed0686ab Merge pull request #1496 from Budibase/feature/draft-apps
Feature/draft apps
2021-05-18 11:25:51 +01:00
Martin McKeaveney fc7ddbe540 merge 2021-05-16 21:29:07 +01:00
Martin McKeaveney 0f2bcf581d revert functionality working 2021-05-16 21:25:37 +01:00
mike12345567 cea82f9335 A general re-work of some parts of the auth lib, as well as moving roles/permissions around to make it possible to build an admin API which has role knowledge. 2021-05-14 15:43:41 +01:00
Andrew Kingston b402254b2c Lint 2021-05-14 15:41:58 +01:00
Martin McKeaveney 48006408f1 publish button 2021-05-13 17:33:31 +01:00
mike12345567 81c5ed5554 Altering object store so that all writes/reads to the object store have the dev app prefix replaced with standard app. 2021-05-13 13:29:53 +01:00
Martin McKeaveney c3e7548255 dev mode E2E 2021-05-13 11:06:08 +01:00
mike12345567 2021c59dd9 Putting together redis lock system. 2021-05-12 17:37:09 +01:00
mike12345567 2ec6b15e56 General cleanup, doing away with the concept of hosting in the builder and the generally confusing difference between cloud, self hosting and running locally - server is simply always a server now. 2021-05-11 17:49:26 +01:00
Andrew Kingston e661fe8cf2 Merge branch 'next' of github.com:Budibase/budibase into lab-day-search 2021-05-11 10:47:52 +01:00
mike12345567 e5f3b3956c Merge branch 'next' of github.com:Budibase/budibase into labday/mike-formulas 2021-05-04 13:24:14 +01:00
Andrew Kingston 797e8a8b67 Add explicit prettier options 2021-05-04 11:32:22 +01:00
mike12345567 dcf69b2181 Merge branch 'next' of github.com:Budibase/budibase into labday/mike-formulas 2021-05-04 10:34:30 +01:00
Keviin Åberg Kultalahti 0afbf1649e lint:fix 2021-05-03 09:31:09 +02:00
Andrew Kingston 6f6770cef7 Add server-side searching and pagination to data providers using internal tables 2021-04-30 16:29:53 +01:00
mike12345567 a14c80bf6c Adding handlebars formulas to the system, it is now possible to set a formula at a column level which will always be applied on the way out with a relationship depth of one. 2021-04-29 19:06:58 +01:00
mike12345567 e85b7682e0 Initial CRUD interface for templates. 2021-04-21 18:15:57 +01:00
mike12345567 2ef1586d4d Adding cleanup operation to dynamo client. 2021-04-19 22:36:14 +01:00
mike12345567 eaa89c824e Updating the server to remove use of the email in the user ID. 2021-04-19 16:26:33 +01:00
mike12345567 4f71e11c94 Updating some test cases to work with new system. 2021-04-09 17:33:21 +01:00
mike12345567 3214abb89a Global users now working through the server, all requests proxied. 2021-04-09 15:11:49 +01:00
mike12345567 8cde219db9 First pass of global user configuration through existing user API with role mappings. 2021-04-08 16:58:33 +01:00
mike12345567 97f8d34947 Some final changes to search system so that the new indexing system is used instead of mango to achieve exactly the same result. 2021-03-26 13:46:20 +00:00
mike12345567 b97071bf82 Rewriting search to use the new couchdb 3.0 search functionality. 2021-03-25 23:42:50 +00:00
mike12345567 c51cf423e3 Creating CouchDB 3.0 indexes. 2021-03-25 19:12:17 +00:00
mike12345567 24c523faad Initialising CouchDB link to lucene and app design DBs for it. 2021-03-25 18:04:44 +00:00
mike12345567 d66af9f151 Getting rid of the CLOUD environment variable, this makes no sense anymore, now there is isDev() and isProd() which will work out the current state of the cluster. 2021-03-24 18:21:23 +00:00
mike12345567 78eb00b39d Merge branch 'single-stack-dev' of github.com:Budibase/budibase into feature/fs-removal 2021-03-22 17:20:07 +00:00
mike12345567 fca242b9ee Updating API keys and changing over system to allow use of builder endpoints when running in cloud. 2021-03-22 16:39:11 +00:00
Martin McKeaveney 6742c3ca99 basic single stack dev setup 2021-03-22 15:43:26 +00:00
mike12345567 d28737da34 Upping relationship coverage overall to 98% - looking over utilities which are barely ever used. 2021-03-16 23:25:18 +00:00
mike12345567 d6329e2409 Adding test cases which bring the link controller coverage to 100%. 2021-03-16 18:13:00 +00:00
mike12345567 47cf63bb16 starting into relationship testing. 2021-03-16 13:24:44 +00:00
mike12345567 794372987e Adding more test cases for the controllers, tables and views weren't as well covered as required. 2021-03-15 16:36:38 +00:00
mike12345567 68bb5d5062 Updating package.json to include an option for coverage, had to re-write some stuff to make sure that views were not getting coverage statements inserted (breaking things). 2021-03-02 17:13:11 +00:00
mike12345567 0c8026c5ce First version, still playing around with styling. 2021-03-01 17:06:08 +00:00
mike12345567 78286ae514 Minor update to fix an issue when updating a row that it would throw an error with 1->to->many relationships on existing relationships for that row, as well as cleaning up how relationshipType is put onto the linked table. 2021-02-25 17:07:32 +00:00
Martin McKeaveney c73c77448c bugfixes 2021-02-25 16:21:41 +00:00
mike12345567 51ed23d0a7 Updating link controller to manage existing column comparison a bit better. 2021-02-25 15:21:08 +00:00
mike12345567 cd36739c23 Merge branch 'master' of github.com:Budibase/budibase into bug/relationship-display-id 2021-02-25 12:36:16 +00:00
Martin McKeaveney 2d75bc750b relationship type constant 2021-02-25 12:21:24 +00:00
mike12345567 429811ec8b Wrapping throws in new errors. 2021-02-25 12:10:18 +00:00
mike12345567 a311002632 Found some issues with relationship columns being doubled up, this isn't validated client side, best to make sure it doesn't happen server-side (can really break your data structure if columns overwrite each other). 2021-02-25 12:06:13 +00:00
Martin McKeaveney 89350c91d1 refactor 2021-02-25 11:59:31 +00:00
Martin McKeaveney bcaed4f4e4 Server side data integrity for 1:N 2021-02-25 11:55:23 +00:00
Martin McKeaveney 19fb11e69d 1-n-data-integrity 2021-02-25 11:05:15 +00:00
mike12345567 91878ed2ce Having the server send out _id and primaryDisplay in an object for relationships, also accepting objects and coercing them on way in. 2021-02-25 09:41:04 +00:00
mike12345567 8f9ea1cd8a Minor change, making sure each link is definitely unique by combining each of its three unique properties into a uniqueness hash, was missing one of the components. 2021-02-24 13:55:48 +00:00
mike12345567 780b6e0956 Fixing some issues with enrichment, making sure display column can always be worked out. 2021-02-19 13:21:38 +00:00
mike12345567 fa6d3e5e63 Updating the self auth endpoint to use the row processor. 2021-02-19 10:32:24 +00:00
mike12345567 474796baea Fixing an issue found by Andrew K - relationship lookup needs to work on both sides of relationship. 2021-02-19 10:17:11 +00:00
mike12345567 f080fa6537 Some major performance optimisations, found that db.find is not fast unless its indexed, there is also no point in indexing for our internal relationship searching, however we can use the allDocs call. This will likely be slow for very large calls (say 100K records) but for these sort of calls we really need to paginate anyway. 2021-02-18 13:38:57 +00:00
mike12345567 5fab1529ec work in progress, enriching in the display names. 2021-02-17 18:04:21 +00:00
mike12345567 a93eb180ce Starting with some work towards a deeper enrichment of rows. 2021-02-17 17:09:59 +00:00
mike12345567 1a9d16c8c7 Updating where utilities are held in builder and then making user table relationships autocolumn aware too. 2021-02-16 15:41:50 +00:00
mike12345567 23cac6a9ac Fixing issue with linked rows not handling uniqueness correctly when links between tables are using fieldnames for uniqueness. 2021-02-15 19:01:15 +00:00
mike12345567 245cd0a791 Fixing issue with relationships. 2021-02-15 18:53:20 +00:00
mike12345567 4b1855974c Work in progress, getting the server backend mostly ready for this work. 2021-02-15 17:47:14 +00:00
mike12345567 f266129489 Merge branch 'develop' of github.com:Budibase/budibase into feature/autocolumns 2021-02-12 13:40:27 +00:00
Andrew Kingston 56d8a27286 Merge branch 'master' of github.com:Budibase/budibase into form-builder 2021-02-10 18:34:45 +00:00
mike12345567 ca20cbeeca First lot of work to update the auto fields into schema. 2021-02-10 17:55:19 +00:00
Martin McKeaveney 587d20b611 Merge branch 'master' of https://github.com/Budibase/budibase into internal-search 2021-02-10 14:02:57 +00:00
Andrew Kingston 10a9b8034a Fix relationships not being saved for new rows 2021-02-09 14:50:02 +00:00
mike12345567 3712de65ee Make sure both directions exist. 2021-02-09 13:20:53 +00:00
mike12345567 04035a24e9 Quick fix to make sure all relationships link to a valid, existing doc. 2021-02-09 13:18:59 +00:00
mike12345567 cc02397b01 Fixing issues with builtin roles living in the database as well as in code (easier to change in the future this way) - discovered by basic test case. 2021-02-09 13:01:45 +00:00
Martin McKeaveney b4628a43d0 merge 2021-02-05 11:18:37 +00:00
mike12345567 8656ef3465 Adding a check to the link utils which should make sure the correct link doc is always picked. 2021-02-03 17:19:41 +00:00
mike12345567 c9690f730c Added some unit tests for the enrichment process of rows, in the process found some issues with linking a table to itself, so fixed those so that we can do that in the future if desired. 2021-02-02 11:46:10 +00:00
Martin McKeaveney 27c7f5697b internal search working 2021-02-01 21:02:54 +00:00
mike12345567 561ce349f9 Fixing an issue that aptkingston found with relationships were links on the way out would be multiplied (due to the bi-directional nature). 2021-01-28 14:03:19 +00:00
Martin McKeaveney 53db6e05f9 merge 2021-01-18 14:43:26 +00:00
mike12345567 16a25a7cff When self hosting it is now possible to use a pretty URL to access the app rather than the normal appId. 2021-01-14 17:01:31 +00:00
Martin McKeaveney d05f1666fc further syntax highlighting updates 2021-01-12 16:49:11 +00:00
Martin McKeaveney 8e40f4b5f8 Allow dynamic query execution from front end components 2021-01-08 12:06:37 +00:00
Martin McKeaveney d7a0d29b03 switching between queries 2021-01-06 12:28:51 +00:00
Martin McKeaveney 29b51bc6c2 separation of datasources and queries 2020-12-18 18:19:43 +00:00
Andrew Kingston 77f049d1bd Merge branch 'master' of github.com:Budibase/budibase into feature/security-update 2020-12-08 13:16:53 +00:00
Martin McKeaveney 39473cb029 merge 2020-12-07 21:20:35 +00:00
mike12345567 74f5197865 Merge branch 'username-email' of github.com:Budibase/budibase into feature/security-update 2020-12-07 18:08:20 +00:00
Martin McKeaveney a9d0c68a60 component store refactor - remove concept of currentPreviewItem and currentComponentInfo 2020-12-07 15:27:46 +00:00
mike12345567 3339f364b6 Updating role constraints and making sure roles can't be deleted if they are in use. 2020-12-07 15:21:06 +00:00
Martin McKeaveney 3b049bc286 allow creation of custom layouts, moving layoutId prop to top level of screen 2020-12-04 23:16:07 +00:00
Martin McKeaveney ad4e4e4679 update user id generation 2020-12-04 13:28:19 +00:00
Martin McKeaveney f05d696ef7 email as default user identifier 2020-12-04 12:22:45 +00:00
Martin McKeaveney 277524b86e accommodate login layout 2020-12-03 17:31:38 +00:00
mike12345567 1a9f1aed9b Merge branch 'feature/security-update' of github.com:Budibase/budibase into feature/page-refactor 2020-12-02 13:26:57 +00:00
mike12345567 05225f7787 Changing the naming of access levels to be roles. 2020-12-02 13:20:56 +00:00
mike12345567 b55c4bc9c0 Merge branch 'master' of github.com:Budibase/budibase into feature/page-refactor 2020-11-30 11:47:08 +00:00
Martin McKeaveney ce4bf552f1 fix users test, remove superfluous files 2020-11-25 15:30:10 +00:00
Martin McKeaveney eb9cfcb8bd tidy up 2020-11-24 17:02:58 +00:00
Martin McKeaveney a92d54f9a7 user table and relationships complete 2020-11-24 14:04:14 +00:00
mike12345567 8ae24a4b30 Storing some work in commit, currently broken, further work needed - application needs cleaned up. 2020-11-23 14:07:18 +00:00
mike12345567 b2da94c490 initial work towards page refactor. 2020-11-20 17:47:13 +00:00
mike12345567 7fcdf9c675 Merge branch 'master' of github.com:Budibase/budibase into feature/backend-routing 2020-11-12 15:08:50 +00:00
Martin McKeaveney 9e190ac1ec tidy up 2020-11-12 10:41:49 +00:00
Martin McKeaveney 9b914e0395 remove squirrelly, compile a single bundle.css for each page, svelte and hbs server rendering 2020-11-12 10:25:25 +00:00
mike12345567 5b26fce1ea Starting work off towards routing of screens in backend, getting view ready and a bit of cleanup to make internal views easier to create. 2020-11-10 17:22:41 +00:00
mike12345567 6d41a30440 Quick change, we had a replication statement for testing, should be removed for production and uncommented when needed. 2020-11-06 15:47:12 +00:00
Michael Drury 8c6a97198f Main work to get screens into the DB, fixing up issue with async page updates not being handled in order. 2020-11-04 12:36:38 +00:00
Michael Drury 7f3410204a Updates to pages so that they are written to DB and retrieved correctly. 2020-11-03 17:42:54 +00:00
Martin McKeaveney ea3162f329 screens in DB 2020-11-03 16:27:28 +00:00
Martin McKeaveney 4d388987c4 pages being stored in couch on initialisation and page save 2020-11-02 14:56:48 +00:00
mike12345567 5b2be03bc3 Renaming instanceId -> appId to reduce confusion through the system, there only is one ID now. 2020-10-29 10:28:27 +00:00
mike12345567 ea03d099b3 Initial work into multi-tenancy removal, experiencing issues with test cases at this point. 2020-10-28 20:35:06 +00:00
mike12345567 0d8ec8e03a Some initial work towards webhooks, that generates schema similar to integromat. 2020-10-22 17:48:32 +01:00
mike12345567 ebffeeb998 Fixing some issues found with deleting tables and relationships not getting cleaned up fully + builder not updating - also making sure builder store initial state of screens is accurate. 2020-10-16 13:48:59 +01:00
mike12345567 8e3e12f234 Linting. 2020-10-16 12:13:27 +01:00
mike12345567 312c5fc437 Fixing an issue whereby in some enrichment calls the count of links would be doubled (counting both sides). 2020-10-16 11:59:59 +01:00
mike12345567 b0cea4c091 Updating formatting. 2020-10-12 17:56:40 +01:00
mike12345567 51ed75978b Merge branch 'master' of github.com:Budibase/budibase into endpoint-renaming 2020-10-12 17:45:11 +01:00
mike12345567 1dea4f24b7 Handling empty relationship column the same way other columns are handled, it won't do anything until it is valid - but doesn't error. 2020-10-12 17:02:52 +01:00
mike12345567 352ff82885 Improving consistency of model saving, making sure that any validation which could fail happens before any updates are carried out. 2020-10-12 16:51:41 +01:00
mike12345567 8df3a3f8de Fixes for deleting records when a table is deleted. 2020-10-12 16:37:08 +01:00
mike12345567 12242cf6b2 Merge branch 'master' of github.com:Budibase/budibase into endpoint-renaming 2020-10-12 15:25:27 +01:00
mike12345567 9841aab689 Fixes the link doc ID so that they do not start with automation ID and fixes an error that was occurring when creating tables. 2020-10-12 14:31:17 +01:00
mike12345567 cfd4d9d34d Merge branch 'master' of github.com:Budibase/budibase into endpoint-renaming 2020-10-12 13:34:32 +01:00
Michael Drury 058149981e Merge pull request #684 from Budibase/link-record-performance
Small change that drastically improves the performance of linked records
2020-10-12 10:47:57 +01:00
mike12345567 512b7e78c0 Formatting code - was causing PR to fail. 2020-10-12 10:41:25 +01:00
mike12345567 03584cacb2 Using lodash flatten rather than pure JS. 2020-10-12 10:28:53 +01:00
mike12345567 d8f3a2ef17 Merge branch 'master' of github.com:Budibase/budibase into endpoint-renaming 2020-10-12 09:41:42 +01:00
mike12345567 abbf7fcc02 Merge branch 'link-record-performance' of github.com:Budibase/budibase into endpoint-renaming 2020-10-09 20:18:46 +01:00
mike12345567 efce1c839e Major performance boost to attachLinks -> makes CSV upload much more snappy. 2020-10-09 20:06:54 +01:00
mike12345567 dc9552dbad Updating tests and re-formatting. 2020-10-09 19:30:50 +01:00
mike12345567 763f7b3321 Updating ID to use ro rather than re for rows. 2020-10-09 19:16:33 +01:00
mike12345567 5d49d529e3 Changing record -> row in this update, completing the update of renaming in the builder, this release needs further testing. 2020-10-09 19:10:28 +01:00
mike12345567 fdaa69ee7f Renaming Model -> Table across the entire system, this is an unstable update and has not been tested fully yet. 2020-10-09 18:49:23 +01:00
mike12345567 c280586b9b Merge branch 'master' of github.com:Budibase/budibase into api-usage-tracking 2020-10-09 11:21:26 +01:00
Martin McKeaveney 05206b6049 Merge branch 'api-usage-tracking' of github.com:Budibase/budibase into deployment-api-usage 2020-10-09 11:21:03 +01:00
Martin McKeaveney f54062575b use centralised document types and separators 2020-10-09 10:50:44 +01:00
Martin McKeaveney aef74c937e code review 2020-10-09 10:46:38 +01:00
mike12345567 325e291222 Removing sanisation, instead just using it as a central path system. 2020-10-09 10:00:57 +01:00
mike12345567 eea0bc5fb9 Update to IDs as has been discussed, to change them from colons (:) to underscores (_) as this is more URL, S3 and file system safe. Also shortening most prefixes down to two characters. 2020-10-09 09:47:37 +01:00
Martin McKeaveney 3080dc0658 use underscores instead of colons, shorten id entity names 2020-10-08 21:50:49 +01:00
mike12345567 552c31a53e Updates for API usage after testing against local Dynamo. 2020-10-08 17:34:41 +01:00
mike12345567 106badc9c6 Merge branch 'linked-records' of github.com:Budibase/budibase into api-usage-tracking 2020-10-07 15:41:39 +01:00