As previously discussed with Marty, any further flakey tests (timing issues) with Cypress will be skipped for now but not removed.
- Timing issues are effecting Auto Screens UI & PostgreSql tests
- We will receive coverage of these tests via QA Wolf
- The tests are not removed so we still have reference for generating relative API tests
Skipping tests for Oracle & datasourceWizard
Both are covered during general regressions
There are timing issues associated with the CI Smoke run
This will help reduce the smoke build run time
The oracle test file was only covering a basic check of invalid configuration (Not essential for the smoke run)
rest.spec.js
- Test was flakey on last nights smoke run
- Updated to specifically search for query-buttons and then add query
commands.js
- Increasing timeout values for createTable & createDatasourceScreen commands
Update createTable test command
createTable command
- Changing how a check is completed when dealing with the create table modals
appPublishWorkflow
- Increasing timeout value related to the app table status
- This increased timeout value is needed specifically for CI runs
MySQL
- Timing issue for the smoke build
- Including an intercept after saving a query and then confirming it exists. Sometimes Cypress tries to find the query within the nav item section before the query has finished
PostgreSQL
- Timing issue for the smoke build
- Sometimes Cypress will continue the test before the page has finished reloading. Increased timeout value here to ensure the page loads. Also ensuring the entire nav item section is visible
UI changes for users requires some test updates
- User commands updates
- New user command - setUserRole
- Test updates to adminAndManagement + Datasource tests
- Some test skips as they need reworked (specifically user management tests)
PostgreSql
- Added intercept when saving a query, sometimes it runs too fast
createTable command
- Improved to ensure better timing, and that table is correctly created
Data-cy IDs are gone for components (I assume due to the UI redesign)
For now I have created a new command to search and add a component. Tests have been updated to reflect this
Getting close.... but there are still some minor timing issues against the smoke build.
I am increasing a few timeout values within postgreSQL & commands files
This time it is adding appropriate deleteAllApps commands and adding waits
- The waits seem to be essential for the smoke build.
- Tests pass locally, but timing issues causes failure on the smoke build
Created a new folder called adminAndManagement
- contains user and portal based tests
Timeouts refactoring
- Replacing a large number of waits with timeouts - this will prevent less time waiting during all testing
Skipping test that attempts to add datasource without config
-Eventually times out with empty error message.
I will raise a bug for this. Skipping the test to keep the automation running
Datasource (MySQL, PostgreSQL)
- Test should now pass for smoke build
Table Tests
- Removed pagination tests - no pagination in the smoke build test run
PostgreSQL
- Test fixes (May still fail due to connection issues on smoke build)
Oracle
- Test fixes
- Skipping most tests (Oracle host needs configured)
commands.spec.js
- minor change to addDatasourceConfig function
I've made some changes to the tests and commands file to allow for the tests to run within the Test env after the latest round of UI changes.
Some of these changes also allow for testing instances in which apps already exist - This is specific for the test env, the CI runs always have a clean instance
createTable
-Pagination is now Test Env only
oracle
-Test Env only
-Removed smoke test tag
commands
-Fix for createApp command
-Increase wait for createRestQuery command
Structural changes surrounding data sources
-Cypress env file removed
-Text change for fetching tables
-Oracle tests organised
-PostgreSQL tests organised
New test is for skipping table fetch via button
There are a few other smaller changes
-Changes made to reflect the new layouts of the test env
--e.g. Changes to the app grid, changes to UI screens
-Updated commands
--New commands added & some updated
-New tests
--Revert App
--AutoScreensUI
--Change app icon and colour
--Data source testing
In particular to data source testing
-I have a file for mySQL, PostgreSQL, Oracle, and REST.
--enabled better regression testing for each
Other changes made for:
-QueryLevelTransformers tests
-Table tests
-Renaming applications
-Automations
-Multi-option datastype
New env file added too
Changes as per PR
-Created files for transformer queries - tests updated accordingly
-Updates for Env variables and usage
-Changes surrounding App Rename testing
Mitch-Budibase
Pedro Silva
mike12345567
Dean
Andrew Kingston