https://blueprints.launchpad.net/tripleo/+spec/automated-ui-testing
We would like to introduce a suite of automated integration tests for the TripleO UI. This will prevent regressions, and will lead to more stable software.
At the moment, upstream CI only tests for lint errors, and runs our unit tests. We’d like to add more integration tests for tripleo-ui to the CI pipeline. This will include a selenium-based approach. This allows us to simulate a browser by using a headless browser when running in CI, and we can detect a lot more problems than we ever could with just unit testing.
We would like write a Tempest plugin for tripleo-ui which uses Selenium to drive a headless browser to execute the tests. We chose Tempest because it’s a standard in OpenStack, and gives us nice error reporting.
We already have the tempest-tripleo-ui project set up.
We plan to write a CI job to run our code in Tempest. In the initial implementation, this will only cover checking for presence of certain UI elements, and no deployments will actually be run.
The alternative is that we do all of our testing manually, waste time, have lower velocity, and have more bugs.
The security impact of this is minimal as it’s CI-specific, and not user-facing.
End users won’t interact with this feature.
This feature will only consume CI resources. There should be no negative resource impact on the End User.
Our goal is to produce software that is more stable. But we’re not changing any features, per se.
Developers will gain a higher degree of confidence in their software.
This is a bit meta.
We will document how a developer who is new to the tripleo-ui project can get started with writing new integration tests.
openstack-dev mailing list discussion: