Migrate existing integration tests to use tempest plugin, so these tests can run under tempest framework. And add negative API tests for heat.
Tempest support external plugin since BP Tempest External Plugin Interface . Basic idea for tempest plugin is that each project can implement tempest like tests in their repo and provide those as tempest plugin. So that those tests can be run as part of tempest run.
Currently integration tests are running with tox and not compatible with tempest plugin, it’s better to migrate our tests to support tempest plugin. Then refstack can use tempest framework to score this project.
Introduce tempest plugin.
Refractor heat_integrationtests structure:
heat_integrationtests/ config.py plugin.py functional/ scenario/ Two new file will be added:config.py and plugin.py. Options in heat_integrationtests/common/config.py will be copied and adjust to heat_integrationtests/config.py.
Create a entrypoint in setup.cfg:
[entry_points] tempest.test_plugins = heat_tests = heat_integrationtests.plugin:HeatTempestPlugin
Make functional tests compatible with tempest plugin.
Make scenario tests compatible with tempest plugin
Change gate to use heat tempest plugin, might need some modification on setup scripts.