Check minimum version for CLI tests
This is my use case:
We package OpenStack internally and right now we're packaging stable/icehouse server packages (i.e. nova) plus the clients based on required versions around early April before the Icehouse release, so we package python-
With branchless Tempest, a CLI test was added for the nova server-group-list API:
https:/
However, that command didn't get into python-novaclient in the 2.17 release, it's on trunk:
https:/
So we fail when trying to run that test with python-
Tempest doesn't hit a problem in the upstream CI since it's testing against trunk code for the clients rather than released versions on pypi.
My proposal here is that we add a @minversion decorator for the Tempest CLI tests such that a minimum version of the client is required for the test to run, otherwise it's skipped.
This would still test the new CLIs against unreleased versions of the clients since the in-development version of the packages should be higher than the minimum based on the git hash and how pbr doesn't packaging, but shouldn't fail for packagers/deployers that are only testing stable releases of the server packages and don't have CI on unreleased versions of the clients.
Blueprint information
- Status:
- Complete
- Approver:
- Matthew Treinish
- Priority:
- High
- Drafter:
- Matt Riedemann
- Direction:
- Approved
- Assignee:
- Matt Riedemann
- Definition:
- Approved
- Series goal:
- Proposed for juno
- Implementation:
- Implemented
- Milestone target:
- juno-3
- Started by
- Matthew Treinish
- Completed by
- Matthew Treinish
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Check minimum version for CLI tests
Gerrit topic: https:/
Addressed by: https:/
Sync versionutils from oslo-incubator
Addressed by: https:/
WIP: Add min_client_version decorator for CLI tests
Work Items
Dependency tree
* Blueprints in grey have been implemented.