This is an old revision of the document!
Key objectives:
Procedure shall be independant from the installer. The procedure shall be performed on any of the installer.
TODO: shall we be more prescritive on the toloing environment (creation of the VM, installation of the tools)?
for release 1 we target the automation of the following tests
The default scenario are:
the first ones (authenticate, nova, cinder, glance, keystone, neutron, quotas, requests, tempest-do-not-run-against-production) can be re-used. However scenario shall be tuned especially for the bench
Note: during first manual launched on alpha Orange platform installed with opensteak installer, there were lots of errors (196) running Tempest scenario and some in Rally scenario (results to be analyzed)
Studies on the testcase shall be done
To be discussed with CI team asap
"Func test" | "Jira" | "Description/Documentation" | "Manual test" | "Result analysis" | "Automated test" | "BGS link" | "Comments" |
---|---|---|---|---|---|---|---|
Rally Bench | installation procedure described https://github.com/Orange-OpenSource/opnfv/blob/master/docs/TEST.md | OK | tested on Orange alpha testbed, Rally natively integrated in Fuel | ||||
Rally Tempest | |||||||
vPing | |||||||
vIMS | based on clearwater solution | ||||||
ODL |