This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
opnfv_test_dashboard [2015/10/26 17:24] Morgan Richomme |
opnfv_test_dashboard [2016/01/19 14:33] (current) Peter Bandzi [Test results server] |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Note working page ...no decision yet...to be discussed during functest and test weekly meeting ====== | + | ====== Testing Dashboard ====== |
- | ===Admin === | + | ==== Admin ==== |
It was decided to adopt the Mongo DB/API/Json approach [[http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2015/opnfv-testperf.2015-09-03-16.03.html|dashboard meeting minutes]] | It was decided to adopt the Mongo DB/API/Json approach [[http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2015/opnfv-testperf.2015-09-03-16.03.html|dashboard meeting minutes]] | ||
Line 12: | Line 12: | ||
- | === Introduction === | + | ==== Introduction ==== |
All the test projects generate results in different format. The goal of a testing dashboard is to provide a consistent view of the different tests from the different projects. | All the test projects generate results in different format. The goal of a testing dashboard is to provide a consistent view of the different tests from the different projects. | ||
- | === Overview === | + | ==== Overview ==== |
Line 79: | Line 79: | ||
* Create a <my_project>2Dashboard.py file into [[https://git.opnfv.org/cgit/releng/tree/utils/test/result_collection_api/dashboard|releng]], This file indicate how to produce "ready to dashboard" data set, that are exposed afterwards through the API | * Create a <my_project>2Dashboard.py file into [[https://git.opnfv.org/cgit/releng/tree/utils/test/result_collection_api/dashboard|releng]], This file indicate how to produce "ready to dashboard" data set, that are exposed afterwards through the API | ||
- | ^Project ^testcases ^Dashboard ready description ^ | + | ^ Project ^ testcases ^ Dashboard ready description ^ |
- | | Functest | vPing | graph1: duration = f(time) \\ graph 2 bar graph (tests run / tests OK) | | + | | Functest | vPing | graph1: duration = f(time) \\ graph 2 bar graph (tests run / tests OK) | |
- | | ::: | Tempest | graph1: duration = f(time) \\ graph 2 (nb tests run, nb tests failed)=f(time) \\ graph 3: bar graph nb tests run, nb failed | | + | | ::: | Tempest | graph1: duration = f(time) \\ graph 2 (nb tests run, nb tests failed)=f(time) \\ graph 3: bar graph nb tests run, nb failed | |
- | | ::: | odl | | | + | | ::: | odl | | |
- | | ::: | rally-* | | | + | | ::: | rally-* | | |
- | | yardstick | | | | + | | yardstick | Ping | graph1: duration = f(time) \\ graph 2 bar graph (tests run / tests OK) | |
- | | VSPERF | | | | + | | ::: | | | |
- | | QTip | | | | + | | VSPERF | | | |
+ | | QTip | | | | ||
- | === First studies for dashboarding === | + | |
+ | ==== First studies for dashboarding ==== | ||
* home made solution | * home made solution | ||
Line 100: | Line 102: | ||
* [[http://butleranalytics.com/5-free-open-source-bi/|BI solution]] | * [[http://butleranalytics.com/5-free-open-source-bi/|BI solution]] | ||
- | === Example of home made solution on functest/vPing === | + | ==== Visualization examples ==== |
+ | |||
+ | * Example of home made solution on functest/vPing: [[vPing4Dashboard example]] | ||
+ | * Example view of using the ELK stack (elasticsearch, logstash, kibana): | ||
+ | * [[opnfv_test_dashboard/opnfv_kibana_dashboards]] | ||
+ | * Visualize Functest (vPing/Tempest) results: [[opnfv_test_dashboard/functest_elk_example|ELK example for FuncTest]] | ||
+ | |||
+ | ===== Test results server ===== | ||
+ | |||
+ | Test results server: | ||
+ | |||
+ | * Single server which hosts and visualizes all OPNFV test results | ||
+ | * Testresults.opnfv.org (also testdashboard.opnfv.org) - 130.211.154.108 | ||
+ | * The server will host | ||
+ | * Test results portal / landing page (nginx) | ||
+ | * Test results data base (MongoDB) | ||
+ | * Yardstick specific data base (InfluxDB) | ||
+ | * ELK stack - with Kibana to serve as Test Dashboard | ||
+ | * Grafana (for Yardstick results visualization) | ||
+ | * (future) - use Kafka as message broker and hook up data-bases (ES, Mongo, ..) to Kafka | ||
+ | |||
+ | Port assignment (for FW): | ||
+ | * 80 - nginx - landingpage | ||
+ | |||
+ | Port assignment (local) | ||
+ | * 5000 - logstash | ||
+ | * 5601 - Kibana | ||
+ | * 8083, 8086 - InfluxDB | ||
+ | * 8082, tornado | ||
+ | * 3000 - Grafana | ||
+ | * 9200-9300 - Elasticsearch APIs | ||
- | see [[vPing4Dashboard example]] |