This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
platform_performance_benchmarking [2015/11/30 19:31] Nauman Ahad [Tests cases:] |
platform_performance_benchmarking [2016/03/07 16:58] (current) Vikram Dham [Qtip Meeting Information] |
||
---|---|---|---|
Line 5: | Line 5: | ||
* Project Name: QTIP | * Project Name: QTIP | ||
* Project Repository: QTIP | * Project Repository: QTIP | ||
+ | * Primary Contact: Vikram Dham | ||
+ | * Project Lead: Vikram Dham | ||
* Project Category: Integration & Testing | * Project Category: Integration & Testing | ||
* Etherpad: https://etherpad.opnfv.org/p/Qtip | * Etherpad: https://etherpad.opnfv.org/p/Qtip | ||
Line 14: | Line 16: | ||
==== Qtip Meeting Information ==== | ==== Qtip Meeting Information ==== | ||
- | * When: Occurs every Thursday from 15:00 to 16:00 (UTC). | ||
* IRC: #opnfv-qtip | * IRC: #opnfv-qtip | ||
- | * Please join my meeting from your computer, tablet or smartphone. https://global.gotomeeting.com/join/741216893 | + | * Schedule for C Release: TBD |
==== Description: ==== | ==== Description: ==== | ||
Line 56: | Line 56: | ||
==== Tests cases: ==== | ==== Tests cases: ==== | ||
- | - [[Compute testcases]]: | + | - [[Compute test suite]]: |
- | * [[Dhrystone on multiple host compute nodes]] | + | * [[Dhrystone on host nodes]] |
- | * [[Dhrystone on virtual machines hosted on differnet compute nodes]] | + | * [[Dhrystone on virtual machines]] |
- | * [[Dhrystone on compute node vs virtual machines]] | + | |
* [[Whetstone on multiple host compute nodes]] | * [[Whetstone on multiple host compute nodes]] | ||
* [[Whetstone on virtual machines hosted on differnet compute nodes]] | * [[Whetstone on virtual machines hosted on differnet compute nodes]] | ||
* [[Whetsone on Compute node vs virtual machines]] | * [[Whetsone on Compute node vs virtual machines]] | ||
- | * [[RAMspeed on multiple host compute nodes]] | + | * [[RAMspeed on host machine]] |
- | * [[RAMspeed on Virtual machines hosted on differnet compute nodes]] | + | * [[RAMspeed on virtual machine]] |
- | * [[RAMspeed on Compute node vs virtual machines]] | + | * [[OpenSSL speed on host machine]] |
- | * [[OpenSSL speed on multiple host compute nodes]] | + | * [[OpenSSL speed on Virtual machine]] |
- | * [[OpenSSL speed on Virtual machines hosted on differnet compute nodes]] | + | * [[nDPI on host node]] |
- | * [[OpenSSL speed on Compute node vs virtual machines]] | + | * [[nDPI on Virtual machine]] |
- | * [[nDPI on multiple host compute nodes]] | + | - [[Storage test suite]] |
- | * [[nDPI on Virtual machines hosted on differnet compute nodes]] | + | * [[50 percent Rand/Read File storage benchmark using FIO for multiple compute nodes]] |
- | * [[nDPI on Compute node vs virtual machines]] | + | * [[50 percent Rand/Read File storage benchmark using FIO for virtual machines]] |
- | * [[All QTIP compute testcases on VMs]] | + | - [[Network test suite]] |
- | * [[All QTIP compute testcases on host compute nodes]] | + | * [[TCP Iperf troughput test across VMs on a single compute node]] |
- | * | + | * [[TCP Iperf throughput test across VMs on separate compute nodes]] |
- | - [[Storage benchmarks]] | + | * [[TCP Iperf throughput test across Multiple compute nodes]] |
- | * [[50 percent Rand/Read Block storage using FIO for multiple compute nodes]] | + | - [[ Complete QTIP testsuite]] |
- | * [[50 percent Rand/Read Block storage using FIO for virtual machines]] | + | |
- | - [[Network testcases]] | + | |
- | * [[UDP Iperf troughput test across VMs on a single compute node]] | + | |
- | * [[UDP Iperf throughput test across VMs on separate compute nodes]] | + | |
- | * [[UDP Iperf throughput test across Multiple compute nodes]] | + | |
- | * [[OVS lookback using DPDK based virtual traffic generator]] | + | |
- | * [[All network testcases]] | + | |
- | - [[ All testcases]] | + | |
==== Sample Tests: ==== | ==== Sample Tests: ==== | ||
Line 138: | Line 129: | ||
* Infrastructure verification (YardStick) [[yardstick|Project: Yardstick - Infrastructure Verification]] deals with Infrastructure validation of OPNFV platforms. QTIP aims to benchmark the performance of components within OPNFV platforms for a quantitative analysis and doesn't deal with validation of the platform. | * Infrastructure verification (YardStick) [[yardstick|Project: Yardstick - Infrastructure Verification]] deals with Infrastructure validation of OPNFV platforms. QTIP aims to benchmark the performance of components within OPNFV platforms for a quantitative analysis and doesn't deal with validation of the platform. | ||
* Testing methodology has a rich set of industry standards, e.g. ETSI NFV ISG, IETF, and so on. As we develop or adopt testing methodologies, we will reference these standards whenever applicable. | * Testing methodology has a rich set of industry standards, e.g. ETSI NFV ISG, IETF, and so on. As we develop or adopt testing methodologies, we will reference these standards whenever applicable. | ||
+ | |||
+ | |||
+ | ==== Reference POD ==== | ||
+ | |||
+ | For Brahamputra release, QTIP would be calculating three indices. | ||
+ | |||
+ | * The Compute Suite Index | ||
+ | * The Storage Suite Index | ||
+ | * The Network Suite Index | ||
+ | |||
+ | These indices are calculated by comparing QTIP results with the QTIP reference results obtained at Dell's OPNFV Lab's POD 3 | ||
+ | |||
+ | [[Reference POD hardware details]] | ||
+ | |||
+ | [[Reference POD QTIP results]] | ||
Line 146: | Line 152: | ||
Committers: | Committers: | ||
+ | * Vikram Dham <vikram@nvirters.com> | ||
* Wenjing Chu, <wenjing_chu@dell.com> | * Wenjing Chu, <wenjing_chu@dell.com> | ||
* Shrinivas Chavan, <shrinivas.chavan@ericsson.com> | * Shrinivas Chavan, <shrinivas.chavan@ericsson.com> | ||
* Sheng-Ann Yu <sheng-ann.yu@ericsson.com> | * Sheng-Ann Yu <sheng-ann.yu@ericsson.com> | ||
- | * Rodriguez, Iben <Iben.Rodriguez@spirent.com> | + | * Iben Rodriguez <Iben.Rodriguez@vmsec.com> |
- | * Prabu, Kuppuswamy <Prabu.Kuppuswamy@spirent.com> | + | |
* Cooper, Trevor <trevor.cooper@intel.com> | * Cooper, Trevor <trevor.cooper@intel.com> | ||
* Michael Haugh <mhaugh@clearpathnet.com> | * Michael Haugh <mhaugh@clearpathnet.com> | ||
* Richomme, Morgan <morgan.richomme@orange.com> | * Richomme, Morgan <morgan.richomme@orange.com> | ||
- | * Vikram Dham <v_dham@dell.com> | + | * Nauman Ahad <nauman.ahad@xflowresearch.com> |
- | * Nauman Ahad <nauman_ahad@dell.com> | + | |
* Pang Hao <shamrock.pang@huawei.com> | * Pang Hao <shamrock.pang@huawei.com> | ||
Line 162: | Line 167: | ||
* aihua.li <aihua.li@huawei.com> | * aihua.li <aihua.li@huawei.com> | ||
* Tien, Michael <Michael_Tien@Dell.com> | * Tien, Michael <Michael_Tien@Dell.com> | ||
- | * Mofassir ul Islam Arif <Mofassir_Arif@dell.com> | + | * Mofassir ul Islam Arif <mofassir.arif@xflowresearch.com> |
==== Planned deliverables ==== | ==== Planned deliverables ==== | ||