This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
platform_performance_benchmarking [2015/11/30 11:06] Nauman Ahad [Tests cases:] |
platform_performance_benchmarking [2016/03/07 16:58] (current) Vikram Dham [Qtip Meeting Information] |
||
|---|---|---|---|
| Line 5: | Line 5: | ||
| * Project Name: QTIP | * Project Name: QTIP | ||
| * Project Repository: QTIP | * Project Repository: QTIP | ||
| + | * Primary Contact: Vikram Dham | ||
| + | * Project Lead: Vikram Dham | ||
| * Project Category: Integration & Testing | * Project Category: Integration & Testing | ||
| * Etherpad: https://etherpad.opnfv.org/p/Qtip | * Etherpad: https://etherpad.opnfv.org/p/Qtip | ||
| Line 14: | Line 16: | ||
| ==== Qtip Meeting Information ==== | ==== Qtip Meeting Information ==== | ||
| - | * When: Occurs every Thursday from 15:00 to 16:00 (UTC). | ||
| * IRC: #opnfv-qtip | * IRC: #opnfv-qtip | ||
| - | * Please join my meeting from your computer, tablet or smartphone. https://global.gotomeeting.com/join/741216893 | + | * Schedule for C Release: TBD |
| ==== Description: ==== | ==== Description: ==== | ||
| Line 56: | Line 56: | ||
| ==== Tests cases: ==== | ==== Tests cases: ==== | ||
| - | - Compute testcases: | + | - [[Compute test suite]]: |
| - | * [[Dhrystone on multiple host compute nodes]] | + | * [[Dhrystone on host nodes]] |
| - | * [[Dhrystone on Virtual machines hosted on differnet compute nodes]] | + | * [[Dhrystone on virtual machines]] |
| - | * [[Dhrystone on Compute node vs virtual machines]] | + | |
| * [[Whetstone on multiple host compute nodes]] | * [[Whetstone on multiple host compute nodes]] | ||
| - | * [[Whetstone on Virtual machines hosted on differnet compute nodes]] | + | * [[Whetstone on virtual machines hosted on differnet compute nodes]] |
| * [[Whetsone on Compute node vs virtual machines]] | * [[Whetsone on Compute node vs virtual machines]] | ||
| - | * [[RAMspeed on multiple host compute nodes]] | + | * [[RAMspeed on host machine]] |
| - | * [[RAMspeed on Virtual machines hosted on differnet compute nodes]] | + | * [[RAMspeed on virtual machine]] |
| - | * [[RAMspeed on Compute node vs virtual machines]] | + | * [[OpenSSL speed on host machine]] |
| - | * [[OpenSSL speed on multiple host compute nodes]] | + | * [[OpenSSL speed on Virtual machine]] |
| - | * [[OpenSSL speed on Virtual machines hosted on differnet compute nodes]] | + | * [[nDPI on host node]] |
| - | * [[OpenSSL speed on Compute node vs virtual machines]] | + | * [[nDPI on Virtual machine]] |
| - | * [[nDPI on multiple host compute nodes]] | + | - [[Storage test suite]] |
| - | * [[nDPI on Virtual machines hosted on differnet compute nodes]] | + | * [[50 percent Rand/Read File storage benchmark using FIO for multiple compute nodes]] |
| - | * [[nDPI on Compute node vs virtual machines]] | + | * [[50 percent Rand/Read File storage benchmark using FIO for virtual machines]] |
| - | - Storage benchmarks | + | - [[Network test suite]] |
| - | * [[50 percent Rand/Read Block storage using FIO for multiple compute nodes]] | + | * [[TCP Iperf troughput test across VMs on a single compute node]] |
| - | * [[50 percent Rand/Read Block storage using FIO for virtual machines]] | + | * [[TCP Iperf throughput test across VMs on separate compute nodes]] |
| - | - Network testcases | + | * [[TCP Iperf throughput test across Multiple compute nodes]] |
| - | * [[UDP Iperf troughput test across VMs on a single compute node]] | + | - [[ Complete QTIP testsuite]] |
| - | * [[UDP Iperf throughput test across VMs on separate compute nodes]] | + | |
| - | * [[UDP Iperf throughput test across Multiple compute nodes]] | + | |
| - | * [[OVS lookback using DPDK based virtual traffic generator]] | + | |
| - | + | ||
| ==== Sample Tests: ==== | ==== Sample Tests: ==== | ||
| Line 134: | Line 129: | ||
| * Infrastructure verification (YardStick) [[yardstick|Project: Yardstick - Infrastructure Verification]] deals with Infrastructure validation of OPNFV platforms. QTIP aims to benchmark the performance of components within OPNFV platforms for a quantitative analysis and doesn't deal with validation of the platform. | * Infrastructure verification (YardStick) [[yardstick|Project: Yardstick - Infrastructure Verification]] deals with Infrastructure validation of OPNFV platforms. QTIP aims to benchmark the performance of components within OPNFV platforms for a quantitative analysis and doesn't deal with validation of the platform. | ||
| * Testing methodology has a rich set of industry standards, e.g. ETSI NFV ISG, IETF, and so on. As we develop or adopt testing methodologies, we will reference these standards whenever applicable. | * Testing methodology has a rich set of industry standards, e.g. ETSI NFV ISG, IETF, and so on. As we develop or adopt testing methodologies, we will reference these standards whenever applicable. | ||
| + | |||
| + | |||
| + | ==== Reference POD ==== | ||
| + | |||
| + | For Brahamputra release, QTIP would be calculating three indices. | ||
| + | |||
| + | * The Compute Suite Index | ||
| + | * The Storage Suite Index | ||
| + | * The Network Suite Index | ||
| + | |||
| + | These indices are calculated by comparing QTIP results with the QTIP reference results obtained at Dell's OPNFV Lab's POD 3 | ||
| + | |||
| + | [[Reference POD hardware details]] | ||
| + | |||
| + | [[Reference POD QTIP results]] | ||
| Line 142: | Line 152: | ||
| Committers: | Committers: | ||
| + | * Vikram Dham <vikram@nvirters.com> | ||
| * Wenjing Chu, <wenjing_chu@dell.com> | * Wenjing Chu, <wenjing_chu@dell.com> | ||
| * Shrinivas Chavan, <shrinivas.chavan@ericsson.com> | * Shrinivas Chavan, <shrinivas.chavan@ericsson.com> | ||
| * Sheng-Ann Yu <sheng-ann.yu@ericsson.com> | * Sheng-Ann Yu <sheng-ann.yu@ericsson.com> | ||
| - | * Rodriguez, Iben <Iben.Rodriguez@spirent.com> | + | * Iben Rodriguez <Iben.Rodriguez@vmsec.com> |
| - | * Prabu, Kuppuswamy <Prabu.Kuppuswamy@spirent.com> | + | |
| * Cooper, Trevor <trevor.cooper@intel.com> | * Cooper, Trevor <trevor.cooper@intel.com> | ||
| * Michael Haugh <mhaugh@clearpathnet.com> | * Michael Haugh <mhaugh@clearpathnet.com> | ||
| * Richomme, Morgan <morgan.richomme@orange.com> | * Richomme, Morgan <morgan.richomme@orange.com> | ||
| - | * Vikram Dham <v_dham@dell.com> | + | * Nauman Ahad <nauman.ahad@xflowresearch.com> |
| - | * Nauman Ahad <nauman_ahad@dell.com> | + | |
| * Pang Hao <shamrock.pang@huawei.com> | * Pang Hao <shamrock.pang@huawei.com> | ||
| Line 158: | Line 167: | ||
| * aihua.li <aihua.li@huawei.com> | * aihua.li <aihua.li@huawei.com> | ||
| * Tien, Michael <Michael_Tien@Dell.com> | * Tien, Michael <Michael_Tien@Dell.com> | ||
| - | * Mofassir ul Islam Arif <Mofassir_Arif@dell.com> | + | * Mofassir ul Islam Arif <mofassir.arif@xflowresearch.com> |
| ==== Planned deliverables ==== | ==== Planned deliverables ==== | ||