User Tools

Site Tools


platform_performance_benchmarking

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
platform_performance_benchmarking [2015/11/30 11:06]
Nauman Ahad [Tests cases:]
platform_performance_benchmarking [2016/03/07 16:58] (current)
Vikram Dham [Qtip Meeting Information]
Line 5: Line 5:
   * Project Name: QTIP   * Project Name: QTIP
   * Project Repository: QTIP   * Project Repository: QTIP
 +  * Primary Contact: Vikram Dham
 +  * Project Lead: Vikram Dham
   * Project Category: Integration & Testing   * Project Category: Integration & Testing
   * Etherpad: ​ https://​etherpad.opnfv.org/​p/​Qtip   * Etherpad: ​ https://​etherpad.opnfv.org/​p/​Qtip
Line 14: Line 16:
 ==== Qtip Meeting Information ==== ==== Qtip Meeting Information ====
  
-  * When: Occurs every Thursday from 15:00 to 16:00 (UTC). 
   * IRC: #opnfv-qtip   * IRC: #opnfv-qtip
-  * Please join my meeting from your computer, tablet or smartphone. https://​global.gotomeeting.com/​join/​741216893 +  * Schedule for C ReleaseTBD
 ==== Description:​ ==== ==== Description:​ ====
  
Line 56: Line 56:
  
 ==== Tests cases: ==== ==== Tests cases: ====
-  - Compute testcases:​ +  - [[Compute test suite]]: 
-      * [[Dhrystone on multiple host compute nodes]] +      * [[Dhrystone on host nodes]] 
-      * [[Dhrystone on Virtual machines hosted on differnet compute ​nodes]] +      * [[Dhrystone on virtual machines]]
-      * [[Dhrystone on Compute node vs virtual machines]]+
       * [[Whetstone on multiple host compute nodes]]       * [[Whetstone on multiple host compute nodes]]
-      * [[Whetstone on Virtual ​machines hosted on differnet compute nodes]]+      * [[Whetstone on virtual ​machines hosted on differnet compute nodes]]
       * [[Whetsone on Compute node vs virtual machines]]       * [[Whetsone on Compute node vs virtual machines]]
-      * [[RAMspeed on multiple ​host compute nodes]] +      * [[RAMspeed on host machine]] 
-      * [[RAMspeed on Virtual machines hosted on differnet compute nodes]] +      * [[RAMspeed on virtual ​machine]]   
-      * [[RAMspeed on Compute node vs virtual ​machines]]   +      * [[OpenSSL speed on host machine]] 
-      * [[OpenSSL speed on multiple ​host compute nodes]] +      * [[OpenSSL speed on Virtual ​machine]] 
-      * [[OpenSSL speed on Virtual ​machines hosted on differnet compute nodes]] +      * [[nDPI on host node]] 
-      * [[OpenSSL speed on Compute node vs virtual machines]] +      * [[nDPI on Virtual ​machine]] 
-      * [[nDPI on multiple ​host compute nodes]] +    ​- ​[[Storage test suite]] 
-      * [[nDPI on Virtual ​machines hosted on differnet compute nodes]] +      * [[50 percent Rand/​Read ​File storage ​benchmark ​using FIO for multiple compute nodes]] 
-      ​* ​[[nDPI on Compute node vs virtual machines]] +      * [[50 percent Rand/​Read ​File storage ​benchmark ​using FIO for  virtual machines]] 
-    - Storage benchmarks +    - [[Network ​test suite]] 
-      * [[50 percent Rand/​Read ​Block storage using FIO for multiple compute nodes]] +      * [[TCP Iperf troughput test across VMs on a single compute node]] 
-      * [[50 percent Rand/​Read ​Block storage using FIO for  virtual machines]] +      * [[TCP Iperf throughput test across VMs on separate compute nodes]] 
-    - Network ​testcases +      * [[TCP Iperf throughput test across Multiple compute nodes]] 
-      * [[UDP Iperf troughput test across VMs on a single compute node]] +    ​- ​[[ Complete QTIP testsuite]]
-      * [[UDP Iperf throughput test across VMs on separate compute nodes]] +
-      * [[UDP Iperf throughput test across Multiple compute nodes]] +
-      ​* ​[[OVS lookback using DPDK based virtual traffic generator]] +
- +
 ==== Sample Tests: ==== ==== Sample Tests: ====
  
Line 134: Line 129:
   * Infrastructure verification (YardStick) [[yardstick|Project:​ Yardstick - Infrastructure Verification]] deals with Infrastructure validation of OPNFV platforms. QTIP aims to benchmark the performance of components within OPNFV platforms for a quantitative analysis and doesn'​t deal with validation of the platform.   * Infrastructure verification (YardStick) [[yardstick|Project:​ Yardstick - Infrastructure Verification]] deals with Infrastructure validation of OPNFV platforms. QTIP aims to benchmark the performance of components within OPNFV platforms for a quantitative analysis and doesn'​t deal with validation of the platform.
   * Testing methodology has a rich set of industry standards, e.g. ETSI NFV ISG, IETF, and so on. As we develop or adopt testing methodologies,​ we will reference these standards whenever applicable.   * Testing methodology has a rich set of industry standards, e.g. ETSI NFV ISG, IETF, and so on. As we develop or adopt testing methodologies,​ we will reference these standards whenever applicable.
 +
 +
 +==== Reference POD ====
 +
 +For Brahamputra release, QTIP would be calculating three indices.
 +
 +  * The Compute Suite Index
 +  * The Storage Suite Index
 +  * The Network Suite Index
 +
 +These indices are calculated by comparing QTIP results with the QTIP reference results obtained at Dell's OPNFV Lab's POD 3
 +
 +[[Reference POD hardware details]]
 +
 +[[Reference POD QTIP results]]
  
  
Line 142: Line 152:
 Committers: Committers:
  
 +  * Vikram Dham <​vikram@nvirters.com>​
   * Wenjing Chu, <​wenjing_chu@dell.com> ​   * Wenjing Chu, <​wenjing_chu@dell.com> ​
   * Shrinivas Chavan, <​shrinivas.chavan@ericsson.com>​   * Shrinivas Chavan, <​shrinivas.chavan@ericsson.com>​
   * Sheng-Ann Yu <​sheng-ann.yu@ericsson.com>​   * Sheng-Ann Yu <​sheng-ann.yu@ericsson.com>​
-  * Rodriguez, Iben <​Iben.Rodriguez@spirent.com>​ +  * Iben Rodriguez <​Iben.Rodriguez@vmsec.com>
-  * Prabu, Kuppuswamy <​Prabu.Kuppuswamy@spirent.com>+
   * Cooper, Trevor <​trevor.cooper@intel.com>​   * Cooper, Trevor <​trevor.cooper@intel.com>​
   * Michael Haugh <​mhaugh@clearpathnet.com>​   * Michael Haugh <​mhaugh@clearpathnet.com>​
   * Richomme, Morgan <​morgan.richomme@orange.com> ​   * Richomme, Morgan <​morgan.richomme@orange.com> ​
-  ​* Vikram Dham <​v_dham@dell.com>​ +  * Nauman Ahad <nauman.ahad@xflowresearch.com>
-  ​* Nauman Ahad <nauman_ahad@dell.com>+
   * Pang Hao <​shamrock.pang@huawei.com>​   * Pang Hao <​shamrock.pang@huawei.com>​
  
Line 158: Line 167:
   * aihua.li <​aihua.li@huawei.com>​   * aihua.li <​aihua.li@huawei.com>​
   * Tien, Michael <​Michael_Tien@Dell.com>​   * Tien, Michael <​Michael_Tien@Dell.com>​
-  * Mofassir ul Islam Arif <Mofassir_Arif@dell.com>+  * Mofassir ul Islam Arif <mofassir.arif@xflowresearch.com>
 ==== Planned deliverables ==== ==== Planned deliverables ====
  
platform_performance_benchmarking.1448881609.txt.gz · Last modified: 2015/11/30 11:06 by Nauman Ahad