Project: Bottlenecks - System Limitation Testing

• Project Name: Bottlenecks
  
• Project Repository: bottlenecks
  
• Project Category: Integration & Testing
  
• Project IRC: #opnfv-bottlenecks
  
• Project Meetings: Working meeting page

	Quick links Bottlenecks Jira tasks Bottlenecks documentation

This project aims to find system bottlenecks by testing and verifying OPNFV infrastructure in a staging environment before committing it to a production environment. Instead of debugging a deployment in production environment, an automatic method for executing benchmarks which plans to validate the deployment during staging is adopted. This project will provide a framework to find the bottlenecks of OPNFV infrastructure. The framework has four components: Workload generator and VNFs (WV), Monitor and Analysis (MA), Deployment and Configuration (DC), Automated Staging (AS). The architecture is as shown here, and the functions of each components are as below.

• Workload generator and VNFs: workload generator generates workloads which go through VNFs
• Monitor and Analysis: monitor VNFs status and infrastructure status to output analyzed results
• Deployment and Configuration: deploy and configure infrastructure and WV
• Automated Staging: implement automated staging

• Meetings:
  • Weekly work meeting: Thursdays 1:00-2:00 UTC
    • Gotomeeting Access: https://global.gotomeeting.com/join/882532573
    • IRC channel: #opnfv-bottlenecks @ Freenode (Web Chat)
    • Check Agenda and Minutes of Meetings
  • Weekly Test&Perf meeting: Thursdays 15:00-16:00 UTC
    • Gotomeeting Access: https://global.gotomeeting.com/join/305553637
    • IRC channel: #opnfv-meeting @ Freenode (Web Chat)
    • See More meeting details
  • Bi-Weekly Test&Perf meeting (Asia&Europe): Thursdays 8:30-9:30 UTC
    • Gotomeeting Access: https://global.gotomeeting.com/join/644444853
    • IRC channel: #opnfv-meeting @ Freenode (Web Chat)
    • See More meeting details

• Etherpads:
  • Bottlenecks release planning - https://etherpad.opnfv.org/p/bottlenecks
  • Bottlenecks and Dovetail - https://etherpad.opnfv.org/p/test_bottleneck_dovetail

• Gerrit: https://gerrit.opnfv.org/gerrit/#/q/bottlenecks

• Git: https://git.opnfv.org/bottlenecks

• Jira: https://jira.opnfv.org/projects/BOTTLENECK

• Project proposal: Bottlenecks Project Proposal

The scope of Bottlenecks project includes:

• Forming a staging test framework
  1. Release candidates A,B… provides a foundation to be tested of Infrastructure layer
  2. A workload generator generates workloads which go through VNFs. This workload generator will be scalable and may cover multiply workload models for different scenarios
  3. Monitor and analysis units will monitor the infrastructure and VNFs status and present results after analysis

• Automatically generating the full set of experimental specification
  1. Document and codes to describe how to generate experimental specification according to different service level agreement (SLA)
  2. Document to describe how to find some typical bottlenecks according to specific monitoring

• Measuring the performance of standard benchmarks over a wide range of hardware and software configurations
  1. Different hardware resource adopted to produce test data used for bottleneck analysis
  2. Different parameters adopted in software configuration files to produce test data used for bottleneck analysis

• Automated iterative staging process for finding bottlenecks
  1. Achieve full automation in system deployment, evaluation, and evolution, by creating code generation tools to link the different steps of deployment, evaluation, reconfiguration, and redesign in full lifecycle.
  2. Reassignment and reconfiguration of hardware resources
  3. Reassignment and reconfiguration of software resource

• Bottlenecks Introduction at Project proposal
• concepts, classification of bottlenecks: https://jira.opnfv.org/projects/BOTTLENECK/issues/BOTTLENECK-34?filter=allopenissues

• basic information and how to use rubbos/vstf in bottlenecks project: http://artifacts.opnfv.org/bottlenecks/brahmaputra/bottlenecks_brahmaputra_docs/index.html

bottlenecks_project_for_test_meeting_20150820.pptx

documents for bottlenecks: http://artifacts.opnfv.org/bottlenecks/docs/bottlenecks_brahmaputra_docs/index.html

• Brahmaputra release page
• OPNFV Main Testing Page
• OPNFV Coding Guidelines
• Ask OPNFV
• Brahmaputra release plan

Lynch Michael A(Intel): michael.a.lynch@intel.com
Qi Liang: liangqi1@huawei.com
Mingjiang Li: limingjiang@huawei.com
Lingli Deng: denglingli@chinamobile.com
Qunwei Yang: qwyang0126@gmail.com
Yaoguang Wang: sunshine.wang@huawei.com