meetings:vsperf
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
meetings:vsperf [2016/02/09 23:39] Al Morton [Feb 10th 2016] |
meetings:vsperf [2016/03/11 13:31] (current) Simona Coppola [Mar 9th 2016] |
||
|---|---|---|---|
| Line 11: | Line 11: | ||
| ---- | ---- | ||
| ====== vSwitch Performance Characterization Meeting Minutes ====== | ====== vSwitch Performance Characterization Meeting Minutes ====== | ||
| - | ==== Feb 10th 2016 ==== | + | |
| - | * Agenda: | + | ==== Mar 9th 2016 ==== |
| - | * Action Items from Feb 3 | + | * **Agenda:** |
| - | * [[ https://wiki.opnfv.org/wiki/vswitchperf_ietf_draft_submission | Preparations for IETF-95 (BMWG) Update ]] | + | * Overview considerations when bench-marking of Virtual Switches |
| - | * Traffic Gen update | + | * Project Dev Status |
| - | * Ixia (RFC5481) | + | * Traffic Gen Updates |
| - | * Spirent | + | * Rel C Planning |
| - | * Moongen | + | |
| - | * Xena | + | * **ACTIONS** |
| - | * Dev update | + | * [ACTION] Maryam to add CI overview to agenda, Wednesday 16th March |
| - | * PTL Meeting (Actions?) | + | * [ACTION] Bill to create an updated installation / usage version of the tool as the one I presented several weeks ago is now obsolete. |
| - | * B Release (Date) | + | * [ACTION] Simona to check with Maryam if we have a best practice guide when upgrading to new version of VSPERF |
| - | * Hackfest at OVS - March 14-15 | + | * [ACTION] All please provide input to Rel C planning etherpad or confirm acceptance (see link below to etherpad) |
| - | * Attending? Demos? Team use/dev of vsperf on Intel Pod3 | + | * [ACTION] Maryam to provide an update next week on help that is being provided by Ixia |
| - | * C Release Test Priority | + | |
| - | * [[ https://wiki.opnfv.org/wiki/vswitch_test_list?&#performance_tests_to_be_defined_list | list ]] | + | * **Benchmarking Overview** |
| - | * VSPERF Dashboard (official version live yet?) | + | * Al gave an overview of Benchmarking for Virtual Switches |
| - | * [[ https://etherpad.opnfv.org/p/vSwitchTestsDrafts | New Test Review on Etherpad ]] | + | * Also presented the slides at Test projects - weekly coordination meeting, main aim to have it adopted by the wider community |
| - | * login and use color when editing | + | |
| + | * **Project Dev Updates** | ||
| + | * Jira Board link to latest status: https://jira.opnfv.org/secure/RapidBoard.jspa?rapidView=43&projectKey=VSPERF&view=planning.nodetail | ||
| + | |||
| + | * **Traffic Gen updates** | ||
| + | * Xena Update | ||
| + | * Trying to run VSPERF on Redhat plus fix Xena bugs, testing of this starting today | ||
| + | *Moognen Update | ||
| + | * Re-write of LUA wrapper done by Andrew more detail on github | ||
| + | * User guide is currently obsolete, plan to stabilize the new version of Moongen before creating the new user guide, should have something for next week. | ||
| + | *Changes can be viewed at Andrews github : https://github.com/atheurer/MoonGen/tree/dpdk2.x-opnfv | ||
| + | *Spirent Update | ||
| + | * Challenge to update to new VSPERF code', Simona to check with Maryam if we have a best practice guide for upgrading to new version of VSPERF | ||
| + | |||
| + | * **Release C updates** | ||
| + | * Indicated our intent to be part of REL C as planned on March 8th | ||
| + | * Now need to focus on assessing our impacts to other projects such as installers, CI, Infrastructure | ||
| + | *Please provide input directly to etherpad link: https://etherpad.opnfv.org/p/VSPERF_C_Planning | ||
| + | *Meeting with IXIA for packet capture was productive, Plan is to move some TCL to python | ||
| + | |||
| + | ==== Mar 2nd 2016 ==== | ||
| + | * Agenda: | ||
| + | * VPP Overview | ||
| + | * Project Dev Updates | ||
| + | * Traffic Gen Updates | ||
| + | * Test Priority List for Release C | ||
| + | |||
| + | * **ACTIONS** | ||
| + | * [ACTION] Maryam to add CI overview to agenda in two weeks, Wednesday 16th March | ||
| + | * [ACTION] Bill to create an updated installation / usage version of the tool as the one presented several weeks ago is now obsolete. | ||
| + | * [ACTION] Simona to send details via email of top Priorities for Rel C - Complete | ||
| + | * [ACTION] All to review and agree final REL C proposal and or provide feedback for any changes/updates | ||
| + | |||
| + | * **Project Dev Updates** | ||
| + | * Maryam added tests from etherpad are now available for review | ||
| + | * Nightly build warning errors are being worked on nearly Clean | ||
| + | * Jira Board link to latest status: https://jira.opnfv.org/secure/RapidBoard.jspa?rapidView=43&projectKey=VSPERF&view=planning.nodetail | ||
| + | |||
| + | |||
| + | * **Traffic Gen updates** | ||
| + | *Xena Update | ||
| + | *working on XML file configuration | ||
| + | *Moognen Update | ||
| + | * Well done to Andrew and Bill, fantastic progress has been made in last few weeks. | ||
| + | * Andrew Theurer has made significant changes to the tool. This is in regards to the Lua wrapper around the DPDK engine, in particular the file opnfv-vsperf.lua which instruments RFC 2544 like testing. | ||
| + | * The changes include but are not limited to: Multi (concurrent) device support. As many pairs of ports as the user wants -Multi queue support for transmit -Hardware tx method is default. | ||
| + | * All bugs with hw tx should now be avoided (with multi queue support) -Major clean up and reorganization of code -Test parameters are now in file -no command line arguments -Tx rate is calibrated before testing to never be above requested rate | ||
| + | * -Uni/bidirectional logic handled in connections[] array -Use log: facility that comes with MoonGen -Too low tx rate detection allows N attempts instead of aborting on first failure | ||
| + | * The tool is now ported from DPDK 1.71 to DPDK 2.2 | ||
| + | *Changes can be viewed at Andrews github : https://github.com/atheurer/MoonGen/tree/dpdk2.x-opnfv | ||
| + | *Spirent Update | ||
| + | * Undecided whether to push two scripts or merge into one, however there potentially could be overlap. Maryam suggested to push scripts as they are and a decision can be made as part of the review. | ||
| + | |||
| + | * **Release C updates** | ||
| + | * Discussed milestones and C planning, see link to WIKI for details https://wiki.opnfv.org/releases/releaseplanning | ||
| + | * MS1 due next week 8th March | ||
| + | *More servers have been requested to be set up for testing, Maryam to follow up on status next week #link https://wiki.opnfv.org/get_started/intel_pod3 | ||
| + | |||
| + | |||
| + | ==== Feb 24th 2016 ==== | ||
| + | * Agenda: | ||
| + | * Review Action Items from Feb 17th | ||
| + | * Project Dev Updates | ||
| + | * Traffic Gen Updates | ||
| + | *IETF-95 Update | ||
| + | * Rel B Status | ||
| + | * Test Priority List for Release C | ||
| + | |||
| + | * **ACTIONS** | ||
| + | * [ACTION] ALL can you please review patches and abandon those that are no longer valid | ||
| + | * [ACTION] All please notify Maryam or Al if you plan on attending hackfest | ||
| + | * [ACTION] : Maryam to update Jira with new tickets for Rel C | ||
| + | * [ACTION] : All Draft tests on etherpad please review and revert back to Maryam and Al with your feedback | ||
| + | * [ACTION] : All please ensure your Jira tickets that have been completed are closed in JIRA | ||
| + | * [ACTION] : Bill to advise on mailing list for Moongen | ||
| + | |||
| + | * **Project Dev Updates** | ||
| + | * Documents now pushed to Master Branch | ||
| + | * Jira Board link to latest status: https://jira.opnfv.org/secure/RapidBoard.jspa?rapidView=43&projectKey=VSPERF&view=planning.nodetail | ||
| + | * Draft test in etherpad, Maryam suggested that we should move them to gerrit and add to Jira | ||
| + | |||
| + | * **Traffic Gen updates** | ||
| + | * Xena Update | ||
| + | *working on XML file configuration | ||
| + | *Moognen Update | ||
| + | * Success in getting 40gb supported, moongen now upgraded to DPDK 2.2 | ||
| + | * Started working on integrating into VSPERF infrastructure | ||
| + | *Spirent Update | ||
| + | * Need to fix issues with older version and then update scripts | ||
| + | |||
| + | * **ITEF-95 Update** | ||
| + | * Al updated Jira ticket deadline has been extended, Maryam to add some updates to the draft | ||
| + | * look at possibility of doing remote presentation | ||
| + | |||
| + | * **Release B updates** | ||
| + | * Official External launch announcement March 1st | ||
| + | * Tag added to stable Brahmaputra branch for VSPERF | ||
| + | |||
| + | * **Release C updates** | ||
| + | * Potential collaboration between OVS and VSPERF on new feature (ability to classify packets and give priority) submitted by AL. | ||
| + | * Could use VSPERF as test suite to measure the benefit | ||
| + | |||
| + | |||
| + | * ** Please send on any agenda items you would like to discuss next week** | ||
| + | |||
| + | |||
| + | ==== Feb 17th 2016 ==== | ||
| + | * Agenda: | ||
| + | * Review Action Items from Feb 10th | ||
| + | * IETF-95 Update | ||
| + | * Project Dev Updates | ||
| + | * Hackfest March | ||
| + | * Traffic Gen Updates | ||
| + | * Rel B Update | ||
| + | * Test Priority List for Release C | ||
| | | ||
| + | * **ACTIONS** | ||
| + | * [ACTION] All can you let Maryam know if you plan on attending hackfest | ||
| + | * [ACTION] Maryam to add review feedback on test results to the backlog for Rel C | ||
| + | |||
| + | * **Project Dev Updates** | ||
| + | * Martin has written patch that will automate test results to the Dashboard | ||
| + | *Documents now pushed to Master Branch | ||
| + | * Jira Board link to latest status: https://jira.opnfv.org/secure/RapidBoard.jspa?rapidView=43&projectKey=VSPERF&view=planning.nodetail | ||
| + | * link http://artifacts.opnfv.org/vswitchperf/docs/index.html link https://wiki.opnfv.org/wiki/vsperf_results | ||
| + | *Update from Sridhar patch for documenting addition of new test case is complete it now needs to be pushed to gerrit. | ||
| + | |||
| + | |||
| + | * **Traffic Gen updates** | ||
| + | * Xena Update | ||
| + | *working on some bugs, having issues with results generation, continue to find issues while testing | ||
| + | *Moognen Update | ||
| + | * Fix implemented for 0% and 1% loss, difference of variance is now closer | ||
| + | *Spirent Update | ||
| + | *newtestcase.rst, according to the comments in done. I’ll relook at this document next week to enhance it to cover other cases (other attributes of testcase) apart from the traffic generator. | ||
| + | *Made initial commit on JIRA-VSPERF:237. Will continue to fine tune the scripts. | ||
| + | *Planning to add scripts for multicast benchmarking (3918). Should create Jira ticket for the same soon. | ||
| + | |||
| + | * **Rel B updates** | ||
| + | * Primary release date on target for Feb 25th | ||
| + | * Only outstanding item, publish dashboard results | ||
| + | *Received some good feedback, need to add definition for tests | ||
| + | *Need to review unstable results, B2B frame test need to define what we are plotting | ||
| + | *Rename scalability OVS/DPDK tests | ||
| + | |||
| + | * **Hackfest** | ||
| + | * Held in SantaClara March 14-15th | ||
| + | * who is attending ? | ||
| + | *Al and Billy(Intel)will be attending | ||
| + | *if we don't have a core list of attendees than might not be worth setting up offline discussions/demos | ||
| + | * Registration is free, link https://www.regonline.com/Register/Checkin.aspx?EventID=1802426 | ||
| + | | ||
| + | |||
| + | * **Test priority list for release C** | ||
| + | * Reviewed updates and new tests on etherpad https://etherpad.opnfv.org/p/vSwitchTestsDrafts, please review and add feedback | ||
| + | *Suggested we have a cut off point for review perhaps one week and then we push to gerrit | ||
| + | |||
| + | |||
| + | * ** Please send on any agenda items you would like to discuss next week** | ||
| + | |||
| + | |||
| + | ==== Feb 10th 2016 ==== | ||
| + | * **Agenda** | ||
| + | * Review Action Items from Feb 3rd | ||
| + | * IETF-95 Update | ||
| + | * Project Dev Updates | ||
| + | * Hackfest March 14-15 | ||
| + | * Traffic Gen Updates | ||
| + | * Rel B Update | ||
| + | * Test Priority List for Release C | ||
| + | | ||
| + | |||
| + | * **ACTIONS** | ||
| + | * [ACTION] Maryam to investigate MPLS support in OVS. | ||
| + | * [ACTION] Al to open a JIRA ticket to Update the Internet draft, etc. | ||
| + | * {ACTION} Al to combine the VM2VM-related tests, then JIRA ticket Priority 1 for Rel C [DONE] | ||
| + | |||
| + | * **IETF-95 Update** | ||
| + | * Need to sync Internet Draft with the list of tests as of Brahmaputra Release | ||
| + | |||
| + | * **Project Dev Updates** | ||
| + | * VSPERF dashboard only seems to be working with chrome, not working with IE and Firefox (Al's experience) | ||
| + | * Jira Board link to latest status: https://jira.opnfv.org/secure/RapidBoard.jspa?rapidView=43&projectKey=VSPERF&view=planning.nodetail | ||
| + | * Still waiting on Test results production link | ||
| + | |||
| + | * **Traffic Gen updates** | ||
| + | * Moongen Update | ||
| + | * made 3 bug fixes to the tool, found missing packets causing tests to fail | ||
| + | * Spirent update | ||
| + | * Sridhar not on the call, no update | ||
| + | * Xena Update: | ||
| + | * Amit finishing up final integration to meet traffic gen spec | ||
| + | * Ixia (RFC 5481)Update: | ||
| + | * made progress on SW upgrade to support packet capture on the Pod in Shannon | ||
| + | * some progress on PDV calculations for results report. | ||
| + | |||
| + | * **Rel B updates** | ||
| + | * Primary release date pushed to Feb 26th | ||
| + | * Any project that is ready will go out on Feb 26th, projects that are not ready will go out March 28th | ||
| + | * Documentation: still open question about the new templates proposed by Chris, room for some flexibility perhaps we can continue to use what we have for this release, as far as we know. | ||
| + | |||
| + | * **Hackfest** | ||
| + | * Will be held in Santa Clara March 14-15th | ||
| + | * Both Maryam and Al attending, would like to know who else is attending so we can plan demos and breakout sessions | ||
| + | * Registration is free, link https://www.regonline.com/Register/Checkin.aspx?EventID=1802426 | ||
| + | * It’s a good opportunity to get input from folks that don’t attend project meetings | ||
| + | |||
| + | * **Test priority list for release C** | ||
| + | * Al added Jira tickets for new tests | ||
| + | * When you combine the VM2VM-related tests, then Priority 1, need wiki update and JIRA ticket | ||
| + | * Voting for Rel C tests are still welcome | ||
| + | * If folks are happy with current top 4, please send a mail to Al confirming | ||
| + | * link to Test Review Scratchpad etherpad: https://etherpad.opnfv.org/p/vSwitchTestsDrafts, welcome test contributions for match action and VM2VM. | ||
| + | * New Draft Test at the Scratchpad (etherpad): | ||
| + | * Overlay Network performance described in general for VXLAN, GRE, GENEVE | ||
| + | * feedback that this approach works, saves time in review. | ||
| + | * link to VM2VM Presentation https://wiki.opnfv.org/wiki/vswitch_readouts?&#vsperf_project_readouts | ||
| ==== Feb 3rd 2016 ==== | ==== Feb 3rd 2016 ==== | ||
meetings/vsperf.1455061156.txt.gz · Last modified: 2016/02/09 23:39 by Al Morton
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: Creative Commons Attribution 4.0 International License
