Differences

This shows you the differences between two versions of the page.

--- nfv-kvm-test [2015/11/03 23:38]
Jiang, Yunhong [Hardware Platform Description]
+++ nfv-kvm-test [2016/01/04 06:24]
Chao Peng
@@ Line 76: / Line 76: @@
 ===== BIOS Setup =====
-===== Environment Setup =====
+Carefully BIOS setup is important to achieve real time latency. Different platform has different BIOS setup, below is the important BIOS setting on the platform collecting the baseline performance data.
+<code>
+CPU Power and Performance <Performance>
+CPU C-State <Disabled>
+C1E Autopromote <Disabled>
+Processor C3 <Disabled>
+Processor C6 <Disabled>
+Select Memory RAS <Maximum Performance>
+NUMA Optimized <Enabled>
+Cluster-on-Die <Disabled>
+Patrol Scrub <Disabled>
+Demand Scrub <Disabled>
+Correctable Error <10>
+Intel(R) Hyper-Threading <Disabled>
+Active Processor Cores <All>
+Execute Disable Bit <Enabled>
+Intel(R) Virtualization Technology <Enabled>
+Intel(R) TXT <Disabled>
+Enhanced Error Containment Mode <Disabled>
+USB Controller <Enabled>
+USB 3.0 Controller <Auto>
+Legacy USB Support <Disabled>
+Port 60/64 Emulation <Disabled>
+</code>
+===== Software Environment Setup =====
+We need setup both the host/guest environment, to reduce any noise. https://gerrit.opnfv.org/gerrit/#/c/2161/ gives detailed implementation on how to setup the environment setup. Below are descriptions of the work done there.
+==== Kernel Parameter ====
+__Kernel configuration__: kernel/arch/x86/configs/opnfv.config.
+__Host kernel boot line example__: isolcpus=11-15,31-35 nohz_full=11-15,31-35 rcu_nocbs=11-15,31-35 iommu=pt intel_iommu=on default_hugepagesz=1G hugepagesz=1G mce=off idle=poll intel_pstate=disable processor.max_cstate=1 pcie_asmp=off tsc=reliable
+__Guest kernel boot line example__:  isolcpus=1 nohz_full=1 rcu_nocbs=1 mce=off idle=poll default_hugepagesz=1G hugepagesz=1G
+Please refer to [[nfv-kvm-tuning]] for more explanation.
+==== Run-time Environment Setup ====
+Not only special kernel parameter needed, also run-time environment adjustment is needed. Below are some BKMs.
+Please refer to [[nfv-kvm-tuning]] for more explanation.
 ====== Test Description ======
+Currently there are three tests are executed for the KVM4NFV project. Please notice, as the integration with the test project is WIP, these test are executed on an Intel lab, instead of OPNFV test bed.
+. Cyclictest
+This is a common real time benchmark. Please refer to https://rt.wiki.kernel.org/index.php/Cyclictest for more information.
+. Device Interrupt Latency Test
+This is a custom test where a FPGA card produce interrupt every 1ms. The latency from the interrupt invoked to the interrupt serviced will be mersured.
+. L2 Packet Forwarding
+This is only used live migration now, although it's planned to be used for real time latency test in future.
 ====== Performance Data ======
+We collected baseline performance data, i.e. the performance data without any enhancement, but with all the system configuration applied already.
 ===== Baseline Performance Data =====
+. CyclicTest
+<code>
+# Min Latencies: 00005
+# Avg Latencies: 00007
+# Max Latencies: 00032
+# Histogram Overflows: 00002
+# Histogram Overflow at cycle number:
+# Thread 0: 45337966 50108448
+</code>
+. Device Interrupt Latency
+<code>
+Latency is Min: 7.22us Max: 55.28us Avg: 8.93us
+Jitter is Min: 963.20us Max: 1040.68us Avg: 1002.62us
+</code>
 ===== Latest Performance Data =====
+This is the test result at 11/09/2015.
+. CyclictTest
+<code>
+# Total: 086400000
+# Min Latencies: 00006
+# Avg Latencies: 00006
+# Max Latencies: 00011
+# Histogram Overflows: 00000
+# Histogram Overflow at cycle number:
+# Thread 0:
+</code>
+. Device Interrupt Latency
+<code>
+Period is 1000 us
+Latency is Min: 4.11us Max: 9.11us Avg: 5.06us
+Jitter is Min: 997.09us Max: 1008.23us Avg: 1002.62us
+</code>
+===== Latest Live Migration Performance Data =====
+For live migration performance data, please refer to https://etherpad.opnfv.org/p/live_migration_optimization_data for information.

Wiki

User Tools

Site Tools

Differences

Page Tools