[V1,2/7] tests/kni:Separated performance cases

Message ID 20220922142950.398902-2-hongbox.li@intel.com (mailing list archive)
State Superseded
Headers
Series [V1,1/7] tests/efd:Separated performance cases |

Commit Message

Li, HongboX Sept. 22, 2022, 2:29 p.m. UTC
  Separated performance cases

Signed-off-by: Hongbo Li <hongbox.li@intel.com>
---
 test_plans/kni_test_plan.rst      |  200 -----
 test_plans/perf_kni_test_plan.rst |  295 +++++++
 tests/TestSuite_kni.py            |  487 ------------
 tests/TestSuite_perf_kni.py       | 1191 +++++++++++++++++++++++++++++
 4 files changed, 1486 insertions(+), 687 deletions(-)
 create mode 100644 test_plans/perf_kni_test_plan.rst
 create mode 100644 tests/TestSuite_perf_kni.py
  

Patch

diff --git a/test_plans/kni_test_plan.rst b/test_plans/kni_test_plan.rst
index 3e21bbb3..050b2abe 100644
--- a/test_plans/kni_test_plan.rst
+++ b/test_plans/kni_test_plan.rst
@@ -385,203 +385,3 @@  Using ``dmesg`` to check whether kernel module is loaded with the specified
 parameters. Some permutations, those with wrong values, must fail to
 success. For permutations with valid parameter values, verify the application can be
 successfully launched and then close the application using CTRL+C.
-
-Test Case: loopback mode performance testing
-============================================
-
-Compare performance results for loopback mode using:
-
-    - lo_mode: lo_mode_fifo and lo_mode_fifo_skb.
-    - kthread_mode: single and multiple.
-    - Number of ports: 1 and 2.
-    - Number of virtual interfaces per port: 1 and 2
-    - Frame sizes: 64 and 256.
-    - Cores combinations:
-
-        - Different cores for Rx, Tx and Kernel.
-        - Shared core between Rx and Kernel.
-        - Shared cores between Rx and Tx.
-        - Shared cores between Rx, Tx and Kernel.
-        - Multiple cores for Kernel, implies multiple virtual interfaces per port.
-
-::
-
-    insmod ./x86_64-default-linuxapp-gcc/kmod/igb_uio.ko
-    insmod ./x86_64-default-linuxapp-gcc/kmod/rte_kni.ko <lo_mode and kthread_mode parameters>
-    ./<build_target>/examples/dpdk-kni -c <Core mask> -n 4 -- -P -p <Port mask> --config="<Ports/Cores configuration>" &
-
-
-At this point, the throughput is measured and recorded for the different
-frame sizes. After this, the application is closed using CTRL+C.
-
-The measurements are presented in a table format.
-
-+------------------+--------------+-------+-----------------+--------+--------+
-| lo_mode          | kthread_mode | Ports | Config          | 64     | 256    |
-+==================+==============+=======+=================+========+========+
-|                  |              |       |                 |        |        |
-+------------------+--------------+-------+-----------------+--------+--------+
-
-
-Test Case: bridge mode performance testing
-==========================================
-
-Compare performance results for bridge mode using:
-
-    - kthread_mode: single and multiple.
-    - Number of ports: 2
-    - Number of ports: 1 and 2.
-    - Number of flows per port: 1 and 2
-    - Number of virtual interfaces per port: 1 and 2
-    - Frame size: 64.
-    - Cores combinations:
-
-        - Different cores for Rx, Tx and Kernel.
-        - Shared core between Rx and Kernel.
-        - Shared cores between Rx and Tx.
-        - Shared cores between Rx, Tx and Kernel.
-        - Multiple cores for Kernel, implies multiple virtual interfaces per port.
-
-The application is launched and the bridge is setup using the commands below::
-
-    insmod ./x86_64-default-linuxapp-gcc/kmod/rte_kni.ko <kthread_mode parameter>
-    ./<build_target>/examples/dpdk-kni -c <Core mask> -n 4 -- -P -p <Port mask> --config="<Ports/Cores configuration>" &
-
-    ifconfig vEth2_0 up
-    ifconfig vEth3_0 up
-    brctl addbr "br_kni"
-    brctl addif br_kni vEth2_0
-    brctl addif br_kni vEth3_0
-    ifconfig br_kni up
-
-
-At this point, the throughput is measured and recorded. After this, the
-application is closed using CTRL+C and the bridge deleted::
-
-    ifconfig br_kni down
-    brctl delbr br_kni
-
-
-The measurements are presented in a table format.
-
-+--------------+-------+-----------------------------+-------+
-| kthread_mode | Flows | Config                      | 64    |
-+==============+=======+=============================+=======+
-|              |       |                             |       |
-+--------------+-------+-----------------------------+-------+
-
-Test Case: bridge mode without KNI performance testing
-======================================================
-
-Compare performance results for bridge mode using only Kernel bridge, no DPDK
-support. Use:
-
-    - Number of ports: 2
-    - Number of flows per port: 1 and 2
-    - Frame size: 64.
-
-Set up the interfaces and the bridge::
-
-    rmmod rte_kni
-    ifconfig vEth2_0 up
-    ifconfig vEth3_0 up
-    brctl addbr "br1"
-    brctl addif br1 vEth2_0
-    brctl addif br1 vEth3_0
-    ifconfig br1 up
-
-
-At this point, the throughput is measured and recorded. After this, the
-application is closed using CTRL+C and the bridge deleted::
-
-    ifconfig br1 down
-    brctl delbr br1
-
-
-The measurements are presented in a table format.
-
-+-------+-------+
-| Flows | 64    |
-+=======+=======+
-| 1     |       |
-+-------+-------+
-| 2     |       |
-+-------+-------+
-
-Test Case: routing mode performance testing
-===========================================
-
-Compare performance results for routing mode using:
-
-    - kthread_mode: single and multiple.
-    - Number of ports: 2
-    - Number of ports: 1 and 2.
-    - Number of virtual interfaces per port: 1 and 2
-    - Frame size: 64 and 256.
-    - Cores combinations:
-
-        - Different cores for Rx, Tx and Kernel.
-        - Shared core between Rx and Kernel.
-        - Shared cores between Rx and Tx.
-        - Shared cores between Rx, Tx and Kernel.
-        - Multiple cores for Kernel, implies multiple virtual interfaces per port.
-
-The application is launched and the bridge is setup using the commands below::
-
-    echo 1 > /proc/sys/net/ipv4/ip_forward
-
-    insmod ./x86_64-default-linuxapp-gcc/kmod/rte_kni.ko <kthread_mode parameter>
-    ./<build_target>/examples/dpdk-kni -c <Core mask> -n 4 -- -P -p <Port mask> --config="<Ports/Cores configuration>" &
-
-    ifconfig vEth2_0 192.170.2.1
-    ifconfig vEth3_0 192.170.3.1
-    route add -net 192.170.2.0  netmask 255.255.255.0 gw 192.170.2.1
-    route add -net 192.170.3.0  netmask 255.255.255.0 gw 192.170.3.1
-    arp -s 192.170.2.2 vEth2_0
-    arp -s 192.170.3.2 vEth3_0
-
-At this point, the throughput is measured and recorded. After this, the
-application is closed using CTRL+C.
-
-The measurements are presented in a table format.
-
-+--------------+-------+-----------------------------+-------+-------+
-| kthread_mode | Ports | Config                      | 64    | 256   |
-+==============+=======+=============================+=======+=======+
-|              |       |                             |       |       |
-+--------------+-------+-----------------------------+-------+-------+
-
-
-Test Case: routing mode without KNI performance testing
-=======================================================
-
-Compare performance results for routing mode using only Kernel, no DPDK
-support. Use:
-
-    - Number of ports: 2
-    - Frame size: 64 and 256
-
-Set up the interfaces and the bridge::
-
-
-    echo 1 > /proc/sys/net/ipv4/ip_forward
-    rmmod rte_kni
-    ifconfig vEth2_0 192.170.2.1
-    ifconfig vEth3_0 192.170.3.1
-    route add -net 192.170.2.0  netmask 255.255.255.0 gw 192.170.2.1
-    route add -net 192.170.3.0  netmask 255.255.255.0 gw 192.170.3.1
-    arp -s 192.170.2.2 vEth2_0
-    arp -s 192.170.3.2 vEth3_0
-
-At this point, the throughput is measured and recorded. After this, the
-application is closed using CTRL+C.
-
-The measurements are presented in a table format.
-
-+-------+-------+-------+
-| Ports | 64    | 256   |
-+=======+=======+=======+
-| 1     |       |       |
-+-------+-------+-------+
-| 2     |       |       |
-+-------+-------+-------+
diff --git a/test_plans/perf_kni_test_plan.rst b/test_plans/perf_kni_test_plan.rst
new file mode 100644
index 00000000..6e63c207
--- /dev/null
+++ b/test_plans/perf_kni_test_plan.rst
@@ -0,0 +1,295 @@ 
+.. SPDX-License-Identifier: BSD-3-Clause
+   Copyright(c) 2010-2017 Intel Corporation
+
+================================
+Kernel NIC Interface (KNI) Tests
+================================
+
+Description
+===========
+
+This document provides the plan for testing the Kernel NIC Interface
+application with support of rte_kni kernel module.
+Kernel NIC Interface is a DPDK alternative solution to the existing linux
+tun-tap interface for the exception path. Kernel NIC Interface allows the
+standard Linux net tools(ethtool/ifconfig/tcpdump) to facilitate managing the
+DPDK port. At the same time, it add an interface with the kernel net stack.
+The test supports Multi-Thread KNI.
+
+All kni model parameter detail info on user guides:http://dpdk.org/doc/guides/sample_app_ug/kernel_nic_interface.html
+
+The ``rte_kni`` kernel module can be installed by a ``lo_mode`` parameter.
+
+loopback disabled::
+
+    insmod rte_kni.ko
+    insmod rte_kni.ko "lo_mode=lo_mode_none"
+    insmod rte_kni.ko "lo_mode=unsupported string"
+
+loopback mode=lo_mode_ring enabled::
+
+    insmod rte_kni.ko "lo_mode=lo_mode_ring"
+
+loopback mode=lo_mode_ring_skb enabled::
+
+    insmod rte_kni.ko "lo_mode=lo_mode_ring_skb"
+
+The ``rte_kni`` kernel module can also be installed by a ``kthread_mode``
+parameter. This parameter is ``single`` by default.
+
+kthread single::
+
+    insmod rte_kni.ko
+    insmod rte_kni.ko "kthread_mode=single"
+
+kthread multiple::
+
+    insmod rte_kni.ko
+    insmod rte_kni.ko "kthread_mode=multiple"
+
+
+The ``kni`` application is run with EAL parameters and parameters for the
+application itself. For details about the EAL parameters, see the relevant
+DPDK **Getting Started Guide**. This application supports two parameters for
+itself.
+
+- ``--config="(port id, rx lcore, tx lcore, kthread lcore, kthread lcore, ...)"``:
+  Port and cores selection. Kernel threads are ignored if ``kthread_mode``
+  is not ``multiple``.
+
+ports cores::
+
+    e.g.:
+
+        --config="(0,1,2),(1,3,4)"              No kernel thread specified.
+        --config="(0,1,2,21),(1,3,4,23)"        One kernel thread in use.
+        --config="(0,1,2,21,22),(1,3,4,23,25)   Two kernel threads in use.
+
+- ``-P``: Promiscuous mode. This is off by default.
+
+Prerequisites
+=============
+
+If using vfio the kernel must be >= 3.6+ and VT-d must be enabled in bios.When
+using vfio, use the following commands to load the vfio driver and bind it
+to the device under test::
+
+   modprobe vfio
+   modprobe vfio-pci
+   usertools/dpdk-devbind.py --bind=vfio-pci device_bus_id
+
+The DUT has at least 2 DPDK supported IXGBE NIC ports.
+
+The DUT has to be able to install rte_kni kernel module and launch kni
+application with a default configuration (This configuration may change form a
+system to another)::
+
+    rmmod rte_kni
+    rmmod igb_uio
+    insmod ./x86_64-default-linuxapp-gcc/kmod/igb_uio.ko
+    insmod ./x86_64-default-linuxapp-gcc/kmod/rte_kni.ko
+    ./<build_target>/examples/dpdk-kni -c 0xa0001e -n 4 -- -P -p 0x3 --config="(0,1,2,21),(1,3,4,23)" &
+
+Case config::
+
+   For enable KNI features, need build DPDK with '-Denable_kmods=True'.
+
+Test Case: loopback mode performance testing
+============================================
+
+Compare performance results for loopback mode using:
+
+    - lo_mode: lo_mode_fifo and lo_mode_fifo_skb.
+    - kthread_mode: single and multiple.
+    - Number of ports: 1 and 2.
+    - Number of virtual interfaces per port: 1 and 2
+    - Frame sizes: 64 and 256.
+    - Cores combinations:
+
+        - Different cores for Rx, Tx and Kernel.
+        - Shared core between Rx and Kernel.
+        - Shared cores between Rx and Tx.
+        - Shared cores between Rx, Tx and Kernel.
+        - Multiple cores for Kernel, implies multiple virtual interfaces per port.
+
+::
+
+    insmod ./x86_64-default-linuxapp-gcc/kmod/igb_uio.ko
+    insmod ./x86_64-default-linuxapp-gcc/kmod/rte_kni.ko <lo_mode and kthread_mode parameters>
+    ./<build_target>/examples/dpdk-kni -c <Core mask> -n 4 -- -P -p <Port mask> --config="<Ports/Cores configuration>" &
+
+
+At this point, the throughput is measured and recorded for the different
+frame sizes. After this, the application is closed using CTRL+C.
+
+The measurements are presented in a table format.
+
++------------------+--------------+-------+-----------------+--------+--------+
+| lo_mode          | kthread_mode | Ports | Config          | 64     | 256    |
++==================+==============+=======+=================+========+========+
+|                  |              |       |                 |        |        |
++------------------+--------------+-------+-----------------+--------+--------+
+
+
+Test Case: bridge mode performance testing
+==========================================
+
+Compare performance results for bridge mode using:
+
+    - kthread_mode: single and multiple.
+    - Number of ports: 2
+    - Number of ports: 1 and 2.
+    - Number of flows per port: 1 and 2
+    - Number of virtual interfaces per port: 1 and 2
+    - Frame size: 64.
+    - Cores combinations:
+
+        - Different cores for Rx, Tx and Kernel.
+        - Shared core between Rx and Kernel.
+        - Shared cores between Rx and Tx.
+        - Shared cores between Rx, Tx and Kernel.
+        - Multiple cores for Kernel, implies multiple virtual interfaces per port.
+
+The application is launched and the bridge is setup using the commands below::
+
+    insmod ./x86_64-default-linuxapp-gcc/kmod/rte_kni.ko <kthread_mode parameter>
+    ./<build_target>/examples/dpdk-kni -c <Core mask> -n 4 -- -P -p <Port mask> --config="<Ports/Cores configuration>" &
+
+    ifconfig vEth2_0 up
+    ifconfig vEth3_0 up
+    brctl addbr "br_kni"
+    brctl addif br_kni vEth2_0
+    brctl addif br_kni vEth3_0
+    ifconfig br_kni up
+
+
+At this point, the throughput is measured and recorded. After this, the
+application is closed using CTRL+C and the bridge deleted::
+
+    ifconfig br_kni down
+    brctl delbr br_kni
+
+
+The measurements are presented in a table format.
+
++--------------+-------+-----------------------------+-------+
+| kthread_mode | Flows | Config                      | 64    |
++==============+=======+=============================+=======+
+|              |       |                             |       |
++--------------+-------+-----------------------------+-------+
+
+Test Case: bridge mode without KNI performance testing
+======================================================
+
+Compare performance results for bridge mode using only Kernel bridge, no DPDK
+support. Use:
+
+    - Number of ports: 2
+    - Number of flows per port: 1 and 2
+    - Frame size: 64.
+
+Set up the interfaces and the bridge::
+
+    rmmod rte_kni
+    ifconfig vEth2_0 up
+    ifconfig vEth3_0 up
+    brctl addbr "br1"
+    brctl addif br1 vEth2_0
+    brctl addif br1 vEth3_0
+    ifconfig br1 up
+
+
+At this point, the throughput is measured and recorded. After this, the
+application is closed using CTRL+C and the bridge deleted::
+
+    ifconfig br1 down
+    brctl delbr br1
+
+
+The measurements are presented in a table format.
+
++-------+-------+
+| Flows | 64    |
++=======+=======+
+| 1     |       |
++-------+-------+
+| 2     |       |
++-------+-------+
+
+Test Case: routing mode performance testing
+===========================================
+
+Compare performance results for routing mode using:
+
+    - kthread_mode: single and multiple.
+    - Number of ports: 2
+    - Number of ports: 1 and 2.
+    - Number of virtual interfaces per port: 1 and 2
+    - Frame size: 64 and 256.
+    - Cores combinations:
+
+        - Different cores for Rx, Tx and Kernel.
+        - Shared core between Rx and Kernel.
+        - Shared cores between Rx and Tx.
+        - Shared cores between Rx, Tx and Kernel.
+        - Multiple cores for Kernel, implies multiple virtual interfaces per port.
+
+The application is launched and the bridge is setup using the commands below::
+
+    echo 1 > /proc/sys/net/ipv4/ip_forward
+
+    insmod ./x86_64-default-linuxapp-gcc/kmod/rte_kni.ko <kthread_mode parameter>
+    ./<build_target>/examples/dpdk-kni -c <Core mask> -n 4 -- -P -p <Port mask> --config="<Ports/Cores configuration>" &
+
+    ifconfig vEth2_0 192.170.2.1
+    ifconfig vEth3_0 192.170.3.1
+    route add -net 192.170.2.0  netmask 255.255.255.0 gw 192.170.2.1
+    route add -net 192.170.3.0  netmask 255.255.255.0 gw 192.170.3.1
+    arp -s 192.170.2.2 vEth2_0
+    arp -s 192.170.3.2 vEth3_0
+
+At this point, the throughput is measured and recorded. After this, the
+application is closed using CTRL+C.
+
+The measurements are presented in a table format.
+
++--------------+-------+-----------------------------+-------+-------+
+| kthread_mode | Ports | Config                      | 64    | 256   |
++==============+=======+=============================+=======+=======+
+|              |       |                             |       |       |
++--------------+-------+-----------------------------+-------+-------+
+
+
+Test Case: routing mode without KNI performance testing
+=======================================================
+
+Compare performance results for routing mode using only Kernel, no DPDK
+support. Use:
+
+    - Number of ports: 2
+    - Frame size: 64 and 256
+
+Set up the interfaces and the bridge::
+
+
+    echo 1 > /proc/sys/net/ipv4/ip_forward
+    rmmod rte_kni
+    ifconfig vEth2_0 192.170.2.1
+    ifconfig vEth3_0 192.170.3.1
+    route add -net 192.170.2.0  netmask 255.255.255.0 gw 192.170.2.1
+    route add -net 192.170.3.0  netmask 255.255.255.0 gw 192.170.3.1
+    arp -s 192.170.2.2 vEth2_0
+    arp -s 192.170.3.2 vEth3_0
+
+At this point, the throughput is measured and recorded. After this, the
+application is closed using CTRL+C.
+
+The measurements are presented in a table format.
+
++-------+-------+-------+
+| Ports | 64    | 256   |
++=======+=======+=======+
+| 1     |       |       |
++-------+-------+-------+
+| 2     |       |       |
++-------+-------+-------+
diff --git a/tests/TestSuite_kni.py b/tests/TestSuite_kni.py
index 0a8c3009..53b77db3 100644
--- a/tests/TestSuite_kni.py
+++ b/tests/TestSuite_kni.py
@@ -1061,493 +1061,6 @@  class TestKni(TestCase):
                 # some permutations have to fail
                 pass
 
-    def test_perf_loopback(self):
-        """
-        KNI loopback performance
-        """
-        self.dut.kill_all()
-
-        header = loopback_perf_results_header
-        for size in packet_sizes_loopback:
-            header.append("%d (pps)" % size)
-
-        self.result_table_create(header)
-
-        # Execute the permutations of the test
-        for step in loopback_performance_steps:
-
-            self.extract_ports_cores_config(step["config"])
-
-            total_cores = len(
-                self.config["tx_cores"]
-                + self.config["rx_cores"]
-                + self.config["kernel_cores"]
-            )
-            if total_cores > self.dut_physical_cores():
-                self.logger.info(
-                    "Skipping step %s (%d cores needed, got %d)"
-                    % (step["config"], total_cores, self.dut_physical_cores())
-                )
-                continue
-
-            self.start_kni(lo_mode=step["lo_mode"], kthread_mode=step["kthread_mode"])
-
-            pps_results = []
-
-            for size in packet_sizes_loopback:
-
-                payload_size = size - 38
-
-                ports_number = len(self.config["ports"])
-
-                # Set up the flows for the ports
-                tgen_input = []
-                for port in self.config["ports"]:
-
-                    rx_mac = self.dut.get_mac_address(port)
-                    tx_port = self.tester.get_local_port(port)
-                    self.tester.scapy_append('dstmac = "%s"' % rx_mac)
-                    self.tester.scapy_append(
-                        'flows = [Ether(dst=dstmac)/IP()/("X"*%d)]' % payload_size
-                    )
-                    pcap = os.sep.join(
-                        [self.output_path, "tester{0}.pcap".format(tx_port)]
-                    )
-                    self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
-                    self.tester.scapy_execute()
-                    tgen_input.append((tx_port, tx_port, pcap))
-
-                time.sleep(1)
-
-                # clear streams before add new streams
-                self.tester.pktgen.clear_streams()
-                # run packet generator
-                streams = self.pktgen_helper.prepare_stream_from_tginput(
-                    tgen_input, 100, None, self.tester.pktgen
-                )
-                _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
-
-                pps_results.append(float(pps) / 1000000)
-
-            ports_number = len(self.config["ports"])
-            results_row = [
-                step["lo_mode"],
-                step["kthread_mode"],
-                ports_number,
-                self.stripped_config_param(),
-            ] + pps_results
-            self.result_table_add(results_row)
-
-            self.dut.kill_all()
-
-        self.result_table_print()
-
-    def test_perf_bridge(self):
-        """
-        KNI performance bridge mode.
-        """
-        self.result_table_create(bridge_perf_results_header)
-
-        self.tester.scapy_append('srcmac="00:00:00:00:00:01"')
-        pcap = os.sep.join([self.output_path, "kni.pcap"])
-        self.tester.scapy_append(
-            'wrpcap("%s", [Ether(src=srcmac, dst="ff:ff:ff:ff:ff:ff")/IP(len=46)/UDP()/("X"*18)])'
-            % pcap
-        )
-        self.tester.scapy_execute()
-
-        for step in bridge_performance_steps:
-
-            self.extract_ports_cores_config(step["config"])
-
-            total_cores = len(
-                self.config["tx_cores"]
-                + self.config["rx_cores"]
-                + self.config["kernel_cores"]
-            )
-            if total_cores > self.dut_physical_cores():
-                self.logger.info(
-                    "Skipping step %s (%d cores needed, got %d)"
-                    % (step["config"], total_cores, self.dut_physical_cores())
-                )
-                continue
-
-            port_virtual_interaces = []
-            for port in self.config["port_details"]:
-                for i in range(len(port["kernel_cores"])):
-                    port_virtual_interaces.append(
-                        self.virtual_interface_name(port["port"], i)
-                    )
-
-            self.dut.kill_all()
-            self.start_kni(lo_mode=None, kthread_mode=step["kthread_mode"])
-
-            for virtual_interace in port_virtual_interaces:
-                out = self.dut.send_expect("ifconfig %s up" % virtual_interace, "# ")
-                self.verify("ERROR" not in out, "Virtual interface not found")
-
-            self.dut.send_expect('brctl addbr "br_kni"', "# ")
-
-            for virtual_interace in port_virtual_interaces:
-                out = self.dut.send_expect(
-                    "brctl addif br_kni %s" % virtual_interace, "# "
-                )
-                self.verify("ERROR" not in out, "Device not found")
-
-            self.dut.send_expect("ifconfig br_kni up", "# ")
-
-            tx_port = self.tester.get_local_port(self.config["ports"][0])
-            rx_port = self.tester.get_local_port(self.config["ports"][1])
-
-            tgenInput = []
-            tgenInput.append((tx_port, rx_port, pcap))
-
-            if step["flows"] == 2:
-                tgenInput.append((rx_port, tx_port, pcap))
-            self.verify(self.dut.is_interface_up(intf="br_kni"), "br_kni should be up")
-
-            # clear streams before add new streams
-            self.tester.pktgen.clear_streams()
-            # run packet generator
-            streams = self.pktgen_helper.prepare_stream_from_tginput(
-                tgenInput, 100, None, self.tester.pktgen
-            )
-            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
-            step["pps"] = float(pps) / 10**6
-
-            results_row = [
-                step["kthread_mode"],
-                step["flows"],
-                self.stripped_config_param(),
-                (float(pps) / 10**6),
-            ]
-
-            self.result_table_add(results_row)
-
-            self.dut.send_expect("ifconfig br_kni down", "# ")
-            self.dut.send_expect('brctl delbr "br_kni"', "# ", 10)
-
-        self.result_table_print()
-
-    def test_perf_bridge_without_kni(self):
-        """
-        Bridge mode performance without KNI.
-        """
-        self.result_table_create(bridge_perf_no_kni_results_header)
-
-        self.dut.kill_all()
-
-        dut_ports = self.dut.get_ports(self.nic)
-
-        self.tester.scapy_append('srcmac="00:00:00:00:00:01"')
-        pcap = os.sep.join([self.output_path, "kni.pcap"])
-        self.tester.scapy_append(
-            'wrpcap("%s", [Ether(src=srcmac, dst="ff:ff:ff:ff:ff:ff")/IP(len=46)/UDP()/("X"*18)])'
-            % pcap
-        )
-        self.tester.scapy_execute()
-
-        allow_list = self.make_allow_list(self.target, self.nic)
-        port_virtual_interaces = []
-        for port in allow_list:
-            information = self.dut.send_expect(
-                "./usertools/dpdk-devbind.py --status | grep '%s'" % port, "# "
-            )
-            data = information.split(" ")
-            for field in data:
-                if field.rfind("if=") != -1:
-                    port_virtual_interaces.append(field.replace("if=", ""))
-
-        self.dut.send_expect("ifconfig %s up" % port_virtual_interaces[0], "# ")
-        self.dut.send_expect("ifconfig %s up" % port_virtual_interaces[1], "# ")
-        self.dut.send_expect('brctl addbr "br1"', "# ")
-        self.dut.send_expect("brctl addif br1 %s" % port_virtual_interaces[0], "# ")
-        self.dut.send_expect("brctl addif br1 %s" % port_virtual_interaces[1], "# ")
-        self.dut.send_expect("ifconfig br1 up", "# ")
-        time.sleep(3)
-
-        tx_port = self.tester.get_local_port(dut_ports[0])
-        rx_port = self.tester.get_local_port(dut_ports[1])
-
-        for flows in range(1, flows_without_kni + 1):
-            tgen_input = []
-            tgen_input.append((tx_port, rx_port, pcap))
-
-            if flows == 2:
-                tgen_input.append((rx_port, tx_port, pcap))
-
-            # clear streams before add new streams
-            self.tester.pktgen.clear_streams()
-            # run packet generator
-            streams = self.pktgen_helper.prepare_stream_from_tginput(
-                tgen_input, 100, None, self.tester.pktgen
-            )
-            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
-
-            self.result_table_add([flows, float(pps) / 10**6])
-
-        self.dut.send_expect("ifconfig br1 down", "# ")
-        self.dut.send_expect('brctl delbr "br1"', "# ", 30)
-
-        for port in allow_list:
-            self.dut.send_expect(
-                "./usertools/dpdk-devbind.py -b igb_uio %s" % (port), "# "
-            )
-        self.result_table_print()
-
-    def test_perf_routing(self):
-        """
-        Routing performance.
-        """
-
-        header = routing_perf_results_header
-
-        for size in packet_sizes_routing:
-            header.append("%d Mpps" % size)
-
-        self.result_table_create(header)
-
-        self.dut.send_expect("echo 1 > /proc/sys/net/ipv4/ip_forward", "# ")
-
-        # Run the test steps
-        for step in routing_performance_steps:
-            self.extract_ports_cores_config(step["config"])
-
-            resutls_row = [
-                step["kthread_mode"],
-                len(self.config["ports"]),
-                self.stripped_config_param(),
-            ]
-
-            self.dut.kill_all()
-            self.start_kni()
-
-            # Set up the IP addresses, routes and arp entries of the virtual
-            # interfaces
-            virtual_interaces = {}
-            ip_subnet = 0
-            for port in self.config["port_details"]:
-
-                port_number = port["port"]
-
-                # Get the virtual interfaces base on the number of kernel
-                # lcores
-                port_virtual_interaces = []
-                for i in range(len(port["kernel_cores"])):
-                    port_virtual_interaces.append(
-                        self.virtual_interface_name(port_number, i)
-                    )
-
-                virtual_interaces[port_number] = port_virtual_interaces
-
-                # Setup IP, ARP and route for each virtual interface
-                for interface in range(len(virtual_interaces[port_number])):
-                    tx_port = self.tester.get_local_port(port_number)
-
-                    self.dut.send_expect(
-                        "ifconfig %s 192.170.%d.1"
-                        % (virtual_interaces[port_number][interface], ip_subnet),
-                        "# ",
-                    )
-                    self.dut.send_expect(
-                        "route add -net 192.170.%d.0  netmask 255.255.255.0 gw 192.170.%d.1"
-                        % (ip_subnet, ip_subnet),
-                        "# ",
-                    )
-                    self.dut.send_expect(
-                        "arp -s 192.170.%d.2 %s"
-                        % (ip_subnet, self.tester.get_mac(tx_port)),
-                        "# ",
-                    )
-                    ip_subnet += 1
-
-            # Get performance for each frame size
-            for packet_size in packet_sizes_routing:
-                payload_size = packet_size - 38
-                tgen_input = []
-
-                # Test one port
-                tx_port = self.tester.get_local_port(self.config["ports"][0])
-                rx_mac = self.dut.get_mac_address(self.config["ports"][0])
-
-                port_iterator = 0
-                cnt = 0
-                for port in self.config["port_details"]:
-                    port_number = port["port"]
-
-                    rx_mac = self.dut.get_mac_address(port_number)
-                    tx_port = self.tester.get_local_port(port_number)
-
-                    num_interfaces_per_port = len(virtual_interaces[port_number])
-
-                    # Set flows from and to virtual interfaces in the same port
-                    src_ip_subnet = port_iterator * num_interfaces_per_port
-                    for interface in range(len(virtual_interaces[port_number])):
-                        dst_ip_subnet = (src_ip_subnet + 1) % num_interfaces_per_port
-                        dst_ip_subnet += port_iterator * num_interfaces_per_port
-                        self.tester.scapy_append("flows = []")
-                        self.tester.scapy_append(
-                            'flows.append(Ether(dst="%s")/IP(src="192.170.%d.2",dst="192.170.%d.2")/("X"*%d))'
-                            % (rx_mac, src_ip_subnet, dst_ip_subnet, payload_size)
-                        )
-                        src_ip_subnet += 1
-                        pcap = os.sep.join(
-                            [self.output_path, "routePerf_{0}.pcap".format(cnt)]
-                        )
-                        self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
-                        self.tester.scapy_execute()
-                        tgen_input.append((tx_port, tx_port, pcap))
-                        cnt += 1
-                        time.sleep(1)
-
-                # clear streams before add new streams
-                self.tester.pktgen.clear_streams()
-                # run packet generator
-                streams = self.pktgen_helper.prepare_stream_from_tginput(
-                    tgen_input, 100, None, self.tester.pktgen
-                )
-                _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
-
-                resutls_row.append(float(pps) / 10**6)
-
-            self.result_table_add(resutls_row)
-
-        self.result_table_print()
-
-    def test_perf_routing_without_kni(self):
-        """
-        Routing performance without KNI.
-        """
-
-        header = routing_perf_no_kni_results_header
-
-        for size in packet_sizes_routing:
-            header.append("%d Mpps" % size)
-
-        self.result_table_create(header)
-
-        self.dut.kill_all()
-        self.dut.send_expect("rmmod rte_kni", "# ", 20)
-
-        self.dut.send_expect("systemctl stop NetworkManager.service", "# ")
-
-        dut_ports = self.dut.get_ports(self.nic)
-
-        allow_list = self.make_allow_list(self.target, self.nic)
-        port_virtual_interaces = []
-
-        for port in allow_list:
-
-            # Enables the interfaces
-            information = self.dut.send_expect(
-                "./usertools/dpdk-devbind.py --status | grep '%s'" % port, "# "
-            )
-            data = information.split(" ")
-            for field in data:
-                if field.rfind("if=") != -1:
-                    interface_aux = field.replace("if=", "")
-                    port_virtual_interaces.append(interface_aux)
-                    self.dut.send_expect("ifconfig %s up" % interface_aux, "# ")
-
-        self.dut.send_expect("echo 1 > /proc/sys/net/ipv4/ip_forward", "# ")
-
-        for port in range(0, ports_without_kni):
-            tx_port = self.tester.get_local_port(dut_ports[port])
-            self.dut.send_expect(
-                "ifconfig %s 192.170.%d.1 up"
-                % (port_virtual_interaces[port], port + 100),
-                "# ",
-            )
-            self.dut.send_expect(
-                "route add -net 192.170.%d.0  netmask 255.255.255.0 gw 192.170.%d.1"
-                % (port + 100, port + 100),
-                "# ",
-            )
-            self.dut.send_expect(
-                "arp -s 192.170.%d.2 %s" % (port + 100, self.tester.get_mac(tx_port)),
-                "# ",
-            )
-
-        one_port_resutls_row = [1]
-        two_port_resutls_row = [2]
-        for packet_size in packet_sizes_routing:
-
-            payload_size = packet_size - 38
-            tgen_input = []
-
-            # Prepare test with 1 port
-            tx_port = self.tester.get_local_port(dut_ports[0])
-            rx_mac = self.dut.get_mac_address(dut_ports[0])
-            self.tester.scapy_append("flows = []")
-            self.tester.scapy_append(
-                'flows.append(Ether(dst="%s")/IP(src="192.170.100.2",dst="192.170.100.2")/("X"*%d))'
-                % (rx_mac, payload_size)
-            )
-            pcap = os.sep.join([self.output_path, "routePerf_1.pcap"])
-            self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
-            self.tester.scapy_execute()
-
-            tgen_input = []
-            tgen_input.append((tx_port, tx_port, pcap))
-
-            # Get throughput with 1 port
-
-            # clear streams before add new streams
-            self.tester.pktgen.clear_streams()
-            # run packet generator
-            streams = self.pktgen_helper.prepare_stream_from_tginput(
-                tgen_input, 100, None, self.tester.pktgen
-            )
-            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
-
-            one_port_resutls_row.append(float(pps) / 10**6)
-            self.result_table_add(one_port_resutls_row)
-
-            # Prepare test with 'ports_without_kni' ports
-            cnt = 0
-            for port in range(ports_without_kni):
-                rx_mac = self.dut.get_mac_address(dut_ports[port])
-                tx_port = self.tester.get_local_port(dut_ports[port])
-                self.tester.scapy_append("flows = []")
-                self.tester.scapy_append(
-                    'flows.append(Ether(dst="%s")/IP(src="192.170.%d.2",dst="192.170.%d.2")/("X"*%d))'
-                    % (
-                        rx_mac,
-                        100 + port,
-                        100 + (port + 1) % ports_without_kni,
-                        payload_size,
-                    )
-                )
-                pcap = os.sep.join(
-                    [
-                        self.output_path,
-                        "routePerf_{0}_{1}.pcap".format(ports_without_kni, cnt),
-                    ]
-                )
-                tgen_input.append((tx_port, tx_port, pcap))
-                self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
-                self.tester.scapy_execute()
-                cnt += 1
-
-            # Get throughput with 'ports_without_kni' ports
-            # clear streams before add new streams
-            self.tester.pktgen.clear_streams()
-            # run packet generator
-            streams = self.pktgen_helper.prepare_stream_from_tginput(
-                tgen_input, 100, None, self.tester.pktgen
-            )
-            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
-
-            two_port_resutls_row.append(float(pps) / 10**6)
-            self.result_table_add(two_port_resutls_row)
-
-        self.result_table_print()
-
-        for port in allow_list:
-            self.dut.send_expect(
-                "./usertools/dpdk-devbind.py -b %s %s" % (self.drivername, port), "# "
-            )
-
     def tear_down(self):
         """
         Run after each test case.
diff --git a/tests/TestSuite_perf_kni.py b/tests/TestSuite_perf_kni.py
new file mode 100644
index 00000000..52ee5a85
--- /dev/null
+++ b/tests/TestSuite_perf_kni.py
@@ -0,0 +1,1191 @@ 
+# SPDX-License-Identifier: BSD-3-Clause
+# Copyright(c) 2010-2019 Intel Corporation
+#
+
+"""
+DPDK Test suite.
+
+Test Kernel NIC Interface.
+"""
+
+import os
+import re
+import time
+from random import randint
+
+import framework.packet as packet
+import framework.utils as utils
+from framework.pktgen import PacketGeneratorHelper
+from framework.test_case import TestCase
+
+dut_ports = []
+port_virtual_interaces = []
+
+ports_without_kni = 2
+flows_without_kni = 2
+
+packet_sizes_loopback = [64, 256]
+packet_sizes_routing = [64, 256]
+
+ports_cores_template = (
+    "\(P([0123]),(C\{\d.\d.\d\}),(C\{\d.\d.\d\}),(C\{\d.\d.\d\}),?(C\{\d.\d.\d\})?\),?"
+)
+
+default_1_port_cores_config = "(P0,C{1.0.0},C{1.1.0},C{1.2.0})"
+default_2_port_cores_config = (
+    "(P0,C{1.0.0},C{1.1.0},C{1.2.0}),(P1,C{1.3.0},C{1.4.0},C{1.5.0})"
+)
+
+stress_test_iterations = 50
+stress_test_random_iterations = 50
+
+routing_performance_steps = [
+    {"kthread_mode": "single", "config": "(P0,C{1.0.0},C{1.1.0},C{1.0.1})"},
+    {"kthread_mode": "single", "config": "(P0,C{1.0.0},C{1.0.1},C{1.1.0})"},
+    {"kthread_mode": "single", "config": "(P0,C{1.0.0},C{1.1.0},C{1.2.0})"},
+    {
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.0.1})",
+    },
+    {
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.4.0})",
+    },
+    {
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.2.0})",
+    },
+    {
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.0.1})",
+    },
+    {
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.4.0})",
+    },
+    {
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.2.0})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.3.0})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.3.0})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.2.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.2.1})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.5.0})",
+    },
+    {
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0},C{1.6.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0},C{1.7.0})",
+    },
+]
+
+bridge_performance_steps = [
+    {
+        "flows": 1,
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.0.1})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.4.0})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.2.0})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.0.1})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.4.0})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.2.0})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.3.0})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.3.0})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.2.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.2.1})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.5.0})",
+    },
+    {
+        "flows": 1,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0},C{1.6.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0},C{1.7.0})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.2.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.2.1})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.5.0})",
+    },
+    {
+        "flows": 2,
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0},C{1.6.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0},C{1.7.0})",
+    },
+]
+
+loopback_performance_steps = [
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.0.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.1.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.2.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.0.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.4.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.2.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.0.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.1.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.2.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.3.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.2.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.3.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.1.1},C{1.5.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0},C{1.6.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0},C{1.7.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.0.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.1.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.2.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.0.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.4.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "single",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.2.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.0.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.1.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.1.0},C{1.2.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.0.1}),(P1,C{1.1.0},C{1.3.0},C{1.1.1})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.0.1},C{1.2.0}),(P1,C{1.1.0},C{1.1.1},C{1.3.0})",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "multiple",
+        "config": "(P0,C{1.0.0},C{1.2.0},C{1.4.0}),(P1,C{1.1.0},C{1.3.0},C{1.5.0})",
+    },
+]
+
+loopback_perf_results_header = ["lo_mode", "kthread_mode", "Ports", "Config"]
+bridge_perf_results_header = ["kthread_mode", "Flows", "Config", "64 Mpps"]
+bridge_perf_no_kni_results_header = ["Flows", "64 Mpps"]
+routing_perf_results_header = ["kthread_mode", "Ports", "Config"]
+routing_perf_no_kni_results_header = ["Ports"]
+
+stress_modes_output = [
+    {
+        "lo_mode": None,
+        "kthread_mode": None,
+        "output": "loopback disabled.*DPDK kni module loaded.*Single kernel thread",
+    },
+    {
+        "lo_mode": "lo_mode_none",
+        "kthread_mode": None,
+        "output": "loopback disabled.*DPDK kni module loaded.*Single kernel thread",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": None,
+        "output": "loopback mode=lo_mode_fifo enabled.*Single kernel thread",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": None,
+        "output": "loopback mode=lo_mode_fifo_skb enabled.*Single kernel thread",
+    },
+    {
+        "lo_mode": "lo_mode_random",
+        "kthread_mode": None,
+        "output": "Incognizant parameter, loopback disabled.*DPDK kni module loaded.*Single kernel thread",
+    },
+    {
+        "lo_mode": None,
+        "kthread_mode": "single",
+        "output": "loopback disabled.*DPDK kni module loaded.*Single kernel thread",
+    },
+    {
+        "lo_mode": None,
+        "kthread_mode": "multiple",
+        "output": "loopback disabled.*DPDK kni module loaded.*Multiple kernel thread",
+    },
+    {
+        "lo_mode": None,
+        "kthread_mode": "singlemulti",
+        "output": "KNI.* Invalid parameter for kthread_mode",
+    },
+    {
+        "lo_mode": "lo_mode_fifo",
+        "kthread_mode": "multiple",
+        "output": "loopback mode=lo_mode_fifo enabled.*Multiple kernel thread",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "multiple",
+        "output": "loopback mode=lo_mode_fifo_skb enabled.*Multiple kernel thread",
+    },
+    {
+        "lo_mode": "lo_mode_fifo_skb",
+        "kthread_mode": "singlemulti",
+        "output": "Invalid parameter for kthread_mode",
+    },
+    {
+        "lo_mode": "lo_mode_random",
+        "kthread_mode": "multiple",
+        "output": "KNI.* Incognizant parameter, loopback disabled",
+    },
+]
+
+#
+#
+# Test class.
+#
+
+
+class TestKni(TestCase):
+
+    #
+    #
+    # Utility methods and other non-test code.
+    #
+    # Insert or move non-test functions here.
+
+    def set_up_all(self):
+        """
+        Run at the start of each test suite.
+
+        KNI Prerequisites
+        """
+        out = self.dut.send_expect("which brctl", "# ")
+        self.verify(
+            "no brctl" not in out,
+            "The linux tool brctl is needed to run this test suite",
+        )
+
+        out = self.dut.build_dpdk_apps("./examples/kni")
+        self.app_kni_path = self.dut.apps_name["kni"]
+        self.verify("Error" not in out, "Compilation failed")
+        p0_pci = self.dut.ports_info[0]["pci"]
+        numa_node = int(
+            self.dut.send_expect(
+                "cat /sys/bus/pci/devices/%s/numa_node" % p0_pci, "# ", 30
+            )
+        )
+        socket_id = numa_node if numa_node > 0 else 0
+        if socket_id == 0:
+            global default_1_port_cores_config
+            global default_2_port_cores_config
+            global routing_performance_steps
+            global bridge_performance_steps
+            global loopback_performance_steps
+
+            default_1_port_cores_config = default_1_port_cores_config.replace(
+                "C{1.", "C{0."
+            )
+            default_2_port_cores_config = default_1_port_cores_config.replace(
+                "C{1.", "C{0."
+            )
+            for i in range(len(routing_performance_steps)):
+                routing_performance_steps[i]["config"] = routing_performance_steps[i][
+                    "config"
+                ].replace("C{1.", "C{0.")
+            for j in range(len(bridge_performance_steps)):
+                bridge_performance_steps[j]["config"] = bridge_performance_steps[j][
+                    "config"
+                ].replace("C{1.", "C{0.")
+            for k in range(len(loopback_performance_steps)):
+                loopback_performance_steps[k]["config"] = loopback_performance_steps[k][
+                    "config"
+                ].replace("C{1.", "C{0.")
+
+        self.extract_ports_cores_config(default_1_port_cores_config)
+        out = self.start_kni()
+        self.verify("Error" not in out, "Error found during kni start")
+        out = self.dut.send_expect("cat /etc/os-release", "# ")
+        if "Ubuntu" in out:
+            self.dut.send_expect("ufw disable", "# ")
+        else:
+            self.dut.send_expect("service iptables stop", "# ")
+            self.dut.send_expect("service firewalld stop", "# ")
+
+        # get dts output path
+        if self.logger.log_path.startswith(os.sep):
+            self.output_path = self.logger.log_path
+        else:
+            cur_path = os.path.dirname(os.path.dirname(os.path.realpath(__file__)))
+            self.output_path = os.sep.join([cur_path, self.logger.log_path])
+        # create an instance to set stream field setting
+        self.pktgen_helper = PacketGeneratorHelper()
+        # enable dut ipv6
+        self.dut.enable_ipv6("all")
+
+    def set_up(self):
+        """
+        Run before each test case.
+        """
+        pass
+
+    def start_kni(self, lo_mode=None, kthread_mode=None):
+        """
+        Insert the igb_uio and rte_kni modules with passed parameters and launch
+        kni application.
+        """
+        module_param = ""
+        if lo_mode is not None:
+            module_param += "lo_mode=%s " % lo_mode
+
+        if kthread_mode is not None:
+            module_param += "kthread_mode=%s" % kthread_mode
+        self.dut.kill_all()
+        out = self.dut.send_expect("rmmod rte_kni", "# ", 10)
+        self.verify("in use" not in out, "Error unloading KNI module: " + out)
+        if self.drivername == "igb_uio":
+            self.dut.send_expect("rmmod igb_uio", "# ", 5)
+            self.dut.send_expect(
+                "insmod ./%s/kmod/igb_uio.ko" % (self.target), "# ", 20
+            )
+        self.dut.bind_interfaces_linux(self.drivername)
+        out = self.dut.send_expect(
+            "insmod ./%s/kmod/rte_kni.ko %s" % (self.target, module_param), "# ", 10
+        )
+
+        self.verify("Error" not in out, "Error loading KNI module: " + out)
+
+        port_mask = utils.create_mask(self.config["ports"])
+        core_mask = utils.create_mask(
+            self.config["rx_cores"]
+            + self.config["tx_cores"]
+            + self.config["kernel_cores"]
+        )
+
+        config_param = self.build_config_param()
+
+        eal_para = self.dut.create_eal_parameters(
+            cores=self.config["rx_cores"]
+            + self.config["tx_cores"]
+            + self.config["kernel_cores"]
+        )
+        out_kni = self.dut.send_expect(
+            "./%s %s -- -P -p %s %s -m &"
+            % (self.app_kni_path, eal_para, port_mask, config_param),
+            "Link [Uu]p",
+            20,
+        )
+
+        time.sleep(5)
+        if kthread_mode == "single":
+            kthread_mask = utils.create_mask(self.config["kernel_cores"])
+            out = self.dut.send_expect(
+                "taskset -p `pgrep -fl kni_single | awk '{print $1}'`", "#"
+            )
+            self.verify("current affinity mask" in out, "Unable to set core affinity")
+
+        return out_kni
+
+    def extract_ports_cores_config(self, ports_cores_config):
+        """
+        Parses a ports/cores configuration string into the 'self.config' variable.
+        """
+        ports_cores_pattern = re.compile(ports_cores_template)
+        port_configs = ports_cores_pattern.findall(ports_cores_config)
+        dut_ports = self.dut.get_ports(self.nic)
+
+        config = {}
+        ports = []
+        rx_cores = []
+        tx_cores = []
+        k_cores = []
+        port_details = []
+        for port_config in port_configs:
+            details = {}
+
+            port_number = int(port_config[0])
+            self.verify(port_number < len(dut_ports), "Not enough ports available")
+
+            ports.append(dut_ports[port_number])
+            details["port"] = dut_ports[port_number]
+            rx_cores.append(self.dut.get_lcore_id(port_config[1]))
+            details["rx_core"] = self.dut.get_lcore_id(port_config[1])
+            tx_cores.append(self.dut.get_lcore_id(port_config[2]))
+            details["tx_core"] = self.dut.get_lcore_id(port_config[2])
+
+            details["kernel_cores"] = []
+            for k_core in port_config[3:]:
+                if k_core != "":
+                    k_cores.append(self.dut.get_lcore_id(k_core))
+                    details["kernel_cores"].append(self.dut.get_lcore_id(k_core))
+
+            port_details.append(details)
+
+        config["ports"] = ports
+        config["rx_cores"] = rx_cores
+        config["tx_cores"] = tx_cores
+        config["kernel_cores"] = k_cores
+        config["port_details"] = port_details
+
+        self.config = config
+
+    def build_config_param(self):
+        """
+        Formats the '--conf=(xxx)' parameter for kni application calls
+        """
+        config_param = '--config="%s'
+        port_cores = "(%s,%s,%s)"
+        port_cores_kernel = "(%s,%s,%s,"
+
+        for port in self.config["port_details"]:
+
+            # Kernel threads specified
+            if len(port["kernel_cores"]) > 0:
+
+                port_config = port_cores_kernel % (
+                    port["port"],
+                    port["rx_core"],
+                    port["tx_core"],
+                )
+
+                for core in port["kernel_cores"]:
+                    port_config += str(core) + ","
+
+                port_config = port_config[:-1] + ")"
+
+            # No kernel threads specified
+            else:
+                port_config = port_cores % (
+                    port["port"],
+                    port["rx_core"],
+                    port["tx_core"],
+                )
+
+            config_param = config_param % port_config + ",%s"
+
+        config_param = config_param.replace(",%s", '"')
+
+        return config_param
+
+    def stripped_config_param(self):
+        """
+        Removes the '--config=' prefix from the config string.
+        Used for reporting.
+        """
+        config_param = self.build_config_param()
+        config_param = config_param.replace('--config="', "")
+        config_param = config_param.replace('"', "")
+        return config_param
+
+    def virtual_interface_name(self, port, sub_port=0):
+        """
+        Given a port and subport name, formats the virtual interface name.
+        """
+        return "vEth%d_%d" % (port, sub_port)
+
+    def dut_physical_cores(self):
+        """
+        Returns the number of physical cores in socket 0.
+        """
+        dut_cores = self.dut.get_all_cores()
+
+        first_core = dut_cores[0]
+        cores = []
+
+        for core in dut_cores[1:]:
+            if core["core"] not in cores and core["socket"] == first_core["socket"]:
+                cores.append(core["core"])
+
+        return len(cores)
+
+    def make_allow_list(self, target, nic):
+        """
+        Create allow list with ports.
+        """
+        allow_list = []
+        dut_ports = self.dut.get_ports(self.nic)
+        self.dut.restore_interfaces()
+        allPort = self.dut.ports_info
+        if self.drivername in ["igb_uio"]:
+            self.dut.send_expect("insmod ./" + self.target + "/kmod/igb_uio.ko", "#")
+        for port in range(0, len(allPort)):
+            if port in dut_ports:
+                allow_list.append(allPort[port]["pci"])
+        return allow_list
+
+    #
+    #
+    #
+    # Test cases.
+    #
+
+    def test_perf_loopback(self):
+        """
+        KNI loopback performance
+        """
+        self.dut.kill_all()
+
+        header = loopback_perf_results_header
+        for size in packet_sizes_loopback:
+            header.append("%d (pps)" % size)
+
+        self.result_table_create(header)
+
+        # Execute the permutations of the test
+        for step in loopback_performance_steps:
+
+            self.extract_ports_cores_config(step["config"])
+
+            total_cores = len(
+                self.config["tx_cores"]
+                + self.config["rx_cores"]
+                + self.config["kernel_cores"]
+            )
+            if total_cores > self.dut_physical_cores():
+                self.logger.info(
+                    "Skipping step %s (%d cores needed, got %d)"
+                    % (step["config"], total_cores, self.dut_physical_cores())
+                )
+                continue
+
+            self.start_kni(lo_mode=step["lo_mode"], kthread_mode=step["kthread_mode"])
+
+            pps_results = []
+
+            for size in packet_sizes_loopback:
+
+                payload_size = size - 38
+
+                ports_number = len(self.config["ports"])
+
+                # Set up the flows for the ports
+                tgen_input = []
+                for port in self.config["ports"]:
+
+                    rx_mac = self.dut.get_mac_address(port)
+                    tx_port = self.tester.get_local_port(port)
+                    self.tester.scapy_append('dstmac = "%s"' % rx_mac)
+                    self.tester.scapy_append(
+                        'flows = [Ether(dst=dstmac)/IP()/("X"*%d)]' % payload_size
+                    )
+                    pcap = os.sep.join(
+                        [self.output_path, "tester{0}.pcap".format(tx_port)]
+                    )
+                    self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
+                    self.tester.scapy_execute()
+                    tgen_input.append((tx_port, tx_port, pcap))
+
+                time.sleep(1)
+
+                # clear streams before add new streams
+                self.tester.pktgen.clear_streams()
+                # run packet generator
+                streams = self.pktgen_helper.prepare_stream_from_tginput(
+                    tgen_input, 100, None, self.tester.pktgen
+                )
+                _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
+
+                pps_results.append(float(pps) / 1000000)
+
+            ports_number = len(self.config["ports"])
+            results_row = [
+                step["lo_mode"],
+                step["kthread_mode"],
+                ports_number,
+                self.stripped_config_param(),
+            ] + pps_results
+            self.result_table_add(results_row)
+
+            self.dut.kill_all()
+
+        self.result_table_print()
+
+    def test_perf_bridge(self):
+        """
+        KNI performance bridge mode.
+        """
+        self.result_table_create(bridge_perf_results_header)
+
+        self.tester.scapy_append('srcmac="00:00:00:00:00:01"')
+        pcap = os.sep.join([self.output_path, "kni.pcap"])
+        self.tester.scapy_append(
+            'wrpcap("%s", [Ether(src=srcmac, dst="ff:ff:ff:ff:ff:ff")/IP(len=46)/UDP()/("X"*18)])'
+            % pcap
+        )
+        self.tester.scapy_execute()
+
+        for step in bridge_performance_steps:
+
+            self.extract_ports_cores_config(step["config"])
+
+            total_cores = len(
+                self.config["tx_cores"]
+                + self.config["rx_cores"]
+                + self.config["kernel_cores"]
+            )
+            if total_cores > self.dut_physical_cores():
+                self.logger.info(
+                    "Skipping step %s (%d cores needed, got %d)"
+                    % (step["config"], total_cores, self.dut_physical_cores())
+                )
+                continue
+
+            port_virtual_interaces = []
+            for port in self.config["port_details"]:
+                for i in range(len(port["kernel_cores"])):
+                    port_virtual_interaces.append(
+                        self.virtual_interface_name(port["port"], i)
+                    )
+
+            self.dut.kill_all()
+            self.start_kni(lo_mode=None, kthread_mode=step["kthread_mode"])
+
+            for virtual_interace in port_virtual_interaces:
+                out = self.dut.send_expect("ifconfig %s up" % virtual_interace, "# ")
+                self.verify("ERROR" not in out, "Virtual interface not found")
+
+            self.dut.send_expect('brctl addbr "br_kni"', "# ")
+
+            for virtual_interace in port_virtual_interaces:
+                out = self.dut.send_expect(
+                    "brctl addif br_kni %s" % virtual_interace, "# "
+                )
+                self.verify("ERROR" not in out, "Device not found")
+
+            self.dut.send_expect("ifconfig br_kni up", "# ")
+
+            tx_port = self.tester.get_local_port(self.config["ports"][0])
+            rx_port = self.tester.get_local_port(self.config["ports"][1])
+
+            tgenInput = []
+            tgenInput.append((tx_port, rx_port, pcap))
+
+            if step["flows"] == 2:
+                tgenInput.append((rx_port, tx_port, pcap))
+            self.verify(self.dut.is_interface_up(intf="br_kni"), "br_kni should be up")
+
+            # clear streams before add new streams
+            self.tester.pktgen.clear_streams()
+            # run packet generator
+            streams = self.pktgen_helper.prepare_stream_from_tginput(
+                tgenInput, 100, None, self.tester.pktgen
+            )
+            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
+            step["pps"] = float(pps) / 10**6
+
+            results_row = [
+                step["kthread_mode"],
+                step["flows"],
+                self.stripped_config_param(),
+                (float(pps) / 10**6),
+            ]
+
+            self.result_table_add(results_row)
+
+            self.dut.send_expect("ifconfig br_kni down", "# ")
+            self.dut.send_expect('brctl delbr "br_kni"', "# ", 10)
+
+        self.result_table_print()
+
+    def test_perf_bridge_without_kni(self):
+        """
+        Bridge mode performance without KNI.
+        """
+        self.result_table_create(bridge_perf_no_kni_results_header)
+
+        self.dut.kill_all()
+
+        dut_ports = self.dut.get_ports(self.nic)
+
+        self.tester.scapy_append('srcmac="00:00:00:00:00:01"')
+        pcap = os.sep.join([self.output_path, "kni.pcap"])
+        self.tester.scapy_append(
+            'wrpcap("%s", [Ether(src=srcmac, dst="ff:ff:ff:ff:ff:ff")/IP(len=46)/UDP()/("X"*18)])'
+            % pcap
+        )
+        self.tester.scapy_execute()
+
+        allow_list = self.make_allow_list(self.target, self.nic)
+        port_virtual_interaces = []
+        for port in allow_list:
+            information = self.dut.send_expect(
+                "./usertools/dpdk-devbind.py --status | grep '%s'" % port, "# "
+            )
+            data = information.split(" ")
+            for field in data:
+                if field.rfind("if=") != -1:
+                    port_virtual_interaces.append(field.replace("if=", ""))
+
+        self.dut.send_expect("ifconfig %s up" % port_virtual_interaces[0], "# ")
+        self.dut.send_expect("ifconfig %s up" % port_virtual_interaces[1], "# ")
+        self.dut.send_expect('brctl addbr "br1"', "# ")
+        self.dut.send_expect("brctl addif br1 %s" % port_virtual_interaces[0], "# ")
+        self.dut.send_expect("brctl addif br1 %s" % port_virtual_interaces[1], "# ")
+        self.dut.send_expect("ifconfig br1 up", "# ")
+        time.sleep(3)
+
+        tx_port = self.tester.get_local_port(dut_ports[0])
+        rx_port = self.tester.get_local_port(dut_ports[1])
+
+        for flows in range(1, flows_without_kni + 1):
+            tgen_input = []
+            tgen_input.append((tx_port, rx_port, pcap))
+
+            if flows == 2:
+                tgen_input.append((rx_port, tx_port, pcap))
+
+            # clear streams before add new streams
+            self.tester.pktgen.clear_streams()
+            # run packet generator
+            streams = self.pktgen_helper.prepare_stream_from_tginput(
+                tgen_input, 100, None, self.tester.pktgen
+            )
+            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
+
+            self.result_table_add([flows, float(pps) / 10**6])
+
+        self.dut.send_expect("ifconfig br1 down", "# ")
+        self.dut.send_expect('brctl delbr "br1"', "# ", 30)
+
+        for port in allow_list:
+            self.dut.send_expect(
+                "./usertools/dpdk-devbind.py -b igb_uio %s" % (port), "# "
+            )
+        self.result_table_print()
+
+    def test_perf_routing(self):
+        """
+        Routing performance.
+        """
+
+        header = routing_perf_results_header
+
+        for size in packet_sizes_routing:
+            header.append("%d Mpps" % size)
+
+        self.result_table_create(header)
+
+        self.dut.send_expect("echo 1 > /proc/sys/net/ipv4/ip_forward", "# ")
+
+        # Run the test steps
+        for step in routing_performance_steps:
+            self.extract_ports_cores_config(step["config"])
+
+            resutls_row = [
+                step["kthread_mode"],
+                len(self.config["ports"]),
+                self.stripped_config_param(),
+            ]
+
+            self.dut.kill_all()
+            self.start_kni()
+
+            # Set up the IP addresses, routes and arp entries of the virtual
+            # interfaces
+            virtual_interaces = {}
+            ip_subnet = 0
+            for port in self.config["port_details"]:
+
+                port_number = port["port"]
+
+                # Get the virtual interfaces base on the number of kernel
+                # lcores
+                port_virtual_interaces = []
+                for i in range(len(port["kernel_cores"])):
+                    port_virtual_interaces.append(
+                        self.virtual_interface_name(port_number, i)
+                    )
+
+                virtual_interaces[port_number] = port_virtual_interaces
+
+                # Setup IP, ARP and route for each virtual interface
+                for interface in range(len(virtual_interaces[port_number])):
+                    tx_port = self.tester.get_local_port(port_number)
+
+                    self.dut.send_expect(
+                        "ifconfig %s 192.170.%d.1"
+                        % (virtual_interaces[port_number][interface], ip_subnet),
+                        "# ",
+                    )
+                    self.dut.send_expect(
+                        "route add -net 192.170.%d.0  netmask 255.255.255.0 gw 192.170.%d.1"
+                        % (ip_subnet, ip_subnet),
+                        "# ",
+                    )
+                    self.dut.send_expect(
+                        "arp -s 192.170.%d.2 %s"
+                        % (ip_subnet, self.tester.get_mac(tx_port)),
+                        "# ",
+                    )
+                    ip_subnet += 1
+
+            # Get performance for each frame size
+            for packet_size in packet_sizes_routing:
+                payload_size = packet_size - 38
+                tgen_input = []
+
+                # Test one port
+                tx_port = self.tester.get_local_port(self.config["ports"][0])
+                rx_mac = self.dut.get_mac_address(self.config["ports"][0])
+
+                port_iterator = 0
+                cnt = 0
+                for port in self.config["port_details"]:
+                    port_number = port["port"]
+
+                    rx_mac = self.dut.get_mac_address(port_number)
+                    tx_port = self.tester.get_local_port(port_number)
+
+                    num_interfaces_per_port = len(virtual_interaces[port_number])
+
+                    # Set flows from and to virtual interfaces in the same port
+                    src_ip_subnet = port_iterator * num_interfaces_per_port
+                    for interface in range(len(virtual_interaces[port_number])):
+                        dst_ip_subnet = (src_ip_subnet + 1) % num_interfaces_per_port
+                        dst_ip_subnet += port_iterator * num_interfaces_per_port
+                        self.tester.scapy_append("flows = []")
+                        self.tester.scapy_append(
+                            'flows.append(Ether(dst="%s")/IP(src="192.170.%d.2",dst="192.170.%d.2")/("X"*%d))'
+                            % (rx_mac, src_ip_subnet, dst_ip_subnet, payload_size)
+                        )
+                        src_ip_subnet += 1
+                        pcap = os.sep.join(
+                            [self.output_path, "routePerf_{0}.pcap".format(cnt)]
+                        )
+                        self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
+                        self.tester.scapy_execute()
+                        tgen_input.append((tx_port, tx_port, pcap))
+                        cnt += 1
+                        time.sleep(1)
+
+                # clear streams before add new streams
+                self.tester.pktgen.clear_streams()
+                # run packet generator
+                streams = self.pktgen_helper.prepare_stream_from_tginput(
+                    tgen_input, 100, None, self.tester.pktgen
+                )
+                _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
+
+                resutls_row.append(float(pps) / 10**6)
+
+            self.result_table_add(resutls_row)
+
+        self.result_table_print()
+
+    def test_perf_routing_without_kni(self):
+        """
+        Routing performance without KNI.
+        """
+
+        header = routing_perf_no_kni_results_header
+
+        for size in packet_sizes_routing:
+            header.append("%d Mpps" % size)
+
+        self.result_table_create(header)
+
+        self.dut.kill_all()
+        self.dut.send_expect("rmmod rte_kni", "# ", 20)
+
+        self.dut.send_expect("systemctl stop NetworkManager.service", "# ")
+
+        dut_ports = self.dut.get_ports(self.nic)
+
+        allow_list = self.make_allow_list(self.target, self.nic)
+        port_virtual_interaces = []
+
+        for port in allow_list:
+
+            # Enables the interfaces
+            information = self.dut.send_expect(
+                "./usertools/dpdk-devbind.py --status | grep '%s'" % port, "# "
+            )
+            data = information.split(" ")
+            for field in data:
+                if field.rfind("if=") != -1:
+                    interface_aux = field.replace("if=", "")
+                    port_virtual_interaces.append(interface_aux)
+                    self.dut.send_expect("ifconfig %s up" % interface_aux, "# ")
+
+        self.dut.send_expect("echo 1 > /proc/sys/net/ipv4/ip_forward", "# ")
+
+        for port in range(0, ports_without_kni):
+            tx_port = self.tester.get_local_port(dut_ports[port])
+            self.dut.send_expect(
+                "ifconfig %s 192.170.%d.1 up"
+                % (port_virtual_interaces[port], port + 100),
+                "# ",
+            )
+            self.dut.send_expect(
+                "route add -net 192.170.%d.0  netmask 255.255.255.0 gw 192.170.%d.1"
+                % (port + 100, port + 100),
+                "# ",
+            )
+            self.dut.send_expect(
+                "arp -s 192.170.%d.2 %s" % (port + 100, self.tester.get_mac(tx_port)),
+                "# ",
+            )
+
+        one_port_resutls_row = [1]
+        two_port_resutls_row = [2]
+        for packet_size in packet_sizes_routing:
+
+            payload_size = packet_size - 38
+            tgen_input = []
+
+            # Prepare test with 1 port
+            tx_port = self.tester.get_local_port(dut_ports[0])
+            rx_mac = self.dut.get_mac_address(dut_ports[0])
+            self.tester.scapy_append("flows = []")
+            self.tester.scapy_append(
+                'flows.append(Ether(dst="%s")/IP(src="192.170.100.2",dst="192.170.100.2")/("X"*%d))'
+                % (rx_mac, payload_size)
+            )
+            pcap = os.sep.join([self.output_path, "routePerf_1.pcap"])
+            self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
+            self.tester.scapy_execute()
+
+            tgen_input = []
+            tgen_input.append((tx_port, tx_port, pcap))
+
+            # Get throughput with 1 port
+
+            # clear streams before add new streams
+            self.tester.pktgen.clear_streams()
+            # run packet generator
+            streams = self.pktgen_helper.prepare_stream_from_tginput(
+                tgen_input, 100, None, self.tester.pktgen
+            )
+            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
+
+            one_port_resutls_row.append(float(pps) / 10**6)
+            self.result_table_add(one_port_resutls_row)
+
+            # Prepare test with 'ports_without_kni' ports
+            cnt = 0
+            for port in range(ports_without_kni):
+                rx_mac = self.dut.get_mac_address(dut_ports[port])
+                tx_port = self.tester.get_local_port(dut_ports[port])
+                self.tester.scapy_append("flows = []")
+                self.tester.scapy_append(
+                    'flows.append(Ether(dst="%s")/IP(src="192.170.%d.2",dst="192.170.%d.2")/("X"*%d))'
+                    % (
+                        rx_mac,
+                        100 + port,
+                        100 + (port + 1) % ports_without_kni,
+                        payload_size,
+                    )
+                )
+                pcap = os.sep.join(
+                    [
+                        self.output_path,
+                        "routePerf_{0}_{1}.pcap".format(ports_without_kni, cnt),
+                    ]
+                )
+                tgen_input.append((tx_port, tx_port, pcap))
+                self.tester.scapy_append('wrpcap("%s",flows)' % pcap)
+                self.tester.scapy_execute()
+                cnt += 1
+
+            # Get throughput with 'ports_without_kni' ports
+            # clear streams before add new streams
+            self.tester.pktgen.clear_streams()
+            # run packet generator
+            streams = self.pktgen_helper.prepare_stream_from_tginput(
+                tgen_input, 100, None, self.tester.pktgen
+            )
+            _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams)
+
+            two_port_resutls_row.append(float(pps) / 10**6)
+            self.result_table_add(two_port_resutls_row)
+
+        self.result_table_print()
+
+        for port in allow_list:
+            self.dut.send_expect(
+                "./usertools/dpdk-devbind.py -b %s %s" % (self.drivername, port), "# "
+            )
+
+    def tear_down(self):
+        """
+        Run after each test case.
+        """
+        if self._suite_result.test_case == "test_ping":
+            for port in self.config["ports"]:
+                tx_port = self.tester.get_local_port(port)
+                tx_interface = self.tester.get_interface(tx_port)
+                self.tester.send_expect("ip addr flush %s" % tx_interface, "# ")
+
+    def tear_down_all(self):
+        """
+        Run after each test suite.
+        """
+        self.dut.kill_all()
+        self.dut.send_expect("rmmod rte_kni", "# ", 10)
+        # disable dut ipv6
+        self.dut.disable_ipv6("all")