From patchwork Tue May 10 03:00:59 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 110947 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E7448A034C; Tue, 10 May 2022 05:01:53 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DF61C4113D; Tue, 10 May 2022 05:01:53 +0200 (CEST) Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by mails.dpdk.org (Postfix) with ESMTP id 06EF140DDA for ; Tue, 10 May 2022 05:01:51 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1652151712; x=1683687712; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=H1Ku7wBb6cvhRuhyGwbnMNgSHaAEOaXplOr73IfH5YA=; b=KQ0+6UosIrXEz0CW8Ndx3ePdL1TuwCXSD4oV3g0ZdA1iwdtV/e0X7srp +oktNa3v7br6pduABSf6Fyunads9JsAdRj3Wz2Ct7s6TNHieqZAk9ZUWI y7ZFkYlKPrGIIuZ3koQQjNs8+nM1BEKl0PsKmD7edzSC7DK813ucfRhxz /2yviJQyanZlnFX1jqxrkOW2UW90OL8i/cSCIhaJWF3jZTYlrlPKZf0Qu 0Ql8bPuKsvN0NqaJyOf48CPj6v77cR/oONb/4C23xcS5G00/Fc1yauiks mQYmARlXetznsFPZ3doJJh1rMUjUuR+QnJl1EK+14BchTjK+b5Cp4pGPb A==; X-IronPort-AV: E=McAfee;i="6400,9594,10342"; a="332277877" X-IronPort-AV: E=Sophos;i="5.91,213,1647327600"; d="scan'208";a="332277877" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by orsmga105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 May 2022 20:01:50 -0700 X-IronPort-AV: E=Sophos;i="5.91,213,1647327600"; d="scan'208";a="710814981" Received: from unknown (HELO localhost.localdomain) ([10.239.251.222]) by fmsmga001-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 May 2022 20:01:48 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Subject: [dts][PATCH V4 1/3] test_plans/index: add dpdk_gro_lib_cbdma Date: Mon, 9 May 2022 23:00:59 -0400 Message-Id: <20220510030059.334346-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Add new testplan dpdk_gro_lib_cbdma_test_plan. Signed-off-by: Wei Ling --- test_plans/index.rst | 1 + 1 file changed, 1 insertion(+) diff --git a/test_plans/index.rst b/test_plans/index.rst index d0f73d23..fbb9a5c4 100644 --- a/test_plans/index.rst +++ b/test_plans/index.rst @@ -236,6 +236,7 @@ The following are the test plans for the DPDK DTS automated test system. vm2vm_virtio_pmd_test_plan vm2vm_virtio_pmd_cbdma_test_plan dpdk_gro_lib_test_plan + dpdk_gro_lib_cbdma_test_plan dpdk_gso_lib_test_plan vswitch_sample_cbdma_test_plan vswitch_pvp_multi_paths_performance_with_cbdma_test_plan From patchwork Tue May 10 03:01:13 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 110948 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 14ED2A034C; Tue, 10 May 2022 05:02:07 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0EF26410F2; Tue, 10 May 2022 05:02:07 +0200 (CEST) Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by mails.dpdk.org (Postfix) with ESMTP id 0158540DDA for ; Tue, 10 May 2022 05:02:04 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1652151725; x=1683687725; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=pp97JLz2h/nAjQB1ALAsP/EMN0Xml8IkZtHJJLNIoJg=; b=fP2NslmRr0wOL2f/sahyAEc7/vHle5aPPQN52AIv2CCEj4OjTcNPTs5y B9yTeCv1svuBhG/IswEOi4ofHpbRk3QGtfE4CNVdVNs2lQvdZSKWC5HTg tGNslYd6X5e+ckFhvsBRRDbePQi7HK6VdskfxPGckelyyltdiN4hPO6G7 5ADA4kCfQxl0u8aNUlZycT1xvZsPbttFtO8jz2X3m0AMjtyntoqzn1pio 2UV+47Hv+OqZbFVBkd/T503SnO1Hnysy1nMQViHVekOi3a82gOcAVlYcb xv4taROkvNLiWEIzfSJsVdYpnxO/ndu/XfUGDO9GMy8gjc6vVfnVo04B6 A==; X-IronPort-AV: E=McAfee;i="6400,9594,10342"; a="266829771" X-IronPort-AV: E=Sophos;i="5.91,213,1647327600"; d="scan'208";a="266829771" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 May 2022 20:02:03 -0700 X-IronPort-AV: E=Sophos;i="5.91,213,1647327600"; d="scan'208";a="710815031" Received: from unknown (HELO localhost.localdomain) ([10.239.251.222]) by fmsmga001-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 May 2022 20:02:02 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Subject: [dts][PATCH V4 2/3] test_plans/dpdk_gro_lib_cbdma: add dpdk_gro_lib_cbdma testplan Date: Mon, 9 May 2022 23:01:13 -0400 Message-Id: <20220510030113.334472-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Add new testplan test_plans/dpdk_gro_lib_cbdma_test_plan. Signed-off-by: Wei Ling --- test_plans/dpdk_gro_lib_cbdma_test_plan.rst | 185 ++++++++++++++++++++ 1 file changed, 185 insertions(+) create mode 100644 test_plans/dpdk_gro_lib_cbdma_test_plan.rst diff --git a/test_plans/dpdk_gro_lib_cbdma_test_plan.rst b/test_plans/dpdk_gro_lib_cbdma_test_plan.rst new file mode 100644 index 00000000..445540a6 --- /dev/null +++ b/test_plans/dpdk_gro_lib_cbdma_test_plan.rst @@ -0,0 +1,185 @@ +.. Copyright (c) <2022>, Intel Corporation + All rights reserved. + + Redistribution and use in source and binary forms, with or without + modification, are permitted provided that the following conditions + are met: + + - Redistributions of source code must retain the above copyright + notice, this list of conditions and the following disclaimer. + + - Redistributions in binary form must reproduce the above copyright + notice, this list of conditions and the following disclaimer in + the documentation and/or other materials provided with the + distribution. + + - Neither the name of Intel Corporation nor the names of its + contributors may be used to endorse or promote products derived + from this software without specific prior written permission. + + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS + FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE + COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, + INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES + (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR + SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) + HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, + STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) + ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED + OF THE POSSIBILITY OF SUCH DAMAGE. + +================================= +DPDK GRO lib with cbdma test plan +================================= + +Description +=========== + +Generic Receive Offload (GRO) is a widely used SW-based offloading +technique to reduce per-packet processing overheads. By reassembling +small packets into larger ones, GRO enables applications to process +fewer large packets directly, thus reducing the number of packets to +be processed. To benefit DPDK-based applications, like Open vSwitch, +DPDK also provides own GRO implementation. In DPDK, GRO is implemented +as a standalone library. Applications explicitly use the GRO library to +reassemble packets. + +In the GRO library, there are many GRO types which are defined by packet +types. One GRO type is in charge of process one kind of packets. For +example, TCP/IPv4 GRO processes TCP/IPv4 packets. + +Each GRO type has a reassembly function, which defines own algorithm and +table structure to reassemble packets. We assign input packets to the +corresponding GRO functions by MBUF->packet_type. + +The GRO library doesn't check if input packets have correct checksums and +doesn't re-calculate checksums for merged packets. The GRO library +assumes the packets are complete (i.e., MF==0 && frag_off==0), when IP +fragmentation is possible (i.e., DF==0). Additionally, it complies RFC +6864 to process the IPv4 ID field. + +Currently, the GRO library provides GRO supports for TCP/IPv4 packets and +VxLAN packets which contain an outer IPv4 header and an inner TCP/IPv4 +packet. + +This test plan includes dpdk gro lib test with TCP/IPv4 traffic with CBDMA. + +..Note: +1.For packed virtqueue virtio-net test, need qemu version > 4.2.0 and VM kernel version > 5.1, and packed ring multi-queues not support reconnect in qemu yet. +2.For split virtqueue virtio-net with multi-queues server mode test, need qemu version >= 5.2.0, dut to old qemu exist reconnect issue when multi-queues test. +3.DPDK local patch that about vhost pmd is needed when testing Vhost asynchronous data path with testpmd. + +Prerequisites +============= + +Modify the testpmd code as following:: + + --- a/app/test-pmd/csumonly.c + +++ b/app/test-pmd/csumonly.c + @@ -693,10 +693,12 @@ pkt_burst_checksum_forward(struct fwd_stream *fs) +                  * and inner headers */ +   +                 eth_hdr = rte_pktmbuf_mtod(m, struct ether_hdr *); + +#if 0 +                 ether_addr_copy(&peer_eth_addrs[fs->peer_addr], +                                 ð_hdr->d_addr); +                 ether_addr_copy(&ports[fs->tx_port].eth_addr, +                                 ð_hdr->s_addr); + +#endif +                 parse_ethernet(eth_hdr, &info); +                 l3_hdr = (char *)eth_hdr + info.l2_len; + +Modify the dpdk code as following:: + + diff --git a/drivers/net/vhost/rte_eth_vhost.c b/drivers/net/vhost/rte_eth_vhost.c + index b38a4b6b1..573250dbe 100644 + --- a/drivers/net/vhost/rte_eth_vhost.c + +++ b/drivers/net/vhost/rte_eth_vhost.c + @@ -1071,8 +1071,14 @@ eth_dev_info(struct rte_eth_dev *dev, + dev_info->min_rx_bufsize = 0; + + dev_info->tx_offload_capa = DEV_TX_OFFLOAD_MULTI_SEGS | + - DEV_TX_OFFLOAD_VLAN_INSERT; + - dev_info->rx_offload_capa = DEV_RX_OFFLOAD_VLAN_STRIP; + + DEV_TX_OFFLOAD_VLAN_INSERT | + + DEV_TX_OFFLOAD_UDP_CKSUM | + + DEV_TX_OFFLOAD_TCP_CKSUM | + + DEV_TX_OFFLOAD_IPV4_CKSUM | + + DEV_TX_OFFLOAD_TCP_TSO; + + dev_info->rx_offload_capa = DEV_RX_OFFLOAD_VLAN_STRIP | + + DEV_RX_OFFLOAD_TCP_CKSUM | + + DEV_RX_OFFLOAD_UDP_CKSUM | + + DEV_RX_OFFLOAD_IPV4_CKSUM | + + DEV_RX_OFFLOAD_TCP_LRO; + } + +Compile DPDK as following:: + + CC=gcc meson --werror -Denable_kmods=True -Dlibdir=lib --default-library=static x86_64-native-linuxapp-gcc + ninja -C x86_64-native-linuxapp-gcc -j 110 + +Test flow +========= + +NIC2(In kernel) -> NIC1(DPDK) -> testpmd(csum fwd) -> Vhost -> Virtio-net + + +Test Case1: DPDK GRO test with two queues and two CBDMA channels using tcp/ipv4 traffic +======================================================================================= + +Test flow +========= + + +1. Connect two nic port directly, put nic2 into another namesapce and turn on the tso of this nic port by below cmds:: + + ip netns del ns1 + ip netns add ns1 + ip link set enp26s0f0 netns ns1 # [enp216s0f0] is the name of nic2 + ip netns exec ns1 ifconfig enp26s0f0 1.1.1.8 up + ip netns exec ns1 ethtool -K enp26s0f0 tso on + +2. Bind cbdma port and nic1 to vfio-pci, launch vhost-user with testpmd and set flush interval to 1:: + + ./usertools/dpdk-devbind.py -b vfio-pci xx:xx.x + ./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 29-31 -n 4 \ + --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=2,dmas=[txq0@80:04.0;txq1@80:04.1]' \ + -- -i --txd=1024 --rxd=1024 --txq=2 --rxq=2 --nb-cores=2 + testpmd> set fwd csum + testpmd> stop + testpmd> port stop 0 + testpmd> port stop 1 + testpmd> csum set tcp hw 0 + testpmd> csum set ip hw 0 + testpmd> csum set tcp hw 1 + testpmd> csum set ip hw 1 + testpmd> set port 0 gro on + testpmd> set gro flush 1 + testpmd> port start 0 + testpmd> port start 1 + testpmd> start + +3. Set up vm with virto device and using kernel virtio-net driver:: + + taskset -c 31 /home/qemu-install/qemu-4.2.1/bin/qemu-system-x86_64 -name us-vhost-vm1 \ + -cpu host -enable-kvm -m 2048 -object memory-backend-file,id=mem,size=2048M,mem-path=/mnt/huge,share=on \ + -numa node,memdev=mem \ + -mem-prealloc -monitor unix:/tmp/vm2_monitor.sock,server,nowait -netdev user,id=yinan,hostfwd=tcp:127.0.0.1:6005-:22 -device e1000,netdev=yinan \ + -smp cores=1,sockets=1 -drive file=/home/osimg/ubuntu2004.img \ + -chardev socket,id=char0,path=./vhost-net \ + -netdev type=vhost-user,id=mynet1,chardev=char0,vhostforce,queues=2 \ + -device virtio-net-pci,mac=52:54:00:00:00:01,netdev=mynet1,mrg_rxbuf=on,csum=on,gso=on,host_tso4=on,guest_tso4=on,mq=on,vectors=15 \ + -vnc :10 -daemonize + +4. In vm, config the virtio-net device with ip and turn the kernel gro off:: + + ifconfig ens4 1.1.1.2 up # [ens3] is the name of virtio-net + ethtool -L ens4 combined 2 + ethtool -K ens4 gro off + +5. Start iperf test, run iperf server at vm side and iperf client at host side, check throughput, should be larger than 10Gbits/sec:: + + Host side : taskset -c 35 ip netns exec ns1 iperf -c 1.1.1.2 -i 1 -t 60 -m -P 2 + VM side: iperf -s From patchwork Tue May 10 03:01:25 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 110949 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 58CBDA034C; Tue, 10 May 2022 05:02:19 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 52F5E41156; Tue, 10 May 2022 05:02:19 +0200 (CEST) Received: from mga04.intel.com (mga04.intel.com [192.55.52.120]) by mails.dpdk.org (Postfix) with ESMTP id DC07B40DDA for ; Tue, 10 May 2022 05:02:17 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1652151738; x=1683687738; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=IHdCjb2lyjatGKtn50v7WlTrqiHrScXROKcb7esWCTo=; b=UzjSw9/446vkBjChJg26cMYHxaabQtXjl18wZGzgr53aX+D4S0aE7d5K 0e7YIXUmnONRCBuHzS1Qhr7XCC/fBebxVr7Su2iQ1rrDEmFj2sMuPyc+y D5gjmcaqRztkLZcLFxALuv0alIH3QFe6iDjCV3ZpSiTQTLziN4B0yCRzv I8Gd+cRQbrZWfFLrlmQcMKPmZTzhsnB0N3cLYVH198QSqny0ODIMyKtqq DmAfNFitJlhfJKNE8tNvOQiJfMH+twUVJ60dQo2PNzpGyDvFrkZpIn0Iz BkUpM9Agm5v2R5GMAmjTcRmcUV8Vld2ZR8chJedOsongMxovbWVoswul+ g==; X-IronPort-AV: E=McAfee;i="6400,9594,10342"; a="268082905" X-IronPort-AV: E=Sophos;i="5.91,213,1647327600"; d="scan'208";a="268082905" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga104.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 May 2022 20:02:16 -0700 X-IronPort-AV: E=Sophos;i="5.91,213,1647327600"; d="scan'208";a="710815120" Received: from unknown (HELO localhost.localdomain) ([10.239.251.222]) by fmsmga001-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 May 2022 20:02:14 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Subject: [dts][PATCH V4 3/3] tests/dpdk_gro_lib_cbdma: add dpdk_gro_lib_cbdma testsuite Date: Mon, 9 May 2022 23:01:25 -0400 Message-Id: <20220510030125.334616-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Add new testsuite tests/TestSuite_dpdk_gro_lib_cbdma.py. Signed-off-by: Wei Ling Acked-by: Xingguang He Tested-by: Chenyu Huang --- tests/TestSuite_dpdk_gro_lib_cbdma.py | 383 ++++++++++++++++++++++++++ 1 file changed, 383 insertions(+) create mode 100644 tests/TestSuite_dpdk_gro_lib_cbdma.py diff --git a/tests/TestSuite_dpdk_gro_lib_cbdma.py b/tests/TestSuite_dpdk_gro_lib_cbdma.py new file mode 100644 index 00000000..66db4555 --- /dev/null +++ b/tests/TestSuite_dpdk_gro_lib_cbdma.py @@ -0,0 +1,383 @@ +# BSD LICENSE +# +# Copyright(c) <2022> Intel Corporation. +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# * Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# * Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# * Neither the name of Intel Corporation nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +""" +DPDK Test suite. + +dpdk gro lib test suite. +In this suite, in order to check the performance of gso lib, will use one +hostcpu to start qemu and only have one vcpu +""" +import re +import time + +import framework.utils as utils +import tests.vhost_peer_conf as peer +from framework.pmd_output import PmdOutput +from framework.test_case import TestCase +from framework.virt_common import VM + + +class TestDPDKGROLibCbdma(TestCase): + def set_up_all(self): + self.dut_ports = self.dut.get_ports() + self.ports_socket = self.dut.get_numa_id(self.dut_ports[0]) + self.def_driver = self.dut.ports_info[self.dut_ports[0]][ + "port" + ].get_nic_driver() + self.pci = peer.get_pci_info() + self.pci_drv = peer.get_pci_driver_info() + self.peer_pci = peer.get_pci_peer_info() + self.nic_in_kernel = peer.get_pci_peer_intf_info() + self.verify( + len(self.pci) != 0 + and len(self.pci_drv) != 0 + and len(self.peer_pci) != 0 + and len(self.nic_in_kernel) != 0, + "Pls config the direct connection info in vhost_peer_conf.cfg", + ) + bind_script_path = self.dut.get_dpdk_bind_script() + self.dut.send_expect( + "%s --bind=%s %s" % (bind_script_path, self.def_driver, self.pci), "# " + ) + self.path = self.dut.apps_name["test-pmd"] + self.testpmd_name = self.path.split("/")[-1] + cores_list = self.dut.get_core_list(config="all", socket=self.ports_socket) + self.vhost_list = cores_list[0:3] + self.qemu_cpupin = cores_list[3:4][0] + + # Set the params for VM + self.virtio_ip1 = "1.1.1.2" + self.virtio_mac1 = "52:54:00:00:00:01" + self.memory_channel = self.dut.get_memory_channels() + if len(set([int(core["socket"]) for core in self.dut.cores])) == 1: + self.socket_mem = "1024" + else: + self.socket_mem = "1024,1024" + self.prepare_dpdk() + self.base_dir = self.dut.base_dir.replace("~", "/root") + self.ports_socket = self.dut.get_numa_id(self.dut_ports[0]) + self.vhost_user = self.dut.new_session(suite="vhost-user") + self.vhost_pmd = PmdOutput(self.dut, self.vhost_user) + + def set_up(self): + """ + Run before each test case. + """ + self.dut.send_expect("rm -rf %s/vhost-net*" % self.base_dir, "#") + self.dut.send_expect("killall -s INT %s" % self.testpmd_name, "#") + self.dut.send_expect("killall -s INT qemu-system-x86_64", "#") + + def get_cbdma_ports_info_and_bind_to_dpdk(self, cbdma_num, allow_diff_socket=False): + """ + get all cbdma ports + """ + self.all_cbdma_list = [] + self.cbdma_list = [] + self.cbdma_str = "" + out = self.dut.send_expect( + "./usertools/dpdk-devbind.py --status-dev dma", "# ", 30 + ) + device_info = out.split("\n") + for device in device_info: + pci_info = re.search("\s*(0000:\S*:\d*.\d*)", device) + if pci_info is not None: + dev_info = pci_info.group(1) + # the numa id of ioat dev, only add the device which on same socket with nic dev + bus = int(dev_info[5:7], base=16) + if bus >= 128: + cur_socket = 1 + else: + cur_socket = 0 + if allow_diff_socket: + self.all_cbdma_list.append(pci_info.group(1)) + else: + if self.ports_socket == cur_socket: + self.all_cbdma_list.append(pci_info.group(1)) + self.verify( + len(self.all_cbdma_list) >= cbdma_num, "There no enough cbdma device" + ) + self.cbdma_list = self.all_cbdma_list[0:cbdma_num] + self.cbdma_str = " ".join(self.cbdma_list) + self.dut.send_expect( + "./usertools/dpdk-devbind.py --force --bind=%s %s" + % (self.drivername, self.cbdma_str), + "# ", + 60, + ) + + def bind_cbdma_device_to_kernel(self): + self.dut.send_expect("modprobe ioatdma", "# ") + self.dut.send_expect( + "./usertools/dpdk-devbind.py -u %s" % self.cbdma_str, "# ", 30 + ) + self.dut.send_expect( + "./usertools/dpdk-devbind.py --force --bind=ioatdma %s" % self.cbdma_str, + "# ", + 60, + ) + + def set_testpmd_params(self): + self.vhost_user.send_expect("set fwd csum", "testpmd> ", 120) + self.vhost_user.send_expect("stop", "testpmd> ", 120) + self.vhost_user.send_expect("port stop 0", "testpmd> ", 120) + self.vhost_user.send_expect("port stop 1", "testpmd> ", 120) + self.vhost_user.send_expect("csum set tcp hw 0", "testpmd> ", 120) + self.vhost_user.send_expect("csum set ip hw 0", "testpmd> ", 120) + self.vhost_user.send_expect("csum set tcp hw 1", "testpmd> ", 120) + self.vhost_user.send_expect("csum set ip hw 1", "testpmd> ", 120) + self.vhost_user.send_expect("set port 0 gro on", "testpmd> ", 120) + self.vhost_user.send_expect("set gro flush 1", "testpmd> ", 120) + self.vhost_user.send_expect("port start 0", "testpmd> ", 120) + self.vhost_user.send_expect("port start 1", "testpmd> ", 120) + self.vhost_user.send_expect("start", "testpmd> ", 120) + + def quit_testpmd(self): + self.vhost_user.send_expect("quit", "#", 120) + self.dut.close_session(self.vhost_user) + + def config_kernel_nic_host(self): + self.dut.send_expect("ip netns del ns1", "#") + self.dut.send_expect("ip netns add ns1", "#") + self.dut.send_expect("ip link set %s netns ns1" % self.nic_in_kernel, "#") + self.dut.send_expect( + "ip netns exec ns1 ifconfig %s 1.1.1.8 up" % self.nic_in_kernel, "#" + ) + self.dut.send_expect( + "ip netns exec ns1 ethtool -K %s tso on" % self.nic_in_kernel, "#" + ) + + def prepare_dpdk(self): + # Changhe the testpmd checksum fwd code for mac change + self.dut.send_expect( + "cp ./app/test-pmd/csumonly.c ./app/test-pmd/csumonly_backup.c", "#" + ) + self.dut.send_expect( + "cp ./drivers/net/vhost/rte_eth_vhost.c ./drivers/net/vhost/rte_eth_vhost-backup.c", + "#", + ) + self.dut.send_expect( + "sed -i '/ether_addr_copy(&peer_eth/i\#if 0' ./app/test-pmd/csumonly.c", "#" + ) + self.dut.send_expect( + "sed -i '/parse_ethernet(eth_hdr, &info/i\#endif' ./app/test-pmd/csumonly.c", + "#", + ) + # change offload of vhost + tx_offload = ( + "RTE_ETH_TX_OFFLOAD_VLAN_INSERT | " + + "RTE_ETH_TX_OFFLOAD_UDP_CKSUM | " + + "RTE_ETH_TX_OFFLOAD_TCP_CKSUM | " + + "RTE_ETH_TX_OFFLOAD_IPV4_CKSUM | " + + "RTE_ETH_TX_OFFLOAD_TCP_TSO;" + ) + rx_offload = ( + "RTE_ETH_RX_OFFLOAD_VLAN_STRIP | " + + "RTE_ETH_RX_OFFLOAD_TCP_CKSUM | " + + "RTE_ETH_RX_OFFLOAD_UDP_CKSUM | " + + "RTE_ETH_RX_OFFLOAD_IPV4_CKSUM | " + + "RTE_ETH_RX_OFFLOAD_TCP_LRO;" + ) + self.dut.send_expect( + "sed -i 's/RTE_ETH_TX_OFFLOAD_VLAN_INSERT;/%s/' drivers/net/vhost/rte_eth_vhost.c" + % tx_offload, + "#", + ) + self.dut.send_expect( + "sed -i 's/RTE_ETH_RX_OFFLOAD_VLAN_STRIP;/%s/' drivers/net/vhost/rte_eth_vhost.c" + % rx_offload, + "#", + ) + self.dut.build_install_dpdk(self.dut.target) + + def unprepare_dpdk(self): + # Recovery the DPDK code to original + self.dut.send_expect( + "cp ./app/test-pmd/csumonly_backup.c ./app/test-pmd/csumonly.c ", "#" + ) + self.dut.send_expect( + "cp ./drivers/net/vhost/rte_eth_vhost-backup.c ./drivers/net/vhost/rte_eth_vhost.c ", + "#", + ) + self.dut.send_expect("rm -rf ./app/test-pmd/csumonly_backup.c", "#") + self.dut.send_expect("rm -rf ./drivers/net/vhost/rte_eth_vhost-backup.c", "#") + self.dut.build_install_dpdk(self.dut.target) + + def set_vm_cpu_number(self, vm_config): + # config the vcpu numbers = 1 + # config the cpupin only have one core + params_number = len(vm_config.params) + for i in range(params_number): + if list(vm_config.params[i].keys())[0] == "cpu": + vm_config.params[i]["cpu"][0]["number"] = 1 + vm_config.params[i]["cpu"][0]["cpupin"] = self.qemu_cpupin + + def start_vm(self, queue=1): + self.vm1 = VM(self.dut, "vm0", "vhost_sample") + self.vm1.load_config() + vm_params_1 = {} + vm_params_1["driver"] = "vhost-user" + vm_params_1["opt_path"] = self.base_dir + "/vhost-net" + vm_params_1["opt_mac"] = self.virtio_mac1 + vm_params_1["opt_queue"] = queue + vm_params_1[ + "opt_settings" + ] = "mrg_rxbuf=on,csum=on,gso=on,host_tso4=on,guest_tso4=on,mq=on,vectors=15" + self.vm1.set_vm_device(**vm_params_1) + self.set_vm_cpu_number(self.vm1) + try: + self.vm1_dut = self.vm1.start(load_config=False, set_target=False) + if self.vm1_dut is None: + raise Exception("Set up VM ENV failed") + except Exception as e: + print((utils.RED("Failure for %s" % str(e)))) + self.vm1_dut.restore_interfaces() + + def iperf_result_verify(self, run_info): + """ + Get the iperf test result + """ + fmsg = self.dut.send_expect("cat /root/iperf_client.log", "#") + print(fmsg) + iperfdata = re.compile("[\d+]*.[\d+]* [M|G|K]bits/sec").findall(fmsg) + print(iperfdata) + self.verify(iperfdata, "There no data about this case") + self.result_table_create(["Data", "Unit"]) + results_row = [run_info] + results_row.append(iperfdata[-1]) + self.result_table_add(results_row) + self.result_table_print() + self.output_result = "Iperf throughput is %s" % iperfdata[-1] + self.logger.info(self.output_result) + iperfdata_kb = 0 + tmp_value = iperfdata[-1].split(" ")[0] + if "Gbits" in iperfdata[-1]: + iperfdata_kb = float(tmp_value) * 1000000 + elif "Mbits" in iperfdata[-1]: + iperfdata_kb = float(tmp_value) * 1000 + else: + iperfdata_kb = float(tmp_value) + return iperfdata_kb + + def check_dut_perf_top_info(self, check_string): + self.dut.send_expect("perf top", "# ") + + def test_vhost_gro_tcp_ipv4_with_cbdma_enable(self): + """ + Test Case1: DPDK GRO test with two queues and two CBDMA channels using tcp/ipv4 traffic + """ + self.config_kernel_nic_host() + self.get_cbdma_ports_info_and_bind_to_dpdk(cbdma_num=2) + lcore_dma = "[lcore{}@{},lcore{}@{},lcore{}@{}]".format( + self.vhost_list[1], + self.cbdma_list[0], + self.vhost_list[1], + self.cbdma_list[1], + self.vhost_list[2], + self.cbdma_list[1], + ) + param = ( + "--txd=1024 --rxd=1024 --txq=2 --rxq=2 --nb-cores=2 --lcore-dma={}".format( + lcore_dma + ) + ) + eal_param = "--vdev 'net_vhost0,iface=vhost-net,queues=2,dmas=[txq0;txq1]'" + ports = self.cbdma_list + ports.append(self.pci) + self.vhost_pmd.start_testpmd( + cores=self.vhost_list, + ports=ports, + prefix="vhost", + eal_param=eal_param, + param=param, + ) + self.set_testpmd_params() + self.start_vm(queue=2) + time.sleep(5) + self.dut.get_session_output(timeout=2) + for port in self.vm1_dut.ports_info: + self.vm1_intf = port["intf"] + self.vm1_dut.send_expect( + "ifconfig %s %s up" % (self.vm1_intf, self.virtio_ip1), "#", 10 + ) + self.vm1_dut.send_expect("ethtool -L %s combined 2" % self.vm1_intf, "#", 10) + self.vm1_dut.send_expect("ethtool -K %s gro off" % (self.vm1_intf), "#", 10) + self.vm1_dut.send_expect("iperf -s", "", 10) + self.dut.send_expect("rm /root/iperf_client.log", "#", 10) + out = self.dut.send_expect( + "ip netns exec ns1 iperf -c %s -i 1 -t 60 -m -P 2 > /root/iperf_client.log &" + % (self.virtio_ip1), + "", + 180, + ) + time.sleep(30) + print(out) + perfdata = self.iperf_result_verify("GRO lib") + print(("the GRO lib %s " % (self.output_result))) + self.quit_testpmd() + self.dut.send_expect("killall -s INT qemu-system-x86_64", "#") + exp_perfdata = 10000000 + if exp_perfdata: + self.verify( + float(perfdata) > float(exp_perfdata), + "TestFailed: W/cbdma iperf data is %s Kbits/sec, W/O cbdma iperf data is %s Kbits/sec" + % (perfdata, exp_perfdata), + ) + + def tear_down(self): + """ + Run after each test case. + """ + self.dut.send_expect("killall -s INT %s" % self.testpmd_name, "#") + self.dut.send_expect("killall -s INT qemu-system-x86_64", "#") + self.dut.send_expect("rm -rf %s/vhost-net" % self.base_dir, "#") + time.sleep(2) + self.dut.send_expect("ip netns del ns1", "# ", 30) + self.dut.send_expect( + "./usertools/dpdk-devbind.py -u %s" % (self.peer_pci), "# ", 30 + ) + self.dut.send_expect( + "./usertools/dpdk-devbind.py -b %s %s" % (self.pci_drv, self.peer_pci), + "# ", + 30, + ) + self.bind_cbdma_device_to_kernel() + + def tear_down_all(self): + """ + Run after each test suite. + """ + self.unprepare_dpdk() + self.dut.send_expect("ip netns del ns1", "# ", 30) + self.dut.send_expect("./usertools/dpdk-devbind.py -u %s" % (self.pci), "# ", 30) + self.dut.send_expect( + "./usertools/dpdk-devbind.py -b %s %s" % (self.pci_drv, self.pci), "# ", 30 + )