From patchwork Tue Sep 14 02:35:24 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 98816 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 52B2BA0C45; Tue, 14 Sep 2021 04:41:37 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 4AD134069C; Tue, 14 Sep 2021 04:41:37 +0200 (CEST) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mails.dpdk.org (Postfix) with ESMTP id EF7CC40151 for ; Tue, 14 Sep 2021 04:41:35 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10106"; a="244183090" X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="244183090" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by fmsmga101.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:41:35 -0700 X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="471800596" Received: from unknown (HELO localhost.localdomain) ([10.240.183.222]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:41:33 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Date: Tue, 14 Sep 2021 10:35:24 +0800 Message-Id: <20210914023524.2305891-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [dts] [PATCH V1 1/6] tests/pvp_multi_paths_performance: check expected value from config file X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Check expected value from config file and remove the check_value method. Signed-off-by: Wei Ling --- tests/TestSuite_pvp_multi_paths_performance.py | 12 ------------ 1 file changed, 12 deletions(-) diff --git a/tests/TestSuite_pvp_multi_paths_performance.py b/tests/TestSuite_pvp_multi_paths_performance.py index 11db11ee..7f809704 100644 --- a/tests/TestSuite_pvp_multi_paths_performance.py +++ b/tests/TestSuite_pvp_multi_paths_performance.py @@ -104,15 +104,6 @@ class TestPVPMultiPathPerformance(TestCase): self.path=self.dut.apps_name['test-pmd'] self.testpmd_name = self.path.split("/")[-1] - @property - def check_value(self): - check_dict = dict.fromkeys(self.frame_sizes) - linerate = {64: 0.085, 128: 0.12, 256: 0.20, 512: 0.35, 1024: 0.50, 1280: 0.55, 1518: 0.60} - for size in self.frame_sizes: - speed = self.wirespeed(self.nic, size, self.number_of_ports) - check_dict[size] = round(speed * linerate[size], 2) - return check_dict - def send_and_verify(self, case_info): """ Send packet with packet generator and verify @@ -138,9 +129,6 @@ class TestPVPMultiPathPerformance(TestCase): streams = self.pktgen_helper.prepare_stream_from_tginput(tgen_input, 100, None, self.tester.pktgen) _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams) Mpps = pps / 1000000.0 - self.verify(Mpps > self.check_value[frame_size], - "%s of frame size %d speed verify failed, expect %s, result %s" % ( - self.running_case, frame_size, self.check_value[frame_size], Mpps)) self.throughput[frame_size][self.nb_desc] = Mpps linerate = Mpps * 100 / \ float(self.wirespeed(self.nic, frame_size, self.number_of_ports)) From patchwork Tue Sep 14 02:35:35 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 98817 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 7F4CAA0C45; Tue, 14 Sep 2021 04:41:49 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 7343C410DC; Tue, 14 Sep 2021 04:41:49 +0200 (CEST) Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by mails.dpdk.org (Postfix) with ESMTP id 2D1D5410DC for ; Tue, 14 Sep 2021 04:41:47 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10106"; a="202027533" X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="202027533" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:41:46 -0700 X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="471800619" Received: from unknown (HELO localhost.localdomain) ([10.240.183.222]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:41:44 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Date: Tue, 14 Sep 2021 10:35:35 +0800 Message-Id: <20210914023535.2305953-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [dts] [PATCH V1 2/6] conf/pvp_multi_paths_performance: modify test parameter and expected value X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Modify test parameter and expected value. Signed-off-by: Wei Ling --- conf/pvp_multi_paths_performance.cfg | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-) diff --git a/conf/pvp_multi_paths_performance.cfg b/conf/pvp_multi_paths_performance.cfg index 4e13c1aa..8847e436 100644 --- a/conf/pvp_multi_paths_performance.cfg +++ b/conf/pvp_multi_paths_performance.cfg @@ -1,6 +1,16 @@ [suite] update_expected = True -test_parameters = {64: [1024],1518: [1024]} +test_parameters = {64: [1024], 128: [1024], 256: [1024], 512: [1024], 1024: [1024], 1518: [1024]} test_duration = 60 accepted_tolerance = 2 -expected_throughput = {'test_perf_pvp_virtio11_vectorized': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_virtio11_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_vector_rx': {64: {1024: 0.00}, 1518: {1024: 0.00}},} +expected_throughput = { + 'test_perf_pvp_virtio11_vectorized': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_virtio11_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_virtio11_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_virtio11_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_virtio11_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_inorder_normal':{64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_normal':{64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_pvp_vector_rx': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}} From patchwork Tue Sep 14 02:35:45 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 98818 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id B7C07A0C45; Tue, 14 Sep 2021 04:41:58 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B1447406FF; Tue, 14 Sep 2021 04:41:58 +0200 (CEST) Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) by mails.dpdk.org (Postfix) with ESMTP id C789A4068F for ; Tue, 14 Sep 2021 04:41:56 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10106"; a="221521882" X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="221521882" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:41:55 -0700 X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="471800629" Received: from unknown (HELO localhost.localdomain) ([10.240.183.222]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:41:54 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Date: Tue, 14 Sep 2021 10:35:45 +0800 Message-Id: <20210914023545.2306013-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [dts] [PATCH V1 3/6] tests/pvp_multi_paths_vhost_single_core_performance: check expected value from config file X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Check expected value from config file and remove the check_value method. Signed-off-by: Wei Ling --- ..._pvp_multi_paths_vhost_single_core_performance.py | 12 ------------ 1 file changed, 12 deletions(-) diff --git a/tests/TestSuite_pvp_multi_paths_vhost_single_core_performance.py b/tests/TestSuite_pvp_multi_paths_vhost_single_core_performance.py index d26b2719..988e588c 100644 --- a/tests/TestSuite_pvp_multi_paths_vhost_single_core_performance.py +++ b/tests/TestSuite_pvp_multi_paths_vhost_single_core_performance.py @@ -104,15 +104,6 @@ class TestPVPMultiPathVhostPerformance(TestCase): self.test_result = {} self.nb_desc = self.test_parameters[64][0] - @property - def check_value(self): - check_dict = dict.fromkeys(self.frame_sizes) - linerate = {64: 0.085, 128: 0.12, 256: 0.20, 512: 0.35, 1024: 0.50, 1280: 0.55, 1518: 0.60} - for size in self.frame_sizes: - speed = self.wirespeed(self.nic, size, self.number_of_ports) - check_dict[size] = round(speed * linerate[size], 2) - return check_dict - def send_and_verify(self, case_info): """ Send packet with packet generator and verify @@ -137,9 +128,6 @@ class TestPVPMultiPathVhostPerformance(TestCase): streams = self.pktgen_helper.prepare_stream_from_tginput(tgen_input, 100, None, self.tester.pktgen) _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams) Mpps = pps / 1000000.0 - self.verify(Mpps > self.check_value[frame_size], - "%s of frame size %d speed verify failed, expect %s, result %s" % ( - self.running_case, frame_size, self.check_value[frame_size], Mpps)) linerate = Mpps * 100 / \ float(self.wirespeed(self.nic, frame_size, self.number_of_ports)) self.throughput[frame_size][self.nb_desc] = Mpps From patchwork Tue Sep 14 02:35:55 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 98819 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E05F4A0C45; Tue, 14 Sep 2021 04:42:08 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DB2B44068F; Tue, 14 Sep 2021 04:42:08 +0200 (CEST) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mails.dpdk.org (Postfix) with ESMTP id B506B4068F for ; Tue, 14 Sep 2021 04:42:07 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10106"; a="244183148" X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="244183148" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by fmsmga101.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:42:06 -0700 X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="471800661" Received: from unknown (HELO localhost.localdomain) ([10.240.183.222]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:42:05 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Date: Tue, 14 Sep 2021 10:35:55 +0800 Message-Id: <20210914023555.2306074-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [dts] [PATCH V1 4/6] conf/pvp_multi_paths_vhost_single_core_performance: modify test parameter and expected value X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Modify test parameter and expected value. Signed-off-by: Wei Ling --- ...p_multi_paths_vhost_single_core_performance.cfg | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-) diff --git a/conf/pvp_multi_paths_vhost_single_core_performance.cfg b/conf/pvp_multi_paths_vhost_single_core_performance.cfg index 76bc5986..688710f4 100644 --- a/conf/pvp_multi_paths_vhost_single_core_performance.cfg +++ b/conf/pvp_multi_paths_vhost_single_core_performance.cfg @@ -1,6 +1,16 @@ [suite] update_expected = True -test_parameters = {64: [1024],1518: [1024]} +test_parameters = {64: [1024], 128: [1024], 256: [1024], 512: [1024], 1024: [1024], 1518: [1024]} test_duration = 60 accepted_tolerance = 2 -expected_throughput = {'test_perf_vhost_single_core_virtio11_vectorized': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_vhost_single_core_virtio11_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_vhost_single_core_virtio11_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_vhost_single_core_virtio11_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_vhost_single_core_virtio11_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_vhost_single_core_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_vhost_single_core_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_vhost_single_core_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_vhost_single_core_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_vhost_single_core_vector_rx': {64: {1024: 0.00}, 1518: {1024: 0.00}}} +expected_throughput = { + 'test_perf_vhost_single_core_virtio11_vectorized': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_virtio11_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_virtio11_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_virtio11_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_virtio11_inorder_normal':{64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_vhost_single_core_vector_rx': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}} From patchwork Tue Sep 14 02:36:07 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 98820 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 1A967A0C45; Tue, 14 Sep 2021 04:42:21 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 10DE54069C; Tue, 14 Sep 2021 04:42:21 +0200 (CEST) Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by mails.dpdk.org (Postfix) with ESMTP id 69C7D40151 for ; Tue, 14 Sep 2021 04:42:19 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10106"; a="307406539" X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="307406539" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by fmsmga105.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:42:18 -0700 X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="471800707" Received: from unknown (HELO localhost.localdomain) ([10.240.183.222]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:42:17 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Date: Tue, 14 Sep 2021 10:36:07 +0800 Message-Id: <20210914023607.2306135-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [dts] [PATCH V1 5/6] tests/pvp_multi_paths_virtio_single_core_performance: check expected value from config file X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Check expected value from config file and remove the check_value method. Signed-off-by: Wei Ling --- ...pvp_multi_paths_virtio_single_core_performance.py | 12 ------------ 1 file changed, 12 deletions(-) diff --git a/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py b/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py index 03c5a3ce..e4150d8a 100644 --- a/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py +++ b/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py @@ -105,15 +105,6 @@ class TestPVPMultiPathVirtioPerformance(TestCase): self.test_result = {} self.nb_desc = self.test_parameters[64][0] - @property - def check_value(self): - check_dict = dict.fromkeys(self.frame_sizes) - linerate = {64: 0.085, 128: 0.12, 256: 0.20, 512: 0.35, 1024: 0.50, 1280: 0.55, 1518: 0.60} - for size in self.frame_sizes: - speed = self.wirespeed(self.nic, size, self.number_of_ports) - check_dict[size] = round(speed * linerate[size], 2) - return check_dict - def send_and_verify(self, case_info): """ Send packet with packet generator and verify @@ -140,9 +131,6 @@ class TestPVPMultiPathVirtioPerformance(TestCase): traffic_opt = {'delay': 5} _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams, options=traffic_opt) Mpps = pps / 1000000.0 - self.verify(Mpps > self.check_value[frame_size], - "%s of frame size %d speed verify failed, expect %s, result %s" % ( - self.running_case, frame_size, self.check_value[frame_size], Mpps)) linerate = Mpps * 100 / \ float(self.wirespeed(self.nic, frame_size, self.number_of_ports)) self.throughput[frame_size][self.nb_desc] = Mpps From patchwork Tue Sep 14 02:36:18 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ling, WeiX" X-Patchwork-Id: 98821 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 43CECA0C45; Tue, 14 Sep 2021 04:42:31 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3F666410DC; Tue, 14 Sep 2021 04:42:31 +0200 (CEST) Received: from mga18.intel.com (mga18.intel.com [134.134.136.126]) by mails.dpdk.org (Postfix) with ESMTP id 238A2410DC for ; Tue, 14 Sep 2021 04:42:29 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10106"; a="208950523" X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="208950523" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by orsmga106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:42:29 -0700 X-IronPort-AV: E=Sophos;i="5.85,291,1624345200"; d="scan'208";a="471800763" Received: from unknown (HELO localhost.localdomain) ([10.240.183.222]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 13 Sep 2021 19:42:28 -0700 From: Wei Ling To: dts@dpdk.org Cc: Wei Ling Date: Tue, 14 Sep 2021 10:36:18 +0800 Message-Id: <20210914023618.2306195-1-weix.ling@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [dts] [PATCH V1 6/6] conf/pvp_multi_paths_virtio_single_core_performance: modify test parameter and expected value X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Modify test parameter and expected value. Signed-off-by: Wei Ling --- ...multi_paths_virtio_single_core_performance.cfg | 15 +++++++++++++-- 1 file changed, 13 insertions(+), 2 deletions(-) diff --git a/conf/pvp_multi_paths_virtio_single_core_performance.cfg b/conf/pvp_multi_paths_virtio_single_core_performance.cfg index ae25ed3c..a1495e42 100644 --- a/conf/pvp_multi_paths_virtio_single_core_performance.cfg +++ b/conf/pvp_multi_paths_virtio_single_core_performance.cfg @@ -1,6 +1,17 @@ [suite] update_expected = True -test_parameters = {64: [1024], 1518: [1024]} +test_parameters = {64: [1024], 128: [1024], 256: [1024], 512: [1024], 1024: [1024], 1518: [1024]} test_duration = 60 accepted_tolerance = 2 -expected_throughput = {'test_perf_virtio_single_core_virtio11_vectorized': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_virtio_single_core_virtio11_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_virtio_single_core_virtio11_mergeable': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_virtio11_normal': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_virtio11_inorder_mergeable': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_virtio11_inorder_normal': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_inorder_mergeable': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_inorder_normal': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_mergeable': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_normal': {64: {1024: 0.0}, 1518: {1024: 0.0}}, 'test_perf_virtio_single_core_vector_rx': {64: {1024: 0.0}, 1518: {1024: 0.0}}} +expected_throughput = { + 'test_perf_virtio_single_core_virtio11_vectorized': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_virtio11_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_virtio11_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_virtio11_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_virtio11_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_virtio11_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}, + 'test_perf_virtio_single_core_vector_rx': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}}