From patchwork Fri Jul 13 16:19:58 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Pattan, Reshma" X-Patchwork-Id: 43064 Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 005D629AC; Fri, 13 Jul 2018 18:20:42 +0200 (CEST) Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id 62E1716E for ; Fri, 13 Jul 2018 18:20:40 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga008.fm.intel.com ([10.253.24.58]) by orsmga105.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 13 Jul 2018 09:20:39 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.51,348,1526367600"; d="scan'208";a="54823965" Received: from sivswdev02.ir.intel.com (HELO localhost.localdomain) ([10.237.217.46]) by fmsmga008.fm.intel.com with ESMTP; 13 Jul 2018 09:20:09 -0700 From: Reshma Pattan To: thomas@monjalon.net, dev@dpdk.org Cc: anatoly.burakov@intel.com, jananeex.m.parthasarathy@intel.com Date: Fri, 13 Jul 2018 17:19:58 +0100 Message-Id: <1531498808-21940-1-git-send-email-reshma.pattan@intel.com> X-Mailer: git-send-email 1.7.0.7 In-Reply-To: References: Subject: [dpdk-dev] [PATCH v2 00/10] Make unit tests great again X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Previously, unit tests were running in groups. There were technical reasons why that was the case (mostly having to do with limiting memory), but it was hard to maintain and update the autotest script. In 18.05, limiting of memory at DPDK startup was no longer necessary, as DPDK allocates memory at runtime as needed. This has the implication that the old test grouping can now be retired and replaced with a more sensible way of running unit tests (using multiprocessing pool of workers and a queue of tests). This patchset accomplishes exactly that. This patchset merges changes done in [1], [2] and [3] [1] http://dpdk.org/dev/patchwork/patch/40370/ [2] http://dpdk.org/dev/patchwork/patch/40371/ [3] http://patches.dpdk.org/patch/40373/ v2: merged changes done in patch set [1],[2] and [3] and created patches 08/10, 09/10, 10/10 Anatoly Burakov (7): autotest: fix printing autotest: fix invalid code on reports autotest: make autotest runner python 2/3 compliant autotest: visually separate different test categories autotest: improve filtering autotest: remove autotest grouping autotest: properly parallelize unit tests Jananee Parthasarathy (1): mk: update make targets for classified testcases Reshma Pattan (2): autotest: add new test cases to autotest autotest: update result for skipped test cases mk/rte.sdkroot.mk | 4 +- mk/rte.sdktest.mk | 33 +- test/test/autotest.py | 13 +- test/test/autotest_data.py | 1101 +++++++++++++++++++++++--------------- test/test/autotest_runner.py | 519 +++++++++--------- test/test/autotest_test_funcs.py | 6 +- 6 files changed, 972 insertions(+), 704 deletions(-)