[v6,00/10] Make unit tests great again

Message ID 1532684420-29500-1-git-send-email-reshma.pattan@intel.com (mailing list archive)
Headers
Series Make unit tests great again |

Message

Pattan, Reshma July 27, 2018, 9:40 a.m. UTC
Previously, unit tests were running in groups. There were technical
reasons why that was the case (mostly having to do with limiting memory),
but it was hard to maintain and update the autotest script.
In 18.05, limiting of memory at DPDK startup was no longer necessary,
as DPDK allocates memory at runtime as needed. This has the implication
that the old test grouping can now be retired and replaced with a more
sensible way of running unit tests (using multiprocessing pool of workers
and a queue of tests). This patchset accomplishes exactly that.

This patchset merges changes done in [1], [2]

[1] http://dpdk.org/dev/patchwork/patch/40370/
[2] http://patches.dpdk.org/patch/40373/

Removed unused and duplicate make rules for test-basic, 
test-mempool, test-ring from make file system in patch 10/10.

v5: Corrected the patch Authorship.


Anatoly Burakov (7):
  autotest: fix printing
  autotest: fix invalid code on reports
  autotest: make autotest runner python 2/3 compliant
  autotest: visually separate different test categories
  autotest: improve filtering
  autotest: remove autotest grouping
  autotest: properly parallelize unit tests

Jananee Parthasarathy (2):
  autotest: update autotest test case list
  mk: update make targets for classified testcases

Reshma Pattan (1):
  mk: remove unnecessary make rules of test

 mk/rte.sdkroot.mk            |    4 +-
 mk/rte.sdktest.mk            |   32 +-
 test/test/autotest.py        |   13 +-
 test/test/autotest_data.py   | 1081 +++++++++++++++++++++++++-----------------
 test/test/autotest_runner.py |  519 ++++++++++----------
 5 files changed, 947 insertions(+), 702 deletions(-)
  

Comments

Thomas Monjalon July 31, 2018, 2:41 p.m. UTC | #1
27/07/2018 11:40, Reshma Pattan:
> Previously, unit tests were running in groups. There were technical
> reasons why that was the case (mostly having to do with limiting memory),
> but it was hard to maintain and update the autotest script.
> In 18.05, limiting of memory at DPDK startup was no longer necessary,
> as DPDK allocates memory at runtime as needed. This has the implication
> that the old test grouping can now be retired and replaced with a more
> sensible way of running unit tests (using multiprocessing pool of workers
> and a queue of tests). This patchset accomplishes exactly that.
> 
> This patchset merges changes done in [1], [2]
> 
> [1] http://dpdk.org/dev/patchwork/patch/40370/
> [2] http://patches.dpdk.org/patch/40373/
> 
> Removed unused and duplicate make rules for test-basic, 
> test-mempool, test-ring from make file system in patch 10/10.
> 
> v5: Corrected the patch Authorship.
> 
> 
> Anatoly Burakov (7):
>   autotest: fix printing
>   autotest: fix invalid code on reports
>   autotest: make autotest runner python 2/3 compliant
>   autotest: visually separate different test categories
>   autotest: improve filtering
>   autotest: remove autotest grouping
>   autotest: properly parallelize unit tests
> 
> Jananee Parthasarathy (2):
>   autotest: update autotest test case list
>   mk: update make targets for classified testcases
> 
> Reshma Pattan (1):
>   mk: remove unnecessary make rules of test

Applied, thanks