Cover Detail
Show a cover letter.
GET /api/covers/89237/?format=api
{ "id": 89237, "url": "https://patches.dpdk.org/api/covers/89237/?format=api", "web_url": "https://patches.dpdk.org/project/dpdk/cover/20210316143253.3849182-1-ciara.power@intel.com/", "project": { "id": 1, "url": "https://patches.dpdk.org/api/projects/1/?format=api", "name": "DPDK", "link_name": "dpdk", "list_id": "dev.dpdk.org", "list_email": "dev@dpdk.org", "web_url": "http://core.dpdk.org", "scm_url": "git://dpdk.org/dpdk", "webscm_url": "http://git.dpdk.org/dpdk", "list_archive_url": "https://inbox.dpdk.org/dev", "list_archive_url_format": "https://inbox.dpdk.org/dev/{}", "commit_url_format": "" }, "msgid": "<20210316143253.3849182-1-ciara.power@intel.com>", "list_archive_url": "https://inbox.dpdk.org/dev/20210316143253.3849182-1-ciara.power@intel.com", "date": "2021-03-16T14:32:47", "name": "[0/6] test: refactor crypto unit test framework", "submitter": { "id": 978, "url": "https://patches.dpdk.org/api/people/978/?format=api", "name": "Power, Ciara", "email": "ciara.power@intel.com" }, "mbox": "https://patches.dpdk.org/project/dpdk/cover/20210316143253.3849182-1-ciara.power@intel.com/mbox/", "series": [ { "id": 15699, "url": "https://patches.dpdk.org/api/series/15699/?format=api", "web_url": "https://patches.dpdk.org/project/dpdk/list/?series=15699", "date": "2021-03-16T14:32:47", "name": "test: refactor crypto unit test framework", "version": 1, "mbox": "https://patches.dpdk.org/series/15699/mbox/" } ], "comments": "https://patches.dpdk.org/api/covers/89237/comments/", "headers": { "Return-Path": "<dev-bounces@dpdk.org>", "X-Original-To": "patchwork@inbox.dpdk.org", "Delivered-To": "patchwork@inbox.dpdk.org", "Received": [ "from mails.dpdk.org (mails.dpdk.org [217.70.189.124])\n\tby inbox.dpdk.org (Postfix) with ESMTP id CB355A054F;\n\tTue, 16 Mar 2021 15:33:02 +0100 (CET)", "from [217.70.189.124] (localhost [127.0.0.1])\n\tby mails.dpdk.org (Postfix) with ESMTP id 87E0D26005B;\n\tTue, 16 Mar 2021 15:33:02 +0100 (CET)", "from mga11.intel.com (mga11.intel.com [192.55.52.93])\n by mails.dpdk.org (Postfix) with ESMTP id D89824069F\n for <dev@dpdk.org>; Tue, 16 Mar 2021 15:33:00 +0100 (CET)", "from orsmga006.jf.intel.com ([10.7.209.51])\n by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;\n 16 Mar 2021 07:32:59 -0700", "from silpixa00400355.ir.intel.com (HELO\n silpixa00400355.ger.corp.intel.com) ([10.237.223.148])\n by orsmga006.jf.intel.com with ESMTP; 16 Mar 2021 07:32:58 -0700" ], "IronPort-SDR": [ "\n lYhqcopjIXg8owFW9v/KPGWbpB2qM8tC7PNgegT4tuPdHenm/4dQQvbgwKUnsdaY8wfB5a0PeN\n 0ruvVZeuqnIg==", "\n 1aWNfoKumoSWwEB5FlxOARzT1EGe4INMNxa/6coSGyJMcXyjhaZ0g+2omswoKrtL8Eo5TN0Cyz\n jKKBmyyb5rjw==" ], "X-IronPort-AV": [ "E=McAfee;i=\"6000,8403,9924\"; a=\"185906428\"", "E=Sophos;i=\"5.81,251,1610438400\"; d=\"scan'208\";a=\"185906428\"", "E=Sophos;i=\"5.81,251,1610438400\"; d=\"scan'208\";a=\"373805401\"" ], "X-ExtLoop1": "1", "From": "Ciara Power <ciara.power@intel.com>", "To": "dev@dpdk.org", "Cc": "declan.doherty@intel.com,\n\tCiara Power <ciara.power@intel.com>", "Date": "Tue, 16 Mar 2021 14:32:47 +0000", "Message-Id": "<20210316143253.3849182-1-ciara.power@intel.com>", "X-Mailer": "git-send-email 2.25.1", "MIME-Version": "1.0", "Content-Transfer-Encoding": "8bit", "Subject": "[dpdk-dev] [PATCH 0/6] test: refactor crypto unit test framework", "X-BeenThere": "dev@dpdk.org", "X-Mailman-Version": "2.1.29", "Precedence": "list", "List-Id": "DPDK patches and discussions <dev.dpdk.org>", "List-Unsubscribe": "<https://mails.dpdk.org/options/dev>,\n <mailto:dev-request@dpdk.org?subject=unsubscribe>", "List-Archive": "<http://mails.dpdk.org/archives/dev/>", "List-Post": "<mailto:dev@dpdk.org>", "List-Help": "<mailto:dev-request@dpdk.org?subject=help>", "List-Subscribe": "<https://mails.dpdk.org/listinfo/dev>,\n <mailto:dev-request@dpdk.org?subject=subscribe>", "Errors-To": "dev-bounces@dpdk.org", "Sender": "\"dev\" <dev-bounces@dpdk.org>" }, "content": "The current crypto unit test framework is not granular enough to\naccurately track unit test results. This is caused by one testcase\nin a suite actually running multiple testcases, but only returning\none result.\n \nThe approach taken in this patchset allows a test suite have either a\nlist of sub-testsuites, or a list of testcases as previously used.\nThe unit test suite runner can then recursively iterate and run the\nsub-testsuites, until it reaches a suite with testcases,\nand it then runs each testcase as it had done previously.\n \nBy allowing this further breakdown into sub-testsuites,\na refactor of the crypto unit tests solves the issue of inaccurate\nreporting, as sub-testsuites can be used in place of the testcases\nthat had multiple testcases hidden on a sub level.\nThe blockcipher tests previously had these hidden testcases,\nbut are now sub-testsuites that are dynamically created and added to a\nparent test suite, allowing for each testcase status to be reported\ndirectly to the runner.\nThe cryptodev test suite is broken down into smaller suites that are\nused as sub-testsuites, which allows for more flexibility choosing which\nsub-testsuites should run for the current device autotest.\nThe introduction of sub-testsuites also allows for more precise\nsetup/teardown functions, rather than general ones loaded with\nconditions as was seen with the initial setup function used for all\ncrypto testsuites.\n \nFor example, when running the cryptodev_aesni_mb_autotest, \nthe AESNI MB parent test suite has its own setup function to initialise\nthe AESNI MB device.\nVarious sub-testsuites are added to the parent test suite, such as some\nof the static suites that were once in the cryptodev_testsuite,\nand blockcipher suites.\nThe unit test runner can then run the AESNI MB parent test suite,\nwhich in turn will run the sub-testsuites.\n \nDocumentation will be added in a later version of the patchset,\nadding to the test document that isn't yet merged. [1]\n\n---\n[1] https://patchwork.dpdk.org/project/dpdk/patch/20210309155757.615536-1-aconole@redhat.com/\n\nCiara Power (6):\n app/test: refactor of unit test suite runner\n test: introduce parent testsuite format\n test/crypto: refactor to use sub-testsuites\n test/crypto: move testsuite params to header file\n test/crypto: dynamically build blockcipher suite\n doc: add unit test suite change to release notes\n\n app/test/test.c | 168 +-\n app/test/test.h | 22 +-\n app/test/test_bitratestats.c | 4 +-\n app/test/test_compressdev.c | 4 +-\n app/test/test_cryptodev.c | 2020 ++++++++++++++++++------\n app/test/test_cryptodev.h | 20 +\n app/test/test_cryptodev_asym.c | 105 +-\n app/test/test_cryptodev_blockcipher.c | 121 +-\n app/test/test_cryptodev_blockcipher.h | 12 +-\n app/test/test_ethdev_link.c | 4 +-\n app/test/test_event_crypto_adapter.c | 4 +-\n app/test/test_event_eth_rx_adapter.c | 8 +-\n app/test/test_event_eth_tx_adapter.c | 4 +-\n app/test/test_event_timer_adapter.c | 4 +-\n app/test/test_eventdev.c | 4 +-\n app/test/test_fbarray.c | 4 +-\n app/test/test_fib.c | 8 +-\n app/test/test_fib6.c | 8 +-\n app/test/test_graph.c | 4 +-\n app/test/test_graph_perf.c | 4 +-\n app/test/test_ipfrag.c | 4 +-\n app/test/test_ipsec.c | 36 +-\n app/test/test_ipsec_sad.c | 4 +-\n app/test/test_latencystats.c | 4 +-\n app/test/test_link_bonding.c | 4 +-\n app/test/test_link_bonding_mode4.c | 4 +-\n app/test/test_link_bonding_rssconf.c | 4 +-\n app/test/test_metrics.c | 4 +-\n app/test/test_pmd_ring.c | 4 +-\n app/test/test_reorder.c | 4 +-\n app/test/test_rib.c | 8 +-\n app/test/test_rib6.c | 8 +-\n app/test/test_security.c | 4 +-\n app/test/test_service_cores.c | 4 +-\n app/test/test_trace.c | 4 +-\n doc/guides/rel_notes/release_21_05.rst | 5 +\n 36 files changed, 1898 insertions(+), 739 deletions(-)" }