From patchwork Thu Apr 13 17:54:14 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Jeremy Spewock X-Patchwork-Id: 126035 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 3ADBE42935; Thu, 13 Apr 2023 19:54:49 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A9BB24113D; Thu, 13 Apr 2023 19:54:48 +0200 (CEST) Received: from mail-pg1-f228.google.com (mail-pg1-f228.google.com [209.85.215.228]) by mails.dpdk.org (Postfix) with ESMTP id 23052410F9 for ; Thu, 13 Apr 2023 19:54:48 +0200 (CEST) Received: by mail-pg1-f228.google.com with SMTP id 41be03b00d2f7-517bdc9e81dso236145a12.1 for ; Thu, 13 Apr 2023 10:54:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1681408487; x=1684000487; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=ui1dMgI1IU4YS9Y7k3ZfJ+WlOB3+AbGB1V80dslfOig=; b=YmHSZzHjywcvU6VhgF8/z+bfoTuNDOPPRgGD9xegyJNUJRMZdJzjAyO5bspCwDPiUo ec67yDUZhw/M/WPK5lSmJfCgcgsvlbjUzIBPDFolsO46QssxirrX+L0GQC9cwRcfydOp ZDH8/suPL6o/wk5ZEnTmWEcKFWWkX79R1spGA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681408487; x=1684000487; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ui1dMgI1IU4YS9Y7k3ZfJ+WlOB3+AbGB1V80dslfOig=; b=Lvqe/GfnciLJcKfzzeBWkDGZ6MB9+LSLiBx/ICrrZIvoCusRrqQEqe8trj+Z+HBOqk qlm61ooNVg8R7+YdMR4dllH2bMwtYeK0/4AWlyPdq9aS8Bf57VvEpIcy9penKgUaShlL a59gkh7ptlkMXrGnHHgCcdPjvj12ZZ3Es7dd7cPzrpiDFRjOpVZ14M8F0kD8n8LOvn35 2N2BiGQRjntVW8zdzoQhh0rj2Hsl+3kNNm+jsCgWO1tTR8hAvCS2vx04gSaO8nuUdhYn fY2J5IxHyLT0hsG7p27wNa/y+MXSjDkUeYQNc3ycPbzVekeumGUzmH1jWIiOs28h5t/p vrvA== X-Gm-Message-State: AAQBX9dH7DygJoWRksk0GbSJd4Yp99rFSRsOSvOPN9eQcAXJUm/AGmO9 dENsnUB1i4BiDenf+MQlwhEd3ZKnwSImuW4p5NTc9KLFRlS4rjRlA7YMgNwW/Os1QgP75Vz4gmd XpMlJr5xl2dI27Q/NSYN7sYzDEXqxcBFhnox0pV9TyyqUFgjnNWTBS2icBWiW4lR+Q/GKevKIU3 mb2JTCP3o0ZyTQ3owxPV67fw== X-Google-Smtp-Source: AKy350YG79bKULtsvyquHBojaZs21+H80aM7JOXnbDnkXWoSu7jsSj68AYKO/FbWbq5TnTwk4hIQnWR0jgux X-Received: by 2002:a05:6a00:2283:b0:62d:e5eb:2d73 with SMTP id f3-20020a056a00228300b0062de5eb2d73mr4914336pfe.34.1681408487181; Thu, 13 Apr 2023 10:54:47 -0700 (PDT) Received: from postal.iol.unh.edu (postal.iol.unh.edu. [2606:4100:3880:1234::84]) by smtp-relay.gmail.com with ESMTPS id s27-20020a056a00179b00b0063b21855a83sm452878pfg.19.2023.04.13.10.54.47 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 13 Apr 2023 10:54:47 -0700 (PDT) X-Relaying-Domain: iol.unh.edu Received: from iol.unh.edu (unknown [IPv6:2606:4100:3880:1220:58fe:317e:37bd:a524]) by postal.iol.unh.edu (Postfix) with ESMTP id 8CE26605246B; Thu, 13 Apr 2023 13:54:46 -0400 (EDT) From: jspewock@iol.unh.edu To: dev@dpdk.org Cc: Jeremy Spewock Subject: [RFC PATCH 0/1] add DTS smoke tests Date: Thu, 13 Apr 2023 13:54:14 -0400 Message-Id: <20230413175415.7683-2-jspewock@iol.unh.edu> X-Mailer: git-send-email 2.40.0 MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Jeremy Spewock This patch series adds a set of smoke tests to be run at the beginning of DTS execution. The point is to validate the user’s setup before running “real” tests. This helps save time by bailing out of DTS early when the setup is not valid, and also prevents DTS displaying “false failures” associated with an incorrect DTS setup. More specificially, these tests will verify the following: * DPDK fast-tests suite * DPDK driver-test suite * Devices are bound to the correct driver * General information about the SUT (kernel version, compiler version, etc.) * DPDK testpmd starts, stops, and receives packets Jeremy Spewock (1): dts: add smoke tests dts/conf.yaml | 7 ++- dts/framework/config/__init__.py | 15 ++++++ dts/framework/config/conf_yaml_schema.json | 16 +++++- dts/framework/dts.py | 19 ++++++- dts/framework/exception.py | 11 ++++ dts/framework/test_result.py | 13 +++-- dts/framework/test_suite.py | 24 ++++++++- dts/tests/TestSuite_smoke_tests.py | 63 ++++++++++++++++++++++ 8 files changed, 159 insertions(+), 9 deletions(-) create mode 100644 dts/tests/TestSuite_smoke_tests.py