From patchwork Thu Jun 15 20:10:58 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jeremy Spewock X-Patchwork-Id: 128759 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 699BE42CCA; Thu, 15 Jun 2023 22:13:50 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3CED840E0F; Thu, 15 Jun 2023 22:13:50 +0200 (CEST) Received: from mail-pl1-f225.google.com (mail-pl1-f225.google.com [209.85.214.225]) by mails.dpdk.org (Postfix) with ESMTP id 0958D40A8B for ; Thu, 15 Jun 2023 22:13:49 +0200 (CEST) Received: by mail-pl1-f225.google.com with SMTP id d9443c01a7336-1b52bf6e669so25495ad.2 for ; Thu, 15 Jun 2023 13:13:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1686860028; x=1689452028; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=5QALC3nizYKxOWcvvQmAq+l8HU0ThPpRx6q5ZjlJsUc=; b=BEvJrzEQZBXekjEGDIA7qANgTfXYaJrDN7uIVeN0iZ7OUnlUUYZ6qn7A8XTtcvJSnU ZPqAT98K5VvT+uDhz9YppFNNXn1HDsv/wfxwEnObkC8+QMzRSpW9PyKXJ84WfOtrXuGk axXOI5cHPOYcMdrOW4htjV6oDDw7uIIklMvck= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1686860028; x=1689452028; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=5QALC3nizYKxOWcvvQmAq+l8HU0ThPpRx6q5ZjlJsUc=; b=PYG8bWARUQQbItKoqR5ixkw6n4KOOc++3/kxmIA36RDeYQo8cytKIFr55wtxk1iqsP Hp//jdP7B6udh0/FarKrmLoNUMEWJrkHGDNjYWZvzwMGWQ+OgYhrwiXr0MCkrZllxm9c 7CRnXfiP1X23HfCNRDDNBm3gVOowOeW94LUMLHFoEaqx8L2TX04Dqw1CgYunRUaOZMx0 E5pH4GmGfbTkrE4+K97fruP/xuv0PYop20apvEEudWrvk2XP3ODiBHhRdZcJc4iDxpYO 5BzSFVssPvDJhaQEaNmmgiy9dntwy+9uUx4/42tQJIXf+5Lz3m8SK0yJuPMDeXXCKXvb Bogg== X-Gm-Message-State: AC+VfDyYgBJV+XZK9EXtqp+i0ob9yiAaSIJAqEtzeuxw0VkrFTD8IawR dQHOPSKS4AUZVc4STEaH2MVczBnJYZZuTZh+dyJTqVOR+4F7+Apla5o+szPmgwgb2Q== X-Google-Smtp-Source: ACHHUZ4DfWeIUvhybXzH6KLQokuV8Dck8Tab6rzAYcNpyIgIHIUU1Sqdu6S8MGOIvZ+SJMS/dFs+z3ocEtuB X-Received: by 2002:a17:902:aa97:b0:1b2:28ca:d16 with SMTP id d23-20020a170902aa9700b001b228ca0d16mr47584plr.44.1686860028224; Thu, 15 Jun 2023 13:13:48 -0700 (PDT) Received: from postal.iol.unh.edu (postal.iol.unh.edu. [2606:4100:3880:1234::84]) by smtp-relay.gmail.com with ESMTPS id jf3-20020a170903268300b0019c14561447sm1155566plb.44.2023.06.15.13.13.48 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 15 Jun 2023 13:13:48 -0700 (PDT) X-Relaying-Domain: iol.unh.edu Received: from iol.unh.edu (unknown [IPv6:2606:4100:3880:1271:90f9:1b64:f6e6:867f]) by postal.iol.unh.edu (Postfix) with ESMTP id 68D19605246B; Thu, 15 Jun 2023 16:13:47 -0400 (EDT) From: jspewock@iol.unh.edu To: Honnappa.Nagarahalli@arm.com, juraj.linkes@pantheon.tech, thomas@monjalon.net, lijuan.tu@intel.com, wathsala.vithanage@arm.com, probb@iol.unh.edu Cc: dev@dpdk.org, Jeremy Spewock Subject: [PATCH v1 0/2] Add DTS smoke tests Date: Thu, 15 Jun 2023 16:10:58 -0400 Message-ID: <20230615201318.13359-2-jspewock@iol.unh.edu> X-Mailer: git-send-email 2.41.0 MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Jeremy Spewock This series adds smoke tests for the new DTS framework which includes various tests to ensure the environment was setup properly. The idea behind these tests are to ensure the integrity of the environment before starting the execution of DTS to "fail-fast" with more informative logging. It tests things such as, meson driver-test and fast-test suites, NICs being bound to the correct driver, and ensuring these devices are present in testpmd. RFCs for this patch: * v3: https://mails.dpdk.org/archives/dev/2023-June/269859.html * v2: https://mails.dpdk.org/archives/dev/2023-May/267915.html * v1: https://mails.dpdk.org/archives/dev/2023-April/266580.html Jeremy Spewock (2): dts: add smoke tests dts: added paramiko to dependencies dts/conf.yaml | 13 ++ dts/framework/config/__init__.py | 114 +++++++++++-- dts/framework/config/conf_yaml_schema.json | 135 ++++++++++++++- dts/framework/dts.py | 101 ++++++++--- dts/framework/exception.py | 12 ++ dts/framework/remote_session/__init__.py | 10 +- dts/framework/remote_session/os_session.py | 34 +++- dts/framework/remote_session/posix_session.py | 30 ++++ .../remote_session/remote/__init__.py | 12 ++ .../remote/interactive_remote_session.py | 113 +++++++++++++ .../remote/interactive_shell.py | 98 +++++++++++ .../remote_session/remote/testpmd_shell.py | 58 +++++++ dts/framework/test_result.py | 38 ++++- dts/framework/test_suite.py | 31 +++- dts/framework/testbed_model/node.py | 2 + dts/framework/testbed_model/sut_node.py | 110 +++++++++++- dts/poetry.lock | 160 ++++++++++++++---- dts/pyproject.toml | 1 + dts/tests/TestSuite_smoke_tests.py | 101 +++++++++++ 19 files changed, 1086 insertions(+), 87 deletions(-) create mode 100644 dts/framework/remote_session/remote/interactive_remote_session.py create mode 100644 dts/framework/remote_session/remote/interactive_shell.py create mode 100644 dts/framework/remote_session/remote/testpmd_shell.py create mode 100644 dts/tests/TestSuite_smoke_tests.py