From patchwork Tue Feb 14 17:40:25 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Michael Baum X-Patchwork-Id: 123903 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id EC05D41C97; Tue, 14 Feb 2023 18:40:52 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 839B8410EF; Tue, 14 Feb 2023 18:40:52 +0100 (CET) Received: from NAM02-BN1-obe.outbound.protection.outlook.com (mail-bn1nam02on2048.outbound.protection.outlook.com [40.107.212.48]) by mails.dpdk.org (Postfix) with ESMTP id 37459410D1 for ; Tue, 14 Feb 2023 18:40:51 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hVYhMq+tSBwOTcqtK5qVs5kE19O6L2fz4pAhKpFDEyHWZJ+OJtF5qtb9FspwbTaTl6S5zlqZj5OLdfvTuQmOiFDOJuinHZwnSGOq6JIYfUxF3aMiDekH+Q8zyr1F7eb0yrD7o9aLUM0tGAR0Oku5SJUDVsH5/njMJbkDKXlgHLEg38P1w7CHBapRrxOC1KNyzQ5Tg5DiomkAC7NGHi4wsE8CCzZhwDDZxR6iBSchI9ealbtjSb67CttOoHtsymnOViIk/VAGw2X7fbC7e4J07MXzygAYVvNql3Wc+2NS3N4xoisR3bCwzSLZH7LslYYZZ2f3jLqn0PaoPK1JgGzCxg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=AVfxIvdaa2HpYzLs6v4SST6UR6v7e4TVWX5faE1oPdc=; b=f1u1DTsODDgAMfxMGnc7cD1lDeucyQ+cqjDYMQi0qr0F2auob5W13DoD8B3BZW/678ievMbYl+6jNGx/6MHf2FuA+DMqnEPJlu7MMA8+mjPsC9FkCcTcLUUW86ltD8GqnqDyeXdWq6ugteo9BZuzFL2asFFE5R/vH9LlVJlmlFeN69fZeS5GK+WpwTR8DGBxnVaX0G8Cn459652ZGcrOArgL6RwxCPTIaQVWx+PcAheBK03S+QhWKzZjJjMP1vA0hJTq51n8lRH67x4NYkaO+yhXnLeX4bgwuSxHJ0N64BU7zHxVR3+Wl/+AayNBrzllr3R6O4ux+/EwD4rs3Ng16g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=AVfxIvdaa2HpYzLs6v4SST6UR6v7e4TVWX5faE1oPdc=; b=RYJ4pC6Kxj+9ZdfrtLkQ+yGK9BNTK52W4zbFJ2mgzG8tLU0lHqaLOQ/2TRpIRP06fLsCTviVKd1EYjQX27N9Sh6MVnnHe8Tml9MdhdfPgf1FxqQQ8BMGrKkKCEZwn2IX7jp8mRwqhl0uJ7I4YCAgZbZ49oJAItMfPZvuYt7VYWZCfsv82M3cBGxbIsJSkye9gr20Am1QQdFLiOfWROt5qa0u52AJJhf8ZqxbQbuf8iynVyn88z5bxRP/CUDpqZXzN66tb00nSw4N2g4yoR6jNrKSzDc7kr+jU2q/eVqs8TkiH+uwUd8f3jF7F4TYCKf7d7kZhufiKI5Miok4wMkONQ== Received: from DM6PR06CA0036.namprd06.prod.outlook.com (2603:10b6:5:120::49) by SJ0PR12MB6990.namprd12.prod.outlook.com (2603:10b6:a03:449::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6086.26; Tue, 14 Feb 2023 17:40:49 +0000 Received: from DM6NAM11FT018.eop-nam11.prod.protection.outlook.com (2603:10b6:5:120:cafe::94) by DM6PR06CA0036.outlook.office365.com (2603:10b6:5:120::49) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6086.26 via Frontend Transport; Tue, 14 Feb 2023 17:40:49 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by DM6NAM11FT018.mail.protection.outlook.com (10.13.172.110) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6086.24 via Frontend Transport; Tue, 14 Feb 2023 17:40:48 +0000 Received: from rnnvmail202.nvidia.com (10.129.68.7) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Tue, 14 Feb 2023 09:40:35 -0800 Received: from rnnvmail202.nvidia.com (10.129.68.7) by rnnvmail202.nvidia.com (10.129.68.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Tue, 14 Feb 2023 09:40:35 -0800 Received: from nvidia.com (10.127.8.13) by mail.nvidia.com (10.129.68.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36 via Frontend Transport; Tue, 14 Feb 2023 09:40:33 -0800 From: Michael Baum To: CC: Matan Azrad , Akhil Goyal , "Ashish Gupta" , Fiona Trahe , "Thomas Monjalon" Subject: [PATCH v4 0/4] compressdev: add LZ4 support Date: Tue, 14 Feb 2023 19:40:25 +0200 Message-ID: <20230214174029.2397125-1-michaelba@nvidia.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230213061140.2157499-1-michaelba@nvidia.com> References: <20230213061140.2157499-1-michaelba@nvidia.com> MIME-Version: 1.0 X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM6NAM11FT018:EE_|SJ0PR12MB6990:EE_ X-MS-Office365-Filtering-Correlation-Id: 914d9c7d-61d4-488d-fea8-08db0eb29c20 X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: azgVF0ss7MH81jIpsqFJgdS5MLOLvv2flGoSRIs+9xpjsUhDOXu3G95J+EUXZivwrvWwB8ZLrzdsePHLjUGVUP769UkwM1mjx2/DPpNkZBhJ7xClNjW+AIFWfsqRIGAUmk6G0efP4CkDB3BhcTEiv4Vha9euAAvAIHdv8i3fDdISYbqy595lSLimwR3URVQlYx7XDdWNdr7CPYmU048TtKFimuIn+y/LME7RL8WsVtJ9vNEEFh+FjelnrPykhZTP2NMhdejlXE2acZkbSSFZfLFdRJJscVBEk9WIu8O371qAkrK+BsZF8uaXlBeVB3oDQ4zrWNCdIktJ7KYnlJqB2RLEkEl7PTGQ1r5lR5eSgD752JPuKtbD4o3WNvCAv2HCEEYcEVIVHGQA81fHstsupBn7AOyFxbayBRzQu7cnf1g1Lyi2qdFht+IIeBISDLxf2zf4+2ax/dEKivNS4RQ5C32zpgHuB7H6gEnPOs2ORvWvgaaJeR6EPq08MxH0/PGkYNczC1dslI9x691DaAOD+1q3bSGzE8/aIbrBIyf2ef4utPakUVACgd6oL62xWzPo1JBpKvVqxEBF3nRLb+GO8D+VEGSNDQR9oxZ9txLYzvUQCQ8g0qZM+w8hzg15ueT8eNB9BkpDREci8NVuAMMxpz6cSb2gXg3pC2ECoDxxwZgZTROD0S4wU4ZajT4AX2odjsavBrZ6wA58d/jfuiBSTwAqoFiyW48Y26MewxN02+LGSgi8iI/c12KS7+D4HpHQoLTWBubfHQs1sfuO0pZF6Z2jSIYMjfQFIXFu09c9W9o= X-Forefront-Antispam-Report: CIP:216.228.117.161; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge2.nvidia.com; CAT:NONE; SFS:(13230025)(4636009)(396003)(346002)(39860400002)(376002)(136003)(451199018)(40470700004)(36840700001)(46966006)(1076003)(47076005)(7636003)(82310400005)(82740400003)(478600001)(966005)(186003)(7696005)(26005)(2906002)(356005)(6286002)(40460700003)(83380400001)(86362001)(36860700001)(426003)(316002)(54906003)(6666004)(41300700001)(70206006)(36756003)(40480700001)(336012)(6916009)(2616005)(8936002)(5660300002)(4326008)(55016003)(8676002)(70586007); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Feb 2023 17:40:48.7870 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 914d9c7d-61d4-488d-fea8-08db0eb29c20 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.161]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: DM6NAM11FT018.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR12MB6990 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Add support for LZ4 compression algorithm for both API and app. In addition, enable app to test de/comp only. This option already exists in both app doc and arguments but isn't implemented inside the application. LZ4: https://github.com/lz4/lz4 RFC: https://patchwork.dpdk.org/project/dpdk/patch/20220410182622.8828-1-rzidane@nvidia.com/ v2: - Add macros for all LZ4 flags in the standard. - Rebase. v3: - Rebase. v4: - Change "allow test single" commit to fix and add "Cc: stable@dpdk.org". - Take all typo fixes into separate commit. - Squash "add LZ4 algo" commit into "add algo option" commit. - Remove unnecessary release notes updates. Michael Baum (4): compressdev: add LZ4 algorithm support app/test-compress-perf: fix some typos app/test-compress-perf: fix missing test single compress op app/test-compress-perf: add algo option app/test-compress-perf/comp_perf_options.h | 9 +- .../comp_perf_options_parse.c | 83 +++++++++++- .../comp_perf_test_common.c | 126 +++++++++++++----- .../comp_perf_test_cyclecount.c | 82 +++++++----- .../comp_perf_test_throughput.c | 75 +++++++---- .../comp_perf_test_verify.c | 75 +++++++---- app/test-compress-perf/main.c | 63 +++++++-- doc/guides/compressdevs/features/default.ini | 7 + doc/guides/rel_notes/release_23_03.rst | 7 + doc/guides/tools/comp_perf.rst | 5 + lib/compressdev/rte_comp.c | 12 ++ lib/compressdev/rte_comp.h | 79 ++++++++++- 12 files changed, 479 insertions(+), 144 deletions(-)