From patchwork Wed Jun 30 07:01:06 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Dmitry Kozlyuk X-Patchwork-Id: 95039 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 891CBA0A0F; Wed, 30 Jun 2021 09:01:39 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5226740141; Wed, 30 Jun 2021 09:01:39 +0200 (CEST) Received: from NAM02-DM3-obe.outbound.protection.outlook.com (mail-dm3nam07on2081.outbound.protection.outlook.com [40.107.95.81]) by mails.dpdk.org (Postfix) with ESMTP id 20E4640040; Wed, 30 Jun 2021 09:01:38 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=gyI69YE6AnXygMfjwrkYPBhjNd3RUnpfQt+qX8N+WqnL/K0FASVi75u24CW74pzWM3iiIdcnU/CDN+e8Wa2iZI5/SzZKiUbrDAMYQqRHfE5azIkPzPVHp1KInR8H0DsaO+HVW8zGXgaErLD8Xj0H612G3RBRA5/6xtEFJzy6whG25ioK7oxlYx/2Pp/CavfEo/KEEucoN5/Rx15ANpPWA8XB6oYGry4KnPIn22j8WiKimpuXx9YrqDEReFmxccDkNXvpKHAYVdX4UH+s2mEisVAbEsFaSzdkT+pU1+Z2Th+rGogjbO1b0ts9MX6ZuZ8BpqUXCucDQ2ciY+VlmCsamA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qMGTVKde1dRKO8N4jGUkyTO/dLCtcsnUYCpta2yCskQ=; b=fGqE8Fvp81iLeFkkv9s3qd3WlENwPHoS/gpzBBxX61hqfMbuRUdZbbEt784L7n57U9ne6TfkApCZjRoyUivmj2nhHup+WwGaoLDdm79zG7OtZo8e0q30Bu7QEt+JprhU6k3Q2JZKtPSvapW51526QQDD3MkkLEzt03e7nGi9SXmtNm4WZo6ajuPFSS9b70MNk+z2xkqZh2sMnMn2C8uDCnthkaGu5A+orcluYlGPD+5RWdpU6SXRF3zw5et4ODONZ9bI7CleSFTI5DFtOijkgzakk928U1UrX15litpn2KggxOw0hts5/6QYRkL1tWgWSZzCl9oPHBsOrjF8/G5oJg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.34) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qMGTVKde1dRKO8N4jGUkyTO/dLCtcsnUYCpta2yCskQ=; b=GR8GNbN0eLgW7hIbJU9BVjHXt0s8MTSFpc/tUETquh8d7A7AksLcqkKU3jvgFNigpMSBnL0XV0ax6qogliwgzGyz9o//JMIVg/8VUqRQumgBfv+o/07O/Okyf5ORkLJI7zL/RmqdP3MR50GFRGLfdti+h6xKHC4OAl1IIAhmS48Y5RRlYD3VL7EE3/QTNOhjKKx/T6Djn8QcPcanSlw4zZKHzGJniY4Jg3SXnySJscEw6ak/bZ2tA4iEGIJYUKbSvVjtl1exixKNyqj/Vl8NTvBtDJ6mJNJU5KOZZafMCZcuEQYgbb+3pcSn3hHJysxpXTkWoEcuPVn5SMvn924uTQ== Received: from BN6PR14CA0007.namprd14.prod.outlook.com (2603:10b6:404:79::17) by MN2PR12MB4829.namprd12.prod.outlook.com (2603:10b6:208:1b6::26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4264.19; Wed, 30 Jun 2021 07:01:35 +0000 Received: from BN8NAM11FT028.eop-nam11.prod.protection.outlook.com (2603:10b6:404:79:cafe::fd) by BN6PR14CA0007.outlook.office365.com (2603:10b6:404:79::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.23 via Frontend Transport; Wed, 30 Jun 2021 07:01:35 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.34) smtp.mailfrom=nvidia.com; dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.34 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.34; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.34) by BN8NAM11FT028.mail.protection.outlook.com (10.13.176.225) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4264.18 via Frontend Transport; Wed, 30 Jun 2021 07:01:35 +0000 Received: from nvidia.com (172.20.187.5) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 30 Jun 2021 07:01:33 +0000 From: Dmitry Kozlyuk To: CC: , Viacheslav Ovsiienko , "Matan Azrad" , Shahaf Shuler Date: Wed, 30 Jun 2021 10:01:06 +0300 Message-ID: <20210630070106.661928-1-dkozlyuk@nvidia.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-Originating-IP: [172.20.187.5] X-ClientProxiedBy: HQMAIL111.nvidia.com (172.20.187.18) To HQMAIL107.nvidia.com (172.20.187.13) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: edd18777-0667-481f-3132-08d93b94e67b X-MS-TrafficTypeDiagnostic: MN2PR12MB4829: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:7691; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: a+Y7UFa8xzMbT0ewnxuPHZoMeIBTje6suJbdeXHgKtqS2U7y85I19EGQ1LJcSFwzAaeSosIp0byNdJ+/qgEenYEMMuT8DMD55KT+QdrN3MmNwE51DCXpcjcc6JQakYi5HjRdXdvuaR/RCC5OrEWgh5p95/+ZqJgAoaiJX4qCP/36TF6pkmGdZgKiTYwi2yRMCJe1e6HBzA/9+J0E8EVc28WeHP3hf91dDBRGt1+9DfvPo7pajrCs0nlMdVenApPOiCzu5pyrDyaNCoTmaOy3mdV0V9+xdXd4Cs124H2CtiyehFl4rhZWFyJUa5GPdaL4uCNjWfP86C8QntMzf7ZyrInllKPbS+SeUVlG7jkt6olE7fHt9v5lwXwGjYrU5dx3YiP6hkUjdz7/osUjEe4CCXI26adXjZR1oZhiYaL/yd4/04cfCMU7BPuCfcDsd71gpfUr6HVDu12V/LsRmeCmf2X0fIdM3CfQfHmMLbhJhnN3onzKunXDetEpe5jVyLlgQT75xZqeSIpAYwVgSnEvWDS+Vwck1zQj9BCHxd3LTJT7Q40Ariqh2YyIQF96PSMv0kIstbs2+V5G+Gsa3BPabk0ShJ5yurVoz79k4ZL+FFBaEomjw3AonfR5XPgPqYtdzh05jQJXj6R8eicu7Pvd6sWBQFWfLD+alVt97mlRMVikAa4khXEm+4s5dXyYMZqEOW5zxmFWkKColj9uFckQsQ== X-Forefront-Antispam-Report: CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE; SFS:(4636009)(346002)(376002)(136003)(396003)(39860400002)(36840700001)(46966006)(316002)(36906005)(450100002)(86362001)(186003)(1076003)(36860700001)(426003)(4326008)(478600001)(2906002)(336012)(54906003)(36756003)(16526019)(2616005)(7696005)(26005)(83380400001)(6286002)(47076005)(8676002)(7636003)(5660300002)(356005)(82310400003)(82740400003)(8936002)(6666004)(107886003)(6916009)(70586007)(70206006)(55016002); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Jun 2021 07:01:35.5868 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: edd18777-0667-481f-3132-08d93b94e67b X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT028.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4829 Subject: [dpdk-dev] [PATCH] net/mlx5: document workaround for ConnectX-4 with L2 encap X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" ConnectX-4 and ConnectX-4 Lx NICs require all L2 headers of transmitted packets to be inlined. By default only first 18 bytes are inlined, which is insufficient if additional encapsulation is used, like Q-in-Q. Thus, default settings caused such traffic to be dropepd on Tx. Document a workaround to increase inlined data size in such cases. Fixes: 505f1fe426d3 ("net/mlx5: add Tx devargs") Cc: stable@dpdk.org Signed-off-by: Dmitry Kozlyuk Reviewed-by: Viacheslav Ovsiienko --- doc/guides/nics/mlx5.rst | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/doc/guides/nics/mlx5.rst b/doc/guides/nics/mlx5.rst index ebefbe607e..05a89d08f2 100644 --- a/doc/guides/nics/mlx5.rst +++ b/doc/guides/nics/mlx5.rst @@ -705,6 +705,13 @@ Driver options it is not recommended and may prevent NIC from sending packets over some configurations. + For ConnectX-4 and ConnectX-4 Lx NICs, automatically configured value + is insufficient for some traffic, because they require at least all L2 headers + to be inlined. For example, Q-in-Q adds 4 bytes to default 18 bytes + of Ethernet and VLAN, thus ``txq_inline_min`` must be set to 22. + MPLS would add 4 bytes per label. Final value must account for all possible + L2 encapsulation headers used in particular environment. + Please, note, this minimal data inlining disengages eMPW feature (Enhanced Multi-Packet Write), because last one does not support partial packet inlining. This is not very critical due to minimal data inlining is mostly required