From patchwork Mon Oct 23 12:42:21 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Gregory Etelson X-Patchwork-Id: 133180 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 07B97431E2; Mon, 23 Oct 2023 14:43:34 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3CF5242830; Mon, 23 Oct 2023 14:43:16 +0200 (CEST) Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2088.outbound.protection.outlook.com [40.107.94.88]) by mails.dpdk.org (Postfix) with ESMTP id 173DD42830 for ; Mon, 23 Oct 2023 14:43:15 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lsGgSpKZ6/Ji9lnrSj3hT3WZBu10ezGqgI7COGtQfqLIYhqU6DER5A23SZrpPZpBlatPBpQpA9aLoaOBpW4JduNPeLMzOwlIBD5HZVHeFmwIFPfz+XvVqf3cmnlVhk/Aw5DncuQiYgEfQiMdDunOTXPep4Ktx/Vw7ScdvkOSDPy/3LZUXb+rrkZKz6PiJBUN929SYr214b9C21C4rK/mfZ/Ih8AOdu1BPqvK8vqQ5ITXVeh3i8um1uiWOKKvS6AkY87UUgO7lxwvOCOgaEXkcPZnC9Zp+H5jHnX4dxpat2uPlE079siWOwSbZUPGKEhh8lCRyBt5chyp4G174IlAtw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=M59nx9z4QAIdFNtQPUSYc5ZO9VEVwibTqTr0uwzhjCI=; b=I0G9p8Gg95EWx68ITq4T6sd0JFKyW058prhGDPRMdoURe6V6qte6fy8I7L5Foa2Uc75lsrBbBdoD2qHtay3FMCzCWysCkRMmu3lNkWcAf42FfSdfLHVUF0zkZus28/98DzdLH3tHU/Nb3BP+ZnRxw6m5KjgiAMx12lhum9oxTEKEp2lX7dR8E6lzPldA6euEHQ0PKZYe4xXY+jwzOrMBWZZlp8FXBFYV0nX7taUi7z/LoiE7hcZwK65dBhJn854GfX+kimh2TAt269F0ZEayifrFYRwso6M0pJfHo3AjDWhTv+bcGIvjq+qa9wTZoFvLruVHv5ULjyF+1atdkmqcmA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=M59nx9z4QAIdFNtQPUSYc5ZO9VEVwibTqTr0uwzhjCI=; b=AidudSyubksaXB/QICV4TY+fXEILN12p09cUV+xOPc1VU+RYKk5WGSg3PNk6wXxcV+k9xQO3iZTeGIwYfkmHPGRiISQeHnpyW6xqPcXc9G84Zndp/mzxtbwJStxpUbGxrWhycDsmuXxrxeScJMvHOgjjzTKoxIt+viDx85/d7zBFC8iqflrb3qQ1EmjDHHYQI1q4IvA5TXWBCalTIBgpPvcZ7LqgM8Htg3jTx8USsATUG/OxzUEIyCYsMVzW/kYYD1sO4hXem2Ss53sdKxN5ptBHdrPrBw8bHveyGPcJJeDWgrfrkb5fb/CU5IlFxG8BpCbie5XZqXSC8Y5bC9eHtA== Received: from MW4PR03CA0097.namprd03.prod.outlook.com (2603:10b6:303:b7::12) by DS7PR12MB5861.namprd12.prod.outlook.com (2603:10b6:8:78::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6863.46; Mon, 23 Oct 2023 12:43:11 +0000 Received: from CO1PEPF000044EF.namprd05.prod.outlook.com (2603:10b6:303:b7:cafe::f6) by MW4PR03CA0097.outlook.office365.com (2603:10b6:303:b7::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6907.33 via Frontend Transport; Mon, 23 Oct 2023 12:43:11 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by CO1PEPF000044EF.mail.protection.outlook.com (10.167.241.69) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6933.15 via Frontend Transport; Mon, 23 Oct 2023 12:43:11 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.41; Mon, 23 Oct 2023 05:43:09 -0700 Received: from nvidia.com (10.126.230.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.41; Mon, 23 Oct 2023 05:43:05 -0700 From: Gregory Etelson To: CC: , =?utf-8?b?wqA=?= , , Haifei Luo , Shun Hao , Suanming Mou , Matan Azrad , Viacheslav Ovsiienko , Ori Kam Subject: [PATCH v4 06/10] net/mlx5/hws: support reformat for hws mirror Date: Mon, 23 Oct 2023 15:42:21 +0300 Message-ID: <20231023124225.141461-7-getelson@nvidia.com> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20231023124225.141461-1-getelson@nvidia.com> References: <20231017080928.30454-1-getelson@nvidia.com> <20231023124225.141461-1-getelson@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.230.35] X-ClientProxiedBy: rnnvmail201.nvidia.com (10.129.68.8) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CO1PEPF000044EF:EE_|DS7PR12MB5861:EE_ X-MS-Office365-Filtering-Correlation-Id: 439947ce-a0e5-4514-80bd-08dbd3c59de7 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: IeyxRjzrERN9zpDltk5apyiu5imlJp+Aq/G5zZ9HkI+cb0akGKDD3JibuztjzBD7YMUr1JFg60MfdnNTxqiyW9nNA2E/NdLaTm4ZTV1teZ44NMq9kTs8CsRItQNBWgYD31LK8o2dMgcd6lWxMUBMe/L2qCnMnaHBgHohvgDTg5ZNohZxmq2tD/IMTFga2dYX8GlAVke+uMINSsUN9LU2H3cA1BcHLzFj4Zg+w8ppIjsiWNdc4l0or60oFqE5wzpk8ni7QIbM+iOx228bJRXRy9hcsxZSNpMuX9MOygxLw70+S9u59d/kumZ9JQVXQhDltjcE0k0tEBNrd3Nn9FvZHIJfErGFKVg1gdfIVHBgXKlkjbp+LNoIU1DoKjCEic+vvzVs/ftHyBSBkLLRmzO/SMa4Ebg4xDdBlx7Z7+dwQIEgqJtDHoBj6SwA7raaXeClyTEW3P7HfoADw6KCCwyd721LtEtIePlsVGGus7no9ED8Igi8ZFwGKWZFvLFkA7qig5AjaxOTxtBjZPnKhehk/tOMxX/2Jff8zH7L9sV7CMBfXhpZrUmMRAHxAHmqOZec4ZXDdZENTlCvZGz0qimQHrqAYU+imzA8AEN/AWaqL5GcETIEHYqu8YOam9H5SSquINqFS3h18jCCtrui3DnqgoA4CMaiUcAVAOpNRoUih1QoEOt4oipRX5gitI3A0y3Dzn0MjWUSkfqGiBsdlwDlns2QmSHg1+0EX5EPkL7aOvHf64+viB0YFyPR9KDTTL6/ X-Forefront-Antispam-Report: CIP:216.228.117.160; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge1.nvidia.com; CAT:NONE; SFS:(13230031)(4636009)(346002)(396003)(376002)(39860400002)(136003)(230922051799003)(451199024)(1800799009)(82310400011)(64100799003)(186009)(46966006)(40470700004)(36840700001)(82740400003)(356005)(7636003)(54906003)(86362001)(316002)(70206006)(70586007)(26005)(7696005)(40460700003)(6286002)(16526019)(107886003)(40480700001)(1076003)(36860700001)(83380400001)(55016003)(6666004)(2616005)(47076005)(6916009)(336012)(36756003)(5660300002)(41300700001)(8936002)(8676002)(4326008)(426003)(2906002)(478600001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Oct 2023 12:43:11.2707 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 439947ce-a0e5-4514-80bd-08dbd3c59de7 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.160]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1PEPF000044EF.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR12MB5861 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Haifei Luo In dest_array action, an optional reformat action can be applied to each destination. This patch supports this by using the extended destination entry. Signed-off-by: Haifei Luo Signed-off-by: Shun Hao Acked-by: Suanming Mou --- drivers/common/mlx5/mlx5_prm.h | 15 +++++++ drivers/net/mlx5/hws/mlx5dr_action.c | 67 +++++++++++++++++++++++++++- drivers/net/mlx5/hws/mlx5dr_action.h | 2 + drivers/net/mlx5/hws/mlx5dr_cmd.c | 10 ++++- drivers/net/mlx5/hws/mlx5dr_cmd.h | 2 + 5 files changed, 94 insertions(+), 2 deletions(-) diff --git a/drivers/common/mlx5/mlx5_prm.h b/drivers/common/mlx5/mlx5_prm.h index aa0b622ca2..bced5a59dd 100644 --- a/drivers/common/mlx5/mlx5_prm.h +++ b/drivers/common/mlx5/mlx5_prm.h @@ -5352,6 +5352,21 @@ enum mlx5_parse_graph_arc_node_index { MLX5_GRAPH_ARC_NODE_PROGRAMMABLE = 0x1f, }; +enum mlx5_packet_reformat_context_reformat_type { + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_L2_TO_L2_TUNNEL = 0x2, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_L2_TO_L3_TUNNEL = 0x4, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_ADD_ESP_TRANSPORT_OVER_IPV4 = 0x5, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_L2_TO_L3_ESP_TUNNEL = 0x6, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_ADD_ESP_TRANSPORT_OVER_UDPV4 = 0x7, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_DEL_ESP_TRANSPORT = 0x8, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_L3_ESP_TUNNEL_TO_L2 = 0x9, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_DEL_ESP_TRANSPORT_OVER_UDP = 0xA, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_ADD_ESP_TRANSPORT_OVER_IPV6 = 0xB, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_ADD_ESP_TRANSPORT_OVER_UDPV6 = 0xC, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_ADD_NISP_TNL = 0xD, + MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_REMOVE_NISP_TNL = 0xE, +}; + #define MLX5_PARSE_GRAPH_FLOW_SAMPLE_MAX 8 #define MLX5_PARSE_GRAPH_IN_ARC_MAX 8 #define MLX5_PARSE_GRAPH_OUT_ARC_MAX 8 diff --git a/drivers/net/mlx5/hws/mlx5dr_action.c b/drivers/net/mlx5/hws/mlx5dr_action.c index 6b62111593..11a7c58925 100644 --- a/drivers/net/mlx5/hws/mlx5dr_action.c +++ b/drivers/net/mlx5/hws/mlx5dr_action.c @@ -1703,6 +1703,44 @@ mlx5dr_action_create_modify_header(struct mlx5dr_context *ctx, return NULL; } +static struct mlx5dr_devx_obj * +mlx5dr_action_dest_array_process_reformat(struct mlx5dr_context *ctx, + enum mlx5dr_action_type type, + void *reformat_data, + size_t reformat_data_sz) +{ + struct mlx5dr_cmd_packet_reformat_create_attr pr_attr = {0}; + struct mlx5dr_devx_obj *reformat_devx_obj; + + if (!reformat_data || !reformat_data_sz) { + DR_LOG(ERR, "Empty reformat action or data"); + rte_errno = EINVAL; + return NULL; + } + + switch (type) { + case MLX5DR_ACTION_TYP_REFORMAT_L2_TO_TNL_L2: + pr_attr.type = MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_L2_TO_L2_TUNNEL; + break; + case MLX5DR_ACTION_TYP_REFORMAT_L2_TO_TNL_L3: + pr_attr.type = MLX5_PACKET_REFORMAT_CONTEXT_REFORMAT_TYPE_L2_TO_L3_TUNNEL; + break; + default: + DR_LOG(ERR, "Invalid value for reformat type"); + rte_errno = EINVAL; + return NULL; + } + pr_attr.reformat_param_0 = 0; + pr_attr.data_sz = reformat_data_sz; + pr_attr.data = reformat_data; + + reformat_devx_obj = mlx5dr_cmd_packet_reformat_create(ctx->ibv_ctx, &pr_attr); + if (!reformat_devx_obj) + return NULL; + + return reformat_devx_obj; +} + struct mlx5dr_action * mlx5dr_action_create_dest_array(struct mlx5dr_context *ctx, size_t num_dest, @@ -1710,6 +1748,7 @@ mlx5dr_action_create_dest_array(struct mlx5dr_context *ctx, uint32_t flags) { struct mlx5dr_cmd_set_fte_dest *dest_list = NULL; + struct mlx5dr_devx_obj *packet_reformat = NULL; struct mlx5dr_cmd_ft_create_attr ft_attr = {0}; struct mlx5dr_cmd_set_fte_attr fte_attr = {0}; struct mlx5dr_cmd_forward_tbl *fw_island; @@ -1796,6 +1835,21 @@ mlx5dr_action_create_dest_array(struct mlx5dr_context *ctx, dest_list[i].destination_id = dests[i].dest->devx_dest.devx_obj->id; fte_attr.action_flags |= MLX5_FLOW_CONTEXT_ACTION_FWD_DEST; break; + case MLX5DR_ACTION_TYP_REFORMAT_L2_TO_TNL_L2: + case MLX5DR_ACTION_TYP_REFORMAT_L2_TO_TNL_L3: + packet_reformat = mlx5dr_action_dest_array_process_reformat + (ctx, + *action_type, + dests[i].reformat.reformat_data, + dests[i].reformat.reformat_data_sz); + if (!packet_reformat) + goto free_dest_list; + + dest_list[i].ext_flags |= MLX5DR_CMD_EXT_DEST_REFORMAT; + dest_list[i].ext_reformat = packet_reformat; + ft_attr.reformat_en = true; + fte_attr.extended_dest = 1; + break; default: DR_LOG(ERR, "Unsupported action in dest_array"); rte_errno = ENOTSUP; @@ -1819,8 +1873,9 @@ mlx5dr_action_create_dest_array(struct mlx5dr_context *ctx, goto free_action; action->dest_array.fw_island = fw_island; + action->dest_array.num_dest = num_dest; + action->dest_array.dest_list = dest_list; - simple_free(dest_list); return action; free_action: @@ -1828,6 +1883,10 @@ mlx5dr_action_create_dest_array(struct mlx5dr_context *ctx, destroy_fw_island: mlx5dr_cmd_forward_tbl_destroy(fw_island); free_dest_list: + for (i = 0; i < num_dest; i++) { + if (dest_list[i].ext_reformat) + mlx5dr_cmd_destroy_obj(dest_list[i].ext_reformat); + } simple_free(dest_list); return NULL; } @@ -1917,6 +1976,12 @@ static void mlx5dr_action_destroy_hws(struct mlx5dr_action *action) case MLX5DR_ACTION_TYP_DEST_ARRAY: mlx5dr_action_destroy_stcs(action); mlx5dr_cmd_forward_tbl_destroy(action->dest_array.fw_island); + for (i = 0; i < action->dest_array.num_dest; i++) { + if (action->dest_array.dest_list[i].ext_reformat) + mlx5dr_cmd_destroy_obj + (action->dest_array.dest_list[i].ext_reformat); + } + simple_free(action->dest_array.dest_list); break; case MLX5DR_ACTION_TYP_REFORMAT_TNL_L3_TO_L2: case MLX5DR_ACTION_TYP_MODIFY_HDR: diff --git a/drivers/net/mlx5/hws/mlx5dr_action.h b/drivers/net/mlx5/hws/mlx5dr_action.h index efe07c9d47..582a38bebc 100644 --- a/drivers/net/mlx5/hws/mlx5dr_action.h +++ b/drivers/net/mlx5/hws/mlx5dr_action.h @@ -153,6 +153,8 @@ struct mlx5dr_action { } devx_dest; struct { struct mlx5dr_cmd_forward_tbl *fw_island; + size_t num_dest; + struct mlx5dr_cmd_set_fte_dest *dest_list; } dest_array; }; }; diff --git a/drivers/net/mlx5/hws/mlx5dr_cmd.c b/drivers/net/mlx5/hws/mlx5dr_cmd.c index 22f7c6b019..781de40c02 100644 --- a/drivers/net/mlx5/hws/mlx5dr_cmd.c +++ b/drivers/net/mlx5/hws/mlx5dr_cmd.c @@ -169,7 +169,9 @@ mlx5dr_cmd_set_fte(struct ibv_context *ctx, uint32_t *in; uint32_t i; - dest_entry_sz = MLX5_ST_SZ_BYTES(dest_format); + dest_entry_sz = fte_attr->extended_dest ? + MLX5_ST_SZ_BYTES(extended_dest_format) : + MLX5_ST_SZ_BYTES(dest_format); total_dest_sz = dest_entry_sz * fte_attr->dests_num; inlen = align((MLX5_ST_SZ_BYTES(set_fte_in) + total_dest_sz), DW_SIZE); in = simple_calloc(1, inlen); @@ -192,6 +194,7 @@ mlx5dr_cmd_set_fte(struct ibv_context *ctx, in_flow_context = MLX5_ADDR_OF(set_fte_in, in, flow_context); MLX5_SET(flow_context, in_flow_context, group_id, group_id); MLX5_SET(flow_context, in_flow_context, flow_source, fte_attr->flow_source); + MLX5_SET(flow_context, in_flow_context, extended_destination, fte_attr->extended_dest); MLX5_SET(set_fte_in, in, ignore_flow_level, fte_attr->ignore_flow_level); action_flags = fte_attr->action_flags; @@ -230,6 +233,11 @@ mlx5dr_cmd_set_fte(struct ibv_context *ctx, dest->destination_type); MLX5_SET(dest_format, in_dests, destination_id, dest->destination_id); + if (dest->ext_flags & MLX5DR_CMD_EXT_DEST_REFORMAT) { + MLX5_SET(dest_format, in_dests, packet_reformat, 1); + MLX5_SET(extended_dest_format, in_dests, packet_reformat_id, + dest->ext_reformat->id); + } break; default: rte_errno = EOPNOTSUPP; diff --git a/drivers/net/mlx5/hws/mlx5dr_cmd.h b/drivers/net/mlx5/hws/mlx5dr_cmd.h index 6f4aa3e320..28e5ea4726 100644 --- a/drivers/net/mlx5/hws/mlx5dr_cmd.h +++ b/drivers/net/mlx5/hws/mlx5dr_cmd.h @@ -14,6 +14,7 @@ struct mlx5dr_cmd_set_fte_dest { uint8_t destination_type; uint32_t destination_id; enum mlx5dr_cmd_ext_dest_flags ext_flags; + struct mlx5dr_devx_obj *ext_reformat; uint16_t esw_owner_vhca_id; }; @@ -21,6 +22,7 @@ struct mlx5dr_cmd_set_fte_attr { uint32_t action_flags; uint8_t ignore_flow_level; uint8_t flow_source; + uint8_t extended_dest; uint8_t encrypt_decrypt_type; uint32_t encrypt_decrypt_obj_id; uint32_t packet_reformat_id;