From patchwork Wed Feb 1 07:28:02 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alex Vesker X-Patchwork-Id: 122781 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8A71641B9B; Wed, 1 Feb 2023 08:29:15 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 55E2842B8E; Wed, 1 Feb 2023 08:29:03 +0100 (CET) Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on2041.outbound.protection.outlook.com [40.107.236.41]) by mails.dpdk.org (Postfix) with ESMTP id AACFF41611 for ; Wed, 1 Feb 2023 08:29:01 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=D6oQ/QgZ1eVEwt05fLN6Wv2nk0YBiLeZyxm0ZBBeJboWZNqS9HHTYZzHKzS8h0ARo0MTRtYuq9nfgmArYbFwwhPb6pN7KLfNfSyQ8qPRoSdNWrKsXmnpUeO09yP1d/XO9I+au8BjZL3/R+5WW6KhZNrsqjkLWMosZ0TvM9EMJw/KOTbotCnp4i7t+9OUFFW5l9yEEOaRZB8nQmnfIAuql/58FaZL+jAXbzfVkm9juQizpGntdTkmOLDvoBgILM9POAf1swsVXdRMoihU9TLPVbFTBtVNNlfrDxocTTBz8bi4zSbByWNXIjXvFr3jiSwe5g0xJ/letUjogF0iaH/wkA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=e8+ALuhZ6RBOXXWs9t/ml0u6TQqeK066bx9YsD0ZGWs=; b=YVQ5mWTK+1VmBwWsb7mQ4ZTrL8cUGyaxtWnGNzYAWtgg2Gc6B9z+ulQRzvKbIFfBQO/7etc/9PnCQAj+cXweBQWXBNRHHlFY2FddTSK8rrlb7jyXhspvhTQUKTnN/VEt1ahUYJpAVAAZNawWK6UA+3XkWj1jgnN1SnYJb4tb0nKqTcnTN1zxTUw9YlNmuurSlz1Mr7+rhJuGLVTGSYsEuHx9zpngtepL+QapPPB1Q8SUuXONO2AhC+2f5THNICQ339LusFS9g2wEUPcj8rBiCJV7VAlKkJNePT3ctcmHoJUQnCSXvpC1yan425QZMmBd2Io9FuugASHmPb+hONPKzw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=monjalon.net smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=e8+ALuhZ6RBOXXWs9t/ml0u6TQqeK066bx9YsD0ZGWs=; b=BVKv+kOFUUsqqROJ++NX9jEeZjACt0LVOYzj6Rp6CZTx2WClBJ/qtBT4OGNRP7qk2N0CWNIHDxiyklVDoG6+Q/QwmCWs1e0kTiJF6wFBi+iHLH2Hv2lAt28zfyYyL3CrlupT537aK6p/8lnRghGEjWbCzoWie+dhXk0UPmO+/KdMIVoOc0Z1fyTZ1QodN0F9cOK50vXtnG2T7MEQDanUsMcE0zZ1R+5EjdlEbmx7DYtNq83WCQOs2uhwbgxWOI/PBMKpp4WgIppR6aIG8821W9YwR2lnZlAfljtx0s2Y+r9Ozzk880fZQfLoAaR24ijUID+CpvmLafDaZT2mlU98xA== Received: from BN9PR03CA0398.namprd03.prod.outlook.com (2603:10b6:408:111::13) by SJ1PR12MB6169.namprd12.prod.outlook.com (2603:10b6:a03:45c::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6043.30; Wed, 1 Feb 2023 07:28:58 +0000 Received: from BN8NAM11FT011.eop-nam11.prod.protection.outlook.com (2603:10b6:408:111:cafe::a2) by BN9PR03CA0398.outlook.office365.com (2603:10b6:408:111::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6043.38 via Frontend Transport; Wed, 1 Feb 2023 07:28:58 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by BN8NAM11FT011.mail.protection.outlook.com (10.13.176.140) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6064.22 via Frontend Transport; Wed, 1 Feb 2023 07:28:58 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Tue, 31 Jan 2023 23:28:44 -0800 Received: from nvidia.com (10.126.230.37) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Tue, 31 Jan 2023 23:28:42 -0800 From: Alex Vesker To: , , , "Matan Azrad" CC: , Subject: [v2 03/16] net/mlx5/hws: support GTA WQE write using FW command Date: Wed, 1 Feb 2023 09:28:02 +0200 Message-ID: <20230201072815.1329101-4-valex@nvidia.com> X-Mailer: git-send-email 2.27.0 In-Reply-To: <20230201072815.1329101-1-valex@nvidia.com> References: <20230131093346.1261066-1-valex@nvidia.com> <20230201072815.1329101-1-valex@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.230.37] X-ClientProxiedBy: rnnvmail201.nvidia.com (10.129.68.8) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BN8NAM11FT011:EE_|SJ1PR12MB6169:EE_ X-MS-Office365-Filtering-Correlation-Id: 576982ee-5e4b-4981-f724-08db0425fb76 X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: xolCEGXPQ3dpAXMfH4kNmIDwp5rtiG6IHQ73N3rsRIfF+/6GEkS5btuz7rcFy0vwBZQNM4BAn4+iKATWqSSgTDKDBeQnLLjDJ8kem7uDE+kt9FjcrkyL1VvJk/VQRJNUsYKWkxMsTZqL0mqO9z8Y/c3J0SsxFtihcrHqny5wQ1NUTrJMe+72ltNSJ5xbpEj8wuS4kNBGVCdkJILWtJ+6OX4kTKVRTW/r7tdRbAWlN7htx7ARWMU5wXi5089cht2pwh0GAy4uhklV/RFvPU4KbmMK6+0BmK9/mV/0I5ur2aEOQTnY3BTzEep8/WRXj5SI8cZPwtptgK/GzEYfwNr6H1rA0EB0QSqLvZAllAF6Bag4ochQ2WHdSWh7rOLZQH4PjW0qWSAKoTZZ/wtCh/733//h8NxpR54eKMp8p/9DT6oRFdHOTGIUljyXuaFiktdk3gDQi5lFucHVKJPHtuPBqpkQzFtknHX5hLrmwXOVUFqj+/Qs2hHJeHzVhhkDWX/Kx0s87dFpOrVSimCdNswN202m9X3GWN3I2OKfblkJTbmyYtGqu0bboC8g18q5SEMSBcdtCh6QMqkeygogj6R+qGUH6O/EnyU+i5qHISVvSDGmHyu4G9Aqp5RYzIDQkIOPVKs5fPKBdLijpT6Re6VAyXKhZQQzt/nt0gtxPmnqi2vNIBCKcGobmSnOJpeQ+v0QKdyl9QMlYY10Q8b3wuQgJQ== X-Forefront-Antispam-Report: CIP:216.228.117.161; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge2.nvidia.com; CAT:NONE; SFS:(13230025)(4636009)(396003)(39860400002)(376002)(136003)(346002)(451199018)(46966006)(36840700001)(40470700004)(4326008)(47076005)(70206006)(36860700001)(70586007)(41300700001)(83380400001)(8936002)(336012)(426003)(8676002)(7636003)(82740400003)(40460700003)(36756003)(2616005)(1076003)(82310400005)(316002)(110136005)(54906003)(5660300002)(40480700001)(26005)(55016003)(356005)(6636002)(16526019)(186003)(6286002)(107886003)(2906002)(478600001)(7696005)(86362001)(6666004); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Feb 2023 07:28:58.0204 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 576982ee-5e4b-4981-f724-08db0425fb76 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.161]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT011.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ1PR12MB6169 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org The generate WQE command is used as an interface to writing GTA WQEs with fields that are not supported in current HW, for example extended match definer. Signed-off-by: Alex Vesker --- drivers/common/mlx5/mlx5_prm.h | 27 +++++++++++++++++- drivers/net/mlx5/hws/mlx5dr_cmd.c | 47 +++++++++++++++++++++++++++++++ drivers/net/mlx5/hws/mlx5dr_cmd.h | 13 +++++++++ 3 files changed, 86 insertions(+), 1 deletion(-) diff --git a/drivers/common/mlx5/mlx5_prm.h b/drivers/common/mlx5/mlx5_prm.h index 9294f65e24..d4d8ddcd2a 100644 --- a/drivers/common/mlx5/mlx5_prm.h +++ b/drivers/common/mlx5/mlx5_prm.h @@ -1141,6 +1141,7 @@ enum { MLX5_CMD_QUERY_REGEX_REGISTERS = 0xb07, MLX5_CMD_OP_ACCESS_REGISTER_USER = 0xb0c, MLX5_CMD_OP_ALLOW_OTHER_VHCA_ACCESS = 0xb16, + MLX5_CMD_OP_GENERATE_WQE = 0xb17, }; enum { @@ -2159,7 +2160,8 @@ struct mlx5_ifc_cmd_hca_cap_2_bits { u8 format_select_dw_gtpu_dw_1[0x8]; u8 format_select_dw_gtpu_dw_2[0x8]; u8 format_select_dw_gtpu_first_ext_dw_0[0x8]; - u8 reserved_at_2a0[0x560]; + u8 generate_wqe_type[0x20]; + u8 reserved_at_2c0[0x540]; }; struct mlx5_ifc_esw_cap_bits { @@ -3529,6 +3531,29 @@ struct mlx5_ifc_create_alias_obj_in_bits { struct mlx5_ifc_alias_context_bits alias_ctx; }; +struct mlx5_ifc_generate_wqe_in_bits { + u8 opcode[0x10]; + u8 uid[0x10]; + u8 reserved_at_20[0x10]; + u8 op_mode[0x10]; + u8 reserved_at_40[0x40]; + u8 reserved_at_80[0x8]; + u8 pdn[0x18]; + u8 reserved_at_a0[0x160]; + u8 wqe_ctrl[0x80]; + u8 wqe_gta_ctrl[0x180]; + u8 wqe_gta_data_0[0x200]; + u8 wqe_gta_data_1[0x200]; +}; + +struct mlx5_ifc_generate_wqe_out_bits { + u8 status[0x8]; + u8 reserved_at_8[0x18]; + u8 syndrome[0x20]; + u8 reserved_at_40[0x1c0]; + u8 cqe_data[0x200]; +}; + enum { MLX5_CRYPTO_KEY_SIZE_128b = 0x0, MLX5_CRYPTO_KEY_SIZE_256b = 0x1, diff --git a/drivers/net/mlx5/hws/mlx5dr_cmd.c b/drivers/net/mlx5/hws/mlx5dr_cmd.c index 32378673cf..c648eacd03 100644 --- a/drivers/net/mlx5/hws/mlx5dr_cmd.c +++ b/drivers/net/mlx5/hws/mlx5dr_cmd.c @@ -795,6 +795,53 @@ mlx5dr_cmd_alias_obj_create(struct ibv_context *ctx, return devx_obj; } +int mlx5dr_cmd_generate_wqe(struct ibv_context *ctx, + struct mlx5dr_cmd_generate_wqe_attr *attr, + struct mlx5_cqe64 *ret_cqe) +{ + uint32_t out[MLX5_ST_SZ_DW(generate_wqe_out)] = {0}; + uint32_t in[MLX5_ST_SZ_DW(generate_wqe_in)] = {0}; + uint8_t status; + void *ptr; + int ret; + + MLX5_SET(generate_wqe_in, in, opcode, MLX5_CMD_OP_GENERATE_WQE); + MLX5_SET(generate_wqe_in, in, pdn, attr->pdn); + + ptr = MLX5_ADDR_OF(generate_wqe_in, in, wqe_ctrl); + memcpy(ptr, attr->wqe_ctrl, MLX5_FLD_SZ_BYTES(generate_wqe_in, wqe_ctrl)); + + ptr = MLX5_ADDR_OF(generate_wqe_in, in, wqe_gta_ctrl); + memcpy(ptr, attr->gta_ctrl, MLX5_FLD_SZ_BYTES(generate_wqe_in, wqe_gta_ctrl)); + + ptr = MLX5_ADDR_OF(generate_wqe_in, in, wqe_gta_data_0); + memcpy(ptr, attr->gta_data_0, MLX5_FLD_SZ_BYTES(generate_wqe_in, wqe_gta_data_0)); + + if (attr->gta_data_1) { + ptr = MLX5_ADDR_OF(generate_wqe_in, in, wqe_gta_data_1); + memcpy(ptr, attr->gta_data_1, MLX5_FLD_SZ_BYTES(generate_wqe_in, wqe_gta_data_1)); + } + + ret = mlx5_glue->devx_general_cmd(ctx, in, sizeof(in), out, sizeof(out)); + if (ret) { + DR_LOG(ERR, "Failed to write GTA WQE using FW"); + rte_errno = errno; + return rte_errno; + } + + status = MLX5_GET(generate_wqe_out, out, status); + if (status) { + DR_LOG(ERR, "Invalid FW CQE status %d", status); + rte_errno = EINVAL; + return rte_errno; + } + + ptr = MLX5_ADDR_OF(generate_wqe_out, out, cqe_data); + memcpy(ret_cqe, ptr, sizeof(*ret_cqe)); + + return 0; +} + int mlx5dr_cmd_query_caps(struct ibv_context *ctx, struct mlx5dr_cmd_query_caps *caps) { diff --git a/drivers/net/mlx5/hws/mlx5dr_cmd.h b/drivers/net/mlx5/hws/mlx5dr_cmd.h index 468557ba16..3689d09897 100644 --- a/drivers/net/mlx5/hws/mlx5dr_cmd.h +++ b/drivers/net/mlx5/hws/mlx5dr_cmd.h @@ -153,6 +153,14 @@ struct mlx5dr_cmd_query_vport_caps { uint32_t metadata_c_mask; }; +struct mlx5dr_cmd_generate_wqe_attr { + uint8_t *wqe_ctrl; + uint8_t *gta_ctrl; + uint8_t *gta_data_0; + uint8_t *gta_data_1; + uint32_t pdn; +}; + struct mlx5dr_cmd_query_caps { uint32_t wire_regc; uint32_t wire_regc_mask; @@ -212,6 +220,11 @@ int mlx5dr_cmd_stc_modify(struct mlx5dr_devx_obj *devx_obj, struct mlx5dr_cmd_stc_modify_attr *stc_attr); +int +mlx5dr_cmd_generate_wqe(struct ibv_context *ctx, + struct mlx5dr_cmd_generate_wqe_attr *attr, + struct mlx5_cqe64 *ret_cqe); + struct mlx5dr_devx_obj * mlx5dr_cmd_ste_create(struct ibv_context *ctx, struct mlx5dr_cmd_ste_create_attr *ste_attr);