From patchwork Fri May 13 07:33:05 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shun Hao X-Patchwork-Id: 111114 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 516AEA00C3; Fri, 13 May 2022 09:33:35 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 2E724427F1; Fri, 13 May 2022 09:33:34 +0200 (CEST) Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2064.outbound.protection.outlook.com [40.107.94.64]) by mails.dpdk.org (Postfix) with ESMTP id E836442832 for ; Fri, 13 May 2022 09:33:31 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Ue14VoyPURECe2EL9kPR5+WELpOGamVCes/JpWCAsQRl0XXwykth32CnpANsHvaJKYnHCIfwBz/vLCRsHGRGFK3j4Y2x1sLn7EIk+vwGd/78Lj59/MqFnnCUTfhN0BseWj/S3r7EnqlOSvfMOqMeJF+I3dbky5nN6GD/BbFeWjI/JYVLqTk/obllDg6foJgaYoumLuin9LZbTgxtAB+77XSf7HEfxUMCPKGEE52wcAg9RxplxzEUjnvOQIxXB1OfH6DZ0YYINurv18V6VQX9ygUIb2nl7mBWaxxIeyfVKvGnBEHSBf8WczLpbiE93Zi+ZJzknhYzTYV7N7wq2nDJ3w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=31eNjWUrqh5AQNl4Hy8ZERV2JfbfG8ZZuLn6zHFHhQ4=; b=BCW6I8AHF9HyLIkYK/YQW0MUJ3nZE+SAe953NYV1mkBCDjrFpwrRFRav0J+ZIJqNjNFskmXILPigPp5XBE9b4brNZocwi/NaUpcjSYLNsAU0BQQqBHJtcevao75ZOvR3Z4TKoKevqVXVzH2E6rwFggelJE9JXWHxajx85oY1sapkPNH0f9cbOpUmuVgyDoxyefXCvTydpPw+4c3g2Aec4/eeyuNaxY6vtdlip5CN3Sx1vOoJUi6MC4RxtYYoieyIoTv69GvXvpTVpGgx6aPdCDCTn5vX70IW8bjEXEzqYnIH8hfCq7o3wypGbUda1h/gzDYe/SmucuwxhYy4q7bq/A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 12.22.5.238) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=31eNjWUrqh5AQNl4Hy8ZERV2JfbfG8ZZuLn6zHFHhQ4=; b=Icl8I0TixzHLowasXO8l6dGnDK28TjBors/uZD+EZDDdLpBnymOs8fRz33sgPxzab2lmLJ7B6nH/RkASFouSxTkj0dx1cW8iUa8XMMlPGq0gbdTr3F4bCPWNNO2b/TAztBPTZiyPo/d9meUW5SS6I2VlKoPDt4AYpTfawyN9Q7CiZ9JANoWl+mKZFKhMQlKijpqst432k+eOEQ8qQ5k1gWqIv+VxKWDzyBextwfN+jEwqxWaM7bR7u38BAia3Ts2WT/fE49ef+R+e24qWA8VCpsh4y3REgNBTtnk+NM1U/iLh0dFgldWC9e6gpD/ObQNjn7grURFW0SZG7Idwjodvw== Received: from BN9PR03CA0627.namprd03.prod.outlook.com (2603:10b6:408:106::32) by BN8PR12MB2866.namprd12.prod.outlook.com (2603:10b6:408:68::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5227.23; Fri, 13 May 2022 07:33:29 +0000 Received: from BN8NAM11FT041.eop-nam11.prod.protection.outlook.com (2603:10b6:408:106:cafe::43) by BN9PR03CA0627.outlook.office365.com (2603:10b6:408:106::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5250.13 via Frontend Transport; Fri, 13 May 2022 07:33:29 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 12.22.5.238) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 12.22.5.238 as permitted sender) receiver=protection.outlook.com; client-ip=12.22.5.238; helo=mail.nvidia.com; Received: from mail.nvidia.com (12.22.5.238) by BN8NAM11FT041.mail.protection.outlook.com (10.13.177.18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5250.13 via Frontend Transport; Fri, 13 May 2022 07:33:29 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL105.nvidia.com (10.27.9.14) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Fri, 13 May 2022 07:33:28 +0000 Received: from nvidia.com (10.126.231.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Fri, 13 May 2022 00:33:26 -0700 From: Shun Hao To: , , CC: , Subject: [PATCH v1 1/4] net/mlx5: support previous meter color aware Date: Fri, 13 May 2022 10:33:05 +0300 Message-ID: <20220513073308.10762-2-shunh@nvidia.com> X-Mailer: git-send-email 2.20.0 In-Reply-To: <20220513073308.10762-1-shunh@nvidia.com> References: <20220513073308.10762-1-shunh@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.231.35] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 4708a241-f642-4baf-0b5f-08da34b2e032 X-MS-TrafficTypeDiagnostic: BN8PR12MB2866:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: se3q0zXXmG0eQpYEYy1scWtmuvceZI6tFa8j+o2/gr2Ln7zCAijYB9xUDnOaQF6nIJHo7poV47KqiALRcT7Zd39Tpp0ai6tqmwi7sVA3bC7p5/4mRiGeHbdX/B/4HYavbSTiCCQlYeQC5wWd5F3pTFrkxK3lEOAT/S9bf4cymg6fMF7QxTjOleCvl3kC7kj6OYkc4nBFOEdRYcdMdzx1zwKuojssmPjAVAWa+x+9IiKgYs/l5e018Ja2Iw4hK3ig0dwPpcfSB9m7+Pw7nCEzD2EbWfgLYXltcvvkK9s02/wRG3deH0rwhzyj+TaylRZd5vMLSGwQ6Qe7Tba7bfkKJWkJnNsuNumguMCEW5Obcy7LlHx3aOtk+7N7egDLeF/YfJLt81R1wo7SJlJLkK8iAR9QMUY/RK3N3etx0oyEsr2XSvDyuD5E/7uFo/1kA+1MPPJkwothjgDnUrirVnm2lez1FaxAuesbsbq8YQz2fbYs/gj7+qZDT1E+ndpReZhnOVlSD45kSBpivas95k+ZlXfez5XcOyr5SRhwAr7vCFZ0Q3ZIpJzqZWiXO7cuwiLbK/G7i5EOSEGujq97UUrFWus+eskoVtVmhQ5BXuKoB50+P0/sIYHnOxVBFyTy2rJbpwScZJiP63UmkSCWOqu7ik6erMEHppaTmTqJe6gYv4fPiglz+fAonQCeAxWuXL3/3JyfMT2fir0pY0CgyLqxy5yfjlVTtRsoqPeKr1JlTX8= X-Forefront-Antispam-Report: CIP:12.22.5.238; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(40470700004)(46966006)(36840700001)(7696005)(16526019)(5660300002)(2906002)(6666004)(82310400005)(426003)(336012)(47076005)(1076003)(83380400001)(186003)(107886003)(36860700001)(55016003)(316002)(6286002)(356005)(81166007)(26005)(8676002)(70586007)(36756003)(70206006)(4326008)(40460700003)(54906003)(110136005)(8936002)(508600001)(6636002)(2616005)(86362001)(36900700001)(309714004); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 May 2022 07:33:29.4983 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 4708a241-f642-4baf-0b5f-08da34b2e032 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.238]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT041.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR12MB2866 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This patch adds the support for previous color aware for meter. Start_color setting is set to UNDEFINED when creating meter object that is color aware. Signed-off-by: Shun Hao Acked-by: Matan Azard --- drivers/net/mlx5/mlx5.h | 2 ++ drivers/net/mlx5/mlx5_flow_aso.c | 19 +++++++++++-------- drivers/net/mlx5/mlx5_flow_meter.c | 3 ++- 3 files changed, 15 insertions(+), 9 deletions(-) diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index 23a28f6e52..c92ce6b527 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -859,6 +859,8 @@ struct mlx5_flow_meter_info { uint32_t transfer:1; uint32_t def_policy:1; /* Meter points to default policy. */ + uint32_t color_aware:1; + /* Meter is color aware mode. */ void *drop_rule[MLX5_MTR_DOMAIN_MAX]; /* Meter drop rule in drop table. */ uint32_t drop_cnt; diff --git a/drivers/net/mlx5/mlx5_flow_aso.c b/drivers/net/mlx5/mlx5_flow_aso.c index eb7fc43da3..4129e3a9e0 100644 --- a/drivers/net/mlx5/mlx5_flow_aso.c +++ b/drivers/net/mlx5/mlx5_flow_aso.c @@ -652,6 +652,7 @@ mlx5_aso_mtr_sq_enqueue_single(struct mlx5_dev_ctx_shared *sh, uint16_t res; uint32_t dseg_idx = 0; struct mlx5_aso_mtr_pool *pool = NULL; + uint32_t param_le; rte_spinlock_lock(&sq->sqsl); res = size - (uint16_t)(sq->head - sq->tail); @@ -688,15 +689,14 @@ mlx5_aso_mtr_sq_enqueue_single(struct mlx5_dev_ctx_shared *sh, wqe->aso_dseg.mtrs[dseg_idx].ebs_eir = 0; } fmp = fm->profile; - if (fmp->profile.packet_mode) - wqe->aso_dseg.mtrs[dseg_idx].v_bo_sc_bbog_mm = - RTE_BE32((1 << ASO_DSEG_VALID_OFFSET) | - (MLX5_FLOW_COLOR_GREEN << ASO_DSEG_SC_OFFSET) | - (MLX5_METER_MODE_PKT << ASO_DSEG_MTR_MODE)); + param_le = (1 << ASO_DSEG_VALID_OFFSET); + if (fm->color_aware) + param_le |= (MLX5_FLOW_COLOR_UNDEFINED << ASO_DSEG_SC_OFFSET); else - wqe->aso_dseg.mtrs[dseg_idx].v_bo_sc_bbog_mm = - RTE_BE32((1 << ASO_DSEG_VALID_OFFSET) | - (MLX5_FLOW_COLOR_GREEN << ASO_DSEG_SC_OFFSET)); + param_le |= (MLX5_FLOW_COLOR_GREEN << ASO_DSEG_SC_OFFSET); + if (fmp->profile.packet_mode) + param_le |= (MLX5_METER_MODE_PKT << ASO_DSEG_MTR_MODE); + wqe->aso_dseg.mtrs[dseg_idx].v_bo_sc_bbog_mm = RTE_BE32(param_le); switch (fmp->profile.alg) { case RTE_MTR_SRTCM_RFC2697: /* Only needed for RFC2697. */ @@ -709,6 +709,9 @@ mlx5_aso_mtr_sq_enqueue_single(struct mlx5_dev_ctx_shared *sh, RTE_BE32(1 << ASO_DSEG_BBOG_OFFSET); break; case RTE_MTR_TRTCM_RFC4115: + wqe->aso_dseg.mtrs[dseg_idx].v_bo_sc_bbog_mm |= + RTE_BE32(1 << ASO_DSEG_BO_OFFSET); + break; default: break; } diff --git a/drivers/net/mlx5/mlx5_flow_meter.c b/drivers/net/mlx5/mlx5_flow_meter.c index a3d1f2c08d..b52de70afa 100644 --- a/drivers/net/mlx5/mlx5_flow_meter.c +++ b/drivers/net/mlx5/mlx5_flow_meter.c @@ -1005,7 +1005,7 @@ mlx5_flow_meter_validate(struct mlx5_priv *priv, uint32_t meter_id, RTE_MTR_ERROR_TYPE_MTR_PARAMS, NULL, "Meter object params null."); /* Previous meter color is not supported. */ - if (params->use_prev_mtr_color) + if (params->use_prev_mtr_color && !priv->sh->meter_aso_en) return -rte_mtr_error_set(error, ENOTSUP, RTE_MTR_ERROR_TYPE_MTR_PARAMS, NULL, @@ -1293,6 +1293,7 @@ mlx5_flow_meter_create(struct rte_eth_dev *dev, uint32_t meter_id, fm->active_state = 1; /* Config meter starts as active. */ fm->is_enable = params->meter_enable; fm->shared = !!shared; + fm->color_aware = !!params->use_prev_mtr_color; __atomic_add_fetch(&fm->profile->ref_cnt, 1, __ATOMIC_RELAXED); if (params->meter_policy_id == priv->sh->mtrmng->def_policy_id) { fm->def_policy = 1; From patchwork Fri May 13 07:33:06 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shun Hao X-Patchwork-Id: 111115 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 0AA2EA00C3; Fri, 13 May 2022 09:33:41 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 27B3642839; Fri, 13 May 2022 09:33:37 +0200 (CEST) Received: from NAM02-DM3-obe.outbound.protection.outlook.com (mail-dm3nam07on2057.outbound.protection.outlook.com [40.107.95.57]) by mails.dpdk.org (Postfix) with ESMTP id 4B908427F1 for ; Fri, 13 May 2022 09:33:33 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Mk5IHQRRs9A+5gAkdaz3q2JQPVZYFatPt2Bob6kcQOzgV0i/XVep9/QxL6SrKlZ2kiTxANPKmphkzxS6/JUP3yPiauR8bGOnsf1jUNx4VpjAS+kprUEJqcUSPDnaCEn309siXtSBpFRJalJ1KtcAwmEREt7Fnb8NVnaOcLtFWnYJL/gMczfWwD77lGyAT75BLXRfnL3g+4DDDmjVejExqJQn3wM89DBZibzP4pRPgkC4LW03H1mLqEwsvptnIQ1OghWzfo1XjkcN/vH3f69MLYP/xWO6rt1gi51YNynNlyX3WS/sp5Nii4FXa4DVPXoDh9sAh5MH4+aMv/h2a8DAjQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=NPBa6kJHTuPJnJwgTsJlGZP28SEVgmWwLtcGxcIgB64=; b=F5CdCw/s62jlkGLTPjFJ7yETTmP1gnMCpgbyu7EKLA1nXs9IAD2DnduBi3a2w024SwwzI59FpElI7A4mt1lnWFVPgCk3DMHUB/0yEn3FEwZYEYMSE9EXPkjQ1Dy2gCBgf5RT20uiSg0J5KHZHdQ8yJ1rD23gN1KocTjg1pOskVFpch0hOtebt0MhtlldmYOHz3n3wn5L608BKHTtxra0zBxWtcxM+IT641c/f+wBoOErmzJlb8ALqwWrF6ybyiuciEiVjn6GpnWvesf8Tlb/dr5cpvfzWMRyHSwrdd5ubPKDYgm0Xoiog1gs3BwVrhjRT0jXp/tOt/+AJP0hHy7bBg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 12.22.5.234) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=NPBa6kJHTuPJnJwgTsJlGZP28SEVgmWwLtcGxcIgB64=; b=CHrR/oH4MkIWAqvIVItN0wtpL8sWDXOKaI3DSeOWXCAenTRXkvpy9K/zy2nOxhq/cnJ6pMgfjU19kRh+rd6aibeCiIav1NFp1iye5hu3yDxil0UndXkWBlvDVY9bhFdnrCSSAni7LQsud/Z8jlbrxuwd4zYAPwVOqaoCM91fqUXvL74E56EyYnf0nknkrOjSOlAsbxh1zQwp0gNtHwdA5BW9u3BS81qFfrO/EQQpl6rCoOVLgL4n4v0fHWCyp0QYVeyLLhOjAVWpFA0mNwvwsaMJT9GxsLER+C+KUdYMKmEhp5CtKjlRj9vcT8wbIqtApuHZit/FZSSsmy41y5JFXg== Received: from MW4PR04CA0330.namprd04.prod.outlook.com (2603:10b6:303:82::35) by BN8PR12MB3282.namprd12.prod.outlook.com (2603:10b6:408:9e::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5227.22; Fri, 13 May 2022 07:33:31 +0000 Received: from CO1NAM11FT059.eop-nam11.prod.protection.outlook.com (2603:10b6:303:82:cafe::fa) by MW4PR04CA0330.outlook.office365.com (2603:10b6:303:82::35) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5250.14 via Frontend Transport; Fri, 13 May 2022 07:33:31 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 12.22.5.234) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 12.22.5.234 as permitted sender) receiver=protection.outlook.com; client-ip=12.22.5.234; helo=mail.nvidia.com; Received: from mail.nvidia.com (12.22.5.234) by CO1NAM11FT059.mail.protection.outlook.com (10.13.174.160) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5250.13 via Frontend Transport; Fri, 13 May 2022 07:33:31 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL101.nvidia.com (10.27.9.10) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Fri, 13 May 2022 07:33:30 +0000 Received: from nvidia.com (10.126.231.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Fri, 13 May 2022 00:33:28 -0700 From: Shun Hao To: , , CC: , Subject: [PATCH v1 2/4] net/mlx5: support yellow meter action in hierarchy Date: Fri, 13 May 2022 10:33:06 +0300 Message-ID: <20220513073308.10762-3-shunh@nvidia.com> X-Mailer: git-send-email 2.20.0 In-Reply-To: <20220513073308.10762-1-shunh@nvidia.com> References: <20220513073308.10762-1-shunh@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.231.35] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 3df53130-f5fa-43af-a1a3-08da34b2e145 X-MS-TrafficTypeDiagnostic: BN8PR12MB3282:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: agHa3B16FyFQuS//IupJG0Ujd17H0mZ6yITHpSMFStK/Knl0r2MjA1rpdAUFD2Bq7N1yY4DWIWpbqSyMqYDIVB723iuDUasj04rjdNt95t+1sU0cev3Z/36P2CK3927pR0uVtd8IctGQFI358mA9UL+MbRMH/i4eeZ89i4tiyEtsoFW/1EeJcea5FGbIDIXdqdCMhKKcBHy+6nAz76L2KHMq2zqCTa5rCxxWuPrLa6O+w+rDyqHVpyndUL+H+cUCxzdNa4HqPnJPuDv39/QytJdpSckc4bjBUp/y4DIMAGTEyB/fNqjkISy4GzTKwJeAUhKCPkvBgts4VdhMoz/CzT8DXZ6oZe6lp1r6pZ5z4BZvAeqooFH+Gejc8taWFmakE6Phu0K8qbpxgsOtN4bnIPJAckRD19AOzbkic574oC+0G1iGx8j7U1UHXGqvjrEm8DaGO70cov5wVmNDNzrX2hGEtHN7kZPLWwZ7BhamdVQPMvoCvsun2oOmSg3qWmoExyjB5BoEFG6jp1rXAVHUgNSWPVOpCvlLWncYZYhCjhapeJtDtUe/7A/nMiw0otKHGW5yvFBHmJDBFWGc2bwbUUv2EUghCPWMjpOUUzflsTiVYdiD+Z24akZblC1ecHJ8JOwHjhXXSfV0NhNfzH5IfA6OA/sA+aC3g8PkBz2UgcRFfmdQ4M+jww/rR26KT6I5iIzD1XthsH7cAV+k+ZObqA== X-Forefront-Antispam-Report: CIP:12.22.5.234; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(36840700001)(46966006)(40470700004)(81166007)(5660300002)(508600001)(82310400005)(6666004)(7696005)(54906003)(36756003)(83380400001)(55016003)(110136005)(2906002)(6636002)(40460700003)(30864003)(16526019)(70206006)(47076005)(6286002)(70586007)(1076003)(336012)(426003)(4326008)(86362001)(316002)(356005)(8676002)(36860700001)(2616005)(8936002)(107886003)(26005)(186003)(36900700001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 May 2022 07:33:31.3200 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 3df53130-f5fa-43af-a1a3-08da34b2e145 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.234]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1NAM11FT059.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR12MB3282 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This patch adds the support of meter action for yellow meter policy flow, so can use meter action for both green and yellow policy flows in meter hierarchy. Currently must use the same meter within one meter policy. Packets passing green/yellow policy flow will have previous meter color of green/yellow in subsequent meter. Signed-off-by: Shun Hao Acked-by: Matan Azard --- drivers/net/mlx5/mlx5.c | 8 ++- drivers/net/mlx5/mlx5.h | 8 ++- drivers/net/mlx5/mlx5_flow_dv.c | 100 ++++++++++++++++++++++------- drivers/net/mlx5/mlx5_flow_meter.c | 57 +++++++++++----- 4 files changed, 132 insertions(+), 41 deletions(-) diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index 72b1e35673..f0988712df 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -686,10 +686,14 @@ mlx5_aso_flow_mtrs_mng_close(struct mlx5_dev_ctx_shared *sh) #ifdef HAVE_MLX5_DR_CREATE_ACTION_ASO for (i = 0; i < MLX5_ASO_MTRS_PER_POOL; i++) { aso_mtr = &mtr_pool->mtrs[i]; - if (aso_mtr->fm.meter_action) + if (aso_mtr->fm.meter_action_g) claim_zero (mlx5_glue->destroy_flow_action - (aso_mtr->fm.meter_action)); + (aso_mtr->fm.meter_action_g)); + if (aso_mtr->fm.meter_action_y) + claim_zero + (mlx5_glue->destroy_flow_action + (aso_mtr->fm.meter_action_y)); } #endif /* HAVE_MLX5_DR_CREATE_ACTION_ASO */ claim_zero(mlx5_devx_cmd_destroy diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index c92ce6b527..ef755ee8cf 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -869,8 +869,10 @@ struct mlx5_flow_meter_info { /**< Use count. */ struct mlx5_indexed_pool *flow_ipool; /**< Index pool for flow id. */ - void *meter_action; + void *meter_action_g; /**< Flow meter action. */ + void *meter_action_y; + /**< Flow meter action for yellow init_color. */ }; /* PPS(packets per second) map to BPS(Bytes per second). @@ -1873,6 +1875,10 @@ struct mlx5_flow_meter_policy *mlx5_flow_meter_policy_find (struct rte_eth_dev *dev, uint32_t policy_id, uint32_t *policy_idx); +struct mlx5_flow_meter_info * +mlx5_flow_meter_hierarchy_next_meter(struct mlx5_priv *priv, + struct mlx5_flow_meter_policy *policy, + uint32_t *mtr_idx); struct mlx5_flow_meter_policy * mlx5_flow_meter_hierarchy_get_final_policy(struct rte_eth_dev *dev, struct mlx5_flow_meter_policy *policy); diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_dv.c index f9c56204c4..ee7a32acc8 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -6534,13 +6534,13 @@ flow_dv_mtr_alloc(struct rte_eth_dev *dev) struct mlx5_aso_mtr_pool, mtrs[mtr_free->offset]); mtr_idx = MLX5_MAKE_MTR_IDX(pool->index, mtr_free->offset); - if (!mtr_free->fm.meter_action) { + if (!mtr_free->fm.meter_action_g) { #ifdef HAVE_MLX5_DR_CREATE_ACTION_ASO struct rte_flow_error error; uint8_t reg_id; reg_id = mlx5_flow_get_reg_id(dev, MLX5_MTR_COLOR, 0, &error); - mtr_free->fm.meter_action = + mtr_free->fm.meter_action_g = mlx5_glue->dv_create_flow_action_aso (priv->sh->rx_domain, pool->devx_obj->obj, @@ -6548,7 +6548,7 @@ flow_dv_mtr_alloc(struct rte_eth_dev *dev) (1 << MLX5_FLOW_COLOR_GREEN), reg_id - REG_C_0); #endif /* HAVE_MLX5_DR_CREATE_ACTION_ASO */ - if (!mtr_free->fm.meter_action) { + if (!mtr_free->fm.meter_action_g) { flow_dv_aso_mtr_release_to_pool(dev, mtr_idx); return 0; } @@ -13401,7 +13401,7 @@ flow_dv_translate(struct rte_eth_dev *dev, NULL, "Failed to get meter in flow."); /* Set the meter action. */ dev_flow->dv.actions[actions_n++] = - wks->fm->meter_action; + wks->fm->meter_action_g; action_flags |= MLX5_FLOW_ACTION_METER; break; case RTE_FLOW_ACTION_TYPE_SET_IPV4_DSCP: @@ -15427,7 +15427,7 @@ __flow_dv_destroy_sub_policy_rules(struct rte_eth_dev *dev, for (i = 0; i < RTE_COLORS; i++) { next_fm = NULL; - if (i == RTE_COLOR_GREEN && policy && + if (i <= RTE_COLOR_YELLOW && policy && policy->act_cnt[i].fate_action == MLX5_FLOW_FATE_MTR) next_fm = mlx5_flow_meter_find(priv, policy->act_cnt[i].next_mtr_id, NULL); @@ -15551,6 +15551,51 @@ flow_dv_destroy_mtr_policy_acts(struct rte_eth_dev *dev, mtr_policy->dr_drop_action[j] = NULL; } +/** + * Create yellow action for color aware meter. + * + * @param[in] dev + * Pointer to the Ethernet device structure. + * @param[in] fm + * Meter information table. + * @param[out] error + * Perform verbose error reporting if not NULL. Initialized in case of + * error only. + * + * @return + * 0 on success, a negative errno value otherwise and rte_errno is set. + */ +static int +__flow_dv_create_mtr_yellow_action(struct rte_eth_dev *dev, + struct mlx5_flow_meter_info *fm, + struct rte_mtr_error *error) +{ +#ifdef HAVE_MLX5_DR_CREATE_ACTION_ASO + struct mlx5_priv *priv = dev->data->dev_private; + struct rte_flow_error flow_err; + struct mlx5_aso_mtr *aso_mtr; + struct mlx5_aso_mtr_pool *pool; + uint8_t reg_id; + + aso_mtr = container_of(fm, struct mlx5_aso_mtr, fm); + pool = container_of(aso_mtr, struct mlx5_aso_mtr_pool, mtrs[aso_mtr->offset]); + reg_id = mlx5_flow_get_reg_id(dev, MLX5_MTR_COLOR, 0, &flow_err); + fm->meter_action_y = + mlx5_glue->dv_create_flow_action_aso(priv->sh->rx_domain, + pool->devx_obj->obj, + aso_mtr->offset, + (1 << MLX5_FLOW_COLOR_YELLOW), + reg_id - REG_C_0); +#else + RTE_SET_USED(dev); +#endif + if (!fm->meter_action_y) { + return -rte_mtr_error_set(error, EINVAL, RTE_MTR_ERROR_TYPE_MTR_ID, NULL, + "Fail to create yellow meter action."); + } + return 0; +} + /** * Create policy action per domain, lock free, * (mutex should be acquired by caller). @@ -15870,7 +15915,7 @@ __flow_dv_create_domain_policy_acts(struct rte_eth_dev *dev, break; } /* - * No need to check meter hierarchy for Y or R colors + * No need to check meter hierarchy for R colors * here since it is done in the validation stage. */ case RTE_FLOW_ACTION_TYPE_METER: @@ -15921,6 +15966,10 @@ __flow_dv_create_domain_policy_acts(struct rte_eth_dev *dev, action_flags |= MLX5_FLOW_ACTION_SET_TAG; } + if (i == RTE_COLOR_YELLOW && next_fm->color_aware && + !next_fm->meter_action_y) + if (__flow_dv_create_mtr_yellow_action(dev, next_fm, error)) + return -rte_errno; act_cnt->fate_action = MLX5_FLOW_FATE_MTR; act_cnt->next_mtr_id = next_fm->meter_id; act_cnt->next_sub_policy = NULL; @@ -16519,7 +16568,7 @@ __flow_dv_create_policy_acts_rules(struct rte_eth_dev *dev, struct mlx5_flow_dv_tag_resource *tag; struct mlx5_flow_dv_port_id_action_resource *port_action; struct mlx5_hrxq *hrxq; - struct mlx5_flow_meter_info *next_fm = NULL; + struct mlx5_flow_meter_info *next_fm[RTE_COLORS] = {NULL}; struct mlx5_flow_meter_policy *next_policy; struct mlx5_flow_meter_sub_policy *next_sub_policy; struct mlx5_flow_tbl_data_entry *tbl_data; @@ -16540,30 +16589,31 @@ __flow_dv_create_policy_acts_rules(struct rte_eth_dev *dev, acts[i].actions_n = 1; continue; } - if (i == RTE_COLOR_GREEN && - mtr_policy->act_cnt[i].fate_action == MLX5_FLOW_FATE_MTR) { + if (mtr_policy->act_cnt[i].fate_action == MLX5_FLOW_FATE_MTR) { struct rte_flow_attr attr = { .transfer = transfer }; - next_fm = mlx5_flow_meter_find(priv, + next_fm[i] = mlx5_flow_meter_find(priv, mtr_policy->act_cnt[i].next_mtr_id, NULL); - if (!next_fm) { + if (!next_fm[i]) { DRV_LOG(ERR, "Failed to get next hierarchy meter."); goto err_exit; } - if (mlx5_flow_meter_attach(priv, next_fm, + if (mlx5_flow_meter_attach(priv, next_fm[i], &attr, &error)) { DRV_LOG(ERR, "%s", error.message); - next_fm = NULL; + next_fm[i] = NULL; goto err_exit; } /* Meter action must be the first for TX. */ if (mtr_first) { acts[i].dv_actions[acts[i].actions_n] = - next_fm->meter_action; + (next_fm[i]->color_aware && i == RTE_COLOR_YELLOW) ? + next_fm[i]->meter_action_y : + next_fm[i]->meter_action_g; acts[i].actions_n++; } } @@ -16621,14 +16671,16 @@ __flow_dv_create_policy_acts_rules(struct rte_eth_dev *dev, acts[i].actions_n++; break; case MLX5_FLOW_FATE_MTR: - if (!next_fm) { + if (!next_fm[i]) { DRV_LOG(ERR, "No next hierarchy meter."); goto err_exit; } if (!mtr_first) { acts[i].dv_actions[acts[i].actions_n] = - next_fm->meter_action; + (next_fm[i]->color_aware && i == RTE_COLOR_YELLOW) ? + next_fm[i]->meter_action_y : + next_fm[i]->meter_action_g; acts[i].actions_n++; } if (mtr_policy->act_cnt[i].next_sub_policy) { @@ -16637,7 +16689,7 @@ __flow_dv_create_policy_acts_rules(struct rte_eth_dev *dev, } else { next_policy = mlx5_flow_meter_policy_find(dev, - next_fm->policy_id, NULL); + next_fm[i]->policy_id, NULL); MLX5_ASSERT(next_policy); next_sub_policy = next_policy->sub_policys[domain][0]; @@ -16664,8 +16716,9 @@ __flow_dv_create_policy_acts_rules(struct rte_eth_dev *dev, } return 0; err_exit: - if (next_fm) - mlx5_flow_meter_detach(priv, next_fm); + for (i = 0; i < RTE_COLORS; i++) + if (next_fm[i]) + mlx5_flow_meter_detach(priv, next_fm[i]); return -1; } @@ -17181,8 +17234,9 @@ flow_dv_meter_sub_policy_rss_prepare(struct rte_eth_dev *dev, DRV_LOG(ERR, "Exceed max meter number in hierarchy."); return NULL; } - next_fm = mlx5_flow_meter_find(priv, - mtr_policy->act_cnt[RTE_COLOR_GREEN].next_mtr_id, NULL); + rte_spinlock_lock(&mtr_policy->sl); + next_fm = mlx5_flow_meter_hierarchy_next_meter(priv, mtr_policy, NULL); + rte_spinlock_unlock(&mtr_policy->sl); if (!next_fm) { DRV_LOG(ERR, "Failed to get next meter in hierarchy."); return NULL; @@ -17330,11 +17384,11 @@ flow_dv_meter_hierarchy_rule_create(struct rte_eth_dev *dev, struct mlx5_flow_tbl_data_entry, tbl); act_cnt = &mtr_policy->act_cnt[i]; if (mtr_first) { - acts.dv_actions[0] = next_fm->meter_action; + acts.dv_actions[0] = next_fm->meter_action_g; acts.dv_actions[1] = act_cnt->modify_hdr->action; } else { acts.dv_actions[0] = act_cnt->modify_hdr->action; - acts.dv_actions[1] = next_fm->meter_action; + acts.dv_actions[1] = next_fm->meter_action_g; } acts.dv_actions[2] = tbl_data->jump.action; acts.actions_n = 3; diff --git a/drivers/net/mlx5/mlx5_flow_meter.c b/drivers/net/mlx5/mlx5_flow_meter.c index b52de70afa..22f6ca7faf 100644 --- a/drivers/net/mlx5/mlx5_flow_meter.c +++ b/drivers/net/mlx5/mlx5_flow_meter.c @@ -611,6 +611,36 @@ mlx5_flow_meter_policy_find(struct rte_eth_dev *dev, return NULL; } +/** + * Get the next meter from one meter's policy in hierarchy chain. + * Lock free, mutex should be acquired by caller. + * + * @param[in] priv + * Pointer to mlx5_priv. + * @param[in] policy + * Pointer to flow meter policy. + * @param[out] mtr_idx + * Pointer to Meter index. + * + * @return + * Pointer to the next meter, or NULL when fail. + */ +struct mlx5_flow_meter_info * +mlx5_flow_meter_hierarchy_next_meter(struct mlx5_priv *priv, + struct mlx5_flow_meter_policy *policy, + uint32_t *mtr_idx) +{ + int i; + + for (i = 0; i < MLX5_MTR_RTE_COLORS; i++) { + if (policy->act_cnt[i].fate_action == MLX5_FLOW_FATE_MTR) + return mlx5_flow_meter_find(priv, + policy->act_cnt[i].next_mtr_id, + mtr_idx); + } + return NULL; +} + /** * Get the last meter's policy from one meter's policy in hierarchy. * @@ -631,8 +661,9 @@ mlx5_flow_meter_hierarchy_get_final_policy(struct rte_eth_dev *dev, struct mlx5_flow_meter_policy *next_policy = policy; while (next_policy->is_hierarchy) { - next_fm = mlx5_flow_meter_find(priv, - next_policy->act_cnt[RTE_COLOR_GREEN].next_mtr_id, NULL); + rte_spinlock_lock(&next_policy->sl); + next_fm = mlx5_flow_meter_hierarchy_next_meter(priv, next_policy, NULL); + rte_spinlock_unlock(&next_policy->sl); if (!next_fm || next_fm->def_policy) return NULL; next_policy = mlx5_flow_meter_policy_find(dev, @@ -1105,9 +1136,9 @@ mlx5_flow_meter_action_modify(struct mlx5_priv *priv, ebs_mantissa, val); } /* Apply modifications to meter only if it was created. */ - if (fm->meter_action) { + if (fm->meter_action_g) { ret = mlx5_glue->dv_modify_flow_action_meter - (fm->meter_action, &mod_attr, + (fm->meter_action_g, &mod_attr, rte_cpu_to_be_64(modify_bits)); if (ret) return ret; @@ -1908,7 +1939,7 @@ mlx5_flow_meter_attach(struct mlx5_priv *priv, rte_spinlock_unlock(&fm->sl); } else { rte_spinlock_lock(&fm->sl); - if (fm->meter_action) { + if (fm->meter_action_g) { if (fm->shared && attr->transfer == fm->transfer && attr->ingress == fm->ingress && @@ -1928,9 +1959,9 @@ mlx5_flow_meter_attach(struct mlx5_priv *priv, fm->transfer = attr->transfer; fm->ref_cnt = 1; /* This also creates the meter object. */ - fm->meter_action = mlx5_flow_meter_action_create(priv, + fm->meter_action_g = mlx5_flow_meter_action_create(priv, fm); - if (!fm->meter_action) { + if (!fm->meter_action_g) { fm->ref_cnt = 0; fm->ingress = 0; fm->egress = 0; @@ -1962,8 +1993,8 @@ mlx5_flow_meter_detach(struct mlx5_priv *priv, rte_spinlock_lock(&fm->sl); MLX5_ASSERT(fm->ref_cnt); if (--fm->ref_cnt == 0 && !priv->sh->meter_aso_en) { - mlx5_glue->destroy_flow_action(fm->meter_action); - fm->meter_action = NULL; + mlx5_glue->destroy_flow_action(fm->meter_action_g); + fm->meter_action_g = NULL; fm->ingress = 0; fm->egress = 0; fm->transfer = 0; @@ -2040,9 +2071,7 @@ mlx5_flow_meter_flush_hierarchy(struct rte_eth_dev *dev, MLX5_ASSERT(policy); while (!fm->ref_cnt && policy->is_hierarchy) { policy_id = fm->policy_id; - next_fm = mlx5_flow_meter_find(priv, - policy->act_cnt[RTE_COLOR_GREEN].next_mtr_id, - &next_mtr_idx); + next_fm = mlx5_flow_meter_hierarchy_next_meter(priv, policy, &next_mtr_idx); if (next_fm) { next_policy = mlx5_flow_meter_policy_find(dev, next_fm->policy_id, @@ -2120,9 +2149,7 @@ mlx5_flow_meter_flush_all_hierarchies(struct rte_eth_dev *dev, policy = sub_policy->main_policy; if (!policy || !policy->is_hierarchy || policy->ref_cnt) continue; - next_fm = mlx5_flow_meter_find(priv, - policy->act_cnt[RTE_COLOR_GREEN].next_mtr_id, - &mtr_idx); + next_fm = mlx5_flow_meter_hierarchy_next_meter(priv, policy, &mtr_idx); if (__mlx5_flow_meter_policy_delete(dev, i, policy, error, true)) return -rte_mtr_error_set(error, From patchwork Fri May 13 07:33:07 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shun Hao X-Patchwork-Id: 111116 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2C937A00C3; Fri, 13 May 2022 09:33:51 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 722474284B; Fri, 13 May 2022 09:33:40 +0200 (CEST) Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11on2077.outbound.protection.outlook.com [40.107.220.77]) by mails.dpdk.org (Postfix) with ESMTP id 511584283C for ; Fri, 13 May 2022 09:33:37 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=jWOSnUpi5b1qdZj+UoQJTqDmQlU4rv34YEl8ZI1Z9hya6Mg1AgCY/e1DJ8qKYvRPpGe6YKIQ56lndiMe75+ABgQogv7T+mJ1uBofU91zkOJlrvXyABEqZba101GnO7kP7UHHNngUMTLbeZ24deJPxIHkORBCscfFWA6CjTX3S7SgALp2OXq9a5jsdp5s4G1VtPOAGcvqzHPJGSuPVNUKLYuqVhHQaqfSUNnSmAw+O5LW4CDzVZJowWxBcCnT320PoBTxypdlaTWbls6NYSLQUJCxN2BroC2uA3200LcyRb1syW3LgMUciki7wpJYx5D1x9P32eKQBex9kCqt/vj+nw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=2BCM+FKN890cbwMpyVS2u8DVHvm4CXJvqLG7raSZsm0=; b=daHHGwuqc400e8qtZ8rGoEXgpj1oZq1KnRWIYJdlmwxg8SYXFAK3wYqH4D7h0w5BrlpSXefFSnnj4euDPhSs/yMtHnZKrXK3U55Fd/wAJ32aKEQZeRhGdXtptAS9h/Hwlh1DFFw+xzLSYTNp8XSz8iLi5SZI2K9KVvLguQqQkI1IARMTZHy7PhlHEuA/2d77ucW41A5/Mi6HueN9XKhhDRBJpC2ksP16EUTUhroPvuhUrisac7Pd7fpUhlEQ7kI/VF0fi7yiacMQUCu/s8H3oQDakdJbn1LVRds3IPzTdkvQdsp62jezyenJJbDAU3qk1OX7PydrwHUEqrFPhPnRHQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 12.22.5.236) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=2BCM+FKN890cbwMpyVS2u8DVHvm4CXJvqLG7raSZsm0=; b=KjWk1I1+BbBBqDHnSv6yBvH7pD3/dbkHp7XhYYL4cmYKVGSxGERt2CvuJAQILiaW3KSawX5Nb3p4rdI753IrIlITdAxO9u5QWMcTxiL1Fa7UYJ5gKoI1q37gI51ifZDapFnC8evfgGvXvob4DNCvZnPfiuzFyItk2A8lVPoSSAztQQTwsvGYVHfxwjl+iCDAV+YVh+0B8oZ58NWNxus6xqRvhPR9mmZxSknbqu4mXbd3rgeQV+S+hYjV9r4ekrM1ULkGh0BBJzVs1oVgBn05vyMbjhPMfq6uStaqiRoxBn+wWQK+xHA9yz4mwm7rJ/OAc/A4pVfQecEQPaXy6BnTtA== Received: from MW4PR03CA0210.namprd03.prod.outlook.com (2603:10b6:303:b8::35) by BYAPR12MB3493.namprd12.prod.outlook.com (2603:10b6:a03:dd::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5227.21; Fri, 13 May 2022 07:33:34 +0000 Received: from CO1NAM11FT057.eop-nam11.prod.protection.outlook.com (2603:10b6:303:b8:cafe::d) by MW4PR03CA0210.outlook.office365.com (2603:10b6:303:b8::35) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5227.23 via Frontend Transport; Fri, 13 May 2022 07:33:33 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 12.22.5.236) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 12.22.5.236 as permitted sender) receiver=protection.outlook.com; client-ip=12.22.5.236; helo=mail.nvidia.com; Received: from mail.nvidia.com (12.22.5.236) by CO1NAM11FT057.mail.protection.outlook.com (10.13.174.205) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5250.13 via Frontend Transport; Fri, 13 May 2022 07:33:33 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL109.nvidia.com (10.27.9.19) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Fri, 13 May 2022 07:33:33 +0000 Received: from nvidia.com (10.126.231.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Fri, 13 May 2022 00:33:30 -0700 From: Shun Hao To: , , CC: , Subject: [PATCH v1 3/4] net/mlx5: support yellow meter action for hierarchy tag rule Date: Fri, 13 May 2022 10:33:07 +0300 Message-ID: <20220513073308.10762-4-shunh@nvidia.com> X-Mailer: git-send-email 2.20.0 In-Reply-To: <20220513073308.10762-1-shunh@nvidia.com> References: <20220513073308.10762-1-shunh@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.231.35] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 6b73fc3c-dd12-43f2-bc8e-08da34b2e294 X-MS-TrafficTypeDiagnostic: BYAPR12MB3493:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: IBo5LIzLmqy5siD3fUSfq/31o/1U6Y7wjPlEOvNluXFjgbmaeoHpyjeRud46XIFaV1jpNCq0YdIRoEpO1IwofG+yJbBYXQP75Z14kfzFRlwHJ3rssFeizJ5WEMr+e6QCVnE3Pl0JtZRvMw5fuN5eZVWIGEFsEoGZrctBbCucJKnwm2jNkcytog2bAUnTviifIT+JxD0TeBCenz33IqCKJcBl6XsWG9XN9SRElYvx6b7E9/xyDMEMo6acWz6VlltXy0S9+637wbQ8PY20N8jxDTDrYQ5wYivvIfLJy9Eg5BvOaNigVflDGuqu4KZWQnjeKESKRTXeIgcgu2Cq4mf7m+euJ7X5IiEH5svU3ubooc2cs/UErmrQhgZ6YY9PAUoeEFT9tbvZvC0fcKnCBiDH3002RniprgkyovYjrKsJFw5hoeXr3EKKZe6xKYyk3lg2US0TzhjF47tdBc3bhvQ+fK8uBoywdehIZEC2fHuvQob5HlypfS43f59sY5A24Zgk5KLWgPxgLaly0tGuu7/LXu2TXf+OUX4Ow6B1xAFvyZ7KyEbTw0Ol+xRPSut62PSVLpWQ72qM8aNWlYEx+BMTVDk0JkJlT8xSsmjryHyM2mZF4gUkGJ6ysMH1R/UjOriATCNSQQy9bCS6y7n73abnbg+z5otNYCGa+sE0hPut2uY1G79uXDbwobv1q6dnbQQybC5vmTza+trEO7q887vnrQ== X-Forefront-Antispam-Report: CIP:12.22.5.236; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(40470700004)(46966006)(36840700001)(2616005)(55016003)(508600001)(1076003)(81166007)(316002)(86362001)(36860700001)(83380400001)(36756003)(107886003)(5660300002)(16526019)(186003)(8936002)(2906002)(336012)(426003)(82310400005)(70586007)(47076005)(8676002)(70206006)(4326008)(30864003)(110136005)(6636002)(54906003)(7696005)(6666004)(356005)(26005)(6286002)(40460700003)(36900700001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 May 2022 07:33:33.5318 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 6b73fc3c-dd12-43f2-bc8e-08da34b2e294 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.236]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1NAM11FT057.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR12MB3493 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org When a hierarchy meter is shared by other ports, it's needed to iterate all meter policies in hierarchy to create tag rules, to set packet with next meter ID, which will be used by related meter drop count. This patch adds the tag rule for yellow support in hierarchy, so both green/yellow policy flows can set the correct meter ID. Signed-off-by: Shun Hao Acked-by: Matan Azard --- drivers/net/mlx5/mlx5_flow_dv.c | 270 +++++++++++++++++++++----------- 1 file changed, 175 insertions(+), 95 deletions(-) diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_dv.c index ee7a32acc8..287095cceb 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -17293,6 +17293,68 @@ flow_dv_meter_sub_policy_rss_prepare(struct rte_eth_dev *dev, return NULL; } +/** + * Check if need to create hierarchy tag rule. + * + * @param[in] priv + * Pointer to mlx5_priv. + * @param[in] mtr_policy + * Pointer to current meter policy. + * @param[in] src_port + * The src port this extra rule should use. + * @param[out] next_fm + * Pointer to next meter in hierarchy. + * @param[out] skip + * Indicate if skip the tag rule creation. + * @param[out] error + * Perform verbose error reporting if not NULL. + * @return + * 0 on success, a negative errno value otherwise and rte_errno is set. + */ +static int +mlx5_meter_hierarchy_skip_tag_rule(struct mlx5_priv *priv, + struct mlx5_flow_meter_policy *mtr_policy, + int32_t src_port, + struct mlx5_flow_meter_info **next_fm, + bool *skip, + struct rte_flow_error *error) +{ + struct mlx5_flow_meter_sub_policy *sub_policy; + struct mlx5_sub_policy_color_rule *color_rule; + uint32_t domain = MLX5_MTR_DOMAIN_TRANSFER; + int ret = 0; + int i; + + *next_fm = NULL; + *skip = false; + rte_spinlock_lock(&mtr_policy->sl); + if (!mtr_policy->is_hierarchy) + goto exit; + *next_fm = mlx5_flow_meter_hierarchy_next_meter(priv, mtr_policy, NULL); + if (!*next_fm) { + ret = rte_flow_error_set(error, EINVAL, RTE_FLOW_ERROR_TYPE_ACTION, + NULL, "Failed to find next meter in hierarchy."); + goto exit; + } + if (!(*next_fm)->drop_cnt) { + *skip = true; + goto exit; + } + sub_policy = mtr_policy->sub_policys[domain][0]; + for (i = 0; i < MLX5_MTR_RTE_COLORS; i++) { + if (mtr_policy->act_cnt[i].fate_action != MLX5_FLOW_FATE_MTR) + continue; + TAILQ_FOREACH(color_rule, &sub_policy->color_rules[i], next_port) + if (color_rule->src_port == src_port) { + *skip = true; + goto exit; + } + } +exit: + rte_spinlock_unlock(&mtr_policy->sl); + return ret; +} + /** * Create the sub policy tag rule for all meters in hierarchy. * @@ -17336,111 +17398,129 @@ flow_dv_meter_hierarchy_rule_create(struct rte_eth_dev *dev, .reserved = 0, }; uint32_t domain = MLX5_MTR_DOMAIN_TRANSFER; - int i; + struct { + struct mlx5_flow_meter_policy *fm_policy; + struct mlx5_flow_meter_info *next_fm; + struct mlx5_sub_policy_color_rule *tag_rule[MLX5_MTR_RTE_COLORS]; + } fm_info[MLX5_MTR_CHAIN_MAX_NUM] = { {0} }; + uint32_t fm_cnt = 0; + uint32_t i, j; - mtr_policy = mlx5_flow_meter_policy_find(dev, fm->policy_id, NULL); - MLX5_ASSERT(mtr_policy); - if (!mtr_policy->is_hierarchy) - return 0; - next_fm = mlx5_flow_meter_find(priv, - mtr_policy->act_cnt[RTE_COLOR_GREEN].next_mtr_id, NULL); - if (!next_fm) { - return rte_flow_error_set(error, EINVAL, - RTE_FLOW_ERROR_TYPE_ACTION, NULL, - "Failed to find next meter in hierarchy."); - } - if (!next_fm->drop_cnt) - goto exit; color_reg_c_idx = mlx5_flow_get_reg_id(dev, MLX5_MTR_COLOR, 0, error); - sub_policy = mtr_policy->sub_policys[domain][0]; - for (i = 0; i < RTE_COLORS; i++) { - bool rule_exist = false; - struct mlx5_meter_policy_action_container *act_cnt; + /* Get all fms who need to create the tag color rule. */ + do { + bool skip = false; - if (i >= RTE_COLOR_YELLOW) - break; - TAILQ_FOREACH(color_rule, - &sub_policy->color_rules[i], next_port) - if (color_rule->src_port == src_port) { - rule_exist = true; - break; - } - if (rule_exist) - continue; - color_rule = mlx5_malloc(MLX5_MEM_ZERO, - sizeof(struct mlx5_sub_policy_color_rule), - 0, SOCKET_ID_ANY); - if (!color_rule) - return rte_flow_error_set(error, ENOMEM, - RTE_FLOW_ERROR_TYPE_ACTION, - NULL, "No memory to create tag color rule."); - color_rule->src_port = src_port; - attr.priority = i; - next_policy = mlx5_flow_meter_policy_find(dev, - next_fm->policy_id, NULL); - MLX5_ASSERT(next_policy); - next_sub_policy = next_policy->sub_policys[domain][0]; - tbl_data = container_of(next_sub_policy->tbl_rsc, - struct mlx5_flow_tbl_data_entry, tbl); - act_cnt = &mtr_policy->act_cnt[i]; - if (mtr_first) { - acts.dv_actions[0] = next_fm->meter_action_g; - acts.dv_actions[1] = act_cnt->modify_hdr->action; - } else { - acts.dv_actions[0] = act_cnt->modify_hdr->action; - acts.dv_actions[1] = next_fm->meter_action_g; - } - acts.dv_actions[2] = tbl_data->jump.action; - acts.actions_n = 3; - if (mlx5_flow_meter_attach(priv, next_fm, &attr, error)) { - next_fm = NULL; - goto err_exit; - } - if (__flow_dv_create_policy_matcher(dev, color_reg_c_idx, - MLX5_MTR_POLICY_MATCHER_PRIO, sub_policy, - &attr, true, item, - &color_rule->matcher, error)) { - rte_flow_error_set(error, errno, - RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, - "Failed to create hierarchy meter matcher."); + mtr_policy = mlx5_flow_meter_policy_find(dev, fm->policy_id, NULL); + MLX5_ASSERT(mtr_policy); + if (mlx5_meter_hierarchy_skip_tag_rule(priv, mtr_policy, src_port, + &next_fm, &skip, error)) goto err_exit; + if (next_fm && !skip) { + fm_info[fm_cnt].fm_policy = mtr_policy; + fm_info[fm_cnt].next_fm = next_fm; + if (++fm_cnt >= MLX5_MTR_CHAIN_MAX_NUM) { + rte_flow_error_set(error, errno, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, + "Exceed max meter number in hierarchy."); + goto err_exit; + } } - if (__flow_dv_create_policy_flow(dev, color_reg_c_idx, - (enum rte_color)i, - color_rule->matcher->matcher_object, - acts.actions_n, acts.dv_actions, - true, item, - &color_rule->rule, &attr)) { - rte_flow_error_set(error, errno, - RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, - "Failed to create hierarchy meter rule."); - goto err_exit; + fm = next_fm; + } while (fm); + /* Create tag color rules for all needed fms. */ + for (i = 0; i < fm_cnt; i++) { + void *mtr_action; + + mtr_policy = fm_info[i].fm_policy; + rte_spinlock_lock(&mtr_policy->sl); + sub_policy = mtr_policy->sub_policys[domain][0]; + for (j = 0; j < MLX5_MTR_RTE_COLORS; j++) { + if (mtr_policy->act_cnt[j].fate_action != MLX5_FLOW_FATE_MTR) + continue; + color_rule = mlx5_malloc(MLX5_MEM_ZERO, + sizeof(struct mlx5_sub_policy_color_rule), + 0, SOCKET_ID_ANY); + if (!color_rule) { + rte_spinlock_unlock(&mtr_policy->sl); + rte_flow_error_set(error, ENOMEM, + RTE_FLOW_ERROR_TYPE_ACTION, NULL, + "No memory to create tag color rule."); + goto err_exit; + } + color_rule->src_port = src_port; + next_fm = fm_info[i].next_fm; + if (mlx5_flow_meter_attach(priv, next_fm, &attr, error)) { + mlx5_free(color_rule); + rte_spinlock_unlock(&mtr_policy->sl); + goto err_exit; + } + fm_info[i].tag_rule[j] = color_rule; + TAILQ_INSERT_TAIL(&sub_policy->color_rules[j], color_rule, next_port); + /* Prepare to create color rule. */ + mtr_action = (next_fm->color_aware && j == RTE_COLOR_YELLOW) ? + next_fm->meter_action_y : + next_fm->meter_action_g; + next_policy = mlx5_flow_meter_policy_find(dev, next_fm->policy_id, NULL); + MLX5_ASSERT(next_policy); + next_sub_policy = next_policy->sub_policys[domain][0]; + tbl_data = container_of(next_sub_policy->tbl_rsc, + struct mlx5_flow_tbl_data_entry, tbl); + if (mtr_first) { + acts.dv_actions[0] = mtr_action; + acts.dv_actions[1] = mtr_policy->act_cnt[j].modify_hdr->action; + } else { + acts.dv_actions[0] = mtr_policy->act_cnt[j].modify_hdr->action; + acts.dv_actions[1] = mtr_action; + } + acts.dv_actions[2] = tbl_data->jump.action; + acts.actions_n = 3; + if (__flow_dv_create_policy_matcher(dev, color_reg_c_idx, + MLX5_MTR_POLICY_MATCHER_PRIO, sub_policy, + &attr, true, item, &color_rule->matcher, error)) { + rte_spinlock_unlock(&mtr_policy->sl); + rte_flow_error_set(error, errno, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, + "Failed to create hierarchy meter matcher."); + goto err_exit; + } + if (__flow_dv_create_policy_flow(dev, color_reg_c_idx, (enum rte_color)j, + color_rule->matcher->matcher_object, + acts.actions_n, acts.dv_actions, + true, item, &color_rule->rule, &attr)) { + rte_spinlock_unlock(&mtr_policy->sl); + rte_flow_error_set(error, errno, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, + "Failed to create hierarchy meter rule."); + goto err_exit; + } } - TAILQ_INSERT_TAIL(&sub_policy->color_rules[i], - color_rule, next_port); + rte_spinlock_unlock(&mtr_policy->sl); } -exit: - /** - * Recursive call to iterate all meters in hierarchy and - * create needed rules. - */ - return flow_dv_meter_hierarchy_rule_create(dev, next_fm, - src_port, item, error); + return 0; err_exit: - if (color_rule) { - if (color_rule->rule) - mlx5_flow_os_destroy_flow(color_rule->rule); - if (color_rule->matcher) { - struct mlx5_flow_tbl_data_entry *tbl = - container_of(color_rule->matcher->tbl, - typeof(*tbl), tbl); - mlx5_list_unregister(tbl->matchers, - &color_rule->matcher->entry); + for (i = 0; i < fm_cnt; i++) { + mtr_policy = fm_info[i].fm_policy; + rte_spinlock_lock(&mtr_policy->sl); + sub_policy = mtr_policy->sub_policys[domain][0]; + for (j = 0; j < MLX5_MTR_RTE_COLORS; j++) { + color_rule = fm_info[i].tag_rule[j]; + if (!color_rule) + continue; + if (color_rule->rule) + mlx5_flow_os_destroy_flow(color_rule->rule); + if (color_rule->matcher) { + struct mlx5_flow_tbl_data_entry *tbl = + container_of(color_rule->matcher->tbl, typeof(*tbl), tbl); + mlx5_list_unregister(tbl->matchers, &color_rule->matcher->entry); + } + if (fm_info[i].next_fm) + mlx5_flow_meter_detach(priv, fm_info[i].next_fm); + TAILQ_REMOVE(&sub_policy->color_rules[j], color_rule, next_port); + mlx5_free(color_rule); } - mlx5_free(color_rule); + rte_spinlock_unlock(&mtr_policy->sl); } - if (next_fm) - mlx5_flow_meter_detach(priv, next_fm); return -rte_errno; } From patchwork Fri May 13 07:33:08 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shun Hao X-Patchwork-Id: 111117 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 611CEA00C3; Fri, 13 May 2022 09:33:58 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 651D542853; Fri, 13 May 2022 09:33:41 +0200 (CEST) Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2073.outbound.protection.outlook.com [40.107.244.73]) by mails.dpdk.org (Postfix) with ESMTP id 40A854283E for ; Fri, 13 May 2022 09:33:38 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ENaybmtoCTVNRlQ5exLYeUSgacwIXLlLgrpOWXK1ZfsHdE6eVs1K4C/rHVWaf3gBVmtpSm7121mG2iMrBDFHNn0o9AgQkINsQKmBdKJaxxJheFADX90AQMNRqlAdiwG+6uLhuzwBn8+/5d3BMF/bsF6sKartHEAT6dzWISe2aIZB/NR/wmOkUObgDXE3gL+Er8iOWz/dLWOcTjGED++NHk5RFqdAs1vtP+jcRaA/qsPRN9hi7y+TY6NOYx562AxBY4ZYghGbSlN0E4NaVjUNvNMVWqHFDCbLfM5EUWFttjgeAjw2Eaj16AfBHN6rbVt/j5rA80855p+5uDmOVsj84g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=PJbNTT/E8NXmGKE6XLunFZ/lQLb6xowggS0A8wVvR9c=; b=AffVMOZF1QSPFSDqHBFfD3h/GRoQUNeHYBwtjaWpid63EBeJTd1u11/xGf+iXH/t58POXUPa86nsThRU2lJWd9CACnyJ+U+RBstlc39arXd+IKQRkgUppoZWrmIcx8TH+iTYP0vJ5/2IYjhh7W8Ius9005weILBZyDYJtm+TdXgmlx1iWgEV8mmR/9ncRXNntZJCA/na19wO9hFO/mwwBInb8YJEdpRBozr2MZGcUug6Cz29ySNpwKUkgWaQi7tw5vz4qNNsxd95DrzcSEjUnHeIC4m3hHPIva8kA3i7MaQb2iYexm7Ttd/DDtyMoblULMacad+jyBkN9l2VcCdHBw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 12.22.5.235) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PJbNTT/E8NXmGKE6XLunFZ/lQLb6xowggS0A8wVvR9c=; b=i3WUWTek41Zeqye9EowX4LJNuT7dNt7AE0B2xVyskw6JcGoQSUeVh/BzPBdjfw5uvYt5dDloK8acgsscGDiTqIUr21xeKb52qp4BSeStF9IUW02lEFA3QDKSnF5QC4s4pz3d35rQXpTZqGMt6/wBkKMtHqnvcKwht/YdgG+NW6WuC0jNnQp7C3dtLAtZgA4Hz8f09BSLSPzH3pPAVBkdCHVPvyfYSbv9YrX+/knFKiEOROao+i/Pp98EDbVdOKnKHkRYW/0abMXocwmtoyri1LgjqFt+uAlMhT9lFA/ECMKUdey2L0U/6QcaSlYqCPaIlfXleO2re1PeCGaSpACQMw== Received: from MWHPR15CA0072.namprd15.prod.outlook.com (2603:10b6:301:4c::34) by BN9PR12MB5148.namprd12.prod.outlook.com (2603:10b6:408:119::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5250.14; Fri, 13 May 2022 07:33:36 +0000 Received: from CO1NAM11FT009.eop-nam11.prod.protection.outlook.com (2603:10b6:301:4c:cafe::5e) by MWHPR15CA0072.outlook.office365.com (2603:10b6:301:4c::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5250.15 via Frontend Transport; Fri, 13 May 2022 07:33:35 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 12.22.5.235) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 12.22.5.235 as permitted sender) receiver=protection.outlook.com; client-ip=12.22.5.235; helo=mail.nvidia.com; Received: from mail.nvidia.com (12.22.5.235) by CO1NAM11FT009.mail.protection.outlook.com (10.13.175.61) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5250.13 via Frontend Transport; Fri, 13 May 2022 07:33:36 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL107.nvidia.com (10.27.9.16) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Fri, 13 May 2022 07:33:34 +0000 Received: from nvidia.com (10.126.231.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Fri, 13 May 2022 00:33:33 -0700 From: Shun Hao To: , , CC: , Subject: [PATCH v1 4/4] net/mlx5: add validation for yellow meter action Date: Fri, 13 May 2022 10:33:08 +0300 Message-ID: <20220513073308.10762-5-shunh@nvidia.com> X-Mailer: git-send-email 2.20.0 In-Reply-To: <20220513073308.10762-1-shunh@nvidia.com> References: <20220513073308.10762-1-shunh@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.231.35] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 3fe0ecf6-3b15-470b-98db-08da34b2e424 X-MS-TrafficTypeDiagnostic: BN9PR12MB5148:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: v4wJ23T9sS1C9rr/4sVmwQuU7oAlXfU5bDi901LfH7n7zEtkSLvx0tAY07lCc7Jftj94ta5japhDybmLky71z3c96fcrJ3ymoFh607KWT/c7OFqltOtjqqnuBJMwj6ioV06lA0FvjjYRjaXd2El1e6uq4Wj88U1fFyLuqFStq9F+xagebHmmuidl4VcA40U5LGqDFRVPg7BLOX4d7UjzPjhcKCIi9KzJpdVNE+q7flQJ0cB7KMhLlFi1AoLR31rsggou4IkLiTNF7NzTWNzTlBnP95bx0pqluAlo34nJuYoZXxRGJJV2dyltFbBj9g5rELTYITHlOVBEUcU/epHr3aAcLcFlmL3HaYsfZ9O6zmltGX8TW5gmRbR9QHDQA5thDGiiheeNZOvMVYU/biQZy7EyDynS+bwgOp+ejPVp61V1I3ptZ4p9VzxbxgGmV50D1nzTlGmZXbWVJWboVJQwqbXfCip6criLXqnPAqSLRUhpI5Mn6VVSbMKjjMtgrXiWsJYr8y6FAdWLMmTXMWPAWOrJ4hNg5X/pcxoV87a6EBKpdQPlrLT3tIaWKQxjFxBKtZUkr6gseaX+/yvSKquODv8do9v7+eiGqGcnn1mt9+UCftfkpterjh6OjtOPME0UfBCRpAjuYqiSBh/HPn6pwo5TJmB08W5uRBkUjdbrOqrHQdrHUl0UGcW4OqyIzSFeWdlrFRy87e09M2y04+r/Tg== X-Forefront-Antispam-Report: CIP:12.22.5.235; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(40470700004)(36840700001)(46966006)(8936002)(36860700001)(83380400001)(82310400005)(6636002)(36756003)(8676002)(4326008)(110136005)(54906003)(2906002)(70586007)(70206006)(316002)(5660300002)(508600001)(6286002)(2616005)(107886003)(26005)(1076003)(6666004)(336012)(426003)(16526019)(47076005)(7696005)(186003)(86362001)(40460700003)(55016003)(356005)(81166007)(36900700001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 May 2022 07:33:36.1679 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 3fe0ecf6-3b15-470b-98db-08da34b2e424 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.235]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1NAM11FT009.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN9PR12MB5148 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Yellow meter action support is added in meter hierarchy validation. If one color uses meter action, the other can only use NULL action or the same meter action. And only shared meter is supported. Signed-off-by: Shun Hao Acked-by: Matan Azard --- doc/guides/nics/mlx5.rst | 6 +++-- drivers/net/mlx5/mlx5_flow_dv.c | 40 +++++++++++++++++---------------- 2 files changed, 25 insertions(+), 21 deletions(-) diff --git a/doc/guides/nics/mlx5.rst b/doc/guides/nics/mlx5.rst index 4805d08a76..a47a3fc576 100644 --- a/doc/guides/nics/mlx5.rst +++ b/doc/guides/nics/mlx5.rst @@ -443,13 +443,15 @@ Limitations - yellow: NULL or END. - RED: DROP / END. - The only supported meter policy actions: - - green: QUEUE, RSS, PORT_ID, REPRESENTED_PORT, JUMP, DROP, MARK and SET_TAG. - - yellow: QUEUE, RSS, PORT_ID, REPRESENTED_PORT, JUMP, DROP, MARK and SET_TAG. + - green: QUEUE, RSS, PORT_ID, REPRESENTED_PORT, JUMP, DROP, MARK, METER and SET_TAG. + - yellow: QUEUE, RSS, PORT_ID, REPRESENTED_PORT, JUMP, DROP, MARK, METER and SET_TAG. - RED: must be DROP. - Policy actions of RSS for green and yellow should have the same configuration except queues. - Policy with RSS/queue action is not supported when ``dv_xmeta_en`` enabled. + - If green action is METER, yellow action must be the same METER action or NULL. - meter profile packet mode is supported. - meter profiles of RFC2697, RFC2698 and RFC4115 are supported. + - RFC4115 implementation is following MEF, meaning yellow traffic may reclaim unused green bandwidth when green token bucket is full. - Integrity: diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_dv.c index 287095cceb..9354675e97 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -18003,8 +18003,8 @@ flow_dv_validate_policy_mtr_hierarchy(struct rte_eth_dev *dev, NULL, "Multiple fate actions not supported."); *hierarchy_domain = 0; + fm = mlx5_flow_meter_find(priv, meter_id, NULL); while (true) { - fm = mlx5_flow_meter_find(priv, meter_id, NULL); if (!fm) return -rte_mtr_error_set(error, EINVAL, RTE_MTR_ERROR_TYPE_MTR_ID, NULL, @@ -18013,6 +18013,10 @@ flow_dv_validate_policy_mtr_hierarchy(struct rte_eth_dev *dev, return -rte_mtr_error_set(error, EINVAL, RTE_MTR_ERROR_TYPE_MTR_ID, NULL, "Non termination meter not supported in hierarchy."); + if (!fm->shared) + return -rte_mtr_error_set(error, EINVAL, + RTE_MTR_ERROR_TYPE_MTR_ID, NULL, + "Only shared meter supported in hierarchy."); policy = mlx5_flow_meter_policy_find(dev, fm->policy_id, NULL); MLX5_ASSERT(policy); /** @@ -18034,7 +18038,9 @@ flow_dv_validate_policy_mtr_hierarchy(struct rte_eth_dev *dev, *is_rss = policy->is_rss; break; } - meter_id = policy->act_cnt[RTE_COLOR_GREEN].next_mtr_id; + rte_spinlock_lock(&policy->sl); + fm = mlx5_flow_meter_hierarchy_next_meter(priv, policy, NULL); + rte_spinlock_unlock(&policy->sl); if (++cnt >= MLX5_MTR_CHAIN_MAX_NUM) return -rte_mtr_error_set(error, EINVAL, RTE_MTR_ERROR_TYPE_METER_POLICY, NULL, @@ -18080,6 +18086,7 @@ flow_dv_validate_mtr_policy_acts(struct rte_eth_dev *dev, uint8_t def_domain = MLX5_MTR_ALL_DOMAIN_BIT; uint8_t hierarchy_domain = 0; const struct rte_flow_action_meter *mtr; + const struct rte_flow_action_meter *next_mtr = NULL; bool def_green = false; bool def_yellow = false; const struct rte_flow_action_rss *rss_color[RTE_COLORS] = {NULL}; @@ -18263,25 +18270,12 @@ flow_dv_validate_mtr_policy_acts(struct rte_eth_dev *dev, ++actions_n; action_flags[i] |= MLX5_FLOW_ACTION_JUMP; break; - /* - * Only the last meter in the hierarchy will support - * the YELLOW color steering. Then in the meter policy - * actions list, there should be no other meter inside. - */ case RTE_FLOW_ACTION_TYPE_METER: - if (i != RTE_COLOR_GREEN) - return -rte_mtr_error_set(error, - ENOTSUP, - RTE_MTR_ERROR_TYPE_METER_POLICY, - NULL, - "Meter hierarchy only supports GREEN color."); - if (*policy_mode != MLX5_MTR_POLICY_MODE_OG) - return -rte_mtr_error_set(error, - ENOTSUP, - RTE_MTR_ERROR_TYPE_METER_POLICY, - NULL, - "No yellow policy should be provided in meter hierarchy."); mtr = act->conf; + if (next_mtr && next_mtr->mtr_id != mtr->mtr_id) + return -rte_mtr_error_set(error, ENOTSUP, + RTE_MTR_ERROR_TYPE_METER_POLICY, NULL, + "Green and Yellow must use the same meter."); ret = flow_dv_validate_policy_mtr_hierarchy(dev, mtr->mtr_id, action_flags[i], @@ -18293,6 +18287,7 @@ flow_dv_validate_mtr_policy_acts(struct rte_eth_dev *dev, ++actions_n; action_flags[i] |= MLX5_FLOW_ACTION_METER_WITH_TERMINATED_POLICY; + next_mtr = mtr; break; default: return -rte_mtr_error_set(error, ENOTSUP, @@ -18378,6 +18373,13 @@ flow_dv_validate_mtr_policy_acts(struct rte_eth_dev *dev, } } } + if (next_mtr && *policy_mode == MLX5_MTR_POLICY_MODE_ALL) { + if (!(action_flags[RTE_COLOR_GREEN] & action_flags[RTE_COLOR_YELLOW] & + MLX5_FLOW_ACTION_METER_WITH_TERMINATED_POLICY)) + return -rte_mtr_error_set(error, EINVAL, RTE_MTR_ERROR_TYPE_METER_POLICY, + NULL, + "Meter hierarchy supports meter action only."); + } /* If both colors have RSS, the attributes should be the same. */ if (flow_dv_mtr_policy_rss_compare(rss_color[RTE_COLOR_GREEN], rss_color[RTE_COLOR_YELLOW]))