From patchwork Fri Jul 2 06:18:10 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Suanming Mou X-Patchwork-Id: 95169 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id B21CDA0A0C; Fri, 2 Jul 2021 08:20:42 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D5D7D413A4; Fri, 2 Jul 2021 08:19:03 +0200 (CEST) Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on2078.outbound.protection.outlook.com [40.107.236.78]) by mails.dpdk.org (Postfix) with ESMTP id 8DB8041353 for ; Fri, 2 Jul 2021 08:19:01 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Ljf0Qsb479TjnMulJzasWhboOPzIhX/xBegZbiWXkVJM+xF+OmOcDLqn7ZoCdmG1RGgaO0F/GvQTPW7684PLQZGejHS39I7h+FRipwaCH9BE42krf6yQrsni6fD6OuNAvSiRhCff5WKweMxHi5kYCXxuOjtPqyl7sYhQtZ4VDmdrjbNpamtg8yddlyIfeAGpxL+vt4awN1o8NXd98FADQegeLxZ0A34nT/yfGHOSGRmi163N3VpQNIqXSsqlmxT2ZrKSjw22vmHdCNaa4Zf/D05W+EbCgg8rGtkEx8U5w5bGHFMh/ch1nEJ6TDcjUORSn0CYsBcl4vUYTPljisD45Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OsF7TEanHe9G4RKUc67QdO6yn1b9peXCU9l0oHLR7AI=; b=kr3RaigI85QDFEH9ESrU98M7aI457wmVYm8uH1JofhCHCMIBjUduyMEGOogGdynsaUw4ejPsV3lSOwGsu25yjZiIIJ/CZmHMZe36KaeimVTmEUnL0zLmUHrXgpAOnm3qjbqvHiCKRuuTJUfdvceJD3nJDC8bHzsvVNcc+hjADAasFVJ8q/Ok9dH72/8bj6GrmkmMlf8XrLxjIiOA2mWzEX1BL/kwRe0yHOjYoSuIrvgIiQBk2kGctSyr8K0MOoFZIjeN5S4QYYStyITfYFS2hY2Er+3mroouPuN980ilHVqCSRAev6si/SWw8Wfb1eXyU33bKSh2Tr/737Nc05ACcA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.34) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OsF7TEanHe9G4RKUc67QdO6yn1b9peXCU9l0oHLR7AI=; b=VTG1PkNLzsIZk+M910h1QOlGDSw+CS8MAYqwsGSVvnkTB/+aie1fnNVXvuf1nOKjwG8O+TNipw9/eltvtnnea3Hk5iRdJO7xDO4QWXB5NpgI5LoLFFj1C9XsvqigY6M/cE2xZ9LAoJ7bX2V9t8ltSmYENVxUfQSrPeRiw2onQBldtCXSjlWqDes9fjF1MQQEIvkrQXCAiqyUFSAfGApYMFS81GxolZK7Tpu0aTJt1oURVnpxhIyE3aq5yGuFJkUVGUuYRm56XA0MvSVfJ/2xnwt2dq6SM3PuEvkmwVvvY2yvbuc1wkQGnxWupEvP/+i8T/XBezQWi4p4ZJtaY4kvvg== Received: from BN0PR04CA0153.namprd04.prod.outlook.com (2603:10b6:408:eb::8) by DM6PR12MB3289.namprd12.prod.outlook.com (2603:10b6:5:15d::31) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4264.23; Fri, 2 Jul 2021 06:19:00 +0000 Received: from BN8NAM11FT059.eop-nam11.prod.protection.outlook.com (2603:10b6:408:eb:cafe::ab) by BN0PR04CA0153.outlook.office365.com (2603:10b6:408:eb::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22 via Frontend Transport; Fri, 2 Jul 2021 06:19:00 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.34) smtp.mailfrom=nvidia.com; dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.34 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.34; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.34) by BN8NAM11FT059.mail.protection.outlook.com (10.13.177.120) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4287.22 via Frontend Transport; Fri, 2 Jul 2021 06:19:00 +0000 Received: from nvidia.com (172.20.187.5) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 2 Jul 2021 06:18:57 +0000 From: Suanming Mou To: , CC: , , Date: Fri, 2 Jul 2021 09:18:10 +0300 Message-ID: <20210702061816.10454-17-suanmingm@nvidia.com> X-Mailer: git-send-email 2.18.1 In-Reply-To: <20210702061816.10454-1-suanmingm@nvidia.com> References: <20210527093403.1153127-1-suanmingm@nvidia.com> <20210702061816.10454-1-suanmingm@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [172.20.187.5] X-ClientProxiedBy: HQMAIL107.nvidia.com (172.20.187.13) To HQMAIL107.nvidia.com (172.20.187.13) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 3ee3f014-a582-463f-0d1b-08d93d214847 X-MS-TrafficTypeDiagnostic: DM6PR12MB3289: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:224; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: uhWOIux2KMg03GWr5VqmcYux6NPLGi59GVATKU5VRr1647n3owwkOPCgiGx3n4azkZNrc+2fIFfRiF7plvkm4f8Ax6fQaeUlMrScy4l4Yp0FutI4WopvYjaIey8sfRGJ1gwqhPJN1WJGtzDN/0f8BHomhlKq+yB3fdXx40tfi2R9gZ5VfQVhATviYGV757m4NTaF3Y6jhYGaoZZzu92noKNv30phadqpqrWBeszdmVLrdURndNUv5/gxaLzBP1wRqvguokBfzrZRyPZHvp7aMEhw+nNXkdoeYonLcPRflJn+nsqfWkZUjNnqwdH7debpnzTfu9akf5XK6pIm1VU6YGBsSfhkb2CJY97ZBcZoQ5ztJnHQzAk2hs6PJSSJSFti7p9NvQvRXA0kWqBAf/8kFHhADMeOSVPpWKryP7enveKRzNVFR3W5qo/deUvqcMytTCmM4aKFSdExr/weR+xTpSwQ8G7H+onh55q1Rn94m9CCiwfB+SE/0Gf5ALqAYOJwmPqURNOuArryCkX3mJC6k+0qErWSlmxlq1plfSHpjl39xho1er/WwqE168+gIOMqLa9L0RSaYXHUW3Kz8jtD1zbYse6vlMPzfbghqEwu/bK5ZgvcVQJkQnPULyMbkU8Bu+ADCCWpugk9OJs+jCZYDEFjc8odtM1WNkb/a6AHVDLLBVeu13qBni9z2xOVvW7MLEnJJjLuWzl6K+MAgThT+1rwaA10cFx6bPrKb7ftJ78= X-Forefront-Antispam-Report: CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE; SFS:(4636009)(396003)(136003)(346002)(376002)(39860400002)(36840700001)(46966006)(1076003)(7636003)(6286002)(316002)(2906002)(110136005)(83380400001)(7696005)(82310400003)(86362001)(6666004)(356005)(5660300002)(36906005)(82740400003)(54906003)(26005)(4326008)(8936002)(55016002)(426003)(8676002)(70586007)(47076005)(36860700001)(478600001)(2616005)(16526019)(70206006)(186003)(336012)(6636002)(36756003)(309714004); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Jul 2021 06:19:00.3557 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 3ee3f014-a582-463f-0d1b-08d93d214847 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT059.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB3289 Subject: [dpdk-dev] [PATCH v3 16/22] net/mlx5: enable index pool per-core cache X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This commit enables the tag and header modify action index pool per-core cache in non-reclaim memory mode. Signed-off-by: Suanming Mou Acked-by: Matan Azrad --- drivers/net/mlx5/mlx5.c | 4 +++- drivers/net/mlx5/mlx5.h | 1 + drivers/net/mlx5/mlx5_flow_dv.c | 3 ++- 3 files changed, 6 insertions(+), 2 deletions(-) diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index 8fb7f4442d..bf1463c289 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -214,7 +214,8 @@ static const struct mlx5_indexed_pool_config mlx5_ipool_cfg[] = { .grow_trunk = 3, .grow_shift = 2, .need_lock = 1, - .release_mem_en = 1, + .release_mem_en = 0, + .per_core_cache = (1 << 16), .malloc = mlx5_malloc, .free = mlx5_free, .type = "mlx5_tag_ipool", @@ -1128,6 +1129,7 @@ mlx5_alloc_shared_dev_ctx(const struct mlx5_dev_spawn_data *spawn, } sh->refcnt = 1; sh->max_port = spawn->max_port; + sh->reclaim_mode = config->reclaim_mode; strncpy(sh->ibdev_name, mlx5_os_get_ctx_device_name(sh->ctx), sizeof(sh->ibdev_name) - 1); strncpy(sh->ibdev_path, mlx5_os_get_ctx_device_path(sh->ctx), diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index c7239e1137..01198b6cc7 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -1093,6 +1093,7 @@ struct mlx5_dev_ctx_shared { uint32_t qp_ts_format:2; /* QP timestamp formats supported. */ uint32_t meter_aso_en:1; /* Flow Meter ASO is supported. */ uint32_t ct_aso_en:1; /* Connection Tracking ASO is supported. */ + uint32_t reclaim_mode:1; /* Reclaim memory. */ uint32_t max_port; /* Maximal IB device port index. */ struct mlx5_bond_info bond; /* Bonding information. */ void *ctx; /* Verbs/DV/DevX context. */ diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_dv.c index e702b78358..f84a2b1a5d 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -5321,7 +5321,8 @@ flow_dv_modify_ipool_get(struct mlx5_dev_ctx_shared *sh, uint8_t index) .grow_trunk = 3, .grow_shift = 2, .need_lock = 1, - .release_mem_en = 1, + .release_mem_en = !!sh->reclaim_mode, + .per_core_cache = sh->reclaim_mode ? 0 : (1 << 16), .malloc = mlx5_malloc, .free = mlx5_free, .type = "mlx5_modify_action_resource",