From patchwork Tue Jul 6 13:32:53 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Suanming Mou X-Patchwork-Id: 95409 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6DFA5A0C47; Tue, 6 Jul 2021 15:36:28 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0F05D41484; Tue, 6 Jul 2021 15:34:01 +0200 (CEST) Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2047.outbound.protection.outlook.com [40.107.244.47]) by mails.dpdk.org (Postfix) with ESMTP id EA44E41478 for ; Tue, 6 Jul 2021 15:33:58 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=X7AXH7ExqptDM8HDNdIAlKA3jsK37Kl4ALJtPkZLQnnozg+nDzHfnSBIBKVdSoS43b2RRyIVJ0qKXWP42qLST1TEg0E0TWvLkTCB7AelNa3whYiETO6H67gnHvhjLqTshkQBLI95cvf7FR0TcZEbXhG6P42Q+XKSiQ76g76JRQxCjxtFVFLinHWcBDRmuIqFZGmma8TPvBm1IWkMgXENabibMi3M8sEu8c8o7ccpNOLCzyOMTOwYkrj42l3AC0baSjOQL6qhjlJ4Dn+uJ7dRdarq96kg0aqbXPm81xnlcHg9AbfPoxuX4LI+JuzKmxVlCOOPmKN4p+E3r76ZI0mH1w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=uyI48novntLp/bR+ihIKj+OVXI3SJNvh26AYEBAZcQo=; b=Ro0mdTlhTj5yCYJL9OtYjhvxkAkvVKXFxYamkysVmfAyv/xmXSswL97n7B9KeFIJ2h9uH5ugLD0InTWOjy6dJsGL2RjJn/1d3Tm7168BbRaCL5PEmyS/V5KsekBwnYrxVR4Psu11dPwqYVerGGe/yJP8Q4eRItwcPhCgIkfuuiOLmuGquPh5N2anltnn4fbEQtHpsffu53m76HZTOxSXtlt3WNjlsRg8hZeTljupC39s//vAgZMT48cGfiSSUtu7MtrtBDtRYhQ3WJ50lP432Xod8LjvPu+VzrEXqn8Wpj2V6gzZ39UFl7bFZqJIrm50uwcDhjBhFrkmen6Pg4Tz6A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.34) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=uyI48novntLp/bR+ihIKj+OVXI3SJNvh26AYEBAZcQo=; b=mraL78xGH2C0bUtuYqSvWKgNxNWYIV6+rTA2RqeLqtGDBGdTDo3N+opqYzfFMKsNvTH7l7VVPSiAnvZh8keXPGhocA0YCoIJ9a+Pz9rjE/frgAHfSD6Qh1hvmcVAyzOK71SrVNUbjaUAJ0jzNCFXXPPJ1QNSJX0N5vnv+ErVKx3H2PNyXryIrvqwTY7ZBxyBpUAwRwN1wFsf5MwwAhAds15xLMceLoyyxksci4OmdQcbv0yYn7rqnCCvmHm5vmWEGZ2Z3szAAGIt2HDPtrNDwXXyUPXR6DRtO1SPvJ6d7NAaAaVXmriB7QDgVLwv6EDZHPuOscFdl0w9SlkFAfmJ2w== Received: from BN9PR03CA0601.namprd03.prod.outlook.com (2603:10b6:408:106::6) by BL1PR12MB5224.namprd12.prod.outlook.com (2603:10b6:208:319::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4264.23; Tue, 6 Jul 2021 13:33:56 +0000 Received: from BN8NAM11FT056.eop-nam11.prod.protection.outlook.com (2603:10b6:408:106:cafe::d5) by BN9PR03CA0601.outlook.office365.com (2603:10b6:408:106::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4308.20 via Frontend Transport; Tue, 6 Jul 2021 13:33:56 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.34) smtp.mailfrom=nvidia.com; dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.34 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.34; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.34) by BN8NAM11FT056.mail.protection.outlook.com (10.13.177.26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4287.22 via Frontend Transport; Tue, 6 Jul 2021 13:33:56 +0000 Received: from nvidia.com (172.20.187.6) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 6 Jul 2021 13:33:55 +0000 From: Suanming Mou To: , CC: , , Date: Tue, 6 Jul 2021 16:32:53 +0300 Message-ID: <20210706133257.3353-23-suanmingm@nvidia.com> X-Mailer: git-send-email 2.18.1 In-Reply-To: <20210706133257.3353-1-suanmingm@nvidia.com> References: <20210527093403.1153127-1-suanmingm@nvidia.com> <20210706133257.3353-1-suanmingm@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [172.20.187.6] X-ClientProxiedBy: HQMAIL101.nvidia.com (172.20.187.10) To HQMAIL107.nvidia.com (172.20.187.13) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 778da68a-76be-49eb-58ad-08d94082b496 X-MS-TrafficTypeDiagnostic: BL1PR12MB5224: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:224; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: u7YfBRq9n5YLhrJEMQEbEyJmq47lUoJMNcyIdgdFHldxcd4S5A4LtMqM2sQPTBJdQy2eHRPrE0B2cdeqeKL4fy8+/zd1V/zDnm3KtIXWFnWuSZqkfidHO6FWq40RN+h0Z/SbGVhpGaYoS02k5/jqi5c+eN+f8aEcFKW5BSswT1vz7lYYp7vwGoaa9KMV9GghsI5LLEEbf1xGDnQQ45QsZASY6DaNNOvlsYXz8iGUVOC31zrNi7O3tsppID0gGz1mUZnXr5eLKU4c6QGCfy/xryrbT1deEN6fRVowViEueGSu39m+n1Xta8N7hU8/RVOoC39hyjQ0sANTiP4GA/t13pKe/JGCJNErBIltdJ7vQcDHXP4nUy6L3efdtZNlJTInNTjWtXkBpaVRFKdgmEu9mgWI/Q5Bj4WWcqEWN4miOz3n/s5qV3v32or5he4zqHgKOLZ029cOCox9UBxzDuRfCZKOeT47OE6q5ursAwyY2lg0ejYWXBObWE3e6kAIk0oFKCG3g6UJtRkAfgoLNNOeqgqAOXukrtVugGi+5wInE03rTHn1Zaef3FEBZJQ1wrEbA59HeDZtdtdc+JKX5llX47qmuOvTS7jfG656WD1fsSlg03hrLWhbYB83bxfbeh6kibLOpbYnPyO2SJMdevL6Xr6eH3KlIryBiZwIgZMxz7mNVVR4+2uwy1V0ChY7ahTJ46jY/gW4cMRSzt+3Uly8ujunQpYCNUlefASUITboUvA= X-Forefront-Antispam-Report: CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE; SFS:(4636009)(136003)(376002)(39860400002)(396003)(346002)(46966006)(36840700001)(70586007)(186003)(54906003)(16526019)(83380400001)(336012)(36906005)(36756003)(6286002)(426003)(5660300002)(6636002)(7696005)(110136005)(316002)(8676002)(2616005)(8936002)(1076003)(2906002)(70206006)(26005)(47076005)(82310400003)(55016002)(4326008)(356005)(478600001)(86362001)(36860700001)(82740400003)(7636003)(309714004); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Jul 2021 13:33:56.7565 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 778da68a-76be-49eb-58ad-08d94082b496 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT056.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR12MB5224 Subject: [dpdk-dev] [PATCH v4 22/26] net/mlx5: enable index pool per-core cache X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This commit enables the tag and header modify action index pool per-core cache in non-reclaim memory mode. Signed-off-by: Suanming Mou Acked-by: Matan Azrad --- drivers/net/mlx5/mlx5.c | 4 +++- drivers/net/mlx5/mlx5.h | 1 + drivers/net/mlx5/mlx5_flow_dv.c | 3 ++- 3 files changed, 6 insertions(+), 2 deletions(-) diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index 08e795ea4c..53dee9164a 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -214,7 +214,8 @@ static const struct mlx5_indexed_pool_config mlx5_ipool_cfg[] = { .grow_trunk = 3, .grow_shift = 2, .need_lock = 1, - .release_mem_en = 1, + .release_mem_en = 0, + .per_core_cache = (1 << 16), .malloc = mlx5_malloc, .free = mlx5_free, .type = "mlx5_tag_ipool", @@ -1126,6 +1127,7 @@ mlx5_alloc_shared_dev_ctx(const struct mlx5_dev_spawn_data *spawn, } sh->refcnt = 1; sh->max_port = spawn->max_port; + sh->reclaim_mode = config->reclaim_mode; strncpy(sh->ibdev_name, mlx5_os_get_ctx_device_name(sh->ctx), sizeof(sh->ibdev_name) - 1); strncpy(sh->ibdev_path, mlx5_os_get_ctx_device_path(sh->ctx), diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index d88abef12c..2e2a98345f 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -1093,6 +1093,7 @@ struct mlx5_dev_ctx_shared { uint32_t qp_ts_format:2; /* QP timestamp formats supported. */ uint32_t meter_aso_en:1; /* Flow Meter ASO is supported. */ uint32_t ct_aso_en:1; /* Connection Tracking ASO is supported. */ + uint32_t reclaim_mode:1; /* Reclaim memory. */ uint32_t max_port; /* Maximal IB device port index. */ struct mlx5_bond_info bond; /* Bonding information. */ void *ctx; /* Verbs/DV/DevX context. */ diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_dv.c index 9666c11861..b30e5a82ce 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -5355,7 +5355,8 @@ flow_dv_modify_ipool_get(struct mlx5_dev_ctx_shared *sh, uint8_t index) .grow_trunk = 3, .grow_shift = 2, .need_lock = 1, - .release_mem_en = 1, + .release_mem_en = !!sh->reclaim_mode, + .per_core_cache = sh->reclaim_mode ? 0 : (1 << 16), .malloc = mlx5_malloc, .free = mlx5_free, .type = "mlx5_modify_action_resource",