From patchwork Wed Jun 30 12:46:03 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Suanming Mou X-Patchwork-Id: 95070 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6517FA0A0F; Wed, 30 Jun 2021 14:48:33 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id BE0B3412C5; Wed, 30 Jun 2021 14:47:08 +0200 (CEST) Received: from NAM02-BN1-obe.outbound.protection.outlook.com (mail-bn1nam07on2074.outbound.protection.outlook.com [40.107.212.74]) by mails.dpdk.org (Postfix) with ESMTP id 73078412B0 for ; Wed, 30 Jun 2021 14:47:03 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AO12jgRkIPn2hYp4FY+5t1ssHRbpEpZ9+AbADLX4rDZzfT3/CaF8CPfK9q77ixchMLxxcmRVJKi18w14VBMe0edG8Ggu7RAOWQMPuxhkhAhsICWWiJiXXyrNs0KLgEkjx/ZZDbv+GBginO1iIr1TDUIOI2PHfB7/aqJ/1rGSPKA/4ph+x878KfYyPOntiAPsxwmUfXh0umby6TLrvc1aXa6C5A0Mbtvv4mRX/fCCkPocQ8Jptf9jUvT7718fFgmhgxj3zC+8kcIDilkQ3FH4u6oQJ3T/7cCVLb2dFc9W9G/OnV7PKUZ9w8x3ExvEB4w3Uz6uwK5FYKJMyrmjiq4q4w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nGevDOvjftZR6sYvk9cPPJcEjMuzQxDHNIoF9KJlbf8=; b=i49f6SSGVMcYw43WlDsoy9AlT156OCPtua9PZrBARACqvMswIGeZvOuRXXGEf7Cj4Qh1Zaz6O5Obv/RsQiOO1aGK923SCkg8TVjPDmLBE8tX78pXizvfeyUzYBsiE+g7T/AUuEOcm5xWg9kkbBe6xJviPm8EY5fsSRDsclI60+NXFCNF+6cesEAw8lcidHF8KOrhFYSycR/v3aaZhHnXQr7DzVeIEHbSUt/rjwL5df0s39aRgRObGl/R06z9KmGEj8jtFxHXFbXTLS9uBGYTKfG8Wwfdjt6Etf1gPVklzE62NfouBfoSrXnkyqharGnpMQ1g+nGD44W7g1pmgkljdw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.34) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nGevDOvjftZR6sYvk9cPPJcEjMuzQxDHNIoF9KJlbf8=; b=OxNIdn0CzqLIvU4Fq31Yc20ZXvo/pPcsmDDbZ10PQqha5ETINgW1fVujkkmi4UXw6p2GoRqDhje3M8bHeKezxXQjTaftfngHy07rb44J0ZJN3PkW+p7nTWuHsm+JXayg0/rsUuRxVbZTh2nNa4tDmCqEVMmDKFEGe6TEJmsVY4CXzPVtRzJliSPmeZr/zde73g+CM155Ur71X7J1CvUvzmJdQduKdOpRgpagF0RQyokc4Fw+OVaw4qST2sj0ZjCinSl9kIGif7iOyl/v3THcwFSYKtmK5nWbo9yYMfoogp47pfu7wiJwcfvDcU/aljz6hV2n9CQnOEmMGYYsvBP1cA== Received: from BN6PR1701CA0024.namprd17.prod.outlook.com (2603:10b6:405:15::34) by MN2PR12MB4454.namprd12.prod.outlook.com (2603:10b6:208:26c::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.21; Wed, 30 Jun 2021 12:47:02 +0000 Received: from BN8NAM11FT045.eop-nam11.prod.protection.outlook.com (2603:10b6:405:15:cafe::ef) by BN6PR1701CA0024.outlook.office365.com (2603:10b6:405:15::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4264.18 via Frontend Transport; Wed, 30 Jun 2021 12:47:02 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.34) smtp.mailfrom=nvidia.com; dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.34 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.34; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.34) by BN8NAM11FT045.mail.protection.outlook.com (10.13.177.47) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4287.22 via Frontend Transport; Wed, 30 Jun 2021 12:47:01 +0000 Received: from nvidia.com (172.20.187.6) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 30 Jun 2021 12:46:54 +0000 From: Suanming Mou To: , CC: , , Date: Wed, 30 Jun 2021 15:46:03 +0300 Message-ID: <20210630124609.8711-17-suanmingm@nvidia.com> X-Mailer: git-send-email 2.18.1 In-Reply-To: <20210630124609.8711-1-suanmingm@nvidia.com> References: <20210527093403.1153127-1-suanmingm@nvidia.com> <20210630124609.8711-1-suanmingm@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [172.20.187.6] X-ClientProxiedBy: HQMAIL101.nvidia.com (172.20.187.10) To HQMAIL107.nvidia.com (172.20.187.13) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 156c5e07-2af4-47f1-d99b-08d93bc52848 X-MS-TrafficTypeDiagnostic: MN2PR12MB4454: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:224; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: pP/+HZ4yU4mFLg1t9O3Un0CI1cYHMtcJIV0Lx2LfM4DwBaBuYpEjAfLJPvdVzpsnYvO09Ohz71Io02ABwG/zhAMP9u/hz642rPWTaWBZaU/H6B5xXQhIUDJsgs6j2cEUBEb5FfdM9smCiQTjdL3VOuqs0S2JCGFg0i+mx3rlHjDLRTvWbyeJDcJj6dX2IUba1F61lRelbKTDBn68nIUXIwjMt84ZL1gQP0dWCNVLXnrm9NMMzbtPv69ulbGdXgxFI3jecMVpRKAi3zIoLxvW8QvuZxRp7qtnxgxoVFGiEIrFV4N2TvFAiDV5OLriYKUdp5ARUaZQiu/ra4JE00NNnSonkNbEgBGgp56Me0Uf0YYViKC7rSsTPwsRILqWSWz9jHOkfIj/VwWnaBNRa+1JdiSHwSa7kDaaswhGOEs92lx8xM/28R4q+DjVDs0mgH7t5xjKBGrVo2QrAkjiuYJhHUqDAuzi8Ba6mLGCE7Q6tkrtDEjp74mqzS1hABJbn9xOHBPKQVvjoLxHVGHXXJo83VLeidx5mll3OmSPft3+UaeD4fX+oqtrUe1umWnoRDXHcjK1trz4MrsQbgMLjS+2HU3NxPFXjVUhZYemVXGB0DEIuoqZoWEuIYieguW+U5ykcWC1Qc67JEv4HcbAox1AMlLJfkX+wFlDwE16AM25HaxLvZ5PtGBCqnAW2h0kZFmJGLIviA7SHilWrkt7lkqa1xiY3x/+AZlyJDwO8u1vXkM= X-Forefront-Antispam-Report: CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE; SFS:(4636009)(346002)(39860400002)(396003)(376002)(136003)(46966006)(36840700001)(7636003)(36860700001)(426003)(336012)(47076005)(316002)(110136005)(6286002)(8676002)(356005)(54906003)(8936002)(82310400003)(4326008)(82740400003)(83380400001)(2616005)(1076003)(70586007)(36756003)(26005)(478600001)(86362001)(6636002)(5660300002)(2906002)(55016002)(7696005)(6666004)(70206006)(16526019)(186003)(309714004); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Jun 2021 12:47:01.8355 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 156c5e07-2af4-47f1-d99b-08d93bc52848 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT045.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4454 Subject: [dpdk-dev] [PATCH v2 16/22] net/mlx5: enable index pool per-core cache X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This commit enables the tag and header modify action index pool per-core cache in non-reclaim memory mode. Signed-off-by: Suanming Mou Acked-by: Matan Azrad --- drivers/net/mlx5/mlx5.c | 4 +++- drivers/net/mlx5/mlx5.h | 1 + drivers/net/mlx5/mlx5_flow_dv.c | 3 ++- 3 files changed, 6 insertions(+), 2 deletions(-) diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index 8fb7f4442d..bf1463c289 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -214,7 +214,8 @@ static const struct mlx5_indexed_pool_config mlx5_ipool_cfg[] = { .grow_trunk = 3, .grow_shift = 2, .need_lock = 1, - .release_mem_en = 1, + .release_mem_en = 0, + .per_core_cache = (1 << 16), .malloc = mlx5_malloc, .free = mlx5_free, .type = "mlx5_tag_ipool", @@ -1128,6 +1129,7 @@ mlx5_alloc_shared_dev_ctx(const struct mlx5_dev_spawn_data *spawn, } sh->refcnt = 1; sh->max_port = spawn->max_port; + sh->reclaim_mode = config->reclaim_mode; strncpy(sh->ibdev_name, mlx5_os_get_ctx_device_name(sh->ctx), sizeof(sh->ibdev_name) - 1); strncpy(sh->ibdev_path, mlx5_os_get_ctx_device_path(sh->ctx), diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index 5774f63244..516f3ffae5 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -1093,6 +1093,7 @@ struct mlx5_dev_ctx_shared { uint32_t qp_ts_format:2; /* QP timestamp formats supported. */ uint32_t meter_aso_en:1; /* Flow Meter ASO is supported. */ uint32_t ct_aso_en:1; /* Connection Tracking ASO is supported. */ + uint32_t reclaim_mode:1; /* Reclaim memory. */ uint32_t max_port; /* Maximal IB device port index. */ struct mlx5_bond_info bond; /* Bonding information. */ void *ctx; /* Verbs/DV/DevX context. */ diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_dv.c index 08704d892a..f79c60e489 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -5321,7 +5321,8 @@ flow_dv_modify_ipool_get(struct mlx5_dev_ctx_shared *sh, uint8_t index) .grow_trunk = 3, .grow_shift = 2, .need_lock = 1, - .release_mem_en = 1, + .release_mem_en = !!sh->reclaim_mode, + .per_core_cache = sh->reclaim_mode ? 0 : (1 << 16), .malloc = mlx5_malloc, .free = mlx5_free, .type = "mlx5_modify_action_resource",