Cover Detail
Show a cover letter.
GET /api/covers/100996/?format=api
{ "id": 100996, "url": "https://patches.dpdk.org/api/covers/100996/?format=api", "web_url": "https://patches.dpdk.org/project/dpdk/cover/20211011085644.2716490-1-dkozlyuk@nvidia.com/", "project": { "id": 1, "url": "https://patches.dpdk.org/api/projects/1/?format=api", "name": "DPDK", "link_name": "dpdk", "list_id": "dev.dpdk.org", "list_email": "dev@dpdk.org", "web_url": "http://core.dpdk.org", "scm_url": "git://dpdk.org/dpdk", "webscm_url": "http://git.dpdk.org/dpdk", "list_archive_url": "https://inbox.dpdk.org/dev", "list_archive_url_format": "https://inbox.dpdk.org/dev/{}", "commit_url_format": "" }, "msgid": "<20211011085644.2716490-1-dkozlyuk@nvidia.com>", "list_archive_url": "https://inbox.dpdk.org/dev/20211011085644.2716490-1-dkozlyuk@nvidia.com", "date": "2021-10-11T08:56:41", "name": "[v6,0/3] eal: add memory pre-allocation from existing files", "submitter": { "id": 2367, "url": "https://patches.dpdk.org/api/people/2367/?format=api", "name": "Dmitry Kozlyuk", "email": "dkozlyuk@oss.nvidia.com" }, "mbox": "https://patches.dpdk.org/project/dpdk/cover/20211011085644.2716490-1-dkozlyuk@nvidia.com/mbox/", "series": [ { "id": 19509, "url": "https://patches.dpdk.org/api/series/19509/?format=api", "web_url": "https://patches.dpdk.org/project/dpdk/list/?series=19509", "date": "2021-10-11T08:56:41", "name": "eal: add memory pre-allocation from existing files", "version": 6, "mbox": "https://patches.dpdk.org/series/19509/mbox/" } ], "comments": "https://patches.dpdk.org/api/covers/100996/comments/", "headers": { "Return-Path": "<dev-bounces@dpdk.org>", "X-Original-To": "patchwork@inbox.dpdk.org", "Delivered-To": "patchwork@inbox.dpdk.org", "Received": [ "from mails.dpdk.org (mails.dpdk.org [217.70.189.124])\n\tby inbox.dpdk.org (Postfix) with ESMTP id 8DF4DA034F;\n\tMon, 11 Oct 2021 10:57:05 +0200 (CEST)", "from [217.70.189.124] (localhost [127.0.0.1])\n\tby mails.dpdk.org (Postfix) with ESMTP id 26155410EA;\n\tMon, 11 Oct 2021 10:57:05 +0200 (CEST)", "from AZHDRRW-EX02.NVIDIA.COM (azhdrrw-ex02.nvidia.com\n [20.64.145.131]) by mails.dpdk.org (Postfix) with ESMTP id BFD95410E6\n for <dev@dpdk.org>; Mon, 11 Oct 2021 10:57:03 +0200 (CEST)", "from NAM04-DM6-obe.outbound.protection.outlook.com (104.47.73.43) by\n mxs.oss.nvidia.com (10.13.234.37) with Microsoft SMTP Server\n (version=TLS1_2,\n cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.858.15; Mon, 11 Oct\n 2021 01:57:02 -0700", "from BN8PR04CA0028.namprd04.prod.outlook.com (2603:10b6:408:70::41)\n by BL0PR12MB2513.namprd12.prod.outlook.com (2603:10b6:207:4a::17)\n with Microsoft SMTP Server (version=TLS1_2,\n cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.18; Mon, 11 Oct\n 2021 08:57:01 +0000", "from BN8NAM11FT067.eop-nam11.prod.protection.outlook.com\n (2603:10b6:408:70:cafe::88) by BN8PR04CA0028.outlook.office365.com\n (2603:10b6:408:70::41) with Microsoft SMTP Server (version=TLS1_2,\n cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.18 via Frontend\n Transport; Mon, 11 Oct 2021 08:57:01 +0000", "from mail.nvidia.com (216.228.112.34) by\n BN8NAM11FT067.mail.protection.outlook.com (10.13.177.159) with Microsoft SMTP\n Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id\n 15.20.4587.18 via Frontend Transport; Mon, 11 Oct 2021 08:57:01 +0000", "from nvidia.com (172.20.187.6) by HQMAIL107.nvidia.com\n (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Mon, 11 Oct\n 2021 08:56:59 +0000" ], "ARC-Seal": "i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;\n b=T7rxvntY6NXmxtskfjrM4wEaZ1p/ri9exMSi/WwaGPDD+fFblVMyev1rQUCTNGa0am9M8oak2PasV/Y0ptmZ5CV1p0hEPaLidMZoK+G/V2sm8/F6Xesbqc5Evm4DohntB1Y4ElOnT2hqqu4f7lHEh8TRQF2/20cp6hzMWskhGBZ1CBUxBBwO+QLdmrlbNm9bMgR4cJFxaEdm0OZnvMciPkIFlzNNuCjEQEjYFFhh3VmBoUwj+Y+AudS36hmwg/ikkBPI5Zc06JQhbpjocl7cw84QDwziiLntGKR4JjbfzVjQyAjZcB8vbb6eRULgRuwPEQXrsA29HU2+GIer+PZ3lg==", "ARC-Message-Signature": "i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;\n s=arcselector9901;\n h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;\n bh=ooVi04YeiMn1WV0oIQoxLkZ5RX1DOmNJ3sUgAlr4H84=;\n b=A+IHnkKPHOekIhlRpWC1PrKVxhIRZbbXRlERY9bS/+AL/l1ql7jk4nEjeXfxayipdyC2r+fL0L6X8fGn4dmukNefmau7e1RxMIxJt0nsNlfCM0w6Clm4xYWqDZy+/HyU8lsXE4FQVtzH8b6AyQfEJgNo9MPrf5f4rW4FVgq9QdxbCXhOe7fA/T1aWBjbI3XDiC3kKKiI00LyPMcd7RYU90CJSeIZfg9Ip5p+P6c6saHQOj04VsbmtI9zhTHJFhONMQ5d8qHtIal5H7V+055PFEed/yNx7kvnSFGARxkWPhad4H2pPj1qgvJR7JFJXiSQ0CK4jM0tfkdGylBtOfk6Qg==", "ARC-Authentication-Results": "i=1; mx.microsoft.com 1; spf=pass (sender ip is\n 216.228.112.34) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com;\n dmarc=pass (p=quarantine sp=none pct=100) action=none header.from=nvidia.com;\n dkim=none (message not signed); arc=none", "DKIM-Signature": "v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com;\n s=selector2;\n h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;\n bh=ooVi04YeiMn1WV0oIQoxLkZ5RX1DOmNJ3sUgAlr4H84=;\n b=YBoNsJ+FdNdYAzSaivE6BQW0Z6kg//yyyqLQU++uTHQ2p4iiSypH+VHiXTsH7PZjqWYetQeL71doKntmLwdw/LXy5Nl4Q++0pSc98+qR6kkaAcLKgM/JV9SdrjnDMS1kBEClRiF2Mmux3RCGQW1ONNahVADBos5RRpQ5oqV7KK2ujsew3/BcheXJAtFcvI4tTm8jRFDd0tRx5BCq3+gdPa9WmXpw0X7jWEFpWR381s2eqAW3beDUI/L4YQy1VMPnDUU5UUliZjM5lK9R6ECa8OKPxl6ppQl8+KoAq7SMg3Hg793mPcb4UzwipTxD0ZZuO50C3slUz4ISpYelwhQv1g==", "X-MS-Exchange-Authentication-Results": "spf=pass (sender IP is 216.228.112.34)\n smtp.mailfrom=nvidia.com; dpdk.org; dkim=none (message not signed)\n header.d=none;dpdk.org; dmarc=pass action=none header.from=nvidia.com;", "Received-SPF": "Pass (protection.outlook.com: domain of nvidia.com designates\n 216.228.112.34 as permitted sender) receiver=protection.outlook.com;\n client-ip=216.228.112.34; helo=mail.nvidia.com;", "From": "Dmitry Kozlyuk <dkozlyuk@oss.nvidia.com>", "To": "<dev@dpdk.org>", "Date": "Mon, 11 Oct 2021 11:56:41 +0300", "Message-ID": "<20211011085644.2716490-1-dkozlyuk@nvidia.com>", "X-Mailer": "git-send-email 2.25.1", "In-Reply-To": "<20210921081632.858873-1-dkozlyuk@nvidia.com>", "References": "<20210921081632.858873-1-dkozlyuk@nvidia.com>", "MIME-Version": "1.0", "Content-Transfer-Encoding": "8bit", "Content-Type": "text/plain", "X-Originating-IP": "[172.20.187.6]", "X-ClientProxiedBy": "HQMAIL105.nvidia.com (172.20.187.12) To\n HQMAIL107.nvidia.com (172.20.187.13)", "X-EOPAttributedMessage": "0", "X-MS-PublicTrafficType": "Email", "X-MS-Office365-Filtering-Correlation-Id": "02253e13-2b4f-4b1a-6057-08d98c9516e5", "X-MS-TrafficTypeDiagnostic": "BL0PR12MB2513:", "X-Microsoft-Antispam-PRVS": "\n <BL0PR12MB25139CFC0DA1C5D7CEBD3C4EB9B59@BL0PR12MB2513.namprd12.prod.outlook.com>", "X-MS-Oob-TLC-OOBClassifiers": "OLM:5797;", "X-MS-Exchange-SenderADCheck": "1", "X-MS-Exchange-AntiSpam-Relay": "0", "X-Microsoft-Antispam": "BCL:0;", "X-Microsoft-Antispam-Message-Info": "\n xLs8uog8zqjHD8Sl0WMCs01mhyjtFMx0o/Wrud6RaXLeZlctSR/aRj3h5ijCBkydrhqkLQ6tXDj4u1Bs41EzjKWzLGbpP+wqyYnJWHZuAwILBve+pC83vDtPV/UwTD6QF/ULGe69qbW/Q5goFuhPuX3N2Q3v8F4JNUvEWkifP8qj3Hauy5rdzkqOCMXAWgxkAliLtaZ3MIqHfB9l66g0cCjBIehmbi8yJXRhC6gzqf8oo16C/BGJLRlRMoSNrEVV8ZMXOGw7+f0RtYmyGK0kmC0ypIVqsIo8NOuOQjek3R3ZucqjnR9OQB08k/6GDj8ymdhMbW0oaoXGBuU8nEDBqYmpeSr/t8k5WE8+iofUzIioSGpE/6hrGn5cQvycXtJ8dxE+vwHIyuK8E99jk+T5PNTjffWcND15D7QzNF29NG5jIJAGDOOZpBrbH0VIpgBg2ekUvKGICPPiotLqnfVSSHkV2b2DmtxcYG9Fw4urkAceq341JD63T6HYDdM9yVuQyZC4jRMgT1LjQFPyLV78t0W/EoF8w/PQj9Rb3gqDzS4WP927WwsdrvkA4zGLHIGlTyUJ9/vkrxZ4tSkxyHHScniaxGU81h++UITsCBiL6Zhvr3dYtg5KgLqR3GJaRsQbKrdKB4Erbm6oSnBWQPsY3uZQU9UvB7B6fa21TA4QQ9mEvOYIwGtzydkQ7EO7stVSU/yCNplaUDlaOx/u9m07qw==", "X-Forefront-Antispam-Report": "CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1;\n SRV:;\n IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE;\n SFS:(4636009)(46966006)(36840700001)(8676002)(7696005)(6666004)(36860700001)(83380400001)(7636003)(356005)(36756003)(16526019)(336012)(26005)(508600001)(6286002)(55016002)(186003)(8936002)(70206006)(70586007)(426003)(2616005)(86362001)(5660300002)(316002)(6916009)(1076003)(82310400003)(2906002)(47076005);\n DIR:OUT; SFP:1101;", "X-MS-Exchange-CrossTenant-OriginalArrivalTime": "11 Oct 2021 08:57:01.0133 (UTC)", "X-MS-Exchange-CrossTenant-Network-Message-Id": "\n 02253e13-2b4f-4b1a-6057-08d98c9516e5", "X-MS-Exchange-CrossTenant-Id": "43083d15-7273-40c1-b7db-39efd9ccc17a", "X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp": "\n TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34];\n Helo=[mail.nvidia.com]", "X-MS-Exchange-CrossTenant-AuthSource": "\n BN8NAM11FT067.eop-nam11.prod.protection.outlook.com", "X-MS-Exchange-CrossTenant-AuthAs": "Anonymous", "X-MS-Exchange-CrossTenant-FromEntityHeader": "HybridOnPrem", "X-MS-Exchange-Transport-CrossTenantHeadersStamped": "BL0PR12MB2513", "Subject": "[dpdk-dev] [PATCH v6 0/3] eal: add memory pre-allocation from\n existing files", "X-BeenThere": "dev@dpdk.org", "X-Mailman-Version": "2.1.29", "Precedence": "list", "List-Id": "DPDK patches and discussions <dev.dpdk.org>", "List-Unsubscribe": "<https://mails.dpdk.org/options/dev>,\n <mailto:dev-request@dpdk.org?subject=unsubscribe>", "List-Archive": "<http://mails.dpdk.org/archives/dev/>", "List-Post": "<mailto:dev@dpdk.org>", "List-Help": "<mailto:dev-request@dpdk.org?subject=help>", "List-Subscribe": "<https://mails.dpdk.org/listinfo/dev>,\n <mailto:dev-request@dpdk.org?subject=subscribe>", "Errors-To": "dev-bounces@dpdk.org", "Sender": "\"dev\" <dev-bounces@dpdk.org>" }, "content": "Hugepage allocation from the system takes time, resulting in slow\nstartup or sporadic delays later. Most of the time spent in kernel\nis zero-filling memory for security reasons, which may be irrelevant\nin a controlled environment. The bottleneck is memory access speed,\nso for speeduup the amount of memory cleared must be reduced.\nWe propose a new EAL option --mem-file FILE1,FILE2,... to quickly\nallocate dirty pages from existing files and clean it as necessary.\nA new malloc_perf_autotest is provided to estimate the impact.\nMore details are explained in relevant patches.\n\nv6: fix copyright line (Thomas), add SPDX header for the new test file\n (BTW, why didn't the CI complain in previous versions?)\nv5: rebase\nv4: getmntent() -> getmntent_r(), better error detection (John Levon)\nv3: fix hugepage mount point detection\nv2: fix CI failures\n\nDmitry Kozlyuk (2):\n eal/linux: make hugetlbfs analysis reusable\n app/test: add allocator performance autotest\n\nViacheslav Ovsiienko (1):\n eal: add memory pre-allocation from existing files\n\n app/test/meson.build | 2 +\n app/test/test_malloc_perf.c | 161 +++++++++\n doc/guides/linux_gsg/linux_eal_parameters.rst | 17 +\n lib/eal/common/eal_common_dynmem.c | 6 +\n lib/eal/common/eal_common_options.c | 23 ++\n lib/eal/common/eal_internal_cfg.h | 4 +\n lib/eal/common/eal_memalloc.h | 8 +-\n lib/eal/common/eal_options.h | 2 +\n lib/eal/common/malloc_elem.c | 5 +\n lib/eal/common/malloc_heap.h | 8 +\n lib/eal/common/rte_malloc.c | 16 +-\n lib/eal/include/rte_memory.h | 4 +-\n lib/eal/linux/eal.c | 28 ++\n lib/eal/linux/eal_hugepage_info.c | 158 ++++++---\n lib/eal/linux/eal_hugepage_info.h | 39 +++\n lib/eal/linux/eal_memalloc.c | 328 +++++++++++++++++-\n 16 files changed, 739 insertions(+), 70 deletions(-)\n create mode 100644 app/test/test_malloc_perf.c\n create mode 100644 lib/eal/linux/eal_hugepage_info.h" }