From patchwork Fri Jul 13 12:47:56 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Burakov, Anatoly" X-Patchwork-Id: 43042 Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id B97F82C18; Fri, 13 Jul 2018 14:48:11 +0200 (CEST) Received: from mga18.intel.com (mga18.intel.com [134.134.136.126]) by dpdk.org (Postfix) with ESMTP id 768CD2C16 for ; Fri, 13 Jul 2018 14:48:07 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga007.jf.intel.com ([10.7.209.58]) by orsmga106.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 13 Jul 2018 05:48:06 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.51,347,1526367600"; d="scan'208";a="56261059" Received: from irvmail001.ir.intel.com ([163.33.26.43]) by orsmga007.jf.intel.com with ESMTP; 13 Jul 2018 05:48:04 -0700 Received: from sivswdev01.ir.intel.com (sivswdev01.ir.intel.com [10.237.217.45]) by irvmail001.ir.intel.com (8.14.3/8.13.6/MailSET/Hub) with ESMTP id w6DCm44a016827; Fri, 13 Jul 2018 13:48:04 +0100 Received: from sivswdev01.ir.intel.com (localhost [127.0.0.1]) by sivswdev01.ir.intel.com with ESMTP id w6DCm4dt006229; Fri, 13 Jul 2018 13:48:04 +0100 Received: (from aburakov@localhost) by sivswdev01.ir.intel.com with LOCAL id w6DCm4PX006225; Fri, 13 Jul 2018 13:48:04 +0100 From: Anatoly Burakov To: dev@dpdk.org Cc: ray.kinsella@intel.com, kuralamudhan.ramakrishnan@intel.com, louise.m.daly@intel.com, bruce.richardson@intel.com, ferruh.yigit@intel.com, konstantin.ananyev@intel.com, thomas@monjalon.net Date: Fri, 13 Jul 2018 13:47:56 +0100 Message-Id: X-Mailer: git-send-email 1.7.0.7 In-Reply-To: References: Subject: [dpdk-dev] [PATCH v3 0/8] Support running DPDK without hugetlbfs mountpoint X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This patchset adds a new command-line option "--in-memory", which takes old debug options "--huge-unlink" and "--no-shconf", and enhances them with additional functionality. This will allow DPDK to reserve hugepages anonymously instead of using hugetlbfs mountpoints. Coupled with the fact that this option also effectively enables both "--no-shconf" and "--huge-unlink" modes, DPDK will be able to run entirely in memory and not create any shared files while running - neither hugepages nor any runtime data. This will, of course, disable secondary processes, but for use-cases this is targeted at (containers etc.), this is not a problem. Older revisions had kernel support at 4.14+ and also required a fairly new glibc, but now due to not using memfd and using mmap() instead, minimum supported kernel version has dropped to 3.8. v2->v3 changes: - Fix compile issue in patch 9 (now 8) - Drop deprecation notice (will be sent separately) v1->v2 changes: - Rebase on latest master - Fix patch 5 to include check from patch 6 as commit message states RFC->v1 changes: - Dropped memfd, using anonymous mmap() instead - Do not deprecate old command-line parameters, instead use them as they are, and add a deprecation notice to remove them in the next release. Anatoly Burakov (8): fbarray: support no-shconf mode ipc: add support for no-shconf mode eal: add support for no-shconf for hugepage info eal: add support for no-shconf in hugepage data file eal: do not create runtime dir in no-shconf mode mem: add support for hugepage-unlink mode eal: add --in-memory option mem: support in-memory mode lib/librte_eal/bsdapp/eal/eal.c | 3 +- lib/librte_eal/bsdapp/eal/eal_hugepage_info.c | 4 + lib/librte_eal/common/eal_common_fbarray.c | 71 +++++---- lib/librte_eal/common/eal_common_options.c | 20 ++- lib/librte_eal/common/eal_common_proc.c | 25 +++ lib/librte_eal/common/eal_internal_cfg.h | 4 + lib/librte_eal/common/eal_options.h | 2 + lib/librte_eal/linuxapp/eal/eal.c | 3 +- .../linuxapp/eal/eal_hugepage_info.c | 95 +++++++---- lib/librte_eal/linuxapp/eal/eal_memalloc.c | 150 ++++++++++++------ lib/librte_eal/linuxapp/eal/eal_memory.c | 16 +- 11 files changed, 276 insertions(+), 117 deletions(-)