From patchwork Fri Jul 13 10:27:06 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Burakov, Anatoly" X-Patchwork-Id: 43013 Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 4C2C54F93; Fri, 13 Jul 2018 12:27:21 +0200 (CEST) Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) by dpdk.org (Postfix) with ESMTP id E1EF04CE4 for ; Fri, 13 Jul 2018 12:27:18 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga001.jf.intel.com ([10.7.209.18]) by orsmga103.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 13 Jul 2018 03:27:18 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.51,347,1526367600"; d="scan'208";a="72442430" Received: from irvmail001.ir.intel.com ([163.33.26.43]) by orsmga001.jf.intel.com with ESMTP; 13 Jul 2018 03:27:16 -0700 Received: from sivswdev01.ir.intel.com (sivswdev01.ir.intel.com [10.237.217.45]) by irvmail001.ir.intel.com (8.14.3/8.13.6/MailSET/Hub) with ESMTP id w6DARFtY007514; Fri, 13 Jul 2018 11:27:15 +0100 Received: from sivswdev01.ir.intel.com (localhost [127.0.0.1]) by sivswdev01.ir.intel.com with ESMTP id w6DARFLs027987; Fri, 13 Jul 2018 11:27:15 +0100 Received: (from aburakov@localhost) by sivswdev01.ir.intel.com with LOCAL id w6DARFRt027981; Fri, 13 Jul 2018 11:27:15 +0100 From: Anatoly Burakov To: dev@dpdk.org Cc: ray.kinsella@intel.com, kuralamudhan.ramakrishnan@intel.com, louise.m.daly@intel.com, bruce.richardson@intel.com, ferruh.yigit@intel.com, konstantin.ananyev@intel.com, thomas@monjalon.net Date: Fri, 13 Jul 2018 11:27:06 +0100 Message-Id: X-Mailer: git-send-email 1.7.0.7 In-Reply-To: References: Subject: [dpdk-dev] [PATCH v2 0/9] Support running DPDK without hugetlbfs mountpoint X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This patchset adds a new command-line option "--in-memory", which takes old debug options "--huge-unlink" and "--no-shconf", and enhances them with additional functionality. This will allow DPDK to reserve hugepages anonymously instead of using hugetlbfs mountpoints. Coupled with the fact that this option also effectively enables both "--no-shconf" and "--huge-unlink" modes, DPDK will be able to run entirely in memory and not create any shared files while running - neither hugepages nor any runtime data. This will, of course, disable secondary processes, but for use-cases this is targeted at (containers etc.), this is not a problem. Older revisions had kernel support at 4.14+ and also required a fairly new glibc, but now due to not using memfd and using mmap() instead, minimum supported kernel version has dropped to 3.8. v1->v2 changes: - Rebase on latest master - Fix patch 5 to include check from patch 6 as commit message states RFC->v1 changes: - Dropped memfd, using anonymous mmap() instead - Do not deprecate old command-line parameters, instead use them as they are, and add a deprecation notice to remove them in the next release. Anatoly Burakov (9): fbarray: support no-shconf mode ipc: add support for no-shconf mode eal: add support for no-shconf for hugepage info eal: add support for no-shconf in hugepage data file eal: do not create runtime dir in no-shconf mode mem: add support for hugepage-unlink mode eal: add --in-memory option doc: add deprecation notice for EAL command line options mem: support in-memory mode doc/guides/rel_notes/deprecation.rst | 5 + lib/librte_eal/bsdapp/eal/eal.c | 3 +- lib/librte_eal/bsdapp/eal/eal_hugepage_info.c | 4 + lib/librte_eal/common/eal_common_fbarray.c | 71 +++++---- lib/librte_eal/common/eal_common_options.c | 20 ++- lib/librte_eal/common/eal_common_proc.c | 25 ++++ lib/librte_eal/common/eal_internal_cfg.h | 4 + lib/librte_eal/common/eal_options.h | 2 + lib/librte_eal/linuxapp/eal/eal.c | 3 +- .../linuxapp/eal/eal_hugepage_info.c | 95 ++++++++---- lib/librte_eal/linuxapp/eal/eal_memalloc.c | 140 ++++++++++++------ lib/librte_eal/linuxapp/eal/eal_memory.c | 16 +- 12 files changed, 271 insertions(+), 117 deletions(-)