From patchwork Mon May 15 09:41:20 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Li, Miao" X-Patchwork-Id: 126850 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 88AFF42B11; Mon, 15 May 2023 11:41:37 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0E07D40687; Mon, 15 May 2023 11:41:37 +0200 (CEST) Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by mails.dpdk.org (Postfix) with ESMTP id 763FB40395 for ; Mon, 15 May 2023 11:41:35 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1684143696; x=1715679696; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=7AZG4k9sgpFiz6RrMTkNxBrWboPd2uK9kmU/WhS3ypo=; b=j7M5/0UMUcUm7kMtmiK7LDAT1Y+0TOwWAAf7rch2tL/0XkD6rOeEFu3f kbJqx4DLK8hMotyWToNeiX6bqBMSPUjQ3cRnzST5SvANUKknmKDKL30sy JIwHVnT2kV3imzB9y+Omp58qZdBUsPTLDe57fkamvkhije13unoFlyYTv 7FNwxt8LUYFveDLY5sDsWP6j35wfoVVJlpGjdapSUcaGrfjdD5Wxw/CCe HXSclBaLWOuYrWU607q5CQDW6S5kwQvU+BRxK/gEeZGHdAqe79m6XqGNk f1NopppU7zcDujrOc2dicAnn/Cwk5RwXWTcFyFGLklF4/Y9MA2gWMp8pC g==; X-IronPort-AV: E=McAfee;i="6600,9927,10710"; a="331527292" X-IronPort-AV: E=Sophos;i="5.99,276,1677571200"; d="scan'208";a="331527292" Received: from fmsmga004.fm.intel.com ([10.253.24.48]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 15 May 2023 02:41:35 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10710"; a="770553383" X-IronPort-AV: E=Sophos;i="5.99,276,1677571200"; d="scan'208";a="770553383" Received: from dpdk-limiao-icelake.sh.intel.com ([10.67.111.26]) by fmsmga004.fm.intel.com with ESMTP; 15 May 2023 02:41:32 -0700 From: Miao Li To: dev@dpdk.org Cc: skori@marvell.com, thomas@monjalon.net, david.marchand@redhat.com, ferruh.yigit@amd.com, chenbo.xia@intel.com, yahui.cao@intel.com Subject: [PATCH v2 0/4] Support VFIO sparse mmap in PCI bus Date: Mon, 15 May 2023 09:41:20 +0000 Message-Id: <20230515094124.722431-1-miao.li@intel.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230515064700.624054-5-miao.li@intel.com> References: <20230515064700.624054-5-miao.li@intel.com> MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This series introduces a VFIO standard capability, called sparse mmap to PCI bus. In linux kernel, it's defined as VFIO_REGION_INFO_CAP_SPARSE_MMAP. Sparse mmap means instead of mmap whole BAR region into DPDK process, only mmap part of the BAR region after getting sparse mmap information from kernel. For the rest of BAR region that is not mmap-ed, DPDK process can use pread/pwrite system calls to access. Sparse mmap is useful when kernel does not want userspace to mmap whole BAR region, or kernel wants to control over access to specific BAR region. Vendors can choose to enable this feature or not for their devices in their specific kernel modules. In this patchset: Patch 1-3 is mainly for introducing BAR access APIs so that driver could use them to access specific BAR using pread/pwrite system calls when part of the BAR is not mmap-able. Patch 4 adds the VFIO sparse mmap support finally. v2: 1. add PCI device internal structure in bus/pci/windows/pci.c 2. fix parameter type error Chenbo Xia (3): bus/pci: introduce an internal representation of PCI device bus/pci: avoid depending on private value in kernel source bus/pci: introduce helper for MMIO read and write Miao Li (1): bus/pci: add VFIO sparse mmap support drivers/bus/pci/bsd/pci.c | 35 +++- drivers/bus/pci/linux/pci.c | 78 +++++-- drivers/bus/pci/linux/pci_init.h | 14 +- drivers/bus/pci/linux/pci_uio.c | 22 ++ drivers/bus/pci/linux/pci_vfio.c | 335 +++++++++++++++++++++++++------ drivers/bus/pci/pci_common.c | 12 +- drivers/bus/pci/private.h | 25 ++- drivers/bus/pci/rte_bus_pci.h | 48 +++++ drivers/bus/pci/version.map | 3 + drivers/bus/pci/windows/pci.c | 14 +- lib/eal/include/rte_vfio.h | 1 - 11 files changed, 491 insertions(+), 96 deletions(-)