From patchwork Thu May 25 16:31:12 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Li, Miao" X-Patchwork-Id: 127374 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 1ECD442B98; Thu, 25 May 2023 10:00:54 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 059E940DDB; Thu, 25 May 2023 10:00:54 +0200 (CEST) Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by mails.dpdk.org (Postfix) with ESMTP id 70CFC40A82 for ; Thu, 25 May 2023 10:00:52 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1685001652; x=1716537652; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=uGRDEFieVhObrcO58l9tOTSSgTdoeazXeQK5Z3r89uQ=; b=eMRryUNuHiCej4s3DNhheOe5Y7b7q4al81GI3Tz1PmamosJkmR7XQEHF 9xRSkb8K0VgkRa+woEacSQJ3KsfEBPyx1XCUoFE5Kt7NQIq61ZxXV60ss ZXcuCRQkK3aMgWOhWbbBydHlaMGCg6OqP4JWNhehihvL8XyFPH3HMJ0ly SBBUfQyfPN8K0r/7ku3va/OBRnZRMsYWH3hKQXJElU6s2i/+QAYqBxcgE j3A4DcLes8Ip5VBndxhAVf+aBgZTu8bWryBC3aLD+oIPBDhWDb/T20oIg iDZh/CQad2SsGPKeWUDQgygNAwA3AmLSpKwpyYfrM2X/jwf1hVmT11SP0 A==; X-IronPort-AV: E=McAfee;i="6600,9927,10720"; a="440178112" X-IronPort-AV: E=Sophos;i="6.00,190,1681196400"; d="scan'208";a="440178112" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga105.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 25 May 2023 01:00:51 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10720"; a="849096252" X-IronPort-AV: E=Sophos;i="6.00,190,1681196400"; d="scan'208";a="849096252" Received: from dpdk-limiao-icelake.sh.intel.com ([10.67.111.26]) by fmsmga001.fm.intel.com with ESMTP; 25 May 2023 01:00:49 -0700 From: Miao Li To: dev@dpdk.org Cc: skori@marvell.com, thomas@monjalon.net, david.marchand@redhat.com, ferruh.yigit@amd.com, chenbo.xia@intel.com, yahui.cao@intel.com Subject: [PATCH v3 0/4] Support VFIO sparse mmap in PCI bus Date: Thu, 25 May 2023 16:31:12 +0000 Message-Id: <20230525163116.682000-1-miao.li@intel.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230515094124.722431-1-miao.li@intel.com> References: <20230515094124.722431-1-miao.li@intel.com> MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This series introduces a VFIO standard capability, called sparse mmap to PCI bus. In linux kernel, it's defined as VFIO_REGION_INFO_CAP_SPARSE_MMAP. Sparse mmap means instead of mmap whole BAR region into DPDK process, only mmap part of the BAR region after getting sparse mmap information from kernel. For the rest of BAR region that is not mmap-ed, DPDK process can use pread/pwrite system calls to access. Sparse mmap is useful when kernel does not want userspace to mmap whole BAR region, or kernel wants to control over access to specific BAR region. Vendors can choose to enable this feature or not for their devices in their specific kernel modules. In this patchset: Patch 1-3 is mainly for introducing BAR access APIs so that driver could use them to access specific BAR using pread/pwrite system calls when part of the BAR is not mmap-able. Patch 4 adds the VFIO sparse mmap support finally. v3: fix variable 'pdev' and 'info' uninitialized error v2: 1. add PCI device internal structure in bus/pci/windows/pci.c 2. fix parameter type error Chenbo Xia (3): bus/pci: introduce an internal representation of PCI device bus/pci: avoid depending on private value in kernel source bus/pci: introduce helper for MMIO read and write Miao Li (1): bus/pci: add VFIO sparse mmap support drivers/bus/pci/bsd/pci.c | 35 +++- drivers/bus/pci/linux/pci.c | 78 +++++-- drivers/bus/pci/linux/pci_init.h | 14 +- drivers/bus/pci/linux/pci_uio.c | 22 ++ drivers/bus/pci/linux/pci_vfio.c | 337 +++++++++++++++++++++++++------ drivers/bus/pci/pci_common.c | 12 +- drivers/bus/pci/private.h | 25 ++- drivers/bus/pci/rte_bus_pci.h | 48 +++++ drivers/bus/pci/version.map | 3 + drivers/bus/pci/windows/pci.c | 14 +- lib/eal/include/rte_vfio.h | 1 - 11 files changed, 492 insertions(+), 97 deletions(-)