Cover Detail
Show a cover letter.
GET /api/covers/194/?format=api
{ "id": 194, "url": "http://patches.dpdk.org/api/covers/194/?format=api", "web_url": "http://patches.dpdk.org/project/dpdk/cover/20230927150854.3670391-1-paul.szczepanek@arm.com/", "project": { "id": 1, "url": "http://patches.dpdk.org/api/projects/1/?format=api", "name": "DPDK", "link_name": "dpdk", "list_id": "dev.dpdk.org", "list_email": "dev@dpdk.org", "web_url": "http://core.dpdk.org", "scm_url": "git://dpdk.org/dpdk", "webscm_url": "http://git.dpdk.org/dpdk", "list_archive_url": "https://inbox.dpdk.org/dev", "list_archive_url_format": "https://inbox.dpdk.org/dev/{}", "commit_url_format": "" }, "msgid": "<20230927150854.3670391-1-paul.szczepanek@arm.com>", "list_archive_url": "https://inbox.dpdk.org/dev/20230927150854.3670391-1-paul.szczepanek@arm.com", "date": "2023-09-27T15:08:52", "name": "[RFC,0/2] add pointer compression API", "submitter": { "id": 3199, "url": "http://patches.dpdk.org/api/people/3199/?format=api", "name": "Paul Szczepanek", "email": "paul.szczepanek@arm.com" }, "mbox": "http://patches.dpdk.org/project/dpdk/cover/20230927150854.3670391-1-paul.szczepanek@arm.com/mbox/", "series": [ { "id": 29659, "url": "http://patches.dpdk.org/api/series/29659/?format=api", "web_url": "http://patches.dpdk.org/project/dpdk/list/?series=29659", "date": "2023-09-27T15:08:52", "name": "add pointer compression API", "version": 1, "mbox": "http://patches.dpdk.org/series/29659/mbox/" } ], "comments": "http://patches.dpdk.org/api/covers/194/comments/", "headers": { "Return-Path": "<dev-bounces@dpdk.org>", "X-Original-To": "patchwork@inbox.dpdk.org", "Delivered-To": "patchwork@inbox.dpdk.org", "Received": [ "from mails.dpdk.org (mails.dpdk.org [217.70.189.124])\n\tby inbox.dpdk.org (Postfix) with ESMTP id 322E142653;\n\tWed, 27 Sep 2023 17:09:49 +0200 (CEST)", "from mails.dpdk.org (localhost [127.0.0.1])\n\tby mails.dpdk.org (Postfix) with ESMTP id 081384029B;\n\tWed, 27 Sep 2023 17:09:49 +0200 (CEST)", "from foss.arm.com (foss.arm.com [217.140.110.172])\n by mails.dpdk.org (Postfix) with ESMTP id 8CC3E402D0\n for <dev@dpdk.org>; Wed, 27 Sep 2023 17:09:47 +0200 (CEST)", "from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14])\n by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 0FC0B1FB;\n Wed, 27 Sep 2023 08:10:25 -0700 (PDT)", "from ampere-altra-2-1.usa.Arm.com (ampere-altra-2-1.usa.arm.com\n [10.118.91.158])\n by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id DCD363F59C;\n Wed, 27 Sep 2023 08:09:46 -0700 (PDT)" ], "From": "Paul Szczepanek <paul.szczepanek@arm.com>", "To": "dev@dpdk.org", "Cc": "Paul Szczepanek <paul.szczepanek@arm.com>", "Subject": "[RFC 0/2] add pointer compression API", "Date": "Wed, 27 Sep 2023 15:08:52 +0000", "Message-Id": "<20230927150854.3670391-1-paul.szczepanek@arm.com>", "X-Mailer": "git-send-email 2.25.1", "MIME-Version": "1.0", "Content-Transfer-Encoding": "8bit", "X-BeenThere": "dev@dpdk.org", "X-Mailman-Version": "2.1.29", "Precedence": "list", "List-Id": "DPDK patches and discussions <dev.dpdk.org>", "List-Unsubscribe": "<https://mails.dpdk.org/options/dev>,\n <mailto:dev-request@dpdk.org?subject=unsubscribe>", "List-Archive": "<http://mails.dpdk.org/archives/dev/>", "List-Post": "<mailto:dev@dpdk.org>", "List-Help": "<mailto:dev-request@dpdk.org?subject=help>", "List-Subscribe": "<https://mails.dpdk.org/listinfo/dev>,\n <mailto:dev-request@dpdk.org?subject=subscribe>", "Errors-To": "dev-bounces@dpdk.org" }, "content": "This patchset is proposing adding a new EAL header with utility functions\nthat allow compression of arrays of pointers.\n\nWhen passing caches full of pointers between threads, memory containing\nthe pointers is copied multiple times which is especially costly between\ncores. A compression method will allow us to shrink the memory size\ncopied.\n\nThe compression takes advantage of the fact that pointers are usually\nlocated in a limited memory region (like a mempool). We can compress them\nby converting them to offsets from a base memory address.\n\nOffsets can be stored in fewer bytes (dictated by the memory region size\nand alignment of the pointer). For example: an 8 byte aligned pointer\nwhich is part of a 32GB memory pool can be stored in 4 bytes. The API is\nvery generic and does not assume mempool pointers, any pointer can be\npassed in.\n\nCompression is based on few and fast operations and especially with vector\ninstructions leveraged creates minimal overhead.\n\nThe API accepts and returns arrays because the overhead means it only is\nworth it when done in bulk.\n\nTest is added that shows potential performance gain from compression. In\nthis test an array of pointers is passed through a ring between two cores.\nIt shows the gain which is dependent on the bulk operation size. In this\nsynthetic test run on ampere altra a substantial (up to 25%) performance\ngain is seen if done in bulk size larger than 32. At 32 it breaks even and\nlower sizes create a small (less than 5%) slowdown due to overhead.\n\nIn a more realistic mock application running the l3 forwarding dpdk\nexample that works in pipeline mode this translated into a ~5% throughput\nincrease on an ampere altra.\n\nPaul Szczepanek (2):\n eal: add pointer compression functions\n test: add pointer compress tests to ring perf test\n\n .mailmap | 1 +\n app/test/test_ring.h | 59 +++++-\n app/test/test_ring_perf.c | 324 ++++++++++++++++++-----------\n lib/eal/include/meson.build | 1 +\n lib/eal/include/rte_ptr_compress.h | 158 ++++++++++++++\n 5 files changed, 419 insertions(+), 124 deletions(-)\n create mode 100644 lib/eal/include/rte_ptr_compress.h" }