From patchwork Thu Sep 16 00:14:04 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Stephen Hemminger X-Patchwork-Id: 98961 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8E187A0C41; Thu, 16 Sep 2021 02:14:21 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 12CBC4003F; Thu, 16 Sep 2021 02:14:21 +0200 (CEST) Received: from mail-pf1-f173.google.com (mail-pf1-f173.google.com [209.85.210.173]) by mails.dpdk.org (Postfix) with ESMTP id 790D64003C for ; Thu, 16 Sep 2021 02:14:20 +0200 (CEST) Received: by mail-pf1-f173.google.com with SMTP id q22so4349831pfu.0 for ; Wed, 15 Sep 2021 17:14:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=1LM/Fq/DZVqj4E0nlHDQQkRs6Zy2G6TyXeIzHXKJgMU=; b=zKQCph/Lv9qCQvliRSeCEujZu1luC/ngsDU3qmwQ6D+825zc2KEWwK/ehXeyuX8eaP NNQR5EHPgJBhzvsylAu7x7vZMJAYHSKrZjOMJ2Z83WfpVCYtN0lLxF6qaa2M4Shs6HOd CXljCWOMyNmvmsM0tM+yYE8/E3H/gR3rnQ+M/lLCHeB3jNZaOFLgFA46hIkPqhN2k7Gz KKKCoqey/x+K3hnaFEJcJTDlBKBMh38GcypeqntQ9agLffmPA3FNxqerhUsBnZG6fOnV YhGVN0gN2e2jK8u9zFxGPQsOxhRtvN2qP3BJEter/X254vvH++ixdFgCfZOleHDUf5e4 ST9Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=1LM/Fq/DZVqj4E0nlHDQQkRs6Zy2G6TyXeIzHXKJgMU=; b=Bj0rkNU/WaDpun2714od/sCyJ5PgLa467O/Ifqm2X6T8J3BsPausbUvNMDJ1aSn211 LuaWPA/UJHJ1zMXG0WWvxNcxa8kNYyyOeC+nfANppeozgapwMO+E1SAMmmWnU8o+4nln MAU3rxW9pGl+DMUg6tSbholS87lCAasWnfgKQGzaFSnZEwkGOn1Z0OU5vCwiuhNzJkxk nlcCwivcAC2ghq4JfXoaF2UgtqJik+3q12Nw6oNjVO1w/hR3E3yTQiDu+g1sKcxECdYQ YgMzdJSn4uE9qfi6FHJoOYHSN9FeOCG0kgmZ5h1FYrYcZp5JgmWHeJ00q4O6ewHXTtBy XpkA== X-Gm-Message-State: AOAM533f1J0RILbcT93Sg1PIAUF+uxUjVYoPrt14klYAmmPiQtUADCL0 mgirKVm0AMZ6A95t6L/yodYd5TTYND1I2g== X-Google-Smtp-Source: ABdhPJwvgbccE6p//02P8zhfElELncILlXrahWa9CTC6vUzXs1WDt/LRlbURfI9AIboyNJvcCJjkmQ== X-Received: by 2002:a63:ef01:: with SMTP id u1mr2335165pgh.336.1631751259045; Wed, 15 Sep 2021 17:14:19 -0700 (PDT) Received: from hermes.local (204-195-33-123.wavecable.com. [204.195.33.123]) by smtp.gmail.com with ESMTPSA id 26sm1082252pgx.72.2021.09.15.17.14.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 15 Sep 2021 17:14:18 -0700 (PDT) From: Stephen Hemminger To: dev@dpdk.org Cc: Stephen Hemminger Date: Wed, 15 Sep 2021 17:14:04 -0700 Message-Id: <20210916001416.39998-1-stephen@networkplumber.org> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20210903004732.109023-1-stephen@networkplumber.org> References: <20210903004732.109023-1-stephen@networkplumber.org> MIME-Version: 1.0 Subject: [dpdk-dev] [PATCH v9 00/12] Packet capture framework enhancements X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This patch set is a more complete version of the the enhanced packet capture support described last year. The new capture library and utility are: - faster avoids lots of extra I/O, does bursting, etc. - gives more information (multiple ports, queues, etc) - has a better user interface (same as Wireshark dumpcap) - fixes structural problems with VLAN's and timestamps v9 changes: - incorporate suggested change to BPF XOR - make autotest for pcapng more complete by reading the resulting file with libpcap v8 changes: - enable BPF tests in autotest - add more BPF test strings - use rte_strscpy to satisfy checkpatch - merge MAINTAINERS (put this in with existing pdump) Stephen Hemminger (12): librte_pcapng: add new library for writing pcapng files lib: pdump is not supported on Windows bpf: allow self-xor operation bpf: add function to convert classic BPF to DPDK BPF bpf: add function to dump eBPF instructions pdump: support pcapng and filtering app/dumpcap: add new packet capture application test: add test for bpf_convert test: add a test for pcapng library test: enable bpf autotest doc: changes for new pcapng and dumpcap MAINTAINERS: add entry for new packet capture features MAINTAINERS | 11 +- app/dumpcap/main.c | 844 ++++++++++++++++++ app/dumpcap/meson.build | 16 + app/meson.build | 1 + app/test/meson.build | 6 + app/test/test_bpf.c | 200 +++++ app/test/test_pcapng.c | 272 ++++++ doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf.in | 1 + .../howto/img/packet_capture_framework.svg | 96 +- doc/guides/howto/packet_capture_framework.rst | 67 +- doc/guides/prog_guide/index.rst | 1 + doc/guides/prog_guide/pcapng_lib.rst | 24 + doc/guides/prog_guide/pdump_lib.rst | 28 +- doc/guides/rel_notes/release_21_11.rst | 10 + doc/guides/tools/dumpcap.rst | 86 ++ doc/guides/tools/index.rst | 1 + lib/bpf/bpf_convert.c | 575 ++++++++++++ lib/bpf/bpf_dump.c | 118 +++ lib/bpf/bpf_validate.c | 9 +- lib/bpf/meson.build | 6 + lib/bpf/rte_bpf.h | 39 + lib/bpf/version.map | 7 + lib/meson.build | 6 +- lib/pcapng/meson.build | 8 + lib/pcapng/pcapng_proto.h | 129 +++ lib/pcapng/rte_pcapng.c | 574 ++++++++++++ lib/pcapng/rte_pcapng.h | 194 ++++ lib/pcapng/version.map | 12 + lib/pdump/meson.build | 2 +- lib/pdump/rte_pdump.c | 441 ++++++--- lib/pdump/rte_pdump.h | 110 ++- lib/pdump/version.map | 8 + 33 files changed, 3683 insertions(+), 220 deletions(-) create mode 100644 app/dumpcap/main.c create mode 100644 app/dumpcap/meson.build create mode 100644 app/test/test_pcapng.c create mode 100644 doc/guides/prog_guide/pcapng_lib.rst create mode 100644 doc/guides/tools/dumpcap.rst create mode 100644 lib/bpf/bpf_convert.c create mode 100644 lib/bpf/bpf_dump.c create mode 100644 lib/pcapng/meson.build create mode 100644 lib/pcapng/pcapng_proto.h create mode 100644 lib/pcapng/rte_pcapng.c create mode 100644 lib/pcapng/rte_pcapng.h create mode 100644 lib/pcapng/version.map