From patchwork Fri Apr 5 21:47:41 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Pavan Nikhilesh Bhagavatula X-Patchwork-Id: 139176 X-Patchwork-Delegate: jerinj@marvell.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id EADFD43E0E; Fri, 5 Apr 2024 23:48:02 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D5D12402D4; Fri, 5 Apr 2024 23:48:02 +0200 (CEST) Received: from mx0b-0016f401.pphosted.com (mx0b-0016f401.pphosted.com [67.231.156.173]) by mails.dpdk.org (Postfix) with ESMTP id 74DC5402CE for ; Fri, 5 Apr 2024 23:48:01 +0200 (CEST) Received: from pps.filterd (m0045851.ppops.net [127.0.0.1]) by mx0b-0016f401.pphosted.com (8.17.1.24/8.17.1.24) with ESMTP id 435GtouG026431; Fri, 5 Apr 2024 14:48:00 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h= from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding:content-type; s= pfpt0220; bh=wrHYGnJZRkaIxb+liDnIaz9kwcY0PPIumNNnXkMXN5g=; b=PWK Pq8DBE4x+KRYiERDa5nWnEvQZx2STIejOwqFvSyh1M3wxdcaQR8x+zkfZgIM1liR 3SJGLCywx/MPppPyIUEDKUtWh0LAfymQ0QET2mHDCZBbG/NfzGldXRJky+4bVLAj op5jT/D96x9zNdgrB8qy92MEWHjW4miB5wcgwpDUAmCmHF6F9Rqi3HQZQzy6dYJ9 3Oy/8Uro3Z/6EOZO/+fXImaQG0rfspEEgFmfiLS6QCRQRQ9ZiMSsVpFtx37J1n4q VoS3vYvpCLzbsWVcUZakqQOR5KAmSsWdD4o1EJKu6cCrRSgbonypXOPohaQXVeLE F0Qx0qaqUDeXFaLuaJg== Received: from dc6wp-exch02.marvell.com ([4.21.29.225]) by mx0b-0016f401.pphosted.com (PPS) with ESMTPS id 3x9em6qhah-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 05 Apr 2024 14:47:59 -0700 (PDT) Received: from DC6WP-EXCH02.marvell.com (10.76.176.209) by DC6WP-EXCH02.marvell.com (10.76.176.209) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Fri, 5 Apr 2024 14:47:58 -0700 Received: from maili.marvell.com (10.69.176.80) by DC6WP-EXCH02.marvell.com (10.76.176.209) with Microsoft SMTP Server id 15.2.1544.4 via Frontend Transport; Fri, 5 Apr 2024 14:47:58 -0700 Received: from MININT-80QBFE8.corp.innovium.com (MININT-80QBFE8.marvell.com [10.28.164.106]) by maili.marvell.com (Postfix) with ESMTP id 75FB63F708F; Fri, 5 Apr 2024 14:47:46 -0700 (PDT) From: To: , Nithin Dabilpuram , "Kiran Kumar K" , Sunil Kumar Kori , Satha Rao , Harman Kalra , "Pavan Nikhilesh" , Shijith Thotton , Anatoly Burakov CC: Subject: [PATCH v3] cnxk: disable building template files Date: Sat, 6 Apr 2024 03:17:41 +0530 Message-ID: <20240405214742.8324-1-pbhagavatula@marvell.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20240405202522.4945-1-pbhagavatula@marvell.com> References: <20240405202522.4945-1-pbhagavatula@marvell.com> MIME-Version: 1.0 X-Proofpoint-ORIG-GUID: 8hXPoKp4t2JyGiUiDvQ9mZf-YqReclC0 X-Proofpoint-GUID: 8hXPoKp4t2JyGiUiDvQ9mZf-YqReclC0 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2024-04-05_26,2024-04-05_02,2023-05-22_02 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Pavan Nikhilesh Disable building template files when CNXK_DIS_TMPLT_FUNC is defined as a part of c_args. Example command: meson build -Dc_args='-DCNXK_DIS_TMPLT_FUNC' -Dexamples=all --cross-file config/arm/arm64_cn10k_linux_gcc Signed-off-by: Pavan Nikhilesh --- v2 Changes: - Fix x86 compilation. v3 Changes: - Consolidate RTE_ARCH_ARM64 defines. drivers/common/cnxk/roc_platform.h | 7 + drivers/event/cnxk/cn10k_eventdev.c | 65 ++++++-- drivers/event/cnxk/cn10k_tx_worker.h | 3 + drivers/event/cnxk/cn10k_worker.h | 10 ++ drivers/event/cnxk/cn9k_eventdev.c | 68 ++++++++- drivers/event/cnxk/cn9k_worker.h | 33 +++++ drivers/event/cnxk/deq/cn10k/deq_0_15.c | 4 + drivers/event/cnxk/deq/cn10k/deq_0_15_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_0_15_seg.c | 4 + .../event/cnxk/deq/cn10k/deq_0_15_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_0_15_tmo.c | 4 + .../event/cnxk/deq/cn10k/deq_0_15_tmo_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_0_15_tmo_seg.c | 4 + .../cnxk/deq/cn10k/deq_0_15_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_112_127.c | 4 + .../event/cnxk/deq/cn10k/deq_112_127_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_112_127_seg.c | 4 + .../cnxk/deq/cn10k/deq_112_127_seg_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_112_127_tmo.c | 4 + .../cnxk/deq/cn10k/deq_112_127_tmo_burst.c | 4 + .../cnxk/deq/cn10k/deq_112_127_tmo_seg.c | 1 + .../deq/cn10k/deq_112_127_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_16_31.c | 4 + .../event/cnxk/deq/cn10k/deq_16_31_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_16_31_seg.c | 4 + .../cnxk/deq/cn10k/deq_16_31_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_16_31_tmo.c | 4 + .../cnxk/deq/cn10k/deq_16_31_tmo_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_16_31_tmo_seg.c | 4 + .../cnxk/deq/cn10k/deq_16_31_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_32_47.c | 4 + .../event/cnxk/deq/cn10k/deq_32_47_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_32_47_seg.c | 4 + .../cnxk/deq/cn10k/deq_32_47_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_32_47_tmo.c | 4 + .../cnxk/deq/cn10k/deq_32_47_tmo_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_32_47_tmo_seg.c | 4 + .../cnxk/deq/cn10k/deq_32_47_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_48_63.c | 4 + .../event/cnxk/deq/cn10k/deq_48_63_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_48_63_seg.c | 4 + .../cnxk/deq/cn10k/deq_48_63_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_48_63_tmo.c | 4 + .../cnxk/deq/cn10k/deq_48_63_tmo_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_48_63_tmo_seg.c | 4 + .../cnxk/deq/cn10k/deq_48_63_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_64_79.c | 4 + .../event/cnxk/deq/cn10k/deq_64_79_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_64_79_seg.c | 4 + .../cnxk/deq/cn10k/deq_64_79_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_64_79_tmo.c | 4 + .../cnxk/deq/cn10k/deq_64_79_tmo_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_64_79_tmo_seg.c | 4 + .../cnxk/deq/cn10k/deq_64_79_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_80_95.c | 4 + .../event/cnxk/deq/cn10k/deq_80_95_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_80_95_seg.c | 4 + .../cnxk/deq/cn10k/deq_80_95_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_80_95_tmo.c | 4 + .../cnxk/deq/cn10k/deq_80_95_tmo_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_80_95_tmo_seg.c | 4 + .../cnxk/deq/cn10k/deq_80_95_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_96_111.c | 4 + .../event/cnxk/deq/cn10k/deq_96_111_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_96_111_seg.c | 4 + .../cnxk/deq/cn10k/deq_96_111_seg_burst.c | 4 + drivers/event/cnxk/deq/cn10k/deq_96_111_tmo.c | 4 + .../cnxk/deq/cn10k/deq_96_111_tmo_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_96_111_tmo_seg.c | 4 + .../cnxk/deq/cn10k/deq_96_111_tmo_seg_burst.c | 4 + .../event/cnxk/deq/cn10k/deq_all_offload.c | 77 ++++++++++ drivers/event/cnxk/deq/cn9k/deq_0_15.c | 4 + drivers/event/cnxk/deq/cn9k/deq_0_15_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_0_15_dual.c | 4 + .../event/cnxk/deq/cn9k/deq_0_15_dual_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_0_15_dual_seg.c | 4 + .../cnxk/deq/cn9k/deq_0_15_dual_seg_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_0_15_dual_tmo.c | 4 + .../cnxk/deq/cn9k/deq_0_15_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_0_15_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_0_15_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_0_15_seg.c | 4 + .../event/cnxk/deq/cn9k/deq_0_15_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_0_15_tmo.c | 4 + .../event/cnxk/deq/cn9k/deq_0_15_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_0_15_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_0_15_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_112_127.c | 4 + .../event/cnxk/deq/cn9k/deq_112_127_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_112_127_dual.c | 4 + .../cnxk/deq/cn9k/deq_112_127_dual_burst.c | 4 + .../cnxk/deq/cn9k/deq_112_127_dual_seg.c | 4 + .../deq/cn9k/deq_112_127_dual_seg_burst.c | 4 + .../cnxk/deq/cn9k/deq_112_127_dual_tmo.c | 4 + .../deq/cn9k/deq_112_127_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_112_127_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_112_127_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_112_127_seg.c | 4 + .../cnxk/deq/cn9k/deq_112_127_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_112_127_tmo.c | 4 + .../cnxk/deq/cn9k/deq_112_127_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_112_127_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_112_127_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_16_31.c | 4 + drivers/event/cnxk/deq/cn9k/deq_16_31_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_16_31_dual.c | 4 + .../cnxk/deq/cn9k/deq_16_31_dual_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_16_31_dual_seg.c | 4 + .../cnxk/deq/cn9k/deq_16_31_dual_seg_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_16_31_dual_tmo.c | 4 + .../cnxk/deq/cn9k/deq_16_31_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_16_31_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_16_31_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_16_31_seg.c | 4 + .../event/cnxk/deq/cn9k/deq_16_31_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_16_31_tmo.c | 4 + .../event/cnxk/deq/cn9k/deq_16_31_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_16_31_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_16_31_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_32_47.c | 4 + drivers/event/cnxk/deq/cn9k/deq_32_47_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_32_47_dual.c | 4 + .../cnxk/deq/cn9k/deq_32_47_dual_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_32_47_dual_seg.c | 4 + .../cnxk/deq/cn9k/deq_32_47_dual_seg_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_32_47_dual_tmo.c | 4 + .../cnxk/deq/cn9k/deq_32_47_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_32_47_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_32_47_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_32_47_seg.c | 4 + .../event/cnxk/deq/cn9k/deq_32_47_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_32_47_tmo.c | 4 + .../event/cnxk/deq/cn9k/deq_32_47_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_32_47_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_32_47_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_48_63.c | 4 + drivers/event/cnxk/deq/cn9k/deq_48_63_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_48_63_dual.c | 4 + .../cnxk/deq/cn9k/deq_48_63_dual_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_48_63_dual_seg.c | 4 + .../cnxk/deq/cn9k/deq_48_63_dual_seg_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_48_63_dual_tmo.c | 4 + .../cnxk/deq/cn9k/deq_48_63_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_48_63_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_48_63_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_48_63_seg.c | 4 + .../event/cnxk/deq/cn9k/deq_48_63_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_48_63_tmo.c | 4 + .../event/cnxk/deq/cn9k/deq_48_63_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_48_63_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_48_63_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_64_79.c | 4 + drivers/event/cnxk/deq/cn9k/deq_64_79_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_64_79_dual.c | 4 + .../cnxk/deq/cn9k/deq_64_79_dual_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_64_79_dual_seg.c | 4 + .../cnxk/deq/cn9k/deq_64_79_dual_seg_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_64_79_dual_tmo.c | 4 + .../cnxk/deq/cn9k/deq_64_79_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_64_79_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_64_79_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_64_79_seg.c | 4 + .../event/cnxk/deq/cn9k/deq_64_79_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_64_79_tmo.c | 4 + .../event/cnxk/deq/cn9k/deq_64_79_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_64_79_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_64_79_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_80_95.c | 4 + drivers/event/cnxk/deq/cn9k/deq_80_95_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_80_95_dual.c | 4 + .../cnxk/deq/cn9k/deq_80_95_dual_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_80_95_dual_seg.c | 4 + .../cnxk/deq/cn9k/deq_80_95_dual_seg_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_80_95_dual_tmo.c | 4 + .../cnxk/deq/cn9k/deq_80_95_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_80_95_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_80_95_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_80_95_seg.c | 4 + .../event/cnxk/deq/cn9k/deq_80_95_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_80_95_tmo.c | 4 + .../event/cnxk/deq/cn9k/deq_80_95_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_80_95_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_80_95_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_96_111.c | 4 + .../event/cnxk/deq/cn9k/deq_96_111_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_96_111_dual.c | 4 + .../cnxk/deq/cn9k/deq_96_111_dual_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_96_111_dual_seg.c | 4 + .../cnxk/deq/cn9k/deq_96_111_dual_seg_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_96_111_dual_tmo.c | 4 + .../cnxk/deq/cn9k/deq_96_111_dual_tmo_burst.c | 4 + .../cnxk/deq/cn9k/deq_96_111_dual_tmo_seg.c | 4 + .../deq/cn9k/deq_96_111_dual_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_96_111_seg.c | 4 + .../cnxk/deq/cn9k/deq_96_111_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_96_111_tmo.c | 4 + .../cnxk/deq/cn9k/deq_96_111_tmo_burst.c | 4 + .../event/cnxk/deq/cn9k/deq_96_111_tmo_seg.c | 4 + .../cnxk/deq/cn9k/deq_96_111_tmo_seg_burst.c | 4 + drivers/event/cnxk/deq/cn9k/deq_all_offload.c | 139 ++++++++++++++++++ drivers/event/cnxk/meson.build | 25 +++- drivers/event/cnxk/tx/cn10k/tx_0_15.c | 4 + drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_112_127.c | 4 + drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_16_31.c | 4 + drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_32_47.c | 4 + drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_48_63.c | 4 + drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_64_79.c | 4 + drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_80_95.c | 4 + drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_96_111.c | 4 + drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c | 4 + drivers/event/cnxk/tx/cn10k/tx_all_offload.c | 27 ++++ drivers/event/cnxk/tx/cn9k/tx_0_15.c | 4 + drivers/event/cnxk/tx/cn9k/tx_0_15_dual.c | 4 + drivers/event/cnxk/tx/cn9k/tx_0_15_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_0_15_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_112_127.c | 4 + drivers/event/cnxk/tx/cn9k/tx_112_127_dual.c | 4 + .../event/cnxk/tx/cn9k/tx_112_127_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_112_127_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_16_31.c | 4 + drivers/event/cnxk/tx/cn9k/tx_16_31_dual.c | 4 + .../event/cnxk/tx/cn9k/tx_16_31_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_16_31_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_32_47.c | 4 + drivers/event/cnxk/tx/cn9k/tx_32_47_dual.c | 4 + .../event/cnxk/tx/cn9k/tx_32_47_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_32_47_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_48_63.c | 4 + drivers/event/cnxk/tx/cn9k/tx_48_63_dual.c | 4 + .../event/cnxk/tx/cn9k/tx_48_63_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_48_63_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_64_79.c | 4 + drivers/event/cnxk/tx/cn9k/tx_64_79_dual.c | 4 + .../event/cnxk/tx/cn9k/tx_64_79_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_64_79_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_80_95.c | 4 + drivers/event/cnxk/tx/cn9k/tx_80_95_dual.c | 4 + .../event/cnxk/tx/cn9k/tx_80_95_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_80_95_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_96_111.c | 4 + drivers/event/cnxk/tx/cn9k/tx_96_111_dual.c | 4 + .../event/cnxk/tx/cn9k/tx_96_111_dual_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_96_111_seg.c | 4 + drivers/event/cnxk/tx/cn9k/tx_all_offload.c | 39 +++++ drivers/net/cnxk/cn10k_rx.h | 16 ++ drivers/net/cnxk/cn10k_rx_select.c | 50 ++++++- drivers/net/cnxk/cn10k_tx.h | 8 + drivers/net/cnxk/cn10k_tx_select.c | 42 +++++- drivers/net/cnxk/cn9k_rx.h | 16 ++ drivers/net/cnxk/cn9k_rx_select.c | 50 ++++++- drivers/net/cnxk/cn9k_tx.h | 8 + drivers/net/cnxk/cn9k_tx_select.c | 43 +++++- drivers/net/cnxk/meson.build | 25 +++- drivers/net/cnxk/rx/cn10k/rx_0_15.c | 4 + drivers/net/cnxk/rx/cn10k/rx_0_15_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_0_15_vec.c | 4 + drivers/net/cnxk/rx/cn10k/rx_0_15_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_112_127.c | 4 + drivers/net/cnxk/rx/cn10k/rx_112_127_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_112_127_vec.c | 4 + .../net/cnxk/rx/cn10k/rx_112_127_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_16_31.c | 4 + drivers/net/cnxk/rx/cn10k/rx_16_31_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_16_31_vec.c | 4 + drivers/net/cnxk/rx/cn10k/rx_16_31_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_32_47.c | 4 + drivers/net/cnxk/rx/cn10k/rx_32_47_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_32_47_vec.c | 4 + drivers/net/cnxk/rx/cn10k/rx_32_47_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_48_63.c | 4 + drivers/net/cnxk/rx/cn10k/rx_48_63_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_48_63_vec.c | 4 + drivers/net/cnxk/rx/cn10k/rx_48_63_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_64_79.c | 4 + drivers/net/cnxk/rx/cn10k/rx_64_79_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_64_79_vec.c | 4 + drivers/net/cnxk/rx/cn10k/rx_64_79_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_80_95.c | 4 + drivers/net/cnxk/rx/cn10k/rx_80_95_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_80_95_vec.c | 4 + drivers/net/cnxk/rx/cn10k/rx_80_95_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_96_111.c | 4 + drivers/net/cnxk/rx/cn10k/rx_96_111_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_96_111_vec.c | 4 + .../net/cnxk/rx/cn10k/rx_96_111_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn10k/rx_all_offload.c | 57 +++++++ drivers/net/cnxk/rx/cn9k/rx_0_15.c | 4 + drivers/net/cnxk/rx/cn9k/rx_0_15_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_0_15_vec.c | 4 + drivers/net/cnxk/rx/cn9k/rx_0_15_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_112_127.c | 4 + drivers/net/cnxk/rx/cn9k/rx_112_127_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_112_127_vec.c | 4 + .../net/cnxk/rx/cn9k/rx_112_127_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_16_31.c | 4 + drivers/net/cnxk/rx/cn9k/rx_16_31_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_16_31_vec.c | 4 + drivers/net/cnxk/rx/cn9k/rx_16_31_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_32_47.c | 4 + drivers/net/cnxk/rx/cn9k/rx_32_47_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_32_47_vec.c | 4 + drivers/net/cnxk/rx/cn9k/rx_32_47_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_48_63.c | 4 + drivers/net/cnxk/rx/cn9k/rx_48_63_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_48_63_vec.c | 4 + drivers/net/cnxk/rx/cn9k/rx_48_63_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_64_79.c | 4 + drivers/net/cnxk/rx/cn9k/rx_64_79_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_64_79_vec.c | 4 + drivers/net/cnxk/rx/cn9k/rx_64_79_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_80_95.c | 4 + drivers/net/cnxk/rx/cn9k/rx_80_95_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_80_95_vec.c | 4 + drivers/net/cnxk/rx/cn9k/rx_80_95_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_96_111.c | 4 + drivers/net/cnxk/rx/cn9k/rx_96_111_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_96_111_vec.c | 4 + drivers/net/cnxk/rx/cn9k/rx_96_111_vec_mseg.c | 4 + drivers/net/cnxk/rx/cn9k/rx_all_offload.c | 50 +++++++ drivers/net/cnxk/tx/cn10k/tx_0_15.c | 4 + drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c | 4 + drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_112_127.c | 4 + drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c | 4 + .../net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_16_31.c | 4 + drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c | 4 + drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_32_47.c | 4 + drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c | 4 + drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_48_63.c | 4 + drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c | 4 + drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_64_79.c | 4 + drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c | 4 + drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_80_95.c | 4 + drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c | 4 + drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_96_111.c | 4 + drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c | 4 + .../net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn10k/tx_all_offload.c | 37 +++++ drivers/net/cnxk/tx/cn9k/tx_0_15.c | 4 + drivers/net/cnxk/tx/cn9k/tx_0_15_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_0_15_vec.c | 4 + drivers/net/cnxk/tx/cn9k/tx_0_15_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_112_127.c | 4 + drivers/net/cnxk/tx/cn9k/tx_112_127_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_112_127_vec.c | 4 + .../net/cnxk/tx/cn9k/tx_112_127_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_16_31.c | 4 + drivers/net/cnxk/tx/cn9k/tx_16_31_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_16_31_vec.c | 4 + drivers/net/cnxk/tx/cn9k/tx_16_31_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_32_47.c | 4 + drivers/net/cnxk/tx/cn9k/tx_32_47_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_32_47_vec.c | 4 + drivers/net/cnxk/tx/cn9k/tx_32_47_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_48_63.c | 4 + drivers/net/cnxk/tx/cn9k/tx_48_63_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_48_63_vec.c | 4 + drivers/net/cnxk/tx/cn9k/tx_48_63_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_64_79.c | 4 + drivers/net/cnxk/tx/cn9k/tx_64_79_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_64_79_vec.c | 4 + drivers/net/cnxk/tx/cn9k/tx_64_79_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_80_95.c | 4 + drivers/net/cnxk/tx/cn9k/tx_80_95_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_80_95_vec.c | 4 + drivers/net/cnxk/tx/cn9k/tx_80_95_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_96_111.c | 4 + drivers/net/cnxk/tx/cn9k/tx_96_111_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_96_111_vec.c | 4 + drivers/net/cnxk/tx/cn9k/tx_96_111_vec_mseg.c | 4 + drivers/net/cnxk/tx/cn9k/tx_all_offload.c | 35 +++++ 392 files changed, 2356 insertions(+), 43 deletions(-) create mode 100644 drivers/event/cnxk/deq/cn10k/deq_all_offload.c create mode 100644 drivers/event/cnxk/deq/cn9k/deq_all_offload.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_all_offload.c create mode 100644 drivers/event/cnxk/tx/cn9k/tx_all_offload.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_all_offload.c create mode 100644 drivers/net/cnxk/rx/cn9k/rx_all_offload.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_all_offload.c create mode 100644 drivers/net/cnxk/tx/cn9k/tx_all_offload.c -- 2.25.1 diff --git a/drivers/common/cnxk/roc_platform.h b/drivers/common/cnxk/roc_platform.h index 4dc69765a8..c513dd6d21 100644 --- a/drivers/common/cnxk/roc_platform.h +++ b/drivers/common/cnxk/roc_platform.h @@ -70,6 +70,13 @@ #define PLT_ETHER_ADDR_LEN RTE_ETHER_ADDR_LEN #endif +#define PLT_DISABLE_TEMPLATE_FUNC 1 +#if PLT_DISABLE_TEMPLATE_FUNC +#ifndef CNXK_DIS_TMPLT_FUNC +#define CNXK_DIS_TMPLT_FUNC +#endif +#endif + /* Cast to specific datatypes */ #define PLT_PTR_CAST(val) ((void *)(val)) #define PLT_U64_CAST(val) ((uint64_t)(val)) diff --git a/drivers/event/cnxk/cn10k_eventdev.c b/drivers/event/cnxk/cn10k_eventdev.c index 18f3b402c9..a39e70a67e 100644 --- a/drivers/event/cnxk/cn10k_eventdev.c +++ b/drivers/event/cnxk/cn10k_eventdev.c @@ -305,13 +305,12 @@ cn10k_sso_updt_tx_adptr_data(const struct rte_eventdev *event_dev) return 0; } -static void -cn10k_sso_fp_fns_set(struct rte_eventdev *event_dev) -{ #if defined(RTE_ARCH_ARM64) +static inline void +cn10k_sso_fp_tmplt_fns_set(struct rte_eventdev *event_dev) +{ +#if !defined(CNXK_DIS_TMPLT_FUNC) struct cnxk_sso_evdev *dev = cnxk_sso_pmd_priv(event_dev); - - struct roc_cpt *cpt = roc_idev_cpt_get(); const event_dequeue_t sso_hws_deq[NIX_RX_OFFLOAD_MAX] = { #define R(name, flags)[flags] = cn10k_sso_hws_deq_##name, NIX_RX_FASTPATH_MODES @@ -423,10 +422,6 @@ cn10k_sso_fp_fns_set(struct rte_eventdev *event_dev) #undef T }; - event_dev->enqueue = cn10k_sso_hws_enq; - event_dev->enqueue_burst = cn10k_sso_hws_enq_burst; - event_dev->enqueue_new_burst = cn10k_sso_hws_enq_new_burst; - event_dev->enqueue_forward_burst = cn10k_sso_hws_enq_fwd_burst; if (dev->rx_offloads & NIX_RX_MULTI_SEG_F) { if (dev->rx_offloads & NIX_RX_REAS_F) { CN10K_SET_EVDEV_DEQ_OP(dev, event_dev->dequeue, sso_hws_reas_deq_seg); @@ -474,6 +469,51 @@ cn10k_sso_fp_fns_set(struct rte_eventdev *event_dev) } } + if (dev->tx_offloads & NIX_TX_MULTI_SEG_F) + CN10K_SET_EVDEV_ENQ_OP(dev, event_dev->txa_enqueue, sso_hws_tx_adptr_enq_seg); + else + CN10K_SET_EVDEV_ENQ_OP(dev, event_dev->txa_enqueue, sso_hws_tx_adptr_enq); + + event_dev->txa_enqueue_same_dest = event_dev->txa_enqueue; +#else + RTE_SET_USED(event_dev); +#endif +} + +static inline void +cn10k_sso_fp_blk_fns_set(struct rte_eventdev *event_dev) +{ +#if defined(CNXK_DIS_TMPLT_FUNC) + struct cnxk_sso_evdev *dev = cnxk_sso_pmd_priv(event_dev); + + event_dev->dequeue = cn10k_sso_hws_deq_all_offload; + event_dev->dequeue_burst = cn10k_sso_hws_deq_burst_all_offload; + if (dev->rx_offloads & NIX_RX_OFFLOAD_TSTAMP_F) { + event_dev->dequeue = cn10k_sso_hws_deq_all_offload_tst; + event_dev->dequeue_burst = cn10k_sso_hws_deq_burst_all_offload_tst; + } + event_dev->txa_enqueue = cn10k_sso_hws_tx_adptr_enq_seg_all_offload; + event_dev->txa_enqueue_same_dest = cn10k_sso_hws_tx_adptr_enq_seg_all_offload; +#else + RTE_SET_USED(event_dev); +#endif +} +#endif + +static void +cn10k_sso_fp_fns_set(struct rte_eventdev *event_dev) +{ +#if defined(RTE_ARCH_ARM64) + struct roc_cpt *cpt = roc_idev_cpt_get(); + + cn10k_sso_fp_blk_fns_set(event_dev); + cn10k_sso_fp_tmplt_fns_set(event_dev); + + event_dev->enqueue = cn10k_sso_hws_enq; + event_dev->enqueue_burst = cn10k_sso_hws_enq_burst; + event_dev->enqueue_new_burst = cn10k_sso_hws_enq_new_burst; + event_dev->enqueue_forward_burst = cn10k_sso_hws_enq_fwd_burst; + if ((cpt != NULL) && cpt->hw_caps[CPT_ENG_TYPE_SE].sg_ver2 && cpt->hw_caps[CPT_ENG_TYPE_IE].sg_ver2) event_dev->ca_enqueue = cn10k_cpt_sg_ver2_crypto_adapter_enqueue; @@ -481,13 +521,6 @@ cn10k_sso_fp_fns_set(struct rte_eventdev *event_dev) event_dev->ca_enqueue = cn10k_cpt_sg_ver1_crypto_adapter_enqueue; event_dev->dma_enqueue = cn10k_dma_adapter_enqueue; - - if (dev->tx_offloads & NIX_TX_MULTI_SEG_F) - CN10K_SET_EVDEV_ENQ_OP(dev, event_dev->txa_enqueue, sso_hws_tx_adptr_enq_seg); - else - CN10K_SET_EVDEV_ENQ_OP(dev, event_dev->txa_enqueue, sso_hws_tx_adptr_enq); - - event_dev->txa_enqueue_same_dest = event_dev->txa_enqueue; event_dev->profile_switch = cn10k_sso_hws_profile_switch; #else RTE_SET_USED(event_dev); diff --git a/drivers/event/cnxk/cn10k_tx_worker.h b/drivers/event/cnxk/cn10k_tx_worker.h index 256237b895..a997f036c0 100644 --- a/drivers/event/cnxk/cn10k_tx_worker.h +++ b/drivers/event/cnxk/cn10k_tx_worker.h @@ -280,4 +280,7 @@ NIX_TX_FASTPATH_MODES (flags) | NIX_TX_MULTI_SEG_F); \ } +uint16_t __rte_hot cn10k_sso_hws_tx_adptr_enq_seg_all_offload(void *port, struct rte_event ev[], + uint16_t nb_events); + #endif diff --git a/drivers/event/cnxk/cn10k_worker.h b/drivers/event/cnxk/cn10k_worker.h index 3426446aaf..c5026409d7 100644 --- a/drivers/event/cnxk/cn10k_worker.h +++ b/drivers/event/cnxk/cn10k_worker.h @@ -517,4 +517,14 @@ NIX_RX_FASTPATH_MODES return fn(port, ev, timeout_ticks); \ } +uint16_t __rte_hot cn10k_sso_hws_deq_all_offload(void *port, struct rte_event *ev, + uint64_t timeout_ticks); +uint16_t __rte_hot cn10k_sso_hws_deq_burst_all_offload(void *port, struct rte_event ev[], + uint16_t nb_events, uint64_t timeout_ticks); +uint16_t __rte_hot cn10k_sso_hws_deq_all_offload_tst(void *port, struct rte_event *ev, + uint64_t timeout_ticks); +uint16_t __rte_hot cn10k_sso_hws_deq_burst_all_offload_tst(void *port, struct rte_event ev[], + uint16_t nb_events, + uint64_t timeout_ticks); + #endif diff --git a/drivers/event/cnxk/cn9k_eventdev.c b/drivers/event/cnxk/cn9k_eventdev.c index 3cd6f448f0..bb675034c7 100644 --- a/drivers/event/cnxk/cn9k_eventdev.c +++ b/drivers/event/cnxk/cn9k_eventdev.c @@ -307,10 +307,11 @@ cn9k_sso_updt_tx_adptr_data(const struct rte_eventdev *event_dev) return 0; } -static void -cn9k_sso_fp_fns_set(struct rte_eventdev *event_dev) -{ #if defined(RTE_ARCH_ARM64) +static inline void +cn9k_sso_fp_tmplt_fns_set(struct rte_eventdev *event_dev) +{ +#if !defined(CNXK_DIS_TMPLT_FUNC) struct cnxk_sso_evdev *dev = cnxk_sso_pmd_priv(event_dev); /* Single WS modes */ const event_dequeue_t sso_hws_deq[NIX_RX_OFFLOAD_MAX] = { @@ -524,6 +525,67 @@ cn9k_sso_fp_fns_set(struct rte_eventdev *event_dev) #endif } +static inline void +cn9k_sso_fp_blk_fns_set(struct rte_eventdev *event_dev) +{ +#if defined(CNXK_DIS_TMPLT_FUNC) + struct cnxk_sso_evdev *dev = cnxk_sso_pmd_priv(event_dev); + + event_dev->dequeue = cn9k_sso_hws_deq_all_offload; + event_dev->dequeue_burst = cn9k_sso_hws_deq_burst_all_offload; + if (dev->rx_offloads & NIX_RX_OFFLOAD_TSTAMP_F) { + event_dev->dequeue = cn9k_sso_hws_deq_all_offload_tst; + event_dev->dequeue_burst = cn9k_sso_hws_deq_burst_all_offload_tst; + } + event_dev->txa_enqueue = cn9k_sso_hws_tx_adptr_enq_seg_all_offload; + event_dev->txa_enqueue_same_dest = cn9k_sso_hws_tx_adptr_enq_seg_all_offload; + if (dev->dual_ws) { + event_dev->dequeue = cn9k_sso_hws_deq_dual_all_offload; + event_dev->dequeue_burst = cn9k_sso_hws_deq_dual_burst_all_offload; + if (dev->rx_offloads & NIX_RX_OFFLOAD_TSTAMP_F) { + event_dev->dequeue = cn9k_sso_hws_deq_dual_all_offload_tst; + event_dev->dequeue_burst = cn9k_sso_hws_deq_dual_burst_all_offload_tst; + } + event_dev->txa_enqueue = cn9k_sso_hws_tx_adptr_enq_dual_seg_all_offload; + event_dev->txa_enqueue_same_dest = cn9k_sso_hws_tx_adptr_enq_dual_seg_all_offload; + } +#else + RTE_SET_USED(event_dev); +#endif +} +#endif + +static void +cn9k_sso_fp_fns_set(struct rte_eventdev *event_dev) +{ +#if defined(RTE_ARCH_ARM64) + struct cnxk_sso_evdev *dev = cnxk_sso_pmd_priv(event_dev); + + cn9k_sso_fp_blk_fns_set(event_dev); + cn9k_sso_fp_tmplt_fns_set(event_dev); + + event_dev->enqueue = cn9k_sso_hws_enq; + event_dev->enqueue_burst = cn9k_sso_hws_enq_burst; + event_dev->enqueue_new_burst = cn9k_sso_hws_enq_new_burst; + event_dev->enqueue_forward_burst = cn9k_sso_hws_enq_fwd_burst; + event_dev->ca_enqueue = cn9k_sso_hws_ca_enq; + event_dev->profile_switch = cn9k_sso_hws_profile_switch; + + if (dev->dual_ws) { + event_dev->enqueue = cn9k_sso_hws_dual_enq; + event_dev->enqueue_burst = cn9k_sso_hws_dual_enq_burst; + event_dev->enqueue_new_burst = cn9k_sso_hws_dual_enq_new_burst; + event_dev->enqueue_forward_burst = cn9k_sso_hws_dual_enq_fwd_burst; + event_dev->ca_enqueue = cn9k_sso_hws_dual_ca_enq; + event_dev->profile_switch = cn9k_sso_hws_dual_profile_switch; + } + + event_dev->dma_enqueue = cn9k_dma_adapter_enqueue; +#else + RTE_SET_USED(event_dev); +#endif +} + static void * cn9k_sso_init_hws_mem(void *arg, uint8_t port_id) { diff --git a/drivers/event/cnxk/cn9k_worker.h b/drivers/event/cnxk/cn9k_worker.h index a8e998951c..c38c31b1b3 100644 --- a/drivers/event/cnxk/cn9k_worker.h +++ b/drivers/event/cnxk/cn9k_worker.h @@ -542,6 +542,33 @@ NIX_RX_FASTPATH_MODES return fn(port, ev, timeout_ticks); \ } +uint16_t __rte_hot cn9k_sso_hws_deq_all_offload(void *port, struct rte_event *ev, + uint64_t timeout_ticks); + +uint16_t __rte_hot cn9k_sso_hws_deq_dual_all_offload(void *port, struct rte_event *ev, + uint64_t timeout_ticks); + +uint16_t __rte_hot cn9k_sso_hws_deq_burst_all_offload(void *port, struct rte_event ev[], + uint16_t nb_events, uint64_t timeout_ticks); + +uint16_t __rte_hot cn9k_sso_hws_deq_dual_burst_all_offload(void *port, struct rte_event ev[], + uint16_t nb_events, + uint64_t timeout_ticks); + +uint16_t __rte_hot cn9k_sso_hws_deq_all_offload_tst(void *port, struct rte_event *ev, + uint64_t timeout_ticks); + +uint16_t __rte_hot cn9k_sso_hws_deq_dual_all_offload_tst(void *port, struct rte_event *ev, + uint64_t timeout_ticks); + +uint16_t __rte_hot cn9k_sso_hws_deq_burst_all_offload_tst(void *port, struct rte_event ev[], + uint16_t nb_events, + uint64_t timeout_ticks); + +uint16_t __rte_hot cn9k_sso_hws_deq_dual_burst_all_offload_tst(void *port, struct rte_event ev[], + uint16_t nb_events, + uint64_t timeout_ticks); + static __rte_always_inline void cn9k_sso_txq_fc_wait(const struct cn9k_eth_txq *txq) { @@ -889,4 +916,10 @@ NIX_TX_FASTPATH_MODES (flags) | NIX_TX_MULTI_SEG_F); \ } +uint16_t __rte_hot cn9k_sso_hws_tx_adptr_enq_seg_all_offload(void *port, struct rte_event ev[], + uint16_t nb_events); + +uint16_t __rte_hot cn9k_sso_hws_tx_adptr_enq_dual_seg_all_offload(void *port, struct rte_event ev[], + uint16_t nb_events); + #endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15.c b/drivers/event/cnxk/deq/cn10k/deq_0_15.c index b715c22b8f..e1ea267394 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15_burst.c b/drivers/event/cnxk/deq/cn10k/deq_0_15_burst.c index 33820eb711..24ec0c125f 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15_seg.c b/drivers/event/cnxk/deq/cn10k/deq_0_15_seg.c index 4c2b60972a..9e48bd2170 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_0_15_seg_burst.c index cf3a44a7be..25aad83844 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo.c index a92c3e23ed..4110b24312 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_burst.c index d8547c15ac..3f6f8d5c55 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg.c index 8acbf3f4d6..27fba138de 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg_burst.c index 3d0beb378a..5558b93f46 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_0_15_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127.c b/drivers/event/cnxk/deq/cn10k/deq_112_127.c index 0ce82d195e..d7c0c21770 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127_burst.c b/drivers/event/cnxk/deq/cn10k/deq_112_127_burst.c index 313530dd5d..b0ab1ee90c 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127_seg.c b/drivers/event/cnxk/deq/cn10k/deq_112_127_seg.c index 07823f065f..47c1ecdf2f 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_112_127_seg_burst.c index 48b3cd8a85..d6456ae724 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo.c index 7c3022f69f..9b4f028678 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_burst.c index 1e224137b1..7bed6ee478 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg.c index b42a87e8c5..7bbe2086ee 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg.c @@ -8,6 +8,7 @@ #error "roc_api.h is included" #endif + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, flags | NIX_RX_REAS_F) diff --git a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg_burst.c index dc3e7e9e69..abc12c6e1c 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_112_127_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31.c b/drivers/event/cnxk/deq/cn10k/deq_16_31.c index ff09a106ea..e5776a8b64 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31_burst.c b/drivers/event/cnxk/deq/cn10k/deq_16_31_burst.c index 4b270ca51f..c098ac56f2 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31_seg.c b/drivers/event/cnxk/deq/cn10k/deq_16_31_seg.c index ec86587bdf..83e1ace903 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_16_31_seg_burst.c index 20051682de..b9400e1c0a 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo.c index dc3a52bb7f..e17e71db2b 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_burst.c index a3c52d0075..3441be7bc3 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg.c index 0d1b713206..bf00a04f34 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg_burst.c index 2a1cd255b1..ceddf71218 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_16_31_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47.c b/drivers/event/cnxk/deq/cn10k/deq_32_47.c index 3bcd49a68f..9fc32fc8f1 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47_burst.c b/drivers/event/cnxk/deq/cn10k/deq_32_47_burst.c index e20f60c372..6c36de6bb5 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47_seg.c b/drivers/event/cnxk/deq/cn10k/deq_32_47_seg.c index 154107219e..8ce1875e98 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_32_47_seg_burst.c index 8bd9464636..35f47e49ea 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo.c index 37f2985fb3..d1dabb0bc3 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_burst.c index 9711381cf1..4c67a8540b 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -17,3 +19,5 @@ NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg.c index 6ee76356d5..a8d0240871 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg_burst.c index 4f7a4580df..61afc8bb14 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_32_47_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63.c b/drivers/event/cnxk/deq/cn10k/deq_48_63.c index 3f20dea608..7a8c548e60 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63_burst.c b/drivers/event/cnxk/deq/cn10k/deq_48_63_burst.c index b2f8661a07..965a7c9bad 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63_seg.c b/drivers/event/cnxk/deq/cn10k/deq_48_63_seg.c index 019ff941c6..7a85c7a7ba 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_48_63_seg_burst.c index e408d55b0b..12095ccac4 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo.c index 73ba2dd7ff..12d045d429 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_burst.c index 734925e40d..59a22a67b2 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg.c index b112e09846..d8e03e2b9c 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg_burst.c index 8a85a33317..ef617e9076 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_48_63_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79.c b/drivers/event/cnxk/deq/cn10k/deq_64_79.c index e13fdc3456..b429886634 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79_burst.c b/drivers/event/cnxk/deq/cn10k/deq_64_79_burst.c index 225c2c325a..4ffd0dfdbd 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79_seg.c b/drivers/event/cnxk/deq/cn10k/deq_64_79_seg.c index 610bff2f1b..6c01a9cce1 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_64_79_seg_burst.c index 2dd3cce7e2..2917c769ee 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo.c index f57700b740..3b08f65652 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_burst.c index 9388d36620..c3cf58d0d6 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg.c index 7d0eeb7bb9..d3dad21179 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg_burst.c index 03b6898f5d..56fc8e18cc 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_64_79_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95.c b/drivers/event/cnxk/deq/cn10k/deq_80_95.c index 6f678aa8f1..22333b5928 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95_burst.c b/drivers/event/cnxk/deq/cn10k/deq_80_95_burst.c index 49ad628924..1cd1e6efd9 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95_seg.c b/drivers/event/cnxk/deq/cn10k/deq_80_95_seg.c index 9ea971438d..9c0cdce7b8 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_80_95_seg_burst.c index 549808ac8e..261f58c93e 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo.c index 499dbe54de..31c18af76a 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_burst.c index f385950b06..0a60982260 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg.c index 379eb7bf8c..3a7e93ff4c 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg_burst.c index 8e43cae326..d35ac9dc36 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_80_95_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111.c b/drivers/event/cnxk/deq/cn10k/deq_96_111.c index dc45350973..4478d0475d 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ(cn10k_sso_hws_deq_##name, flags) \ SSO_DEQ(cn10k_sso_hws_reas_deq_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111_burst.c b/drivers/event/cnxk/deq/cn10k/deq_96_111_burst.c index c14d4da750..d331a6ea0b 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ cn10k_sso_hws_deq_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111_seg.c b/drivers/event/cnxk/deq/cn10k/deq_96_111_seg.c index c10fbb5f46..be97fbcf60 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) \ SSO_DEQ_SEG(cn10k_sso_hws_reas_deq_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_96_111_seg_burst.c index 5d8febc64e..71f5fcc835 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ cn10k_sso_hws_deq_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo.c index 37f4f0cc74..cb90b5c31a 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) \ SSO_DEQ_TMO(cn10k_sso_hws_reas_deq_tmo_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_burst.c index 84760d1e00..026968c05b 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ cn10k_sso_hws_deq_tmo_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg.c index 8fe43b44d0..9a3d09fae7 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) \ SSO_DEQ_TMO_SEG(cn10k_sso_hws_reas_deq_tmo_seg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg_burst.c index 1a440456f3..ef93b4f2ce 100644 --- a/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn10k/deq_96_111_tmo_seg_burst.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ cn10k_sso_hws_deq_tmo_seg_##name, flags) \ @@ -16,3 +18,5 @@ NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn10k/deq_all_offload.c b/drivers/event/cnxk/deq/cn10k/deq_all_offload.c new file mode 100644 index 0000000000..1d0ad548a6 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_all_offload.c @@ -0,0 +1,77 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn10k_worker.h" + +#ifdef _ROC_API_H_ +#error "roc_api.h is included" +#endif + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_hot +cn10k_sso_hws_deq_all_offload(void *port, struct rte_event *ev, uint64_t timeout_ticks) +{ + const uint32_t flags = (NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | + NIX_RX_OFFLOAD_CHECKSUM_F | NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | + NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F | NIX_RX_REAS_F); + struct cn10k_sso_hws *ws = port; + uint16_t ret = 1; + uint64_t iter; + + if (ws->swtag_req) { + ws->swtag_req = 0; + ws->gw_rdata = cnxk_sso_hws_swtag_wait(ws->base + SSOW_LF_GWS_WQE0); + return ret; + } + + ret = cn10k_sso_hws_get_work(ws, ev, flags); + for (iter = 1; iter < timeout_ticks && (ret == 0); iter++) + ret = cn10k_sso_hws_get_work(ws, ev, flags); + + return ret; +} + +uint16_t __rte_hot +cn10k_sso_hws_deq_all_offload_tst(void *port, struct rte_event *ev, uint64_t timeout_ticks) +{ + const uint32_t flags = (NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | + NIX_RX_OFFLOAD_CHECKSUM_F | NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_TSTAMP_F | NIX_RX_OFFLOAD_VLAN_STRIP_F | + NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F | NIX_RX_REAS_F); + struct cn10k_sso_hws *ws = port; + uint16_t ret = 1; + uint64_t iter; + + if (ws->swtag_req) { + ws->swtag_req = 0; + ws->gw_rdata = cnxk_sso_hws_swtag_wait(ws->base + SSOW_LF_GWS_WQE0); + return ret; + } + + ret = cn10k_sso_hws_get_work(ws, ev, flags); + for (iter = 1; iter < timeout_ticks && (ret == 0); iter++) + ret = cn10k_sso_hws_get_work(ws, ev, flags); + + return ret; +} + +uint16_t __rte_hot +cn10k_sso_hws_deq_burst_all_offload(void *port, struct rte_event ev[], uint16_t nb_events, + uint64_t timeout_ticks) +{ + RTE_SET_USED(nb_events); + return cn10k_sso_hws_deq_all_offload(port, ev, timeout_ticks); +} + +uint16_t __rte_hot +cn10k_sso_hws_deq_burst_all_offload_tst(void *port, struct rte_event ev[], uint16_t nb_events, + uint64_t timeout_ticks) +{ + RTE_SET_USED(nb_events); + return cn10k_sso_hws_deq_all_offload_tst(port, ev, timeout_ticks); +} + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15.c b/drivers/event/cnxk/deq/cn9k/deq_0_15.c index 446f562805..8254fad3a2 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_burst.c index 6796c8ffff..3d5bd04999 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual.c index d00aa0ea20..91a69ea0d7 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_burst.c index ef24b9ef10..b2a0759ea5 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg.c index d2e3c759af..8a1dfceb14 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg_burst.c index 9c7fdc927b..c6b6043fd0 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo.c index f1015011a8..6028dd679a 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_burst.c index e5c0ffbc6d..e613f29eb0 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg.c index 67d5380706..55405b0f7b 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg_burst.c index 1121e9f1db..8c93903291 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_seg.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_seg.c index b0d4e1eba3..5d01377d77 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_seg_burst.c index 931e980572..f770176c06 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo.c index df9b1e63a4..b7d566f2f1 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_burst.c index 30ba882c71..0b5ed0ef9a 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg.c index badc8346e9..ea83fe83d4 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg_burst.c index c79a159b01..531bb9a80f 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_0_15_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127.c b/drivers/event/cnxk/deq/cn9k/deq_112_127.c index f8ee78dc51..63d06f41cb 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_burst.c index e59cf0654a..a352f1ea20 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual.c index c2a0409dc1..766c02df2a 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_burst.c index be81ac1fbe..85a20f955f 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg.c index 493ae28313..f452db50c1 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg_burst.c index a447c39a8f..69555ec5ae 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo.c index 9b2841c723..0b549f5214 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_burst.c index d3527e6e00..9a6558d8a4 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg.c index 9da34219ff..9dd678843f 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg_burst.c index 91a4caec98..2e2e29b80c 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_seg.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_seg.c index 53ab547538..090730be2e 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_seg_burst.c index 05513281f3..9089fc0a92 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo.c index 3e4a898886..7796446dc5 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_burst.c index f4da1c8138..24318eae5a 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg.c index 524e10544c..125d27f098 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg_burst.c index 4e26e8364f..e1b5888410 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_112_127_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31.c b/drivers/event/cnxk/deq/cn9k/deq_16_31.c index 7db3de6c8f..be209d9e09 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_burst.c index 4a0be77703..61603d3181 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual.c index bd911ee843..c214893f2d 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_burst.c index 8d02245b23..0e1bca172d 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg.c index 5d11d2a40c..bd1ce1a7fa 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg_burst.c index cfbb722527..24246a4be2 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo.c index aa03e2bb74..0c163186da 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_burst.c index 13728f4d69..f3f83f7deb 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg.c index 7cb9256b70..542dc51e11 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg_burst.c index 0443303ee2..4889ad2d3b 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_seg.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_seg.c index 43aa9cd9bf..86302a6a12 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_seg_burst.c index aba167e0fa..c7d49c8ad5 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo.c index 3169b29beb..c3018902fd 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_burst.c index 512e6f32d9..e9d83fe1f2 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg.c index eb87736337..2518dffe50 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg_burst.c index b04c5fc242..7a2774fac3 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_16_31_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47.c b/drivers/event/cnxk/deq/cn9k/deq_32_47.c index 8d0970e389..1167097c6c 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_burst.c index 022eeee9bc..76cbc2acdf 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual.c index 1278f26742..d51fdd88b5 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_burst.c index 241e5290fb..30d2ec8bc1 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg.c index a1f2b69005..f465582540 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg_burst.c index e9ae964fa9..a8c5fbeabc 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo.c index fcbace5425..6afdcc26a0 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_burst.c index 1db4980cb0..b72bccfb45 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg.c index 57e29d3bb9..016f410e48 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg_burst.c index 74b408da71..0147ddd7fe 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_seg.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_seg.c index fb260d1ec4..c00a5749cc 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_seg_burst.c index 07db4f0791..a993fd2ecc 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo.c index 7ad22d5b81..5345264883 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_burst.c index 5a5006cf88..6b9fa1559c 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg.c index e7e5c71bb8..94c7b08638 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg_burst.c index fdc438d6f2..652b2182f1 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_32_47_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63.c b/drivers/event/cnxk/deq/cn9k/deq_48_63.c index a70c7916f7..6e2e6e49cc 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_burst.c index 598153cd02..5f0c68281d 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual.c index 8b5e9c0802..cdc1defebf 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_burst.c index 7faef8f320..ac22146e3b 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg.c index 98d74018de..49efa68b16 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg_burst.c index d883dced4d..c7d74d2f42 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo.c index d304d9a4aa..bd31462d96 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_burst.c index 44fa135323..7c13d53680 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg.c index 3f763196d4..cd047f48e5 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg_burst.c index bd73141256..842d69ce7c 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_seg.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_seg.c index 7c8b92c24a..b485d2163e 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_seg_burst.c index ce4102bfa7..b38526f71e 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo.c index 340f19701f..10de29e85d 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_burst.c index 6e60f9bf70..195d8b9e5d 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg.c index c64a4f88f6..b553d2dc53 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg_burst.c index 1b55c9b067..e3e80be9d9 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_48_63_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79.c b/drivers/event/cnxk/deq/cn9k/deq_64_79.c index b6068d3d38..169c4244d9 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_burst.c index d0d8c3ffcd..a49d0f0bc8 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual.c index 9b4f38e0db..4f1c6624ed 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_burst.c index 4f06f7b533..7a2dcb86c8 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg.c index fc6d2e1c1a..b5382fc908 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg_burst.c index f771465935..10aafd3a59 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo.c index 19d6c29b47..68aeb1b0d5 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_burst.c index 7b9eac1dee..d406fb2207 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg.c index 16325f9ad6..763568e25a 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg_burst.c index 1d1e7368f9..bed8e10b12 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_seg.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_seg.c index 7722f3d6e4..98d7a31a4a 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_seg_burst.c index fcfcdc019c..f07f03941d 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo.c index f1e2d3ffb9..b79dc6a7c1 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_burst.c index e9d65ce2df..ca2c48fd11 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg.c index be0bee1f95..92c9400d91 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg_burst.c index 705061eeb3..b57b5c46ca 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_64_79_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95.c b/drivers/event/cnxk/deq/cn9k/deq_80_95.c index 54a909009b..64000836c2 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_burst.c index 3d3a862d9f..785892c848 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual.c index b045d3d618..c69d2f4100 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_burst.c index 99144b2988..801eb3dae6 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg.c index 063d0db0a7..f232d36778 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg_burst.c index bb69ecb328..8f384991a8 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo.c index f33a7f2400..948695fcf8 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_burst.c index 5ed3a1e18b..124c2c19fb 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg.c index 5d37375cc7..d3055e348b 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg_burst.c index 7370a77ff2..02c80e5a84 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_seg.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_seg.c index 7642fef84b..76bef5e3a8 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_seg_burst.c index eb8c5af468..3cc764195b 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo.c index 378171adb2..0c1bc7bf42 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_burst.c index 330f9c8948..d3003b13c2 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg.c index 2755e56396..2a8f42af79 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg_burst.c index 8fb83d5202..97dc7557e9 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_80_95_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111.c b/drivers/event/cnxk/deq/cn9k/deq_96_111.c index f5688cefce..a2eed2643b 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ(cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_burst.c index 8fcb39d31e..134b8b09b6 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_burst_##name, \ cn9k_sso_hws_deq_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual.c index 06a84f8b04..706ecee7e8 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ(cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_burst.c index 66de5feaf8..0b91af8c86 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_burst_##name, \ cn9k_sso_hws_dual_deq_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg.c index 007724706f..f9c71d52b0 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_SEG(cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg_burst.c index ba77a8f783..4dbdbb5946 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_dual_deq_seg_burst_##name, \ cn9k_sso_hws_dual_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo.c index 17c53e06f0..0b5eb0fbf8 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DUAL_DEQ_TMO(cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_burst.c index 331d55515f..d62e14adb9 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg.c index 990e0620ba..8bb6ff5e93 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg.c @@ -6,8 +6,12 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_DUAL_DEQ_TMO_SEG(cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg_burst.c index 162fc48965..54eca8d2d1 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_dual_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_dual_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_dual_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_seg.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_seg.c index 124b96d81a..ac293a5f5d 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_SEG(cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_seg_burst.c index 129d7ac91f..9be36c1686 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_SEG_BURST(cn9k_sso_hws_deq_seg_burst_##name, \ cn9k_sso_hws_deq_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo.c index 0a61b4eb2a..20965f3d3f 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO(cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_burst.c index 30124e86bb..bbc35901e3 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_burst_##name, \ cn9k_sso_hws_deq_tmo_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg.c index a3cc1dcc99..4fe1e582ff 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg.c @@ -6,7 +6,11 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) SSO_DEQ_TMO_SEG(cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg_burst.c index 3ad0aaf80e..e18f977e05 100644 --- a/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg_burst.c +++ b/drivers/event/cnxk/deq/cn9k/deq_96_111_tmo_seg_burst.c @@ -6,9 +6,13 @@ #include "cnxk_eventdev.h" #include "cnxk_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ SSO_CMN_DEQ_BURST(cn9k_sso_hws_deq_tmo_seg_burst_##name, \ cn9k_sso_hws_deq_tmo_seg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/event/cnxk/deq/cn9k/deq_all_offload.c b/drivers/event/cnxk/deq/cn9k/deq_all_offload.c new file mode 100644 index 0000000000..f8288fbb4e --- /dev/null +++ b/drivers/event/cnxk/deq/cn9k/deq_all_offload.c @@ -0,0 +1,139 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn9k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_hot +cn9k_sso_hws_deq_all_offload(void *port, struct rte_event *ev, uint64_t timeout_ticks) +{ + const uint32_t flags = + (NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F); + + struct cn9k_sso_hws *ws = port; + uint16_t ret = 1; + uint64_t iter; + if (ws->swtag_req) { + ws->swtag_req = 0; + cnxk_sso_hws_swtag_wait(ws->base + SSOW_LF_GWS_TAG); + return ret; + } + ret = cn9k_sso_hws_get_work(ws, ev, flags, ws->lookup_mem); + for (iter = 1; iter < timeout_ticks && (ret == 0); iter++) + ret = cn9k_sso_hws_get_work(ws, ev, flags, ws->lookup_mem); + return ret; +} + +uint16_t __rte_hot +cn9k_sso_hws_deq_dual_all_offload(void *port, struct rte_event *ev, uint64_t timeout_ticks) +{ + const uint32_t flags = + (NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F); + struct cn9k_sso_hws_dual *dws = port; + uint16_t ret = 1; + uint64_t iter; + + if (dws->swtag_req) { + dws->swtag_req = 0; + cnxk_sso_hws_swtag_wait(dws->base[!dws->vws] + SSOW_LF_GWS_TAG); + return ret; + } + ret = cn9k_sso_hws_dual_get_work(dws->base[dws->vws], dws->base[!dws->vws], ev, flags, dws); + dws->vws = !dws->vws; + for (iter = 1; iter < timeout_ticks && (ret == 0); iter++) { + ret = cn9k_sso_hws_dual_get_work(dws->base[dws->vws], dws->base[!dws->vws], ev, + flags, dws); + dws->vws = !dws->vws; + } + return ret; +} + +uint16_t __rte_hot +cn9k_sso_hws_deq_all_offload_tst(void *port, struct rte_event *ev, uint64_t timeout_ticks) +{ + const uint32_t flags = + (NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | NIX_RX_OFFLOAD_TSTAMP_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F); + + struct cn9k_sso_hws *ws = port; + uint16_t ret = 1; + uint64_t iter; + if (ws->swtag_req) { + ws->swtag_req = 0; + cnxk_sso_hws_swtag_wait(ws->base + SSOW_LF_GWS_TAG); + return ret; + } + ret = cn9k_sso_hws_get_work(ws, ev, flags, ws->lookup_mem); + for (iter = 1; iter < timeout_ticks && (ret == 0); iter++) + ret = cn9k_sso_hws_get_work(ws, ev, flags, ws->lookup_mem); + return ret; +} + +uint16_t __rte_hot +cn9k_sso_hws_deq_dual_all_offload_tst(void *port, struct rte_event *ev, uint64_t timeout_ticks) +{ + const uint32_t flags = + (NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | NIX_RX_OFFLOAD_TSTAMP_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F); + struct cn9k_sso_hws_dual *dws = port; + uint16_t ret = 1; + uint64_t iter; + + if (dws->swtag_req) { + dws->swtag_req = 0; + cnxk_sso_hws_swtag_wait(dws->base[!dws->vws] + SSOW_LF_GWS_TAG); + return ret; + } + ret = cn9k_sso_hws_dual_get_work(dws->base[dws->vws], dws->base[!dws->vws], ev, flags, dws); + dws->vws = !dws->vws; + for (iter = 1; iter < timeout_ticks && (ret == 0); iter++) { + ret = cn9k_sso_hws_dual_get_work(dws->base[dws->vws], dws->base[!dws->vws], ev, + flags, dws); + dws->vws = !dws->vws; + } + return ret; +} + +uint16_t __rte_hot +cn9k_sso_hws_deq_burst_all_offload(void *port, struct rte_event ev[], uint16_t nb_events, + uint64_t timeout_ticks) +{ + RTE_SET_USED(nb_events); + return cn9k_sso_hws_deq_all_offload(port, ev, timeout_ticks); +} + +uint16_t __rte_hot +cn9k_sso_hws_deq_dual_burst_all_offload(void *port, struct rte_event ev[], uint16_t nb_events, + uint64_t timeout_ticks) +{ + RTE_SET_USED(nb_events); + return cn9k_sso_hws_deq_dual_all_offload(port, ev, timeout_ticks); +} + +uint16_t __rte_hot +cn9k_sso_hws_deq_burst_all_offload_tst(void *port, struct rte_event ev[], uint16_t nb_events, + uint64_t timeout_ticks) +{ + RTE_SET_USED(nb_events); + return cn9k_sso_hws_deq_all_offload_tst(port, ev, timeout_ticks); +} + +uint16_t __rte_hot +cn9k_sso_hws_deq_dual_burst_all_offload_tst(void *port, struct rte_event ev[], uint16_t nb_events, + uint64_t timeout_ticks) +{ + RTE_SET_USED(nb_events); + return cn9k_sso_hws_deq_dual_all_offload_tst(port, ev, timeout_ticks); +} + +#endif diff --git a/drivers/event/cnxk/meson.build b/drivers/event/cnxk/meson.build index 2a30b97bff..e0e350570d 100644 --- a/drivers/event/cnxk/meson.build +++ b/drivers/event/cnxk/meson.build @@ -28,13 +28,20 @@ sources = files( 'cnxk_tim_worker.c', ) +disable_template = false +if meson.version().version_compare('>=1.1.0') + if '-DCNXK_DIS_TMPLT_FUNC' in meson.build_options() + disable_template = true + endif +endif + if soc_type == 'cn9k' or soc_type == 'all' sources += files( 'cn9k_eventdev.c', 'cn9k_worker.c', ) -if host_machine.cpu_family().startswith('aarch') +if host_machine.cpu_family().startswith('aarch') and not disable_template sources += files( 'deq/cn9k/deq_0_15_burst.c', 'deq/cn9k/deq_16_31_burst.c', @@ -167,6 +174,7 @@ sources += files( 'deq/cn9k/deq_80_95_dual_tmo_seg_burst.c', 'deq/cn9k/deq_96_111_dual_tmo_seg_burst.c', 'deq/cn9k/deq_112_127_dual_tmo_seg_burst.c', + 'deq/cn9k/deq_all_offload.c', ) sources += files( @@ -205,6 +213,12 @@ sources += files( 'tx/cn9k/tx_80_95_dual_seg.c', 'tx/cn9k/tx_96_111_dual_seg.c', 'tx/cn9k/tx_112_127_dual_seg.c', + 'tx/cn9k/tx_all_offload.c', +) +else +sources += files( + 'deq/cn9k/deq_all_offload.c', + 'tx/cn9k/tx_all_offload.c', ) endif endif @@ -215,7 +229,7 @@ sources += files( 'cn10k_worker.c', ) -if host_machine.cpu_family().startswith('aarch') +if host_machine.cpu_family().startswith('aarch') and not disable_template sources += files( 'deq/cn10k/deq_0_15_burst.c', 'deq/cn10k/deq_16_31_burst.c', @@ -281,6 +295,7 @@ sources += files( 'deq/cn10k/deq_80_95_tmo_seg_burst.c', 'deq/cn10k/deq_96_111_tmo_seg_burst.c', 'deq/cn10k/deq_112_127_tmo_seg_burst.c', + 'deq/cn10k/deq_all_offload.c', ) sources += files( @@ -300,6 +315,12 @@ sources += files( 'tx/cn10k/tx_80_95_seg.c', 'tx/cn10k/tx_96_111_seg.c', 'tx/cn10k/tx_112_127_seg.c', + 'tx/cn10k/tx_all_offload.c', +) +else +sources += files( + 'deq/cn10k/deq_all_offload.c', + 'tx/cn10k/tx_all_offload.c', ) endif endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_0_15.c b/drivers/event/cnxk/tx/cn10k/tx_0_15.c index 4e5322ba6d..d0f8bc49c7 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_0_15.c +++ b/drivers/event/cnxk/tx/cn10k/tx_0_15.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c b/drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c index 912c64d819..da1aebc1ba 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_112_127.c b/drivers/event/cnxk/tx/cn10k/tx_112_127.c index 4ba0b7f802..982c364713 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_112_127.c +++ b/drivers/event/cnxk/tx/cn10k/tx_112_127.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c b/drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c index 6be641113e..4384e365f6 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_16_31.c b/drivers/event/cnxk/tx/cn10k/tx_16_31.c index 673d2d9d22..c7aeff732a 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_16_31.c +++ b/drivers/event/cnxk/tx/cn10k/tx_16_31.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c b/drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c index b7512e2eb1..795e7a012a 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_32_47.c b/drivers/event/cnxk/tx/cn10k/tx_32_47.c index 25a92c114e..789932c04d 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_32_47.c +++ b/drivers/event/cnxk/tx/cn10k/tx_32_47.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c b/drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c index 495c335183..9a484f0a78 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_48_63.c b/drivers/event/cnxk/tx/cn10k/tx_48_63.c index e2762e87d8..53ee9f8d19 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_48_63.c +++ b/drivers/event/cnxk/tx/cn10k/tx_48_63.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c b/drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c index c3d898fcae..d9629c15a7 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_64_79.c b/drivers/event/cnxk/tx/cn10k/tx_64_79.c index d9b7f2167f..af548ffe22 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_64_79.c +++ b/drivers/event/cnxk/tx/cn10k/tx_64_79.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c b/drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c index 3a28e0eee7..75b19de75b 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_80_95.c b/drivers/event/cnxk/tx/cn10k/tx_80_95.c index a95b00d270..5b9305047c 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_80_95.c +++ b/drivers/event/cnxk/tx/cn10k/tx_80_95.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c b/drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c index f0264ee701..b9edf97f47 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_96_111.c b/drivers/event/cnxk/tx/cn10k/tx_96_111.c index 519ec1623f..d992d9be5a 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_96_111.c +++ b/drivers/event/cnxk/tx/cn10k/tx_96_111.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c b/drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c index 1e6383fdf7..8d318acb5a 100644 --- a/drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c +++ b/drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn10k/tx_all_offload.c b/drivers/event/cnxk/tx/cn10k/tx_all_offload.c new file mode 100644 index 0000000000..77a98c00d1 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_all_offload.c @@ -0,0 +1,27 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn10k_tx_worker.h" + +#ifdef _ROC_API_H_ +#error "roc_api.h is included" +#endif + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_hot +cn10k_sso_hws_tx_adptr_enq_seg_all_offload(void *port, struct rte_event ev[], uint16_t nb_events) +{ + const uint32_t flags = + (NIX_TX_OFFLOAD_L3_L4_CSUM_F | NIX_TX_OFFLOAD_OL3_OL4_CSUM_F | + NIX_TX_OFFLOAD_VLAN_QINQ_F | NIX_TX_OFFLOAD_MBUF_NOFF_F | NIX_TX_OFFLOAD_TSO_F | + NIX_TX_OFFLOAD_TSTAMP_F | NIX_TX_OFFLOAD_SECURITY_F | NIX_TX_MULTI_SEG_F); + uint64_t cmd[8 + CNXK_NIX_TX_MSEG_SG_DWORDS - 2]; + + struct cn10k_sso_hws *ws = port; + RTE_SET_USED(nb_events); + return cn10k_sso_hws_event_tx(ws, &ev[0], cmd, (const uint64_t *)ws->tx_adptr_data, flags); +} + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_0_15.c b/drivers/event/cnxk/tx/cn9k/tx_0_15.c index 085901ee55..5a2bf4ed16 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_0_15.c +++ b/drivers/event/cnxk/tx/cn9k/tx_0_15.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_0_15_dual.c b/drivers/event/cnxk/tx/cn9k/tx_0_15_dual.c index 19514256e0..55792a11cf 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_0_15_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_0_15_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_0_15_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_0_15_dual_seg.c index ed8c2e2b28..fcd6ce3f6f 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_0_15_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_0_15_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_0_15_seg.c b/drivers/event/cnxk/tx/cn9k/tx_0_15_seg.c index ca0e4515b2..f42b747cdb 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_0_15_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_0_15_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_112_127.c b/drivers/event/cnxk/tx/cn9k/tx_112_127.c index a46790c9ac..3464ea9be7 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_112_127.c +++ b/drivers/event/cnxk/tx/cn9k/tx_112_127.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_112_127_dual.c b/drivers/event/cnxk/tx/cn9k/tx_112_127_dual.c index 1a8d74a4ff..3f64b87aa2 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_112_127_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_112_127_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_112_127_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_112_127_dual_seg.c index f37db03318..1bfc74d44b 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_112_127_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_112_127_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_112_127_seg.c b/drivers/event/cnxk/tx/cn9k/tx_112_127_seg.c index a52071817f..95d20c7151 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_112_127_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_112_127_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_16_31.c b/drivers/event/cnxk/tx/cn9k/tx_16_31.c index 9165a472e4..6ee62673ed 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_16_31.c +++ b/drivers/event/cnxk/tx/cn9k/tx_16_31.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_16_31_dual.c b/drivers/event/cnxk/tx/cn9k/tx_16_31_dual.c index 20356577c7..2963d59cfa 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_16_31_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_16_31_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_16_31_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_16_31_dual_seg.c index c23abf103f..fd0a981b14 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_16_31_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_16_31_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_16_31_seg.c b/drivers/event/cnxk/tx/cn9k/tx_16_31_seg.c index ceea07eb47..f7f02b54b1 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_16_31_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_16_31_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_32_47.c b/drivers/event/cnxk/tx/cn9k/tx_32_47.c index f44215bc0f..e76a663e86 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_32_47.c +++ b/drivers/event/cnxk/tx/cn9k/tx_32_47.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_32_47_dual.c b/drivers/event/cnxk/tx/cn9k/tx_32_47_dual.c index 6b57b6f307..6add7cb986 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_32_47_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_32_47_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_32_47_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_32_47_dual_seg.c index a5ac3b05ac..a0022c3b15 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_32_47_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_32_47_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_32_47_seg.c b/drivers/event/cnxk/tx/cn9k/tx_32_47_seg.c index 19693816d9..5aa3878ef6 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_32_47_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_32_47_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_48_63.c b/drivers/event/cnxk/tx/cn9k/tx_48_63.c index 10efcb8190..d6b6e4babf 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_48_63.c +++ b/drivers/event/cnxk/tx/cn9k/tx_48_63.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_48_63_dual.c b/drivers/event/cnxk/tx/cn9k/tx_48_63_dual.c index 9fc4cffc33..8231f8f778 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_48_63_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_48_63_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_48_63_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_48_63_dual_seg.c index 885115ada4..17e46158e6 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_48_63_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_48_63_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_48_63_seg.c b/drivers/event/cnxk/tx/cn9k/tx_48_63_seg.c index 5a2a11c985..525406746a 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_48_63_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_48_63_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_64_79.c b/drivers/event/cnxk/tx/cn9k/tx_64_79.c index 2820c01350..8613044e5e 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_64_79.c +++ b/drivers/event/cnxk/tx/cn9k/tx_64_79.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_64_79_dual.c b/drivers/event/cnxk/tx/cn9k/tx_64_79_dual.c index b07b8b15d1..c02f4d46cf 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_64_79_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_64_79_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_64_79_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_64_79_dual_seg.c index 520c400543..ebd0ce0f48 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_64_79_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_64_79_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_64_79_seg.c b/drivers/event/cnxk/tx/cn9k/tx_64_79_seg.c index 1360418e76..127c655f62 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_64_79_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_64_79_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_80_95.c b/drivers/event/cnxk/tx/cn9k/tx_80_95.c index 34f747f254..aa008a4a86 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_80_95.c +++ b/drivers/event/cnxk/tx/cn9k/tx_80_95.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_80_95_dual.c b/drivers/event/cnxk/tx/cn9k/tx_80_95_dual.c index babd25d698..2fa5360cc9 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_80_95_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_80_95_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_80_95_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_80_95_dual_seg.c index da9348008e..f3fa95c35c 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_80_95_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_80_95_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_80_95_seg.c b/drivers/event/cnxk/tx/cn9k/tx_80_95_seg.c index 7c31a9d6f5..d99068c121 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_80_95_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_80_95_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_96_111.c b/drivers/event/cnxk/tx/cn9k/tx_96_111.c index 97f5630ba5..4dc1d55a8b 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_96_111.c +++ b/drivers/event/cnxk/tx/cn9k/tx_96_111.c @@ -4,7 +4,11 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) SSO_TX(cn9k_sso_hws_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_96_111_dual.c b/drivers/event/cnxk/tx/cn9k/tx_96_111_dual.c index ed3ec15fdd..bcd9cc3147 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_96_111_dual.c +++ b/drivers/event/cnxk/tx/cn9k/tx_96_111_dual.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX(cn9k_sso_hws_dual_tx_adptr_enq_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_96_111_dual_seg.c b/drivers/event/cnxk/tx/cn9k/tx_96_111_dual_seg.c index c284247703..b67b5dde62 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_96_111_dual_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_96_111_dual_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_DUAL_TX_SEG(cn9k_sso_hws_dual_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_96_111_seg.c b/drivers/event/cnxk/tx/cn9k/tx_96_111_seg.c index 640bee0a00..4af915320e 100644 --- a/drivers/event/cnxk/tx/cn9k/tx_96_111_seg.c +++ b/drivers/event/cnxk/tx/cn9k/tx_96_111_seg.c @@ -4,8 +4,12 @@ #include "cn9k_worker.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ SSO_TX_SEG(cn9k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/event/cnxk/tx/cn9k/tx_all_offload.c b/drivers/event/cnxk/tx/cn9k/tx_all_offload.c new file mode 100644 index 0000000000..d715dccd86 --- /dev/null +++ b/drivers/event/cnxk/tx/cn9k/tx_all_offload.c @@ -0,0 +1,39 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn9k_worker.h" + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_hot +cn9k_sso_hws_tx_adptr_enq_seg_all_offload(void *port, struct rte_event ev[], uint16_t nb_events) +{ + const uint32_t flags = + (NIX_TX_OFFLOAD_L3_L4_CSUM_F | NIX_TX_OFFLOAD_OL3_OL4_CSUM_F | + NIX_TX_OFFLOAD_VLAN_QINQ_F | NIX_TX_OFFLOAD_MBUF_NOFF_F | NIX_TX_OFFLOAD_TSO_F | + NIX_TX_OFFLOAD_TSTAMP_F | NIX_TX_OFFLOAD_SECURITY_F | NIX_TX_MULTI_SEG_F); + uint64_t cmd[8 + CNXK_NIX_TX_MSEG_SG_DWORDS - 2]; + struct cn9k_sso_hws *ws = port; + + RTE_SET_USED(nb_events); + return cn9k_sso_hws_event_tx(ws->base, &ev[0], cmd, (uint64_t *)ws->tx_adptr_data, flags); +} + +uint16_t __rte_hot +cn9k_sso_hws_tx_adptr_enq_dual_seg_all_offload(void *port, struct rte_event ev[], + uint16_t nb_events) +{ + const uint32_t flags = + (NIX_TX_OFFLOAD_L3_L4_CSUM_F | NIX_TX_OFFLOAD_OL3_OL4_CSUM_F | + NIX_TX_OFFLOAD_VLAN_QINQ_F | NIX_TX_OFFLOAD_MBUF_NOFF_F | NIX_TX_OFFLOAD_TSO_F | + NIX_TX_OFFLOAD_TSTAMP_F | NIX_TX_OFFLOAD_SECURITY_F | NIX_TX_MULTI_SEG_F); + uint64_t cmd[8 + CNXK_NIX_TX_MSEG_SG_DWORDS - 2]; + struct cn9k_sso_hws_dual *ws = port; + + RTE_SET_USED(nb_events); + return cn9k_sso_hws_event_tx(ws->base[!ws->vws], &ev[0], cmd, (uint64_t *)ws->tx_adptr_data, + flags); +} + +#endif diff --git a/drivers/net/cnxk/cn10k_rx.h b/drivers/net/cnxk/cn10k_rx.h index 89621af3fb..9dde2bea57 100644 --- a/drivers/net/cnxk/cn10k_rx.h +++ b/drivers/net/cnxk/cn10k_rx.h @@ -2563,4 +2563,20 @@ NIX_RX_FASTPATH_MODES #define NIX_RX_RECV_VEC_MSEG(fn, flags) \ NIX_RX_RECV_VEC(fn, flags | NIX_RX_MULTI_SEG_F) +uint16_t __rte_noinline __rte_hot cn10k_nix_recv_pkts_all_offload(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn10k_nix_recv_pkts_vec_all_offload(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn10k_nix_recv_pkts_all_offload_tst(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn10k_nix_recv_pkts_vec_all_offload_tst(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + #endif /* __CN10K_RX_H__ */ diff --git a/drivers/net/cnxk/cn10k_rx_select.c b/drivers/net/cnxk/cn10k_rx_select.c index 6a5c34287e..fe1f0dda73 100644 --- a/drivers/net/cnxk/cn10k_rx_select.c +++ b/drivers/net/cnxk/cn10k_rx_select.c @@ -19,7 +19,7 @@ pick_rx_func(struct rte_eth_dev *eth_dev, rte_eth_fp_ops[eth_dev->data->port_id].rx_pkt_burst = eth_dev->rx_pkt_burst; - rte_atomic_thread_fence(__ATOMIC_RELEASE); + rte_atomic_thread_fence(rte_memory_order_release); } static uint16_t __rte_noinline __rte_hot __rte_unused @@ -29,10 +29,11 @@ cn10k_nix_flush_rx(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) return cn10k_nix_flush_recv_pkts(rx_queue, rx_pkts, pkts, flags); } -void -cn10k_eth_set_rx_function(struct rte_eth_dev *eth_dev) -{ #if defined(RTE_ARCH_ARM64) +static void +cn10k_eth_set_rx_tmplt_func(struct rte_eth_dev *eth_dev) +{ +#if !defined(CNXK_DIS_TMPLT_FUNC) struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); const eth_rx_burst_t nix_eth_rx_burst[NIX_RX_OFFLOAD_MAX] = { @@ -122,3 +123,44 @@ cn10k_eth_set_rx_function(struct rte_eth_dev *eth_dev) RTE_SET_USED(eth_dev); #endif } + +static void +cn10k_eth_set_rx_blk_func(struct rte_eth_dev *eth_dev) +{ +#if defined(CNXK_DIS_TMPLT_FUNC) + struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); + + /* Copy multi seg version with security for tear down sequence */ + if (rte_eal_process_type() == RTE_PROC_PRIMARY) + dev->rx_pkt_burst_no_offload = cn10k_nix_flush_rx; + + if (dev->scalar_ena) { + eth_dev->rx_pkt_burst = cn10k_nix_recv_pkts_all_offload; + if (dev->rx_offloads & RTE_ETH_RX_OFFLOAD_TIMESTAMP) + eth_dev->rx_pkt_burst = cn10k_nix_recv_pkts_all_offload_tst; + } else { + eth_dev->rx_pkt_burst = cn10k_nix_recv_pkts_vec_all_offload; + if (dev->rx_offloads & RTE_ETH_RX_OFFLOAD_TIMESTAMP) + eth_dev->rx_pkt_burst = cn10k_nix_recv_pkts_vec_all_offload_tst; + } + + if (eth_dev->data->dev_started) + rte_eth_fp_ops[eth_dev->data->port_id].rx_pkt_burst = eth_dev->rx_pkt_burst; +#else + RTE_SET_USED(eth_dev); +#endif +} +#endif + +void +cn10k_eth_set_rx_function(struct rte_eth_dev *eth_dev) +{ +#if defined(RTE_ARCH_ARM64) + cn10k_eth_set_rx_blk_func(eth_dev); + cn10k_eth_set_rx_tmplt_func(eth_dev); + + rte_atomic_thread_fence(rte_memory_order_release); +#else + RTE_SET_USED(eth_dev); +#endif +} diff --git a/drivers/net/cnxk/cn10k_tx.h b/drivers/net/cnxk/cn10k_tx.h index 5c4b9e559e..3818b0445a 100644 --- a/drivers/net/cnxk/cn10k_tx.h +++ b/drivers/net/cnxk/cn10k_tx.h @@ -3618,4 +3618,12 @@ NIX_TX_FASTPATH_MODES (flags) | NIX_TX_MULTI_SEG_F); \ } +uint16_t __rte_noinline __rte_hot cn10k_nix_xmit_pkts_all_offload(void *tx_queue, + struct rte_mbuf **tx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn10k_nix_xmit_pkts_vec_all_offload(void *tx_queue, + struct rte_mbuf **tx_pkts, + uint16_t pkts); + #endif /* __CN10K_TX_H__ */ diff --git a/drivers/net/cnxk/cn10k_tx_select.c b/drivers/net/cnxk/cn10k_tx_select.c index aa0620eec9..62bcd895e1 100644 --- a/drivers/net/cnxk/cn10k_tx_select.c +++ b/drivers/net/cnxk/cn10k_tx_select.c @@ -36,12 +36,11 @@ cn10k_nix_tx_queue_sec_count(void *tx_queue) return cnxk_nix_tx_queue_sec_count(txq->fc_mem, txq->sqes_per_sqb_log2, txq->cpt_fc); } -#endif -void -cn10k_eth_set_tx_function(struct rte_eth_dev *eth_dev) +static void +cn10k_eth_set_tx_tmplt_func(struct rte_eth_dev *eth_dev) { -#if defined(RTE_ARCH_ARM64) +#if !defined(CNXK_DIS_TMPLT_FUNC) struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); const eth_tx_burst_t nix_eth_tx_burst[NIX_TX_OFFLOAD_MAX] = { @@ -81,12 +80,45 @@ cn10k_eth_set_tx_function(struct rte_eth_dev *eth_dev) if (dev->tx_offloads & RTE_ETH_TX_OFFLOAD_MULTI_SEGS) pick_tx_func(eth_dev, nix_eth_tx_vec_burst_mseg); } +#else + RTE_SET_USED(eth_dev); +#endif +} + +static void +cn10k_eth_set_tx_blk_func(struct rte_eth_dev *eth_dev) +{ +#if defined(CNXK_DIS_TMPLT_FUNC) + struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); + + if (dev->scalar_ena || dev->tx_mark) + eth_dev->tx_pkt_burst = cn10k_nix_xmit_pkts_all_offload; + else + eth_dev->tx_pkt_burst = cn10k_nix_xmit_pkts_vec_all_offload; + + if (eth_dev->data->dev_started) + rte_eth_fp_ops[eth_dev->data->port_id].tx_pkt_burst = eth_dev->tx_pkt_burst; +#else + RTE_SET_USED(eth_dev); +#endif +} +#endif + +void +cn10k_eth_set_tx_function(struct rte_eth_dev *eth_dev) +{ +#if defined(RTE_ARCH_ARM64) + struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); + + cn10k_eth_set_tx_blk_func(eth_dev); + cn10k_eth_set_tx_tmplt_func(eth_dev); + if (dev->tx_offloads & RTE_ETH_TX_OFFLOAD_SECURITY) eth_dev->tx_queue_count = cn10k_nix_tx_queue_sec_count; else eth_dev->tx_queue_count = cn10k_nix_tx_queue_count; - rte_mb(); + rte_atomic_thread_fence(rte_memory_order_release); #else RTE_SET_USED(eth_dev); #endif diff --git a/drivers/net/cnxk/cn9k_rx.h b/drivers/net/cnxk/cn9k_rx.h index d8bb65c643..79b56fe160 100644 --- a/drivers/net/cnxk/cn9k_rx.h +++ b/drivers/net/cnxk/cn9k_rx.h @@ -1102,4 +1102,20 @@ NIX_RX_FASTPATH_MODES #define NIX_RX_RECV_VEC_MSEG(fn, flags) \ NIX_RX_RECV_VEC(fn, flags | NIX_RX_MULTI_SEG_F) +uint16_t __rte_noinline __rte_hot cn9k_nix_recv_pkts_all_offload(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn9k_nix_recv_pkts_vec_all_offload(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn9k_nix_recv_pkts_all_offload_tst(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn9k_nix_recv_pkts_vec_all_offload_tst(void *rx_queue, + struct rte_mbuf **rx_pkts, + uint16_t pkts); + #endif /* __CN9K_RX_H__ */ diff --git a/drivers/net/cnxk/cn9k_rx_select.c b/drivers/net/cnxk/cn9k_rx_select.c index 05bc33ce6a..0d4031ddeb 100644 --- a/drivers/net/cnxk/cn9k_rx_select.c +++ b/drivers/net/cnxk/cn9k_rx_select.c @@ -18,14 +18,13 @@ pick_rx_func(struct rte_eth_dev *eth_dev, if (eth_dev->data->dev_started) rte_eth_fp_ops[eth_dev->data->port_id].rx_pkt_burst = eth_dev->rx_pkt_burst; - - rte_atomic_thread_fence(__ATOMIC_RELEASE); } -void -cn9k_eth_set_rx_function(struct rte_eth_dev *eth_dev) -{ #if defined(RTE_ARCH_ARM64) +static void +cn9k_eth_set_rx_tmplt_func(struct rte_eth_dev *eth_dev) +{ +#if !defined(CNXK_DIS_TMPLT_FUNC) struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); const eth_rx_burst_t nix_eth_rx_burst[NIX_RX_OFFLOAD_MAX] = { @@ -73,3 +72,44 @@ cn9k_eth_set_rx_function(struct rte_eth_dev *eth_dev) RTE_SET_USED(eth_dev); #endif } + +static void +cn9k_eth_set_rx_blk_func(struct rte_eth_dev *eth_dev) +{ +#if defined(CNXK_DIS_TMPLT_FUNC) + struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); + + /* Copy multi seg version with no offload for tear down sequence */ + if (rte_eal_process_type() == RTE_PROC_PRIMARY) + dev->rx_pkt_burst_no_offload = cn9k_nix_recv_pkts_all_offload; + + if (dev->scalar_ena) { + eth_dev->rx_pkt_burst = cn9k_nix_recv_pkts_all_offload; + if (dev->rx_offloads & RTE_ETH_RX_OFFLOAD_TIMESTAMP) + eth_dev->rx_pkt_burst = cn9k_nix_recv_pkts_all_offload_tst; + } else { + eth_dev->rx_pkt_burst = cn9k_nix_recv_pkts_vec_all_offload; + if (dev->rx_offloads & RTE_ETH_RX_OFFLOAD_TIMESTAMP) + eth_dev->rx_pkt_burst = cn9k_nix_recv_pkts_vec_all_offload_tst; + } + + if (eth_dev->data->dev_started) + rte_eth_fp_ops[eth_dev->data->port_id].rx_pkt_burst = eth_dev->rx_pkt_burst; +#else + RTE_SET_USED(eth_dev); +#endif +} +#endif + +void +cn9k_eth_set_rx_function(struct rte_eth_dev *eth_dev) +{ +#if defined(RTE_ARCH_ARM64) + cn9k_eth_set_rx_blk_func(eth_dev); + cn9k_eth_set_rx_tmplt_func(eth_dev); + + rte_atomic_thread_fence(rte_memory_order_release); +#else + RTE_SET_USED(eth_dev); +#endif +} diff --git a/drivers/net/cnxk/cn9k_tx.h b/drivers/net/cnxk/cn9k_tx.h index 018fae2eb7..6fc9e4d758 100644 --- a/drivers/net/cnxk/cn9k_tx.h +++ b/drivers/net/cnxk/cn9k_tx.h @@ -2391,4 +2391,12 @@ NIX_TX_FASTPATH_MODES NIX_TX_MULTI_SEG_F); \ } +uint16_t __rte_noinline __rte_hot cn9k_nix_xmit_pkts_all_offload(void *tx_queue, + struct rte_mbuf **tx_pkts, + uint16_t pkts); + +uint16_t __rte_noinline __rte_hot cn9k_nix_xmit_pkts_vec_all_offload(void *tx_queue, + struct rte_mbuf **tx_pkts, + uint16_t pkts); + #endif /* __CN9K_TX_H__ */ diff --git a/drivers/net/cnxk/cn9k_tx_select.c b/drivers/net/cnxk/cn9k_tx_select.c index 5ecf919d7c..3256988f70 100644 --- a/drivers/net/cnxk/cn9k_tx_select.c +++ b/drivers/net/cnxk/cn9k_tx_select.c @@ -36,12 +36,11 @@ cn9k_nix_tx_queue_sec_count(void *tx_queue) return cnxk_nix_tx_queue_sec_count(txq->fc_mem, txq->sqes_per_sqb_log2, txq->cpt_fc); } -#endif -void -cn9k_eth_set_tx_function(struct rte_eth_dev *eth_dev) +static void +cn9k_eth_set_tx_tmplt_func(struct rte_eth_dev *eth_dev) { -#if defined(RTE_ARCH_ARM64) +#if !defined(CNXK_DIS_TMPLT_FUNC) struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); const eth_tx_burst_t nix_eth_tx_burst[NIX_TX_OFFLOAD_MAX] = { @@ -77,13 +76,45 @@ cn9k_eth_set_tx_function(struct rte_eth_dev *eth_dev) if (dev->tx_offloads & RTE_ETH_TX_OFFLOAD_MULTI_SEGS) pick_tx_func(eth_dev, nix_eth_tx_vec_burst_mseg); } +#else + RTE_SET_USED(eth_dev); +#endif +} + +static void +cn9k_eth_set_tx_blk_func(struct rte_eth_dev *eth_dev) +{ +#if defined(CNXK_DIS_TMPLT_FUNC) + struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); + + if (dev->scalar_ena || dev->tx_mark) + eth_dev->tx_pkt_burst = cn9k_nix_xmit_pkts_all_offload; + else + eth_dev->tx_pkt_burst = cn9k_nix_xmit_pkts_vec_all_offload; + + if (eth_dev->data->dev_started) + rte_eth_fp_ops[eth_dev->data->port_id].tx_pkt_burst = eth_dev->tx_pkt_burst; +#else + RTE_SET_USED(eth_dev); +#endif +} +#endif + +void +cn9k_eth_set_tx_function(struct rte_eth_dev *eth_dev) +{ +#if defined(RTE_ARCH_ARM64) + struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); + + cn9k_eth_set_tx_blk_func(eth_dev); + cn9k_eth_set_tx_tmplt_func(eth_dev); + if (dev->tx_offloads & RTE_ETH_TX_OFFLOAD_SECURITY) eth_dev->tx_queue_count = cn9k_nix_tx_queue_sec_count; else eth_dev->tx_queue_count = cn9k_nix_tx_queue_count; - - rte_mb(); + rte_atomic_thread_fence(rte_memory_order_release); #else RTE_SET_USED(eth_dev); #endif diff --git a/drivers/net/cnxk/meson.build b/drivers/net/cnxk/meson.build index 8cc06f4967..7bce80098a 100644 --- a/drivers/net/cnxk/meson.build +++ b/drivers/net/cnxk/meson.build @@ -44,6 +44,13 @@ sources = files( 'cnxk_tm.c', ) +disable_template = false +if meson.version().version_compare('>=1.1.0') + if '-DCNXK_DIS_TMPLT_FUNC' in meson.build_options() + disable_template = true + endif +endif + if soc_type == 'cn9k' or soc_type == 'all' # CN9K sources += files( @@ -54,7 +61,7 @@ sources += files( 'cn9k_tx_select.c', ) -if host_machine.cpu_family().startswith('aarch') +if host_machine.cpu_family().startswith('aarch') and not disable_template sources += files( 'rx/cn9k/rx_0_15.c', 'rx/cn9k/rx_16_31.c', @@ -88,6 +95,7 @@ sources += files( 'rx/cn9k/rx_80_95_vec_mseg.c', 'rx/cn9k/rx_96_111_vec_mseg.c', 'rx/cn9k/rx_112_127_vec_mseg.c', + 'rx/cn9k/rx_all_offload.c', ) sources += files( @@ -123,6 +131,12 @@ sources += files( 'tx/cn9k/tx_80_95_vec_mseg.c', 'tx/cn9k/tx_96_111_vec_mseg.c', 'tx/cn9k/tx_112_127_vec_mseg.c', + 'tx/cn9k/tx_all_offload.c', +) +else +sources += files( + 'rx/cn9k/rx_all_offload.c', + 'tx/cn9k/tx_all_offload.c', ) endif endif @@ -137,7 +151,7 @@ sources += files( 'cn10k_tx_select.c', ) -if host_machine.cpu_family().startswith('aarch') +if host_machine.cpu_family().startswith('aarch') and not disable_template sources += files( 'rx/cn10k/rx_0_15.c', 'rx/cn10k/rx_16_31.c', @@ -171,6 +185,7 @@ sources += files( 'rx/cn10k/rx_80_95_vec_mseg.c', 'rx/cn10k/rx_96_111_vec_mseg.c', 'rx/cn10k/rx_112_127_vec_mseg.c', + 'rx/cn10k/rx_all_offload.c', ) sources += files( @@ -206,6 +221,12 @@ sources += files( 'tx/cn10k/tx_80_95_vec_mseg.c', 'tx/cn10k/tx_96_111_vec_mseg.c', 'tx/cn10k/tx_112_127_vec_mseg.c', + 'tx/cn10k/tx_all_offload.c', +) +else +sources += files( + 'rx/cn10k/rx_all_offload.c', + 'tx/cn10k/tx_all_offload.c', ) endif endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_0_15.c b/drivers/net/cnxk/rx/cn10k/rx_0_15.c index 4447f4760b..c272a815a9 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_0_15.c +++ b/drivers/net/cnxk/rx/cn10k/rx_0_15.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_0_15_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_0_15_mseg.c index 7fcdc99f6f..c65949bf0b 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_0_15_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_0_15_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_0_15_vec.c b/drivers/net/cnxk/rx/cn10k/rx_0_15_vec.c index c018aff2a7..16d3987796 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_0_15_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_0_15_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_0_15_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_0_15_vec_mseg.c index 093885ef67..39b9f97849 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_0_15_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_0_15_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_112_127.c b/drivers/net/cnxk/rx/cn10k/rx_112_127.c index 5b060dc499..0516fa0fb8 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_112_127.c +++ b/drivers/net/cnxk/rx/cn10k/rx_112_127.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_112_127_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_112_127_mseg.c index af2eb0944a..5c79734f0b 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_112_127_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_112_127_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_112_127_vec.c b/drivers/net/cnxk/rx/cn10k/rx_112_127_vec.c index b451d33d59..603896ef83 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_112_127_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_112_127_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_112_127_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_112_127_vec_mseg.c index 961cf7547b..623ea8fa83 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_112_127_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_112_127_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_16_31.c b/drivers/net/cnxk/rx/cn10k/rx_16_31.c index 59ca07f619..521433edb6 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_16_31.c +++ b/drivers/net/cnxk/rx/cn10k/rx_16_31.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_16_31_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_16_31_mseg.c index 4a11d3907c..7df3d6c3f4 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_16_31_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_16_31_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_16_31_vec.c b/drivers/net/cnxk/rx/cn10k/rx_16_31_vec.c index d2f5304ff3..a185287d8e 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_16_31_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_16_31_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_16_31_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_16_31_vec_mseg.c index 274665fdc7..f87e8133e0 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_16_31_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_16_31_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_32_47.c b/drivers/net/cnxk/rx/cn10k/rx_32_47.c index e6458bef89..cc993aca2e 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_32_47.c +++ b/drivers/net/cnxk/rx/cn10k/rx_32_47.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_32_47_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_32_47_mseg.c index 0b2ce03b65..4c087c771e 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_32_47_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_32_47_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_32_47_vec.c b/drivers/net/cnxk/rx/cn10k/rx_32_47_vec.c index fd7b43840b..e0b56959f1 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_32_47_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_32_47_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_32_47_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_32_47_vec_mseg.c index d1527224e4..2f24577ae8 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_32_47_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_32_47_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_48_63.c b/drivers/net/cnxk/rx/cn10k/rx_48_63.c index 610d14a25f..cef3e5e5a0 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_48_63.c +++ b/drivers/net/cnxk/rx/cn10k/rx_48_63.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_48_63_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_48_63_mseg.c index 6d709cdf8b..4eb26d1dcb 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_48_63_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_48_63_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_48_63_vec.c b/drivers/net/cnxk/rx/cn10k/rx_48_63_vec.c index 4006550699..efb83a6cb6 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_48_63_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_48_63_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_48_63_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_48_63_vec_mseg.c index 61158ad0ca..a13f8273cb 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_48_63_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_48_63_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_64_79.c b/drivers/net/cnxk/rx/cn10k/rx_64_79.c index e374c9fbc0..82a044245d 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_64_79.c +++ b/drivers/net/cnxk/rx/cn10k/rx_64_79.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_64_79_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_64_79_mseg.c index e3d06aaf27..b107352752 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_64_79_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_64_79_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_64_79_vec.c b/drivers/net/cnxk/rx/cn10k/rx_64_79_vec.c index 6045c227fb..cd7eb46d90 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_64_79_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_64_79_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_64_79_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_64_79_vec_mseg.c index 6101be67b9..bd251b9fdf 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_64_79_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_64_79_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_80_95.c b/drivers/net/cnxk/rx/cn10k/rx_80_95.c index 4b8984ccb9..6c504b2fae 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_80_95.c +++ b/drivers/net/cnxk/rx/cn10k/rx_80_95.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_80_95_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_80_95_mseg.c index cb271c0afc..341ec4a858 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_80_95_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_80_95_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_80_95_vec.c b/drivers/net/cnxk/rx/cn10k/rx_80_95_vec.c index 146cea33da..a83c3d6975 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_80_95_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_80_95_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_80_95_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_80_95_vec_mseg.c index bc51fc6c9c..8189b60fe4 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_80_95_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_80_95_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_96_111.c b/drivers/net/cnxk/rx/cn10k/rx_96_111.c index 09f6efb95d..8e99861342 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_96_111.c +++ b/drivers/net/cnxk/rx/cn10k/rx_96_111.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) \ NIX_RX_RECV(cn10k_nix_recv_pkts_reas_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_96_111_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_96_111_mseg.c index 085e2787ac..078d9a9bcd 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_96_111_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_96_111_mseg.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) \ NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_reas_mseg_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_96_111_vec.c b/drivers/net/cnxk/rx/cn10k/rx_96_111_vec.c index 0f4e117baf..0090561ff1 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_96_111_vec.c +++ b/drivers/net/cnxk/rx/cn10k/rx_96_111_vec.c @@ -8,9 +8,13 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) \ NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_reas_vec_##name, flags | NIX_RX_REAS_F) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_96_111_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_96_111_vec_mseg.c index 37f7f61341..21cc3da2e2 100644 --- a/drivers/net/cnxk/rx/cn10k/rx_96_111_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn10k/rx_96_111_vec_mseg.c @@ -8,6 +8,8 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) \ NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_reas_vec_mseg_##name, \ @@ -15,3 +17,5 @@ NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn10k/rx_all_offload.c b/drivers/net/cnxk/rx/cn10k/rx_all_offload.c new file mode 100644 index 0000000000..1381917340 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_all_offload.c @@ -0,0 +1,57 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn10k_rx.h" + +#ifdef _ROC_API_H_ +#error "roc_api.h is included" +#endif + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_noinline __rte_hot +cn10k_nix_recv_pkts_all_offload(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn10k_nix_recv_pkts(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | + NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | NIX_RX_OFFLOAD_TSTAMP_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | + NIX_RX_MULTI_SEG_F | NIX_RX_REAS_F); +} + +uint16_t __rte_noinline __rte_hot +cn10k_nix_recv_pkts_vec_all_offload(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn10k_nix_recv_pkts_vector(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | NIX_RX_OFFLOAD_TSTAMP_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | + NIX_RX_MULTI_SEG_F | NIX_RX_REAS_F, + NULL, NULL, 0, 0); +} + +uint16_t __rte_noinline __rte_hot +cn10k_nix_recv_pkts_all_offload_tst(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn10k_nix_recv_pkts(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | + NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | + NIX_RX_MULTI_SEG_F | NIX_RX_REAS_F); +} + +uint16_t __rte_noinline __rte_hot +cn10k_nix_recv_pkts_vec_all_offload_tst(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn10k_nix_recv_pkts_vector(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | + NIX_RX_MULTI_SEG_F | NIX_RX_REAS_F, + NULL, NULL, 0, 0); +} + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_0_15.c b/drivers/net/cnxk/rx/cn9k/rx_0_15.c index 3afc058870..0e2364797a 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_0_15.c +++ b/drivers/net/cnxk/rx/cn9k/rx_0_15.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_0_15_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_0_15_mseg.c index f797e3a1fc..89abae97ee 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_0_15_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_0_15_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_0_15_vec.c b/drivers/net/cnxk/rx/cn9k/rx_0_15_vec.c index b16a0e2f1d..d708934f16 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_0_15_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_0_15_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_0_15_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_0_15_vec_mseg.c index d51f7491b5..1215b06c49 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_0_15_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_0_15_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_0_15 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_112_127.c b/drivers/net/cnxk/rx/cn9k/rx_112_127.c index 5240a0ea6b..5ac87bbbc8 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_112_127.c +++ b/drivers/net/cnxk/rx/cn9k/rx_112_127.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_112_127_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_112_127_mseg.c index 8f3b0ff7e4..39afb2e928 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_112_127_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_112_127_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_112_127_vec.c b/drivers/net/cnxk/rx/cn9k/rx_112_127_vec.c index ffb7fee187..078e68c419 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_112_127_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_112_127_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_112_127_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_112_127_vec_mseg.c index af4fdd1c67..acd44beb87 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_112_127_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_112_127_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_112_127 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_16_31.c b/drivers/net/cnxk/rx/cn9k/rx_16_31.c index 322c4c7cf7..8ee551e569 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_16_31.c +++ b/drivers/net/cnxk/rx/cn9k/rx_16_31.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_16_31_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_16_31_mseg.c index 146973a784..ae18f24fa3 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_16_31_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_16_31_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_16_31_vec.c b/drivers/net/cnxk/rx/cn9k/rx_16_31_vec.c index 8aaaffefbf..72fb241d75 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_16_31_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_16_31_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_16_31_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_16_31_vec_mseg.c index bf75c0116b..7f958701a1 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_16_31_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_16_31_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_16_31 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_32_47.c b/drivers/net/cnxk/rx/cn9k/rx_32_47.c index 4b0b630224..db298c5605 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_32_47.c +++ b/drivers/net/cnxk/rx/cn9k/rx_32_47.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_32_47_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_32_47_mseg.c index 718b0491f0..9e46396c30 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_32_47_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_32_47_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_32_47_vec.c b/drivers/net/cnxk/rx/cn9k/rx_32_47_vec.c index af9550379e..54fe82b294 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_32_47_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_32_47_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_32_47_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_32_47_vec_mseg.c index 4f5521f5ba..d19ab66bb3 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_32_47_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_32_47_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_32_47 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_48_63.c b/drivers/net/cnxk/rx/cn9k/rx_48_63.c index 490a9cfce5..a57015f5a3 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_48_63.c +++ b/drivers/net/cnxk/rx/cn9k/rx_48_63.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_48_63_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_48_63_mseg.c index 230a9315ea..893c239193 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_48_63_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_48_63_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_48_63_vec.c b/drivers/net/cnxk/rx/cn9k/rx_48_63_vec.c index a9a00024a3..c8212acf07 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_48_63_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_48_63_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_48_63_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_48_63_vec_mseg.c index 0b0411b338..f4c3012ef9 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_48_63_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_48_63_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_48_63 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_64_79.c b/drivers/net/cnxk/rx/cn9k/rx_64_79.c index 0a60bc76cf..aee32cf521 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_64_79.c +++ b/drivers/net/cnxk/rx/cn9k/rx_64_79.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_64_79_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_64_79_mseg.c index b847dd2fb5..65af719db5 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_64_79_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_64_79_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_64_79_vec.c b/drivers/net/cnxk/rx/cn9k/rx_64_79_vec.c index b8fe924033..eab92e8aa9 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_64_79_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_64_79_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_64_79_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_64_79_vec_mseg.c index ba42783e4d..983826770a 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_64_79_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_64_79_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_64_79 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_80_95.c b/drivers/net/cnxk/rx/cn9k/rx_80_95.c index 4f322f2984..596414da31 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_80_95.c +++ b/drivers/net/cnxk/rx/cn9k/rx_80_95.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_80_95_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_80_95_mseg.c index 4a3e254d09..28de85b712 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_80_95_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_80_95_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_80_95_vec.c b/drivers/net/cnxk/rx/cn9k/rx_80_95_vec.c index a6a7893efa..8cb9efb228 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_80_95_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_80_95_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_80_95_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_80_95_vec_mseg.c index 5472e638fe..8cbc1bbe45 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_80_95_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_80_95_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_80_95 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_96_111.c b/drivers/net/cnxk/rx/cn9k/rx_96_111.c index 27e27edd29..8aaf692258 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_96_111.c +++ b/drivers/net/cnxk/rx/cn9k/rx_96_111.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV(cn9k_nix_recv_pkts_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_96_111_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_96_111_mseg.c index 7989e61982..ef3d448926 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_96_111_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_96_111_mseg.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_MSEG(cn9k_nix_recv_pkts_mseg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_96_111_vec.c b/drivers/net/cnxk/rx/cn9k/rx_96_111_vec.c index 9df9f7a6fa..034673306a 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_96_111_vec.c +++ b/drivers/net/cnxk/rx/cn9k/rx_96_111_vec.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) NIX_RX_RECV_VEC(cn9k_nix_recv_pkts_vec_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_96_111_vec_mseg.c b/drivers/net/cnxk/rx/cn9k/rx_96_111_vec_mseg.c index 7170e5d215..6e25b17ffd 100644 --- a/drivers/net/cnxk/rx/cn9k/rx_96_111_vec_mseg.c +++ b/drivers/net/cnxk/rx/cn9k/rx_96_111_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_rx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define R(name, flags) \ NIX_RX_RECV_VEC_MSEG(cn9k_nix_recv_pkts_vec_mseg_##name, flags) NIX_RX_FASTPATH_MODES_96_111 #undef R + +#endif diff --git a/drivers/net/cnxk/rx/cn9k/rx_all_offload.c b/drivers/net/cnxk/rx/cn9k/rx_all_offload.c new file mode 100644 index 0000000000..9e8e3e0d2b --- /dev/null +++ b/drivers/net/cnxk/rx/cn9k/rx_all_offload.c @@ -0,0 +1,50 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn9k_ethdev.h" +#include "cn9k_rx.h" + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_noinline __rte_hot +cn9k_nix_recv_pkts_all_offload(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn9k_nix_recv_pkts(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | + NIX_RX_OFFLOAD_CHECKSUM_F | NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | + NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F); +} + +uint16_t __rte_noinline __rte_hot +cn9k_nix_recv_pkts_vec_all_offload(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn9k_nix_recv_pkts_vector(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | + NIX_RX_MULTI_SEG_F); +} + +uint16_t __rte_noinline __rte_hot +cn9k_nix_recv_pkts_all_offload_tst(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn9k_nix_recv_pkts(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | + NIX_RX_OFFLOAD_CHECKSUM_F | NIX_RX_OFFLOAD_MARK_UPDATE_F | + NIX_RX_OFFLOAD_TSTAMP_F | NIX_RX_OFFLOAD_VLAN_STRIP_F | + NIX_RX_OFFLOAD_SECURITY_F | NIX_RX_MULTI_SEG_F); +} + +uint16_t __rte_noinline __rte_hot +cn9k_nix_recv_pkts_vec_all_offload_tst(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) +{ + return cn9k_nix_recv_pkts_vector(rx_queue, rx_pkts, pkts, + NIX_RX_OFFLOAD_RSS_F | NIX_RX_OFFLOAD_PTYPE_F | NIX_RX_OFFLOAD_CHECKSUM_F | + NIX_RX_OFFLOAD_MARK_UPDATE_F | NIX_RX_OFFLOAD_TSTAMP_F | + NIX_RX_OFFLOAD_VLAN_STRIP_F | NIX_RX_OFFLOAD_SECURITY_F | + NIX_RX_MULTI_SEG_F); +} + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15.c b/drivers/net/cnxk/tx/cn10k/tx_0_15.c index c4495baea5..0c736bc96f 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_0_15.c +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c index ce7f59b24b..3b301b598f 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c index dffc40974e..b05bd6b1ff 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c index d0e8042815..dd370d5675 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127.c b/drivers/net/cnxk/tx/cn10k/tx_112_127.c index 81fd139fc6..9a7d5fdfde 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_112_127.c +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c index 9129c5c330..70720e3fb4 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c index df6e9ed680..05ec22d507 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c index c144e71232..fab3bef301 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31.c b/drivers/net/cnxk/tx/cn10k/tx_16_31.c index 41e77c48e7..e47da9a421 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_16_31.c +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c index 527b009c4b..fcf0aabb72 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c index 36eca00f1d..a7807be858 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c index 8bd3311de6..dec25128aa 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47.c b/drivers/net/cnxk/tx/cn10k/tx_32_47.c index 7dcd9a4fb7..9bc70456e3 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_32_47.c +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c index 987667951f..e6c8e2a354 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c index e5edce2f0c..ecd8136a38 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c index e9f940ddb1..a326f28973 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63.c b/drivers/net/cnxk/tx/cn10k/tx_48_63.c index 7bc735bd80..1fc8c90ac7 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_48_63.c +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c index 6a1d0a3e69..2b4e1a38d8 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c index 95e5a1663b..63b9fb89e5 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c index d46587b5b0..2aaabd1ea1 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79.c b/drivers/net/cnxk/tx/cn10k/tx_64_79.c index 0819c770c0..0c7b836fdb 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_64_79.c +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c index 45af7e8687..b0a25a7e4f 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c index 8247564779..382d60a1b0 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c index 58426c976a..9f042b5d34 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95.c b/drivers/net/cnxk/tx/cn10k/tx_80_95.c index d690633724..40f0d43ebe 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_80_95.c +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c index 5b01eded11..80cbae7a68 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c index 0f6545a33e..7c6815921d 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c index ad1f0ce4df..fe705d979e 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111.c b/drivers/net/cnxk/tx/cn10k/tx_96_111.c index 2688e502e2..9b00f80c77 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_96_111.c +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111.c @@ -8,7 +8,11 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c index c18b4ba7da..40d58fa7d4 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c index 94ffcb74a8..03d983b19e 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c index ad1d124968..c8fee2aec7 100644 --- a/drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c @@ -8,8 +8,12 @@ #error "roc_api.h is included" #endif +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn10k/tx_all_offload.c b/drivers/net/cnxk/tx/cn10k/tx_all_offload.c new file mode 100644 index 0000000000..b929fb636d --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_all_offload.c @@ -0,0 +1,37 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn10k_tx.h" + +#ifdef _ROC_API_H_ +#error "roc_api.h is included" +#endif + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_noinline __rte_hot +cn10k_nix_xmit_pkts_all_offload(void *tx_queue, struct rte_mbuf **tx_pkts, uint16_t pkts) +{ + uint64_t cmd[8 + CNXK_NIX_TX_MSEG_SG_DWORDS - 2]; + + return cn10k_nix_xmit_pkts_mseg(tx_queue, NULL, tx_pkts, pkts, cmd, + NIX_TX_OFFLOAD_L3_L4_CSUM_F | NIX_TX_OFFLOAD_OL3_OL4_CSUM_F | + NIX_TX_OFFLOAD_VLAN_QINQ_F | NIX_TX_OFFLOAD_MBUF_NOFF_F | + NIX_TX_OFFLOAD_TSO_F | NIX_TX_OFFLOAD_TSTAMP_F | NIX_TX_OFFLOAD_SECURITY_F | + NIX_TX_MULTI_SEG_F); +} + +uint16_t __rte_noinline __rte_hot +cn10k_nix_xmit_pkts_vec_all_offload(void *tx_queue, struct rte_mbuf **tx_pkts, uint16_t pkts) +{ + uint64_t cmd[8 + CNXK_NIX_TX_MSEG_SG_DWORDS - 2]; + + return cn10k_nix_xmit_pkts_vector(tx_queue, NULL, tx_pkts, pkts, cmd, + NIX_TX_OFFLOAD_L3_L4_CSUM_F | NIX_TX_OFFLOAD_OL3_OL4_CSUM_F | + NIX_TX_OFFLOAD_VLAN_QINQ_F | NIX_TX_OFFLOAD_MBUF_NOFF_F | + NIX_TX_OFFLOAD_TSO_F | NIX_TX_OFFLOAD_TSTAMP_F | NIX_TX_OFFLOAD_SECURITY_F | + NIX_TX_MULTI_SEG_F); +} + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_0_15.c b/drivers/net/cnxk/tx/cn9k/tx_0_15.c index 6d6465b6cf..ac06423325 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_0_15.c +++ b/drivers/net/cnxk/tx/cn9k/tx_0_15.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_0_15_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_0_15_mseg.c index 3a807104bb..bf57895a57 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_0_15_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_0_15_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_0_15_vec.c b/drivers/net/cnxk/tx/cn9k/tx_0_15_vec.c index ace5f43209..f322e3d54c 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_0_15_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_0_15_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_0_15_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_0_15_vec_mseg.c index 23056214ca..4bce761101 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_0_15_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_0_15_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_0_15 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_112_127.c b/drivers/net/cnxk/tx/cn9k/tx_112_127.c index 1882e72cb1..da1d97c2a0 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_112_127.c +++ b/drivers/net/cnxk/tx/cn9k/tx_112_127.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_112_127_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_112_127_mseg.c index b2d09e2074..2147c1eef1 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_112_127_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_112_127_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_112_127_vec.c b/drivers/net/cnxk/tx/cn9k/tx_112_127_vec.c index 9ebb1bd82a..38f38481ea 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_112_127_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_112_127_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_112_127_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_112_127_vec_mseg.c index e045b9eebc..6b40caf943 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_112_127_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_112_127_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_112_127 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_16_31.c b/drivers/net/cnxk/tx/cn9k/tx_16_31.c index dd4d6db763..aacad32b6c 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_16_31.c +++ b/drivers/net/cnxk/tx/cn9k/tx_16_31.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_16_31_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_16_31_mseg.c index 0296e054cc..dac52b78a9 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_16_31_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_16_31_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_16_31_vec.c b/drivers/net/cnxk/tx/cn9k/tx_16_31_vec.c index aaff8ad7db..9deb71557d 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_16_31_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_16_31_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_16_31_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_16_31_vec_mseg.c index 056b0b11ec..67fd77785c 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_16_31_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_16_31_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_16_31 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_32_47.c b/drivers/net/cnxk/tx/cn9k/tx_32_47.c index b9429a996d..d23249a0c5 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_32_47.c +++ b/drivers/net/cnxk/tx/cn9k/tx_32_47.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_32_47_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_32_47_mseg.c index 82252abdb1..aaa76f0662 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_32_47_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_32_47_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_32_47_vec.c b/drivers/net/cnxk/tx/cn9k/tx_32_47_vec.c index a19445dd91..881e5b9ef4 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_32_47_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_32_47_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_32_47_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_32_47_vec_mseg.c index 3f6a194394..9ca1013d5b 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_32_47_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_32_47_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_32_47 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_48_63.c b/drivers/net/cnxk/tx/cn9k/tx_48_63.c index 8510d09cc4..5de66300c7 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_48_63.c +++ b/drivers/net/cnxk/tx/cn9k/tx_48_63.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_48_63_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_48_63_mseg.c index 5e65d12b2f..47f5a8b93d 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_48_63_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_48_63_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_48_63_vec.c b/drivers/net/cnxk/tx/cn9k/tx_48_63_vec.c index d39acccb92..ace198e93f 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_48_63_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_48_63_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_48_63_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_48_63_vec_mseg.c index 3ffa9508b7..444d9a16a3 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_48_63_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_48_63_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_48_63 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_64_79.c b/drivers/net/cnxk/tx/cn9k/tx_64_79.c index 0a972cf3e9..015b39fa56 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_64_79.c +++ b/drivers/net/cnxk/tx/cn9k/tx_64_79.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_64_79_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_64_79_mseg.c index 610e3903b2..a852a0a125 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_64_79_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_64_79_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_64_79_vec.c b/drivers/net/cnxk/tx/cn9k/tx_64_79_vec.c index 863cc8e1ee..9ce31f3d23 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_64_79_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_64_79_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_64_79_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_64_79_vec_mseg.c index c3b96cfadf..63f482f1f0 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_64_79_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_64_79_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_64_79 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_80_95.c b/drivers/net/cnxk/tx/cn9k/tx_80_95.c index 3ae3da2962..67d9394877 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_80_95.c +++ b/drivers/net/cnxk/tx/cn9k/tx_80_95.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_80_95_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_80_95_mseg.c index 5e6933644b..f32d63559e 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_80_95_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_80_95_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_80_95_vec.c b/drivers/net/cnxk/tx/cn9k/tx_80_95_vec.c index 5bf2a32230..958b9899f1 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_80_95_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_80_95_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_80_95_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_80_95_vec_mseg.c index 684ebb03a9..f34fa2fac4 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_80_95_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_80_95_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_80_95 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_96_111.c b/drivers/net/cnxk/tx/cn9k/tx_96_111.c index 8484562dc3..859f50313a 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_96_111.c +++ b/drivers/net/cnxk/tx/cn9k/tx_96_111.c @@ -5,7 +5,11 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) NIX_TX_XMIT(cn9k_nix_xmit_pkts_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_96_111_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_96_111_mseg.c index d006da6450..1e5a991cb4 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_96_111_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_96_111_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_MSEG(cn9k_nix_xmit_pkts_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_96_111_vec.c b/drivers/net/cnxk/tx/cn9k/tx_96_111_vec.c index a86e9fced5..636e5379c5 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_96_111_vec.c +++ b/drivers/net/cnxk/tx/cn9k/tx_96_111_vec.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC(cn9k_nix_xmit_pkts_vec_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_96_111_vec_mseg.c b/drivers/net/cnxk/tx/cn9k/tx_96_111_vec_mseg.c index 8e0dbec518..90b819407c 100644 --- a/drivers/net/cnxk/tx/cn9k/tx_96_111_vec_mseg.c +++ b/drivers/net/cnxk/tx/cn9k/tx_96_111_vec_mseg.c @@ -5,8 +5,12 @@ #include "cn9k_ethdev.h" #include "cn9k_tx.h" +#if !defined(CNXK_DIS_TMPLT_FUNC) + #define T(name, sz, flags) \ NIX_TX_XMIT_VEC_MSEG(cn9k_nix_xmit_pkts_vec_mseg_##name, sz, flags) NIX_TX_FASTPATH_MODES_96_111 #undef T + +#endif diff --git a/drivers/net/cnxk/tx/cn9k/tx_all_offload.c b/drivers/net/cnxk/tx/cn9k/tx_all_offload.c new file mode 100644 index 0000000000..f76365a717 --- /dev/null +++ b/drivers/net/cnxk/tx/cn9k/tx_all_offload.c @@ -0,0 +1,35 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2022 Marvell. + */ + +#include "cn9k_ethdev.h" +#include "cn9k_tx.h" + +#if defined(CNXK_DIS_TMPLT_FUNC) + +uint16_t __rte_noinline __rte_hot +cn9k_nix_xmit_pkts_all_offload(void *tx_queue, struct rte_mbuf **tx_pkts, uint16_t pkts) +{ + uint64_t cmd[8 + CNXK_NIX_TX_MSEG_SG_DWORDS - 2]; + + return cn9k_nix_xmit_pkts_mseg(tx_queue, tx_pkts, pkts, cmd, + NIX_TX_OFFLOAD_L3_L4_CSUM_F | NIX_TX_OFFLOAD_OL3_OL4_CSUM_F | + NIX_TX_OFFLOAD_VLAN_QINQ_F | + NIX_TX_OFFLOAD_MBUF_NOFF_F | NIX_TX_OFFLOAD_TSO_F | + NIX_TX_OFFLOAD_TSTAMP_F | NIX_TX_OFFLOAD_SECURITY_F | + NIX_TX_MULTI_SEG_F); +} + +uint16_t __rte_noinline __rte_hot +cn9k_nix_xmit_pkts_vec_all_offload(void *tx_queue, struct rte_mbuf **tx_pkts, uint16_t pkts) +{ + uint64_t cmd[8 + CNXK_NIX_TX_MSEG_SG_DWORDS - 2]; + + return cn9k_nix_xmit_pkts_vector(tx_queue, tx_pkts, pkts, cmd, + NIX_TX_OFFLOAD_L3_L4_CSUM_F | NIX_TX_OFFLOAD_OL3_OL4_CSUM_F | + NIX_TX_OFFLOAD_VLAN_QINQ_F | NIX_TX_OFFLOAD_MBUF_NOFF_F | + NIX_TX_OFFLOAD_TSO_F | NIX_TX_OFFLOAD_TSTAMP_F | NIX_TX_OFFLOAD_SECURITY_F | + NIX_TX_MULTI_SEG_F); +} + +#endif