Message ID | 20231002095859.12187-1-syalavarthi@marvell.com (mailing list archive) |
---|---|
Headers |
Return-Path: <dev-bounces@dpdk.org> X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4F6B3426A0; Mon, 2 Oct 2023 11:59:08 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 2453C40294; Mon, 2 Oct 2023 11:59:08 +0200 (CEST) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id 812484003C for <dev@dpdk.org>; Mon, 2 Oct 2023 11:59:06 +0200 (CEST) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 391MUBjT011401 for <dev@dpdk.org>; Mon, 2 Oct 2023 02:59:05 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=pfpt0220; bh=M3LVqBEgO+qSLyR1Wipzax1HtXQmri/3BObRdeBBhOk=; b=MCWhZeoA5XLM+ZVdyOIEWRC4xkQKNv+iEmbWLtTJ37aPKl9fa96gbiXB+Wyaratfoqyt wvmRfeSBj0lZNT9s1wtUi0yg0bmn0TJw958U5i/Fsank0X4MUYdiKDm4ClstT6IC4jjG U4OAiE+EuW7fZPZwtFFkLuWEScUqygOjRLyiP8n7lVwZ3KyR8H7+vdFdTwJjpy6j7am3 gCM3Uwak/5JRAIfCwVw5+srWd2ira7PV/LiCS43xTua6EJ7cta5K8cG5iRz1T1nIMFbJ BnVjatDME4lGPxZ1qx2npi+WEkrMl3QVOhotp6KgTHYqAyUyKg+e5ju/ggEo2mveIVUF Kg== Received: from dc5-exch02.marvell.com ([199.233.59.182]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 3teh1qvcqm-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT) for <dev@dpdk.org>; Mon, 02 Oct 2023 02:59:05 -0700 Received: from DC5-EXCH01.marvell.com (10.69.176.38) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server (TLS) id 15.0.1497.48; Mon, 2 Oct 2023 02:59:03 -0700 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server id 15.0.1497.48 via Frontend Transport; Mon, 2 Oct 2023 02:59:03 -0700 Received: from ml-host-33.caveonetworks.com (unknown [10.110.143.233]) by maili.marvell.com (Postfix) with ESMTP id AC75D3F704B; Mon, 2 Oct 2023 02:59:02 -0700 (PDT) From: Srikanth Yalavarthi <syalavarthi@marvell.com> To: CC: <dev@dpdk.org>, <syalavarthi@marvell.com>, <sshankarnara@marvell.com>, <aprabhu@marvell.com>, <ptakkar@marvell.com> Subject: [PATCH v4 0/3] Spec changes to support multi I/O models Date: Mon, 2 Oct 2023 02:58:55 -0700 Message-ID: <20231002095859.12187-1-syalavarthi@marvell.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20230830155303.30380-1-syalavarthi@marvell.com> References: <20230830155303.30380-1-syalavarthi@marvell.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Proofpoint-GUID: DWpE2KEl05ufNUhB6QcdnYN6X_51A6uw X-Proofpoint-ORIG-GUID: DWpE2KEl05ufNUhB6QcdnYN6X_51A6uw X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.267,Aquarius:18.0.980,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-10-02_03,2023-09-28_03,2023-05-22_02 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions <dev.dpdk.org> List-Unsubscribe: <https://mails.dpdk.org/options/dev>, <mailto:dev-request@dpdk.org?subject=unsubscribe> List-Archive: <http://mails.dpdk.org/archives/dev/> List-Post: <mailto:dev@dpdk.org> List-Help: <mailto:dev-request@dpdk.org?subject=help> List-Subscribe: <https://mails.dpdk.org/listinfo/dev>, <mailto:dev-request@dpdk.org?subject=subscribe> Errors-To: dev-bounces@dpdk.org |
Series |
Spec changes to support multi I/O models
|
|
Message
Srikanth Yalavarthi
Oct. 2, 2023, 9:58 a.m. UTC
This series implements changes to mldev spec to extend support for ML models with multiple inputs and outputs. Changes include introduction of I/O layout to support packed and split buffers for model input and output. Extended the rte_ml_model_info structure to support multiple inputs and outputs. Updated rte_ml_op and quantize / dequantize APIs to support an array of input and output ML buffer segments. Support for batches option is dropped from test application. v4: - Squashed release notes v3: - Added release notes for 23.11 v2: - Minor fixes - Cleanup of application help v1: - Initial changes Srikanth Yalavarthi (3): mldev: add support for arbitrary shape dimensions mldev: introduce support for IO layout mldev: drop input and output size get APIs app/test-mldev/ml_options.c | 16 - app/test-mldev/ml_options.h | 2 - app/test-mldev/test_inference_common.c | 420 +++++++++++++++++-------- app/test-mldev/test_inference_common.h | 6 + app/test-mldev/test_model_common.c | 6 - app/test-mldev/test_model_common.h | 1 - doc/guides/rel_notes/release_23_11.rst | 15 + doc/guides/tools/testmldev.rst | 6 - drivers/ml/cnxk/cn10k_ml_dev.h | 3 + drivers/ml/cnxk/cn10k_ml_model.c | 84 +++-- drivers/ml/cnxk/cn10k_ml_model.h | 12 + drivers/ml/cnxk/cn10k_ml_ops.c | 135 +++----- lib/mldev/meson.build | 2 +- lib/mldev/mldev_utils.c | 30 -- lib/mldev/mldev_utils.h | 16 - lib/mldev/rte_mldev.c | 50 +-- lib/mldev/rte_mldev.h | 201 +++++------- lib/mldev/rte_mldev_core.h | 68 +--- lib/mldev/version.map | 3 - 19 files changed, 521 insertions(+), 555 deletions(-)
Comments
02/10/2023 11:58, Srikanth Yalavarthi: > This series implements changes to mldev spec to extend support > for ML models with multiple inputs and outputs. Changes include > introduction of I/O layout to support packed and split buffers > for model input and output. Extended the rte_ml_model_info > structure to support multiple inputs and outputs. > > Updated rte_ml_op and quantize / dequantize APIs to support an > array of input and output ML buffer segments. > > Support for batches option is dropped from test application. Applied, thanks.