From patchwork Mon Oct 2 09:58:55 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Srikanth Yalavarthi X-Patchwork-Id: 218 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4F6B3426A0; Mon, 2 Oct 2023 11:59:08 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 2453C40294; Mon, 2 Oct 2023 11:59:08 +0200 (CEST) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id 812484003C for ; Mon, 2 Oct 2023 11:59:06 +0200 (CEST) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 391MUBjT011401 for ; Mon, 2 Oct 2023 02:59:05 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=pfpt0220; bh=M3LVqBEgO+qSLyR1Wipzax1HtXQmri/3BObRdeBBhOk=; b=MCWhZeoA5XLM+ZVdyOIEWRC4xkQKNv+iEmbWLtTJ37aPKl9fa96gbiXB+Wyaratfoqyt wvmRfeSBj0lZNT9s1wtUi0yg0bmn0TJw958U5i/Fsank0X4MUYdiKDm4ClstT6IC4jjG U4OAiE+EuW7fZPZwtFFkLuWEScUqygOjRLyiP8n7lVwZ3KyR8H7+vdFdTwJjpy6j7am3 gCM3Uwak/5JRAIfCwVw5+srWd2ira7PV/LiCS43xTua6EJ7cta5K8cG5iRz1T1nIMFbJ BnVjatDME4lGPxZ1qx2npi+WEkrMl3QVOhotp6KgTHYqAyUyKg+e5ju/ggEo2mveIVUF Kg== Received: from dc5-exch02.marvell.com ([199.233.59.182]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 3teh1qvcqm-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT) for ; Mon, 02 Oct 2023 02:59:05 -0700 Received: from DC5-EXCH01.marvell.com (10.69.176.38) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server (TLS) id 15.0.1497.48; Mon, 2 Oct 2023 02:59:03 -0700 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server id 15.0.1497.48 via Frontend Transport; Mon, 2 Oct 2023 02:59:03 -0700 Received: from ml-host-33.caveonetworks.com (unknown [10.110.143.233]) by maili.marvell.com (Postfix) with ESMTP id AC75D3F704B; Mon, 2 Oct 2023 02:59:02 -0700 (PDT) From: Srikanth Yalavarthi To: CC: , , , , Subject: [PATCH v4 0/3] Spec changes to support multi I/O models Date: Mon, 2 Oct 2023 02:58:55 -0700 Message-ID: <20231002095859.12187-1-syalavarthi@marvell.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20230830155303.30380-1-syalavarthi@marvell.com> References: <20230830155303.30380-1-syalavarthi@marvell.com> MIME-Version: 1.0 X-Proofpoint-GUID: DWpE2KEl05ufNUhB6QcdnYN6X_51A6uw X-Proofpoint-ORIG-GUID: DWpE2KEl05ufNUhB6QcdnYN6X_51A6uw X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.267,Aquarius:18.0.980,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-10-02_03,2023-09-28_03,2023-05-22_02 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This series implements changes to mldev spec to extend support for ML models with multiple inputs and outputs. Changes include introduction of I/O layout to support packed and split buffers for model input and output. Extended the rte_ml_model_info structure to support multiple inputs and outputs. Updated rte_ml_op and quantize / dequantize APIs to support an array of input and output ML buffer segments. Support for batches option is dropped from test application. v4: - Squashed release notes v3: - Added release notes for 23.11 v2: - Minor fixes - Cleanup of application help v1: - Initial changes Srikanth Yalavarthi (3): mldev: add support for arbitrary shape dimensions mldev: introduce support for IO layout mldev: drop input and output size get APIs app/test-mldev/ml_options.c | 16 - app/test-mldev/ml_options.h | 2 - app/test-mldev/test_inference_common.c | 420 +++++++++++++++++-------- app/test-mldev/test_inference_common.h | 6 + app/test-mldev/test_model_common.c | 6 - app/test-mldev/test_model_common.h | 1 - doc/guides/rel_notes/release_23_11.rst | 15 + doc/guides/tools/testmldev.rst | 6 - drivers/ml/cnxk/cn10k_ml_dev.h | 3 + drivers/ml/cnxk/cn10k_ml_model.c | 84 +++-- drivers/ml/cnxk/cn10k_ml_model.h | 12 + drivers/ml/cnxk/cn10k_ml_ops.c | 135 +++----- lib/mldev/meson.build | 2 +- lib/mldev/mldev_utils.c | 30 -- lib/mldev/mldev_utils.h | 16 - lib/mldev/rte_mldev.c | 50 +-- lib/mldev/rte_mldev.h | 201 +++++------- lib/mldev/rte_mldev_core.h | 68 +--- lib/mldev/version.map | 3 - 19 files changed, 521 insertions(+), 555 deletions(-)