From patchwork Wed Sep 27 18:11:54 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Srikanth Yalavarthi X-Patchwork-Id: 195 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 14D52425B7; Wed, 27 Sep 2023 20:12:10 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DBE4540271; Wed, 27 Sep 2023 20:12:09 +0200 (CEST) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id 6B6AD4026B for ; Wed, 27 Sep 2023 20:12:08 +0200 (CEST) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 38RCJcOk015146 for ; Wed, 27 Sep 2023 11:12:07 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=pfpt0220; bh=SkytQ9kwRpr0smZdSS3aL4Kdb7x3IaNNdRBO1H/5Qm0=; b=klCcRRAiqwDL2rQ9Qqa2Q9vFrqAE4dVdvAimN44mMr5i8k6v6788ADfD1j13uOPvXb+G cCoYi3C9Idih8kFPa3HccBW8MHGdOp6fWyNeX/FU12NYO5a/IWQvN4lEMqSqN4SmQKb0 tbpKqKGd4ZjDWGBj2Sspx3PaxAQobO54w+Xf6oXVlzTd+hFt1ca2JHQvys47ltgZRyi+ 3MePT+2IP8iJKxd/qjlZTA+9dIPP52EeL45iLUfcv7fEsoo/8VA5phwu+5eOkoJ6nNNW 1eCjvwpz9tGfNL6U1K4s1NYzO4kUZCYhO146E8a9zuNQKj/A+I6YyNDY2/mylJOu+L93 aA== Received: from dc5-exch02.marvell.com ([199.233.59.182]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 3tcma5sdn9-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT) for ; Wed, 27 Sep 2023 11:12:07 -0700 Received: from DC5-EXCH01.marvell.com (10.69.176.38) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server (TLS) id 15.0.1497.48; Wed, 27 Sep 2023 11:12:05 -0700 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server id 15.0.1497.48 via Frontend Transport; Wed, 27 Sep 2023 11:12:05 -0700 Received: from ml-host-33.caveonetworks.com (unknown [10.110.143.233]) by maili.marvell.com (Postfix) with ESMTP id B6CF73F7090; Wed, 27 Sep 2023 11:12:05 -0700 (PDT) From: Srikanth Yalavarthi To: CC: , , , , Subject: [PATCH v3 0/4] Spec changes to support multi I/O models Date: Wed, 27 Sep 2023 11:11:54 -0700 Message-ID: <20230927181159.9794-1-syalavarthi@marvell.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20230830155303.30380-1-syalavarthi@marvell.com> References: <20230830155303.30380-1-syalavarthi@marvell.com> MIME-Version: 1.0 X-Proofpoint-GUID: YiWhUW64JUjzteqFH5gyy9b2M9lugXuj X-Proofpoint-ORIG-GUID: YiWhUW64JUjzteqFH5gyy9b2M9lugXuj X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.267,Aquarius:18.0.980,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-09-27_12,2023-09-27_01,2023-05-22_02 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This series implements changes to mldev spec to extend support for ML models with multiple inputs and outputs. Changes include introduction of I/O layout to support packed and split buffers for model input and output. Extended the rte_ml_model_info structure to support multiple inputs and outputs. Updated rte_ml_op and quantize / dequantize APIs to support an array of input and output ML buffer segments. Support for batches option is dropped from test application. v3: - Added release notes for 23.11 v2: - Minor fixes - Cleanup of application help v1: - Initial changes Srikanth Yalavarthi (4): mldev: add support for arbitrary shape dimensions mldev: introduce support for IO layout mldev: drop input and output size get APIs mldev: update release notes for 23.11 app/test-mldev/ml_options.c | 16 - app/test-mldev/ml_options.h | 2 - app/test-mldev/test_inference_common.c | 420 +++++++++++++++++-------- app/test-mldev/test_inference_common.h | 6 + app/test-mldev/test_model_common.c | 6 - app/test-mldev/test_model_common.h | 1 - doc/guides/rel_notes/release_23_11.rst | 15 + doc/guides/tools/testmldev.rst | 6 - drivers/ml/cnxk/cn10k_ml_dev.h | 3 + drivers/ml/cnxk/cn10k_ml_model.c | 84 +++-- drivers/ml/cnxk/cn10k_ml_model.h | 12 + drivers/ml/cnxk/cn10k_ml_ops.c | 135 +++----- lib/mldev/meson.build | 2 +- lib/mldev/mldev_utils.c | 30 -- lib/mldev/mldev_utils.h | 16 - lib/mldev/rte_mldev.c | 50 +-- lib/mldev/rte_mldev.h | 201 +++++------- lib/mldev/rte_mldev_core.h | 68 +--- lib/mldev/version.map | 3 - 19 files changed, 521 insertions(+), 555 deletions(-)