Patch Detail
get:
Show a patch.
patch:
Update a patch.
put:
Update a patch.
GET /api/patches/123262/?format=api
{ "id": 123262, "url": "https://patches.dpdk.org/api/patches/123262/?format=api", "web_url": "https://patches.dpdk.org/project/dpdk/patch/20230207151316.835441-7-jerinj@marvell.com/", "project": { "id": 1, "url": "https://patches.dpdk.org/api/projects/1/?format=api", "name": "DPDK", "link_name": "dpdk", "list_id": "dev.dpdk.org", "list_email": "dev@dpdk.org", "web_url": "http://core.dpdk.org", "scm_url": "git://dpdk.org/dpdk", "webscm_url": "http://git.dpdk.org/dpdk", "list_archive_url": "https://inbox.dpdk.org/dev", "list_archive_url_format": "https://inbox.dpdk.org/dev/{}", "commit_url_format": "" }, "msgid": "<20230207151316.835441-7-jerinj@marvell.com>", "list_archive_url": "https://inbox.dpdk.org/dev/20230207151316.835441-7-jerinj@marvell.com", "date": "2023-02-07T15:13:10", "name": "[v3,06/12] mldev: support input and output data handling", "commit_ref": null, "pull_url": null, "state": "accepted", "archived": true, "hash": "3a986773c31e06f801420bfad0e0acbc10e0aea6", "submitter": { "id": 1188, "url": "https://patches.dpdk.org/api/people/1188/?format=api", "name": "Jerin Jacob Kollanukkaran", "email": "jerinj@marvell.com" }, "delegate": { "id": 1, "url": "https://patches.dpdk.org/api/users/1/?format=api", "username": "tmonjalo", "first_name": "Thomas", "last_name": "Monjalon", "email": "thomas@monjalon.net" }, "mbox": "https://patches.dpdk.org/project/dpdk/patch/20230207151316.835441-7-jerinj@marvell.com/mbox/", "series": [ { "id": 26852, "url": "https://patches.dpdk.org/api/series/26852/?format=api", "web_url": "https://patches.dpdk.org/project/dpdk/list/?series=26852", "date": "2023-02-07T15:13:04", "name": "mldev: introduce machine learning device library", "version": 3, "mbox": "https://patches.dpdk.org/series/26852/mbox/" } ], "comments": "https://patches.dpdk.org/api/patches/123262/comments/", "check": "success", "checks": "https://patches.dpdk.org/api/patches/123262/checks/", "tags": {}, "related": [], "headers": { "Return-Path": "<dev-bounces@dpdk.org>", "X-Original-To": "patchwork@inbox.dpdk.org", "Delivered-To": "patchwork@inbox.dpdk.org", "Received": [ "from mails.dpdk.org (mails.dpdk.org [217.70.189.124])\n\tby inbox.dpdk.org (Postfix) with ESMTP id 3AEA841C30;\n\tTue, 7 Feb 2023 16:14:21 +0100 (CET)", "from mails.dpdk.org (localhost [127.0.0.1])\n\tby mails.dpdk.org (Postfix) with ESMTP id BA23D42D29;\n\tTue, 7 Feb 2023 16:13:57 +0100 (CET)", "from mx0b-0016f401.pphosted.com (mx0b-0016f401.pphosted.com\n [67.231.156.173])\n by mails.dpdk.org (Postfix) with ESMTP id 056A742D38\n for <dev@dpdk.org>; Tue, 7 Feb 2023 16:13:55 +0100 (CET)", "from pps.filterd (m0045851.ppops.net [127.0.0.1])\n by mx0b-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id\n 317BJhJn017823; Tue, 7 Feb 2023 07:13:55 -0800", "from dc5-exch01.marvell.com ([199.233.59.181])\n by mx0b-0016f401.pphosted.com (PPS) with ESMTPS id 3nhqrtme5v-1\n (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT);\n Tue, 07 Feb 2023 07:13:55 -0800", "from DC5-EXCH02.marvell.com (10.69.176.39) by DC5-EXCH01.marvell.com\n (10.69.176.38) with Microsoft SMTP Server (TLS) id 15.0.1497.42;\n Tue, 7 Feb 2023 07:13:53 -0800", "from maili.marvell.com (10.69.176.80) by DC5-EXCH02.marvell.com\n (10.69.176.39) with Microsoft SMTP Server id 15.0.1497.42 via Frontend\n Transport; Tue, 7 Feb 2023 07:13:53 -0800", "from jerin-lab.marvell.com (jerin-lab.marvell.com [10.28.34.14])\n by maili.marvell.com (Postfix) with ESMTP id 8EDDB3F7083;\n Tue, 7 Feb 2023 07:13:50 -0800 (PST)" ], "DKIM-Signature": "v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com;\n h=from : to : cc :\n subject : date : message-id : in-reply-to : references : mime-version :\n content-transfer-encoding : content-type; s=pfpt0220;\n bh=VCQbREmgf1DY/HvbMRW1FU88wqMUtSCurwMgrbACnRc=;\n b=Ybe7jiKRv1xrxgGglI+L4mfYW4R3ZECZxhfRUQrREf4r2cJgdk80xnozE2tAxO/V7ba4\n 3haotOcdE3I6tZW6s1XghEbefoBG2FXYKmbdYuuxfq50b/t765u87mvGIPz+bw3oyFdb\n 14H3fmysBNmdSA8F/WGZhEoG55JK0L3vnY1MxGr/3yk/pfpY0aRZ3SIW+XTnxNSWpv6d\n Zpyc4vjJeuuIL4j4QHxrwNNYemOGa36IXMBjg6Htstqg6kmRBFO8SSJcQjDYFtzK7FVU\n IbvPYsk4UYD5jyY5OS50E7XOj7ExMPMhkvNR2WpwESagfYcvhSc6G5PuAKcpI2gsr1tQ 9w==", "From": "<jerinj@marvell.com>", "To": "<dev@dpdk.org>, Srikanth Yalavarthi <syalavarthi@marvell.com>", "CC": "<thomas@monjalon.net>, <ferruh.yigit@xilinx.com>,\n <stephen@networkplumber.org>, <dchickles@marvell.com>,\n <sshankarnara@marvell.com>, Jerin Jacob <jerinj@marvell.com>", "Subject": "[dpdk-dev] [PATCH v3 06/12] mldev: support input and output data\n handling", "Date": "Tue, 7 Feb 2023 20:43:10 +0530", "Message-ID": "<20230207151316.835441-7-jerinj@marvell.com>", "X-Mailer": "git-send-email 2.39.1", "In-Reply-To": "<20230207151316.835441-1-jerinj@marvell.com>", "References": "<20230206202453.336280-1-jerinj@marvell.com>\n <20230207151316.835441-1-jerinj@marvell.com>", "MIME-Version": "1.0", "Content-Transfer-Encoding": "8bit", "Content-Type": "text/plain", "X-Proofpoint-GUID": "aTOxl_lh-XGNYAkbbnRAi2wfwcJ_5GG9", "X-Proofpoint-ORIG-GUID": "aTOxl_lh-XGNYAkbbnRAi2wfwcJ_5GG9", "X-Proofpoint-Virus-Version": "vendor=baseguard\n engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1\n definitions=2023-02-07_07,2023-02-06_03,2022-06-22_01", "X-BeenThere": "dev@dpdk.org", "X-Mailman-Version": "2.1.29", "Precedence": "list", "List-Id": "DPDK patches and discussions <dev.dpdk.org>", "List-Unsubscribe": "<https://mails.dpdk.org/options/dev>,\n <mailto:dev-request@dpdk.org?subject=unsubscribe>", "List-Archive": "<http://mails.dpdk.org/archives/dev/>", "List-Post": "<mailto:dev@dpdk.org>", "List-Help": "<mailto:dev-request@dpdk.org?subject=help>", "List-Subscribe": "<https://mails.dpdk.org/listinfo/dev>,\n <mailto:dev-request@dpdk.org?subject=subscribe>", "Errors-To": "dev-bounces@dpdk.org" }, "content": "From: Srikanth Yalavarthi <syalavarthi@marvell.com>\n\nAdded library functions to handle model input and\noutput data. The APIs can be used to get the size of I/O\nbuffers, quantize input data and dequantize output data.\n\nSigned-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>\nSigned-off-by: Jerin Jacob <jerinj@marvell.com>\n---\n lib/mldev/rte_mldev.c | 94 ++++++++++++++++++++++++++++++++\n lib/mldev/rte_mldev_core.h | 106 +++++++++++++++++++++++++++++++++++++\n lib/mldev/version.map | 4 ++\n 3 files changed, 204 insertions(+)", "diff": "diff --git a/lib/mldev/rte_mldev.c b/lib/mldev/rte_mldev.c\nindex 9642e62815..f9684e90ea 100644\n--- a/lib/mldev/rte_mldev.c\n+++ b/lib/mldev/rte_mldev.c\n@@ -508,4 +508,98 @@ rte_ml_model_params_update(int16_t dev_id, uint16_t model_id, void *buffer)\n \treturn (*dev->dev_ops->model_params_update)(dev, model_id, buffer);\n }\n \n+int\n+rte_ml_io_input_size_get(int16_t dev_id, uint16_t model_id, uint32_t nb_batches,\n+\t\t\t uint64_t *input_qsize, uint64_t *input_dsize)\n+{\n+\tstruct rte_ml_dev *dev;\n+\n+\tif (!rte_ml_dev_is_valid_dev(dev_id)) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Invalid dev_id = %d\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\tdev = rte_ml_dev_pmd_get_dev(dev_id);\n+\tif (*dev->dev_ops->io_input_size_get == NULL)\n+\t\treturn -ENOTSUP;\n+\n+\treturn (*dev->dev_ops->io_input_size_get)(dev, model_id, nb_batches, input_qsize,\n+\t\t\t\t\t\t input_dsize);\n+}\n+\n+int\n+rte_ml_io_output_size_get(int16_t dev_id, uint16_t model_id, uint32_t nb_batches,\n+\t\t\t uint64_t *output_qsize, uint64_t *output_dsize)\n+{\n+\tstruct rte_ml_dev *dev;\n+\n+\tif (!rte_ml_dev_is_valid_dev(dev_id)) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Invalid dev_id = %d\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\tdev = rte_ml_dev_pmd_get_dev(dev_id);\n+\tif (*dev->dev_ops->io_output_size_get == NULL)\n+\t\treturn -ENOTSUP;\n+\n+\treturn (*dev->dev_ops->io_output_size_get)(dev, model_id, nb_batches, output_qsize,\n+\t\t\t\t\t\t output_dsize);\n+}\n+\n+int\n+rte_ml_io_quantize(int16_t dev_id, uint16_t model_id, uint16_t nb_batches, void *dbuffer,\n+\t\t void *qbuffer)\n+{\n+\tstruct rte_ml_dev *dev;\n+\n+\tif (!rte_ml_dev_is_valid_dev(dev_id)) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Invalid dev_id = %d\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\tdev = rte_ml_dev_pmd_get_dev(dev_id);\n+\tif (*dev->dev_ops->io_quantize == NULL)\n+\t\treturn -ENOTSUP;\n+\n+\tif (dbuffer == NULL) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Dev %d, dbuffer cannot be NULL\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\tif (qbuffer == NULL) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Dev %d, qbuffer cannot be NULL\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\treturn (*dev->dev_ops->io_quantize)(dev, model_id, nb_batches, dbuffer, qbuffer);\n+}\n+\n+int\n+rte_ml_io_dequantize(int16_t dev_id, uint16_t model_id, uint16_t nb_batches, void *qbuffer,\n+\t\t void *dbuffer)\n+{\n+\tstruct rte_ml_dev *dev;\n+\n+\tif (!rte_ml_dev_is_valid_dev(dev_id)) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Invalid dev_id = %d\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\tdev = rte_ml_dev_pmd_get_dev(dev_id);\n+\tif (*dev->dev_ops->io_dequantize == NULL)\n+\t\treturn -ENOTSUP;\n+\n+\tif (qbuffer == NULL) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Dev %d, qbuffer cannot be NULL\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\tif (dbuffer == NULL) {\n+\t\tRTE_MLDEV_LOG(ERR, \"Dev %d, dbuffer cannot be NULL\\n\", dev_id);\n+\t\treturn -EINVAL;\n+\t}\n+\n+\treturn (*dev->dev_ops->io_dequantize)(dev, model_id, nb_batches, qbuffer, dbuffer);\n+}\n+\n RTE_LOG_REGISTER_DEFAULT(rte_ml_dev_logtype, INFO);\ndiff --git a/lib/mldev/rte_mldev_core.h b/lib/mldev/rte_mldev_core.h\nindex 602f541589..46e6e7a4e5 100644\n--- a/lib/mldev/rte_mldev_core.h\n+++ b/lib/mldev/rte_mldev_core.h\n@@ -255,6 +255,100 @@ typedef int (*mldev_model_info_get_t)(struct rte_ml_dev *dev, uint16_t model_id,\n */\n typedef int (*mldev_model_params_update_t)(struct rte_ml_dev *dev, uint16_t model_id, void *buffer);\n \n+/**\n+ * @internal\n+ *\n+ * Get size of input buffers.\n+ *\n+ * @param dev\n+ *\tML device pointer.\n+ * @param model_id\n+ *\tModel ID to use.\n+ * @param nb_batches\n+ *\tNumber of batches.\n+ * @param input_qsize\n+ *\tSize of quantized input.\n+ * @param input_dsize\n+ *\tSize of dequantized input.\n+ *\n+ * @return\n+ *\t- 0 on success.\n+ *\t- <0, error on failure.\n+ */\n+typedef int (*mldev_io_input_size_get_t)(struct rte_ml_dev *dev, uint16_t model_id,\n+\t\t\t\t\t uint32_t nb_batches, uint64_t *input_qsize,\n+\t\t\t\t\t uint64_t *input_dsize);\n+\n+/**\n+ * @internal\n+ *\n+ * Get size of output buffers.\n+ *\n+ * @param dev\n+ *\tML device pointer.\n+ * @param model_id\n+ *\tModel ID to use.\n+ * @param nb_batches\n+ *\tNumber of batches.\n+ * @param output_qsize\n+ *\tSize of quantized output.\n+ * @param output_dsize\n+ *\tSize of dequantized output.\n+ *\n+ * @return\n+ *\t- 0 on success.\n+ *\t- <0, error on failure.\n+ */\n+typedef int (*mldev_io_output_size_get_t)(struct rte_ml_dev *dev, uint16_t model_id,\n+\t\t\t\t\t uint32_t nb_batches, uint64_t *output_qsize,\n+\t\t\t\t\t uint64_t *output_dsize);\n+\n+/**\n+ * @internal\n+ *\n+ * Quantize model data.\n+ *\n+ * @param dev\n+ *\tML device pointer.\n+ * @param model_id\n+ *\tModel ID to use.\n+ * @param nb_batches\n+ *\tNumber of batches.\n+ * @param dbuffer\n+ *\tPointer t de-quantized data buffer.\n+ * @param qbuffer\n+ *\tPointer t de-quantized data buffer.\n+ *\n+ * @return\n+ *\t- 0 on success.\n+ *\t- <0, error on failure.\n+ */\n+typedef int (*mldev_io_quantize_t)(struct rte_ml_dev *dev, uint16_t model_id, uint16_t nb_batches,\n+\t\t\t\t void *dbuffer, void *qbuffer);\n+\n+/**\n+ * @internal\n+ *\n+ * Quantize model data.\n+ *\n+ * @param dev\n+ *\tML device pointer.\n+ * @param model_id\n+ *\tModel ID to use.\n+ * @param nb_batches\n+ *\tNumber of batches.\n+ * @param qbuffer\n+ *\tPointer t de-quantized data buffer.\n+ * @param dbuffer\n+ *\tPointer t de-quantized data buffer.\n+ *\n+ * @return\n+ *\t- 0 on success.\n+ *\t- <0, error on failure.\n+ */\n+typedef int (*mldev_io_dequantize_t)(struct rte_ml_dev *dev, uint16_t model_id, uint16_t nb_batches,\n+\t\t\t\t void *qbuffer, void *dbuffer);\n+\n /**\n * @internal\n *\n@@ -299,6 +393,18 @@ struct rte_ml_dev_ops {\n \n \t/** Update model params. */\n \tmldev_model_params_update_t model_params_update;\n+\n+\t/** Get input buffer size. */\n+\tmldev_io_input_size_get_t io_input_size_get;\n+\n+\t/** Get output buffer size. */\n+\tmldev_io_output_size_get_t io_output_size_get;\n+\n+\t/** Quantize data */\n+\tmldev_io_quantize_t io_quantize;\n+\n+\t/** De-quantize data */\n+\tmldev_io_dequantize_t io_dequantize;\n };\n \n /**\ndiff --git a/lib/mldev/version.map b/lib/mldev/version.map\nindex 8da70f2443..d65b0792ab 100644\n--- a/lib/mldev/version.map\n+++ b/lib/mldev/version.map\n@@ -12,6 +12,10 @@ EXPERIMENTAL {\n \trte_ml_dev_socket_id;\n \trte_ml_dev_start;\n \trte_ml_dev_stop;\n+\trte_ml_io_dequantize;\n+\trte_ml_io_input_size_get;\n+\trte_ml_io_output_size_get;\n+\trte_ml_io_quantize;\n \trte_ml_model_info_get;\n \trte_ml_model_load;\n \trte_ml_model_params_update;\n", "prefixes": [ "v3", "06/12" ] }