mbox series

[v4,0/3] Spec changes to support multi I/O models

Message ID 20231002095859.12187-1-syalavarthi@marvell.com (mailing list archive)
Headers
Series Spec changes to support multi I/O models |

Message

Srikanth Yalavarthi Oct. 2, 2023, 9:58 a.m. UTC 
  This series implements changes to mldev spec to extend support
for ML models with multiple inputs and outputs. Changes include
introduction of I/O layout to support packed and split buffers
for model input and output. Extended the rte_ml_model_info
structure to support multiple inputs and outputs.

Updated rte_ml_op and quantize / dequantize APIs to support an
array of input and output ML buffer segments.

Support for batches option is dropped from test application.

v4:
  - Squashed release notes

v3:
  - Added release notes for 23.11

v2:
  - Minor fixes
  - Cleanup of application help

v1:
  - Initial changes


Srikanth Yalavarthi (3):
  mldev: add support for arbitrary shape dimensions
  mldev: introduce support for IO layout
  mldev: drop input and output size get APIs

 app/test-mldev/ml_options.c            |  16 -
 app/test-mldev/ml_options.h            |   2 -
 app/test-mldev/test_inference_common.c | 420 +++++++++++++++++--------
 app/test-mldev/test_inference_common.h |   6 +
 app/test-mldev/test_model_common.c     |   6 -
 app/test-mldev/test_model_common.h     |   1 -
 doc/guides/rel_notes/release_23_11.rst |  15 +
 doc/guides/tools/testmldev.rst         |   6 -
 drivers/ml/cnxk/cn10k_ml_dev.h         |   3 +
 drivers/ml/cnxk/cn10k_ml_model.c       |  84 +++--
 drivers/ml/cnxk/cn10k_ml_model.h       |  12 +
 drivers/ml/cnxk/cn10k_ml_ops.c         | 135 +++-----
 lib/mldev/meson.build                  |   2 +-
 lib/mldev/mldev_utils.c                |  30 --
 lib/mldev/mldev_utils.h                |  16 -
 lib/mldev/rte_mldev.c                  |  50 +--
 lib/mldev/rte_mldev.h                  | 201 +++++-------
 lib/mldev/rte_mldev_core.h             |  68 +---
 lib/mldev/version.map                  |   3 -
 19 files changed, 521 insertions(+), 555 deletions(-)

Comments

Thomas Monjalon Oct. 11, 2023, 2:45 p.m. UTC | #1 
02/10/2023 11:58, Srikanth Yalavarthi:
> This series implements changes to mldev spec to extend support
> for ML models with multiple inputs and outputs. Changes include
> introduction of I/O layout to support packed and split buffers
> for model input and output. Extended the rte_ml_model_info
> structure to support multiple inputs and outputs.
> 
> Updated rte_ml_op and quantize / dequantize APIs to support an
> array of input and output ML buffer segments.
> 
> Support for batches option is dropped from test application.

Applied, thanks.