mbox series

[v3,0/4] Spec changes to support multi I/O models

Message ID 20230927181159.9794-1-syalavarthi@marvell.com (mailing list archive)
Headers
Series Spec changes to support multi I/O models |

Message

Srikanth Yalavarthi Sept. 27, 2023, 6:11 p.m. UTC 
  This series implements changes to mldev spec to extend support
for ML models with multiple inputs and outputs. Changes include
introduction of I/O layout to support packed and split buffers
for model input and output. Extended the rte_ml_model_info
structure to support multiple inputs and outputs.

Updated rte_ml_op and quantize / dequantize APIs to support an
array of input and output ML buffer segments.

Support for batches option is dropped from test application.

v3:
  - Added release notes for 23.11

v2:
  - Minor fixes
  - Cleanup of application help

v1:
  - Initial changes

Srikanth Yalavarthi (4):
  mldev: add support for arbitrary shape dimensions
  mldev: introduce support for IO layout
  mldev: drop input and output size get APIs
  mldev: update release notes for 23.11

 app/test-mldev/ml_options.c            |  16 -
 app/test-mldev/ml_options.h            |   2 -
 app/test-mldev/test_inference_common.c | 420 +++++++++++++++++--------
 app/test-mldev/test_inference_common.h |   6 +
 app/test-mldev/test_model_common.c     |   6 -
 app/test-mldev/test_model_common.h     |   1 -
 doc/guides/rel_notes/release_23_11.rst |  15 +
 doc/guides/tools/testmldev.rst         |   6 -
 drivers/ml/cnxk/cn10k_ml_dev.h         |   3 +
 drivers/ml/cnxk/cn10k_ml_model.c       |  84 +++--
 drivers/ml/cnxk/cn10k_ml_model.h       |  12 +
 drivers/ml/cnxk/cn10k_ml_ops.c         | 135 +++-----
 lib/mldev/meson.build                  |   2 +-
 lib/mldev/mldev_utils.c                |  30 --
 lib/mldev/mldev_utils.h                |  16 -
 lib/mldev/rte_mldev.c                  |  50 +--
 lib/mldev/rte_mldev.h                  | 201 +++++-------
 lib/mldev/rte_mldev_core.h             |  68 +---
 lib/mldev/version.map                  |   3 -
 19 files changed, 521 insertions(+), 555 deletions(-)