mbox series

[v2,0/3] Spec changes to support multi I/O models

Message ID 20230920071910.10428-1-syalavarthi@marvell.com (mailing list archive)
Headers
Series Spec changes to support multi I/O models |

Message

Srikanth Yalavarthi Sept. 20, 2023, 7:19 a.m. UTC 
  This series implements changes to mldev spec to extend support
for ML models with multiple inputs and outputs. Changes include
introduction of I/O layout to support packed and split buffers
for model input and output. Extended the rte_ml_model_info
structure to support multiple inputs and outputs.

Updated rte_ml_op and quantize / dequantize APIs to support an
array of input and output ML buffer segments.

Support for batches option is dropped from test application.

v2:
  - Minor fixes
  - Cleanup of application help

v1:
  - Initial changes

Srikanth Yalavarthi (3):
  mldev: add support for arbitrary shape dimensions
  mldev: introduce support for IO layout
  mldev: drop input and output size get APIs

 app/test-mldev/ml_options.c            |  16 -
 app/test-mldev/ml_options.h            |   2 -
 app/test-mldev/test_inference_common.c | 420 +++++++++++++++++--------
 app/test-mldev/test_inference_common.h |   6 +
 app/test-mldev/test_model_common.c     |   6 -
 app/test-mldev/test_model_common.h     |   1 -
 doc/guides/tools/testmldev.rst         |   6 -
 drivers/ml/cnxk/cn10k_ml_dev.h         |   3 +
 drivers/ml/cnxk/cn10k_ml_model.c       |  84 +++--
 drivers/ml/cnxk/cn10k_ml_model.h       |  12 +
 drivers/ml/cnxk/cn10k_ml_ops.c         | 135 +++-----
 lib/mldev/meson.build                  |   2 +-
 lib/mldev/mldev_utils.c                |  30 --
 lib/mldev/mldev_utils.h                |  16 -
 lib/mldev/rte_mldev.c                  |  50 +--
 lib/mldev/rte_mldev.h                  | 201 +++++-------
 lib/mldev/rte_mldev_core.h             |  68 +---
 lib/mldev/version.map                  |   3 -
 18 files changed, 506 insertions(+), 555 deletions(-)