how to provide batch input data for dali pipeline whicn input shapes [-1] about dali_backend HOT 1 OPEN

Hello @DequanZhu
Triton accepts only requests with batches of uniformly sized samples.
The trick to batch together encoded images of different lengths is to pad them with zeros to equal size. The zeroed suffix will be ignored by the decoder.

Triton server can also take advantage of dynanmic_batching. It's enabled by default for DALI models and it accepts so called ragged_batches, so it can batch together samples of different shapes. This way, even when sending images of different lengths, server can batch them together if they arrive in a time window that is short enough (time window can be configured, see https://github.com/triton-inference-server/server/blob/main/docs/user_guide/model_configuration.md#dynamic-batcher)

from dali_backend.