Currently, models are fed data image-by-image. This is not efficient, and ideally they will be able to take a batch of images at one time to create predictions.
Determine how to enable image batching, and create a NEW endpoint that will be able to batch upload images at /model/batch_predict.
Do not worry about compatibility with existing micro-services, as they can be updated later to fit this new pattern and the old endpoint still exists.
Currently, models are fed data image-by-image. This is not efficient, and ideally they will be able to take a batch of images at one time to create predictions.
Determine how to enable image batching, and create a NEW endpoint that will be able to batch upload images at /model/batch_predict.
Do not worry about compatibility with existing micro-services, as they can be updated later to fit this new pattern and the old endpoint still exists.