Implement a static method for the model class, accepting a list of models of that type, that can provide batched prediction for that list of models. In case it is not implemented, just call predict on each model.
A custom batched predict task could be significantly faster than looping over each model, calling predict and summing the predictions.
Implement a static method for the model class, accepting a list of models of that type, that can provide batched prediction for that list of models. In case it is not implemented, just call predict on each model.
A custom batched predict task could be significantly faster than looping over each model, calling predict and summing the predictions.