Describe the bug
After integrating the Custom ML backend with the Label-Studio and while during the annotation on the particular file. it throws up the warning [ml.models::predict_tasks::183] [WARNING] 'ML backend 'Staged Model' doesn't support batch processing of tasks, switched to one-by-one task retrieval and the prediction call is getting twice for the same file.
Need to know why it occurs two times at the backend and it has to be fixed with the single call to the backend.
This even occurs for the simple text classifier in the provided example.
Initialize and set up an ML backend for getting auto-prediction. It will be served with a particular host.
For a label-studio project, set up the ML and add a model with the host IP.
Select this preference in Machine Learning (Show predictions to annotators in the Label Stream and Quick View)
Upload a new file and click the file for the annotation.
Check for the logs, you can notice that the following warning occurs.
[2021-11-18 05:22:20,285] [ml.models::predict_tasks::183] [WARNING] 'ML backend 'Staged Model' doesn't support batch processing of tasks, switched to one-by-one task retrieval
Expected behavior
It is expected to take a single call for the prediction.
Screenshots
At the Custom-ML Backend Server
Logs at the Label-Studio
Environment (please complete the following information):
Describe the bug After integrating the Custom ML backend with the Label-Studio and while during the annotation on the particular file. it throws up the warning
[ml.models::predict_tasks::183] [WARNING] 'ML backend 'Staged Model' doesn't support batch processing of tasks, switched to one-by-one task retrieval
and the prediction call is getting twice for the same file.Need to know why it occurs two times at the backend and it has to be fixed with the single call to the backend.
This even occurs for the simple text classifier in the provided example.
Parent ticket: https://github.com/heartexlabs/label-studio-ml-backend/issues/64
To Reproduce Steps to reproduce the behavior:
Show predictions to annotators in the Label Stream and Quick View
)[2021-11-18 05:22:20,285] [ml.models::predict_tasks::183] [WARNING] 'ML backend 'Staged Model' doesn't support batch processing of tasks, switched to one-by-one task retrieval
Expected behavior It is expected to take a single call for the prediction.
Screenshots
Environment (please complete the following information):