Closed osma closed 1 year ago
PR #663 is going to bring support for batch suggest operations.
The SVC backend could benefit from implementing _suggest_batch instead of _suggest. It could process a batch of texts with parallel and/or vector operations.
PR #663 is going to bring support for batch suggest operations.
The SVC backend could benefit from implementing _suggest_batch instead of _suggest. It could process a batch of texts with parallel and/or vector operations.