Support for batch inference

weaviate / t2v-transformers-models

This is the repo for the container that holds the models for the text2vec-transformers module

BSD 3-Clause "New" or "Revised" License

39 stars 27 forks source link

Open MoaazZaki opened 1 year ago

MoaazZaki commented 1 year ago

Is there any plan to support batch inference, instead of single input ?

axeloh commented 11 months ago

This would definitely be a game changer