search

weaviate / t2v-transformers-models

This is the repo for the container that holds the models for the text2vec-transformers module
BSD 3-Clause "New" or "Revised" License
42 stars 27 forks source link

Multi-GPU support #58

Open ghost opened 1 year ago

ghost commented 1 year ago

Is it possible to use Weaviate with multi-GPUs? For example, we can see only one of the GPUs being used in our machine.

trengrj commented 1 year ago

The modules just use a single GPU but you can run multi modules and load balance between them. @antas-marcin has an example of this.

ghost commented 1 year ago

Dear @antas-marcin , Is there any chance you could share the example @trengrj mentions, please? It would be amazing to learn how to run multi modules? Or any other methods to reduce the search and question answering time, with multi GPUs or without extra GPUs. Many Thanks in advance.