Select GPU for Embedding Process

[Mingzefei]

My system has two GPUs:

• GPU0: An NVIDIA GPU with higher computational power.
• GPU1: An integrated GPU with lower performance.

When running the embedding process, the plugin defaults to GPU1 (the integrated GPU), which results in slower performance. I would like to utilize GPU0 instead.

Is it possible to add an option for users to select which GPU to use for the embedding process? Or, alternatively, could the plugin automatically detect and select the more powerful GPU by default?

Environment:

• Plugin Version: 2.2.79
• OS: Windows 10
• Hardware:
  • GPU0: NVIDIA GeForce RTX 3050 Ti Laptop GPU
  • GPU1: AMD Raden(TM) Graphics

Thank you for your help and for the great work on this plugin!

[brianpetro]

Hi @Mingzefei

I don't think this is currently possible using the open-source huggingface transformers.js module that Smart Connections utilizes for local embeddings.

If the option becomes available in the future, then passing that option through as a setting to SC should be pretty straightforward.

🌴