fix hf embedding to support loading to different device

HKUDS / LightRAG

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

https://arxiv.org/abs/2410.05779

MIT License

9.26k stars 1.14k forks source link

Closed davidleon closed 1 week ago

davidleon commented 1 week ago

as title. currently local hf model embed func doesn't take care of loading model to cuda.

LarFii commented 1 week ago

Thanks!