search

dvmazur / mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops
MIT License
2.28k stars 223 forks source link

Can it run with LlamaIndex? #16

Open LeMoussel opened 6 months ago

LeMoussel commented 6 months ago

Is it possible to use mixtral-offloading with llamaindex to construct a RAG? If yes, do you have an example?