raid-guild / gaianet-rag-api-pipeline

Supercharge your Gaianet node by generating a vector knowledge base from any API. Demo slides: https://hackmd.io/@santteegt/ByoykY4nC#/ Link to Docs below
https://raid-guild.github.io/gaianet-rag-api-pipeline/
MIT License
1 stars 0 forks source link

Integrate ollama for embeddings generation #40

Closed santteegt closed 2 months ago

santteegt commented 2 months ago

Ollama was successfully tested on a local computer for loading an embedding model and generate vector embeddings from chunked data. It could handle a load of data in the order of 100k records without breaking and in ~3 hours (Mac Studio with M1 chip). The following actions are needed for integrating it into the pipeline: