Implement required changes to the pipeline to make Gaia the primary provider for embeddings generation

raid-guild / gaianet-rag-api-pipeline

Supercharge your Gaianet node by generating a vector knowledge base from any API. Demo slides: https://hackmd.io/@santteegt/ByoykY4nC#/ Link to Docs below

https://raid-guild.github.io/gaianet-rag-api-pipeline/

MIT License

1 stars 0 forks source link

Implement required changes to the pipeline to make Gaia the primary provider for embeddings generation #48

Closed santteegt closed 6 days ago

santteegt commented 2 weeks ago

Waiting for findings in #44 to define the neccesary steps to work on this ticket

santteegt commented 6 days ago

Updated CLI now uses GaiaNet node as default LLM provider
A GaiaNet node should be started in embeddings-only mode by running the following command:

cd $HOME/gaianet
wasmedge --dir .:./dashboard --env NODE_VERSION=0.4.7 \
  --nn-preload embedding:GGML:AUTO:nomic-embed-text-v1.5.f16.gguf llama-api-server.wasm \
  --model-name Nomic-embed-text-v1.5 --model-alias embedding --prompt-template embedding \
  --ctx-size 8192 --batch-size 768 --web-ui ./ --socket-addr 0.0.0.0:8080