raid-guild / gaianet-rag-api-pipeline

Supercharge your Gaianet node by generating a vector knowledge base from any API. Demo slides: https://hackmd.io/@santteegt/ByoykY4nC#/ Link to Docs below
https://raid-guild.github.io/gaianet-rag-api-pipeline/
MIT License
1 stars 0 forks source link

2.1.4 Plug Gaia Node into Pipeline #20

Closed earth2travis closed 2 months ago

earth2travis commented 3 months ago

Integrate the Gaia node with the data pipeline. The connection should enable seamless data flow between the pipeline and the node, ensuring that the processed data can be embedded and stored efficiently. Successful integration is essential for maintaining the integrity and performance of the entire system.

santteegt commented 2 months ago

Some progress on this has already been done at the data pipeline level in #12

wtfsayo commented 2 months ago

@santteegt would recommend using phi3-mini-4k-instruct as output model, its the most available model on gaianet See here