This PR adds postgres vecto.rs as vector storage and retrieval system as well as decouples the data fetching, embedding and inserting from the startup of the system. Thanks to @Silvan-WMDE for the fetcher implementation from #42
As haystack did not integrate with vecto.rs, and I also wanted to experiment with langchain to compare it to haystack, the retrieval is now implemented by langchain, leaving us with a funny mix of libraries. To be cleaned up.
This PR adds postgres vecto.rs as vector storage and retrieval system as well as decouples the data fetching, embedding and inserting from the startup of the system. Thanks to @Silvan-WMDE for the fetcher implementation from #42
As haystack did not integrate with vecto.rs, and I also wanted to experiment with langchain to compare it to haystack, the retrieval is now implemented by langchain, leaving us with a funny mix of libraries. To be cleaned up.
Closes #39