jonfairbanks / local-rag

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.
GNU General Public License v3.0
535 stars 64 forks source link

exporting / reimporting of indexed data? #35

Closed wolfspyre closed 8 months ago

wolfspyre commented 8 months ago

once the data's been indexed.. it'd be neat if one could export it in a durable fashion... preferably one that would be easy for other LLM tooling to use for training... but at least so that it could be easily consumed by local-rag later... rather than having to reindex the same data any time the app glitches