jonfairbanks / local-rag

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.
GNU General Public License v3.0
449 stars 52 forks source link

exporting / reimporting of indexed data? #35

Closed wolfspyre closed 3 months ago

wolfspyre commented 3 months ago

once the data's been indexed.. it'd be neat if one could export it in a durable fashion... preferably one that would be easy for other LLM tooling to use for training... but at least so that it could be easily consumed by local-rag later... rather than having to reindex the same data any time the app glitches