Adapt upload-route to use new Document Class

mt7180 / quaigle

RAG-based LLM application: project to explore different llm-frameworks like llamaindex, marvin and langchain, other used frameworks: streamlit, fastapi

1 stars 1 forks source link

Adapt upload-route to use new Document Class #16

Closed mt7180 closed 1 year ago

mt7180 commented 1 year ago

The class LlamaTextDocument loads and converts a text file into LlamaIndex nodes and a marvin ai_model predicts the text category and gives a short summary of the text.

[x] make usage of the LlamaTextDocument class by instanciating it with the UploadFile filename
[x] implement callback_manager to get information about the used token amount
[x] use the callback manager while classifying and summarizing the text of the document and hand over to logging in debug mode

mt7180 commented 1 year ago

the class for the custom chat engine as well as the class for the ai parsed (extracted metadata) documents are both located in script.py, which is imported by fastapi_app.py (backend).

Finally, I created the upload route to upload and process a text document.