search

neo4j-labs / llm-graph-builder

Neo4j graph construction from unstructured data using LLMs
https://neo4j.com/labs/genai-ecosystem/llm-graph-builder/
Apache License 2.0
2.54k stars 404 forks source link

Logic behind the app(Application Blog) #771

Open mystvearn opened 1 month ago

mystvearn commented 1 month ago

I've been doing extensive testing the method on medical question answering and so far it works great. However the logic behind document processing and retrieval seems complicated just by looking at the code. For example I realized that 52 pages of context being stuffed into the LLM prompt. I wonder how could the LLM (GPT-4o) handle that much context. Secondly the processing time seems to be much faster in my application, where I stuffed in only 10 chunks (equivalent to approximately 4 pages only).

Any diagram to visualize the process of chunking, entities extraction, community formulation, post-processing, retrieval process ... will be much appreciated and believed to be useful for any body.

kartikpersistent commented 1 month ago

Hi @mystvearn we are writing a blog about our application and it will be released soon until you can go through this link. Detailed walkthrough

bamalburg commented 3 weeks ago

Yes I agree, having more documentation (a blog post, diagrams, etc.) that describe or show how the app works, in detail, would be really great! Especially the retrieval process (for each different "chat mode"). (Obviously you can figure it all out by looking through the code, but some documentation/diagrams would make it much easier/quicker to understand)