[Issue]: The prompt for each task request is too long

microsoft / graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

https://microsoft.github.io/graphrag/

MIT License

20.01k stars 1.96k forks source link

[Issue]: The prompt for each task request is too long #668

Closed hust-zXX closed 4 months ago

hust-zXX commented 4 months ago

Describe the issue

Taking the demo file A Christmas Carol by Charles Dickens as an example, after the knowledge graph is built, the tokens consumed by executing a question are almost the same as the entire article, reaching more than 100,000.

Steps to reproduce

No response

GraphRAG Config Used

No response

Logs and screenshots

No response

Additional Information

GraphRAG Version:
Operating System:
Python Version:
Related Issues:

AlonsoGuevara commented 4 months ago

Hi @hust-zXX If you're running Global Search this would be expected as this is an extensive operation over the Knowledge Graph. You can also run Local Search, which leverages embeddings to operate over "closer" entities.