FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
29.42k stars 15.22k forks source link

[FEATURE] GraphRAG + Flowise #2837

Open Iternal-JBH4 opened 1 month ago

Iternal-JBH4 commented 1 month ago

GraphRAG (https://github.com/microsoft/graphrag) shows great promise of a more improved and effective method of RAG beyond simple document chunking.

With the introduction of more cost effective models such as GPT-4o-mini and future generations the cost of a GraphRAG approach to indexing can be significantly reduced.

Request is to add a GraphRAG component to flowise that can accept a multi-document / multi-source input which on upsert runs the GraphRAG indexing, and then can be queried like any other Flowise RAG chatflow for use with standard chat bots, chains, and Agents.

Thank you!

delinecnlin commented 1 month ago

+1

Mzaxd commented 1 month ago

+1 gpt4omini is already in main branch, just wait for graphRag now.

lucasbuges commented 1 month ago

+1

sirsimonson commented 1 month ago

As the indexing seems very complex to build plus it requires a graph database I wonder if you have tried out indexing your data through the solution accelerator provided by MS?

@HenryHengZJ correct me if I'm wrong but the best way to tackle this would be to have an Azure AI Search (as they have for Langchain python now) Tool. At least we could then query that graph index.

I'll try playing around with this architecture this week. But as of now I think the indexing is too complex to be a out-of-the-box no-brainer for flowise.

zryf2000 commented 1 month ago

Hope this helps https://js.langchain.com/v0.2/docs/tutorials/graph/

HenryHengZJ commented 1 month ago

yeah we are still tinkering how to make it easy to do it on Flowise, as GraphRAG does involves much more technnical challenges

asrguru20 commented 1 month ago

I cannot wait to see this feature for flowise Thank you all Devs

Pierre-Cyber commented 1 month ago

+1

Hbmr9000 commented 1 month ago

+1

sonmitdev commented 1 month ago

+1

ysatnaf commented 1 month ago

+1

sirsimonson commented 4 weeks ago

Just to keep you up to date: https://neo4j.com/developer-blog/global-graphrag-neo4j-langchain/

Check out this blog post which goes in detail into how to build a proper graph using langchain that's like MS Paper. It's expensive.. and somewhat complex. At least the indexing

Iternal-JBH4 commented 2 weeks ago

FYI I've been testing graphRAG with GPT4-turbo and GPT4o-mini, switching from GPT4 to 4o-mini reduced cost from $50 indexing cost, down to ONLY $0.37 for same size indexing. Cost should no longer be a major factor in this type of approach, especially for static datasets.

I'm open to putting a bounty on this if anyone is interested.

kstan79 commented 2 weeks ago

+1

haimco50 commented 1 week ago

+1

googlepoke commented 3 days ago

GraphRAG (https://github.com/microsoft/graphrag) shows great promise of a more improved and effective method of RAG beyond simple document chunking.

With the introduction of more cost effective models such as GPT-4o-mini and future generations the cost of a GraphRAG approach to indexing can be significantly reduced.

Request is to add a GraphRAG component to flowise that can accept a multi-document / multi-source input which on upsert runs the GraphRAG indexing, and then can be queried like any other Flowise RAG chatflow for use with standard chat bots, chains, and Agents.

Thank you!

Yes PLEASE!