Open Iternal-JBH4 opened 1 month ago
+1
+1 gpt4omini is already in main branch, just wait for graphRag now.
+1
As the indexing seems very complex to build plus it requires a graph database I wonder if you have tried out indexing your data through the solution accelerator provided by MS?
@HenryHengZJ correct me if I'm wrong but the best way to tackle this would be to have an Azure AI Search (as they have for Langchain python now) Tool. At least we could then query that graph index.
I'll try playing around with this architecture this week. But as of now I think the indexing is too complex to be a out-of-the-box no-brainer for flowise.
Hope this helps https://js.langchain.com/v0.2/docs/tutorials/graph/
yeah we are still tinkering how to make it easy to do it on Flowise, as GraphRAG does involves much more technnical challenges
I cannot wait to see this feature for flowise Thank you all Devs
+1
+1
+1
+1
Just to keep you up to date: https://neo4j.com/developer-blog/global-graphrag-neo4j-langchain/
Check out this blog post which goes in detail into how to build a proper graph using langchain that's like MS Paper. It's expensive.. and somewhat complex. At least the indexing
FYI I've been testing graphRAG with GPT4-turbo and GPT4o-mini, switching from GPT4 to 4o-mini reduced cost from $50 indexing cost, down to ONLY $0.37 for same size indexing. Cost should no longer be a major factor in this type of approach, especially for static datasets.
I'm open to putting a bounty on this if anyone is interested.
+1
+1
GraphRAG (https://github.com/microsoft/graphrag) shows great promise of a more improved and effective method of RAG beyond simple document chunking.
With the introduction of more cost effective models such as GPT-4o-mini and future generations the cost of a GraphRAG approach to indexing can be significantly reduced.
Request is to add a GraphRAG component to flowise that can accept a multi-document / multi-source input which on upsert runs the GraphRAG indexing, and then can be queried like any other Flowise RAG chatflow for use with standard chat bots, chains, and Agents.
Thank you!
Yes PLEASE!
GraphRAG (https://github.com/microsoft/graphrag) shows great promise of a more improved and effective method of RAG beyond simple document chunking.
With the introduction of more cost effective models such as GPT-4o-mini and future generations the cost of a GraphRAG approach to indexing can be significantly reduced.
Request is to add a GraphRAG component to flowise that can accept a multi-document / multi-source input which on upsert runs the GraphRAG indexing, and then can be queried like any other Flowise RAG chatflow for use with standard chat bots, chains, and Agents.
Thank you!