dylanhogg / llmgraph

Create knowledge graphs with LLMs
MIT License
339 stars 27 forks source link

Does it work with other LLM models: Claude/anthropic #12

Open mahamatnoumai opened 2 months ago

mahamatnoumai commented 2 months ago

Hi there,

I found your llmgraph looks interesting, I would like to use it, just wondering if it would work with other LLM models beside current defauts one.

I am trying to test it using CLAUDE google LLM model.

Thank you

dylanhogg commented 2 months ago

You can specify a different LLM provider, including running with a local https://github.com/jmorganca/ollama model.

You should be able to specify (via the --llm-model argument, see docs here) anything supported by LiteLLM as described here: https://docs.litellm.ai/docs/providers

You'll find Claude models under the Anthropic provider: https://docs.litellm.ai/docs/providers/anthropic

Note that the prompts to extract related entities were tested with OpenAI and may not work as well with other models.

Thanks for your interest in the project.