neo4j-labs / llm-graph-builder

Neo4j graph construction from unstructured data
Apache License 2.0
344 stars 88 forks source link

Question on Compatibility of Embeddings #476

Open rmccorkl opened 4 days ago

rmccorkl commented 4 days ago

Apologise this is more a question , If you define the embedding model

EMBEDDING_MODEL="openai"

But then use different models for different documents

LLM_MODELS="gpt-3.5, gpt-4"

  1. DocA uses gpt-3.5
  2. DocB used gpt-4

Is this generally acceptable when querying the GRAG (graphical RAG), or is it best to stick to one model across the graph ?

I'm thinking the embeddings generated by different models like GPT-3.5 and GPT-4 might not be directly comparable or interoperable due to differences in model architecture, training data, and resultant vector spaces.

Thanks in advance