Langchaingo can't handle latest embedding models

tmc / langchaingo

LangChain for Go, the easiest way to write LLM-based programs in Go

https://tmc.github.io/langchaingo/

MIT License

4.48k stars 610 forks source link

Langchaingo can't handle latest embedding models #946

Open chew-z opened 3 months ago

chew-z commented 3 months ago

Langchaingo is using indirectly github.com/pkoukk/tiktoken-go v 0.1.6 while newer OpenAI embedding models (text-embedding-3-small, text-embedding-3-large) had been added in 0.1.7...

kill3rstabs commented 2 months ago

I cant seem to to figure out in examples how are embedding models of huggingface can be used as, in every example llm model is used for embedding