search

tmc / langchaingo

LangChain for Go, the easiest way to write LLM-based programs in Go
https://tmc.github.io/langchaingo/
MIT License
4.21k stars 585 forks source link

Run vector stores tests on CI #623

Open mdelapenya opened 6 months ago

mdelapenya commented 6 months ago

Hi @tmc thanks for considering testcontainers-go as a testing library for the integration tests (https://github.com/tmc/langchaingo/pull/519) 🙇 I'm super excited to be able to help out here if possible.

Do you have a plan for running the vector store tests on the CI: I know that they need a valid OPENAI_API_KEY to work, so not sure if we should have a strategy to run the tests with a certain cadence: in front of any PR, only merge commits, releases, nightly builds etc. Do you have anything in mind?

Once we have that I could start contributing the store modules so they can be executed on the CI with the given frequency.

Thanks!

mdelapenya commented 6 months ago

BTW, I have a local branch using the recently added testcontainers-go modules for the vector databases, and using a valid OPENAI_API_KEY, and they work! If we have the key in a secret for the main repo, then it's doable

tmc commented 6 months ago

Open to having that key in CI, may need to control when those run as to prevent possible exfil.

mdelapenya commented 6 months ago

Do we have access to the openAi folks for a key? I used one from my company for a quick test, although I noticed several runs ended up in 429 errors.

Do you know how other langchain projects do that? I think I can check with the Java flavour folks 🤔