search

hegelai / prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
http://prompttools.readthedocs.io
Apache License 2.0
2.65k stars 230 forks source link

ChromaDB Experiment and tests #21

Closed HashemAlsaket closed 1 year ago

HashemAlsaket commented 1 year ago

@steventkrawczyk @NivekT I started implementing the ChromaDB code to kick off vector db integration

On building the test for the experiment, I think it might be worth considering an additional framework to prompttest to support inputs represented as vectors before being sent to prompttest. It feels like trying to integrate prompts and raw representations in the same module will get a bit sticky. I can see how fundamentally it is the same process, but from a user's experience, templating and other gotchas can get in the way at a semantic level. Thoughts? Thanks!

NivekT commented 1 year ago

Merged in c7c3ec014340c12453f8cd7dcbaef344e56898a2