search

weaviate / recipes

This repository shares end-to-end notebooks on how to use various Weaviate features and integrations!
552 stars 104 forks source link

Add weaviate + dspy + langwatch recipe #104

Closed rogeriochaves closed 3 months ago

rogeriochaves commented 3 months ago

Description

The PR adds a cookbook on how to build and optimize a RAG with DSPy, that uses Weaviate as a retriever, and LangWatch to visualize the optimization process.

I've used the WeaviateBlogChunk for filling the database and the WeaviateBlogRAG-0-0-0.json as a dataset, using gpt-4o teacher to optimize a gpt-4o-mini student using MIPROv2

At the end, we also exemplify how to use and instrument a DSPy program in production.

Contribution Type

Promotion

weaviate-git-bot commented 3 months ago

To avoid any confusion in the future about your contribution to Weaviate, we work with a Contributor License Agreement. If you agree, you can simply add a comment to this PR that you agree with the CLA so that we can merge.

beep boop - the Weaviate bot 👋🤖

PS:
Are you already a member of the Weaviate Slack channel?

rogeriochaves commented 3 months ago

I agree

erika-cardenas commented 3 months ago

Thanks for the PR @rogeriochaves! I'll review it today or tomorrow 🙂