search

langchain-ai / langsmith-cookbook

https://langsmith-cookbook.vercel.app
783 stars 149 forks source link

Benchmarking candidate against prod #209

Closed hinthornw closed 8 months ago

hinthornw commented 8 months ago
  1. Sample runs from project.
  2. Map run inputs to dataset inputs
  3. Copy over runs as a new test against this dataset - this is the baseline
  4. Run new system against new dataset
vercel[bot] commented 8 months ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
langsmith-cookbook ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 19, 2024 1:53am