search

explodinggradients / ragas

Supercharge Your LLM Application Evaluations 🚀
https://docs.ragas.io
Apache License 2.0
6.93k stars 696 forks source link

[R-297] 🚨 Migration Help from v0.1 to v0.2 #1486

Open jjmachan opened 5 days ago

jjmachan commented 5 days ago

With V0.2 there has been some breaking changes will use this form to help everyone have a smooth transition and clear and questions 🙂 .

This will also help us improve the migration docs

R-297

Twist333d commented 4 days ago

@jjmachan again, an awesome job and congratz on the 0.2.0 release!

Couple of things:

  1. There are missing md files under Customizations -> Testset Generation
  2. As a user of previous testset generator, I couldn't find any guide on how to transition the dataset generator from 0.1.* to 0.2
jjmachan commented 4 days ago

hey @Twist333d thanks a lot for pointing out the missing link - will fix that 🙂. But right now we don't have it well documented - points to a a 'talk-to-us' page because we were not sure how users are looking to customize it and wanted to help them on a one-off basis.

as for migration could you share a bit more about how your using testset generation today? I'll help you migrate it and then I'll add it to the docs so that it helps others as well.

Twist333d commented 4 days ago

Thanks for a prompt reply @jjmachan! Got it :)

With regards to my own testset geneneration needs - I currently use it to generate smaller (10-50 question) dataset for my open-source RAG app. Currently at least I am in the initial stages of implementation, and I often re-create or re-run dataset creation process so that's why I was curious about migration in general.

My previous flow:

I've already migrated to 0.2 so seems like the current docs are sufficient, but having more guidance never hurts I would say :)