-
Basically the title. I have just started with getting into rag evaluation and came across your repo with truelens. Curious as to why gemni pro. I don't have access to pro yet.
-
#### Goal
- 다양한 모델 / task / Parameter Efficient Fine-tuning에 대하여 BF16 training 시 성능 관찰 및 분석
#### Role
- 대표적인 PEFT 방법으로 4~5개 NLP/Mulit-modal task에 대해서 BF16 finetuning 때 성능 비교분석
-
[x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
Hi, I'm currently getting into evaluation of my RAG-system but had a prob…
-
P0
- [x] Create menu/basic pulling from the existing menu section https://github.com/firebase/genkit/pull/57
- [x] Replace genkit init output with "menuSuggestionFlow" & modify documentation for Ge…
-
Hello,
Thank you for your great work, I managed to run the code with the provided dataset.
However, I have been exploring the repository as well as the paper and noticed that the method for prepar…
-
Hi team,
First of all, thanks for putting all of these together! It is amazingly great coverage and depth on the subject. The best I have seen so far. Super well done!
I am wondering whether yo…
-
This task involves automating the current 'precheck' stage which currently involves a human 'triage-er' to validate whether the student model already knows the information which a user is trying to te…
-
-
I currently get this error when passing a local function to evaluate:
promptflow.exceptions.UserErrorException: Failed to import from module , please make sure it's a global function.
That is d…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I use ragas to evaluate my RAG system. For now, I have 100 qu…