-
https://ksy.moe/pandora/hentaisr/
You should update it to compare against AnimeVideoV3, not shitty V2 model
It would also be nice to have it on slow.pics instead of your site, so I can more easily c…
-
**Context**
When running the evaluators over larger datasets, depending on the model, it is very common to run into LLM errors where the output is not valid JSON. For example, while running the ben…
-
您好，总结和翻译这一步提示
ValueError: [red]❌ Faithfulness translation of block 1 failed after 3 retries. Please ch…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am able to calculate 4 metrics {'faithfulness': 1.0000, 'an…
-
@francojc
Dear Professor Francom, this is Yuncheng Ni finally finished my literature review on project step 2. I combined my research with my learning from Professor Zhu's class as well. I believe th…
-
[2024-07-05 11:14:35,572] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[WARNING] async_io requires the dev libaio .so object and headers but these w…
-
[X] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
what is unclear to you? What would you like to know?
…
-
Hi, I came across FactKB in a project to evaluate summarization and found it useful for my study. I tried to run the code and found that the pretrained model only accepts max 512 tokens which seems to…
-
https://arxiv.org/abs/2304.11633
-
I've been enjoying the Weave library quite a bit, but I have been running into an issue using the Evaluate method. The issue is that 20% of the time, when running my evaluation, I get the `Runtime Err…