-
### Checklist
* fine-tuning with different open/closed-source LLMs;
* benchmarking & evaluation;
* cost estimation;
-
## Goal
Experiment on WhisperVQ model for better result on multilingual. Hypothesis the current codebook is only 512 which is a small space to compress the multilingual capability.
## Learning Goa…
-
# URL
- https://arxiv.org/abs/2411.11072
# Authors
- Shaolin Zhu
- Supryadi
- Shaoyang Xu
- Haoran Sun
- Leiyu Pan
- Menglong Cui
- Jiangcun Du
- Renren Jin
- António Branco
- Deyi…
-
### GitHub Issue Title:
Problem with `answer_relevancy` Metric in Ragas Framework
### Description:
Hello,
I am experiencing an issue with the Ragas evaluation framework when using the `answer_…
-
https://github.com/rlancemartin/auto-evaluator
https://autoevaluator.langchain.com/
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain.js documentation with the integrated search.
- [X] I used the GitHub search to find a …
-
按照教程走没有发现不一样地方,运行训练代码报错、;
`(langgpt) root@intern-studio-50152060:~/InternLM/XTuner# xtuner train ./internlm2_chat_1_8b_qlora_alpaca_e3_copy.py
/root/.conda/envs/langgpt/lib/python3.10/site-packages/…
-
- [ ] [evidently/README.md at main · evidentlyai/evidently](https://github.com/evidentlyai/evidently/blob/main/README.md?plain=1)
# evidently/README.md at main · evidentlyai/evidently
## Evidently
…
-
Hello, greetings from **the software engineering group from Beihang University**, China. We have been working on **the evaluation of Domain Specific Modeling Languages (DSMLs )**, the main purpose is …
-
Here is my result:
![image](https://github.com/user-attachments/assets/8926ce7f-17a0-490c-9ef2-912c59bbdb67)
and my code:
```
import typing as t
import asyncio
from typing import List
from …