-
This issue is now to track the implementation of various evaluation methods and workflows for LLMs.
Evaluations:
- [x] G-Eval
- [ ] PingPong
- [ ] InfiniteBench
- [ ] Ruler
- [ ] MMLU
- [ ] M…
-
-
A number of users have asked how to add new content to an existing index without needing to re-run the entire process. This is a feature we are planning, and are in the design stages now to ensure we …
-
[https://dl.acm.org/citation.cfm?id=1625736](https://dl.acm.org/citation.cfm?id=1625736)
-
-
### Motivation
## Motivation for Implementing Llama 3.2 lmdeploy Inference Engine Support
Llama 3.2's release presents a strong case for expanding lmdeploy with dedicated support:
* **Multi-mod…
-
## 論文リンク
https://arxiv.org/abs/1909.03186
## 公開日(yyyy/mm/dd)
2019/09/07
## 概要
文章要約タスクにおいて、重要な文を抽出するステップとそれを基に抽象的な文章を生成するステップに別れた複合的な手法を用いた。
この複合的な手法自体が全く新しいというものではないが、前者のステップに二つの Bi-directio…
-
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.79.8640&rep=rep1&type=pdf
-
Hi, can you provide any code for using your pretrained checkpoint for zero-shot summarization? And can the aspects be provided as slots or are they automatically extracted? Thanks :D
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hello all,
How can we do filtering by a particular document name and do Q&A only on t…