-
## ざっくり言うと
GPT-3などのzero-shotで使われているpromptingの考えと、pretrain-finetuneの考えを組み合わせた"instruction tuning"を提案した。"instruction tuning"は入力文内にタスク内容の説明文を含める学習方法で、タスクの説明文からその問題の解き方を学習させたいという意図がある。結果としてzero-shotの精度を向…
-
# URL
- https://arxiv.org/abs/2301.08721
# Affiliations
- Zhoujun Cheng, N/A
- Jungo Kasai, N/A
- Tao Yu, N/A
# Abstract
- Performing inference on large volumes of samples with large language …
-
- [ ] [ClipNotes for paper: GPTScore - Evaluate as you desire](https://github.com/jinlanfu/GPTScore)
# GPTScore: Evaluate as You Desire
## Introduction
Assessing the quality of generated text is an…
-
# URL
- https://arxiv.org/abs/2310.12342
# Affiliations
- Yongqi Tong, N/A
- Yifan Wang, N/A
- Dawei Li, N/A
- Sizhe Wang, N/A
- Zi Lin, N/A
- Simeng Han, N/A
- Jingbo Shang, N/A
# Abstr…
-
### Prerequisite
- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expe…
-
-
Hello, I want to figure out one thing,
firstly, you reversed the labels in WGDataset:
` for entry in data:
label = entry[0]
alternative1 = entry[2]
a…
-
# URL
- https://arxiv.org/abs/2309.15427
# Affiliations
- Yijun Tian, N/A
- Huan Song, N/A
- Zichen Wang, N/A
- Haozhu Wang, N/A
- Ziqing Hu, N/A
- Fang Wang, N/A
- Nitesh V. Chawla, N/A…
-
### Description
The texts are overlapping in this selection. The Table and the texts should not overlap.
### (Optional:) Please add any files, screenshots, or other information here.
_No response_
…
-
The paper mentions taking the last 300 examples for math reasoning, but I can't seem to find that for Commonsense.
Thanks!