-
Thank you for your valuable contributions. I've been eager to examine the datasets in your repository. However, upon inspection of the data folder, I noticed that the datasets, particularly the 'list …
-
We are seeking detailed clarification on the OpenGPTs License terms, particularly given its contrast with common open-source licenses like Apache 2.0 and MIT. OpenGPTs is promoted as a free alternativ…
wfjt updated
8 months ago
-
# GPT Prompt 提示词工程
-
python main.py \
> --model hf-causal-experimental \
> --model_args pretrained=../LLaMA-Efficient-Tuning/model/Baichuan-13B-Instruction \
> --tasks Ceval-valid-* \
> --device cuda:0…
-
Hi, when install this pkg with pip:
```
pip install lm-eval
```
or through git:
```
pip install git+https://github.com/EleutherAI/lm-evaluation-harness.git
```
This will not package the file i…
-
Hi,
Im planning to train a model on this data and then evaluate on BigBenchHard. Is any of the BBH data in here?
Thanks
-
The goal here is to extract out the string value of the first key in each item in the `examples` list.
```
!format
https://raw.githubusercontent.com/google/BIG-bench/main/bigbench/benchmark_tasks…
-
The info [here](https://github.com/google/BIG-bench/blob/main/docs/doc.md#testing-and-submitting) and [here](https://github.com/google/BIG-bench/pull/830#discussion_r888249152) lead me to believe that…
-
We want to be able to evaluate our models on BIG-Bench Lite. The BIGBench code is not the most outsider-friendly so I'll try to add the BigBench lite tasks to the eval-harness, and test on GPT2 for eq…
-
As suggested by @severo:
> should we remove the dependency to torch and torchaudio? cc @polinaeterna
- [ ] #1282
- [ ] Remove torch