-
Hello!
I am trying to reproduce commonsense reasoning numbers on LLaMA with this run script: https://github.com/stanfordnlp/pyreft/tree/main/examples/loreft#commonsense-reasoning-tasks
But my ev…
-
We'll try a slightly different format for our meeting notes this summer, and keep them all in a single thread. This is it!
-
A preregistration based on the As Predicted template.
## Registration
### Data collection. Have any data been collected for this study already?
> Yes, we already collected the data.
> **No, no…
-
- [ ] [awesome-llm-planning-reasoning/README.md at main · samkhur006/awesome-llm-planning-reasoning](https://github.com/samkhur006/awesome-llm-planning-reasoning/blob/main/README.md?plain=1)
# awesom…
-
Check how GPT labels statements on our labeling task. Use $Global R^2 = 1-\frac{mse(prediction,actual)}{mse(baseline,actual)}$ to score, and we can visualize in observable.
Would be nice to see ho…
-
When I'm doing the evaluation, should I use _--load_8bit_? I'm trying to reproduce the results of LLaMa-7B-LoRA
Finetune:
`CUDA_VISIBLE_DEVICES=8 python finetune.py --base_model 'yahma/llama-7b-…
-
Hi
@VictorSanh
Thanks for releasing the code and data. I am trying to retrain it in pytorch
Some questions , in your paper you have p=1 vs p=5.7 results
Say for p=1 we take one random promp…
-
This is a list of tasks not yet in ParlAI that would be great to have. Feel free to add more to the list also! We will remove individual items when they are done.
Chit Chat
- [x] DailyDialog htt…
-
**Submitting author:** @hellokayas (Sayak Chakrabarty)
**Repository:** https://github.com/souradipp76/MM-PoE
**Branch with paper.md** (empty if default branch): main
**Version:** v0.1.2
**Editor:** @f…
-
Thanks for the great work! I'm also using FLAN for training, so I'm wondering how to include only tasks that are in Tasksource but not in FLAN.