-
Testing rouge accuracy for Llama-2-70b-chat-hf model with summarize.py with fp8 quantization for 2-GPUs and 4-GPUs respectively.
Quantization follows the instructions [here](https://github.com/NVID…
-
### System Info
```shell
- `transformers` version: 4.20.0.dev0
- Platform: Linux-5.13.0-30-generic-x86_64-with-glibc2.29
- Python version: 3.8.10
- Huggingface_hub version: 0.6.0
- PyTorch versio…
-
I intend to use LLM2 to assist in evaluating the response of another LLM1.
Therefore, the vars for the first request will be passed to LLM2 again.
However, if the vars contain special characters (su…
-
#There probably be Fatal Error in evaluate_utils.py (see Line-106).
> `prompt_target = [prompt + ' ' + target for prompt, target in zip(prompts,targets)]`
> modified into:
> `prompt_target = …
-
### Is there an existing issue for the same bug?
- [X] I have checked the troubleshooting document at https://opendevin.github.io/OpenDevin/modules/usage/troubleshooting
- [X] I have checked the e…
-
When running ReEvo with the command `python main.py problem=tsp_aco`, an error occurs during the evaluation of the seed function, leading to a `RuntimeError`. The error message suggests that the see…
-
Subscribe to this issue and stay notified about new [daily trending repos in Svelte](https://github.com/trending/svelte?since=daily).
-
- [x] General
- [x] No need () around citation
- [x] use figure capture and figure number, and reference the figure in the text
- [x] add table caption
- [x] in each capture: Analysis of …
-
Hi!
First of all, thank you for sharing your amazing work. I have two questions:
1. In `https://huggingface.co/defog/llama-3-sqlcoder-8b?fbclid=IwZXh0bgNhZW0CMTEAAR28ltksnyUgl8zct50HTLk2F0PBrcno…
-
Hi, I've found out that Pythia (from EleutherAI) is better that Cerebras GPT in terms of evaluation results. Pythia is basically a LLM that based on GPT NeoX architecture but it's parameters ranging f…