-
Hi,
I am reproducing your work, and does 50.69% accuracy for hellaswag benchmark and 9.095 ppl for wikitext 2 for llama 3 8b make sense? To be able to run the computation on my resources, I reduced …
-
What are all llama 3.1 providers for free on gpt4free
-
The code is running perfectly with all the other models. But there are issues when running the **meta-llama/Meta-Llama-3.1-8B-Instruct**.
I tried adding the following code part as instructed, but…
-
Would be very usefull to add open source models like Llama3
-
How do I add the latest Lama 3 model or will it be added?
-
I tested the speed of lama models using exlama and noticed that the speed of 8b models is much slower than 7b (although this is not the case with other inferences. Can you tell me what the problem mig…
-
When training either Llama 3 or 3.1 8B base model using the Llama 3 template for conversation prompt format, it seems to not train with the correct tokens. It ends up producing text containing tokens…
-
Dear LitGPT Maintainer,
Thank you for your great work. I encountered an issue while trying to fine-tune LLaMA 3.1 and came here for reference. I was looking for the LLaMA 3.1 RoPE function change, …
-
### Description & Motivation
In the Tensor Parallel example [here](https://github.com/Lightning-AI/pytorch-lightning/tree/master/examples/fabric/tensor_parallel) while the proposed model is a Llama…
-
Would you consider training a model with the latest version of LLAMA 3/LLAMA 3.1 in the near future? I'm interested in the performance and its weight.