-
Does Llama 3 or 3.1 (instruct or text models) support fill-in-the-middle like CodeLlama?
(Couldn't find this information on the web so decided to ask here, sorry if it's the wrong place)
-
### System Info
```shell
transformers[torch]==4.33.2
onnxruntime 1:
/Users/goodspeed/Downloads/transformers.js-main/scripts/myenv/lib/python3.11/site-packages/transformers/models/llama/modeling_…
-
![image](https://github.com/OpenGVLab/OmniQuant/assets/149936473/6680ad6f-5edb-483f-8f43-2f7c03642c62)
I have obtained the weight offset factor for llama3-8b, but there was a unique mismatch issu…
-
would be really nice to have a functionary version of llama 3.1 70b/8b!
-
Hi, I used vllm as the backend to run codegen and evaluate `meta-llama/Meta-Llama-3.1-8B` base model, and the results are very bad, far away from meta's report.
My commands are like:
```shell
p…
-
Based on the competition rules, any public models can be used if they are uploaded before May 31st 2024.
But, i think transformers>=4.40.0 is required for llama 3 (current version is 4.39.3 in yml f…
-
All I can see from the terminal is: Awaiting local response... (model: llama3) after sending a message, it stays like that and the response never arrives
-
new version of transfomer, no need to use BetterTransformer, try setting attn impl to sdpa...
attn imp:
Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used …
-
Thanks for your contributions!
It would be nice if you please let me you if you are going to release Video-LLaMA checkpoints with LLaMA 3.1 anytime soon.
Thanks,
Shraman
-
When I use Ollama with Llama 3.1 8B, the agent just keeps looping and listing out it's functionality.
```
I'm an Autonomous JSON AI Task-Solving Agent. I can memorize, forget, and delete memories.…