-
I have tried to convert llama 2 model from .gguf to .bin
```
~/llm_inferences/llama.cpp/models/meta$ ls
llama-2-7b.Q4_K_M.gguf
python3 export.py llama2_7b.bin --meta-llama /home/####/llm_inf…
-
### Motivation
This is **not** an important feature, but I figured I'd mention it because it was a small point of friction that I think could be improved in the future. Currently my script does this:…
-
Hello mlcommons team,
I want to run the "Automated command to run the benchmark via MLCommons CM" (from the example: https://github.com/mlcommons/inference/tree/master/language/llama2-70b), but I d…
-
Llama.dll that can be downloaded from llama.cpp repo is suitable mostly for programming languages that have abilities to work with rather difficult (for novice coder) concepts like pointers, structure…
-
1. The Readme points to using a eval.py, which is missing from the llama2 scripts folder.
2. Instructions to run this reference implementation on multiple nodes would be helpful for anyone looking to…
-
Per the readme, LORA weights for LLama2 is available in github release v1.1.0. However the branch doesnt have the weights for the model.
-
I am currently learning about the example llama2 by following the instructions provided in the [README](https://github.com/pytorch/executorch/blob/main/examples/models/llama2/README.md). In this examp…
-
### System Info
4090
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported ta…
-
Hello,
I've been attempting to replicate the ASR results mentioned in the paper. Although successful in most aspects, I've encountered difficulties specifically with the warmstart version of advpro…
-
When running the bash build_all.sh command most of them are building but mojo is giving an error,
$ bash build_all.sh
/workspaces/lamatune/bench /workspaces/lamatune/bench
/opt/homebrew/opt/llvm/bi…