-
Hi,
Thanks for the code. I downloaded the app via Testflight on my iPhone device (iPhone 14Pro, iOS 17).
I tried to chat with Models Dolly v2 and Pythia, but the app crashed after asking 'How is th…
-
### System Info
- `transformers` version: 4.32.0.dev0
- Platform: Linux-5.19.0-42-generic-x86_64-with-glibc2.27
- Python version: 3.10.10
- Huggingface_hub version: 0.15.1
- Safetensors version: …
-
Hi there 👋
I've noticed a weird behavior when tried to fine-tune OpenLLaMA-3B model:
```bash
python finetune/lora.py --checkpoint_dir checkpoints/openlm-research/open_llama_3b --precision bf16…
-
I'm getting this error when trying to run on MacOS:
```
error: invalid value 'llama-2' for '': llama-2 is not one of supported model architectures: [Bloom, Gpt2, GptJ, GptNeoX, Llama, Mpt]
```
I…
-
## ❓ Question
I want to train a custom tokenizer (just like GPTNeoX tokenizer) using the [same script](https://github.com/EleutherAI/gpt-neox/blob/main/megatron/tokenizer/train_tokenizer.py) GP…
-
I am facing an error while I am finetuning:
```
raise ValueError("q_len %d should be divisible by group size %d."%(q_len, group_size))
ValueError: q_len 583 should be divisible by group size 14…
-
Thanks for the brilliant work!
It raised an error when I tried to finetune llama2 13b 8k lora weight. Could you let me know how to solve this?
File "/users/PAA0201/shubaobao/anaconda3/envs/lo…
-
https://www.together.xyz/blog/openchatkit this new repository might also be a good candidate for any local deployment with a strong GPU. As the gptNeox focus is on GPU deployments.
-
**Describe the bug**
When using the `pdsh` launcher, the runner replaces any existing content of the PDSH_SSH_ARGS_APPEND environment variable, instead of adding to it. As a result, any existing valu…
-
Here is my benchmark result on A30 using llama-7b
![image](https://github.com/NVIDIA/TensorRT-LLM/assets/26128514/c3acdb13-14ac-415b-bb3d-0d784dec75f8)
Seems the performance using paged attentio…