-
```
FileNotFoundError: Couldn't find a dataset script at
/content/JosephusCheung/GuanacoDataset/GuanacoDataset.py or any data file in the
same directory. Couldn't find 'JosephusCheung/GuanacoDatas…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [ ] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
system_info: n_threads = 4 / 8 | AVX = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 |…
-
I am trying to run the harness with these settings. My base model is the new Falcon model and I've trained a LoRA adapter on top of that. I am receiving an error when trying to load it. I am a novice…
-
操作系统: CentOS Linux 7
GPU: 3090,一张
python版本:3.8.16
库的版本和requirements.txt中一致
llama-7b-hf数据提前下好了
cuda版本:11.4
nvcc --version:
`nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA …
-
1.I tried
python3 -m fastchat.serve.cli --model-path /home/ubuntu/ChatGPT/Models/lmsys/vicuna-7b-v1.3 --num-gpus 2
2.Only ong GPU used, why this happen?
-
**Describe the current behavior**
A clear and concise explanation of what is currently happening.
**Describe the expected behavior**
A clear and concise explanation of what you expected to ha…
-
Thanks for the project, I have managed to run the project on CPU with decent speed (**6.2 - 6.8 tokens per second**), however, the
the model only generates a small piece of content, and the response…
-
### Describe the bug
The web UI was working fine for me, I could load 7b and 13b models without problems.
But all of that changed after updating to the latest version, in which I now get a "Done! Pr…
-
### System Info
```Shell
- `Accelerate` version: 0.20.3
- Platform: Linux-5.4.0-110-generic-x86_64-with-glibc2.31
- Python version: 3.10.11
- Numpy version: 1.23.5
- PyTorch version (GPU?): 2.0.1…