-
我分析了一下数据,发现merge.json中sql相关的指令数据非常少,但是Chinese-Vicuna-lora-7b-belle-and-guanaco的编写sql能力还是不错的,这是什么原因导致的,而且merge.json的数据只有400M貌似有点少,但是模型效果还是不错的原因是什么?
-
本人第一次接触这类项目,请问文档里的Chinese-Vicuna-lora-7b-3epoch-belle-and-guanaco这个模型是怎么训练出来的,finetune.py的输出又是什么,checkpoint-final是什么,和13B-based lora model什么关系。另外CPU推理的tools/merge_lora_for_cpp.py这个文件也没有。可以从huggingface…
-
### Describe the bug
After assigning some layers, I see that the model is still only using my CPU and RAM. Is there anything else that I need to do to force it to use the GPU as well? I've seen some …
-
For context, my system configuration is as follows: MacBook Air M1 with 16GB of RAM, running macOS 13.3. I am using Python 3.10.9, GNU Make 3.81, and g++ with Apple Clang version 14.0.3. With lastest …
-
```
FileNotFoundError: Couldn't find a dataset script at
/content/JosephusCheung/GuanacoDataset/GuanacoDataset.py or any data file in the
same directory. Couldn't find 'JosephusCheung/GuanacoDatas…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [ ] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
**Describe the current behavior**
A clear and concise explanation of what is currently happening.
**Describe the expected behavior**
A clear and concise explanation of what you expected to ha…
-
system_info: n_threads = 4 / 8 | AVX = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 |…
-
Thanks for the project, I have managed to run the project on CPU with decent speed (**6.2 - 6.8 tokens per second**), however, the
the model only generates a small piece of content, and the response…
-
操作系统: CentOS Linux 7
GPU: 3090,一张
python版本:3.8.16
库的版本和requirements.txt中一致
llama-7b-hf数据提前下好了
cuda版本:11.4
nvcc --version:
`nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA …