search

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.76k stars 137 forks source link

Support for Llama3 #210

Open gultar opened 2 months ago

gultar commented 2 months ago

Hi! It would fantastic if it supported Llama3. I hit a bug, and I'm unsure whether or not it is caused by quantization or by Ctransformers not being able to handle Llama3.

ERROR: byte not found in vocab: ' '

javileyes commented 2 months ago

This error is due to llama3 is not supported. The last update in that nice project was 7 month ago. I think is important somebody take the code, make a fork and continue this great project.

atb29 commented 2 months ago

This error is due to llama3 is not supported. The last update in that nice project was 7 month ago. I think is important somebody take the code, make a fork and continue this great project.

why this repository stoped updating ?