search

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.76k stars 137 forks source link

fix: context_length has no effect #200

Open chosen-ox opened 5 months ago

chosen-ox commented 5 months ago

When I ran the model, I found context_length has no effect. I try to fix it same as https://github.com/marella/ctransformers/blob/ed02cf4b9322435972ff3566fd4832806338ca3d/ctransformers/gptq/llm.py#L213