-
model.tokenize("1111")
crashes the python interpreter
if relevant, I'm using https://huggingface.co/TheBloke/Nous-Hermes-13B-GGML
-
(In the readme at least) the config passed in CTransformers doesn't accept stop strings, which is a common feature.
-
Trying simple example on m1 mac:
```
from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.from_pretrained(
"/path/to/starcoderbase-GGML/starcoderbase-ggml-q4_0.bin",
…
-
Hi @AndreasFischer1985 , really nice examples here.
I'm going through your notebook on [LangChain with agents](https://github.com/AndreasFischer1985/code-snippets/blob/master/py/LangChain_HuggingFa…
-
Didn't take the time to dig in but on colab I'm getting a weird error "2023-05-28 22:47:44.286686: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT" afte…
-
### System Info
transformer version : 4.30,4.31,4.34,4.35
python version : 3.11.1, 3.11.5,3.8
### Who can help?
_No response_
### Information
- [X] The official example scripts
- [ ] …
-
I've been tracking the Falcon https://github.com/ggerganov/ggml/pull/231 PR, and as I understand currently it won't work on a released version of `ggml`.
Any suggestions on how to test it config wi…
-
### Describe the bug
Upgraded to current version and now after loading any model I get an Illegal instruction (core dumped) error. I did a clean onclick install on linux and a reboot to see if that c…
-
### Describe the bug
When attempting to launch using a setup with the requirements_nocuda.txt, an error indicates a missing exllama dependency, which was previously not required for llama-cpp. Upon c…
-
Context: https://github.com/marella/ctransformers/issues/1#issuecomment-1556068861
@bgonzalezfractal did you notice any performance improvement just by changing the `threads` parameter?
If you d…