-
I'm trying to integrate LM-Infinite into GPTNeoX `pythia-dedup`. I managed to bring in the `lambda_attn` to work, but the rotary's implementation on the GPTNeoX is a bit different, and the heads is a …
-
### System Info
- `transformers` version: 4.32.1
- Platform: Linux-5.15.0-52-generic-x86_64-with-glibc2.31
- Python version: 3.10.11
- Huggingface_hub version: 0.15.1
- Safetensors version: 0.3…
-
Stability released their latest 3B model, but there is an error when executing the convert.py script:
// Model card and files on NF
https://huggingface.co/stabilityai/stablelm-3b-4e1t
//Error…
-
As discovered in #42.
The incompatibility was introduced in https://github.com/huggingface/transformers/commit/7dcd8703ef904adc3ac19b47f769879221c33849
Concretely, the reason for the problem lie…
-
### Describe the bug
I loaded a GGML model in Hungarian on ctransformers with gptneox:
https://huggingface.co/TheBloke/PULI-GPT-3SX-GGML
It loaded successfully, but the accented characters gave a…
-
Generate settings throws an error when using any Huggingface GPTNeo**X**ForCausalLM model (interestingly it doesn't for GPTNeoForCausalLM models).
- Independent of weights (bug replicates across pr…
-
AFAIU we are missing tokenizer tests for supported models like
* Baichuan
* Bloom
* GptNeoX
* Persimmon
* Refact
* Starcoder
It would be great if anyone would be helping out.
-
### 🐛 Describe the bug
The gradients of samples for models with and without memory efficient SPD should be nearly identical, but are in practice often very different. I have a code example here: ht…
-
![image](https://github.com/lm-sys/FastChat/assets/12007367/dfa3318d-d4cd-435a-a130-5216eb89e280)
Since there is no non fast version of gptneox dolly fails to load in 8 bit compression mode.
T…
PCIHD updated
10 months ago
-
#python3 llama.cpp/convert.py persimmon-8b-chat --outfile persimmon-8b-chat.gguf --outtype q8_0
# Expected Behavior
produce a gguf of persimmon 8b at q8_0
# Current Behavior
Traceback (most …