-
![image](https://github.com/lm-sys/FastChat/assets/12007367/dfa3318d-d4cd-435a-a130-5216eb89e280)
Since there is no non fast version of gptneox dolly fails to load in 8 bit compression mode.
T…
PCIHD updated
10 months ago
-
#python3 llama.cpp/convert.py persimmon-8b-chat --outfile persimmon-8b-chat.gguf --outtype q8_0
# Expected Behavior
produce a gguf of persimmon 8b at q8_0
# Current Behavior
Traceback (most …
-
Hello everyone! I found Llama models like `beomi/llama-2-ko-7b` are giving junk output like `\n[/INST]\n\n[/INST]...`. I tried with multiple Llama2 korean models and I am getting similar junk results.…
-
I did the following test to tokenize `wiki.test.raw` using our tokenizer and the Python tokenizer.
The expectation is that the outputs will match:
```bash
# generate ggml-vocab-falcon.gguf
./con…
-
I am using optimum neuron run_qa.py to fine-tune GPT2, by looking at the output it seems like it does data parallelism.
Kindly confirm what kind of parallelism is done?
If I enter 8 as batch size it…
-
Thank you for the great work on rewardbench, as it's been super helpful in evaluating/researching reward models.
I've been wrapping your rewardbench.py code to run the reward models published on th…
-
# Expected Behavior
I'm trying to convert the [redpajama 3b chat model](https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1) to a ggml model from the `pytorch_model.bin`.
I saw in …
-
### System Info
Happy New Year all!
- `transformers` version: 4.36.2
- Platform: Linux-5.15.0-1049-aws-x86_64-with-glibc2.31
- Python version: 3.10.12
- Huggingface_hub version: 0.19.4
- S…
-
Curious if this will work for Microsoft/phi-1_5 or any plans to add support for it since I know it uses the CodeGenTokenizer.
-
### System Info
- `transformers` version: 4.31.0
- Platform: Linux-5.10.112-005.ali5000.alios7.x86_64-x86_64-with-glibc2.17
- Python version: 3.8.13
- Huggingface_hub version: 0.12.1
- PyTorch …