-
Besides the introduction of instruction-following scenarios (expected), there are some other differences between the ligh_scenarios exported by the new `export_scenario_text.py` script and our old ver…
-
### System Info
- `transformers` version: 4.30.1
- Platform: Linux-5.15.0-1034-gcp-x86_64-with-glibc2.2.5
- Python version: 3.8.10
- Huggingface_hub version: 0.14.1
- Safetensors version: 0.3.1…
-
Testing against 5974d617 and https://github.com/ggerganov/llama.cpp/pull/3538
While running
```
bin/main --mlock -m /mnt/f2fs/mpt/ggml-model-mpt-7b-storywriter-f16-q5_1.gguf -t 1 -ngl 999 -p '…
-
### System Info
```shell
After recent integration of transformer test cases to optimum-habana ,it was observed that several beam search related testcases are failing with the following error, The tes…
-
### 🐛 Describe the bug
Please correct me if I'm wrong, but it looks like SFT for Anthropic simply maximizes log p(x) on the entire dialogue history, rather than only maximizing log p(y|x), where x is…
-
Please correct me if I'm wrong, but shouldn't there be a BOS and EOS token enabled for these kinds of tokenization?
https://github.com/Lightning-AI/lit-gpt/blob/91014a7783d83c7dcb745d384a01bedaa7a8…
-
### Branch/Tag/Commit
main
### Docker Image Version
nvcr.io/nvidia/tensorflow:22.09-tf1-py3
### GPU name
A100
### CUDA Driver
515.65.01
### Reproduced Steps
```shell
Hi,
When I was using nvi…
-
(This is from Version 0.1)
The current version doesn't appear to have an implementation for MergedLinear but the version I trained my models with has a bug that is preventing me from merging the weig…
-
I tried to test the`oasst-sft-1-pythia-12b` Open Assistant model as described by Sean Moriarty in the [Open-Source Elixir Alternatives to ChatGPT](https://dockyard.com/blog/2023/05/16/open-source-elix…
-
### System Info
- `transformers` version: 4.28.0.dev0
- Platform: Linux-4.18.0-425.10.1.el8_7.x86_64-x86_64-with-glibc2.28
- Python version: 3.9.13
- Huggingface_hub version: 0.13.3
- Safetensors…