-
Usage stats collection is enabled. To disable this, run the following command: `ray disable-usage-stats` before starting Ray. See https://docs.ray.io/en/master/cluster/usage-stats.html for more detail…
-
batch_index157 rank0:
```
question=['Input: Instruction: 请您将下面这篇文章中的语法错误修改为正确的形式,以提高其语法准确性。 Input: 我来中国以后已经过一年八个多月了。我一个人在异国他乡,时常给我打电话,时常寄给我包裹,包裹里面的东西都是我喜欢的。比如,药、日本特色的食品、日本的时装杂志等都在中国买不到的,我感到非常高兴。你…
-
### Describe the bug
Hi there, thanks for all the work.
Was trying some SuperHOT 8k merged models (like https://huggingface.co/Panchovix/tulu-30b-SuperHOT-8K-4bit-32g), and then, when trying to ge…
-
@PanQiWei @TheBloke
So Here is my Script for Infrence:
```
import torch
from transformers import AutoTokenizer, TextGenerationPipeline
from auto_gptq import AutoGPTQForCausalLM
from huggingf…
-
### Describe the bug
Was working fine for the last few days, and I update before each launch fine. today though i get an error updating.
I am using the one click install version and updating via the…
-
Something went wrong for me unfortunately.
Made a fresh first install. All according to instructions. CPU mode.
When I tried to login for the first time I get error message in web UI:
```
[E…
-
### Issue you'd like to raise.
I am trying to follow the basic python example. I have downloaded the model `.bin` file as well from gpt4all.io: https://gpt4all.io/models/ggml-vicuna-13b-1.1-q4_2.bin
…
-
Hello.
When new ggml using which wrapped clblast with vicuna prompt. `main.exe` shows weird response.
Characters after last `### Humans:` are generated by `main.exe`
Both cpu & cuda versions w…
-
### Describe the bug
I had gotten a few errors before which were solved after searching, then the next error that happened was this. I tried to install/re-install with this "conda install pytorch tor…
-
here is the model am using which is 12B i want to change to 30B:
defual one:
`MODELS=`[
{
"name": "OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5",
"datasetName": "OpenAssistant/oasst1"…