-
-
我扩充了llama3的训练词表,并修改config中tokenizer和model中响应部分,但是报了RuntimeError: CUDA error: device-side assert triggered这样的错误。具体错误见图
tokenizer = dict(
type=AutoTokenizer.from_pretrained,
pretrained_model_…
-
在运行api_v2.py时这个问题依然存在?请问怎么解决呀?
Traceback (most recent call last):
File "D:\ai\josencomfyui\GPT-SoVITS\api_v2.py", line 144, in
tts_pipeline = TTS(tts_config)
^^^^^^^^^^^^^^^
File "D:\ai\josenco…
-
Hi author!
Huge fan of your work. When I read the README, I didn't see the step of loading the pretrained model. I was wondering for command `python predict_bindingsites.py 1brs_A --noMSA`, the pretr…
-
I'm looking to use pytriton to run inference for a model. We have existing systems that send requests with the format:
```
{
'embedding' : [...]
}
```
However triton/pytriton requires th…
-
os: windows
I think my environment is ready
use jupyter notebook locally
when i run these:
"from unsloth import FastLanguageModel
import torch
max_seq_length = 8192 # Choose any! We auto sup…
-
I trained LoRA adapters for unsloth/gemma-2-9b-it-bnb-4bit models, but I also added lm_head, embed_tokens to the adapter
```
model = FastLanguageModel.get_peft_model(
model,
r = LORA_R…
-
I am new to pytorch and nlp. I have a question when I tried to build a model.
Since my training dataset is not so big, the size of its _vocab_ is relatively small (around 5000). However, I want to …
-
Hi,
I thought I would draw attention to the fact that the install instructions do not work for me, since the link to the HF SD 1.5 resources is now giving a 404.
As a work-around, I attempted to…
-
Hi there, so I am loading a finetuned Llama 2 13b model, and I get this error.
Here's part of the error:
File /usr/local/lib/python3.10/dist-packages/unsloth/models/loader.py:172, in FastLanguag…