-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
有人尝试过glm2二次微调吗?比如先全量微调glm2,接着再对微调后的模型再进行Lora微调
我尝试了glm2全量微调并用了 --quantization_bit 8 参数进行量…
-
### Feature request
We try to propose the addition of a new and widely-adopted scheduler strategy for language model pretraining in the Transformers repository. Upon reviewing the current schedulers …
-
### Describe the bug
env: MODEL_NAME=runwayml/stable-diffusion-v1-5
env: INSTANCE_DIR=/content/drive/MyDrive/Newfolder
env: HF_ENDPOINT=https://hf-mirror.com/
2024-08-18 08:46:08.308678: E externa…
-
When I convert BERT (pytorch model) to onnx format (without any optimizations) and then try to run the "symbolic_shape_infer.py" script with the obtained onnx model as an input argument, I get the fol…
-
### 🐛 Describe the bug
from torch.distributed.fsdp import (
FullyShardedDataParallel as FSDP,
MixedPrecision,
BackwardPrefetch,
ShardingStrategy,
FullStateDictConfig,
St…
-
I am trying to run the following python script, which uses the medium model:
```
import torchaudio
from audiocraft.models import MusicGen
from audiocraft.data.audio import audio_write
model =…
-
# prompt
Calibrate Before Use: Improving Few-Shot Performance of Language Models (https://arxiv.org/abs/2102.09690)
p-tuning (https://arxiv.org/abs/2104.08691)
Do Prompt-Based Models Really Underst…
-
May I ask how to finetune trocr on my own dataset? What's the format of dataset I need to prepare?
-
## 🐛 Bug
There seems to be a discrepancy (in addition to https://github.com/pytorch/xla/issues/3718) in how `torch.nn.Linear` (`torch.nn.functional.linear`) is implemented and dispatched between th…
-
First here is my machine:
```
Model Name: MacBook Pro
Model Identifier: MacBookPro18,3
Model Number: Z15G001WDLL/A
Chip: Apple M1 Pro
Total Number of Cores: 10 (8 performance and 2 eff…