yeyupiaoling / Whisper-Finetune

Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment

Apache License 2.0

813 stars 129 forks source link

如何随机化模型参数，从头开始训练 #41

Closed xyx361100238 closed 8 months ago

xyx361100238 commented 9 months ago

你好，如果我想从头开始训练，如何对加载的模型参数进行随机化？

获取模型

model = WhisperForConditionalGeneration.from_pretrained(args.base_model, load_in_8bit=args.use_8bit, device_map=device_map, local_files_only=args.local_files_only)

yeyupiaoling commented 9 months ago

这个不太清楚，你应该去找一下Transformers文档。

xyx361100238 commented 9 months ago

多谢