Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。
Other
1.21k
stars
111
forks
source link
报错Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit #67
Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit
是GPU不够吗
if "cpu" in device_map_without_lm_head.values() or "disk" in device_map_without_lm_head.values():
-> 3246 raise ValueError(
3247 """
3248 Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit
...
these modules in 32-bit, you need to set load_in_8bit_fp32_cpu_offload=True and pass a custom
device_map to from_pretrained. Check
https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu
for more details.
zhao1iang
commented
8 months ago
Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit 是GPU不够吗 if "cpu" in device_map_without_lm_head.values() or "disk" in device_map_without_lm_head.values(): -> 3246 raise ValueError( 3247 """ 3248 Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit ... these modules in 32-bit, you need to set
load_in_8bit_fp32_cpu_offload=Trueand pass a customdevice_maptofrom_pretrained. Check https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu for more details.