HKUDS / GraphGPT

[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"
https://arxiv.org/abs/2310.13023
Apache License 2.0
577 stars 55 forks source link

在使用graphgpt的checkpoints推理时报错“Cannot copy out of meta tensor; no data!” #80

Closed wmx0708 closed 1 month ago

wmx0708 commented 1 month ago

跑graphgpt_eval.sh时,sh文件配置如下,stage_1中放置的是pytorch_model-00001-of-00003.bin文件和相关huggingface上的配置文件 image 结果在加载模型到cuda的时候,报错“NotImplementedError: Cannot copy out of meta tensor; no data!” image 运行时一直warning "copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass assign=True to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?)” image 且提示模型初始化参数问题 image 请问是否是我在运行eval时的配置存在问题