search

EmbodiedGPT / EmbodiedGPT_Pytorch

331 stars 32 forks source link

can not load the pretrain weight correctly in inference scripts #6

Open Heathcliff-saku opened 4 months ago

Heathcliff-saku commented 4 months ago

Hi, @YaoMarkMu I think this is a fantastic piece of work. My question is, when I attempted to use the provided weights https://drive.google.com/file/d/1sBTy8oXeweJg3STbhzBR_5pLcVs1F20q/view?usp=sharing for a simple inference in demo/inference and demo/test by replace the model_path: 1716819500755

I encountered an error stating like:

1716819119621

Could you provide more guidance on how to perform inference (e.g. like model card in huggingface to guide follower the model‘s input format) ? Additionally, I am concerned about the quality of the open-source code for this work. As far as I understand, this is one of the early works introducing Vision-Language Large Models to embodied tasks and, being a spotlight work at NeurIPS, I hope your team could further open up the code and weights to enable the community to conduct more thorough evaluations.

BillSiriusLiu commented 3 months ago

@Heathcliff-saku The google drive model is damaged, but the hugging fcae link in README.md https://huggingface.co/Liang-ZX/Embodied_family_7b/ is fine.