search

Go2Heart / EchoSight

[EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.
https://go2heart.github.io/echosight/
39 stars 2 forks source link

运行demo #10

Open Mungeryang opened 2 hours ago

Mungeryang commented 2 hours ago

作者您好，想请问一下关于demo的app.py中"qformer_ckpt_path": "/PATH/TO/QFORMER_CHECKPOINT", "llm_ckpt":"/PATH/TO/LLM_CHECKPOINT" # Mistral-7B is the default model；所需要的文件在哪里下载呢？这周在拜读您的paper，想跑一下您的demo app-pymain函数

Go2Heart commented 2 hours ago

感谢您对本工作的关注，qformer_ckpt_path是训练完成后reranker ckpt的路径，llm_ckpt则是最终完成vqa的llm ckpt的路径。若想要运行demo的话，可以先使用README中提到的reranker ckpt和mistral llm ckpt。

Mungeryang commented 1 hour ago

好的，感谢您的回信帮助！