search

yuanzhoulvpi2017 / zero_nlp

中文nlp解决方案(大模型、数据、模型、训练、推理)
MIT License
2.81k stars 351 forks source link

llava run error in jupyter #176

Open liu19876666 opened 2 months ago

liu19876666 commented 2 months ago

llava_demo

Initializing a model from the llava-1.5-7b style configuration

model = LlavaForConditionalGeneration(configuration) 每次执行到这里会报错，麻烦问一下这里是啥问题？具体报错的信息： 22:55:16.349 [error] Disposing session as kernel process died ExitCode: undefined, Reason: 22:55:16.589 [info] Cell 12 completed in -1718549700.326s (start: 1718549700326, end: undefined)

yuanzhoulvpi2017 commented 2 months ago
  1. 是最新的那个初始化model的ipynb文件么。
  2. 检查一下你的transformers版本问题、检查一下显存是不是不够的问题。
  3. 注意查看readme.md里面的关联的视频。
liu19876666 commented 2 months ago

我这边用的是最新的code03_build_model_show.ipynb v100的显卡，显存是30G。 transformers的版本4.40.1

yuanzhoulvpi2017 commented 2 months ago

你尝试吧log打印一下吧，看不到log，确实不容易定位问题。