CASIA-IVA-Lab / AnomalyGPT

[AAAI 2024 Oral] AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models
https://anomalygpt.github.io
Other
672 stars 81 forks source link

大概需要多少内存才能成功加载Llama的预训练模型vicuna7B?????? #62

Closed plshuaishuai2 closed 5 months ago

plshuaishuai2 commented 5 months ago

程序执行self.llama_model = LlamaForCausalLM.from_pretrained(vicuna_ckpt_path)这一行的时候,程序直接终止了,也不报错,,,不知道是不是因为内存不够?但我服务器内存已经48G了,按理说应该不小了,,,到底需要多少内存才行呀?各位有没有遇到类似问题?