THUDM / CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型
Apache License 2.0
5.91k stars 406 forks source link

AMD Support #43

Closed userbox020 closed 10 months ago

userbox020 commented 11 months ago

Hello, Would like to run the model but I only have that amount of vram avalible with amd gpus

Sleepychord commented 11 months ago

theoretically, the HIP can serve like CUDA. So you just need to use the amd version of pytorch.

userbox020 commented 11 months ago

going to check and go back here with pytorch version and rocm version used to register if mine versions works

userbox020 commented 11 months ago

do you have discord or telegram group where i can join bro?

1049451037 commented 10 months ago

No discord or telegram group yet. We have slack group: https://join.slack.com/t/chatglm/shared_invite/zt-1y7pqoloy-9b1g6T6JjA8J0KxvUjbwJw and wechat groups here: https://github.com/THUDM/VisualGLM-6B/blob/main/examples/WECHAT.md