Closed userbox020 closed 10 months ago
theoretically, the HIP can serve like CUDA. So you just need to use the amd version of pytorch.
going to check and go back here with pytorch version and rocm version used to register if mine versions works
do you have discord or telegram group where i can join bro?
No discord or telegram group yet. We have slack group: https://join.slack.com/t/chatglm/shared_invite/zt-1y7pqoloy-9b1g6T6JjA8J0KxvUjbwJw and wechat groups here: https://github.com/THUDM/VisualGLM-6B/blob/main/examples/WECHAT.md
Hello, Would like to run the model but I only have that amount of vram avalible with amd gpus