When trying to run the chatglm3-4bit model. I keep getting
Error occurred when executing LoadChatGLM3:
name 'round_up' is not defined
I have no idea at this point what could be the issue. The 8bit runs flawlessly with the exception of the times I get an OOM error because of my low-vram.
Really would like to gain a little headway on dealing with this error.
weisiren000
commented
21 hours ago
When trying to run the chatglm3-4bit model. I keep getting
I have no idea at this point what could be the issue. The 8bit runs flawlessly with the exception of the times I get an OOM error because of my low-vram.
Really would like to gain a little headway on dealing with this error.