search

Vahe1994 / SpQR

Apache License 2.0
525 stars 42 forks source link

Process killed after eval phase #21

Open Iambestfeed opened 1 year ago

Iambestfeed commented 1 year ago

I did try running the code from your repository; however, when I attempted to add the --save_safetensors feature, the process was interrupted after performing the evaluation. I didn't encounter any issues regarding permissions or memory problems. Do you think there might be an issue here?

Vahe1994 commented 1 year ago

Hello! Hard to tell. Can you please send the logs of the run? What was the error message?

Iambestfeed commented 1 year ago

Hello! Hard to tell. Can you please send the logs of the run? What was the error message?

I don't keep a log, but what I see is that the message before everything stops is just 1 line "Killed"

flozi00 commented 1 year ago

Are you running on Linux ? Try to increase the swap size, most times linux just print "Killed" if running out of CPU memory

Iambestfeed commented 1 year ago

Are you running on Linux ? Try to increase the swap size, most times linux just print "Killed" if running out of CPU memory

Hmm, looks like the problem I'm having is that I'm trying to convert model 7b to a personal computer. @Vahe1994 So can you provide specific configuration with CPU should have to convert 1 model 7b? I see that everything is only using the CPU so I also wonder why we don't use the GPU?