Then it just quits without any error message. The same thing occurs without the --wbits 4 flag.
I am able to use opt.py perfectly well, and Task Manager shows that nothing is being maxed out so it can't be a hardware limitation:
System instability:
When I was running the command I mentioned above, trying to capture the image of the Task Manager usage graphs, an Electron app restarted itself and Task Manager displayed some black artifacts and closed. This is not a regular occurence for this machine, and only happened when I ran that command. On another occasion, Firefox froze for a few seconds while llama.py was attempting to run.
Unfortunately, I have been unable to reproduce either of these behaviours. Even so, I feel it's worth mentioning.
Silent Failure:
I'm attempting to use
llama.py
to reduce the size of the Airochronos L2 13B model.Then it just quits without any error message. The same thing occurs without the
--wbits 4
flag.I am able to use
opt.py
perfectly well, and Task Manager shows that nothing is being maxed out so it can't be a hardware limitation:System instability:
When I was running the command I mentioned above, trying to capture the image of the Task Manager usage graphs, an Electron app restarted itself and Task Manager displayed some black artifacts and closed. This is not a regular occurence for this machine, and only happened when I ran that command. On another occasion, Firefox froze for a few seconds while
llama.py
was attempting to run.Unfortunately, I have been unable to reproduce either of these behaviours. Even so, I feel it's worth mentioning.