Open willswire opened 5 months ago
I have the same issue with a Macbook M3 Max with 96GB RAM.
Same thing with me as well, M3 Max w/ 36GB of RAM 🤔 I'm wondering if this is a Mac OS thing or a zsh thing, going to try and disable mac's automatic killing of processes: https://osxdaily.com/2012/05/15/disable-automatic-termination-of-apps-in-mac-os-x/
RE: that didn't work, still got killed. I ran it with sudo and I was able to get a bit farther it seems, right after the Running MIL backend_program pipeline
I got this:
Restoring PyTorch conversion op 'log' to <function log at 0x13f499f80>
.
It looks like a process ANECompiler
is the one running when the exporters script seems to hang, not sure if that's useful information.
Gonna keep trying things, maybe even debug the script if I have time.
I tried cpu_only, cpu_and_gpu, cpu_and_ne and it still got killed. Was hoping it was specific to trying to optimize it for NE (based on the top process in the screenshot) but apparrently not.
I am also doing a mistral model, SynthIA 7B, maybe this is unique to those models?
Can try a different type to see.
So far I've tried:
I've also tried the version of exporters when mistral support was added, same thing it just hangs and zsh kills the process.
I've tried:
3.10.13 -> suggested here, did not work. Crashed way earlier. I also tried using a lower version of tqdm as suggsted in the same thread.
I closed all other windows and just had the terminal open, got this other error sometimes but most of the time still gets killed:
RuntimeError: [MIL FileWriter]: Unknown error occured while writing data to the file.
Progress? 😆
I tried the same synthia model conversion, same setup, on an M2 Max, and the conversion at least worked.
Validation failed, but I wonder if this is M3* family of chip specific.
This also happens with coremltools directly, even when trying to quantize a relatively small model. Pretty sure it has nothing to do with this repo 😬
Similar to #61, my exporter process is being killed. I'd like to verify this is a resource constraint, and not an issue in project. I am running
python3 -m exporters.coreml --model=mistralai/Mistral-7B-v0.1 mistral.mlpackage
on a M3 MacBook Pro with 18GB of memory.