search

JonasGeiping / cramming

Cramming the training of a (BERT-type) language model into limited compute.
MIT License
1.3k stars 100 forks source link

try it on Mac M1 but failed #36

Closed yangboz closed 10 months ago

yangboz commented 11 months ago

after pip install -e . try

python pretrain.py name=test arch=hf-bert-base train=bert-base  dryrun=True

the console error as following 

zsh: illegal hardware instruction  python pretrain.py name=test arch=hf-bert-base train=bert-base  dryrun=True

any idea ? thanks.

JonasGeiping commented 11 months ago

Uh, that is a mean error message. It is likely unrelated to cramming directly, though. You might have an ARM/x86_64 mismatch on some dependencies (maybe pytorch?). Sorry, this is hard for me to debug at all without acess to an M1 Mac.

JonasGeiping commented 10 months ago

Closing this for now. Feel free to re-open if anything comes up