stanfordnlp / pyvene

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions
http://pyvene.ai
Apache License 2.0
604 stars 56 forks source link

[P2] Mac chip MPS mode support #67

Open frankaging opened 8 months ago

frankaging commented 8 months ago

Descriptions: Currently, matrix exponential will fail with M1 chip MPS framework for rotation-based interventions. Need to figure out other ways to handle this so that M1 chip can run pyvene with trainable interventions like DAS as well.

fblissjr commented 5 months ago

even better, MLX support? :)