I found your analysis of linearized fine-tuning to be both fascinating and helpful, and I’m currently attempting to reproduce it. However, I’m encountering some issues because I’m using a Mac with an M1 chip, which doesn’t support DDP and causes compatibility problems with JAX.
Would it be possible for you to share the checkpoint for the linearized fine-tuning? It would be incredibly convenient and helpful for my work as a contribution to interpretability. I would greatly appreciate it!
I found your analysis of linearized fine-tuning to be both fascinating and helpful, and I’m currently attempting to reproduce it. However, I’m encountering some issues because I’m using a Mac with an M1 chip, which doesn’t support DDP and causes compatibility problems with JAX. Would it be possible for you to share the checkpoint for the linearized fine-tuning? It would be incredibly convenient and helpful for my work as a contribution to interpretability. I would greatly appreciate it!