mukobi / Unadaptable-Foundation-Models

MIT License
3 stars 0 forks source link

FIM Loss calculation bug #24

Closed m-walters closed 4 months ago

m-walters commented 5 months ago

In compute_fim_loss (see here), the code will only work if fim_reduce == "trace_max". @Rohan138 git blame at you, can you update this func as necessary to handle other fim_reduce values (if None, then what? throw exception?). Please add a docstring too.

Rohan138 commented 4 months ago

Fixed in main