ApolloResearch / rib

Library for methods related to the Local Interaction Basis (LIB)
MIT License
3 stars 0 forks source link

Check whether torch.compile speeds things up #179

Open danbraunai-apollo opened 10 months ago

nix-apollo commented 10 months ago

I tested this a tiny bit on play/torch-compile by putting a torch.compiled function in the inner loop of edge calculation. The compiler seemed to function, but the speedup was negligible (4%?). I still think this is plausibly worth investigating further, but I expect it will be more of a "read a bunch of docs, think carefully, and try a bunch of things out" project, not a "magical improvements out of the box" project. Though not bad to check the box once and a while and see if magic is inside.