search

JSybrandt / agatha

AGATHA: Automatic Graph-mining And Transformer based Hypothesis generation Approach
http://agatha-hypothesis-generation.rtfd.io/
GNU General Public License v3.0
56 stars 9 forks source link

Migrates the abstract generator for horovod to pytorch lightning #7

Closed JSybrandt closed 4 years ago

JSybrandt commented 4 years ago

This leads to a significant performance increase, coupled with simpler code. One major issue comes from the move to pytorch.distributed under the hood. pytorch-lightning expects a lot to be managed by slurm. We have to set a range ov env variables in order to overcome this.