search

reml-lab / mTAN

Code for "Multi-Time Attention Networks for Irregularly Sampled Time Series", ICLR 2021.
MIT License
113 stars 22 forks source link

Not able to reproduce results for Physionet dataset #1

Open yalavarthivk opened 2 years ago

yalavarthivk commented 2 years ago

Hi,

I have downloaded the code from the git repository and ran the mTAN classifier full on my local machine with the same hyperparameters mentioned. My results do not match with the published ones. In the paper, the mean ROC is 0.858 while I get 0.830.

I could not install torch==1.4.0, hence used torch---1.9. I am attaching the result for your reference. physionet-cnn-0-569442.log

satyanshukla commented 2 years ago

I'm looking into the logs and checking the code, would be updating the code shortly to get the 0.858 ROC.