mlds-lab / interp-net

Code for "Interpolation-Prediction Networks for Irregularly Sampled Time Series", ICLR 2019.
MIT License
91 stars 14 forks source link

Should the step "python src/mimic_data_extraction.py" be very slow? #11

Closed ruilialice closed 3 months ago

ruilialice commented 3 years ago

Hi, when I run the script python src/mimic_data_extraction.py it works very slow, after 4 hours, it only processed about 170 visits, but the total number of visits is more than 20000, so I am wondering that whether it should be that slow or there is something wrong with my database constructed with postgres. Thanks.

satyanshukla commented 3 years ago

You can try to run the data extraction for each variable in a parallel way. Basically, every curr.execute command in the code can be executed parallelly.