search

matthieukomorowski / AI_Clinician

Reinforcement learning for medical decisions
95 stars 45 forks source link

OOM error loading `preadm_fluid.csv` #3

Open moberst opened 5 years ago

moberst commented 5 years ago

@matthieukomorowski @moberst Sorry to bother you again. When I am running the AIClinician_sepsis3_def_160219.m, I got an error of this lineinputpreadm=table2array(readtable('D:/exportdir/preadm_fluid.csv')); because the first coloum is double while the second is cell. Then I change it to inputpreadm=table2cell(readtable('D:/exportdir/preadm_fluid.csv'));

And I still got an out of memory error, I ran the code on a 32GB Ubuntu. I am wondering how much memory will it cost?

Thanks!

_Originally posted by @bywbilly in https://github.com/matthieukomorowski/AI_Clinician/issues/1#issuecomment-468052064_

moberst commented 5 years ago

This does not happen to me, but if you look at the code that generates that csv file, it puts NULL values in the second column for missing data. When I export to csv, these entries are just empty, and it loads into matlab just fine with table2array and has a pretty small memory footprint.

moberst commented 5 years ago

@bywbilly