search

billray0259 / stockbot_2020

A previous attempt at profitable algorithmic trading
0 stars 0 forks source link

join_candles method causes memory spike #12

Closed billray0259 closed 4 years ago

billray0259 commented 4 years ago

While this method has worked in the past recently the line big_df = dataframes[0].join(dataframes[1:]) has caused a memory spike that uses 100% of my computer's memory.

I believe there is a problem with pandas' join method potentially causing a memory leak.

billray0259 commented 4 years ago

I was able to copy the individual ticker .h5 files from another DataHandler directory to the directory of the DataHandler that was unable to join from the histories directory. It was able to join these copied .h5 files. Maybe it's not a memory leak, not sure what was going on. Closing this issue until I run into a similar problem.