rdustinb / noaasolarweather

Python graphing script that pulls real time NOAA satellite data and displays it in a graph.
14 stars 2 forks source link

Performance: Download Data Files, then Parse Locally #22

Closed rdustinb closed 9 years ago

rdustinb commented 9 years ago

Determine if this is a valid performance increase. After initially restructuring one of the data set blocks to use more efficient Python schemes, the performance wasn't increased as much as hoped. It is possible that the issue is just the access of the NOAA data.

rdustinb commented 9 years ago

So far from a user perspective this has no visible impact on the initial start up of the application.

rdustinb commented 9 years ago

Need to separate the process of pulling the remote data and actually drawing the graphs. This should be a supplier/consumer model of Python processes, one to write the data locally running on a cronjob or such and the other is my current application, simply parsing the local data files.

rdustinb commented 9 years ago

Downloading and parsing is not causing the bottleneck in performance. Closing.