nzinck17 / DCRShinyApp

The Shiny App to view and analyze water quality data collected by the Massachusetts Department of Conservation and Recreation
MIT License
0 stars 0 forks source link

Speed and Profiling #36

Open nzinck17 opened 6 years ago

nzinck17 commented 6 years ago

Is there ways we can make the App faster?

from running load.ms.access, it seems like as.posxct is very slow (takes longer than fetching the data from the databases). I found a link that has an alternative method which does this computation in C+.

https://stackoverflow.com/questions/13638545/speedup-conversion-of-2-million-rows-of-date-strings-to-posix-ct

Are we filtering dataframes more times than necessary in the large modules?

create year, month, and season columns once in load.ms.access, so do not have to keep on recreating them or directly performing this calc everytime.

nzinck17 commented 6 years ago

RDS files are now read upon opening WAVE session instead of database connection. Seems like we are pretty good on speed, but will leave open for future consideration