Then each day just append the last day data that we got from data providers. That will not reduce the number of i/o requests to data providers but will significantly reduce the bandwidth of such requests. Also, this can provide a fallback in case new data isn't yet available.
Then each day just append the last day data that we got from data providers. That will not reduce the number of i/o requests to data providers but will significantly reduce the bandwidth of such requests. Also, this can provide a fallback in case new data isn't yet available.
See https://github.com/butterdao/whip/issues/49 for a discussion on performance issues.