Most data is available, but we probably don't want to be hitting these external sites too often. At the same point, hosting large files ourselves costs money. Also, it could be the case that we process a lot of raw data and store the results in the DB - what do we do with the raw data, if anything?
Clear guidelines and best practices are needed here. Doesn't need to be perfect the first time around, this isn't the final version!
Most data is available, but we probably don't want to be hitting these external sites too often. At the same point, hosting large files ourselves costs money. Also, it could be the case that we process a lot of raw data and store the results in the DB - what do we do with the raw data, if anything?
Clear guidelines and best practices are needed here. Doesn't need to be perfect the first time around, this isn't the final version!