cfpb / college-costs

⚠️ Deprecated: see note. ⚠️ A tool to help students weigh the costs and rewards of a college program.
https://www.consumerfinance.gov/paying-for-college2/understanding-your-financial-aid-offer/about-this-tool/
50 stars 27 forks source link

Adds option for loading program CSVs right from s3 #247

Closed higs4281 closed 8 years ago

higs4281 commented 8 years ago

Our data pipeline stores incoming school program data in s3; this allows the load_programs script to load these files directly fro s3 rather than requiring the moving and handling of files.

Additions

./manage.py load_programs --s3 true \
"http://files.consumerfinance.gov.s3.amazonaws.com/pb/paying_for_college/csv/CFPBDATAFILE713%20(2).CSV"

If you run ./manage.py purge programs first, it should load 1,522 programs.
If you run it without purging, it should report updating 1,522 programs.

Review

coveralls commented 8 years ago

Coverage Status

Coverage remained the same at 100.0% when pulling 1b0205e74387df6d537672696f844184f6df5699 on load-s3 into 503ad3882338e8f1120b9fa2b3aa88b4d3b165fe on master.

amymok commented 8 years ago

Looks good.