dssg / matching-tool

Integrating HMIS and criminal-justice data
Other
7 stars 7 forks source link

Make uploader usable without s3 [Resolves #320] #321

Closed thcrock closed 6 years ago

thcrock commented 6 years ago

Since much of the code was already using smart_open, the replacement here that uses boto3 has the same semantics as smart_open: an open function that switches between filesystem and s3 based on scheme.

To showcase this, there is a new endpoint test that does the while flow (uploading and merging) without mocking s3 at all to prove that it works.