CouncilDataProject / cdp-backend

Data storage utilities and processing pipelines used by CDP instances.
https://councildataproject.org/cdp-backend
Mozilla Public License 2.0
22 stars 26 forks source link

Use requests stream and shutil.copyfileobj to constrain memory usage during resource copy #236

Closed whargrove closed 1 year ago

whargrove commented 1 year ago

Link to Relevant Issue

This pull request resolves #235

Description of Changes

codecov[bot] commented 1 year ago

Codecov Report

Merging #236 (0964eb4) into main (6c1c1ff) will increase coverage by 0.45%. The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #236      +/-   ##
==========================================
+ Coverage   71.67%   72.12%   +0.45%     
==========================================
  Files          50       50              
  Lines        3329     3376      +47     
==========================================
+ Hits         2386     2435      +49     
+ Misses        943      941       -2     
Impacted Files Coverage Δ
cdp_backend/tests/utils/test_file_utils.py 100.00% <100.00%> (ø)
cdp_backend/utils/file_utils.py 90.47% <100.00%> (+2.18%) :arrow_up: