Issue 137 ensure s3 dataset download

[pvk-developer]

Created a dataloader.py that is able to download from http and s3 at the moment. More download methods can be implemented in this file.

• Change on the data_load methods so there is not too much access to disk.
• Removed the API preprocessors as there is no need of them anymore because of the database.py changes.
• Fix on the worker.py s3 upload metrics / models.
• Adaptation on the rest of the code where the download / data load was used.
• utilities.py removed unused code.

Resolve #137

[codecov-io]

Codecov Report

Merging #140 into master will increase coverage by 1.5%. The diff coverage is 71.89%.

@@            Coverage Diff            @@
##           master     #140     +/-   ##
=========================================
+ Coverage   62.95%   64.45%   +1.5%     
=========================================
  Files          15       15             
  Lines        1663     1646     -17     
=========================================
+ Hits         1047     1061     +14     
+ Misses        616      585     -31

Impacted Files	Coverage Δ
atm/utilities.py	82.14% <ø> (+13.06%)	:arrow_up:
atm/encoder.py	69.56% <ø> (-6.63%)	:arrow_down:
atm/api/__init__.py	0% <0%> (ø)	:arrow_up:
atm/classifier.py	67.13% <100%> (-0.85%)	:arrow_down:
atm/core.py	70.29% <100%> (-1.93%)	:arrow_down:
atm/config.py	77.67% <100%> (+0.2%)	:arrow_up:
atm/worker.py	75.51% <45.45%> (-0.52%)	:arrow_down:
atm/dataloader.py	70.37% <70.37%> (ø)
atm/database.py	76.81% <95.55%> (+2.69%)	:arrow_up:

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 3983efc...4cb4462. Read the comment docs.