[CACHE] Use AlertaDengue's MinIO StorageBox to store the parsed Parquets as a File Cache

AlertaDengue / PySUS

Library to download, clean and analyze openly available datasets from Brazilian Universal health system, SUS.

GNU General Public License v3.0

175 stars 68 forks source link

Open luabida opened 7 months ago

luabida commented 7 months ago

The files would be retrieved from MinIO instead of DATASUS FTP, already parsed to parquets

Notes:

The CACHE system has to be able of handling files that are currently being updated, probably storing the last update date of the cached parquets