[CACHE] Use AlertaDengue's MinIO StorageBox to store the parsed Parquets as a File Cache

AlertaDengue / PySUS

Library to download, clean and analyze openly available datasets from Brazilian Universal health system, SUS.

GNU General Public License v3.0

178 stars 70 forks source link

Open luabida opened 8 months ago

luabida commented 8 months ago

The files would be retrieved from MinIO instead of DATASUS FTP, already parsed to parquets

Notes:

The CACHE system has to be able of handling files that are currently being updated, probably storing the last update date of the cached parquets