search

datagouv / datagouvfr_data_pipelines

MIT License
5 stars 3 forks source link

[data-processing][rne] Unzip one stock rne file at a time #97

Closed HAEKADI closed 11 months ago

HAEKADI commented 11 months ago

Unzipped files are about 100G, and the prod server isn't big enough. Instead of extracting all files at once, only one file is extracted at a time.

HAEKADI commented 11 months ago

RNE data will be processed with annuaire workflows.