Thanks for the great resource. The files are huge, and for good reason — but they're also stored as CSVs. Would it be possible to instead store the files as parquet? This will enable less bandwidth usage, storage space, and also has the schema defined inside the file format for ease of use. I can submit a PR if you're interested :)
Hey there,
Thanks for the great resource. The files are huge, and for good reason — but they're also stored as CSVs. Would it be possible to instead store the files as parquet? This will enable less bandwidth usage, storage space, and also has the schema defined inside the file format for ease of use. I can submit a PR if you're interested :)