Generate one file that contains a subset of fields (to keep size within GitHub's limits) for all reports

data-liberation-project / phmsa-hazmat-incident-reports

Data from decades of PHMSA's "5800.1" hazardous material transportation incident reports

7 stars 3 forks source link

Open jsvine opened 1 year ago

jsvine commented 1 year ago

Key questions:

What columns are most useful (and to whom)?
How many columns can we fit without exceeding the file size limits (100mb)
In order to fit more columns, should we instead be making one file per decade?