Currently the headers of our different CSV's differ based on what data was available in the original collection. This makes merging CSV's together more difficult and error prone, particularly when it's done manually.
We should normalise the headers across all the files, but also preserve the data that we've collected. A dumb way to do this is to move create a old directory in each state directory, and put them the current versions with the extra headers in there. Then we can cut down the production files without losing anything. This feels like an intuitive way for people to find and access the old data—at least until we think of something better.
Currently the headers of our different CSV's differ based on what data was available in the original collection. This makes merging CSV's together more difficult and error prone, particularly when it's done manually.
We should normalise the headers across all the files, but also preserve the data that we've collected. A dumb way to do this is to move create a
olddirectory in each state directory, and put them the current versions with the extra headers in there. Then we can cut down the production files without losing anything. This feels like an intuitive way for people to find and access the old data—at least until we think of something better.