mekevans / forestTIME

1 stars 0 forks source link

Get more columns #28

Closed diazrenata closed 8 months ago

diazrenata commented 8 months ago

Switches to pulling in all columns from the TREE, PLOT, and CONDITION tables and storing them in the hive format.

This creates some complexities in loading in data, because some of the columns (e.g. HABITATTYPE) can create problems for some states. For the create_tables functions, I am getting around this by never loading those columns into memory. For the query_tables function, I manually removed some columns that were creating problems for Idaho, but there is the potential for the same basic problem, different columns, to create errors for other states. I am mulling on a better workaround for this.