V2 data status

[nerik]

Opening this issue to keep track of the data needed for the v2:

• [x] Routing geometries

  • [x] It seems that the dataset we have does not have routing for all origin - destination pairs (about 60% of them, precise count TBD)
  • [x] The lines are overly simplified, which generates ugly artefacts when two routes overlap at high-ish zoom levels. Could you provide a much less simplified version of the geometries (something with like 10 times less simplification). Payload size is far from being a concern so far.

• [ ] Drought and flood scenarios

  • [ ] ~We'll need a vector layer for the global intensity layer on the map.~
    • [ ] This will be two extra fields on the counties table and we'll paint a choropleth
  • [x] Calories count for drought and flood scenarios:
    • [x] We suggest adding two columns to every kcal_produced_[crop name]_results_df.csv file (liek Value_drought and Value_flood)

• [ ] "% of agriculture in GDP" for each county (as an extra field in the kcal_produced_Apples_results_df.csv file)

• [ ] Probably not in our radar for this phase of work, but just so we have that on the radar: for some sentences in the designs we are missing data, such as:

  • [ ] Roads used in routes ("Most of the commodities consumed in Cook, IL county travel through Interstate 95 (I-95) and Interstate 80 (I-80).")
  • [ ] Data related to droughts/flods ("Cook, IL has spent 82% of the past five years in drought; over half of that at “exceptional” intensity. If these conditions persisted in the next five years, the most likely crops to be impacted would be Almonds and Wheat.")

• [ ] Contents/ideas for the intro modal

[vgeorge]

@nerik @MaceGrim there are 90.740 O/D pairs in kcal_flows table and the route geometries are missing for 44.966 (~50%) of them. Examples:

[MaceGrim]

For computational reasons, I assumed that the routes were symmetrical. I'm hoping that explains the missing routes.

The lines themselves came straight from OSRM without any post-processing simplification. I'll check the config file to see if there's some simplification in there.

[cameronkruse]

@nerik Zia and I will be working to finish the climate models this week which will produce adjusted calorie counts in heat and drought per county. Do you need data sooner than tuesday/wednesday of next week? If so I can try to produce some randomly reduced data sets as dummy data.

Can you remind me what you need in the ""% of agriculture in GDP" for each county (as an extra field in the kcal_produced_Apples_results_df.csv file)" request?

I'll get to the intro modal later this week.

[nerik]

@cameronkruse I can generate random data on the frontend for purely rendering purposes. Can we wait for the week of the 31st to display real data? (@vgeorge is usually taking care of this, and he'll be OOO July 24th - July 31st)

Can you remind me what you need in the ""% of agriculture in GDP" for each county (as an extra field in the kcal_produced_Apples_results_df.csv file)" request?

This is part of an effort to display more meaningful stats in that top sidebar section (as suggested by @faustoperez). Sorry, the filename was wrong, what I meant was:

"% of agriculture in GDP" for each county (as an extra field in the county-population-consumption-production-scaled.csv file)

Hope that clarifies things. Thanks :)