Historical data from USDA Risk Management Agency 2021-08-01

[theo-armour]

https://theo-armour.github.io/maps-2021/sandbox/rma-stats/rma-stats/v-2021-08-01-1400/rma-stats.html

Screen shot 14:00 release

Concept

This script loads, parses and displays sample data files from here:

• https://www.rma.usda.gov/en/Information-Tools/Summary-of-Business/Cause-of-Loss

Cause of Loss Historical Data Files Summarized participation information broken down by the causes of loss. Each link contains a ZIP file with compressed data containing pipe (|) delimited flat-files that can be imported into any standard spreadsheet and/or database for further analysis. Record description file located in each subfolder.

At load time

• Download RMA sample data files from GitHub Page server using XMLHttpRequest. Files are typically4MB ZIP files.
• Decompress the files using JSZip.js. Uncompressed files are typically 38 MB with over 125,000 lines of CSV-type data with 30 fields
• Parse the data into an array of arrays in JSON format
• Report file size, number of lines, time to load
• Display the first 30 lines of records

At run time, you can

• Click on a list of years to load, parse and display its data ( repeat load time events for that year ) Sample data files from here:
• Click on a list of all the field headings to display the data for that field
  • If the data is categorical (FIPs code or name of a state), find al the unique values and list their count
  • if the data is tabular * number of acres or size of indemnity, list the sum, average, minimum and maximum of all values
• Click a button to view a list of all the counties showing county name, state, FIPs code, acres planted, total liability and total indemnity.

14:00

14:00: Add: identify major crops, crop acres, indemnities and loss codes by county

Issues

• Looks like "Planted Acres" is being double counted along with other other similar issues

To Do / Wish List

• 2021-08-01 ~ Develop a way of checking county data for errors in data interpretation
• 2021-08-01 ~ Present data by states then county
• 2021-08-01 ~ Use menu or display tag to show and hide data by state then county
• 2021-08-01 ~ Identify major crops by country, state & county
• 2021-08-01 ~ Identify major losses by country, state & county
• 2021-08-01 ~ Help Identify data that may be viewed on a map

[theo-armour]

@managingwholes

Thank you for the link to the USDA RMA historical data files. Lot's of good numbers here! Will be fun to explore.

The code in this little demo may be useful in helping you create an Observable that displays data of this nature.

Currently I have enough on to-do list to proceed by myself: the next iteration or two of the text viewer and a number of fixes to the 3D globe.

After that is done, we could start to help me come to some understanding as to what all of this means and how it applies to soil conservation.