feedback: USDA needs to add "ARMS" dataset

[ceteri]

Updates from Julia -- good to reassign among others on the team:

USDA needs us to add the "ARMS" dataset for their review in mid-March:

• Agricultural Resource Management Survey
• https://www.ers.usda.gov/data-products/arms-farm-financial-and-crop-production-practices/

Wwe'll need to research which publications are linked. I've checked a few sources already and that looks reasonably rich. Here are several hundred candidates for Agricultural Resource Management Survey full-text search:

• https://pubmed.ncbi.nlm.nih.gov/?term=%22Agricultural+Resource+Management+Survey%22
• https://app.dimensions.ai/discover/publication?search_text=%22Agricultural%20Resource%20Management%20Survey%22&search_type=kws&search_field=full_search
• https://explore.openaire.eu/search/find?keyword=%22Agricultural%20Resource%20Management%20Survey%22

[ernestogimeno]

@andrewhnorris already added "ARMS" dataset in datasets.json.

As a starting point, I'm creating a datadrop using "USDA Agricultural Resource Management Survey" as search term -which returns ~140 unique titles- and breaking it down into 5 chunks of work, to do it in parallel.

[ernestogimeno]

@ceteri I realized that the federated search script does not includes journal in the datadrop, so that information is not included in the new partitions.

1. Should I fix that in federated search?
2. Is that an issue for the already generated partitions?

[ceteri]

No prob! Given either a doi or a good match on title, the journal is simple to retrieve later in the workflow.

[ernestogimeno]

Trying to came up with new search terms for generating new datadrops I access the dataset website and they have this page Uses and Publications where they reference only ERS (internal) use of ARMS.

Is there any value for including those in our KG at this point?

[ceteri]

Good find! Are all of those publications included, from https://www.ers.usda.gov/data-products/arms-farm-financial-and-crop-production-practices/uses-and-publications/#pubs ?

We should make sure we have coverage on those.

[ernestogimeno]

I tried with a few searches using our federated search -which only processes openAIRE, dimensions and PubMed at this time- and I could not find any of those reports.

Should we include authors in the partition for these ones in case they are not retrieved from any API we are using?

Do we also need to include those under "Other Material Highlighting ARMS" subtitle?

[ernestogimeno]

@ceteri In a couple of publications I found mentions to a "predecessor" dataset:

Data on farms and farm operator households were obtained from USDA’s Agricultural Resource Management Survey (ARMS) and its predecessor, the Farms Costs and Returns Survey (FCRS). The FCRS first reported comparable data in 1989, so we used that year as our starting point.

(source http://dx.doi.org/10.22004/ag.econ.34089)

I added Farms Costs and Returns Survey as an alternative title, but I'm not sure if that is the best way to handle this case. Should I add it as a different dataset?

[ceteri]

My sense is yes, that datasets have entirely different instances over time and typically get called as distinctly different data. Clayton may have a different view, which is good to check about -- but for now let's have a different dataset for FCRS.

[ceteri]

reopening, to make sure we can capture the points above