search

globaldothealth / outbreak-data

For users of G.h data: notes, timelines, sources, etc.
MIT License
0 stars 0 forks source link

Is there value in tracking both the USDA and WOAH sites for the timeline? #17

Closed JacqSauer closed 4 months ago

JacqSauer commented 4 months ago

@aimeehan1 stated: "The question we were asked last week -- is there value added in tracking both sites, does one provide unique information not listed by the other, or can we default to presenting WOAH data? Dinesh was able to set-up an automated scrape/ pull of USDA data. Let me know your thoughts after playing around with both sites I'll load his Excel version into our outbreak folder - it's too big for Slack."

USDA website: https://www.aphis.usda.gov/livestock-poultry-disease/avian/avian-influenza/hpai-detections WOAH website: https://wahis.woah.org/#/in-review/4451?reportId=167672&fromPage=event-dashboard-url and https://wahis.woah.org/#/in-review/4309?fromPage=event-dashboard-url

@jackie-powers @JacqSauer @julianasopko please add thoughts/opinions/experiences

jackie-powers commented 4 months ago

For the cases on our poultry outbreaks and cattle outbreaks sheets, I compared the USDA's confirmed date variable and WOAH's start date variable to see the average difference in days between the two sources. For the poultry data, USDA reported the cases about 4 days later on average compared to WOAH. The biggest discrepancy I saw for the poultry data was a 19 day difference between the two sources. The cattle data on the cattle outbreaks sheet is incomplete, but for the cases I did have, USDA reported the cases about 11 days later on average compared to WOAH with there being a 53 day delay in reporting for one of the cases. I hope this brings some insight into the magnitude of this date discrepancy we're seeing.

JacqSauer commented 4 months ago

Going off of @jackie-powers comment, I feel the USDA reports are released more frequently/at an earlier time. I logged USDA poultry cases 33 and 34 last week (07/01) but did not see any information released on these cases by the WOAH until a short time later (07/03 is when the report came out I believe). While the USDA information is available sooner, we are seeing issues of data reconciliation. I think both sources are helpful, the USDA gives us more frequent reports that allow for a quick turnaround of data/information and the WOAH is a source that allows us to check/verify our entries

JacqSauer commented 4 months ago

curator decison: keep using both as USDA posts more frequently and the WOAH posts one a week, use WOAH for confirmation process