cagov / covid19

This is the official COVID19 response website for the state of California.
https://covid19.ca.gov/
44 stars 22 forks source link

Systematically link to Open Data Portal (from chart information and tracker boxes) #5353

Closed mediajunkie closed 2 years ago

mediajunkie commented 3 years ago

Still to do:

Needs some exploration.

Here is how SF does it.

Screen Shot 2021-09-23 at 1 14 43 PM
abquirarte commented 3 years ago

FWIW- I made this ask :)

Currently we bury links to the open data versions of our data dashboards/charts. As best practice, I'd like to have a link to the open data of each viz close to the visualization.

mediajunkie commented 3 years ago

@m-sullivan7 let's discuss how to implement this across all the data page and trackers.

m-sullivan7 commented 3 years ago

Off the top of my head, this may be as simple as putting a link in the Chart information drawers. I look forward to talking about it!

mediajunkie commented 3 years ago

That may well do the trick, and we could mock it up for discussion and review.

For the sake of argument let's consider how we might make the affordance visible by default without additional exploration required, as a further constraint.

m-sullivan7 commented 3 years ago

I'd benefit from some coordination before I mock something up to:

abquirarte commented 3 years ago

For me: I want to make sure any dashboard/data viz on covid19 that has open data posted has the link to the open dataset next to the visualization. This could start with a link on the "data notes" accordion, but would prefer something more visible if we can figure something out.

This means we'll have to inventory our data vizes and work with CDPH open data team to see which ones also post open data.

This addressed needs of users that are more data savy. Academics, journalists, data scientists.

Thanks team! Cc @mediajunkie @m-sullivan7

m-sullivan7 commented 3 years ago

Here's a spreadsheet of all our charts (plus a question about whether to include one map) with my best guesses as to what data source backs each up. Where I didn't have a good guess I left it blank.

@mediajunkie If you can fill any gaps and/or confirm my guesses, I'd love your assistance!

mediajunkie commented 3 years ago

on it!

On Fri, Oct 8, 2021 at 1:25 PM Michael Sullivan @.***> wrote:

Here's a spreadsheet of all our charts https://docs.google.com/spreadsheets/d/1pCYn_COc16VLmJmex9AF3eCLvsa_iAaOm5EuSkWAzng/edit?usp=sharing (plus a question about whether to include one map) with my best guesses as to what data source backs each up. Where I didn't have a good guess I left it blank.

@mediajunkie https://github.com/mediajunkie If you can fill any gaps and/or confirm my guesses, I'd love your assistance!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/cagov/covid19/issues/5353#issuecomment-939096511, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAYT54UPVGSZZLNBDYQ55KDUF5HR3ANCNFSM5ESNVAXQ .

-- Christian Crumlish Product Manager | Office of Digital Innovation Digital Crisis Standard https://github.com/cagov/covid19/wiki/Crisis-Standard - covid19.ca.gov 415-672-5759 | @.***

Follow us: web https://alpha.ca.gov/ | blog https://medium.com/cadotgov | twitter https://twitter.com/cadotgov

m-sullivan7 commented 3 years ago

Here's a list of all the charts/tracker boxes we can't clearly identify an Open Data Portal source to back up between @mediajunkie and me. We need to provide this list to our data stewards so they can help us identify (or, if needed, establish) data sources to link to.

State dashboard

Health equity

m-sullivan7 commented 3 years ago

Since we have data sources for everything on Vaccination progress data, I used that one to make a Google Doc mock up what links to data would look like.

m-sullivan7 commented 3 years ago

Vaccination progress data has been published with data sources. I will alert engineers to look at the column width of the last three columns where it looks like the data source note extends to the left of the chart.

I will work on state dashboard and health equity tomorrow.

abquirarte commented 3 years ago

Thank you @m-sullivan7! 😄

m-sullivan7 commented 3 years ago

@mediajunkie

Thanks to CDPH publishing the health equity Open Data Portal page, we can now add source data and Data and tools links to our pages. Here are Google Docs with those changes:

I'll ask a potentially radical question: do we need data dictionaries on covid19.ca.gov if we're providing clear source data links? These links go to the landing page for each data set, which includes a clear link to the data dictionary for each data set. In fact, it's easier for people to find these definitions by following those source links than by going to a separate page and having to flip back and forth between charts and figure out for themselves what goes with what.

Perhaps good reasons for hosting this data on covid19.ca.gov still exist, but my outsider brain flagged this as something that didn't make initial sense. This would reduce duplicated content between our site and the Open Data Portal and reduce the content load on our site.

mediajunkie commented 3 years ago

I wonder this as well. Let me do two things:

Feel free to do the latter yourself in the meantime if so inclined!

On Mon, Oct 25, 2021 at 4:51 PM Michael Sullivan @.***> wrote:

@mediajunkie https://github.com/mediajunkie

Thanks to CDPH publishing the health equity Open Data Portal page https://data.chhs.ca.gov/dataset/covid-19-equity-metrics, we can now add source data and Data and tools https://covid19.ca.gov/data-and-tools/ links to our pages. Here are Google Docs with those changes:

I'll ask a potentially radical question: do we need data dictionaries on covid19.ca.gov if we're providing clear source data links? These links go to the landing page for each data set, which includes a clear link to the data dictionary for each data set. In fact, it's easier for people to find these definitions by following those source links than by going to a separate page and having to flip back and forth between charts and figure out for themselves what goes with what.

Perhaps good reasons for hosting this data on covid19.ca.gov still exist, but my outsider brain flagged this as something that didn't make initial sense. This would reduce duplicated content between our site and the Open Data Portal and reduce the content load on our site.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/cagov/covid19/issues/5353#issuecomment-951320035, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAYT54QTYBI4FETZUC3BNRLUIW7NFANCNFSM5ESNVAXQ .

-- Christian Crumlish Product Manager | Office of Digital Innovation Digital Crisis Standard https://github.com/cagov/covid19/wiki/Crisis-Standard - covid19.ca.gov 415-672-5759 | @.***

Follow us: web https://alpha.ca.gov/ | blog https://medium.com/cadotgov | twitter https://twitter.com/cadotgov

m-sullivan7 commented 3 years ago

I discovered that https://covid19.ca.gov/vaccination-progress-data/#overview has a link in the Tableau chart to https://covid19.ca.gov/data-and-tools/#COVID-19-VACCINE-DATA. It's the only Tableau chart that links to our Data and tools page. Perhaps we had links in old Tableau charts we've since replaced with D3 charts. That would explain why we have anchor links for each accordion.

I can't recall if the data dictionaries predate Hannah. Here's the archive folder of content drafts. The oldest useful draft is from March 2021. Don't think there's much that's helpful in there, but thought I'd share all the same. :smile:

mediajunkie commented 3 years ago

please do make the blocked changes above. I'm afraid the "radical" question distracted me from the straightforward one. (More on that separately.)

m-sullivan7 commented 3 years ago

Data and tools is live. Jim is investigating getting a couple of links in the health equity page in the right place. Content is mostly staged and ready to go.

m-sullivan7 commented 3 years ago

Health equity is live too now.

That leaves just one source data link missing @mediajunkie: the Positivity rate in California/county chart. I suspect that it's the same data as the neighboring chart, Total tests in California/county. If they use the same source data, it's an easy content fix to make the existing link cover both charts.

Do we want to continue the bigger Data and tools discussion in this issue or create a new issue so this issue can be closed (since the original purpose will be fulfilled)?

mediajunkie commented 3 years ago

It does appear that the same source that gives the total number of tests per county also gives the number of positive tests, so maybe the question to confirm with @jbum is whether that ratio is the source of the positivity rate we report, or if it we have another source that is documented elsewhere in the ODP.

m-sullivan7 commented 3 years ago

Thanks for the initial look! I'll wait for final confirmation from @jbum before preparing a quick edit for state dashboard.

m-sullivan7 commented 3 years ago

@mediajunkie I confirmed with Jim that the charts use the same source data. I drafted this content update to cover off our last piece of source data documentation. OK to publish?

I also updated our spreadsheet with this last piece.

mediajunkie commented 3 years ago

Yes, please!

m-sullivan7 commented 2 years ago

The final source data link is on state dashboard. Do we want to have the Data and tools overhaul on this ticket or will we close this one and move that to a new ticket?

mediajunkie commented 2 years ago

new ticket, in backlog -- Christian Crumlish Product Manager | Office of Digital Innovation Digital Crisis Standard https://github.com/cagov/covid19/wiki/Crisis-Standard - covid19.ca.gov 415-672-5759 | @.***

Follow us: web https://alpha.ca.gov/ | blog https://medium.com/cadotgov | twitter https://twitter.com/cadotgov