create a /data page - Githubissues

18F / pulse

How the federal .gov domain space is doing at best practices and policies.

Other

95 stars 56 forks source link

create a /data page #449

Closed gbinal closed 7 years ago

gbinal commented 8 years ago

https://pulse.cio.gov/data would be a good page to have going forward.

gbinal commented 8 years ago

HTTPS scan data downloads - https://pulse.cio.gov/data/domains/https.csv
DAP scan data downloads - https://pulse.cio.gov/data/domains/analytics.csv
Domain Scan data downloads - https://s3.amazonaws.com/pulse.cio.gov/live/scan/inspect.csv

gbinal commented 8 years ago

a11y individual error details - https://staging.pulse.cio.gov/static/data/tables/accessibility/a11y.json
agencies and error totals - https://staging.pulse.cio.gov/static/data/tables/accessibility/agencies.json
domains and error totals - https://staging.pulse.cio.gov/static/data/tables/accessibility/domains.json

https://github.com/18F/pulse/tree/master/static/data/tables/accessibility

gbinal commented 8 years ago

Note also the urls on https://github.com/18F/pulse/issues/425

gbinal commented 8 years ago

@konklone - game to create the page as a shell? I tried but wasn't sure how to navigate the URL structure since there is a data folder.

I'm happy to follow up and populate if helpful.

It'd be great to be to include an MVP of this in the 8-24 push.

gbinal commented 8 years ago

Rock. We've got a placeholder for this now here (screenshot below).

screenshot from 2016-08-24 00-24-49

gbinal commented 7 years ago

Here's the outline I've got for the pulse.cio.gov/data page:

Download the Data

Pulse is a project of the General Services Administration that measures how U.S. government domains are following best practices for federal websites.

Pulse is also an experiment built on automated tools, and is probably not perfect. Pulse measures domains over the public internet using open source tools, and its results can be reviewed by anyone.

Site Wide

Domain Inspect Results (CSV)

HTTPS

HTTPS Scan Results (CSV)

Digital Analytics Program

Scan Data (CSV)
Participating DAP sites

Accessibility

Individual Error Results (CSV)
Individual Error Results (JSON)
Domain-Level Results (JSON)
Agency-Level Results (JSON)

gbinal commented 7 years ago

We're getting a first pass of this up, with https://github.com/18F/pulse/pull/597.

Other datafiles to potentially add:

konklone commented 7 years ago

Not db.json. That's the actual database -- it's published for our own convenience reasons (you can easily download it to sync an environment) but is not at all convenient or designed for the public.

gbinal commented 7 years ago

Roger that. I'll strike it through.

gbinal commented 7 years ago

This is done. There's more to do (linking it from more places, adding further links, but this issue can be closed for now.