PAB Review Prep

[csmcallister]

10x Qualitative Data User story

As a person that cares about this project, I'd like us to think about the following things to include/be aware of going into the PAB meeting.

10x/Qualitative Data Management Run Through Follow Up Questions

• How did this change the USAgov team?
  • [ ] Measure time reduction and/or cost avoidance in labeling comments
  • [ ] Show model's classification report on August data (this will show how good it is despite being such a simple model right now!)
• How could others in GSA use it?
  • Anyone with textual data that has been labeled into different categories (e.g. ham vs. spam) could use this to automate classification.
  • By exposing the model and a related database via an API and creating a UI on cloud.gov, folks could simply upload some labeled data once, let the model train, and then register their survey tool with the application so that it streams survey responses into the application. Survey comment classification would be scheduled to occur as that data streams in, populating the database. The UI sits atop this database and provides analytics to the end-user.
• How could other agencies use it?
  • The exact same way
  • [ ] Might be a good idea to ask the DAP team how many federal websites they track.
• Team would like to see a visual of what the product would look like.
  • [ ] Include the UI sketch here for an idea of what that could look like.
  • [ ] screenshots of the code? I think that was requested.
• How would the $650,000 be spent?
  • Database development
  • API development (for model(s), database)
    • might want to consider creating an API that could ingest data from non-Qualtrics sources, i.e. whatever the user has
  • Front-end dev for UI
  • cloud.gov hosting
• "how cheap our product would be vs these other products? "
  • https://cloud.gov/pricing/

[csmcallister]

[csmcallister]

This is also interesting if we want to speak to the number federal website users:

[DK1999]

2.64 billion visits is only pages with DAP code. They don't cover the whole gov.

[DK1999]

Here is a before image of comments. Which of these are helpful to our writers for improving or understanding how people use our content?

[DK1999]

Here is after the HSM has evaluated them. Now the writers don't have to read the one's marked spam. It's not just putting aside the real spammy junk. It even understands which comments are helpful to us.

[DK1999]

Agencies / Projects with survey comments that are interested in our work: HHS USDA / Centers of Excellence Customer Experience CAP Goals Working Group GSA via the Office of Customer Experience.

[DK1999]

Non-survey usage: PBS and Fleet Management Contact Center intake https://www.ftccomplaintassistant.gov/?utm_source=takeaction#crnt&panel1-1 https://consumercomplaints.fcc.gov/hc/en-us Search.gov

[DK1999]

https://www.regulations.gov/

[DK1999]

Every single member of congress has a comment box form. White House, too. They must get SO MUCH SPAM.

[amoose]

❤️