MarciMcGuireGCIO
commented
3 years ago - @zacharymorel it appears that the detail pages are not displaying the new PDF and online tool icons.
Icons for Change Direction:
- 💚 Positive - New results are better than original results
- 🔴 Negative - New results are worse the original results
- ❓ Mixed - Some positive, some negative aspects
- ➖ Neutral - Results are comparable
| Search term | Prod (Post-Launch) | Change Direction (Post-Launch Prod vs. Post-Launch Prod) | Comments |
|---|---|---|---|
| 88241i | No results | Neutral; still a bug | Adding after John reporting bug on Staging last week |
| 10101 | 10-10172 is found, VA10101 is not | Neutral; still a bug | Adding after VA reported bug last week |
| assign a representive | 5 | 💚 Positive | Includes results with "assign" and "repres…" root word, disregards "a". |
| assign a representative | 6 | 💚 Positive | Includes results with "assign" "repres…" and "appeal" root words, disregards "a" |
| va representative for appeals | 12 | 💚 Positive | Includes results with "assign" and "repres…" root word |
| how do I get a representative for va assistance | 15 | 💚 Positive | Includes results with key root words (rep, assistance) |
| 1010 | 186 | ❓ Mixed | Plus: Correctly finds forms starting with 10-10 and places 10-10EZ (most popular) at the top. Minus - returns far more results than Prod (188), some of which do not contain 10-10 or 1010. First page lists 22-10204 which seems irrelevant. Everything from page 4 on seems like it shouldn't be listed. 👉🏻 Update: This is a limitation of the search library. |
| 1010ez | 4 | ➖ Neutral | Also brings back 10-10EC, which could be useful in the event of user typo |
| 21P1775 | 1 | ➖ Neutral | Staging results same as Production |
| 210304 | 2 | 💚 Positive | Correctly finds 21-0304, even without the dash. Also brings back 21-0307, which could be useful in the event of user typo |
| va form 21-526 | 1 | ➖ Neutral | Post-launch results same as pre-launch Production |
| represenative | 4 | 💚 Positive | purposely misspelled based on research study; now brings back forms with the word "representative" in the name, and a form with "representation", which appears first. This is not unexpected since the search term is misspelled. |
| representive | 4 | 💚 Positive | purposely misspelled based on research study; now brings back forms with the word "representative" in the name, and a form with "representation", which appears first. This is not unexpected since the search term is misspelled. |
| travel | 3 | 💚 Positive | Staging results list results with word "travel" earlier in the title first. |
| nurse | 5 | 💚 Positive | Now places 10-2850A at the top (most popular form with the word 'nurse') and also includes a root word match that includes "nursing" |
| direct deposit | 9 | 💚 Positive | Match for exact phrase at the top, AND most popular form with that phrase is at the very top. Also includes matches based on root words. |
| release of information | 40 | 💚 Positive | Match for form name containing the full phrase "release of information" does not appear at the top For discussion: A form's popularity probably should not outrank a close match for the exact search phrase. |
| travel pay | 12 | ➖ Neutral | Result with exact string "pay" in title appears first. Other results are based on root words. Negative - some lower results contain actual string "travel" or "pay", but appear below root word matches containing "payroll" or "payment". Popularity doesn't seem to be a factor since higher-ranked aren't listed in popular forms. |
| dbq | 0 | ➖ Neutral | No change; we will need to do another iteration that focuses on common abbreviations |
| aid and attendance | 6 | 💚 Positive | Matches with literal string "aid and attendance" appear at the top. Top result is more popular than second match with exact phrase. |
| va form 21-526 | 1 | ➖ Neutral | Post-launch results same as pre-launch Production |
| certificate of eligibility | 63 | 💚 Positive | Full phrase match appears at top. Disregarding "of" drastically improves results. Second result is in the top 70 popular forms. |
| appeal | 10 | ❓ Mixed | VA9 is listed first, presumably because the word "appeal" appears twice in its name, making it most relevant to the search term. Second result with the word appeal is in the top 70 popular forms. 21-22 and 21-22a don't seem to be related to appeals, unless keywords have been added in the background |
| notification of personnel action | 4 | 💚 Positive | No exact match, but results with "personnel action" are ranked first, and the English version appears before the Spanish version of SF-52, even though the form names are formatted differently in the VA forms database. Disregarding "of" drastically improves results |
| intent to file | 3 | 💚 Positive | full phrase match at top, disregarding "to" drastically improves results |
| burial | 4 | 💚 Positive | Staging results list results with word "burial" earlier in the title first. |
| report of contact | 44 | 💚 Positive | No exact match, disregarding "of" drastically improves results |
| sf-50/ notification of personnel action | 4 | 💚 Positive | No exact match, but results with "personnel action appear at the top with the English version appearing before the Spanish version. Disregarding "of" drastically improves results |
| clothing allowance | 5 | 💚 Positive | full phrase match at top; next result with single-word match is in the top 70 popular forms. |
| ptsd | 2 | 💚 Positive | Results with "PTSD" earlier in the title first. |
| disability | 15 | 💚 Positive | Lists 21-526ez first as it's the most popular form with "disability" in the name. Bonus - now includes root word results for "disabled" |
| coe | 0 | ➖ Neutral | No change; we will need to do another iteration that focuses on common abbreviations |
| medical records | 32 | 💚 Positive | Full phrase match at top; bonus - also includes "medical record" without the s |
| fmla | 0 | ➖ Neutral | No change; we will need to do another iteration that focuses on common abbreviations |
| power of attorney | 2 | 💚 Positive | full phrase match at top |
| travel reimbursement | 9 | 💚 Positive | Top result is among top 70 popular forms. Matches containing both words (even though not in the same order) appear above matches with just one word. Also returns root word match for "reimbursable" |
| pension | 29 | 💚 Positive | Now puts 21-0966 at the top as it's one of the top 70 popular forms. Places results with "pension" in the middle of word like "Suspension" below exact word matches. |
| va form 10-2850c application for associated health occupations | 121 | 💚 Positive | 10-2850C name matches "10-2850c application for associated health occupations" and appears at the top. It is ranked 64th most popular. Disregarding "for" greatly improves result relevance. |
| authorization | 20 | 💚 Positive | Form 10-0459, in which "authorization" appears at the end of the name is listed second, even though later matches start with the word "authorization"; that particular order is not based on our popularity ranking. Positive - results also include root word match "authority" 👉🏻 Update: This is a limitation of the search library; two types of ranking are conflicting. |
| rfs | 0 | ➖ Neutral | No change; we will need to do another iteration that focuses on common abbreviations |
| notice of disagreement | 12 | 💚 Positive | Full phrase match at top; disregarding "of" drastically improves results. |
| request for service | 86 | 💚 Positive | Top result contains exact phrase and is among top 70 forms. |
| statement in support of claim | 69 | 💚 Positive | Full phrase matches are at the top. Top match is also most popular form. Disregarding "in" and "of" also drastically improves results |
| caregiver | 1 | ➖ Neutral | No change |
| change of address | 9 | 💚 Positive | full phrase matches at top, disregarding "of" also drastically improves results |
| burial benefits | 29 | 💚 Positive | full phrase matches at top; also includes root word matches for "benefit". |
| application for associated health occupations | 121 | 💚 Positive | full phrase match at top, disregarding "for" also drastically improves results |
| home loan | 50 | 💚 Positive | full phrase matches at top, seemingly ranked by how early in the name the string appears. |
| advance directive | 7 | 💚 Positive | Forms 10-0137 and 10-0137A which both contain "advance directive" appear at the top. Also brings back matches for "direct" |
| award letter | 13 | ➖ Neutral | No exact matches; not sure what determines order in this case. Match with "award" as third word listed after a match for "letter" as fourth word |
| supplemental claim | 42 | ➖ Neutral | 20-0995 which contains exact phrase "supplemental claim" is first, followed by partial matches. Also returns matches for "claims" and "claimant". |
| chapter 35 | 6 | 💚 Positive | No exact match, but returns every form with "chapter" in the name. |
| prior authorization | 24 | 💚 Positive | Also returns matches for "authority" |
| statement of service | 61 | 💚 Positive | No exact match, but disregarding "of" drastically improves results |
| application for nurses | 90 | 💚 Positive | full phrase match at top, disregarding "for" also drastically improves results |
| agent orange | 2 | 💚 Positive | No exact match, but an more popular English form match is now listed above a less-popular Spanish match. |
| nurse application | 90 | 💚 Positive | Matches with both words (even though not the the same order) at the top. Also returns matches for "nurses" |
| request for services | 85 | 💚 Positive | Top result contains "request for service" and is a popular form. Disregarding "for" drastically improves results |
| name change | 9 | 💚 Positive | Top result contains both words, even though not in the same order. No longer including results with "change" found in the middle of the word "exchange". |
| application for pension | 107 | 💚 Positive | Matches with both words (even though not the the same order) at the top. Top result is among most popular forms. Excluding "for" also improves results |
| third party | 8 | 💚 Positive | Matches with exact phrase appear at the top. Also includes matches with "parties" |
johnhashva
User Story
Issue for conducting Production smoke test July 6, 2021
Expected Behavior
Team will test Find a VA Form on the Staging environment at https://staging.va.gov/find-forms/
Acceptance Criteria
- [ ] Designer confirms that PDF download instructions on form detail pages match mockups (final design TBD)DESCOPED FROM THIS RELEASE 6/14/2021Search Terms for Testing
Note - copy and paste below table into your own comment for testing.
Icons for Change Direction: