As a Search.gov Manager, I want to see SEO information about sites in the Federal Web Presence - Githubissues

18F / site-scanning

The code base for the first Site Scanning engine

https://digital.gov/site-scanning

18 stars 9 forks source link

As a Search.gov Manager, I want to see SEO information about sites in the Federal Web Presence #809

Closed alexbielen closed 4 years ago

alexbielen commented 4 years ago

Goal:

As a Search.gov Manager, I want to see SEO information about sites in the Federal Web Presencei.e.

Tasks:

[x] og_date_final_url
[x] og_title_final_url
[x] og_description_final_url
[x] main_element_final_url
[x] robots_txt_final_url
[x] robots_txt_final_url_live
[x] robots_txt_target_url_redirects
[x] robots_txt_final_url_filesize
[x] robots_txt_final_url_MIMEtype
[x] robots_txt_crawl_delay
[x] robots_txt_sitemap_locations
[x] robots_txt_sitemap_final_url
[x] sitemap_xml_final_url_live
[x] sitemap_xml_target_url_redirects
[x] sitemap_xml_final_url_filesize
[x] sitemap_xml_final_url_MIMEtype
[x] sitemap_xml_count
[x] sitemap_xml_pdf_count

Acceptance Criteria:

[x] Add To Scanner
[x] Add to Data Model
[x] Expose field in API
[x] Errors Logged
[x] Feature Tested

alexbielen commented 4 years ago

@laurenancona @gbinal

From coworking:

Hold on og:date until we hear more
main_element_final_url should be a boolean
For robots_* the request should start from the target_url
For filesize use bytes.