Prepare prod for beta.developer.mozilla.org

[escattone]

User story

As a developer, I want to prepare production to handle the separate beta.developer.mozilla.org and wiki.developer.mozilla.org domains so we're ready when we make those domains public.

Acceptance criteria

• [x] Site test checklist (as defined in https://github.com/mdn/sprints/issues/1205) passes for all of the domains: developer.mozilla..org, beta.developer.mozilla.org, and wiki.developer.mozilla.org.

Tasks

• [x] New SSL cert for production CDN
• [x] (Maybe) New SSL cert for production ELB
• [x] (Maybe) New SSL cert for stage ELB
• [x] Create a new behavior for the production CDN to handle requests to /api/v1/doc/*
• [x] Create a new behavior for the production CDN to handle requests to /api/v1/whoami/*
• [x] Add the prod S3 bucket as an origin on the prod CDN
• [x] Populate the prod S3 bucket with the document API JSON files derived from the prod DB (it's not currently populated)
• [x] Create DNS CNAMES for beta.developer.mozilla.org and wiki.developer.mozilla.org (pointing to the prod CDN and the prod ELB respectively)
• [x] Create DNS CNAMES for beta.developer.allizom.org and wiki.developer.allizom.org (pointing to the stage CDN and the stage ELB respectively)
• [x] Run through the test checklist (as defined in https://github.com/mdn/sprints/issues/1205) for all of the domains: developer.mozilla..org, beta.developer.mozilla.org, and wiki.developer.mozilla.org (this task depends on the prior successful completion of https://github.com/mdn/sprints/issues/1205 -- the details are here)

[escattone]

• created new, validated SSL certs for the stage, prod, and standby ELB's
• attached the new SSL certs to their respective ELB's
• deleted all of the old, unused SSL certs for stage, prod, and standby
• with @limed's help, updated the DNS entries for wiki.developer.allizom.org and wiki.developer.mozilla.org to point to their respective ELB's (bypassing their respective CDN's)
• created a new SSL cert for the prod CDN (still need to attach it)

[escattone]

• attached the new SSL cert to the prod CDN
• added wiki.developer.mozilla.org and beta.developer.mozilla.org to the prod CDN's list of alternate domain names (CNAME's)
• added the prod API S3 bucket as an origin on the prod CDN
• created a new behavior for the production CDN to handle requests to /api/v1/doc/* from S3
• created a new behavior for the production CDN to handle requests to /api/v1/whoami/* from the ELB

[escattone]

I published all of the production documents to the production S3 bucket. Well, all except one. There is this one evil document (/zh-CN/docs/Archive/Web/LiveConnect) which crashes the celery worker when it is run. When I tried to publish it manually it crashed Python as well. Also, when I request the document like https://developer.mozilla.org/zh-CN/docs/Archive/Web/LiveConnect, I wait and wait and wait (>30 seconds) but no response. Something is rotten with that document.

[jmswisher]

Given that it's under /Archive, it's probably not a big deal to delete that document. It would be great to figure out what's wrong with it, but not if it turns into a rabbit hole.

[escattone]

I also re-published all of the stage documents to the stage S3 bucket. I did this because https://github.com/mozilla/kuma/pull/5402 added an enSlug attribute to the JSON that the document API returns.

[escattone]

I'm going to document the results of my testing against prod.

Home page

Load https://developer.mozilla.org/en-US and https://wiki.developer.mozilla.org/en-US

• [x] Loads without errors
• [x] Does not have banner "MDN is currently in read-only maintenance mode. Learn more."
• [x] Has "Sign in" or "View Profile" at the top
• [x] Has entries for the Hacks Blog

Load https://beta.developer.mozilla.org/en-US

• [x] Loads without errors
• [x] Does not have banner "MDN is currently in read-only maintenance mode. Learn more."
• Failed Missing header as well as MDN contribution banner (this is a known issue)
• [x] Has entries for the Hacks Blog

Article page

Load https://developer.mozilla.org/en-US/docs/Web/HTML, https://wiki.developer.mozilla.org/en-US/docs/Web/HTML, and https://beta.developer.mozilla.org/en-US/docs/Web/HTML

• [x] Loads without errors
• [x] No Maintenance Mode banner
• [x] Has "Sign in" or "View Profile" at the top

[escattone]

Functional and Headless Tests

The Firefox and Chrome functional tests as well as the headless tests pass when run against stage (https://developer.allizom.org) from Jenkins.

• [x] Functional tests pass
• [x] Headless tests pass

The Firefox and Chrome functional tests as well as the headless tests pass when run against https://wiki.developer.mozilla.org.

• [x] Functional tests pass
• [x] Headless tests pass

[escattone]

Submitted https://github.com/mozilla/kuma/pull/5426 (minor tweaks) to address a testing issue with the headless tests when run against the production or wiki domains.

[escattone]

The Firefox and Chrome functional tests as well as the headless tests pass when run against https://developer.mozilla.org.

• [x] Functional tests pass
• [x] Headless tests pass

[escattone]

Full Manual Tests

Content tests

These URLs should have similar results for anonymous or logged-in users:

• [x] https://mdn.mozillademos.org/en-US/docs/Learn/CSS/Styling_text/Fundamentals$samples/Color - 200, sample as a stand-alone page
• [x] https://mdn.mozillademos.org/files/12984/web-font-example.png - 200, PNG of some "Hipster ipsum" text
• [x] https://developer.mozilla.org/@api/deki/files/3613/=hut.jpg - 200, image of a hat
• [x] https://wiki.developer.mozilla.org/@api/deki/files/3613/=hut.jpg - 200, image of a hat
• [x] https://beta.developer.mozilla.org/@api/deki/files/3613/=hut.jpg - 200, image of a hat
• [x] https://developer.mozilla.org/contribute.json - 200, project info
• [x] https://wiki.developer.mozilla.org/contribute.json - 200, project info
• [x] https://beta.developer.mozilla.org/contribute.json - 200, project info
• [x] https://developer.mozilla.org/diagrams/workflow/workflow.svg - 200, SVG with images
• [x] https://wiki.developer.mozilla.org/diagrams/workflow/workflow.svg - 200, SVG with images
• [x] https://beta.developer.mozilla.org/diagrams/workflow/workflow.svg - 404 - Drop support for legacy files
• [x] https://developer.mozilla.org/en-US/Firefox/Releases - 200, Firefox logo, list of releases (zoned URL)
• [x] https://wiki.developer.mozilla.org/en-US/Firefox/Releases - 200, Firefox logo, list of releases (zoned URL)
• [x] https://beta.developer.mozilla.org/en-US/Firefox/Releases - 200, Firefox logo, list of releases (zoned URL)
• [x] https://developer.mozilla.org/en-US/dashboards/macros - 200, list of macros and page counts
• [x] https://wiki.developer.mozilla.org/en-US/dashboards/macros - 200, list of macros and page counts
• [x] https://beta.developer.mozilla.org/en-US/dashboards/macros - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/dashboards/revisions - 200, list of recent changes (when signed-in)
• [x] https://wiki.developer.mozilla.org/en-US/dashboards/revisions - 200, list of recent changes (when signed-in)
• [x] https://beta.developer.mozilla.org/en-US/dashboards/revisions - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Learn/CSS/Styling_text/Fundamentals#Color - 200, with sample as iframe
• [x] https://wiki.developer.mozilla.org/en-US/docs/Learn/CSS/Styling_text/Fundamentals#Color - 200, with sample as iframe
• [x] https://beta.developer.mozilla.org/en-US/docs/Learn/CSS/Styling_text/Fundamentals#Color - 200, with sample as iframe
• [x] https://developer.mozilla.org/en-US/docs/Learn/CSS/Styling_text/Fundamentals$toc - 200, HTML table of contents
• [x] https://wiki.developer.mozilla.org/en-US/docs/Learn/CSS/Styling_text/Fundamentals$toc - 200, HTML table of contents
• [x] https://beta.developer.mozilla.org/en-US/docs/Learn/CSS/Styling_text/Fundamentals$toc - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Web/HTML$children - 200, JSON list of child pages
• [x] https://wiki.developer.mozilla.org/en-US/docs/Web/HTML$children - 200, JSON list of child pages
• [x] https://beta.developer.mozilla.org/en-US/docs/Web/HTML$children - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Web/HTML$compare?locale=en-US&to=1299417&from=1293895 - 200, compares revisions
• [x] https://wiki.developer.mozilla.org/en-US/docs/Web/HTML$compare?locale=en-US&to=1299417&from=1293895 - 200, compares revisions
• [x] https://beta.developer.mozilla.org/en-US/docs/Web/HTML$compare?locale=en-US&to=1299417&from=1293895 - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Web/HTML$history - 200, list of revisions
• [x] https://wiki.developer.mozilla.org/en-US/docs/Web/HTML$history - 200, list of revisions
• [x] https://beta.developer.mozilla.org/en-US/docs/Web/HTML$history - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Web/HTML$json - 200, JSON of page metadata
• [x] https://wiki.developer.mozilla.org/en-US/docs/Web/HTML$json - 200, JSON of page metadata
• [x] https://beta.developer.mozilla.org/en-US/docs/Web/HTML$json - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Web/HTML$revision/1293895 - 200, historical revision
• [x] https://wiki.developer.mozilla.org/en-US/docs/Web/HTML$revision/1293895 - 200, historical revision
• [x] https://beta.developer.mozilla.org/en-US/docs/Web/HTML$revision/1293895 - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/all - 200, paginated list of docs
• [x] https://wiki.developer.mozilla.org/en-US/docs/all - 200, paginated list of docs
• [x] https://beta.developer.mozilla.org/en-US/docs/all - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/ckeditor_config.js - 200, JavaScript
• [x] https://wiki.developer.mozilla.org/en-US/docs/ckeditor_config.js - 200, JavaScript
• [x] https://beta.developer.mozilla.org/en-US/docs/ckeditor_config.js - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/feeds/atom/files/ - 200, Atom feed of changed files
• [x] https://wiki.developer.mozilla.org/en-US/docs/feeds/atom/files/ - 200, Atom feed of changed files
• [x] https://beta.developer.mozilla.org/en-US/docs/feeds/atom/files/ - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/feeds/rss/all/ - 200, RSS feed of new pages
• [x] https://wiki.developer.mozilla.org/en-US/docs/feeds/rss/all/ - 200, RSS feed of new pages
• [x] https://beta.developer.mozilla.org/en-US/docs/feeds/rss/all/ - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/feeds/rss/needs-review/ - 200, RSS feed of pages needing review
• [x] https://wiki.developer.mozilla.org/en-US/docs/feeds/rss/needs-review/ - 200, RSS feed of pages needing review
• [x] https://beta.developer.mozilla.org/en-US/docs/feeds/rss/needs-review/ - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/feeds/rss/needs-review/technical - 200, RSS feed of pages needing technical review
• [x] https://wiki.developer.mozilla.org/en-US/docs/feeds/rss/needs-review/technical - 200, RSS feed of pages needing technical review
• [x] https://beta.developer.mozilla.org/en-US/docs/feeds/rss/needs-review/technical - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/feeds/rss/revisions - 200, RSS feed of changes
• [x] https://wiki.developer.mozilla.org/en-US/docs/feeds/rss/revisions - 200, RSS feed of changes
• [x] https://beta.developer.mozilla.org/en-US/docs/feeds/rss/revisions - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/feeds/rss/tag/CSS - 200, RSS feed of pages with CSS tag
• [x] https://wiki.developer.mozilla.org/en-US/docs/feeds/rss/tag/CSS - 200, RSS feed of pages with CSS tag
• [x] https://beta.developer.mozilla.org/en-US/docs/feeds/rss/tag/CSS - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/needs-review/editorial - 200, paginated list of documents
• [x] https://wiki.developer.mozilla.org/en-US/docs/needs-review/editorial - 200, paginated list of documents
• [x] https://beta.developer.mozilla.org/en-US/docs/needs-review/editorial - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/tag/ARIA - 200, list of documents
• [x] https://wiki.developer.mozilla.org/en-US/docs/tag/ARIA - 200, list of documents
• [x] https://beta.developer.mozilla.org/en-US/docs/tag/ARIA - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/tags - 200, paginated list of tags
• [x] https://wiki.developer.mozilla.org/en-US/docs/tags - 200, paginated list of tags
• [x] https://beta.developer.mozilla.org/en-US/docs/tags - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/top-level - 200, paginated list of documents
• [x] https://wiki.developer.mozilla.org/en-US/docs/top-level - 200, paginated list of documents
• [x] https://beta.developer.mozilla.org/en-US/docs/top-level - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/with-errors - 200, (empty?) paginated list of documents
• [x] https://wiki.developer.mozilla.org/en-US/docs/with-errors - 200, (empty?) paginated list of documents
• [x] https://beta.developer.mozilla.org/en-US/docs/with-errors - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/without-parent - 200, paginated list of documents
• [x] https://wiki.developer.mozilla.org/en-US/docs/without-parent - 200, paginated list of documents
• [x] https://beta.developer.mozilla.org/en-US/docs/without-parent - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/profiles/sheppy - 200, Sheppy's profile
• [x] https://wiki.developer.mozilla.org/en-US/profiles/sheppy - 200, Sheppy's profile
• [x] https://beta.developer.mozilla.org/en-US/profiles/sheppy - 404 - Do not support (for now)
• [x] https://developer.mozilla.org/en-US/promote/ - 200, Promote MDN with 4 buttons
• [x] https://wiki.developer.mozilla.org/en-US/promote/ - 200, Promote MDN with 4 buttons
• [x] https://beta.developer.mozilla.org/en-US/promote/ - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/search - 200, Search results
• [x] https://wiki.developer.mozilla.org/en-US/search - 200, Search results
• [x] https://beta.developer.mozilla.org/en-US/search - 200
• [x] https://developer.mozilla.org/fellowship/ - 301 to archive of 2015 MDN Fellowship Program
• [x] https://wiki.developer.mozilla.org/fellowship/ - 301 to archive of 2015 MDN Fellowship Program
• [x] https://beta.developer.mozilla.org/fellowship/ - 301 to archive of 2015 MDN Fellowship Program - NOTE: The beta archived pages are missing the warning border.
• [x] https://developer.mozilla.org/files/12984/web-font-example.png - Redirects to https://mdn.mozillademos.org
• [x] https://wiki.developer.mozilla.org/files/12984/web-font-example.png - Redirects to https://mdn.mozillademos.org
• [x] https://beta.developer.mozilla.org/files/12984/web-font-example.png - Redirects to https://mdn.mozillademos.org
• [x] https://developer.mozilla.org/fr/docs/feeds/rss/l10n-updates/ - 200, RSS feed of out-of-date pages
• [x] https://wiki.developer.mozilla.org/fr/docs/feeds/rss/l10n-updates/ - 200, RSS feed of out-of-date pages
• [x] https://beta.developer.mozilla.org/fr/docs/feeds/rss/l10n-updates/ - 404 - Do not support
• [x] https://developer.mozilla.org/fr/docs/localization-tag/inprogress - 200, paginated list of documents
• [x] https://wiki.developer.mozilla.org/fr/docs/localization-tag/inprogress - 200, paginated list of documents
• [x] https://beta.developer.mozilla.org/fr/docs/localization-tag/inprogress - 404 - Do not support
• [x] https://developer.mozilla.org/humans.txt - 200, list of GitHub usernames
• [x] https://wiki.developer.mozilla.org/humans.txt - 200, list of GitHub usernames
• [x] https://beta.developer.mozilla.org/humans.txt - 200, list of GitHub usernames
• [x] https://developer.mozilla.org/media/kumascript-revision.txt - 200, git commit hash for kumascript
• [x] https://wiki.developer.mozilla.org/media/kumascript-revision.txt - 200, git commit hash for kumascript
• [x] https://beta.developer.mozilla.org/media/kumascript-revision.txt - 200, git commit hash for kumascript
• [x] https://developer.mozilla.org/media/revision.txt - 200, git commit hash for kuma
• [x] https://wiki.developer.mozilla.org/media/revision.txt - 200, git commit hash for kuma
• [x] https://beta.developer.mozilla.org/media/revision.txt - 200, git commit hash for kuma
• [x] https://developer.mozilla.org/miel - 500 Internal Server Error
• [x] https://wiki.developer.mozilla.org/miel - 500 Internal Server Error
• [x] https://beta.developer.mozilla.org/miel - 404 - Do not support
• [x] https://developer.mozilla.org/presentations/microsummaries/index.html - 200, 2006 OSCON presentation
• [x] https://wiki.developer.mozilla.org/presentations/microsummaries/index.html - 200, 2006 OSCON presentation
• [x] https://beta.developer.mozilla.org/presentations/microsummaries/index.html - 404 - Drop support for legacy files
• [x] https://developer.mozilla.org/robots.txt - 200, robots disallow list
• [x] https://wiki.developer.mozilla.org/robots.txt - 200, robots disallow list
• [x] https://beta.developer.mozilla.org/robots.txt - 200, robots disallow list
• [x] https://developer.mozilla.org/samples/webgl/sample3 - 200, Shows WebGL demo
• [x] https://wiki.developer.mozilla.org/samples/webgl/sample3 - 200, Shows WebGL demo
• [x] https://beta.developer.mozilla.org/samples/webgl/sample3 - 200, Shows WebGL demo
• [x] https://developer.mozilla.org/sitemap.xml - 200, list of sitemaps
• [x] https://wiki.developer.mozilla.org/sitemap.xml - 200, list of sitemaps (containing the same URL's as for https://developer.mozilla.org)
• [x] https://beta.developer.mozilla.org/sitemap.xml - 200, list of sitemaps (containing the same URL's as for https://developer.mozilla.org)
• [x] https://developer.mozilla.org/sitemaps/en-US/sitemap.xml - 200, list of en-US pages
• [x] https://wiki.developer.mozilla.org/sitemaps/en-US/sitemap.xml - 200, list of en-US pages (containing the same URL's as for https://developer.mozilla.org)
• [x] https://beta.developer.mozilla.org/sitemaps/en-US/sitemap.xml - 200, list of en-US pages (containing the same URL's as for https://developer.mozilla.org)

Anonymous tests

Test these URLs as an anonymous user:

• [x] https://developer.mozilla.org/admin/users/user/1/ - 302 redirect to the Admin login page, asking for a username and password.
• [x] https://wiki.developer.mozilla.org/admin/users/user/1/ - 302 redirect to the Admin login page, asking for a username and password.
• [x] https://beta.developer.mozilla.org/admin/users/user/1/ - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/dashboards/spam - 302 redirect to user sign-in page, asking to Sign In with GitHub
• [x] https://wiki.developer.mozilla.org/en-US/dashboards/spam - 302 redirect to user sign-in page, asking to Sign In with GitHub
• [x] https://beta.developer.mozilla.org/en-US/dashboards/spam - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Web/HTML$edit - 302 redirect to user sign-in page
• [x] https://wiki.developer.mozilla.org/en-US/docs/Web/HTML$edit - 302 redirect to user sign-in page
• [x] https://beta.developer.mozilla.org/en-US/docs/Web/HTML$edit - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/docs/Web/HTML$translate - 302 redirect to user sign-in page
• [x] https://wiki.developer.mozilla.org/en-US/docs/Web/HTML$translate - 302 redirect to user sign-in page
• [x] https://beta.developer.mozilla.org/en-US/docs/Web/HTML$translate - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/Firefox/Releases$edit - 302 redirect to user sign-in page
• [x] https://wiki.developer.mozilla.org/en-US/Firefox/Releases$edit - 302 redirect to user sign-in page
• [x] https://beta.developer.mozilla.org/en-US/Firefox/Releases$edit - 404 - Do not support
• [x] https://developer.mozilla.org/en-US/Firefox/Releases$translate - 302 redirect to user sign-in page
• [x] https://wiki.developer.mozilla.org/en-US/Firefox/Releases$translate - 302 redirect to user sign-in page
• [x] https://beta.developer.mozilla.org/en-US/Firefox/Releases$translate - 404 - Do not support

Regular Account Tests (for https://wiki.developer.mozilla.org)

Some things to try with a regular account, to exercise write functionality:

• [x] Send an account recovery link for an existing MDN user account
• [x] Update the account profile
• [x] Add and verify a new email for a profile
• [x] Create a new page, such as https://wiki.developer.mozilla.org/en-US/docs/user:escattone/test1
• [x] Create a translation of the new page
• [x] Subscribe to a page
• [x] Update the original page with a KumaScript macro, such as {{cssxref("background")}}.
• [x] Update the translation of a changed English page
• [x] Upload an image to the page
• [x] Add the image to the page content
• [x] Edit a zoned URL like https://wiki.developer.mozilla.org/en-US/Firefox/Releases
• [x] Log out

Admin Tests (for https://wiki.developer.mozilla.org)

Some things to try with an admin account, to exercise restricted functionality:

• [x] Move a page
• [x] Delete a page
• [x] View https://wiki.developer.mozilla.org/admin/users/user/1/ - 200, first user
• [x] View https://wiki.developer.mozilla.org/en-US/dashboards/spam - 200, "please wait" or dashboard

[escattone]

Test anomalies (none are failures in regard to this effort, but indicate follow-on work):

• The beta archive pages are missing the striped warning border. This is something we need to address in the front-end for the beta domain archive pages.
• I found one case where a revision created by the mdnwebdocs-bot had its toc_depth attribute modified from its original value of 4 to 0, effectively reducing the $toc response to an empty one. I'm worried now that this has happened to all revisions modified by the mdnwebdocs-bot.

[escattone]

The acceptance criteria has been met.