As per process, QA runs through the following cases to ensure that the major chromium bump that's about to get merged into master doesn't regress the Nightly channel. Once the major chromium bump is merged into master, QA will run through a full manual pass on Windows & Android.
Startup & Components
[x] Verify that Brave is only contacting *.brave.com endpoints on first launch using either Charles Proxy, Fiddler, Wireshark or LittleSnitch (or a similar application)
[ ] Verify that opening a NTP doesn't trigger any outbound connections related to widgets without user interaction
[x] Remove the following component folders and ensure that they're being re-downloaded after restarting the browser:
[x] afalakplffnnnlkncjhbmahjfjhmlkal: AutoplayWhitelist.dat, ExtensionWhitelist.dat, ReferrerWhitelist.json and Greaselion.json
[x] CertificateRevocation
[x] gccbbckogglekeggclmmekihdgdpdgoe: (Sponsored New Tab Images)
[x] gkboaolpopklhgplhaaiboijnklogmbc: Brave Ad Block List Catalog
[x] iodkpdagapdfkphljnddpjlldadblomo: Brave Ad Block Updater
[x] mfddibmblmbccpadfndgakiopmmhebop: Brave Ad Block List Catalog
[x] oofiananboodjbbmdelgdommihjbkfag: HTTPSE
[x] Safe Browsing
[x] Restart the browser, load brave://components, wait for 8 mins and verify that no component shows any errors
Note: Always double check brave://components to make sure there's no errors/missing version numbers
Upgrade
[x] Make sure that data from the last version appears in the new version OK
[x] Ensure that brave://version lists the expected Brave & Chromium versions
[x] With data from the last version, verify that:
[x] Bookmarks on the bookmark toolbar and bookmark folders can be opened
[x] Cookies are preserved
[x] Installed extensions are retained and work correctly
[x] Opened tabs can be reloaded
[x] Stored passwords are preserved
[x] Sync chain created in previous version is retained
[x] Social media-blocking buttons changes are retained
[x] Custom filters under brave://settings/shields/filters are retained
[x] Custom lists under brave://settings/shields/filters are retained
[x] Rewards
[x] BAT balance is retained
[x] Auto-contribute list is retained
[x] Both Tips and Monthly Contributions are retained
[x] Panel transactions list is retained
[x] Changes to rewards settings are retained
[x] Ensure that Auto Contribute is not being enabled when upgrading to a new version if AC was disabled
[x] Ads
[x] Both Estimated pending rewards & Ad notifications received this month are retained
[x] Changes to ads settings are retained
[x] Ensure that ads are not being enabled when upgrading to a new version if they were disabled
[x] Ensure that ads are not disabled when upgrading to a new version if they were enabled
As per process, QA runs through the following cases to ensure that the major chromium bump that's about to get merged into
master
doesn't regress theNightly
channel. Once the major chromium bump is merged intomaster
, QA will run through a full manual pass onWindows
&Android
.Startup & Components
*.brave.com
endpoints on first launch using eitherCharles Proxy
,Fiddler
,Wireshark
orLittleSnitch
(or a similar application)afalakplffnnnlkncjhbmahjfjhmlkal
:AutoplayWhitelist.dat
,ExtensionWhitelist.dat
,ReferrerWhitelist.json
andGreaselion.json
CertificateRevocation
gccbbckogglekeggclmmekihdgdpdgoe
: (Sponsored New Tab Images)gkboaolpopklhgplhaaiboijnklogmbc
: Brave Ad Block List Catalogiodkpdagapdfkphljnddpjlldadblomo
: Brave Ad Block Updatermfddibmblmbccpadfndgakiopmmhebop
: Brave Ad Block List Catalogoofiananboodjbbmdelgdommihjbkfag
: HTTPSESafe Browsing
brave://components
, wait for 8 mins and verify that no component shows any errorsNote: Always double check
brave://components
to make sure there's no errors/missing version numbersUpgrade
brave://version
lists the expected Brave & Chromium versionsEstimated pending rewards
&Ad notifications received this month
are retained