Manual test run on Windows x64 for 1.57.x - Release

[LaurenWags]

Installer

• [x] Check signature:
  • [x] If Windows right click on the brave_installer-x64.exe and go to Properties, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window

Widevine

• [x] Verify Widevine Notification is shown when you visit Netflix for the first time
• [x] Test that you can stream on Netflix on a fresh profile after installing Widevine
• [x] Verify Widevine Notification is shown when you visit HBO Max for the first time
• [x] Test that you can stream on HBO Max on a fresh profile after installing Widevine

Rewards

• [x] Verify that none of the reward endpoints are being contacted when a user visits a media creator (youtube.com, reddit.com, twitter.com, github.com) and hasn't joined rewards
  • [x] Verify that rewards.brave.com, pcdn.brave.com, grant.rewards.brave.com or api.rewards.brave.com are not being contacted
• [x] Verify you are able to create a new Rewards profile and are in the unverified state by default
  • [x] Verify when you visit a creator in this state the panel shows a prompt to connect a custodian and no BAT information (earnings, balance, etc) is displayed
  • [x] Verify when you visit brave://rewards in this state there are no Auto Contribution, Tipping, or summary panels on this page
  • [x] Verify you can toggle ads off/on from this page and the panel and NTP widget respond accordingly
  • [x] Verify you can toggle rewards off/on from the panel and the brave://rewards page and NTP widget respond accordingly
• [x] Verify you are able to connect a custodian
  • [x] Verify Rewards balance shows correct BAT and USD value on brave://rewards, panel, and NTP widget after you connect
  • [x] Verify when you click on the BR panel while on a site, the panel displays site-specific information (site favicon, domain, attention %)
  • [x] Verify you are able to tip a creator who has the same custodian as you
  • [x] Verify you are able to perform an auto contribution
  • [x] Verify if you disable auto-contribute you are still able to tip creators

TLS Pinning

• [x] Visit https://ssl-pinning.someblog.org/ and verify a pinning error is displayed
• [x] Visit https://pinning-test.badssl.com/ and verify a pinning error is not displayed

Update tests

• [x] Verify visiting brave://settings/help triggers update check
• [x] Verify once update is downloaded, prompts to Relaunch to install update

Startup & Components

• [x] Verify that Brave is only contacting *.brave.com endpoints on first launch using either Charles Proxy, Fiddler, Wireshark or LittleSnitch (or a similar application)
  • [x] Verify that opening a NTP doesn't trigger any outbound connections related to widgets without user interaction
• [x] Delete Adblock folder from browser profile and restart browser. Visit brave://components and verify Brave Ad Block Updater downloads and update the component. Repeat for all Brave components

Upgrade

• [x] Make sure that data from the last version appears in the new version OK
• [x] Ensure that brave://version lists the expected Brave & Chromium versions
• [x] With data from the last version, verify that
  • [x] Bookmarks on the bookmark toolbar and bookmark folders can be opened
  • [x] Cookies are preserved
  • [x] Installed extensions are retained and work correctly
  • [x] Opened tabs can be reloaded
  • [x] Stored passwords are preserved
  • [x] Sync chain created in previous version is retained
  • [x] Social media blocking buttons changes are retained
  • [x] Custom filters under brave://settings/shields/filters are retained
  • [ ] Custom lists under brave://settings/shields/filters are retained
  • [x] Rewards
  • [x] BAT balance is retained
  • [x] Auto-contribute list is retained
  • [x] Both Tips and Monthly Contributions are retained
  • [x] Panel transactions list is retained
  • [x] Changes to rewards settings are retained
  • [x] Ensure that Auto Contribute is not being enabled when upgrading to a new version if AC was disabled
  • [x] Ads
  • [x] Both Estimated pending rewards & Ad notifications received this month are retained
  • [x] Changes to ads settings are retained
  • [x] Ensure that ads are not being enabled when upgrading to a new version if they were disabled
  • [x] Ensure that ads are not disabled when upgrading to a new version if they were enabled

[LaurenWags]

Reduced test cases as a full manual pass was run via https://github.com/brave/brave-browser/issues/31156 against 1.58.x/Nightly when C116 was merged

[MadhaviSeelam]

Verification PASSED using

Brave | 1.57.44 Chromium: 116.0.5845.82 (Official Build) (64-bit)
-- | --
Revision | 109e984111c5152478bf49d266f4e19861c0b63e
OS | Windows 11 Version 22H2 (Build 22621.2134)