Manual test run on macOS (Intel) for 1.65.x - Release #3 - Githubissues

brave / brave-browser

Brave browser for Android, iOS, Linux, macOS, Windows.

https://brave.com

Mozilla Public License 2.0

17.9k stars 2.34k forks source link

Manual test run on macOS (Intel) for 1.65.x - Release #3 #37873

Closed LaurenWags closed 6 months ago

LaurenWags commented 6 months ago

Installer

[x] Check signature:
- [x] If macOS, using x64 binary run spctl --assess --verbose for the installed version and make sure it returns accepted
- [x] If macOS, using universal binary run spctl --assess --verbose for the installed version and make sure it returns accepted

Widevine

[x] Verify Widevine Notification is shown when you visit Netflix for the first time
[x] Test that you can stream on Netflix on a fresh profile after installing Widevine
[x] If macOS, run the above Widevine tests for both x64 and universal builds

Rewards

[x] Verify that you are able to successfully join Rewards on a fresh profile

TLS Pinning

[x] Visit https://ssl-pinning.someblog.org/ and verify a pinning error is displayed
[x] Visit https://pinning-test.badssl.com/ and verify a pinning error is not displayed

Update tests

[x] Verify visiting brave://settings/help triggers update check
[x] Verify once update is downloaded, prompts to Relaunch to install update

Upgrade

[x] Make sure that data from the last version appears in the new version OK
[x] Ensure that brave://version lists the expected Brave & Chromium versions
[x] With data from the last version, verify that
- [x] Bookmarks on the bookmark toolbar and bookmark folders can be opened
- [x] Cookies are preserved
- [x] Installed extensions are retained and work correctly
- [x] Opened tabs can be reloaded
- [x] Stored passwords are preserved
- [x] Sync chain created in previous version is retained
- [x] Social media blocking buttons changes are retained
- [x] Custom filters under brave://settings/shields/filters are retained
- [x] Custom lists under brave://settings/shields/filters are retained
- [x] Rewards
- [x] BAT balance is retained
- [x] Auto-contribute list is retained
- [x] Both Tips and Monthly Contributions are retained
- [x] Panel transactions list is retained
- [x] Changes to rewards settings are retained
- [x] Ensure that Auto Contribute is not being enabled when upgrading to a new version if AC was disabled
- [x] Ads
- [x] Both Estimated pending rewards & Ad notifications received this month are retained
- [x] Changes to ads settings are retained
- [x] Ensure that ads are not being enabled when upgrading to a new version if they were disabled
- [x] Ensure that ads are not disabled when upgrading to a new version if they were enabled

LaurenWags commented 6 months ago

Tests above verified with

Brave | 1.65.123 Chromium: 124.0.6367.91 (Official Build) (x86_64)
-- | --
Revision | dd88871b12997b018e3acb2f589713a3ea10338b
OS | macOS Version 13.6.6 (Build 22G630)