ghostery / ghostery-extension

Ghostery Browser Extension for Firefox, Chrome, Opera, Edge and Safari
Mozilla Public License 2.0
1.36k stars 138 forks source link

[QA] Tests of Release 10.3.14 #1740

Closed GRadziejewski closed 1 month ago

GRadziejewski commented 1 month ago

Tests of: https://github.com/ghostery/ghostery-extension/pull/1739

GRadziejewski commented 1 month ago

Smoke tests Iteration no 1:

Tests of: https://github.com/ghostery/ghostery-extension/pull/1739#issuecomment-2233152161

Tests are finished at 11:30 19.07.2024.

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Feature Browser Browser Browser Browser Browser Browser
NO X Windows10
Chrome
macOS
Safari
macOS
Firefox
Android
Firefox
Windows10
Opera
iOS
Safari
Windows10
Edge
NO Status
01 Install ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
01b Install fresh (no profiles etc) 🟨 🟨 🟨 🟨 🟨 🟨
02 Update 🟨 🟨 🟨 🟨 🟨 🟨
03 Ghostery cannot work before onboarding ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
04 Onboarding ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
05 Enable/Disable Ghostery ️✔️ ✔️ ✔️ ✔️ ✔️ ✔️
06 Blocked all main features (AB, AT, NC) (reversed in 10.3.6) ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
07 Enable/Disable Ad-blocking ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
08   Trust / block the tracker ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
09 Enable/Disable Anti-tracking ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
10   Trusted 1 categories (for v10) ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
10a     Essential ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
10b     ... ... ... ... ... ... ...
11   Trust / block the tracker
https://github.com/ghostery/ghostery-extension/issues/1748

https://github.com/ghostery/ghostery-extension/issues/1748

https://github.com/ghostery/ghostery-extension/issues/1748

https://github.com/ghostery/ghostery-extension/issues/1748

https://github.com/ghostery/ghostery-extension/issues/1748

https://github.com/ghostery/ghostery-extension/issues/1748
12   URL / Trackers blocked on UI ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
13 Enable/Disable Never Consent ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
13a   Check website with
  - CPM Onetrust (booking.com)
✔️ ✔️ ✔️ ✔️ ✔️ ✔️
13b   Check website with
  - CPM CookieBot (thingiverse.com)
✔️ ✔️
https://github.com/ghostery/broken-page-reports/issues/770

https://github.com/ghostery/broken-page-reports/issues/770
✔️ ✔️
13c   Check website with
  - CPM Evidon (playstation.com)
✔️ ✔️ ✔️ ✔️ ✔️ ✔️
13d   Check website with
  - CPM Airbnb (airbnb.com)
✔️ ✔️ ✔️ ✔️ ✔️ ✔️
13e   Check website with
  - CPM Usercentric (should not be blocked) (hornbach.de)
✔️ ✔️
https://github.com/ghostery/broken-page-reports/issues/769

https://github.com/ghostery/broken-page-reports/issues/769
✔️ ✔️
13f     ... ... ... ... ... ... ...
14 Pause Ghostery ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
15 Trackers Preview ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
16 Restart the browser ✔️ ✔️ 🟨 🟨 ✔️ ✔️
17 Licences ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
18 Language (ENG, FR, etc) ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
19 Uninstall survey ✔️ 🟦 ✔️ 🟦 ✔️ 🟦
20 Sign in/out ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
21   Sign in and then update 🟨 🟨 🟨 🟨 🟨 🟨
22   Check Sync from / into another device ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
23    Check Ghostery Background logs ✔️ ✔️ ✔️ 🟨 ✔️ 🟨
24   Check Ghostery account settings ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
25 Check settings ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
26   Trackers database / menu ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
27     Sing in and check Trackers database / menu ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
28 Log into Google account and open google.com ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
29   Try to search for anything ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
30   Try to search something with video
https://github.com/ghostery/broken-page-reports/issues/737

https://github.com/ghostery/broken-page-reports/issues/737
✔️ ✔️
https://github.com/ghostery/broken-page-reports/issues/737

https://github.com/ghostery/broken-page-reports/issues/737
Browser: Chrome 126.0.6478.127
OS: Windows 10
GBE 10.3.14

Browser: Safari 17.5
OS: macOS 14.5
GBE 10.3.14

Browser: Firefox 128
OS: macOS 14.5
GBE 10.3.14

Browser: Firefox 127.0.2
OS: Android 14
GBE 10.3.14

Browser: Opera 112.0.5197.25
OS: Windows 10
GBE 10.3.14

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.14

Legend:

GRadziejewski commented 1 month ago

Smoke tests Iteration no 2:

Tests of: https://github.com/ghostery/ghostery-extension/pull/1739#issuecomment-2238935189

Tests are finished at 17:41 19.07.2024.

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Feature Browser Browser Browser Browser Browser Browser
NO X Windows10
Chrome
macOS
Safari
macOS
Firefox
Android
Firefox
Windows10
Opera
iOS
Safari
Windows10
Edge
NO Status passed passed passed passed passed passed
01 Install ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
01b Install fresh (no profiles etc) 🟨 🟨 🟨 🟨 🟨 🟨
02 Update 🟨 🟨 🟨 🟨 🟨 🟨
03 Ghostery cannot work before onboarding ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
04 Onboarding ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
05 Enable/Disable Ghostery ️🟨 🟨 🟨 🟨 🟨 🟨
06 Blocked all main features (AB, AT, NC) (reversed in 10.3.6) ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
07 Enable/Disable Ad-blocking ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
08   Trust / block the tracker ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
09 Enable/Disable Anti-tracking ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
10   Trusted 1 categories (for v10) ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
10a     Essential ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
10b     ... ... ... ... ... ... ...
11   Trust / block the tracker ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
12   URL / Trackers blocked on UI ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
13 Enable/Disable Never Consent ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
13a   Check website with
  - CPM Onetrust (booking.com)
🟨 🟨 🟨 🟨 🟨 🟨
13b   Check website with
  - CPM CookieBot (thingiverse.com)
🟨 🟨 🟨 🟨 🟨 🟨
13c   Check website with
  - CPM Evidon (playstation.com)
🟨 🟨 🟨 🟨 🟨 🟨
13d   Check website with
  - CPM Airbnb (airbnb.com)
🟨 🟨 🟨 🟨 🟨 🟨
13e   Check website with
  - CPM Usercentric (should not be blocked) (hornbach.de)
🟨 🟨 🟨 🟨 🟨 🟨
13f     ... ... ... ... ... ... ...
14 Pause Ghostery ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
15 Trackers Preview 🟨 🟨 🟨 🟨 🟨 🟨
16 Restart the browser 🟨 🟨 🟨 🟨 🟨 🟨
17 Licences 🟨 🟨 🟨 🟨 🟨 🟨
18 Language (ENG, FR, etc) 🟨 🟨 🟨 🟨 🟨 🟨
19 Uninstall survey ✔️ 🟦 ✔️ 🟦 ✔️ 🟦
20 Sign in/out 🟨 🟨 🟨 🟨 🟨 🟨
21   Sign in and then update 🟨 🟨 🟨 🟨 🟨 🟨
22   Check Sync from / into another device 🟨 🟨 🟨 🟨 🟨 🟨
23    Check Ghostery Background logs 🟨 🟨 🟨 🟨 🟨 🟨
24   Check Ghostery account settings 🟨 🟨 🟨 🟨 🟨 🟨
25 Check settings ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
26   Trackers database / menu ✔️ ✔️ ✔️ ✔️ ✔️ ✔️
27     Sing in and check Trackers database / menu 🟨 🟨 🟨 🟨 🟨 🟨
28 Log into Google account and open google.com 🟨 🟨 🟨 🟨 🟨 🟨
29   Try to search for anything 🟨 🟨 🟨 🟨 🟨 🟨
30   Try to search something with video 🟨 🟨 🟨 🟨 🟨 🟨
Browser: Chrome 126.0.6478.127
OS: Windows 10
GBE 10.3.14

Browser: Safari 17.5
OS: macOS 14.5
GBE 10.3.14

Browser: Firefox 128
OS: macOS 14.5
GBE 10.3.14

Browser: Firefox 127.0.2
OS: Android 14
GBE 10.3.14

Browser: Opera 112.0.5197.25
OS: Windows 10
GBE 10.3.14

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.14

Legend: