search

ghostery / ghostery-extension

Ghostery Browser Extension for Firefox, Chrome, Opera, Edge and Safari
Mozilla Public License 2.0
1.34k stars 140 forks source link

[QA] Tests of Release 10.3.4 #1621

Closed GRadziejewski closed 3 weeks ago

GRadziejewski commented 4 weeks ago

Tests of: https://github.com/ghostery/ghostery-extension/pull/1620

GRadziejewski commented 4 weeks ago

Smoke tests Iteration no 1:

Tests of: https://github.com/ghostery/ghostery-extension/pull/1620#issuecomment-2141759824

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Tests are finished at 18:00 31.05.2024.

Feature Browser
NO X Windows 10
Chrome		 Windows 10
Firefox		 MacOS
Safari		 Windows 10
Opera		 iOS
Safari		 Windows 10
Edge
01 Install fresh (no profiles etc) 🟨
02 Update 🟨
03 Ghostery cannot work before onboarding ✔️
04 Onboarding ✔️
05 Enable/Disable Ghostery ️✔️
06 Enable/Disable Ad-blocking ✔️
07   Trust / block the tracker ✔️
08 Enable/Disable Anti-tracking ✔️
09   All blocked 3 main categories ✔️
10     Advertising ✔️
11     Site Analytics ✔️
12     Adult Advertising ✔️
13   Trust / block the tracker ✔️
14   URL / Trackers blocked on UI ✔️
15 Pause Ghostery ❌
16 Enable/Disable Never Consent ✔️
17 Trackers Preview ✔️
18 Restart the browser 🟨
19 Licences ✔️
20 Language (ENG, FR, etc) ✔️
21 Uninstall survey ✔️
22 Sign in/out ✔️
23   Sign in and then update 🟨
24   Check Sync from / into another device 🟨
25    Check Ghostery Background logs ✔️
26   Check Ghostery account settings ✔️
27 Check settings ✔️
28   Trackers database / menu ✔️
29     Sing in and check Trackers database / menu ✔️
30 Log into Google account and open google.com ✔️
31   Try to search for anything ✔️
32   Try to search something with video ✔️ 
Browser: Chrome 125.0.6422.113
OS: Windows 10 Pro
GBE 10.3.4

Legend:

GRadziejewski commented 4 weeks ago

Issue no 01

Description When the Ghostery is paused (site is trusted), Anti-tracking is still active

Steps to Reproduce

  1. Open any website, for example https://www.aarp.org/

  2. Open Ghostery panel and click on the "Trust this site" button image

  3. Open Ghostery panel once more - there are few trackers modified image image

Expected results: When Ghostery is paused (the site is trusted), Anti-tracking cannot be active and cannot modify any trackers.

GRadziejewski commented 4 weeks ago

Issue no 02

Description When Pause (Trust the site) is enabled, the site is automatically reloaded. In the Ghostery panel, the user can see that trackers are blocked and modified. When the site is manually reloaded, the trackers are still modified.

Steps to Reproduce

  1. Open any website, for example https://www.aarp.org/

  2. Open Ghostery panel and click on the "Trust this site" button

  3. On the Ghostery there is information that trackers are blocked and modified image

  4. Reload the website

  5. Open Ghostery panel, there is information that trackers are modified image

https://github.com/ghostery/ghostery-extension/assets/40433708/b91b76f7-1583-4c55-977e-d182e565c38c

Expected results: When Ghostery is paused (the site is trusted), Anti-tracking cannot be active and cannot modify any trackers.

GRadziejewski commented 4 weeks ago

Issue no 03

Description Anti-tracking is working all the time on the Chrome browser. When Pause (Trust the site) is enabled, user can see that trackers are modified.

Steps to Reproduce

  1. Open any website, for example https://www.aarp.org/
  2. Open Ghostery panel and click on the "Trust this site" button
  3. Reload the website
  4. Open Ghostery panel, there is information that trackers are modified image

Expected results: When Pause (Trust the site) is enabled, Anti-tracking cannot modify trackers.

GRadziejewski commented 3 weeks ago

Smoke tests Iteration no 1:

Tests of: version 166.

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Tests are finished at 17:10 03.05.2024.

Feature Browser Browser
NO X MacOS
Safari		 iOS
Safari		 Windows 10
Chrome		 Windows 10
Firefox		 Windows 10
Edge		 Windows 10
Opera
01 Install fresh (no profiles etc) 🟨 🟨
02 Update 🟨 🟨
03 Ghostery cannot work before onboarding ✔️ ✔️
04 Onboarding ✔️ ✔️
05 Enable/Disable Ghostery ️✔️ ✔️
06 Blocked all main features (AB, AT, NC) ✔️ ✔️
07 Enable/Disable Ad-blocking ✔️ ✔️
08   Trust / block the tracker ✔️ ✔️
09 Enable/Disable Anti-tracking ❌ ❌
10   All blocked 3 main categories ✔️ ✔️
11     Advertising ✔️ ✔️
12     Site Analytics ✔️ ✔️
13     Adult Advertising ✔️ ✔️
14   Trust / block the tracker ✔️ ❌
15   URL / Trackers blocked on UI ✔️ ✔️
16 Enable/Disable Never Consent ✔️ ✔️
17 Pause Ghostery ❌ ❌
18 Trackers Preview ✔️ ✔️
19 Restart the browser ✔️ ✔️
20 Licences ✔️ ✔️
21 Language (ENG, FR, etc) ✔️ ✔️
22 Uninstall survey 🟦 🟦
23 Sign in/out ✔️ ✔️
24   Sign in and then update 🟨 🟨
25   Check Sync from / into another device ✔️ ✔️
26    Check Ghostery Background logs ✔️ 🟨
27   Check Ghostery account settings ✔️ ✔️
28 Check settings ✔️ ❌
29   Trackers database / menu ✔️ ✔️
30     Sing in and check Trackers database / menu ✔️ ✔️
31 Log into Google account and open google.com ✔️ ✔️
32   Try to search for anything ✔️ ✔️
33   Try to search something with video ✔️ ✔️ 
Browser: Safari 17.5
OS: MacOS 14.5
GBE 10.3.4

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.4

Legend:

GRadziejewski commented 3 weeks ago

Issue no 04

Description DNR lists are still set to works, even if all 3 features (Ad-Blocking, Anti-Tracking, Never-Consent) are disabled.

Steps to Reproduce

  1. Open Ghostery settings, click 3 times on the version number to open dev tools

  2. Disable all 3 features (Ad-Blocking, Anti-Tracking, Never-Consent)

  3. Open any other tab, for example Websites, and go back to Privacy protection tab

  4. Open dev tools once more

  5. Look at DNR rulesets image

  6. Open any website, for example https://aarp.org and open Ghostery panel image

Expected results: When all 3 features (Ad-Blocking, Anti-Tracking, Never-Consent) are disabled, it should work just like Pause. Nothing should be blocked.

Versions:

Browser: Safari 17.5
OS: MacOS 14.5
GBE 10.3.4

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.4

Browser: Edge 125.0.2535.79
OS: Windows 10
GBE 10.3.4
GRadziejewski commented 3 weeks ago

Issue no 05

Description The list of exceptions on Ghostery settings/ Website does not refresh after adding a new one. The user needs to restart the browser.

Steps to Reproduce

  1. Open any website, for example https://aarp.org

  2. Open Ghostery panel on the detailed view

  3. Select any tracker, for example DoubleClick

  4. Click on "Blocked on all websites" and add aarp.org as an exception image

  5. Open Ghostery settings on Websites image

  6. Restart the browser and open Ghostery settings / Websites image

https://github.com/ghostery/ghostery-extension/assets/40433708/4b5c1f5d-a9ee-41da-afd6-2eee80ded122

Expected results: The list of exceptions on Ghostery settings/ Website must be refreshed after adding a new one.

Versions:

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.4
GRadziejewski commented 3 weeks ago

Issue no 06

Description When I open Ghostery settings by clicking the cogwheel, it opens the last opened setting tab. I cannot click any tab to switch - the tabs do not respond.

Steps to Reproduce

  1. Open Ghostery settings on any tab, for example Privacy protection
  2. Open any website, for example https://aarp.org
  3. Open Ghostery panel and click cogwheel (on the right of Observed activities)
  4. Ghostery settings are open
  5. Try to select, for example, Websites tab

https://github.com/ghostery/ghostery-extension/assets/40433708/70a66c99-b4b1-4f99-9582-b315313af728

Expected results: When I open Ghostery settings by clicking the cogwheel, it must open the Websites tab. I can click any tab to switch - the tabs must respond.

Versions:

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.4
smalluban commented 3 weeks ago

All of the found problems have separate issues, which are taken care of. Closing this issue.