search

ghostery / ghostery-extension

Ghostery Browser Extension for Firefox, Chrome, Opera, Edge and Safari
Mozilla Public License 2.0
1.34k stars 140 forks source link

[QA] Tests of Release 10.3.0 #1568

Closed GRadziejewski closed 1 month ago

GRadziejewski commented 2 months ago

Tests of: https://github.com/ghostery/ghostery-extension/pull/1565#issuecomment-2083085352

GRadziejewski commented 2 months ago

Smoke tests Iteration no 1:

Issues:

Fixed:

Tests are finished at 15:40 30.04.2024.

Feature Browser Browser
NO X Windows 10
Chrome		 Windows 10
Firefox
01 Install fresh (no profiles etc) 🟨 🟨
02 Update 🟨 🟨
03 Ghostery cannot work before onboarding ✔️ ✔️
04 Onboarding ✔️ ✔️
05 Enable/Disable Ghostery ️✔️ ✔️
06 Enable/Disable Ad-blocking ✔️ ✔️
07 Enable/Disable Anti-tracking ✔️ ✔️
08 Pause Ghostery ✔️ ✔️
09 Never Consent ✔️ ❌
10 Trackers Preview ✔️ ✔️
11 Restart the browser ✔️ ✔️
12 Licences ✔️ ✔️
13 Language (ENG, FR, etc) Waiting for translations Waiting for translations
14 Uninstall survey ✔️ ✔️
15 Sign in/out ✔️ ✔️
16   Sign in and then update 🟨 🟨
17   Check Sync from / into another device ✔️ ✔️
18    Check Ghostery Background logs ✔️ ✔️
19   Check Ghostery account settings ✔️ ✔️
20 Check settings ✔️ ✔️
21   Trackers ❌ ❌
22 Log into Google account and open google.com ✔️ ✔️
23   Try to search for anything ✔️ ✔️
24   Try to search something with video ✔️ ✔️ 
Browser: Chrome 124.0.6367.92
OS: Windows 10 Pro
GBE 10.3.0

Browser: Firefox 126.0b7
OS: Windows 10 Pro
GBE 10.3.0

Legend:

GRadziejewski commented 2 months ago

Issue no 01

Description When I press the Ghosty icon, the panel appears after a few seconds 

Browser: Firefox 126.0b7
OS: Windows 10 Pro
GBE 10.3.0

Steps to Reproduce

  1. Open any website, for example https://edition.cnn.com/
  2. Click on the Ghosty icon

https://github.com/ghostery/ghostery-extension/assets/40433708/1159b615-0314-4f6d-af83-b43c649b93a2

Expected results: The Ghostery panel should be visible in less than a few seconds after clicking the icon

Also added here: https://github.com/orgs/ghostery/projects/42/views/1?pane=issue&itemId=61443030

GRadziejewski commented 2 months ago

Issue no 02

Description When a new filter is added, either nothing is blocked or only partially.

Steps to Reproduce

  1. Open Ghostery settings/ Privacy protection
  2. Open Developer tools
  3. Add for example @@doubleclick.net and Update filters

Image

  1. Open, for example website https://www.aarp.org/
  2. Open Ghostery panel on Detailed view
  3. Look for Advertising/ DoubleClick

Image

Expected results: Once the new filter is added, it should work properly and everything should be blocked - in this case, all URLs contain doubleclick.net

Also added here: https://github.com/orgs/ghostery/projects/42/views/1?pane=issue&itemId=61440811

GRadziejewski commented 2 months ago

Issue no 03.

Description Visible differences in the performance of the same version of the extension, on the same page, in different browsers - Chrome vs Firefox.

Steps to Reproduce

  1. In Chrome open website https://www.espn.com/
  2. The entire website is behind a grey curtain - the background of the cookie pop-up is not hidden
  3. In Firefox open website https://www.espn.com/
  4. Cookie pop-up is hidden correctly

image

Expected results: There should be no visible differences in the performance of the same version of the extension, in different browsers - Chrome vs Firefox.

Also added here: https://github.com/orgs/ghostery/projects/42/views/1?pane=issue&itemId=61454006

GRadziejewski commented 2 months ago

Issue no 04

Description The tracker is set to Trusted on all websites, but still, the URLs are blocked.

Steps to Reproduce

  1. Open, for example, website https://www.foxnews.com/politics/ny-v-trump-criminal-trial-begins-3rd-week-former-president-accused-gag-order-violations
  2. Open Ghostery panel on Detailed view

image

  1. Look for Site Analytics/ Adobe Experience Cloud

Image

  1. Check for additional custom filters

Image

  1. Check for any additional exceptions for this tracker

Image

Expected results: If the tracker is set to Trusted, none of the URLs should be blocked. It should have an observed status.

Also added here: https://github.com/orgs/ghostery/projects/42/views/1?pane=issue&itemId=61455968

GRadziejewski commented 2 months ago

Smoke tests Iteration no 2:

Tests of : https://github.com/ghostery/ghostery-extension/pull/1565#issuecomment-2085306995

Issues:

-

Fixed:

Tests are finished at 15:40 30.04.2024.

Feature Browser Browser
NO X Windows 10
Chrome		 Windows 10
Firefox
01 Install fresh (no profiles etc) 🟨 🟨
02 Update 🟨 🟨
03 Ghostery cannot work before onboarding ✔️ ✔️
04 Onboarding ✔️ ✔️
05 Enable/Disable Ghostery ️✔️ ✔️
06 Enable/Disable Ad-blocking ✔️ ✔️
07 Enable/Disable Anti-tracking ✔️ ✔️
08 Pause Ghostery ✔️ ✔️
09 Never Consent ✔️ ❌
10 Trackers Preview ✔️ ✔️
11 Restart the browser ✔️ ✔️
12 Licences ✔️ ✔️
13 Language (ENG, FR, etc) Waiting for translations Waiting for translations
14 Uninstall survey ✔️ ✔️
15 Sign in/out ✔️ ✔️
16   Sign in and then update 🟨 🟨
17   Check Sync from / into another device ✔️ ✔️
18    Check Ghostery Background logs ✔️ ✔️
19   Check Ghostery account settings ✔️ ✔️
20 Check settings ✔️ ✔️
21   Trackers ✔️
22 Log into Google account and open google.com ✔️ ✔️
23   Try to search for anything ✔️ ✔️
24   Try to search something with video ✔️ ✔️ 
Browser: Chrome 124.0.6367.92
OS: Windows 10 Pro
GBE 10.3.0

Browser: Firefox 126.0b7
OS: Windows 10 Pro
GBE 10.3.0

Legend:

GRadziejewski commented 2 months ago

Issue no 05

Description When I click Ad-blocking (or Anti-tracking or Never-Consent) on the Ghostery panel, the tab with the selected Privacy protection is not opening.

Steps to Reproduce

  1. Open Ghostery settings/ Trackers

  2. Select any tracker, for example DoubleClick image

  3. Click on Ghosty to open Ghostery panel

  4. Click on Ad-Blocking (or Anti-Tracking or Never-Consent) - nothing happens

Image

Expected results: When I click Ad-blocking (or Anti-tracking or Never-Consent) on the Ghostery panel, the tab with the selected Privacy protection should be open.

Also added here: https://github.com/orgs/ghostery/projects/42/views/1?pane=issue&itemId=61485000

GRadziejewski commented 1 month ago

Smoke tests Iteration no 3:

Tests of: https://github.com/ghostery/ghostery-extension/pull/1565#issuecomment-2100620340

Issues:

-

Fixed:

Tests are finished at 19:45 08.05.2024.

Feature Browser Browser
NO X Windows 10
Opera		 Windows 10
Edge
01 Install fresh (no profiles etc) 🟨 🟨
02 Update 🟨 🟨
03 Ghostery cannot work before onboarding ✔️ ✔️
04 Onboarding ✔️ ✔️
05 Enable/Disable Ghostery ️✔️ ✔️
06 Enable/Disable Ad-blocking ✔️ ✔️
07   Trust / block the tracker ✔️ ✔️
08 Enable/Disable Anti-tracking ✔️ ✔️
09   All blocked 3 main categories ✔️ ✔️
10     Advertising ✔️ ✔️
11     Site Analytics ✔️ ✔️
12     Adult Advertising ✔️ ✔️
13   Trust / block the tracker ✔️ ✔️
14 Pause Ghostery ✔️ ✔️
15 Enable/Disable Never Consent ✔️ ✔️
16 Trackers Preview ✔️ ✔️
17 Restart the browser ✔️ ✔️
18 Licences ✔️ ✔️
19 Language (ENG, FR, etc) ✔️ ✔️
20 Uninstall survey ✔️ ✔️
21 Sign in/out ✔️ ✔️
22   Sign in and then update 🟨 🟨
22   Check Sync from / into another device ✔️ ✔️
23    Check Ghostery Background logs ✔️ ✔️
24   Check Ghostery account settings ✔️ ✔️
25 Check settings ✔️ ✔️
26   Trackers database / menu ✔️ ✔️
26     Sing in and check Trackers database / menu ✔️ ✔️
27       (sync) 🟦 🟦
28 Log into Google account and open google.com ✔️ ✔️
29   Try to search for anything ✔️ ✔️
30   Try to search something with video ✔️ ✔️ 
Browser: Opera 109.0.5097.80
OS: Windows 10 Pro
GBE 10.3.0

Browser: Edge 124.0.2478.80
OS: Windows 10 Pro
GBE 10.3.0

Legend:

GRadziejewski commented 1 month ago

Smoke tests Iteration no 4:

Tests of: https://github.com/ghostery/ghostery-extension/pull/1565#issuecomment-2102516741

Issues:

-

Fixed:

Tests are finished at 17:30 09.05.2024.

Feature Browser Browser
NO X Windows 10
Chromium		 Windows 10
Chromium
01 Install fresh (no profiles etc) ✔️ ✔️
02 Update ✔️8.12.10 ✔️10.3.0
03 Ghostery cannot work before onboarding ✔️ ✔️
04 Onboarding ✔️ ✔️
05 Enable/Disable Ghostery ️✔️ ✔️
06 Enable/Disable Ad-blocking ✔️ ✔️
07   Trust / block the tracker ✔️ ✔️
08 Enable/Disable Anti-tracking ✔️ ✔️
09   All blocked 3 main categories ✔️ ✔️
10     Advertising ✔️ ✔️
11     Site Analytics ✔️ ✔️
12     Adult Advertising ✔️ ✔️
13   Trust / block the tracker ✔️ ✔️
14 Pause Ghostery ✔️ ✔️
15 Enable/Disable Never Consent ✔️ ✔️
16 Trackers Preview ✔️ ✔️
17 Restart the browser 🟨 🟨
18 Licences 🟨 🟨
19 Language (ENG, FR, etc) 🟨 🟨
20 Uninstall survey ✔️ ✔️
21 Sign in/out ✔️ ✔️
22   Sign in and then update ✔️ 🟨
22   Check Sync from / into another device 🟨 🟨
23    Check Ghostery Background logs 🟨 ✔️
24   Check Ghostery account settings ✔️ ✔️
25 Check settings ✔️ ✔️
26   Trackers database / menu ✔️ ✔️
26     Sing in and check Trackers database / menu ✔️ ✔️
27       (sync) 🟦 🟦
28 Log into Google account and open google.com 🟨 🟨
29   Try to search for anything 🟨 🟨
30   Try to search something with video 🟨 🟨 
Browser: Chromium 126.0.6469.0 (Developer Build) (64-bit)
OS: Windows 10 Pro
GBE 8.12.10 -> 10.3.0

Legend: