[QA] Tests of Release 10.3.12

GRadziejewski commented 4 weeks ago

Tests of: https://github.com/ghostery/ghostery-extension/pull/1699

GRadziejewski commented 4 weeks ago

Smoke tests Iteration no 1:

Tests of: https://github.com/ghostery/ghostery-extension/pull/1697#issuecomment-2191102149

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Tests are finished at 15:49 27.06.2024.

Feature	Browser	Browser
NO	X	macOS Safari	iOS Safari	Windows10 Edge	Windows10 Firefox	Android Firefox	Windows10 Chrome	Windows10 Opera
NO	Status	passed	passed
01	Install	✔️	✔️
01b	Install fresh (no profiles etc)	🟨	🟨	🟨	🟨
02	Update	🟦	🟦
03	Ghostery cannot work before onboarding	✔️	✔️
04	Onboarding	✔️	✔️
05	Enable/Disable Ghostery	️✔️	✔️
06	Blocked all main features (AB, AT, NC) (reversed in 10.3.6)	✔️	✔️
07	Enable/Disable Ad-blocking	✔️	✔️
08	Trust / block the tracker	🟨	🟨
09	Enable/Disable Anti-tracking	✔️	✔️
10	Trusted 1 categories (for v10)	✔️	✔️
10a	Essential	✔️	✔️
10b	...	...	...	...	...
11	Trust / block the tracker	🟨	🟨
12	URL / Trackers blocked on UI	✔️	✔️
13	Enable/Disable Never Consent	✔️	✔️
13a	Check website with - CPM Onetrust (booking.com)	✔️	✔️
13b	Check website with - CPM CookieBot (thingiverse.com)	🟨	🟨
13c	Check website with - CPM Evidon (playstation.com)	🟨	🟨
13d	Check website with - CPM Airbnb (airbnb.com)	🟨	🟨
13e	...	...	...	...	...
14	Pause Ghostery	✔️	✔️
15	Trackers Preview	✔️	✔️
16	Restart the browser	✔️	✔️
17	Licences	✔️	✔️
18	Language (ENG, FR, etc)	🟨	🟨
19	Uninstall survey	🟦	🟦
20	Sign in/out	✔️	✔️
21	Sign in and then update	🟨	🟨
22	Check Sync from / into another device	✔️	✔️
23	Check Ghostery Background logs	🟨	🟨
24	Check Ghostery account settings	🟨	🟨
25	Check settings	✔️	✔️
26	Trackers database / menu	✔️	✔️
27	Sing in and check Trackers database / menu	✔️	✔️
28	Log into Google account and open google.com	🟨	🟨
29	Try to search for anything	✔️	✔️
30	Try to search something with video	✔️	✔️

Browser: Safari 17.5
OS: macOS 14.5
GBE 10.3.12

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.12

Legend:

✔️ - Checked and working
❌ - Issue
🟦 - Not available
🟨 - Not tested
passed -
conditionally passed - There are production errors that will be fixed in the next version. This is not a constraint to the release of this version.
failed -

GRadziejewski commented 3 weeks ago

Smoke tests Iteration no 2:

Tests of: https://github.com/ghostery/journal/issues/364#issuecomment-2205558936

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Tests are finished at 15:35 03.07.2024.

Keep in mind that this version is a transition and:

Testing highlights:

    All of the features wiped out - no protection at all
    Ghostery icon has an annoying dot - when clicked - opens up the full page - the same as the native app has
    The only view has 3 links - one to install the new extension, one to see the blog post, and the last to mail us

The background process is cleaned up too, please test if the extension starts correctly after closing Safari - if the icon opens up the instructions.

Feature	Browser	Browser
NO	X	macOS Safari	iOS Safari	Windows10 Edge	Windows10 Firefox	Android Firefox	Windows10 Chrome	Windows10 Opera
NO	Status	passed	conditionally passed
01	Install	✔️	✔️
01b	Install fresh (no profiles etc)	✔️	🟨
02	Update	🟦	🟦
03	Enable/Disable Ghostery	️✔️	✔️
04	Enable/Disable Ad-blocking	Ads are not blocked. ✔️	Ads are not blocked. ✔️
05	Enable/Disable Anti-tracking	I cannot open Ghostery panel. ✔️	I cannot open Ghostery panel. ✔️
06	Enable/Disable Never Consent	Cookie pop-ups are visible. ✔️	Cookie pop-ups are visible. ✔️
07	Pause Ghostery	I cannot open Ghostery panel. ✔️	I cannot open Ghostery panel. ✔️
08	Trackers Preview	No Trackers Preview on Google search results. ✔️	No Trackers Preview on Google search results. ✔️
09	Restart the browser	✔️	✔️
10	Language (ENG, FR, etc)	🟨	🟨
11	Uninstall survey	🟦	🟦
12	Sign in/out	I can sign in, but I cannot open Ghostery panel. ✔️	I can sign in, but I cannot open Ghostery panel. ✔️
13	Check Ghostery Background logs	No logs are visible. ✔️	🟨
14	Check settings	I cannot check settings. ✔️	I cannot check settings. ✔️
15	Open Ghostery panel	Full page is opened. ✔️	❌ https://github.com/ghostery/ghostery-extension/issues/1708

Browser: Safari 17.5
OS: macOS 14.5
GBE 10.3.12 (179)

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.12 (179)

Legend:

✔️ - Checked and working
❌ - Issue
🟦 - Not available
🟨 - Not tested
passed -
conditionally passed - There are production errors that will be fixed in the next version. This is not a constraint to the release of this version.
failed -

GRadziejewski commented 3 weeks ago

Smoke tests Iteration no 3:

Tests of: https://github.com/ghostery/journal/issues/364#issuecomment-2208632729

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Tests are finished at 18:00 04.07.2024.

Keep in mind that this version is a transition and:

    Added red icon for the extension
    Added translations for native and extension parts

The logic is untouched.

Feature	Browser	Browser
NO	X	macOS Safari	iOS Safari	Windows10 Edge	Windows10 Firefox	Android Firefox	Windows10 Chrome	Windows10 Opera
NO	Status	failed	failed
01	Install	✔️	✔️
01b	Install fresh (no profiles etc)	🟨	🟨
02	Update	🟦	🟦
03	Enable/Disable Ghostery	️✔️	✔️
04	Enable/Disable Ad-blocking	🟨	🟨
05	Enable/Disable Anti-tracking	🟨	🟨
06	Enable/Disable Never Consent	🟨	🟨
07	Pause Ghostery	🟨	🟨
08	Trackers Preview	🟨	🟨
09	Restart the browser	🟨	🟨
10	Language (ENG, FR, etc)	❌	❌
11	Uninstall survey	🟦	🟦
12	Sign in/out	🟨	🟨
13	Check Ghostery Background logs	🟨	🟨
14	Check settings	🟨	🟨
15	Open Ghostery panel	🟨	🟨

Browser: Safari 17.5
OS: macOS 14.5
GBE 10.3.12 (180)

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.12 (180)

Legend:

✔️ - Checked and working
❌ - Issue
🟦 - Not available
🟨 - Not tested
passed -
conditionally passed - There are production errors that will be fixed in the next version. This is not a constraint to the release of this version.
failed -

GRadziejewski commented 3 weeks ago

Smoke tests Iteration no 4:

Tests of: https://github.com/ghostery/journal/issues/364#issuecomment-2209253691

Issues:

Fixed:

Cannot reproduce:

Will not be fixed:

Tests are finished at 18:28 04.07.2024.

Keep in mind that this version is a transition and:

    Added red icon for the extension
    Added translations for native and extension parts

The logic is untouched.

Feature	Browser	Browser
NO	X	macOS Safari	iOS Safari	Windows10 Edge	Windows10 Firefox	Android Firefox	Windows10 Chrome	Windows10 Opera
NO	Status	passed	passed
01	Install	✔️	✔️
01b	Install fresh (no profiles etc)	🟨	🟨
02	Update	🟦	🟦
03	Enable/Disable Ghostery	️🟨	🟨
04	Enable/Disable Ad-blocking	🟨	🟨
05	Enable/Disable Anti-tracking	🟨	🟨
06	Enable/Disable Never Consent	🟨	🟨
07	Pause Ghostery	🟨	🟨
08	Trackers Preview	🟨	🟨
09	Restart the browser	🟨	🟨
10	Language (ENG, FR, etc)	✔️	✔️
11	Uninstall survey	🟦	🟦
12	Sign in/out	🟨	🟨
13	Check Ghostery Background logs	🟨	🟨
14	Check settings	🟨	🟨
15	Open Ghostery panel	🟨	🟨

Browser: Safari 17.5
OS: macOS 14.5
GBE 10.3.12 (181)

Browser: Safari
OS: iOS 17.5.1
GBE 10.3.12 (181)

Legend:

✔️ - Checked and working
❌ - Issue
🟦 - Not available
🟨 - Not tested
passed -
conditionally passed - There are production errors that will be fixed in the next version. This is not a constraint to the release of this version.
failed -

ghostery / ghostery-extension