GoogleChromeLabs / ps-analysis-tool

Privacy Sandbox Analysis Chrome Extension and CLI for analysis and understanding of cookie usage on web pages, and new privacy-preserving Chrome APIs
https://www.privacysandbox.com
Apache License 2.0
101 stars 23 forks source link

[QA] - Develop branch #768

Closed pavanpatil1 closed 2 months ago

pavanpatil1 commented 3 months ago

For Next Release

pavanpatil1 commented 3 months ago

In the extension’s report.html file, the sidebar navigation menu bar scroller on the cookie landing page is not working properly.

scroller.webm

pavanpatil1 commented 3 months ago

On the cookie landing page, the Exemption cookie text is not translated, whereas it is translated in the report.

Landing Page Report
Screenshot 2024-07-23 at 11 02 41 AM Screenshot 2024-07-23 at 11 03 59 AM
pavanpatil1 commented 3 months ago

The 'Analyze this tab' button is not displayed on one of the tabs immediately after switching from multi-tab to single-tab mode.

Steps to reproduce:

  1. Enable multi-tab processing and analyze 3-4 tabs.
  2. Disable the multi-tab settings and review all tabs. You should notice that cookies are still visible in tab where we close the mutitab settings.
  3. Reopen the DevTools on that tab and observe the results.

multitab.webm

pavanpatil1 commented 3 months ago

When executing the CLI with the ‘-o’ parameter the report.html file is not visible in output folder.

Screenshot 2024-07-23 at 11 59 19 AM
pavanpatil1 commented 3 months ago

On the page where no cookies are present, the report button is enabled, but the report download button is not working properly.

example.webm

pavanpatil1 commented 3 months ago

The horizontal scroller should appear when multiple filters are selected in the global filter. Also, the menu bar could be positioned a bit lower.

Screenshot 2024-07-23 at 3 08 26 PM
pavanpatil1 commented 3 months ago

Encountering an error during CLI analysis of the Amazon site.

Screenshot 2024-07-25 at 10 03 36 AM
pavanpatil1 commented 3 months ago

The path column sorting filter is not working properly. The column has only one value, but when clicking on the filter, the values are changing.

path.webm

pavanpatil1 commented 3 months ago

The CSV report downloaded from the cookie table is named as: "site-name-report.csv". To maintain consistency with other reports, could we add the date and time to this report name as well? It should be formatted as "-report.csv

Screenshot 2024-07-25 at 2 37 47 PM
pavanpatil1 commented 3 months ago

The errors appear when running the build command.

Note: It is failing on all build commands.

Screenshot 2024-07-28 at 2 36 07 PM
pavanpatil1 commented 3 months ago

The httpOnly filter is not working properly. When CDP is off, it works fine, but when enabled, it does not sort properly.

Note: Same observed for partition key filter.

http.webm

pavanpatil1 commented 3 months ago

The horizontal scrollbar is not functioning correctly. Initially, when the devtool is opened, the table columns within the frames are not fully visible, and the horizontal scrollbar does not work.

scroll.webm

pavanpatil1 commented 3 months ago

The 'Exempted Cookies' section appears in the report, but it is not visible on the landing page when CDP is turned off, even though it shows up in the report

Screenshot 2024-07-29 at 1 15 31 PM
pavanpatil1 commented 3 months ago

The report analysis time is not updating correctly in the extension after downloading the report ZIP file. The final report.html file in the extension displays the previous analysis time.

reporttime.webm

pavanpatil1 commented 3 months ago

In the report ZIP, the cookies-issue.csv file is missing the 'priority' and 'size' columns. These columns, which are present in the table, are not present in the CSV file.

Screenshot 2024-07-29 at 3 34 28 PM
pavanpatil1 commented 3 months ago

On the NYTimes site, in the cookie.csv file, For the cookie '_v__cb_cp' the priority column is not correctly displayed; it appears within the size column instead.

Screenshot 2024-07-29 at 3 54 34 PM
pavanpatil1 commented 3 months ago

In the report.html file, sorting of the 'SameSite' column is not functioning properly.

samesite.webm

milindmore22 commented 3 months ago

CLI : Ignore GDPR -i CLI option is not working correctly in both cases. It shows the same number of cookies on both accepted and ignored cases.

Tested on 1) https://aljazeera.com/ 2) https://www.singaporeair.com/

Default (Accepted GDPR banner) Cookie Count: 64 image

Ignore blank (Ignore GDPR banner) Cookie Count : 64

image

milindmore22 commented 3 months ago

CLI: Partition key column sorting from CLI report is not working properly.

https://github.com/user-attachments/assets/7515ed85-f370-46d4-be33-4a5269727f2a

milindmore22 commented 3 months ago

CLI: The downloaded report.html file has a console error.

GET file:///Users/milind/Downloads/psat_cli_report_aljazeera-com_2024-07-29_17-21-52/index.js net::ERR_FILE_NOT_FOUND

image

pavanpatil1 commented 3 months ago

CLI: In the CSV and sitemap execution via CLI, the report.html file is missing the analysis date and time information.

report.webm

milindmore22 commented 3 months ago

Extension : We need a proper message to the Blocked cookie section when there are not blocked cookies (ie. count is zero) image

You can visit example site homepage https://domain-aaa.com/

milindmore22 commented 3 months ago

Extension Reports : The Downloaded Reports display in Light mode when your system and browser preference is dark mode. image

pavanpatil1 commented 3 months ago

Extension: On the cookie landing page, the messages in the "Known Breakages" and "Exempted Cookies" sections are not center-aligned.

स्क्रीनशॉट 2024-07-31, अ 4 36 00 पर
pavanpatil1 commented 3 months ago

An unwanted ` symbol is visible after the migration text in the GSI description within the "Known Breakages" section.

Screenshot 2024-07-31 at 4 09 56 PM
pavanpatil1 commented 3 months ago

Extension: In the platform column, if there are entries labeled "Unknown," the sorting functionality does not work correctly. The "Unknown" values are displayed at the top of the list.

platform.webm

pavanpatil1 commented 3 months ago

Extension: The frames section does not work when global filters are applied in the report.

frames.webm

milindmore22 commented 3 months ago

CLI : Invalid CSV getting generated if there is JSON in cookies value.

Steps to reproduce.

  1. psat -u https://spectator.org/defund-npr-yesterday/
  2. It will generate a report, open it.
  3. Click Download from Cookie landing page.
  4. extract zip file
  5. Open cookies.csv
  6. Look for plsGeoObj with value in JSON format {"ip":"117.202.207.242","country":"IN","region":"MH","city":"Pune","zip":"411004","location":"18.6161,73.7286"}

The value is not parsing correctly due to double quotes, creating invalid CSV

https://csvlint.io/validation/66aa2855b7d0ed000200006b

pavanpatil1 commented 3 months ago

Extension: In the Exemption Cookie section, the color does not update when selecting an exemption cookie from the filter. The color should change to reflect the selected cookie.

Steps to reproduce:

  1. Go to the site: https://about.disqus.com/disqus-demo-page
  2. Choose any exemption reason from the global filter and check the color change.

excemption.webm

pavanpatil1 commented 3 months ago

CLI: The HttpOnly filter is not functioning correctly on some sites.

httponly.webm

pavanpatil1 commented 3 months ago

The "SameSite" column is inconsistently displaying "none" and "None" for empty rows where the SameSite value is absent. It should be consistant to use either "none" or "None" consistently across all entries.

Screenshot 2024-08-02 at 9 04 06 AM
pavanpatil1 commented 3 months ago

In the Korean translations, some values for the SameSite column appear translated in the table, but after downloading the CSV file, those translations are not visible in the CSV.

Screenshot 2024-08-02 at 12 11 06 PM
pavanpatil1 commented 2 months ago

Fixed and Released as a part of v0.10