sitespeedio / sitespeed.io

sitespeed.io is an open-source tool for comprehensive web performance analysis, enabling you to test, monitor, and optimize your website’s speed using real browsers in various environments.
https://www.sitespeed.io/
MIT License
4.75k stars 603 forks source link

Getting the same metrics values in the multiple page run... #3855

Open anbu2014 opened 1 year ago

anbu2014 commented 1 year ago

Hi, I am running a test for a webpage where I am measuring multiple pages. I am seeing the same values carry forward for all the pages. Example: LCP values, max potential, FCP..... In logs: I am seeing info: No element attached to the entry in LCP.

soulgalore commented 1 year ago

Hi @anbu2014 can you please share some more info on how you run etc? If you are testing a SPA the metrics that comes from the browser will be the same until the browser vendors has agreed on how that kind of navigation would be measured. For the visual metrics they should work though.

anbu2014 commented 1 year ago

I am running a SPA application. Even though I add --spa in the run comment still I was getting the same matrices in all the transactions.

soulgalore commented 1 year ago

Metrics that comes from the browser (first contentful paint, largest contentful paint etc) will not change until https://github.com/WICG/soft-navigations is implemented in browsers. What you can do is focus on the visual metrics (the metrics that comes from analysing the video between navigations) until browser and soft navigation support.

anbu2014 commented 1 year ago

Thanks for your suggestion. I tried installing visual metrics using this doc "https://github.com/WPO-Foundation/visualmetrics" still, I was getting an error visual metrics failed to run.

soulgalore commented 1 year ago

Ah @anbu2014 sorry for being unclear, visual metrics is already installed if you use sitespeed.io. Can you share how you run, I can help you in the right direction.

anbu2014 commented 1 year ago

@soulgalore

I have used "npm install -g sitespeed.io" cmd to install the sitespeed.io I have installed several image processing tools like

ffmpeg: Required for video extraction compare: Part of Imagemagick convert: Part of Imagemagick Pillow: Python imaging library pyssim: Python module for Structural Similarity Image Metric (SSIM)

Execution: From GITBASH I run the comment ---> bin\sitespeed.js C:\sitespeed\Scripts\StudentAction.js --chrome.chromedriverPath C:\sitespeed\Driver\chromedriver_win32\chromedriver.exe --spa --multi -b chrome -n 1 --visualMetrics

soulgalore commented 1 year ago

Hi @anbu2014 ImageMagick is for an old version of Visual Metrics. This is the list to get it to work on Windows (at least on our CI): https://github.com/sitespeedio/browsertime/blob/main/.github/workflows/windows.yml#L22-L30C37

anbu2014 commented 1 year ago

Hi @soulgalore thanks for your wonderfull support I am able to caputure the visualMeterics now. I have noticed that video caputured is not full screen any reason? WhatsApp Image 2023-05-23 at 3 05 11 PM

soulgalore commented 10 months ago

One way to try would be to try different viewports? I wonder if there's something strange happening on Windows.