HTTPArchive / cwv-tech-report

Core Web Vitals Technology Report
https://cwvtech.report
28 stars 2 forks source link

Afterpay missing from April dataset #17

Open rviscomi opened 2 years ago

rviscomi commented 2 years ago
SELECT
  COUNT(DISTINCT url)
FROM
  `httparchive.technologies.2022_04_01_*`
WHERE
  app = 'Afterpay'

There are 0 pages detected with Afterpay in the April dataset. In March there were 14,349 pages.

Need to investigate whether something breaking changed in Wappalyzer (source) recently, or potentially if there's something that needs to be fixed in the WebPageTest agents.

A methodology change in the CWV Tech Report caused all technologies missing from the April dataset to get dropped from the report. So now even though we do have historical data for Afterpay, it's not available. I can fix that general design issue in parallel, but something seems particularly off about Afterpay's detections.

cc @pmeenan @rockeynebhwani

tunetheweb commented 2 years ago

Some guy called @rockeynebhwani already raised that Wappalyzer's detection of this is intermittent: https://github.com/wappalyzer/wappalyzer/issues/5883

Looking at that example website (https://www.dillards.com/search-term/floral/women), it mostly doesn't show in Wappalayzer's Chrome Extension.

rockeynebhwani commented 2 years ago

@tunetheweb I remember this :-). Rarely it doesn't appear in Chrome extension due to slowness but most of the time I see it working on sites. Try this - https://www.davidjones.com/product/papinelle-cheri-blossom-pant-and-organic-cotton-ls-top-24956223?nav=882517

Going from 14,349 to 0 worried me... as this will suggest it completely stopped working