US-GHG-Center / veda-config-ghg

Veda config for GHG
https://ghg-demo.netlify.app
Other
3 stars 15 forks source link

Investigate critical error view stats #249

Closed j08lue closed 8 months ago

j08lue commented 10 months ago

GHG Center site analytics from 5 December (public launch spike) show that, some of the ~700 visitors, in total encountered "Critical Error" failures 10 times:

image

Are these stats reliable? If so, is there any way we can get to the cause?

Acceptance criteria

j08lue commented 10 months ago

We have earlier seen Critical Error's in Exploration when datasets where missing summaries (in STAC collection metadata).

I tried "Exploration" on all datasets in https://earth.gov/ghgcenter/data-catalog (that had raster layers), testing many sub-layers, but all worked. 🤷

anayeaye commented 10 months ago

I did a quick check on ghg for missing summaries but all collections look good. Dropping a note so no one else has to do this check:

curl -X 'GET' \
  'https://ghg.center/api/stac/collections?limit=100' \
  -H 'accept: application/geo+json' | jq -r '.collections[]'  | jq .id,.summaries | less 
hanbyul-here commented 10 months ago

Any more clues about this error will help. @aboydnw Is there any way to know more about the context? ( the previous page? previous interaction? How long the user was on the page? what browser is used? Anything will help.)

aboydnw commented 10 months ago

Here are a couple screenshots I pulled from analytics.

The first, is a report that shows some information on the critical errors. Most of them are happening on the home page, but there's a few other stragglers. I don't know if this means there is something wrong with the home page or if it has the most errors because it has WAY more traffic than any other page. In fact, it might be a sign that the home page is more performant than other pages because it has like 100x as many views as the Analysis page, which is also on the list.

Untitled Report › Untitled Page 2023-12-07 12-30-54

The second, is a path exploration in google analytics. This shows that almost all of the critical errors are happening when the land for the first time or after the first click. Again, I'm not sure if this is definitive because we don't have high engagement from people. Users drop off pretty quickly.

Analytics 2023-12-07 12-26-13
aboydnw commented 10 months ago

I posted this in slack but also sharing here: 30 critical errors represents ~1.2% of overall traffic

We should consider that with the effort we put towards this ticket

j08lue commented 8 months ago

We addressed this in the following ways:

  1. Improving the wording and UX of the formerly called "critical error" page, which is now much less alarming and tells users what they can do
  2. Continuing to monitor this - the error has been absent recently, it seems