search

matrix-org / matrix.org

matrix.org public website
Other
408 stars 339 forks source link

Feedback widget is distracting / annoying #809

Closed jryans closed 1 year ago

jryans commented 4 years ago

The feedback widget that appears lately on all matrix.org page lately is quite distracting / annoying. It lowers my confidence in the site overall, and makes me less likely to share matrix.org pages, as I don't want to inflict it on other people.

While I can understand a desire for feedback, are we actually getting useful signals through this widget? If removing it is not possible, could it be change to a much less distracting icon in the corner that can be expanded, like some other sites use?

Relevant code

aaronraimist commented 4 years ago

I agree with this. The rating thing is pretty annoying. It pops up on seemingly every single page load and right as I notice it and start to move my mouse over it then it disappears. I can't imagine a 1-5 star rating by itself is even all that useful even if it wasn't annoying.

If you need to collect feedback then maybe something built in to the bottom of the page with both a rating and a text field would be better.

It also seems just premature to add something like this at all. There are plenty of open issues worth taking care of already here on GitHub.

MadLittleMods commented 3 years ago

I was curious to check in on how often these ratings are being used so I checked in Matomo. It looks like there are 1770 rating events in there since it was first introduced in 2020-07-01.

I was also curious to see which pages are getting less than 5 star ratings but Matomo's interface is a bit infuriating. It seemed like I was getting a bunch of timeouts or no data errors when trying to troubleshoot things, i.e. Oops… there was a problem during the request. Maybe the server had a temporary issue, or maybe you requested a report with too much data. Please try again. If this error occurs repeatedly please contact your Matomo administrator for assistance. or when picking a smaller time range, There is no data for this report. but after a while and a refresh, things just magically worked. Maybe there is some indexing background process but it would be a lot nicer if they exposed that progress and that is still just a guess.

Eventually I was able to make a segment on matrix.org where it only showed visits where a rating event happened. Then I could go to the Event Names tab and export the data from there to process in a spreadsheet.

Here are any page URL's which have more than 3 ratings overall with an average rating of less than 4 (Matomo source). I'm not sure this is that helpful since it probably has a lot of 5-stars skewing this where people had no problem with the page:

If we ignore any 5-star ratings (Matomo source):

I don't know the original intentions of adding the rating system to know if this analysis draws the proper insights/conclusions we were looking for. But thought it was interesting 🌈

thibaultamartin commented 1 year ago

Widget has been nuked from orbit in the Zola migration 🚀