microsoft / clarity

A behavioral analytics library that uses dom mutations and user interactions to generate aggregated insights.
https://clarity.microsoft.com
MIT License
2.06k stars 203 forks source link

Microsoft Clarity Missing Issues | Questions #297

Open chanduaki1998 opened 1 year ago

chanduaki1998 commented 1 year ago

Hi Team ,

We have integrated Microsoft Clarity using Google Tag Manager as well as running A/B Testing experiments through Optimizely. A discrepancy was found between the experiment specific data between Clarity and GA4 and here are a few questions we would like answered.

  1. Does Clarity record all recordings, heatmaps & sessions for all users?
  2. Are there any daily limits in Microsoft clarity ?
  3. How will the Distinct Users be calculated in Clarity? Can we compare the number of distinct users in Clarity with that of the number of total users in GA4
ClaritySupport commented 1 year ago

@chanduaki1998

  1. Clarity tracks every session, but recordings may not be available for every session.
  2. Heat maps are limited to up to 100,000 page views per heat map and Clarity records up to 100,000 sessions per project per day.
  3. The users are calculated on Clarity by the clarity-js script writing a cookie to for a randomized userId, and subsequent page views from that machine will be marked as the same user.
chanduaki commented 1 year ago
  1. If we take 1000 sessions , in that for how many sessions does clarity records the recordings
ClaritySupport commented 1 year ago

@chanduaki , Clarity tracks every session, but recordings may not be available for every session.

chanduaki commented 1 year ago

@clarity support

Thanks, based on the doc we understand that clarity won't record every session

But according to our usecase, we want to understand to each user behavior. Let's take 100 sessions with 100 users, in that how many sessions does clarity track the session recordings

ClaritySupport commented 1 year ago

@chanduaki , the 100,000 limit only applies to playbacks. We continue to track sessions beyond 100,000 and they will show up in the metrics and heatmaps.

chanduaki commented 1 year ago

@clarity support

I accept that clarity won't record each and every recording

Would like to know how much percentage of sessions are recorded, in order to take further decisions

ClaritySupport commented 1 year ago

@chanduaki1998 , Clarity tracks every session without exception.if you take 1000 sessions, you should see 1000 sessions in the Clarity portal. If you are having trouble finding a significant amount of sessions, then its possible that you are not installing Clarity on all your pages, which is a very common mistake.

chanduaki commented 1 year ago

Hi Team ,

As you say, "Clarity tracks all sessions, but recordings may not be available for all sessions.".

Can you please tell us for which particular sessions recordings are available in Microsoft Clarity and what are the required considerations for recording sessions

chanduaki commented 1 year ago

Also in a month let's take an example 150 sessions are happening and out of 150 , we are able to see 12 recordings can we consider 8% (12/150) of recordings are recorded in clarity

GFoley83 commented 11 months ago

@chanduaki , Clarity tracks every session, but recordings may not be available for every session.

@ClaritySupport How does Clarity decide what to record and what not to record? Is there any flag you can add to specifically request recordings e.g. for a particular user or URL?

py-chou commented 10 months ago

@chanduaki , Clarity tracks every session, but recordings may not be available for every session.

@ClaritySupport How does Clarity decide what to record and what not to record? Is there any flag you can add to specifically request recordings e.g. for a particular user or URL?

@ClaritySupport We're also wondering the recording rate of the Clarity. Coz We noticed some visitors in our website only are recorded 2 or 3 recordings with 10+ sessions

ClaritySupport commented 10 months ago

@py-chou ,

1.Clarity tracks all sessions, but recordings may not be available for every session. We only show a recording if it was captured without any issues from beginning to end. We’re working on improving it even further.

  1. If you can share more details along with project ID over email to our support aliasClarityMS@microsoft.com, we can check and assist further.
chetandalal1993 commented 10 months ago

@ClaritySupport

@ClaritySupport Any ballpark estimates on what % of recordings are captured?

anubhavmalik commented 10 months ago

Would really appreciate a more clear answer on this @ClaritySupport. Session recordings are really important for us. A percentage would really help me determine if Clarity is the right choice for my project.

ClaritySupport commented 10 months ago

@anubhavmalik ,All sessions are fully captured for playback by default (up to a soft limit of 100,000 playbacks per day). Certain client side errors or network errors can break Clarity’s capture logic, but these errors are usually rare and are client specific. If a recording breaks halfway through a session, the partial recording is discarded to avoid skewing the data available to the site owner. If you are a site owner and you cant find the majority of your recordings, something in your site could be breaking your recordings and you should contact support over email with details of your Clarity project and site, so that we can start an investigation and resolve the issue

atVish commented 7 months ago

1.Clarity tracks all sessions, but recordings may not be available for every session. We only show a recording if it was captured without any issues from beginning to end. We’re working on improving it even further.

@ClaritySupport

Is there any updates on the improvements? I see many of my important sessions are not recorded.

Also let us know what are all the issues that affect the capturing

Anisomorpha commented 7 months ago

:D This is so funny. No matter how many times you ask, you're going to get the same answer. Must be a Lor version of ChatGPT (Star Trek TNG refrence).

"Clarity tracks all sessions, but recordings may not be available for every session. " I understand, but what percentage of sessions are recorded? "Clarity tracks all sessions, but recordings may not be available for every session. "

Alfi-was-taken commented 7 months ago

:D This is so funny. No matter how many times you ask, you're going to get the same answer. Must be a Lor version of ChatGPT (Star Trek TNG refrence).

"Clarity tracks all sessions, but recordings may not be available for every session. " I understand, but what percentage of sessions are recorded? "Clarity tracks all sessions, but recordings may not be available for every session. "

Probably website dependent. I found out you can download all the recordings, which gives you list of recordings in .csv and compare the data with the 'sessions' information available on the clarity dashboard. If there are too many recordings, you can just do it for a subset of a couple of days.

This should give you the percentage of recorded sessions.

founderskyway commented 6 months ago

In my experience, clarity will not record visits under 8-10? seconds or when using certain VPNs. VPNs WITH short visits are never recorded. I don't know why the clarity rep won't just say that!

shanda506365 commented 5 months ago

That's also what I want to ask, I have the sense that the session records are not incomplete, but I dont know clarity rules.