[Dashboards] Visualize quickstart installs leading to new user signups

[jpvajda]

Relates to #1789

Issue

Ensure that pack installs can be tied to new user signups so we can measure sign up conversions from I/O external with the goal to be able to know if a new user signed up on the I/O site, did they Install a quickstart or not.

Queries

there was an attempt

// page_action events DevEn currently has

FROM PageAction
SELECT
funnel(session,
  WHERE actionName = 'TDEV_QuickstartClick_instantObservability' as 'View details',
  WHERE actionName = 'TDEV_QuickstartInstall_instantObservability' as 'Click install',
)
SINCE 1 week ago
LIMIT MAX

// signup_events query from PLG  

FROM TessenAction SELECT filter(uniqueCount(anonymousId), WHERE eventName = 'TLMK_SignUp_signup'), filter(uniqueCount(anonymousId), WHERE eventName = 'TLMK_SignUp_signupThankYou') TIMESERIES AUTO SINCE 1 month ago

Acceptance Criteria

Note there is a Tableau Dashboard where this is being tracked which we can use to validate our queries. - @jpvajda has access.

• [x] update wip dashboards to track this data here [DevEn] External I/O & Quickstarts Ecosystem
• [ ] Share with @JuliaNocera as she was also interested in this data.

[jpvajda]

Zoe said we be able to tie in some additional data for new user sign ups by using the following

• To reproduce this in NR1, you will need to build a funnel:
• tdev_quickstartinstall_instantobservability is the 1st event
• tlmk_signup_signup is the 2nd event, and context_page_search = ‘?via=login’
• tlmk_signup_signupthankyou indicates signup form submission
• We have a more complicated join to identify whether the email verification is completed after signup form submission

[jpvajda]

@rudouglas i was thinking this might be a case for a custom viz? 🤔

[jpvajda]

I have funnel setup per these instructions but it doesn't seem to showing any data for the tlmk events, any thoughts @rudouglas

[rudouglas]

@jpvajda slack me a link to the query you are using, I think because they are 2 different events we'll need to do some trickery

[jpvajda]

We found that the tlmk events are probably created in a different account from our development enablement account, so a custom viz may be the way.

[jpvajda]

I'm going to give a custom viz a whirl.

[jpvajda]

This viz repo: https://github.com/jpvajda/new-user-signups (currently set to private) Also this video by Maria is handy

[jpvajda]

I don't think this is going to be possible right now, there's no unique identifying attribute that all the eventName 's use to track a user. The 2 PLG queries referenced above have something called anonymousId which would probably be something we would need to add to our events.

Even with a CustomViz theres no way to link a specific users install click with a signup event. We'll need to consider adding something like that -- from @rudouglas

I'm going to put this back in tentative next and perhaps can resolve it when we figure out 1789

[jpvajda]

@JuliaNocera is also interested in the outcome of this

[jpvajda]

We decided the exploration of the anonymousID assumption should be a seperate ticket... which relates to this ticket as well....

[zstix]

This is almost ready to be worked on, but was blocked on a few things:

• [x] This issue (which was closed by this PR)
• [x] This release of the theme (v3.5.0)
• [x] Deploy a version of the developer site with the new version of the theme that includes anonymous IDs

[zstix]

Now that we have an anonymousId for all our events, I think this is the query that we need to achieve the desired funnel. I'm going to add this to the [DevEn] External I/O & Quickstarts Ecosystem dashboard.

FROM TessenAction
SELECT funnel(anonymousId as 'Unique user',
  WHERE eventName = 'TDEV_QuickstartClick_instantObservability' AS 'View details',
  WHERE eventName = 'TDEV_QuickstartInstall_instantObservability' as 'Click install',
  WHERE eventName = 'TLMK_SignUp_signup' AS 'Signup form',
  WHERE eventName = 'TLMK_SignUp_signupThankYou' AS 'Signup success'
)
SINCE 1 week
AGO LIMIT MAX