search

PostHog / meta

This is a place to discuss non-product issues in public.
MIT License
15 stars 4 forks source link

Onboarding and G2 Review Request tweaks #149

Closed joethreepwood closed 11 months ago

joethreepwood commented 11 months ago

Tweaking the emails to reflect two main changes.

Onboarding

We had feedback from a user that they were getting emails too regularly. I looked into this and saw the emails were indeed arriving sooner that we would like them to. So, I've tweaked the flow for the Cloud onboarding in two ways:

  1. I've changed all 1 day waits to 2 day waits
  2. I've moved all of these waits to occur before we check user subscription status, instead of after.

Step 2. is important because there's a risk that users could subscribe to a product in this two day window, and then get the wrong email.

The overall result is that it now takes 6 days, rather than 3, to move through the upsell cycle.

If we felt strongly that emails are too frequent, we could additionally look at spacing out the newsletter invites or moving them to the end of the flow.

G2 Targeting

A suggestion from @andyvan-ph was that we tweak the G2 review requester to focus on engineers, in order to up the quality of our reviews. This roles that in.

We had previously tried similar targeting aimed at users who were engineers AND high ICP users and it did not create good results, as it decimated our response rate. Before that we had tried targeting just engineers with a different incentive and that too killed our response rate -- but trying targeting engineers with the current incentive seems worth a shot.

charlescook-ph commented 11 months ago

I think maybe we don't need consistent gaps between emails - for example upselling to a new product should occur after a week maybe? A lot of people will still be very much in tinkering around phase within a week I suspect.

(But I'm curious what the data says - do you see people clicking through and then activating on those new products?)

Agree on the G2 recommendation 👍

joethreepwood commented 11 months ago

The challenge is how the flows combine. We can increase the delays to a week, but then users get stuck early in the flow.

For example: If there's a one week delay before the FF upsell, we don't check about Surveys until a week later. That means the survey upsell is delayed (which is fine), and the Survey welcome is delayed too (not fine).

There's a way to fix this by completely restructuring the flows using properties and different logic, I think. However, it'll be a big job and I'll need to think it through carefully.

For now, I'll increase the delays to weeks as reflected in the new commit to address the feedback, and I'll plan to overhaul all of this in the following sprint.

charlescook-ph commented 11 months ago

Sounds sensible!