search

PostHog / posthog

🦔 PostHog provides open-source web & product analytics, session recording, feature flagging and A/B testing that you can self-host. Get started - free.
https://posthog.com
Other
22.07k stars 1.33k forks source link

Sprint - July 8 to July 19, 2024 #23325

Closed mariusandra closed 3 months ago

mariusandra commented 4 months ago

Global Sprint Planning

3 things that might take us down

  1. MSK Kafka -> someone shipping something that writes a lot to kafka, b/c we use shared kafka. Could we monitor/alert?

Team sprint planning

For your team sprint planning copy this template into a comment below for each team.

# Team ___

**Support hero:** ___

## Retro

<!-- Grab the high and low priority items from last time and add whether that item was completed or not -->

- 

## Hang over items from previous sprint

<!-- For each item, decide to re-prioritise (and add below) or deprioritise -->

- Item 1. prioritised/deprioritise

## OKR

1. OKR, status (red/yellow/green) and action points if yellow/red

### High priority

-

### Low priority / side quests

-
mariusandra commented 4 months ago

Team CDP, WIP.

We're both off the last week of the previous sprint, so posting this already.

Retro

Hang over items from previous sprint

OKR

Sprint plan

Megaissues: CDP & Hog

pauldambra commented 4 months ago

Team Error Obsession, Obsessing on things

Support hero: @pauldambra

items from previous sprint

High priority

Low priority / side quests

OKR

  1. OKR, status (red/yellow/green) and action points if yellow/red

High priority

Low priority / side quests

EDsCODE commented 4 months ago

Team Data <->, collecting of Hogs and more

OKR Q2 2024

Objective

Query 3000

Data Modeling MVP

Retro

High Priority

thmsobrmlr commented 4 months ago

Team Product Analytics

Support hero: Week 1: @thmsobrmlr @skoob13 (secondary) Week 2: @Twixes @thmsobrmlr (secondary)

Time off: @aspicer only there for first three days

Retro

Extra things done

High priority

Low priority / side quests

Q3 2024 objectives

  1. Rock-solid analytics (@thmsobrmlr + @webjunkie + @aspicer + @anirudhpillai)
    1. Legacy Minus – removing legacy insights code so that we can move fast
      • FilterType gone from the frontend.
      • rm -rf posthog/queries/
      • Experiments ported to HogQL.
      • All the flags from HogQL/querying work.
    2. Tests Plus – shipping fewer bugs in the first place
      • Ensure we test with the feature flags that users actually experience, both in end-to-end and integration tests.
      • When shipping changes to queries, replay old vs. new version on thousands of real queries to check for regressions.
    3. Metrics Plus – catching issues before before users report
      • Analytics performance dashboard in Grafana (query duration, failures, etc.). Paging alerts on critical metrics, e.g. if the number of queries drops rapidly, or failures rise.
      • Analytics experience dashboard in PostHog (time till data available, result freshness across insights and subscriptions, refreshes initiated manually vs. automatically, etc.)
      • Alerts on major Product Analytics errors from Sentry, and us acting on every alert. (Bonus: checking up the Sentry routing rules for the #product-analytics team.)
      • Cohorts dashboard in Grafana (successful vs. failed calculations per day, recalculation backlog). Alerts here too.
    4. Performance Plus - eliminating UX pain via maximum query performance/reliability, based on Metrics Plus data
      • Partial calculation of multi-day time series results …and more – work with Team Query Performance to find the lowest-hanging fruit, similarly to Tim's performance mega issue
    5. Support Plus – sparking joy for users when they’re led to report a bug
      • 1 hero + 1 sidekick
      • Goal: 90% of tickets fulfill the SLA
  2. Answering more product questions, deeper (@thmsobrmlr + @webjunkie + @aspicer + @anirudhpillai)
    1. Growth Plus - increasing ease of onboarding, and subsequent retention
      • Identify growth opportunities working with Anna, our product manager – implement growth optimizations and track their impact whenever possible.
      • Work with Team Growth on optimizing the onboarding experience of Product Analytics.
    2. Analysis Plus - answering more product questions, more deeply
      • Analytics alerts are out to users (implemented with the contributor)
      • “Done for the first time” in Trends, to kill the janky First Time Event Plugin
      • Query in new insight URL for instant insight sharing
      • Optional funnel steps
      • ...and more, based on user feedback - see the most requested features in GitHub
  3. ArtificialHog (@Twixes + @skoob13) – an LLM-based chat-like interface for answering product questions.
tiina303 commented 4 months ago

Team Pipeline

Off: Brett 2 days, Xavier 2 days Support: Tiina

Retro

High priority

Low priority / side quests

OKR

✅=finished 🟢=on track to finish this quarter 🟡=might not finish 🔴=won't finish ✔️=progressed last sprint ; ➡️=planned work for this sprint

🟢 Test Warpstream as PoC and decide whether to do it or not 🟢➡️ Pipeline scalability Improving pipeline throughput 🟢➡️ Help other teams ship fast 🟢 Stretch: better e2e monitoring

High priority

Low priority / side quests

fuziontech commented 4 months ago

Team Click Haus, Haus of the Hogs

OKR Q2 2024

Objective

James as a Service -> Clickhouse as a Service

Board

https://github.com/orgs/PostHog/projects/85/views/2

Retro

@Daesgar - There have been changes to our scope. We have changed our scope by 1/2 just because of changing priorities and fires. Feeling comfortable. Able to do config automation and provide value in the first sprint. Working on the backups. Needs more context for the rest of how things work at PH (like the plugin server). Sometimes it's hard to get focus on something. When a question comes up in the chat there is ambiguity on whether it's something urgent or something to focus on.

@fuziontech - Overall I think this sprint went amazingly. Having 2x the firepower is a hack. Getting a lot more done than even my highest expectations. Having ~two incidents was less than ideal though for a first sprint.

High priority

image
robbie-c commented 4 months ago

Team web analytics session table

Support hero: @robbie-c

Retro

Session table PR got merged, we are dogfooding, I'm fixing issues as they come up.

Had some detailed customer interactions around channel type attribution. One customer sent me a spreadsheet of their GA compared with us. We're pretty close but there were a few differences that I was able to fix or help them fix. A few other support tickets have asked for help with this, so I'm adding a session attribution debugger.

Tasks

🟢 Get session table v2 PR over the line 🟢 Start backfilling, prioritising EU, and team 2 on US for dogfooding 🆕 Help customers debug attribution 🆕🟢 Add live session count

Stretch

🔴 Get a versions of WA up that is terrifyingly fast because it can just use the sessions table + it can sample

OKR

  1. Make querying fast enough for large customers
  2. Heavily requested features
  3. Improve synergy with other products
  4. Product and growth

High priority

Ongoing

neilkakkar commented 4 months ago

Team Feature Success

Support hero: @Phanatic Days off: Juraj: 1 days Phani: 0 days Dylan: 1 days Neil: 2 weeks

Retro

Hang over items from previous sprint

OKRs

  1. Make sure feature flags can handle 10x current scale
  2. No-code experiments
  3. Split out experiments into its own product

High priority

Low priority / side quests / maybe Neil will get to this next year

raquelmsmith commented 4 months ago

Team Growth

Retro

Retro items - [x] Q3 planning - @raquelmsmith - [x] Support for first week - [x] Pricing page experiments - iterate here with cory and eli until it's done - [x] Stay on top of revenue issues - [x] Start working on toolbar dashboard template thing - [x] Keep on top of personless comms and customer issues and metrics - [x] Lots of interviews... - @zlwaterfield - [ ] Complete _subscribe to all products_ - [x] frontend changes - [x] release under feature flag to new users - [ ] backfill existing users and communicate with them - [x] (if time permits - probably next sprint) cleanup! remove/clean single product subscribe code where we can. - [x] Start on the Stripe metadata changes - close RFC, updates to Zapier, work on backfill, etc. - [ ] re-run the plans map and compare with the new auto-cancel functionality

Q3 Goals

✅=finished 🟡=in progress 🔴=won't finish ⚪=not started

  1. 🟡 Make onboarding awesome for Product analytics and Data warehouse (Raquel)
  2. ⚪ Support self-serve annual commitments (Zach)
  3. ⚪ Dive into the data to understand our billing metrics and customers better (Zach)
  4. 🟡 Launch pricing for data warehouse (Raquel)
  5. 🟡 Hire 2 people (one for billing, one for auth/permissions focus)

This sprint

High priority

benjackwhite commented 4 months ago

Team Infra

OKR

  1. 🦹 Zero-trust security
  2. 🤓 10x Developer Experience
  3. 💪 Every service lives and dies alone
  4. 💰 Save big on cost

High priority