We need to provide a guide to Support on how to troubleshoot Experiments. This should not duplicate what's already in our docs; it should just cover additional info Support may need that customers won't. It should include:
An overview of the Analytics Infrastructure
A list of common failure modes and what the cause is. For example:
Experiments shows as not enabled: Check the Analytics App config
The Experiment is running, but not data is being collected:
Ensure that there's enough data for the chart and table to show (e.g. minimum 10 sessions and at least one successful and unsuccessful conversion for each variant)
View the results of the CubeJS call to see if any data was returned
etc.
Visitors don't seem to be routed to the variants
etc.
How to get help from R&D if they have questions or need help (e.g., post a message in the #falcon-heavy channel, or DM the PM or team lead directly)
We need to provide a guide to Support on how to troubleshoot Experiments. This should not duplicate what's already in our docs; it should just cover additional info Support may need that customers won't. It should include: