influx-product-manager
commented
2 years ago Link to subfeature: https://influxdata.productboard.com/feature-board/planning/features/13761101
Open influx-product-manager opened 2 years ago
influx-product-manager
commented
2 years ago Link to subfeature: https://influxdata.productboard.com/feature-board/planning/features/13761101
User Story
As Product Manager and service provider, I want to know how users are feeling about and adopting the new data explorer experience so that I know what needs to be refined and when/if I can turn off the old data explorer.
Notes
The following is a wishlist without regard for what may be technically feasible/possible. The Acceptance Criteria here is simply our best effort at the highest priority wish list items that are feasible.
Note: Color coded version with priorities listed here:
https://docs.google.com/document/d/1PFAjWbOChS3du2DrCXwpKiWz5RDXUvAgTOJXxDOkCgA/edit
New Data Explorer Analytic Instrumentation
New Data Explorer Toggle
How often a user selects the new data explorer and never turns it back off.
How often a user selects the new data explorer but turns it back off.
When a user turns off the new data explorer, how quickly they turn it off
When a user turns off the new data explorer, if they have had any interaction with that UI first (bucket selection, typing into flux window, etc.).
Number and percentage of times users select a bucket and then switch back to the old data explorer
Number and percentage of times users type into script editor then switch back to old data explorer
Number and percentage of times users run a query and then switch back to old data explorer
How often a user tries the new data explorer more than once (goes back to it after toggle it off)
Number and percentage of times users have turned on, turned off, and then turned back on the new data explorer
Average number of times a user switches between new and old data explorer
New Data Explorer (in general)
How long are the sessions in the new Data Explorer?
What percentage of users that go into the new Data Explorer, click a schema item first, vs. type in the flux window first, vs. browse flux functions first.
Number and percentage of times users click a schema item first in the new data explorer
Number and percentage of times users make selections in the query builder first in the old data explorer
Number and percentage of times users type in the flux window first in the new data explorer
Number and percentage of times users switch to the script editor first in the old data explorer
Number and percentage of users who scroll through or click on flux function first in the new data explorer
What percentage of the time users click "run" when launching data explorer
Number and percentage of times users run a query in the new data explorer
Number and percentage of times users run a query in the old data explorer
What percentage of the time data is returned in the results window when users click "run" vs. what percentage of time is there an error vs. what percentage of time is the result set empty
Number and percentage of times data is returned in the results window after running a query in the new data explorer
Number and percentage of times data is returned in the results window after running a query in the old data explorer
Number and percentage of times there is an error after running a query in the new data explorer
Number and percentage of times there is an error after running a query in the old data explorer
Number and percentage of times there is an empty result set after running a query in the new data explorer
Number and percentage of times there is an empty result set after running a query in the old data explorer
What percentage of the time does the query timeout?
Number and percentage of queries that time out in the new data explorer
Number and percentage of queries that time out in the old data explorer
What is the average length of session in the new data explorer?
Average session time in the new data explorer
Average session time in the old data explorer
What is the average time from query run to query results?
Average query run + render time in new data explorer
Average query run + render time in old data explorer
What is the longest time from query run to query results?
Longest query run + render time in new data explorer
Longest query run + render time in old data explorer
How often is the next path after leaving data explorer going to Notebooks?
Number and percentage of times users go to Notebooks from the new Data Explorer
Number and percentage of times users go to Notebooks from the old Data Explorer
How often is the next path after leaving data explorer going to Dashboards?
Number and percentage of times users go to Dashboards from the new Data Explorer
Number and percentage of times users go to Dashboards from the old Data Explorer
What percentage of queries are re-run after the first run
Number and percentage of queries that are re-run after the first run in the new Data Explorer
Number and percentage of queries that are re-run after the first run in the old Data Explorer
What percentage of queries are re-run with no changes to flux?
Number and percentage of queries that are re-run with no changes to flux in the new Data Explorer
Number and percentage of queries that are re-run with no changes to flux in the old Data Explorer
What are the path breakdowns for usage, and how often is each path taken (ie. Schema browser selections, Schema Browser Inject, Manual Edit, Run, Table, Graph)
Schema browser selection
Number and percentage of times users select a bucket in the new data explorer
Number and percentage of times users select a bucket in the old data explorer
Number and percentage of times users select a measurement in the new data explorer
Number and percentage of times users select a measurement in the old data explorer
Number and percentage of times users select/inject a field in the new data explorer
Number and percentage of times users select a field in the old data explorer
Number and percentage of times users select/inject a tag value in the new data explorer
Number and percentage of times users select a tag value in the old data explorer
Schema browser injection (first)
Number and percentage of times users inject something in the script editor at least 1 time using the schema browser in the new data explorer
Number and percentage of times users run a query at least 1 time using only the query builder in the old data explorer
Schema browser injection (subsequent)
Number and percentage of times users inject something in the script editor more than 1 time using the schema browser in the new data explorer
Number and percentage of times users run a query more than 1 time using only the query builder in the old data explorer
Average number of times a user injects code from the schema browser in the new data explorer
Manual typing or pasting into flux editor
Number and percentage of times users manually type into the script editor in the new data explorer
Number and percentage of times users manually type into the script editor in the old data explorer
Number and percentage of times users paste into the script editor in the new data explorer
Number and percentage of times users paste into the script editor in the old data explorer
Time Range Selection
Number and percentage of times users select the time range feature in the new data explorer
Number and percentage of times users select the time range feature in the old data explorer
Number and percentage of times users change the time range selection in the new data explorer
Number and percentage of times users change the time range selection in the old data explorer
Number and percentage of times users use calendar date selection in in the new data explorer
Number and percentage of times users use calendar date selection in in the old data explorer
Number and percentage of times users use time options (ie. in in the new data explorer
Number and percentage of times users use the data selection in in the old data explorer
Flux Function Search
Number and percentage of times users use flux function search in new data explorer
Number and percentage of times users use flux function search in old data explorer
Flux Function Selection & Injection (first)
Number and percentage of times users inject a flux function in the script editor at least 1 time using the flux browser in the new data explorer
Number and percentage of times users inject a flux function in the script editor at least 1 time using the flux browser at least 1 time using only the query builder in the old data explorer
Flux Function Selection & Injection (subsequent)
Number and percentage of times users inject a flux function in the script editor more than 1 time using the flux browser in the new data explorer
Number and percentage of times users inject a flux function in the script editor more than 1 time using the flux browser in the old data explorer
Average number of times a user injects a flux function from the flux browser in the new data explorer
Average number of times a user injects a flux function from the flux browser in the old data explorer
Clicking Run
Number and percentage of times users click run in the new data explorer
Number and percentage of times users click run in the old data explorer
Getting Results
Number and percentage of times users get results after clicking run in the new data explorer
Number and percentage of times users get results after clicking run in the old data explorer
Scrolling through results
Number and percentage of times users use the next button on results pagination in the new data explorer
Number and percentage of times users use the next button on results pagination in the old data explorer
Toggling to graph
Number and percentage of times users switch to graph in the new data explorer
Number and percentage of times users who switch to simple table in the old data explorer
Graph Selection
Number and percentage breakdown of graph types selected in the new data explorer
Number and percentage breakdown of graph types selected in the old data explorer
Leaving Data Explorer
Number and percentage of times users bounce from the new data explorer page
Number and percentage of times users bounce from the old data explorer page
Number and percentage of times users exit from the new data explorer page
Number and percentage of times users exit from the old data explorer page
Schema Browser
What percentage of unique users make a bucket selection after launching data explorer
What percentage of any usage makes a bucket selection after launching data explorer
What percentage of time bucket selection happens with a bucket search vs. not a bucket search
When bucket search is used, how many characters are typed before bucket selection is made
What percentage of unique users make a field selection after launching data explorer and selecting a bucket
What percentage of any usage makes a field selection after launching data explorer and selecting a bucket
What percentage of time field selection happens with a field search vs. not a field search
When field search is used, how many characters are typed before field selection is made
What percentage of unique users make a tag key selection after launching data explorer and selecting a bucket
What percentage of any usage makes a tag key selection happens after launching data explorer and selecting a bucket
What percentage of time tag selection happens with a tag key search vs. not a tag search
When tag search is used, how many characters are typed before tag key selection is made
What percentage of unique users make a tag value selection after launching data explorer and selecting a bucket
What percentage of any usage makes a tag value selection after launching data explorer and selecting a bucket
How often are more than 1 field selected (may not be applicable with current prototype)?
How often are more than 1 tag keys selected (may not be applicable with current prototype)?
How often are more than 1 tag values selected may not be applicable with current prototype)?
Average Number of fields selected
Average Number of tags selected
Average Number of tag values selected
Time it takes from bucket down area to bucket list to show
Time it takes from bucket selection for field/tag list to show
Time it takes from tag key selection for tag values to show
Flux Script Editor
How often/what percentage of queries has something pasted into the Script Editor
How often/what percentage of queries has manual tying in the script editor (vs. just injection).
What number and percentage of queries have:
Typing only in the new data explorer
Typing only in the old data explorer
Injection only from the Schema Browser in the new data explorer
Query ran only using the query builder in the old data explorer
Started in the query builder and switched to script in the old data explorer
Injection only from the Function Browser in the new data explorer
Injection only from either the Schema Browser & Function Browser in the new data explorer
Injection only from both the Schema Browser & Function Browser in the new data explorer
Injection from the Schema Browser and typing in the new data explorer
Injection from the Function Browser and typing in the new data explorer
Injection from both the Schema browser and function browser and typing in the new data explorer
Flux Function Window
What percentage of queries that get run have used function injection?
Number and percentage of queries that have used a function injection in the new data explorer
Number and percentage of queries that have used a function injection in the old data explorer
How often does the function browser/injection get browsed but not injected?
Number and percentage of times that users interact with the flux browser but don’t inject into the script editor in the new data explorer
Number and percentage of times that users interact with the flux browser but don’t inject into the script editor in the old data explorer
What percentage of function searches find a match?
Number and percentage of times users search for a flux function and inject it into the script editor in the new data explorer
Number and percentage of times users search for a flux function and inject it into the script editor in the old data explorer
What flux functions are selected (times each one is selected)?
Number of times each flux function is injected into the script editor in the new data explorer
Number of times each flux function is injected into the script editor in the old data explorer