sourcegraph / sourcegraph-public-snapshot

Code AI platform with Code Search & Cody
https://sourcegraph.com
Other
10.1k stars 1.27k forks source link

UX: Simple .com home page (CTA improvements) (Iteration 2) #44608

Closed almeidapaulooliveira closed 1 year ago

almeidapaulooliveira commented 1 year ago

This is the second iteration of this design issue:

Define

We removed a ton of noise below the search bar that was getting in the way of devs using Sourcegraph. The new design intends to provide better syntax guidance and search examples, and we'll be tracking interactions and continuing to iterate on what's working best.

We ran unmoderated usability tests with eight participants on sourcegraph.com with the new home fully implemented and here what we discover:

Seven out of eight users could quickly find the About and Docs pages and learn about our product and company. All participants got the right idea of Sourcegraph after interacting with the product. We've found that the code search basics and query examples are really helpful for first-time visitors. Five participants couldn't perceive the signup CTA; they didn't see it and couldn't access the signup page. Three others partially succeeded but were confused by the purpose of the signup.

Full report here.

Problem statement: Our success rate was 63% for validating if the search query basics and examples on the homepage are helpful and 19% for validating if the 'pro tip' CTA communicates his value proposition. Although 63% is a positive result, the tab component can sometimes make it hard to use. We could improve it by showing code search basics and query examples on the same screen. 19% is a pretty low rate. We could increase signups by making the CTA on the home page more prominent. In addition, the message should be clear and straightforward.

Design

Testing

We had a 19% success rate on this CTA; what do we want to reach now? Above 40%? Above 60%? Above 80%? Our SMART goal will be based on the desired success rate.

Measure

Design process (Size: XS)

almeidapaulooliveira commented 1 year ago

@taylorsperry - In this issue, I have opened a second iteration for the actionable items from the research.