search

BitcoinDesign / Meta

Discussions around the processes and coordination of the Bitcoin Design Community
207 stars 20 forks source link

Conduct a Bitcoin Design Guide survey #320

Closed Bosch-0 closed 1 year ago

Bosch-0 commented 2 years ago

Now that the Bitcoin Design community is almost 3 years old and we have the Bitcoin Design Guide in pretty good shape (for mobile lightning wallets anyways) I was thinking it would be worthwhile to conduct a survey with the community to uncover a few things:

I recommending doing this anonymously and collecting no personal information (or have that optionally opt-in only) to stick with our ethos.

I was thinking we keep focused on the guide for this initial survey but also would see some value in doing a community survey later on which discusses the more meta points of Bitcoin Design, thoughts?

moneyball commented 2 years ago

Two years old😁

On Sat, Jun 18, 2022 at 12:37 AM bosch @.***> wrote:

Now that the Bitcoin Design community is almost 3 years old and we have the Bitcoin Design Guide in pretty good shape (for mobile lightning wallets anyways) I was thinking it would be worthwhile to conduct a survey with the community to uncover a few things:

  • What could we do better with the guides current content?
  • Have you applied or found the guides content useful, is so what and how?
  • Have you found anything in the guide you dislike?
  • Have you contributed to the guide? If so, why? Was the barrier to entry too high? What could we do better?
  • What new content would you like to see in the guide?
  • Other ideas, nothing is too crazy!

I recommending doing this anonymously and collecting no personal information (or have that optionally opt-in only) to stick with our ethos.

I was thinking we keep focused on the guide for this initial survey but also would see some value in doing a community survey later on which discusses the more meta points of Bitcoin Design, thoughts?

— Reply to this email directly, view it on GitHub https://github.com/BitcoinDesign/Meta/issues/320, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACPUA5OQXVWBHGKOA5VTWTVPV4ENANCNFSM5ZELI3JQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

mouxdesign commented 2 years ago

@Bosch-0 Love this initiative! And it follows 100% about putting the users first which is what good UX design is all about. We can only know what users really want by getting closer to them and by speaking with them.

If I were to take this one step further I think actually speaking to projects that used the design guide in their product development process would be also super practical, allowing them to feely express themselves and collect some qualitative data.

Do you guys know of any projects/companies/Foss projects that have directly mentioned that they are using/use the bitcoin design guide? I'll name some that I know of here:

  1. Alby
  2. Cashapp

Idea...could the survey be perhaps focused on quantitative data, some examples of quantitative questions are:

  1. How many times per week do you use the bitcoin design guide?

  2. How many projects have you built where you directly used the bitcoin deign guide for advice/guidance?

I would like to add on some more questions and would be more than happy to analyze the data we collect together with you and anyone else.

Qualitative questions: (we could ask by interviewing) This open conversation will also allow the people talking to say and express things abut the guide that we may not have thought about ourselves.....

  1. What could we do better with the guides current content?

  2. Have you applied or found the guides content useful, is so what and how?

  3. Have you found anything in the guide you dislike?

  4. Have you contributed to the guide? If so, why? Was the barrier to entry too high? What could we do better?

  5. What new content would you like to see in the guide?

  6. Other ideas, nothing is too crazy!

We can create a simple Googledoc with a list of these qualitative and quantitative questions.

mouxdesign commented 2 years ago

Google doc Feel free to comment/suggest!

Goal

The bitcoin design guide was established 2 years ago with the goal of helping builders build more intuitive and accessible products. We would like to understand if we are achieving this goal as well as what we can do make the guide more valuable.

We would like to create more user driven content and value. To do this we must get closer to users as we continue to develop the guide.

We would like to understand:

A combination of both qualitative as well as quantitative research techniques can be used to collect an in depth overview. Below is a rough collection of both types of questions which can be used to collect data to drive future decisions.

Qualitative:

Quantitative:

How often do you use the bitcoin design guide?

Have you contributed to the guide?

Do you know how to contribute to the bitcoin design guide?

How many projects have you built where you directly used the bitcoin design guide for advice/guidance?

How regularly do you have questions during your product development process that you seek answers to?

GBKS commented 2 years ago

Great idea. As Mo suggested, I would couple this with direct conversations with project contributors. A survey can cast a broad net, but is standardized by necessity. In a 1-1 conversation, you can directly discuss the specific needs of the designer and project and have a bit of a back and forth.

It would be helpful to know a few facts about the respondent to better understand their answers, like what type of product they are working on, how experienced they are, etc. We could also ask how they go about solving design problems when they cannot find information in the guide.

mouxdesign commented 2 years ago

Some very good points from Christoph. I've updated the google doc to include;

Added in qualitative question; How do you solve design problems when you are unable to find the information in the guide?

Some additional questions to ask ourselves:

  1. Would we like to record the interviews if the people interviewed are comfortable with that, an audio recording could work as well.
  2. The interviews can also be done with 2 people, one asking questions and the other taking notes, this then negating the need for it to be recorded.

We can then:

Bosch-0 commented 2 years ago

Do you guys know of any projects/companies/Foss projects that have directly mentioned that they are using/use the bitcoin design guide? I'll name some that I know of here:

This is what I was hoping to unearth with the Survey initially. We can craft the survey in a way that starts with simple yes / no questions that then drives what questions follows. One being have you used the guide to build something. If no, it would go down a more general community path. If yes, it would go down a path focused more on the guides content.

could the survey be perhaps focused on quantitative data

If we frame the questions right I think we can get both quant and qual data from responses. Once we find out projects who have used the guide we should follow up with 1 on 1's for more in-depth answers.

Cam across this survey tool that claims to be private, secure, and anonymous - maybe a good candidate to checkout for this: https://blocksurvey.io/. They seem to like bitcoin also!

Bosch-0 commented 2 years ago

Created a Figjam file we can visually layout the survey on. Find these easier to plan things. Started with what we have now, feel free to add / change / comment.

https://www.figma.com/file/yVjOTCOli1GRWgmK0hqeF2/Untitled?node-id=0%3A1

mouxdesign commented 2 years ago

@Bosch-0 and I had a great session this morning and worked on refining the strategy and the questions for the initial survey.

Below is an idea of the process that we have in mind:

Copy of Project (part 3) (5)

Link to refined questions

We also thought about understanding:

  1. What the role is of the users using the bitcoin design guide
  2. Which stage they are at in the product development process. (if they are builders).


This would allow us to understand more interms of what kind of content we could be focusing on depending on where they are in the build process.

We also left options open to find out what all the possibilities are for non-builders using the guide and what content is relevent for them.

Next steps @bosch and I will now be working on the following:

  1. Creating an image to be used to be posted with the call for participants on the various channels
  2. Create figma flow of the survey questions
  3. Create the survey questions in Typeform
mouxdesign commented 2 years ago

@Bosch-0 Has Created the survey here using Google survey and I have created a Readme file version of the survey upon the suggestion from Christoph for survey takers who might not want to use Google Survey.

Survey

https://github.com/UXResearchBitcoin/BitcoinDesignGuideSurvey

To do: Still to add in some images and send out the initial survey to the core team for some feedback, almost there!

mouxdesign commented 2 years ago

Quick update. @Bosch-0 have started doing interviews. We have done 3 so far and Bosch is currently reaching out to people and setting up more calls.

Google doc List

mouxdesign commented 2 years ago

Started to go through the interview videos and take notes.

Will eventually summarize these in the form of a report.

mouxdesign commented 2 years ago

Have gone through all of the interviews and updated the notes. Will not look for some insights in the interviews and create that in the form of a report.

mouxdesign commented 1 year ago

BDG Research Summary

It's a wrap! Took all the content of the research and summarized it into 3 different ways.

The Google doc contains all the extensive direct quotes from people we interviewed. While the PDF is a slightly more extended version and the Video the most succinct.

sbddesign commented 1 year ago

@mouxdesign, I have reviewed. Looks great. I have some typos I found and some typographical nitpicks. But content-wise, I think it's ready to distribute broadly.

mouxdesign commented 1 year ago

Thanks for commenting on the video @sbddesign. Stephen, have made some corrections based on your suggestions. Would appreciate another review just to see if all text is good now.

Video

Also made corrections to the pdf, it is also ready for another review. PDF

sbddesign commented 1 year ago

@mouxdesign When I look at the video link, I still see a bunch of typos. I left comments on them just in-case.

PDF looks great! My only nitpicky comment is that on page 10, "Naming conventions" and "Bullet lists" should be title-cased to match the title-casing on the other "Quotes" pages.

sbddesign commented 1 year ago

@mouxdesign Reviewed the video link you sent me out of band, LGTM.

mouxdesign commented 1 year ago

Thanks @sbddesign

Adding in the updated links

GBKS commented 1 year ago

Should we close this issue? If so, do we want to link to this survey from anywhere so it doesn't complete disappear into the void? There is a paragraph about "Identifying what to fix" in the contribute section of the guide where this could be referenced? It could also be a nice reference for the research kit.

mouxdesign commented 1 year ago

Agree with closing this issue. Also good to link it to the section Identifying what to fix. Some text could be: The community has done some research on the Bitcoin Design guide, here's what we discovered. Or something along those lines.

GBKS commented 1 year ago

I created a pull request to add that link. Please take a look and then we can close this issue.

GBKS commented 1 year ago

Alright, that PR is merged so I'm going to close this issue now. We could do another one of these surveys at some point. Anecdotally, I heard from lots of people at BTC Prague that they are familiar with the guide and they like/love it.