Conducting User Experience Research

Five main steps for conducting UX research.

 

The first two steps are about forming questions and hypotheses, and the last three steps are about gathering knowledge through selected UX research methods.

1. What are the knowledge gaps we need to fill?
2. Hypotheses.What do we think we understand about our users?
3. Based on time and manpower, what methods should we select?
4. Gather data through the selected methods.
5. Fill in the knowledge gaps, prove or disprove our hypotheses, and discover opportunities for our design efforts.

 

It's really hard to design products by (User) groups. Alot of times, people don't know what they want until you show them. – Steve Jobs

 

The Role Of Research In The User Experience Design Process

 

UX research is the starting point for a project. Research helps us learn about the users and their behavior, goals, motivations, and needs. It also shows us how they currently navigate a system, where they have problems and, most importantly, how they feelwhen interacting with our product.

UX research comes first in the UX design process because without it, our work can only be based on our own experiences and assumptions, which is not objective. As Neil Turner, founder of UX for the Masses told us, a good foundation is key to successful design:

 

Good user research is key to designing a great user experience. Designing without good user research is like building a house without solid foundations—your design will soon start to crumble and eventually fall apart.

 

 

The Value of User Experience Research

In the current digital product landscape, the real value of UX research is its ability to reduce uncertainty in terms of what users want and need, which yields benefits for the product, the business, and the users themselves.

Product Benefits

UX research provides data about the end user of the product, how and when the user will use the product, and the main problems the product will solve. UX research is also helpful when a team has to decide between multiple design solutions.

Business Benefits

UX research brings a lot of a value to businesses. By knowing the end users and incorporating design requirements upfront, businesses can speed up the product development process, eliminate redesign costs, and increase user satisfaction.

User Benefits

One of the greatest values of user experience research is that it’s unbiased user feedback. Simply put, UX research speaks the user’s thoughts—without any influence from outside authority. It also serves as a bridge between users and the company.

 

User experience research provides powerful insights that allow companies to humanize their customers and insert their needs, intentions, and behaviors into the design and development process. In turn, these insights enable companies to create experiences that meet—and sometimes exceed—customer needs and expectations. User experience research should be conducted well before the first sketch is drawn and integrated throughout the concept, iterative design, and launch phases of a product. - Janelle Estes, Director of Research Strategy

 

User Experience Research Methods: User Groups

User groups—also called “focus group discussions” or “focus groups”—are structured interviews that quickly and inexpensively reveal the desires, experiences, and attitudes of a target audience. User groups are a helpful user experience research method when a company needs a lot of insight in a short amount of time. If you are unsure when to use a user experience research method, user groups can be a good one to start with.

 

Why Do We Conduct User Groups?

User groups can help your company better understand:

1) How users perceive a product

2) What users believe are a product’s most important features

3) What problems users experience with the product

4) Where users feel the product fails to meet expectations

User groups can also be used to generate ideas of what users want to see in the future.

What people say and what people do are often very different, therefore user groups do not provide an accurate measurement of behavior. And because user groups are conducted with more than one user at a time, participants may influence each other’s opinions and preferences (aka “groupthink”), thus introducing bias and producing inaccurate data.

 

Best Practices

Getting the most out of your user group is straightforward if you follow the following best practices when conducting this particular user research technique.

1. Ask Good Questions.Make sure your questions are clear, open-ended, and focused on the topics you’re investigating.
2. Choose a Few Topics.On average, plan to discuss 3-5 topics during a 90-minute focus group.
3. Include the Right Amount of People. A good focus group should include 3-6 users—large enough to include a variety of perspectives, but small enough so everyone has a chance to speak.

 

 

Conducting user research allows you to dive deep beneath the surface of what your users say they want, to instead uncover what they actually need. It’s the key to ensuring that your products and features will actually solve the problems that your clients face on a day to day basis. User research is imperative if you want to create a successful, habit forming product. - Jennifer Aldrich, UX and Content Strategist

 

How To Conduct User Experience Research With User Groups

Conducting user groups can be broken down into a few major steps:

1. Create a schedule that provides enough time for recruiting, testing, analyzing, and integrating results.
2. Assemble your team, and establish roles: choose a moderator, note-taker, and discussion leader.
3. Define the scope of your research: what questions will you ask? And how in depth do you want to explore the answers? This will determine the number of people and the number of groups that need to be tested.
4. Create a discussion guide that includes 3-5 topics for discussion.
5. Recruit potential or existing users who are likely to provide good feedback.
6. Conduct user group testing, and record data.
7. Analyze and report findings.

 

User Experience Research Methods: Usability Testing

According to the usability.gov website, usability testing refers to “evaluating a product or service by testing it with representative users.” During a test, participants will be asked to complete specific tasks while one or more observers watch, listen, and record notes. The main goal of this user experience testing method is to identify usability problems, collect qualitative data, and determine participants’ overall satisfaction with the product.

 

Why Do We Perform Usability Testing?

Usability testing helps identify problems before they are coded. When development issues are identified early on, it is typically less expensive to fix them. Usability testing also reveals how satisfied users are with the product , as well as what changes are required to improve user satisfaction and performance.

Unfortunately, usability testing is not 100% representative of the real life scenario in which a user will engage with your product. Also, because the data is qualitative, this kind of ux testing method doesn’t provide the large samples of feedback a questionnaire might. The good news it that the qualitative feedback you receive can be far more accurate and insightful.

 

Best Practices

1. Test with Five Users.Testing five users is typically enough to identify a design’s most important usability problems.
2. Invite Your Team to the Testing Sessions.Anyone who is involved with how fast and how well problems are addressed should be invited to the usability testing sessions. These stakeholders may include the executive team, and lead developers or designers.
3. Keep the Findings Brief and To-The-Point.When you report the findings of a usability test, limit the comments to the ones that are really important. One good rule of thumb is to include the top three positive comments and the top three problems. The overall report should be no more than approximately 50 comments and 30 pages.

 

How to Conduct UX Research with Usability Testing

Usability testing can be broken down into a few major steps:

1. Identify what needs to be tested and why (e.g. a new product, feature, etc.)
2. Identify the target audience (or your desired customers).
3. Create a list of tasks for the participants to work through.
4. Recruit the right participants for the test.
5. Involve the right stakeholders.
6. Apply what you learn.

 

One of usability’s most hard-earned lessons is that ‘you are not the user.’ If you work on a development project, you’re atypical by definition. Design to optimize the user experience for outsiders, not insiders. –Jakob Nielsen

 

User Experience Research Methods: Interviews

A well-known user experience methodology is an interview. An interview is a user experience research method used to discover the attitudes, beliefs, and experiences of users (and potential users) of a product. Interviews are typically conducted by one interviewer speaking to one user at a time for 30 minutes to an hour. Interviews can take place face-to-face, over the phone, or via video streaming.

Why Do We Conduct Interviews?

Of all the user experience design methods, interviews are typically conducted at the beginning of the product development cycle when reviewing product goals. Because of the one-to-one nature of the interview, individual concerns and misunderstandings can be directly addressed and cleared up.

Face-to-face interviews also allow you to capture verbal and nonverbal cues, such as emotions and body language, which may identify enthusiasm for the product or discomfort with the questions.

When thinking about what research methodology to use, bear in mind that interviews are also a good supplement to online surveys: conducting an interview beforehand helps you refine questions for the survey, while conducting an interview afterwards allows you to gain explanations for survey answers.

There are a few drawbacks, however. First, because interviews require a team of people to conduct them, personnel costs are usually difficult to keep low. Sample size is also limited to the size of the interviewing staff.

Best Practices

1. Hire a skilled interviewer.A skilled interviewer asks questions in a neutral manner, listens well, makes users feel comfortable, and knows when and how to probe for more details.
2. Create a discussion guide.Write up a discussion guide (or an interview protocol) for all interviewers to follow. This guide should include questions and follow-up questions.
3. Get informed consent.Before conducting the interview, make sure to get permission or consent to record the session. It’s also good to have one or two note takers on hand.

 

How To Conduct User Experience Research With Interviews

Conducting an interview can be broken down into a few major steps:

1. Prepare a discussion guide, or a list of questions to ask participants.
2. Select a recording method (e.g. written notes, tape recorder, video).
3. Conduct at least one trialrun of the interview.
4. Recruit the right participants for the interview.
5. Conduct the interview.
6. Analyze and report the results.

 

Curiosity is a natural outcome of caring, and it is the single greatest contributor to effective user research … Caring and curiosity engender personal investment, and investment motivates a researcher to develop a deep understanding of users. – Demetrius Madrigal

 

User Experience Research Methods: Online Surveys

A survey is a research tool that typically includes a set of questions used to find out the preferences, attitudes, and opinions of your users on a given topic. Today, surveys are generally conducted online and in various lengths and formats. Data collected from surveys is received automatically, and the survey tool selected generally provides some level of analysis, the data from which can then be used for user experience studies further down the line to inform your product.

 

It is so important to avoid using leading questions when it comes to surveys. It’s a common mistake that many people make. For example phrasing a question like - What do you dislike about Uber? Assumes the user has a negative preference for the service off the bat. A more neutral phrase would be - Tell us about your experience getting around town. - this elicits more natural user feedback and behavior instead of forcing them down a funnel. - Tip from a UX Beginner

 

Why Do We Conduct Online Surveys?

Unlike traditional surveys, online surveys enable companies to quickly collect data from a broad (and sometimes remote) audience for free—or a low price. Surveys also help you discover who your users are , what your users want to accomplish, and what information your users are looking for.

Unfortunately, what users say versus what they do are two different things and can often yield inaccurate results. Furthermore, poorly worded questions can negatively influence how users respond. Length can also be an issue—many people hate taking long surveys. This is why it’s important to create short surveys so users are more likely to complete them and participate in future research efforts.

 

Best Practice

1. Keep it short.Keep your surveys brief, especially if participants will be compensated little or not at all. Only focus on what is truly important.
2. Keep it simple.Make sure questions can be easily understood: ambiguous or complex wording can make questions more difficult to understand, which can bring the data into question.
3. Keep it engaging.Include a mix of both multiple choice questions and open-ended questions (or questions in which users complete the answer).

 

How To Conduct User Experience Research With Online Surveys

Conducting an online survey can be broken down into a few major steps:

1. Identify goals and objectives of the survey.
2. Create survey questions.

Note: Consider collecting information about how satisfied users are with your product, what users like/dislike, and if they have suggestions for improvement.

1. Select an online survey tool (e.g. SurveyMonkey, Qualtrics).
2. Recruit participants.
3. Conduct the survey.
4. Analyze and report the results.

 

We have to arm ourselves with data, research … and a clear understanding of our users so our decisions are not made out of fear but out of real, actionable information. Although our clients may not have articulated reasons for why they want what they want, it is our responsibility to have an ironclad rationale to support our design decisions.– Debra Levin Gelman

 

User Experience Research Methods: User Personas

A user persona is a fictional representation of your ideal customer. A persona is generally based on user research and includes the needs, goals, and observed behavior patterns of your target audience.

 

Why Do We Create User Personas?

Whether you’re developing a smartphone app or a mobile-responsive website, any user experience research job will require you to understand who will be using the product. Knowing your audience will help influence the features and design elements you choose, thus making your product more useful. A persona clarifies who is in your target audience by answering the following questions:

1. Who is my ideal customer?
2. What are the current behavior patterns of my users?
3. What are the needs and goals of my users?

Understanding the needs of your users is vital to developing a successful product. Well-defined personas will enable you to efficiently identify and communicate user needs. Personas will also help you describe the individuals who use your product, which is essential to your overall value proposition.

Unfortunately, creating personas can be expensive—it all depends on how deep into user research your organization is willing to go. There is also no real “scientific logic” behind persona building, which makes some people a little more hesitant to accept them.

 

Best Practices

1. Create a well-defined user persona.A great persona contains four key pieces of information: header, demographic profile, end goal(s), scenario. (For more details on how to create a persona, click here.)
2. Keep personas brief.As a rule of thumb, avoid adding extra details that cannot be used to influence the design. If it does not affect the final design or help make any decisions easier: omit it.
3. Make personas specific and realistic.Avoid exaggerated caricatures, and include enough detail to help you find real-life representation.

 

How To Conduct User Experience Research By Creating Personas

Creating user personas can be broken down into these main steps:

1. Discuss and identify who your target users are with stakeholders (e.g. ux team, marketing team, product manager).
2. Survey and/or interview real users to get their demographic information, pain points, and preferences.
3. Condense the research, and look for themes to define your groups.
4. Organize your groups into personas.
5. Test your personas.

 

Be someone else. It takes great empathy to create a good experience. To create relevant experiences, you have to forget everything you know and design for others. Align with the expected patience, level of interest, and depth of knowledge of your users. Talk in the user’s language. – Niko Nyman

Conclusion

Overall, the purpose of user experience research is simple: to discover patterns and reveal unknown insights and preferences from the people who use your product. It basically provides the context for our design. Research also helps us fight the tendency to design for ourselves (or our stakeholders)—and returns the focus on designing for the user.

 

(User experience research) is the work that uncovers and articulates the needs of individuals and/or groups in order to inform the design of products and services in a structured manner. —Nick Remis, Adaptive Path

(User experience research) is the work that uncovers and articulates the needs of individuals and/or groups in order to inform the design of products and services in a structured manner.

—Nick Remis, Adaptive Path