🙅🏽 How To Avoid Bias In UX Research (https://lnkd.in/eVY87iTE), a practical guide with common mistakes that often lead to false insights and skewed results. Neatly put together by Sundar Subramanian. ❌ “Would you recommend [a product] to a friend or colleague?” ✅ “Have you referred [a product] to a friend or colleague this year?” ✅ “Have you discouraged someone from using [a product]? ❌ “What did you like or dislike while using [a product]?” ✅ “Can you describe the last time you used [a product]?” ✅ “What adjectives fit best to describe your experience?” ❌ “Which of these two versions do you prefer, and why?” ✅ “Please complete the following tasks in these 2 versions.” ✅ “Could you describe your experience in both?” ❌ “Have you ever used this feature in [a product]?” ✅ “How do you usually complete this task?” ✅ “What features do you use frequently in [a product]?” ❌ “Do you often need the support of a technical person?” ✅ “What technical issues do you experience frequently?” ✅ “How do you usually manage these technical problems?” ❌ “Choose the most useful features in the alphabetical list below.” ✅ “Choose features that you use often in the randomized list below.” ✅ “Which features do you find confusing in your work?” What people do, say, think and feel are often very different things. Measure completion times and success rates. Beware of interpretations. Often you will be surprised how differently we can interpret things that a customer expressed. So always check and recheck affirmation in different ways. Repeat user’s words to gauge more insights. Play devil’s advocate to your own thoughts and hypothesis. We tend to overemphasize observations from the first and last interviews, so break them down into smaller chunks and randomize their arrangement. Good research is always rooted in the past. So whenever possible, try to frame your questions to past actions, rather than future predictions. Useful resources: How To Ask The Right Questions In UX Research, by Fabricio Teixeira https://lnkd.in/eCBrf_tS UX Research Questions Cheat Sheet, by Krisztina Szerovay https://lnkd.in/eUYSPX8g UX Research Guides, and How To Ask Them Maze: https://lnkd.in/e_-R7-fY UserInterviews: https://lnkd.in/eXSf43Qz Confirmation Bias in UX, by Jennifer Junge (attached visual) https://lnkd.in/etRY9azG How To Avoid Bias in UX research, by Genís Frigola https://lnkd.in/eG8atWHw Overcoming Cognitive Bias in User Research, by Adam Kiryk https://lnkd.in/eb5uVxqW How To Prevent Bias in UX Research, by Lizzy Burnam 🐞 https://lnkd.in/eviNcrT7 Research Questions Are Not Interview Questions, by Erika Hall https://lnkd.in/ef_8jNgU #ux #design #research
If we are developing prototypes for the general populace, we should go to supermarkets, museums, the local park, the mall... Talk to disabled people, to busy mums, to exhausted dads after work, to shopkeepers waiting for customers. It's exhausting the first few tries as courage needs to be summoned. We can go easy at the start and ramp up when we feel more confident. I even have Zoom calls with an overseas customer. Only do not make guesses in front of the monitor! 😊
Excellent points, as always Vitaly Friedman! Unfortunately UX budgets have gone very far south, and with UX people very much overworked - there is absolutely zero appreciation, interest and energy for correct insights in large public companies come 2024 I'm afraid. Especially when workloads have tripled and key staff laid off. On top of that, many teams' "UX" strategists also happen to be their scrum masters, handy with LucidCharts or similar diagramming tools! Test subjects and moderators are nowhere to be found too, unless you count Cypress automated tests as such (!)
I think there's a useful technique to help reduce bias. Go meet actual, living, breathing users 😊 Works everytime! 👍🏾
Thanks so much for sharing my sketch Vitaly, great summary 👏
Haha I love that the first point crossed out is basically NPS. Totally agree - this is a widely used metric but sadly not very helpful.
Stumbled across this post in a search and, I'm not in UX but love that this can apply to almost anything where you are trying to establish or gather qualitative information.
This is really helpful.. Thanks for sharing.
Hey, this is great
How do you think cultural variations might affect the interpretation of user feedback in global products? It seems crucial to understand not just what users do, but also why they do it, which might be deeply influenced by their cultural background.