• The 4 Phases
    • All Methods
    • Phase 1Observation
      • 5 Whys
      • 6 Thinking Hats
      • AEIOU Framework
      • Card Sorting
      • Content Audit
      • Contextual Inquiry Plan
      • Crazy Eights
      • Empathy Map
      • Focus Groups
      • Future Trends
      • How Might We
      • Hypothesis Testing
      • Jobs-to-be-done (JTBD)
      • Journey Mapping
      • Lessons Learned
      • Mind Mapping
      • Moodboards
      • Mystery Shopping
      • Netnography
      • Observation
      • Personas
      • Poems
      • Poster Session
      • Product Love Letters
      • Stakeholder Map
      • Surveys
      • World Café
    • Phase 2Creation
      • 6 Thinking Hats
      • 6-3-5 Brainwriting
      • Bodystorming
      • Brainstorming
      • Business Model Canvas (BMC)
      • Card Sorting
      • Challenge Assumptions
      • Click Dummy
      • Could, Should, Must
      • Crazy Eights
      • Dark Horse Prototype
      • Emotional Journey Map
      • Empathy Map
      • Focus Groups
      • How Might We
      • Hypothesis Testing
      • Innovation Board
      • Jobs-to-be-done (JTBD)
      • Journey Mapping
      • Low-Fidelity Prototyping
      • Mind Mapping
      • Mobile Diaries
      • Moodboards
      • Personas
      • Poster Session
      • Product Love Letters
      • SCAMPER
      • Stakeholder Map
      • Storyboards
      • Surveys
      • SWOT Analysis
      • User Testing
      • Value Proposition
      • Wizard of Oz
      • World Café
    • Phase 3Implementation
      • A/B Testing
      • Business Model Canvas (BMC)
      • Could, Should, Must
      • Innovation Board
      • Low-Fidelity Prototyping
      • Mobile Diaries
      • Product Love Letters
      • Storyboards
      • SWOT Analysis
      • User Interviews
      • User Stories
    • Phase 4Validation
      • A/B Testing
      • Concept Testing Plan
      • Contextual Inquiry Plan
      • Hypothesis Testing
      • Innovation Board
      • KPI Tracking
      • SCAMPER
      • Surveys
      • User Interviews
      • User Stories
      • User Testing
    • About us
  • UXSD Team
  • Liquid Design System
  1. UX Toolkit
  2. Methods
  3. A/B Testing
advancedimplementationvalidation
A/B TestingEvaluate which of two versions of a website, product or software works best for the user.
1 - 5 d10+ Participantssoloreviewusers
+2
DOWNLOAD FILES
INTERNAL ONLY
Summary
If you want to test two or more different expressions (or a part) of a user interface, you can use the A/B Testing method. Some of the users will see version A and some will see version B. After a few users have visited you can evaluate how both versions performed in comparison to each other. There is a variety of tools/resources that help you to carry out the test, as FigPii or trbo.
Step-by-step
  1. Identify your web page's most-traffic-areas. Which functions are particularly popular? Where did User Testing reveal room for improvement?
  2. Create at least two different versions (A, B, C etc.) of one feature, which differ in one or more aspects from each other.
  3. Wait until you got a good amount of impressions (i.e. users have seen it) on all feature variations.
  4. Evaluate the results, e.g. whether one version was used longer or more effectively than the other ones. Then implement the variation that performed best.
  5. If you’re using an A/B Testing software the results will be automatically calculated. This can save time and provide a good overview of all uses.
What you need
  • Version A of software/website
  • Version B of software/website
  • Optional: Maze
  • Optional: playbookux
  • Optional: lookback
External resources
  • A/B Testing 101
    by NNgroup
Do you have a question?
These methods might seem simple, but applying them in a real project is another story. We’re there to help. If you have any questions, do not hesitate to get in touch with us at the User Experience Strategy & Design team.
Ask Away!
Explore similar methods
6 Thinking Hatsobservation
6+ Participants
45 - 90 min

Spot quality ideas after having generated a good amount of output.

Future Trendsobservation
2+ Participants
45 - 90 min

Discuss and assess topics that may become trends in the future.

Mystery Shoppingobservation
5+ Participants
3 h - 2 d

Observe people having a shopping experience in a store while observing and understanding their behaviour.

Stakeholder Mapobservation
1+ Participants
4 - 8 h

Understand who can influence the product or could be affected by it.

Personasobservation
1+ Participants
30 - 90 min

Get to know the target group and have a foundation for future decisions.

© Merck KGaA, Darmstadt, Germany, 2021.
Follow us
  • Dribbble
  • Instagram
  • Medium
  • Behance
Phases
  • Observation
  • Creation
  • Implementation
  • Validation
Learn more
  • About Us
  • User Experience Strategy & Design
  • Liquid Design System
Legal
  • Data Privacy
  • Terms and Conditions
  • Imprint
Follow us
  • Dribbble
  • Instagram
  • Medium
  • Behance
This website uses cookies to give you the best, most relevant experience. Using this website means you’re OK with this. You can change which cookies are set at any time – and find out more about them in our Cookie Policy.