• The 4 Phases
  • All Methods
    • Phase 1Observation
      • 5 Whys
      • 6 Thinking Hats
      • AEIOU Framework
      • Card Sorting
      • Collage
      • Competitive Analysis
      • Content Audit
      • Contextual Inquiry Plan
      • Crazy Eights
      • Eisenhower Matrix
      • Empathy Map
      • Field Study
      • Focus Groups
      • Future Trends
      • How Might We
      • Hypothesis Testing
      • Jobs-to-be-done (JTBD)
      • Journey Mapping
      • Knowns and Unknowns Framework
      • Lessons Learned
      • Mental Models
      • Mind Mapping
      • Moodboards
      • Mystery Shopping
      • Netnography
      • Observation
      • Personas
      • Poems
      • Poster Session
      • Product Love Letters
      • Stakeholder Map
      • Surveys
      • World Café
      • Worst Possible Ideas
    • Phase 2Creation
      • 6 Thinking Hats
      • 6-3-5 Brainwriting
      • Bodystorming
      • Brainstorming
      • Business Model Canvas (BMC)
      • Card Sorting
      • Challenge Assumptions
      • Click Dummy
      • Collage
      • Could, Should, Must
      • Crazy Eights
      • Dark Horse Prototype
      • Eisenhower Matrix
      • Emotional Journey Map
      • Empathy Map
      • Field Study
      • Focus Groups
      • How Might We
      • Hypothesis Testing
      • Innovation Board
      • Jobs-to-be-done (JTBD)
      • Journey Mapping
      • Knowns and Unknowns Framework
      • Low-Fidelity Prototyping
      • Mental Models
      • Mind Mapping
      • Mobile Diaries
      • Moodboards
      • One-Minute-Pitch
      • Personas
      • Pluralistic Walkthrough
      • Poster Session
      • Product Love Letters
      • Remote Usability Test
      • SCAMPER
      • Service Blueprints
      • Stakeholder Map
      • Storyboards
      • Surveys
      • SWOT Analysis
      • User Testing
      • Value Proposition
      • Walt Disney Method
      • Wizard of Oz
      • World Café
      • Worst Possible Ideas
      • Wow-How-Now Matrix
    • Phase 3Implementation
      • A/B Testing
      • Business Model Canvas (BMC)
      • Could, Should, Must
      • Eye Tracking
      • Golden Circle
      • High-Fidelity Prototype
      • Innovation Board
      • Low-Fidelity Prototyping
      • Mobile Diaries
      • One-Minute-Pitch
      • Pluralistic Walkthrough
      • Product Love Letters
      • Remote Usability Test
      • Service Blueprints
      • Storyboards
      • SWOT Analysis
      • User Interviews
      • User Stories
    • Phase 4Validation
      • A/B Testing
      • Competitive Analysis
      • Concept Testing Plan
      • Contextual Inquiry Plan
      • Eye Tracking
      • HEART Framework
      • High-Fidelity Prototype
      • Hypothesis Testing
      • Innovation Board
      • KPI Tracking
      • One-Minute-Pitch
      • Pluralistic Walkthrough
      • Remote Usability Test
      • SCAMPER
      • Search-Log Analysis
      • Service Blueprints
      • Social Media Monitoring
      • Surveys
      • User Interviews
      • User Stories
      • User Testing
  • Workshop Bundles
  • About us
  • Meet the Creators
  • Get support
  1. UX Toolkit
  2. Methods
  3. A/B Testing
advancedimplementationvalidation
A/B TestingEvaluate which of two versions of a website, product or software works best for the user.
1 – 5 d10+ Participantssoloreviewusers
+2
Open in FigJamOpen in Miro
Summary
If you want to test two or more different expressions (or a part) of a user interface, you can use the A/B Testing method. Some of the users will see version A and some will see version B. After a few users have visited you can evaluate how both versions performed in comparison to each other. There is a variety of tools/resources that help you to carry out the test, as FigPii or trbo.
Step-by-step
  1. Identify your web page's most-traffic-areas. Which functions are particularly popular? Where did User Testing reveal room for improvement?
  2. Create at least two different versions (A, B, C etc.) of one feature, which differ in one or more aspects from each other.
  3. Wait until you got a good amount of impressions (i.e. users have seen it) on all feature variations.
  4. Evaluate the results, e.g. whether one version was used longer or more effectively than the other ones. Then implement the variation that performed best.
  5. If you’re using an A/B Testing software the results will be automatically calculated. This can save time and provide a good overview of all uses.
What you need
  • Version A of software/website
  • Version B of software/website
  • Optional: Maze
  • Optional: playbookux
  • Optional: lookback
External resources
  • A/B Testing 101
    by NNgroup
Do you have a question?
These methods might seem simple, but applying them in a real project is another story. We’re there to help. If you have any questions, do not hesitate to get in touch with us at the User Experience Strategy & Design team.
Ask Away!
Explore similar methods
Bodystormingcreation
2+ Participants
60 – 90 min

Physically experience user scenarios.

Value Propositioncreation
2+ Participants
60 – 90 min

A short statement that convinces the customer to invest in your product by letting him know the product's unique selling point and which problem it solves.

Emotional Journey Mapcreation
1+ Participants
15 – 60 min

This method serves to explore and question the overall experience of users.

Card Sortingobservation
4 – 12 Participants
30 min

Structure information into reasonable groups.

High-Fidelity Prototypeimplementation
5+ Participants
1 – 2 weeks

Create an interactive experience.

© Merck KGaA, Darmstadt, Germany, 2022.
Follow us
  • Dribbble
  • Instagram
  • Medium
  • Behance
Phases
  • Observation
  • Creation
  • Implementation
  • Validation
Learn more
  • About Us
  • User Experience Strategy & Design
  • Liquid Design System
Legal
  • Data Privacy
  • Terms and Conditions
  • Imprint
Follow us
  • Dribbble
  • Instagram
  • Medium
  • Behance
This website uses cookies to give you the best, most relevant experience. Using this website means you’re OK with this. You can change which cookies are set at any time – and find out more about them in our Cookie Policy.