3.2: User Testing

• User Testing:

  • the process through which the interface and functions of a website, app, product, or service are tested by real users who perform specific tasks in realistic conditions
  • purpose is to evaluate the usability of the website/app and to decide whether it is ready to be launched for real users
• Types of User Testing:

  • Usability testing (UX research)
  • Surveys
  • A/B testing
  • Focus Groups
  • Beta Testing
• A/B Testing:

  • the process by which two different variants of an email are sent to different groups of subscribers
• Purpose of A/B testing

  • leaning as much as possible about customer behavior and preferences
• Focus Groups:

  • a qualitative research technique. consisting of establishing a discussion on a given topic with a group of 8-10 participants, usually for 1-2 hrs
• Beta Testing:

  • aims to finish performance testing and the need to identify problems that cause errors
  • Beta Version: considered a complete version that is not yet ready for the end-user due to lack of tests in real conditions and incorrect errors
• Doing User Testing

  1. Defining a Goal.
  2. Preparing the test object.
  3. Selecting the test method.
  4. Writing a test script.
  5. Recruiting test subjects.
  6. Preparing the site & infrastructure.
  7. Carrying out a test run.
  8. Evaluation & analysis.
• Low-fidelity prototypes:

  • usually used at the very beginning of a project
  • mainly used to validate a first concept or an idea
• High-fidelity Prototypes:

  • are finished websites, apps, or pixel-precise visual designs
  • helpful feedback on visual aspects can also be found here utilizing a user test
  • the more perfected a prototype is, the less it is questioned purely in terms of content
• • A typical test script consists of a warmup, a body, and a cool-down.
  • Takes between 5-10 tasks and usually takes between 30-60 mins.
• Selection:

  • to obtain meaningful and valuable results with a user test; crucial when recruiting the test persons to ensure that they correspond to the actual target group (persona)
• User testing: refers to the emotions, responses, and behaviors of a customers regarding your products from the moment they start using it to the moment they stop
• Usability testing: refers to the way that one of your customers can use your product to accomplish a specific goal/thing that really plays a part in the user experience; does not cover the entire experience
• Prototyping: an experimental process where design teams implement ideas into tangible forms from paper to digital
• Advantages of Prototyping:

  • Have a solid foundation from which to ideate towards improvements
  • Can adapt changes early
  • Show the prototype to your users so they can give feedback to help pinpoint which elements/variants work best and whether an overhaul is required
  • Provide a sense of ownership to all concerned stakeholders
  • Have a tool to experiment with associated parts of the users' needs and problems
  • Improve time-to-market by minimizing the number of errors to correct before product release
• • Prototypes are often used in the final, testing phase in order to determine how users behave with the prototype to reveal new solutions to problems, or to find out whether or not the implemented solutions have been successful.