The Combined Walkthrough: Measuring Behavioral, Affective, and Cognitive Information in Usability Testing
Timo Partala and Riitta Kangaskorte
Journal of Usability Studies, Volume 5, Issue 1, Nov 2009, pp. 21 - 33
Abstract
This paper describes an experiment in studying users’ behavior, emotions, and cognitive processes in single usability testing sessions using an experimental method called the combined walkthrough. The users’ behavior was studied using task times and completion rates, and emotions were studied using bipolar scales for experienced valence and arousal. Cognition was studied after each task by revisiting detected usability problems together with the users and applying an interactive method based on cognitive walkthrough to each usability problem. An interactive media application was tested with 16 participants using these methods. The results of the experiment showed that the developed methods were efficient in identifying usability problems and measuring the different aspects of interaction, which enabled the researchers to obtain a more multifaceted view of the users’ interaction with the system and the nature of the problems encountered.
Practitioner’s Take Away
The following were the main findings of this experiment:
- Behavioral, affective, and cognitive aspects of computer system usage can be cost-effectively studied together in usability testing.
- The information obtained by the behavioral, affective, and cognitive measurements can contribute to a more multifaceted understanding of user interaction with the system.
- Variations in the users’ emotional experiences (valence and arousal) related to completing a task using an interactive system can be efficiently measured using bipolar scales. Systematic measurement of emotional experiences broadens the scope of subjective measures beyond traditional satisfaction measures.
- The use of highly positive or negative media elements influences overall ratings of task-related affective experiences in interactive media applications.
- Ideas underlying the cognitive walkthrough can be useful in retrospective analysis of usability problems together with the user.
Article Contents
Download Article