Qualzy Blog

What does psychology say about qualitative research via webcam?

If you've experienced online qualitative research via webcam, you'll know the familiar disadvantages: weaker rapport, lost body language, lower participant motivation. But based on an academic review of the psychology literature, the science suggests the issues go further than that.

Person on a video call via laptop webcam

If you have experienced online qualitative research via webcam, then you will already know of its disadvantages compared to face-to-face methods. They include weaker rapport, a loss of body language and less participant motivation. In fact, based on my recent academic review of the topic, the science suggests that the issues go further than that.

I commissioned an academic review of psychology literature in relation to online qual. One of the interesting things I learned is that if not carefully managed, qualitative research via webcam can impact how participants process the stimuli that the moderator shares with them — and therefore could result in less meaningful feedback.

In this article, I'm sharing one of the papers that I found particularly interesting.

People process information differently via webcam

A psychology experiment by Ferran and Watts compared how people react to ideas that are presented to them in face-to-face and online webcam settings. Participants in both conditions were asked to assess dimensions such as the perceived quality of ideas, how easy it was to follow and how likeable the speaker was. The study involved 143 participants' experiences of one of 19 different events, in either a face-to-face or webcam context. The results were striking.

People will judge the speaker more than the ideas via webcam

People in the webcam group were more influenced by how much they liked the speaker than by the perceived quality of the information being presented. Whereas people in the face-to-face group were more influenced by the perceived quality of information than the likeability of the person sharing it. People also found it harder to follow what was being shared via webcam compared to face-to-face.

This has implications for online qualitative researchers. As moderators, we need to design research in which the concepts being tested are evaluated on their merits, rather than superficial distractions such as how likeable the moderator seems.

The greater cognitive load imposed by webcam encourages more superficial responses

The findings in the study were explained by the Heuristic Systematic Model (HSM) of information processing. This theory suggests that people get more distracted in the webcam group as it imposes a greater cognitive workload — that is, greater mental effort — compared to people in the face-to-face group. For example, it's harder for them to know when it's their turn to speak via webcam, there are fewer social cues available, and there are more distractions.

The greater cognitive workload in webcam discussions means participants are less likely to evaluate concepts on their merits, which would require a more mentally taxing and meaningful 'systematic processing'. Instead they resort to more automatic, lower-effort 'heuristic processing'.

Webcam encourages more biased reactions to concepts being shared

In this automatic mode, the likeability of the person sharing information has more influence over participants' reactions than the perceived quality of the ideas themselves. They are more likely to employ a bias towards the speaker in the webcam setting because they do not have the mental space to fully engage with the ideas themselves.

For concept testing and stimulus evaluation in particular, this is a meaningful challenge. It suggests that the medium itself can systematically skew participant reactions in ways that researchers may not be accounting for — and that design choices (structuring turn-taking clearly, reducing moderator presence during stimulus review, using asynchronous formats) can help to mitigate the effect.

Reference

Carlos Ferran, Stephanie Watts (2008). Videoconferencing in the Field: A Heuristic Processing Model. Management Science 54(9):1565–1578.

TW
About the author
Tom Woodnutt

Tom Woodnutt is the multi-award winning Founder of Feeling Mutual, the agile online and mobile qualitative research specialists. An early pioneer of online qualitative research, Tom has spent years examining the psychology of how people engage with research in digital environments.

View LinkedIn profile →
See it in practice

Async research — designed to work the way psychology says it should

Participants respond in their own time, without the cognitive overload of managing a live video call. Better conditions for more considered responses.