Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies

Lene Nielsen; Joni Salminen; Soon Gyo Jung; Bernard J. Jansen

doi:10.1007/978-3-030-85607-6_67

Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies

Lene Nielsen^*, Joni Salminen, Soon Gyo Jung, Bernard J. Jansen

^*Corresponding author for this work

Qatar Computing Research Institute

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method. We coin the phrase “think-aloud survey method”, where participants think-aloud while completing a questionnaire. We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants’ Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design. The think- aloud survey method further offers other insights into usability issues and encourages the participants to provide system improvement proposals. The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice.

Original language	English
Title of host publication	Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings
Editors	Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, Kori Inkpen
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	504-508
Number of pages	5
ISBN (Print)	9783030856069
DOIs	https://doi.org/10.1007/978-3-030-85607-6_67
Publication status	Published - 2021
Event	18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021 - Virtual, Online Duration: 30 Aug 2021 → 3 Sept 2021

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12936 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021
City	Virtual, Online
Period	30/08/21 → 3/09/21

Keywords

Interface design
Surveys
Tests

Access to Document

10.1007/978-3-030-85607-6_67

Cite this

Nielsen, L., Salminen, J., Jung, S. G., & Jansen, B. J. (2021). Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies. In C. Ardito, R. Lanzilotti, A. Malizia, A. Malizia, H. Petrie, A. Piccinno, G. Desolda, & K. Inkpen (Eds.), Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings (pp. 504-508). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12936 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-85607-6_67

Nielsen, Lene ; Salminen, Joni ; Jung, Soon Gyo et al. / Think-Aloud Surveys : A Method for Eliciting Enhanced Insights During User Studies. Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings. editor / Carmelo Ardito ; Rosa Lanzilotti ; Alessio Malizia ; Alessio Malizia ; Helen Petrie ; Antonio Piccinno ; Giuseppe Desolda ; Kori Inkpen. Springer Science and Business Media Deutschland GmbH, 2021. pp. 504-508 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{ec58d55780414d9fb252ac00fbabcb67,

title = "Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies",

abstract = "In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method. We coin the phrase “think-aloud survey method”, where participants think-aloud while completing a questionnaire. We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants{\textquoteright} Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design. The think- aloud survey method further offers other insights into usability issues and encourages the participants to provide system improvement proposals. The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice.",

keywords = "Interface design, Surveys, Tests",

author = "Lene Nielsen and Joni Salminen and Jung, {Soon Gyo} and Jansen, {Bernard J.}",

note = "Publisher Copyright: {\textcopyright} 2021, IFIP International Federation for Information Processing.; 18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021 ; Conference date: 30-08-2021 Through 03-09-2021",

year = "2021",

doi = "10.1007/978-3-030-85607-6_67",

language = "English",

isbn = "9783030856069",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "504--508",

editor = "Carmelo Ardito and Rosa Lanzilotti and Alessio Malizia and Alessio Malizia and Helen Petrie and Antonio Piccinno and Giuseppe Desolda and Kori Inkpen",

booktitle = "Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings",

address = "Germany",

}

Nielsen, L, Salminen, J, Jung, SG & Jansen, BJ 2021, Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies. in C Ardito, R Lanzilotti, A Malizia, A Malizia, H Petrie, A Piccinno, G Desolda & K Inkpen (eds), Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12936 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 504-508, 18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021, Virtual, Online, 30/08/21. https://doi.org/10.1007/978-3-030-85607-6_67

Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies. / Nielsen, Lene; Salminen, Joni; Jung, Soon Gyo et al.
Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings. ed. / Carmelo Ardito; Rosa Lanzilotti; Alessio Malizia; Alessio Malizia; Helen Petrie; Antonio Piccinno; Giuseppe Desolda; Kori Inkpen. Springer Science and Business Media Deutschland GmbH, 2021. p. 504-508 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12936 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Think-Aloud Surveys

T2 - 18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021

AU - Nielsen, Lene

AU - Salminen, Joni

AU - Jung, Soon Gyo

AU - Jansen, Bernard J.

PY - 2021

Y1 - 2021

N2 - In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method. We coin the phrase “think-aloud survey method”, where participants think-aloud while completing a questionnaire. We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants’ Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design. The think- aloud survey method further offers other insights into usability issues and encourages the participants to provide system improvement proposals. The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice.

AB - In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method. We coin the phrase “think-aloud survey method”, where participants think-aloud while completing a questionnaire. We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants’ Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design. The think- aloud survey method further offers other insights into usability issues and encourages the participants to provide system improvement proposals. The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice.

KW - Interface design

KW - Surveys

KW - Tests

UR - http://www.scopus.com/inward/record.url?scp=85115239424&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-85607-6_67

DO - 10.1007/978-3-030-85607-6_67

M3 - Conference contribution

AN - SCOPUS:85115239424

SN - 9783030856069

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 504

EP - 508

BT - Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings

A2 - Ardito, Carmelo

A2 - Lanzilotti, Rosa

A2 - Malizia, Alessio

A2 - Petrie, Helen

A2 - Piccinno, Antonio

A2 - Desolda, Giuseppe

A2 - Inkpen, Kori

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 30 August 2021 through 3 September 2021

ER -

Nielsen L, Salminen J, Jung SG , Jansen BJ. Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies. In Ardito C, Lanzilotti R, Malizia A, Malizia A, Petrie H, Piccinno A, Desolda G, Inkpen K, editors, Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 504-508. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-85607-6_67

Think-Aloud Surveys: A Method for Eliciting Enhanced Insights During User Studies

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this