Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms

Joni Salminen; Soon gyo Jung; Bernard J. Jansen

doi:10.1007/978-3-030-90238-4_11

Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms

Joni Salminen^*, Soon gyo Jung, Bernard J. Jansen

^*Corresponding author for this work

Qatar Computing Research Institute

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

During exceptional times when researchers do not have physical access to users of technology, the importance of remote user studies increases. We provide recommendations based on lessons learned from conducting online user studies utilizing four online research platforms (Appen, MTurk, Prolific, and Upwork). Our recommendations aim to help those inexperienced with online user studies. They are also beneficial for those interested in increasing their proficiency, employing this increasingly important research methodology for studying people’s interactions with technology and information.

Original language	English
Title of host publication	HCI International 2021 - Late Breaking Papers
Subtitle of host publication	Design and User Experience - 23rd HCI International Conference, HCII 2021, Proceedings
Editors	Constantine Stephanidis, Marcelo M. Soares, Marcelo M. Soares, Elizabeth Rosenzweig, Aaron Marcus, Sakae Yamamoto, Hirohiko Mori, Pei-Luen Patrick Rau, Gabriele Meiselwitz, Xiaowen Fang, Abbas Moallem
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	127-146
Number of pages	20
ISBN (Print)	9783030902377
DOIs	https://doi.org/10.1007/978-3-030-90238-4_11
Publication status	Published - 2021
Event	23rd International Conference on Human-Computer Interaction , HCII 2021 - Virtual, online Duration: 24 Jul 2021 → 29 Jul 2021

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13094 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	23rd International Conference on Human-Computer Interaction , HCII 2021
City	Virtual, online
Period	24/07/21 → 29/07/21

Keywords

Online user studies
Platforms
Remote user studies

Access to Document

10.1007/978-3-030-90238-4_11

Cite this

Salminen, J., Jung, S. G., & Jansen, B. J. (2021). Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms. In C. Stephanidis, M. M. Soares, M. M. Soares, E. Rosenzweig, A. Marcus, S. Yamamoto, H. Mori, P.-L. P. Rau, G. Meiselwitz, X. Fang, & A. Moallem (Eds.), HCI International 2021 - Late Breaking Papers: Design and User Experience - 23rd HCI International Conference, HCII 2021, Proceedings (pp. 127-146). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13094 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-90238-4_11

Salminen, Joni ; Jung, Soon gyo ; Jansen, Bernard J. / Suggestions for Online User Studies : Sharing Experiences from the Use of Four Platforms. HCI International 2021 - Late Breaking Papers: Design and User Experience - 23rd HCI International Conference, HCII 2021, Proceedings. editor / Constantine Stephanidis ; Marcelo M. Soares ; Marcelo M. Soares ; Elizabeth Rosenzweig ; Aaron Marcus ; Sakae Yamamoto ; Hirohiko Mori ; Pei-Luen Patrick Rau ; Gabriele Meiselwitz ; Xiaowen Fang ; Abbas Moallem. Springer Science and Business Media Deutschland GmbH, 2021. pp. 127-146 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{eb2e0b16348542bba52b15ba3e6b56d0,

title = "Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms",

abstract = "During exceptional times when researchers do not have physical access to users of technology, the importance of remote user studies increases. We provide recommendations based on lessons learned from conducting online user studies utilizing four online research platforms (Appen, MTurk, Prolific, and Upwork). Our recommendations aim to help those inexperienced with online user studies. They are also beneficial for those interested in increasing their proficiency, employing this increasingly important research methodology for studying people{\textquoteright}s interactions with technology and information.",

keywords = "Online user studies, Platforms, Remote user studies",

author = "Joni Salminen and Jung, {Soon gyo} and Jansen, {Bernard J.}",

note = "Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.; 23rd International Conference on Human-Computer Interaction , HCII 2021 ; Conference date: 24-07-2021 Through 29-07-2021",

year = "2021",

doi = "10.1007/978-3-030-90238-4_11",

language = "English",

isbn = "9783030902377",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "127--146",

editor = "Constantine Stephanidis and Soares, {Marcelo M.} and Soares, {Marcelo M.} and Elizabeth Rosenzweig and Aaron Marcus and Sakae Yamamoto and Hirohiko Mori and Rau, {Pei-Luen Patrick} and Gabriele Meiselwitz and Xiaowen Fang and Abbas Moallem",

booktitle = "HCI International 2021 - Late Breaking Papers",

address = "Germany",

}

Salminen, J, Jung, SG & Jansen, BJ 2021, Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms. in C Stephanidis, MM Soares, MM Soares, E Rosenzweig, A Marcus, S Yamamoto, H Mori, P-LP Rau, G Meiselwitz, X Fang & A Moallem (eds), HCI International 2021 - Late Breaking Papers: Design and User Experience - 23rd HCI International Conference, HCII 2021, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13094 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 127-146, 23rd International Conference on Human-Computer Interaction , HCII 2021, Virtual, online, 24/07/21. https://doi.org/10.1007/978-3-030-90238-4_11

Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms. / Salminen, Joni; Jung, Soon gyo ; Jansen, Bernard J.
HCI International 2021 - Late Breaking Papers: Design and User Experience - 23rd HCI International Conference, HCII 2021, Proceedings. ed. / Constantine Stephanidis; Marcelo M. Soares; Marcelo M. Soares; Elizabeth Rosenzweig; Aaron Marcus; Sakae Yamamoto; Hirohiko Mori; Pei-Luen Patrick Rau; Gabriele Meiselwitz; Xiaowen Fang; Abbas Moallem. Springer Science and Business Media Deutschland GmbH, 2021. p. 127-146 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13094 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Suggestions for Online User Studies

T2 - 23rd International Conference on Human-Computer Interaction , HCII 2021

AU - Salminen, Joni

AU - Jung, Soon gyo

AU - Jansen, Bernard J.

PY - 2021

Y1 - 2021

N2 - During exceptional times when researchers do not have physical access to users of technology, the importance of remote user studies increases. We provide recommendations based on lessons learned from conducting online user studies utilizing four online research platforms (Appen, MTurk, Prolific, and Upwork). Our recommendations aim to help those inexperienced with online user studies. They are also beneficial for those interested in increasing their proficiency, employing this increasingly important research methodology for studying people’s interactions with technology and information.

AB - During exceptional times when researchers do not have physical access to users of technology, the importance of remote user studies increases. We provide recommendations based on lessons learned from conducting online user studies utilizing four online research platforms (Appen, MTurk, Prolific, and Upwork). Our recommendations aim to help those inexperienced with online user studies. They are also beneficial for those interested in increasing their proficiency, employing this increasingly important research methodology for studying people’s interactions with technology and information.

KW - Online user studies

KW - Platforms

KW - Remote user studies

UR - http://www.scopus.com/inward/record.url?scp=85120617863&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-90238-4_11

DO - 10.1007/978-3-030-90238-4_11

M3 - Conference contribution

AN - SCOPUS:85120617863

SN - 9783030902377

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 127

EP - 146

BT - HCI International 2021 - Late Breaking Papers

A2 - Stephanidis, Constantine

A2 - Soares, Marcelo M.

A2 - Rosenzweig, Elizabeth

A2 - Marcus, Aaron

A2 - Yamamoto, Sakae

A2 - Mori, Hirohiko

A2 - Rau, Pei-Luen Patrick

A2 - Meiselwitz, Gabriele

A2 - Fang, Xiaowen

A2 - Moallem, Abbas

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 24 July 2021 through 29 July 2021

ER -

Salminen J, Jung SG , Jansen BJ. Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms. In Stephanidis C, Soares MM, Soares MM, Rosenzweig E, Marcus A, Yamamoto S, Mori H, Rau PLP, Meiselwitz G, Fang X, Moallem A, editors, HCI International 2021 - Late Breaking Papers: Design and User Experience - 23rd HCI International Conference, HCII 2021, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 127-146. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-90238-4_11

Suggestions for Online User Studies: Sharing Experiences from the Use of Four Platforms

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this