Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Data quality comparison between computers and smartphones in different web survey modes and question formats

Data quality comparison between computers and smartphones in different web survey modes and... Low response rates in web surveys and the use of different devices in entering web survey responses are the two main challenges to response quality of web surveys. The purpose of this study is to compare the effects of using interviewers to recruit participants in computer-assisted self-administered interviews (CASI) vs computer-assisted personal interviews (CAPI) and smartphones vs computers on participation rate and web survey response quality.Design/methodology/approachTwo field experiments using two similar media use studies on US college students were conducted to compare response quality in different survey modes and response devices.FindingsResponse quality of computer entry was better than smartphone entry in both studies for open-ended and closed-ended question formats. Device effect was only significant on overall completion rate when interviewers were present.Practical implicationsSurvey researchers are given guidance how to conduct online surveys using different devices and choice of question format to maximize survey response quality. The benefits and limitations of using an interviewer to recruit participants and smartphones as web survey response devices are discussed.Social implicationsIt shows how computer-assisted self-interviews and smartphones can improve response quality and participation for underprivileged groups.Originality/valueThis is the first study to compare response quality in different question formats between CASI, e-mailed delivered online surveys and CAPI. It demonstrates the importance of human factor in creating sense of obligation to improve response quality. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Internet Research Emerald Publishing

Data quality comparison between computers and smartphones in different web survey modes and question formats

Ha, Louisa; Zhang, Chenjie; Jiang, Weiwei
Internet Research , Volume 30 (6): 19 – Oct 24, 2020
Download PDF
19 pages

Loading next page...
 
/lp/emerald-publishing/data-quality-comparison-between-computers-and-smartphones-in-different-Ou2DRpVnyd
Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
1066-2243
DOI
10.1108/intr-09-2018-0417
Publisher site
See Article on Publisher Site

Abstract

Low response rates in web surveys and the use of different devices in entering web survey responses are the two main challenges to response quality of web surveys. The purpose of this study is to compare the effects of using interviewers to recruit participants in computer-assisted self-administered interviews (CASI) vs computer-assisted personal interviews (CAPI) and smartphones vs computers on participation rate and web survey response quality.Design/methodology/approachTwo field experiments using two similar media use studies on US college students were conducted to compare response quality in different survey modes and response devices.FindingsResponse quality of computer entry was better than smartphone entry in both studies for open-ended and closed-ended question formats. Device effect was only significant on overall completion rate when interviewers were present.Practical implicationsSurvey researchers are given guidance how to conduct online surveys using different devices and choice of question format to maximize survey response quality. The benefits and limitations of using an interviewer to recruit participants and smartphones as web survey response devices are discussed.Social implicationsIt shows how computer-assisted self-interviews and smartphones can improve response quality and participation for underprivileged groups.Originality/valueThis is the first study to compare response quality in different question formats between CASI, e-mailed delivered online surveys and CAPI. It demonstrates the importance of human factor in creating sense of obligation to improve response quality.

Journal

Internet Research – Emerald Publishing

Published: Oct 24, 2020

Keywords: Data quality; Survey mode; Interviewer; Smartphone; Computer-assisted self-interview; Computer-assisted personal Interview

References

  • Total survey error: design, implementation and evaluation
    Biemer, P.
  • Social desirability effects on computerized and paper-and-pencil questionnaires
    Booth-Kewley, S.; Larson, G.E.; Miyoshi, D.K.
  • Application of audio computer-assisted self-interviews to collect self-reported health data: an overview
    Brown, J.L.; Swartzendruber, A.; DiClemente, R.J.
  • Making mobile browser surveys smarter: results from a randomized experiment comparing online surveys completed via computer or smartphone
    Buskirk, T.D.; Andrus, C.H.
  • From mixed-mode to multiple devices -- web surveys, smartphone surveys and apps: has the respondent gone ahead of us in answering surveys?
    Callegaro, M.
  • Web surveys: a review of issues and approaches
    Couper, M.P.
  • The future of modes of data collection
    Couper, M.P.
  • Improving response rates and questionnaire design for mobile web surveys
    De-Bruijne, M.; Wijnant, A.
  • A classification of response scale characteristics that affect response quality: a literature review
    DeCastellarnau, A.
  • Item non-response to financial questions in household surveys: an experimental study of interviewer and mode effects
    Essig, L.; Winter, J.K.
  • The value of online surveys: a look back and a look ahead
    Evans, J.R.; Mathur, A.
  • An experimental comparison of web and telephone surveys
    Fricker, S.; Galesic, M.; Tourangeau, R.; Yan, T.
  • Effects of questionnaire length on participation and indicators of response quality in a web survey
    Galesic, M.; Bosnjak, M.
  • Three eras of survey research
    Groves, R.M.
  • Explaining interview duration in web surveys: a multilevel approach
    Gummer, T.; Roβmann, J.
  • Use of survey research in top mass communication journals 2001-2010 and the total survey error paradigm
    Ha, L.; Hu, X.; Fang, L.; Henize, S.; Park, S.; Stana, A.; Zhang, X.
  • Survey satisficing inflates reliability and validity measures: an experimental comparison of college and Amazon Mechanical Turk samples
    Hamby, T.; Taylor, W.
  • Questionnaire survey nonresponse: a comparison of postal mail and Internet surveys
    Hoonakker, P.; Carayon, P.
  • Respondent screening and revealed preference axioms: testing quarantining methods for enhanced response quality in Web panel surveys
    Jones, M.S.; House, L.A.; Gao, Z.
  • The influence of answer box format on response behavior on list-style open-ended questions
    Keusch, F.
  • Straightlining: overview of measurement, comparison of indicators, effects in mail-web mixed-mode surveys
    Kim, Y.; Dykema, J.; Stevenson, J.; Black, P.; Moberg, D.P.
  • Mobile technologies for conducting, augmenting and potentially replacing surveys
    Link, M.W.; Murphy, J.; Schober, M.F.; Buskirk, T.D.; Childs, J.H.; Tesfaye, C.L.
  • Allocation for dual frame telephone surveys with nonresponse
    Lohr, S.L.; Brick, J.M.
  • Response quality in PC and mobile web surveys
    Mavletova, A.
  • Problems and prospects in survey research
    Moy, P.; Murphy, P.
  • Bridging psychometrics and survey methodology: can mixed Rasch Models identify socially desirable reporting behavior?
    Mneimneh, Z.N.; Heeringa, S.G.; Tourangeau, R.; Elliott, M.R.
  • Audio computerized self- interviewing versus face-to-face interviewing for data collection at drug abuse treatment programs
    Perlis, T.E.; Des Jarlais, D.C.; Friedman, S.R.; Arasteh, K.; Turner, C.F.
  • Experiments in mobile survey design: similarities to other modes and unique considerations
    Peytchev, A.; Hill, C.A.
  • A comparison of the quality of questions in a face-to-face and a web survey
    Revilla, M.A.; Saris, W.E.
  • Do online access panels need to adapt surveys for mobile devices?
    Revilla, M.A.; Toninelli, D.; Ochoa, C.; Loewe, G.
  • A meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews
    Richman, W.L.; Kiesler, S.; Weisband, S.; Drasgow, F.
  • Accuracy in estimation with nonresponse: a function of degree of imbalance and degree of explanation
    Sarndal, C.; Lundquist, P.
  • The implications of the survey method for measuring cultivation effects
    Schrum, L.J.
  • Why do respondents break off Web surveys and does it matter? Results from four follow-up surveys
    Steinbrecher, M.; Roβmann, J.; Blumenstiel, J.E.
  • Effects of design in Web surveys: comparing trained and fresh respondents
    Toepoel, V.; Das, M.; Van Soest, A.
  • Response styles in survey research: a literature review of antecedents, consequences, and remedies
    Van Vaerengergh, Y.; Thomas, T.D.
  • Are demographics adequate controls for cell-phone-only coverage bias in mass communication research?
    Watson, B.R.; Zamith, R.; Cavanah, C.; Lewis, S.C.