This paper contrasts findings from a quantitative survey with those from a cognitive interviewing follow-up investigation on a subset of the same respondents. The data were gathered as part of a larger study to explore measurement error across three modes of data collection, but this paper focuses on the question format experiments rather than the mode effects part of the larger study. Three examples are presented which demonstrate how cognitive interviewing can cast new light on quantitative results by increasing the accuracy of the inferences made. These include instances where: (1) quantitative indicators of poor respondent behaviour (e.g., acquiescence bias on agree/disagree questions) are over-estimates, (2) similar quantitative response distributions across satisfaction and behavioural questions (from a fully-labelled versus end-labelled experiment) imply similar respondent satisficing behaviour, but cognitive interviews show that different response processes are at work and (3) unlikely quantitative findings (from an experiment comparing 3 vs. 7 or 8 response options) could easily be dismissed as due to chance but were instead the result of unforeseen respondent difficulties. The paper concludes with a discussion of the value of using a cognitive interviewing follow-up study as a tool in the interpretation of ambiguous quantitative findings.
Quality & Quantity – Springer Journals
Published: Apr 7, 2015
It’s your single place to instantly
discover and read the research
that matters to you.
Enjoy affordable access to
over 18 million articles from more than
15,000 peer-reviewed journals.
All for just $49/month
Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly
Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place.
Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals.
Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more.
All the latest content is available, no embargo periods.
“Hi guys, I cannot tell you how much I love this resource. Incredible. I really believe you've hit the nail on the head with this site in regards to solving the research-purchase issue.”Daniel C.
“Whoa! It’s like Spotify but for academic articles.”@Phil_Robichaud
“I must say, @deepdyve is a fabulous solution to the independent researcher's problem of #access to #information.”@deepthiw
“My last article couldn't be possible without the platform @deepdyve that makes journal papers cheaper.”@JoseServera