“Whoa! It's like Spotify but for academic articles.”

Instant Access to Thousands of Journals for just $40/month

Get 2 Weeks Free


USER INTERFACE DESIGN PROCESS AND EVALUATION AN AFTER-SCENARIO QUESTIONNAIR E FOR USABILITY STUDIES : PSYCHOMETRIC EVALUATIO N OVER THREE TRIALS James R . Lewi s DISCUSSIO N Design Center/Human Factors IBM Boca Raton, Florida INTRODUCTIO N The purpose of this report is to (1) describe a psychometric evaluation of a printer scenario questionnaire (PSQ) that was used to assess user satisfaction during scenario-base d usability studies of printers and (2) compare the psychometric properties of the PSQ with those of the After Scenario Questionnaire (ASQ) (Lewis, 1991b) . The PSQ i s similar to the ASQ, but is composed of three five-poin t scales rather than three seven-point scales . METHOD The results of this study of the PSQ are similar to thos e reported for the ASQ (Lewis, 1991b) . The factor analyse s showed the same pattern of association with scenarios, but extended through three trials . The analysis of variance ha d the same pattern as well, with no main effect of printer bu t a significant Printer-by-Scenario interaction . The correlation between the summed PSQ ratings and successfu l scenario completion for the first trial was - .38, very close to that of the ASQ . In the only discrepant result from the ASQ study, coefficient alpha for the PSQ ranged from .64 to .93 . Coefficient alphas reported for the ASQ all exceeded .90 . Because the internal consistency of a questionnaire is partially determined by the number of scale step s per item (Nunnally, 1978), it is likely that the smalle r coefficient alphas found for the PSQ were primarily due to the use of five-point scales rather than seven-point scales . CONCLUSIO N A total of 70 users participated in the studies, ten users pe r printer . Seven printers were evaluated, and the studies ha d four scenarios in common . Each scenario was presented three times during the study . After participants finished a scenario, they completed the PSQ. RESULTS This research showed that the usefulness of the ASQ i s probably not dependent upon the order, format, or the exac t wording of the items, and the ASQ should remain usefu l across multiple trials. Therefore, the ASQ (see Lewis, 1991b) should be seriously considered when choosing a measurement of participant satisfaction for scenario-base d usability studies . http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM SIGCHI Bulletin Association for Computing Machinery

Loading next page...
1 Page

You're reading a free preview. Subscribe to read the entire article.

And millions more from thousands of peer-reviewed journals, for just $40/month

Get 2 Weeks Free

To be the best researcher, you need access to the best research

  • With DeepDyve, you can stop worrying about how much articles cost, or if it's too much hassle to order — it's all at your fingertips. Your research is important and deserves the top content.
  • Read from thousands of the leading scholarly journals from Springer, Elsevier, Nature, IEEE, Wiley-Blackwell and more.
  • All the latest content is available, no embargo periods.