Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 7-Day Trial for You or Your Team.

Learn More →

Multivariate Hypothesis Testing Methods for Evaluating Significant Individual Change

Multivariate Hypothesis Testing Methods for Evaluating Significant Individual Change The measurement of individual change has been an important topic in both education and psychology. For instance, teachers are interested in whether students have significantly improved (e.g., learned) from instruction, and counselors are interested in whether particular behaviors have been significantly changed after certain interventions. Although classical test methods have been unable to adequately resolve the problems in measuring change, recent approaches for measuring change have begun to use item response theory (IRT). However, all prior methods mainly focus on testing whether growth is significant at the group level. The present research targets a key research question: Is the “change” in latent trait estimates for each individual significant across occasions? Many researchers have addressed this research question assuming that the latent trait is unidimensional. This research generalizes their earlier work and proposes four hypothesis testing methods to evaluate individual change on multiple latent traits: a multivariate Z-test, a multivariate likelihood ratio test, a multivariate score test, and a Kullback–Leibler test. Simulation results show that these tests hold promise of detecting individual change with low Type I error and high power. A real-data example from an educational assessment illustrates the application of the proposed methods. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Applied Psychological Measurement SAGE

Multivariate Hypothesis Testing Methods for Evaluating Significant Individual Change

Wang, Chun; Weiss, David J.
Applied Psychological Measurement , Volume 42 (3): 19 – May 1, 2018
Download PDF
19 pages

Loading next page...
 
/lp/sage/multivariate-hypothesis-testing-methods-for-evaluating-significant-Oky2JtbIgC

References (50)

Publisher
SAGE
Copyright
© The Author(s) 2017
ISSN
0146-6216
eISSN
1552-3497
DOI
10.1177/0146621617726787
Publisher site
See Article on Publisher Site

Abstract

The measurement of individual change has been an important topic in both education and psychology. For instance, teachers are interested in whether students have significantly improved (e.g., learned) from instruction, and counselors are interested in whether particular behaviors have been significantly changed after certain interventions. Although classical test methods have been unable to adequately resolve the problems in measuring change, recent approaches for measuring change have begun to use item response theory (IRT). However, all prior methods mainly focus on testing whether growth is significant at the group level. The present research targets a key research question: Is the “change” in latent trait estimates for each individual significant across occasions? Many researchers have addressed this research question assuming that the latent trait is unidimensional. This research generalizes their earlier work and proposes four hypothesis testing methods to evaluate individual change on multiple latent traits: a multivariate Z-test, a multivariate likelihood ratio test, a multivariate score test, and a Kullback–Leibler test. Simulation results show that these tests hold promise of detecting individual change with low Type I error and high power. A real-data example from an educational assessment illustrates the application of the proposed methods.

Journal

Applied Psychological Measurement – SAGE

Published: May 1, 2018

There are no references for this article.