Access the full text.
Sign up today, get DeepDyve free for 14 days.
Jacob Cohen (1994)
The earth is round (p < .05)American Psychologist, 49
B. Gerhart, G. Milkovich (1990)
Organizational Differences in Managerial Compensation and Financial PerformanceAcademy of Management Journal, 33
Mark Huselid, B. Becker (1996)
Methodological Issues in Cross‐Sectional and Panel Estimates of the Human Resource‐Firm Performance LinkIndustrial Relations, 35
John Delery, D. Doty (1996)
Modes of theorizing in strategic human resource management: Tests of universalistic, contingency, and configurational performance predictionsAcademy of Management Journal, 39
D. Campbell, D. Fiske (1959)
Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological bulletin, 56 2
F. Schmidt, J. Hunter (1989)
Interrater reliability coefficients cannot be computed when only one stimulus is rated.Journal of Applied Psychology, 74
K. Sutcliffe (1994)
What Executives Notice: Accurate Perceptions in Top Management TeamsAcademy of Management Journal, 37
C. Viswesvaran, D. Ones, F. Schmidt (1996)
Comparative analysis of the reliability of job performance ratingsJournal of Applied Psychology, 81
L. Gómez‐Mejía (1992)
Structure and process of diversification, compensation strategy, and firm performanceSouthern Medical Journal, 13
Casey Ichniowski, K. Shaw, Giovanna Prennushi (1995)
The Effects of Human Resource Management Practices on ProductivityStrategy Models for Firm Performance Enhancement eJournal
J. Seidler (1974)
On Using Informants: A Technique for Collecting Quantitative Data and Controlling Measurement Error in Organization AnalysisAmerican Sociological Review, 39
Richard Shavelson, Noreen Webb (1991)
Generalizability Theory: A Primer
Schwab Schwab (1980)
Construct validity in organizational behaviorResearch in Organizational Behavior, 2
P. Wright, Gary Mcmahan (1992)
Theoretical Perspectives for Strategic Human Resource ManagementJournal of Management, 18
L. James (1982)
Aggregation Bias in Estimates of Perceptual Agreement.Journal of Applied Psychology, 67
Ichniowski Ichniowski, Shaw Shaw, Prennushi Prennushi (1997)
The effects of human resource management practices on productivity: A study of steel finishing linesAmerican Economic Review, 87
B. Becker, B. Gerhart (1996)
The Impact of Human Resource Management on Organizational Performance: Progress and ProspectsAcademy of Management Journal, 39
L. James, R. Demaree, Gerrit Wolf (1993)
rwg: An assessment of within-group interrater agreement.Journal of Applied Psychology, 78
D. Rubin, L. Cronbach, G. Gleser, H. Nanda, Nageswari Rajaratnam (1974)
The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles.Journal of the American Statistical Association, 69
Augustine Lado, M. Wilson (1994)
Human Resource Systems and Sustained Competitive Advantage: A Competency-Based PerspectiveAcademy of Management Review, 19
S. Kozlowski, Keith Hattrup (1992)
A disagreement about within-group agreement: Disentangling issues of consistency versus consensus.Journal of Applied Psychology, 77
D. Campbell (1960)
Recommendations for APA test standards regarding construct, trait, or discriminant validity.American Psychologist, 15
Gerhart Gerhart (1999)
Human resource management and firm performance: Measurement issues and their effect on causal and policy inferencesResearch in Personnel and Human Resources Management
J. Arthur (1994)
Effects of human resource systems on manufacturing performance and turnoverAcademy of Management Journal, 37
Delery Delery
Issues of fit in strategic human resource management: Implications for researchHuman Resource Management Review
R. Rosnow, R. Rosenthal (1989)
Statistical Procedures and the Justification of Knowledge in Psychological ScienceAmerican Psychologist, 44
Gregory Dess, R. Robinson (1984)
Measuring organizational performance in the absence of objective measures: The case of the privately-held firm and conglomerate business unitSouthern Medical Journal, 5
R. DeShon (1998)
A Cautionary Note on Measurement Error Corrections in Structural Equation ModelsPsychological Methods, 3
M. Youndt, S. Snell, J. Dean, David Lepak (1996)
Human Resource Management, Manufacturing Strategy, and Firm PerformanceAcademy of Management Journal, 39
F. Schmidt, J. Hunter (1996)
Measurement Error in Psychological Research: Lessons From 26 Research ScenariosPsychological Methods, 1
Mark Huselid, S. Jackson, R. Schuler (1997)
Technical and Strategic Human Resource Management Effectiveness as Determinants of Firm PerformanceAcademy of Management Journal, 40
F. Schmidt (1996)
Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of ResearchersPsychological Methods, 1
L. James, R. Demaree, Gerrit Wolf (1984)
Estimating within-group interrater reliability with and without response bias.Journal of Applied Psychology, 69
Casey Ichniowski, T. Kochan, D. Levine, C. Olson, G. Strauss (1996)
What works at work : overview and assessmentIndustrial Relations, 35
S. Searle (1988)
Linear Models For Unbalanced Data
B. Becker, Mark Huselid (1992)
Direct estimates of SDy and the implications for utility analysisJournal of Applied Psychology, 77
Gomez‐Mejia Gomez‐Mejia (1992)
Structure and process of diversification, compensation strategy, and firm performanceStrategic Management Journal, 13
T. Judge, D. Cable (1997)
APPLICANT PERSONALITY, ORGANIZATIONAL CULTURE, AND ORGANIZATION ATTRACTIONPersonnel Psychology, 50
Mark Huselid (1995)
The Impact of Human Resource Management Practices on Turnover, Productivity, and Corporate Financial PerformanceERN: Other Organizations & Markets: Policies & Processes (Topic)
J. Barney (1991)
Firm Resources and Sustained Competitive AdvantageJournal of Management, 17
W. Starbuck, John Mezias (1996)
Opening Pandora's Box: Studying the Accuracy of Managers' PerceptionsEconometrics: Data Collection & Data Estimation Methodology eJournal
J. George, L. James (1993)
Personality, affect, and behavior in groups revisited: Comment on aggregation, levels of analysis, and a recent application of within and between analysis.Journal of Applied Psychology, 78
A. Tsui (1990)
A Multiple-Constituency Model of Effectiveness: An Empirical Examination at the Human Resource Subunit Level.Administrative Science Quarterly, 35
Cheri Ostroff, N. Schmitt (1993)
Configurations of Organizational Effectiveness and EfficiencyAcademy of Management Journal, 36
Becker Becker, Huselid Huselid (1998)
High performance work systems and firm performance: A synthesis of research and managerial implicationsResearch in Personnel and Human Resources Management, 16
Terpstra Terpstra, Rozell Rozell (1993)
The relationship of staffing practices to organizational level measures of performancePersonnel Psychology, 46
J. Hunter, F. Schmidt (1976)
Critical analysis of the statistical and ethical implications of various definitions of test bias.Psychological Bulletin, 83
P. Shrout, J. Fleiss (1979)
Intraclass correlations: uses in assessing rater reliability.Psychological bulletin, 86 2
Brown Brown, Perry Perry (1994)
Removing the financial performance halo from Fortune's “most admired” companiesAcademy of Management Journal, 37
Snell Snell, Youndt Youndt, Wright Wright (1996)
Establishing a framework for research in strategic human resource management: Merging resource theory and organizational learningResearch in Personnel and Human Resources Management, 14
John Macduffie (1995)
Human Resource Bundles and Manufacturing Performance: Organizational Logic and Flexible Production Systems in the World Auto IndustryIndustrial & Labor Relations Review, 48
J. Nunnally (1978)
Psychometric Theory (2nd ed), New York: McGraw-Hill.
Studies of the relationship between human resource (HR) practices and firm performance typically use a single respondent to assess firm level HR practices or HR effectiveness. However, previous research in other substantive areas suggests that rater differences are a potentially important source of measurement error. We demonstrate analytically the potential consequences of both random and systematic measurement error in research on HR and firm performance. However, our main focus is on random error and we show how generalizability theory can be applied to obtain better estimates of reliability by simultaneously recognizing multiple sources (e.g., items, raters) of random measurement error. These more inclusive reliability estimates, in turn, offer the possibility of more precisely quantifying substantive relationships in the HR and firm performance literature. In our sample, reliabilities (as estimated by generalizability coefficients) for single‐rater assessments of HR variables were generally below .50. This degree of measurement error, if present in substantive studies on HR and firm performance, could lead to considerable bias, given that an unstandardized regression coefficient is corrected for measurement error in the independent variable by dividing by its reliability coefficient (not its square root). We also found only limited convergent validity between HR and line managers ratings of a second type of HR measure, HR effectiveness. In general, our findings suggest that future researchers need to devote greater attention to measurement error and construct validity issues. Our study provides an example of how generalizability theory can be useful in this pursuit.
Personnel Psychology – Wiley
Published: Dec 1, 2000
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.