Access the full text.
Sign up today, get DeepDyve free for 14 days.
William Cashin (1995)
Student Ratings of Teaching: The Research Revisited. IDEA Paper No. 32.
H. Marsh, L. Roche (2000)
Effects of Grading Leniency and Low Workload on Students' Evaluations of Teaching: Popular Myth, Bias, Validity, or Innocent Bystanders?Journal of Educational Psychology, 92
Leonardo Sussman (1978)
MisleadingIndex on Censorship, 7
Charles Emery, T. Kramer, R. Tian (2003)
Return to academic standards: a critique of student evaluations of teaching effectivenessQuality Assurance in Education, 11
Charles Eiszler (2002)
College Students' Evaluations of Teaching and Grade InflationResearch in Higher Education, 43
H. Marsh, L. Roche (1997)
Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.American Psychologist, 52
H. Marsh, Michael Bailey (1993)
Multidimensional Students' Evaluations of Teaching Effectiveness: A Profile Analysis.The Journal of Higher Education, 64
D. Peel (2005)
Peer observation as a transformatory tool?1Teaching in Higher Education, 10
P. Abrami, H. Marsh (1987)
Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future ResearchEducational Researcher
H. Marsh (1982)
SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching.British Journal of Educational Psychology, 52
C. Daraio, L. Simar (2007)
Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approachJournal of Productivity Analysis, 28
Haksever Cengiz, Muragishi Yuki (1998)
Measuring Value in MBA ProgrammesEducation Economics, 6
J. Centra (2003)
Will Teachers Receive Higher Student Evaluations by Giving Higher Grades and Less Course Work?Research in Higher Education, 44
C. Daraio, L. Simar (2007)
Advanced Robust and Nonparametric Methods in Efficiency Analysis: Methodology and Applications
J. Brakel (1983)
Foundations of measurement
L. Cherchye, Timo Kuosmanen (2002)
Benchmarking Sustainable Development : A Synthetic Meta-index Approach
G. Johnes, J. Johnes (1993)
Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis, 45
S. Stevens, H. Meyerhoff, W. Davis, I. Bacto-Agar (1946)
On the Theory of Scales of Measurement.Science, 103 2684
J.M. Ryan, P.D. Harrison
The relationship between individual characteristics and overall assessment of teaching effectiveness across different instructional contexts
P. Zhou, B. Ang, K. Poh (2007)
A mathematical programming approach to constructing composite indicatorsEcological Economics, 62
H. Marsh (1984)
Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and UsefulnessJournal of Educational Psychology, 76
S.M. Hobson, D.M. Talbot
Understanding student evaluations
J. Johnes
Data envelopment analysis and its application to the measurement of efficiency in higher education
W. McKeachie (1997)
Student ratings: The validity of use.American Psychologist, 52
K. Feldman (1977)
Consistency and variability among college students in rating their teachers and courses: A review and analysisResearch in Higher Education, 6
Catherine Cazals, J. Florens, L. Simar (2002)
Nonparametric frontier estimation: a robust approachJournal of Econometrics, 106
W.E. Cashin
Student ratings of teaching: the research revisited
K. Feldman (1996)
Identifying exemplary teaching: Using data from course and teacher evaluationsNew Directions for Teaching and Learning, 1996
M. Farrell (1957)
The Measurement of Productive Efficiency, 120
K.A. Feldman
Identifying exemplary teaching: evidence from student ratings
Shu‐Hui Liaw, K. Goh (2003)
Evidence and control of biases in student evaluations of teachingInternational Journal of Educational Management, 17
B. Griffin (2004)
Grading leniency, grade discrepancy, and student ratings of instructionContemporary Educational Psychology, 29
B. Griffin (2001)
Instructor Reputation and Student Ratings of Instruction.Contemporary educational psychology, 26 4
W. Melyn, W. Moesen (1991)
Towards a synthetic indicator of macroeconomic performance: Unequal weighting when limited information is available
Marilyn Wang, J. Stanley (1970)
Differential Weighting: A Review of Methods and Empirical Studies1Review of Educational Research, 40
M. Badri, M. Abdulla, M. Kamali, H. Dodeen (2006)
Identifying Potential Biasing Variables in Student Evaluation of Teaching in a Newly Accredited Business Program in the UAE.International Journal of Educational Management, 20
Joe Zhu (2003)
Quantitative models for performance evaluation and benchmarkingA Quarterly Journal of Operations Research
J. Ryan, P. Harrison (1995)
The relationship between individual instructional characteristics and the overall assessment of teaching effectiveness across different instructional contextsResearch in Higher Education, 36
J. Centra (1994)
The Use of the Teaching Portfolio and Student Evaluations for Summative Evaluation.The Journal of Higher Education, 65
H. Marsh, D. Hocevar (1991)
The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course levelTeaching and Teacher Education, 7
S. Hobson, Donna Talbot (2001)
Understanding Student Evaluations: What All Faculty Should KnowCollege Teaching, 49
K. Ting (2000)
A Multilevel Perspective on Student Ratings of Instruction: Lessons from the Chinese ExperienceResearch in Higher Education, 41
H. Koh, T. Tan (1997)
Empirical investigation of the factors affecting SET resultsInternational Journal of Educational Management, 11
Nira Hativa (1995)
The department-wide approach to improving faculty instruction in higher education: A qualitative evaluationResearch in Higher Education, 36
E. Thanassoulis, M.C. Portela, R. Allen
Incorporating value judgements in DEA
W. Cook (2011)
Qualitative Data in Dea
K. Witte, Mika Kortelainen (2008)
Blaming the Exogenous Environment? Conditional Efficiency Estimation with Continuous and Discrete Environmental VariablesEnvironmental Economics
A. Charnes, W. Cooper, E. Rhodes (1978)
Measuring the efficiency of decision making unitsEuropean Journal of Operational Research, 2
P. Harrison, J. Ryan, P. Moore (1996)
College students' self-insight and common implicit theories in ratings of teaching effectivenessJournal of Educational Psychology, 88
R. Thompson, L. Langemeier, Chiheyon Lee, Euntaik Lee, R. Thrall (1990)
The role of multiplier bounds in efficiency analysis with application to Kansas farmingJournal of Econometrics, 46
J. Yunker (1983)
Validity research on student evaluations of teaching effectiveness: Individual student observations versus class mean observationsResearch in Higher Education, 19
W. Cooper, L. Seiford, Joe Zhu (2011)
Handbook on data envelopment analysis
M. Weimer
It's a myth: nobody knows what makes teaching good
R. Jong, K. Westerhof (2001)
The quality of student ratings of teacher behaviourLearning Environments Research, 4
S. Stevens (1951)
Mathematics, measurement, and psychophysics.
H.W. Marsh, M.J. Dunkin
Students' evaluations of university teaching: a multidimensional perspective
L. Cherchye, W. Moesen, N. Rogge, T. Van Puyenbroeck
An introduction to ‘benefit of the doubt’ composite indicators
R. Thorndike (1969)
Measurement and Evaluation in Psychology and Education
R.D. Pritchard, M.D. Watson, K. Kelly, A.R. Paquin
Helping Teachers Teach Well: A New System for Measuring and Improving Teaching Effectiveness in Higher Education
G. Köksal, Burak Nalcaci (2006)
The Relative Efficiency of Departments at a Turkish Engineering College: A Data Envelopment AnalysisHigher Education, 51
S. d’Apollonia, P. Abrami (1997)
Navigating student ratings of instruction.American Psychologist, 52
L. Cherchye, W. Moesen, Nicky Rogge, T. Puyenbroeck (2007)
An Introduction to ‘Benefit of the Doubt’ Composite IndicatorsSocial Indicators Research, 82
S. Stevens (1971)
Issues in psychophysical measurement.Psychological Review, 78
H.W. Marsh, M. Bailey
Multidimensional students' evaluations of teaching effectiveness
D. Streiner, J. Goldberg, H. Miller (1993)
MCMI-II item weights: their lack of effectiveness.Journal of personality assessment, 60 3
H.W. Marsh, L. Roche
The Use of Students’ Evaluations of University Teaching to Improve Teaching Effectiveness
P. Abrami, W. Dickens, R. Perry, L. Leventhal (1980)
Do Teacher Standards for Assigning Grades Affect Student Evaluations of InstructionJournal of Educational Psychology, 72
P. Abrami, S. d’Apollonia, P. Cohen (1990)
Validity of student ratings of instruction : what we know and what we do notJournal of Educational Psychology, 82
L. Cherchye, P. Abeele (2005)
On research efficiency: A micro-analysis of Dutch university research in Economics and Business ManagementResearch Policy, 34
L. Langbein (2008)
Management by Results: Student Evaluation of Faculty Teaching and the Mis-Measurement of Performance.Economics of Education Review, 27
C. Lovell, J. Pastor, J. Turner (1995)
Measuring macroeconomic performance in the OECD: A comparison of European and non-European countriesEuropean Journal of Operational Research, 87
W. Cooper, L. Seiford, K. Tone (1999)
Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEA-Solver Software
C. Daraio, L. Simar (2005)
Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic ApproachJournal of Productivity Analysis, 24
University of Huddersfield Repository Data envelopment analysis and its application to the measurement of efficiency in higher education
C. Kao, Hsi-Tai Hung (2005)
Data envelopment analysis with common weights: the compromise solution approachJournal of the Operational Research Society, 56
P.‐F. Velleman, L. Wilkinson
Nominal, ordinal, interval, and ratio typologies are misleading
M. Abbott, C. Doucouliagos (2003)
The efficiency of Australian universities: a data envelopment analysisEconomics of Education Review, 22
P. Cranton, Ronald Smith (1990)
Reconsidering the Unit of Analysis: A Model of Student Ratings of Instruction.Journal of Educational Psychology, 82
F. Nasser, K. Hagtvet (2006)
MULTILEVEL ANALYSIS OF THE EFFECTS OF STUDENT AND INSTRUCTOR/COURSE CHARACTERISTICS ON STUDENT RATINGSResearch in Higher Education, 47
L. Langbein (1994)
The Validity of Student Evaluations of TeachingPS: Political Science & Politics, 27
Y. Wong, J. Beasley (1990)
Restricting Weight Flexibility in Data Envelopment AnalysisJournal of the Operational Research Society, 41
Purpose – This paper proposes a benefit of the doubt (BoD) approach to construct and analyse teacher effectiveness scores (i.e. SET scores). Design/methodology/approach – The BoD approach is related to data envelopment analysis (DEA), a linear programming tool for evaluating the relative efficiency performance of a set of similar units (e.g. firms, departments, individuals, etc.) who use (possibly multiple) inputs to produce (possibly multiple) outputs in operation environments typically characterised by no reliable information on the prices of inputs and/or no (exact) knowledge about the “functional form” of the production or cost function. Findings – A major appeal of BoD is the flexibility in the construction of the SET scores. In particular, BoD puts teacher performances into a relative perspective to be evaluated optimally, thereby accounting for different values and interpretations that teachers attach to “good teaching”. Furthermore, if available, stakeholder opinion can be easily incorporated into the evaluation. The swift identification of teachers' relative strengths and weaknesses is another advantage. The advantages show in the application. Originality/value – Several issues specific to the construction and analysis of SET scores have remained largely untouched, and hence unresolved, in the literature. One particular blank area is the weighting and aggregation of SETs into teacher performance scores. This paper contributes to the literature in that it presents a methodology that addresses this issue. To illustrate the usefulness of BoD for teacher evaluations with summative intentions and/or formative purposes, the methodology is applied to SET data collected at a university college in Brussels (Belgium).
International Journal of Educational Management – Emerald Publishing
Published: Aug 16, 2011
Keywords: Student evaluations of teaching; Data envelopment analysis; Higher education; Benefit‐of‐the‐doubt; Weight restrictions; Performance appraisal; Teachers; Belgium
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.