Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Assessing teacher innovations: expert versus peer ratings

Assessing teacher innovations: expert versus peer ratings The growing recognition of the role of teacher innovative behavior in educational improvement has led to more systematic assessment of teacher-driven innovations, usually through expert panels. Innovative peer-teachers may be more closely aligned with the correlates of teacher innovative behavior than experts, and hence their participation in such panels might make the process more robust. Hence, the authors ask, “Do expert and peer assessments relate to individual-related correlates of innovative teacher behavior differently?”Design/methodology/approachInnovations of 347 teachers in India were assessed by an expert panel and a peer-teacher panel using the consensual technique of rating innovations. Structural equation modeling was used to study the relationships of the ratings with the innovative teachers' self-reported creative self-efficacy, intrinsic motivation, learning orientation and proactive personality.FindingsExpert ratings were significantly related to creative self-efficacy beliefs (β = 0.53, p < 0.05), whereas peer ratings were not. Peer ratings were significantly related to learning orientation (β = 0.19, p < 0.05), whereas expert ratings were not. Also, expert ratings were found to be indirectly associated with teachers' proactive personality and intrinsic motivation via creative self-efficacy beliefs; peer ratings were not associated with proactive personality.Originality/valueThe paper, through a robust methodology that relates expert and peer assessments with individual-related correlates of innovative behavior, makes a case for educational innovation managers to consider mixed panels of experts and innovative teacher-peers to make the assessment process more robust. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png International Journal of Educational Management Emerald Publishing

Assessing teacher innovations: expert versus peer ratings

Download PDF
16 pages

Loading next page...
 
/lp/emerald-publishing/assessing-teacher-innovations-expert-versus-peer-ratings-zn7o3NIjxS
Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
0951-354X
DOI
10.1108/ijem-04-2020-0185
Publisher site
See Article on Publisher Site

Abstract

The growing recognition of the role of teacher innovative behavior in educational improvement has led to more systematic assessment of teacher-driven innovations, usually through expert panels. Innovative peer-teachers may be more closely aligned with the correlates of teacher innovative behavior than experts, and hence their participation in such panels might make the process more robust. Hence, the authors ask, “Do expert and peer assessments relate to individual-related correlates of innovative teacher behavior differently?”Design/methodology/approachInnovations of 347 teachers in India were assessed by an expert panel and a peer-teacher panel using the consensual technique of rating innovations. Structural equation modeling was used to study the relationships of the ratings with the innovative teachers' self-reported creative self-efficacy, intrinsic motivation, learning orientation and proactive personality.FindingsExpert ratings were significantly related to creative self-efficacy beliefs (β = 0.53, p < 0.05), whereas peer ratings were not. Peer ratings were significantly related to learning orientation (β = 0.19, p < 0.05), whereas expert ratings were not. Also, expert ratings were found to be indirectly associated with teachers' proactive personality and intrinsic motivation via creative self-efficacy beliefs; peer ratings were not associated with proactive personality.Originality/valueThe paper, through a robust methodology that relates expert and peer assessments with individual-related correlates of innovative behavior, makes a case for educational innovation managers to consider mixed panels of experts and innovative teacher-peers to make the assessment process more robust.

Journal

International Journal of Educational Management – Emerald Publishing

Published: Mar 15, 2021

Keywords: Innovation ratings; Teacher innovations; Expert and peer raters; Teacher innovative behavior

References

  • Social psychology of creativity: a consensual assessment technique
    Amabile, T.M.
  • A model of creativity and innovation in organizations
    Amabile, T.M.
  • Creativity and innovation in organizations
    Amabile, T.M.
  • Affect and creativity at work
    Amabile, T.M.; Barsade, S.G.; Mueller, J.S.; Staw, B.M.
  • Classrooms: goals, structures, and student motivation
    Ames, C.
  • Achievement goals in the classroom: students' learning strategies and motivation processes
    Ames, C.; Archer, J.
  • Examining variations among researchers' and teachers' conceptualizations of creativity: a review and synthesis of contemporary research
    Andiliou, A.; Murphy, P.K.
  • Influence of motivation, self-beliefs, and instructional practices on science achievement of adolescents in Canada
    Areepattamannil, S.; Freeman, J.G.; Klinger, D.A.
  • The proactive component of organizational behavior: a measure and correlates
    Bateman, T.S.; Crant, J.M.
  • Assessment of creativity evaluation skills: a psychometric investigation in prospective teachers
    Benedek, M.; Nordtvedt, N.; Jauk, E.; Koschmieder, C.; Pretsch, J.; Krammer, G.; Neubauer, A.C.
  • Balancing on the creative highwire: forecasting the success of novel ideas in organizations
    Berg, J.M.
  • Proactive personality at work: seeing more to do and doing more?
    Bergeron, D.M.; Schroeder, T.D.; Martinez, H.A.
  • Rewards and creative performance: a meta-analytic test of theoretically derived hypotheses
    Byron, K.; Khazanchi, S.
  • Mainstreaming the practices of innovative teachers: managing decentralized professional development in public schooling
    Chand, V.S.
  • Socio-educational entrepreneurship within the public sector: leveraging teacher-driven innovations for improvement
    Chand, V.S.
  • Dialoguing with teacher-educators, valorizing teacher innovations
    Chand, V.S.; Kuril, S.; Shukla, A.
  • Pre-service teachers' innovation on English activity designs and materials for young learners
    Chien, C.W.
  • Commenting on writing: typology and perceived helpfulness of comments from novice peer reviewers and subject matter experts
    Cho, K.; Schunn, C.D.; Charney, D.
  • Individual and contextual predictors of creative performance
    Choi, J.N.
  • A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation
    Deci, E.L.; Koestner, R.; Ryan, R.M.
  • Enhancement and recognition of teaching and learning in higher education
    Efimenko, E.; Roman, A.; Pinto, M.; Remião, F.; Teixeira, P.
  • Factors influencing individual creativity in the workplace: an examination of quantitative empirical research
    Egan, T.M.
  • A hierarchical model of approach and avoidance achievement motivation
    Elliot, A.J.; Church, M.A.
  • Enhancing creativity through “mindless” work: a framework of workday design
    Elsbach, K.D.; Hargadon, A.B.
  • Developing a public school entrepreneurship inventory: theoretical conceptualization and empirical examination
    Eyal, O.; Inbar, D.E.
  • Managing educational champions: entrepreneurship in schools
    Eyal, O.; Yosef-Hassidim, D.
  • Individual innovation
    Farr, J.L.; Ford, C.M.; West, M.A.; Farr, J.L.
  • What good are positive emotions?
    Fredrickson, B.L.
  • Management of experiential learning projects in marketing coursework
    Gaidis, W.C.; Andrews, J.C.
  • Understanding when bad moods foster creativity and good ones don't: the role of context and clarity of feelings
    George, J.M.; Zhou, J.
  • Employee learning orientation , transformational leadership, and employee Creativity : the mediating role of employee creative self-efficacy
    Gong, Y.; Huang, J.C.; Farh, J.L.
  • Getting credit for proactive behavior: supervisor reactions depend on what you value and how you feel
    Grant, A.M.; Parker, S.; Collins, C.
  • The role of passion and persistence in creativity
    Grohman, M.G.; Ivcevic, Z.; Silvia, P.; Kaufman, S.B.
  • Predictors of individual-level innovation at work: a meta-analysis
    Hammond, M.M.; Neff, N.L.; Farr, J.L.; Schwall, A.R.; Zhao, X.
  • Beyond Baron and Kenny: statistical mediation analysis in the new millennium
    Hayes, A.F.
  • Peer versus expert feedback: an investigation of the quality of peer feedback among secondary school students
    Hovardas, T.; Tsivitanidou, O.E.; Zacharia, Z.C.
  • Creative self-efficacy and innovative behavior in a service setting: optimism as a moderator
    Hsu, M.L.A.; Hou, S.; Fan, H.
  • Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives
    Hu, L.; Bentler, P.M.
  • Leadership, creativity, and innovation: a critical review and practical recommendations
    Hughes, D.J.; Lee, A.; Tian, A.W.; Newman, A.; Legood, A.
  • Improving creativity performance assessment: a rater effect examination with many facet Rasch model
    Hung, S.-P.; Chen, P.-H.; Chen, H.-C.
  • Transformational leadership, innovation climate, creative self-efficacy and employee creativity: a multilevel study
    Jaiswal, N.K.; Dhar, R.L.
  • Beyond new and appropriate: who decides what is creative?
    Kaufman, J.C.; Baer, J.
  • A comparison of expert and nonexpert raters using the consensual assessment technique
    Kaufman, J.C.; Baer, J.; Cole, J.C.; Sexton, J.D.
  • Time pressure and team member creativity within R&D projects: the role of learning orientation and knowledge sourcing
    Khedhaouria, A.; Montani, F.; Thurik, R.
  • Teaching excellence, teaching expertise, and the scholarship of teaching
    Kreber, C.
  • Motivational mechanisms of employee creativity: a meta-analytic examination and theoretical extension of the creativity literature
    Liu, D.; Jiang, K.; Shalley, C.E.; Keem, S.; Zhou, J.
  • Proactive personality, goal orientation and meta-skills as predictors of protean and boundary less career attitudes
    Lochab, A.; Nath, V.
  • A comparison of assessment methods and raters in product creativity
    Lu, C.C.; Luh, D.B.
  • Power analysis and determination of sample size for covariance structure modelin
    MacCallum, R.C.; Browne, M.W.; Sugawara, H.M.
  • Confidence limits for the indirect effect: distribution of the product and resampling methods
    MacKinnon, D.P.; Lockwood, C.M.; Williams, J.
  • Linking proactive personality and the big five to motivation to learn and development activity
    Major, D.A.; Turner, J.E.; Fletcher, T.D.
  • The assessment of creative and innovative performance
    McKay, A.S.; Kaufman, J.C.; Mumford, M.D.; Todd, M.E.
  • Reframing the decision-makers' dilemma: towards a social context model of creative idea recognition
    Mueller, J.; Melwani, S.; Loewenstein, J.; Deal, J.J.
  • How does proactive personality promote creativity? A multilevel examination of the interplay between formal and informal leadership
    Pan, J.; Liu, S.; Ma, B.; Qu, Z.
  • Peering into large lectures: examining peer and expert mark agreement using peerScholar, an online peer assessment tool
    Paré, D.E.; Joordens, S.
  • Assessing Innovation: a 360‐degree appraisal study
    Potočnik, K.; Anderson, N.
  • Patterns in student–student commenting
    Rada, R.; Hu, K.
  • Predicting innovative performance through proactive personality: examining its criterion validity and incremental validity over the five‐factor model
    Rodrigues, N.; Rebelo, T.
  • Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being
    Ryan, R.M.; Deci, E.L.
  • Are you really doing good things in your boss's eyes? Interactive effects of employee innovative work behavior and leader–member exchange on supervisory performance ratings
    Schuh, S.C.; Zhang, X.; Morgeson, F.P.; Tian, P.; andvan Dick, R.
  • Determinants of innovative behavior: a path model of individual innovation in the workplace
    Scott, S.G.; Bruce, R.A.
  • What do proactive people do? A longitudinal model linking proactive personality and career success
    Seibert, S.E.; Kraimer, M.L.; Crant, J.M.
  • Discernment and creativity: how well can people identify their most creative ideas
    Silvia, P.J.
  • The clinician crowdsourcing challenge: using participatory design to seed implementation strategies
    Stewart, R.E.; Williams, N.; Byeon, Y.V.; Buttenheim, A.; Sridharan, S.; Zentgraf, K.; Jones, D.; Hoskins, K.; Candon, M.; Beidas, R.S.
  • Toward a model of explaining teachers' innovative behavior: a literature review
    Thurlings, M.; Evers, A.T.; Vermeulen, M.
  • Creative self-efficacy : its potential antecedents and relationship to creative performance
    Tierney, P.; Farmer, S.
  • 100 years of applied psychology research on individual careers: from career management to retirement
    Wang, M.; Wanberg, C.R.
  • Peer assessment: the participants' perception of two activities on a further education teacher education course
    Woolhouse, M.
  • Innovative behavior in the workplace: the role of performance and image outcome expectations
    Yuan, F.; Woodman, R.W.
  • Research on employee creativity: a critical review and directions for future research
    Zhou, J.; Shalley, C.E.