A fuzzy set theory based computational model to represent the quality of inter-rater agreement

A fuzzy set theory based computational model to represent the quality of inter-rater agreement In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Quality & Quantity Springer Journals

A fuzzy set theory based computational model to represent the quality of inter-rater agreement

16 pages
Read Article

Loading next page...
 
/lp/springer_journal/a-fuzzy-set-theory-based-computational-model-to-represent-the-quality-0jpiE9w065
Publisher
Springer Netherlands
Copyright
Copyright © 2013 by Springer Science+Business Media Dordrecht
Subject
Social Sciences, general; Methodology of the Social Sciences; Social Sciences, general
ISSN
0033-5177
eISSN
1573-7845
D.O.I.
10.1007/s11135-013-9888-3
Publisher site
See Article on Publisher Site

Abstract

In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study.

Journal

Quality & Quantity – Springer Journals

Published: Jul 6, 2013

References

  • How expert clinicians’ prototypes of an ideal treatment correlate with outcome in psychodynamic and cognitive-behavioral therapy
    Ablon, J; Jones, E
  • Psychotherapy process in the national institute of mental health treatment of depression collaborative research program
    Ablon, J; Jones, E
  • Validity of controlled clinical trials of psychotherapy: findings from the nimh treatment of depression collaborative research program
    Ablon, J; Jones, E
  • Beyond brand names of psychotherapy: identifying empirically supported change processes
    Ablon, J; Levy, R; Katzenstein, T
  • The grid of the models of interpretations (gmi): a trans-theoretical method to study therapist interpretive activity
    Auletta, A; Salvatore, S; Metrangolo, R; Monteforte, G; Pace, V; Puglisi, M
  • Remembered duration: evidence for a contextual-change hypothesis
    Block, R; Reed, M
  • General distress as second order latent variable estimated trough PLS-PM approach
    Ciavolino, E.
  • Ecsi-customer satisfaction modelling and analysis: a case study
    Ciavolino, E; Dahlgaard, J
  • The fuzzy approach to statistical analysis
    Coppi, R; Gil, M; Kiers, H
  • Fuzzy logic: toward measuring gottfredson’s concept of occupational social space
    Hesketh, B; Pryor, R; Gleitzman, M
  • An application of a computerized fuzzy graphic rating scale to the psychological measurement of individual differences
    Hesketh, T; Pryor, R; Hesketh, B
  • Prior probabilities
    Jaynes, E
  • Psychoterapy Process Q-set Coding Manual
    Jones, E
  • Comparing the process in psychodynamic and cognitive-behavioral therapies
    Jones, E; Pulos, S
  • Fuzzy Sets and Fuzzy Logic
    Klir, G; Yuan, B
  • The role of affects in culture-based interventions: implications for practice
    Mannarini, T; Ciavolino, E; Nitti, M; Salvatore, S
  • Misurazione e scale: qualche riflessione e una proposta
    Marradi, A
  • An overview of membership function generation techniques for pattern recognition
    Medasani, S; Kim, J; Krishnapuram, R
  • A fuzzified BRAIN algorithm for learning DNF from incomplete data
    Rampone, S.; Russo, C.
  • Fuzzy Logic with Engineering Applications
    Ross, T
  • Affect, unconscious and sensemaking. A psychodynamic, semiotic and dialogic model
    Salvatore, S; Freda, M
  • Fuzzy sets
    Zadeh, L
  • Fuzzy sets as a basis for a theory of possibility
    Zadeh, L
  • Toward a generalized theory of uncertainty (GTU)–an outline
    Zadeh, L.
  • Fuzzy Sets in Psychology
    Zétényi, T

You’re reading a free preview. Subscribe to read the entire article.

Try 2 weeks free now

DeepDyve is your
personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

Enjoy affordable access to
over 18 million articles from more than
15,000 peer-reviewed journals.

All for just $49/month

Explore the DeepDyve Library

or browse the journals available

Search

Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly

Organize

Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place.

Access

Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals.

Your journals are on DeepDyve

Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more.

All the latest content is available, no embargo periods.

See the journals in your area

DeepDyve

Freelancer

DeepDyve

Pro

Price

FREE

$49/month
$360/year

Save searches from
Google Scholar,
PubMed

Create lists to
organize your research

Export lists, citations

Read DeepDyve articles

Abstract access only

Unlimited access to over
18 million full-text articles

Print

20 pages / month

PDF Discount

20% off

Sign up
for free
Start 14 day
Free Trial