Intra-rater repeatability of a structured method of selecting abstracts for the annual euraps scientific meeting

Intra-rater repeatability of a structured method of selecting abstracts for the annual euraps... To date, surprisingly little attention has been given to the process of selection of abstracts submitted to biomedical meetings and there are no reports on the intra-rater reliability of such a selection. We wanted to determine the intra-rater repeatability of the selection by multiple reviewers, of abstracts submitted to a plastic surgical scientific meeting. Prospective analysis of repeated structured ratings of five abstracts by three blinded reviewers of each of the 202 abstracts submitted to the annual scientific meeting of the European Association of Plastic Surgeons (EURAPS). The intra-class correlation coefficient of the score and repeated score of five abstracts and the kappa statistic of the dichotomy of acceptance of the top two rated abstracts vs rejection of the remaining three abstracts. Both were calculated for the set of repeated scores by each individual reviewer, as well as for the set of totals of scores by all reviewers. The median of the reviewers’ individual intra-class correlation coefficient was 0.86 (range, −0.56–0.92). Six out of 10 reviewers rated the same two abstracts as top abstracts during both reviews, resulting in kappa statistics ranging from −0.15 to 1.0 (median, 0.59). The median intra-class correlation coefficient of joined scores was 0.93 (range, 0.92–0.97), and the kappa statistic for the joined top-rated abstracts was 1.0. Excellent repeatability of the ranking and dichotomy of abstracts based on the joined scores of multiple peer reviewers gives confidence in EURAPS’ structured method of abstract selection. European Journal of Plastic Surgery Springer Journals

Intra-rater repeatability of a structured method of selecting abstracts for the annual euraps scientific meeting

Loading next page...
Copyright © 2006 by Springer-Verlag
Medicine & Public Health; Plastic Surgery
Publisher site
See Article on Publisher Site


You’re reading a free preview. Subscribe to read the entire article.

DeepDyve is your
personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

Enjoy affordable access to
over 12 million articles from more than
10,000 peer-reviewed journals.

All for just $49/month

Explore the DeepDyve Library

Unlimited reading

Read as many articles as you need. Full articles with original layout, charts and figures. Read online, from anywhere.

Stay up to date

Keep up with your field with Personalized Recommendations and Follow Journals to get automatic updates.

Organize your research

It’s easy to organize your research with our built-in tools.

Your journals are on DeepDyve

Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more.

All the latest content is available, no embargo periods.

See the journals in your area

Monthly Plan

  • Read unlimited articles
  • Personalized recommendations
  • No expiration
  • Print 20 pages per month
  • 20% off on PDF purchases
  • Organize your research
  • Get updates on your journals and topic searches


Start Free Trial

14-day Free Trial

Best Deal — 39% off

Annual Plan

  • All the features of the Professional Plan, but for 39% off!
  • Billed annually
  • No expiration
  • For the normal price of 10 articles elsewhere, you get one full year of unlimited access to articles.



billed annually
Start Free Trial

14-day Free Trial