Access the full text.
Sign up today, get DeepDyve free for 14 days.
Yusuke Watanabe, E. Bilgic, Ekaterina Lebedeva, K. McKendy, L. Feldman, G. Fried, M. Vassiliou (2016)
A systematic review of performance assessment tools for laparoscopic cholecystectomySurgical Endoscopy, 30
Ericsson Ka (2015)
Acquisition and maintenance of medical expertise: a perspective from the expert-performance approach with deliberate practice.Academic Medicine, 90
Alice Miller, J. Archer (2010)
Impact of workplace based assessment on doctors’ education and performance: a systematic reviewThe BMJ, 341
M. Hojat, D. Paskin, C. Callahan, T. Nasca, D. Louis, J. Veloski, J. Erdmann, J. Gonnella (2007)
Components of postgraduate competence: analyses of thirty years of longitudinal dataMedical Education, 41
John Young, Caitlin Hasser, E. Hung, Martin Kusz, P. O’Sullivan, Colin Stewart, A. Weiss, Nancy Williams (2017)
Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological LessonsAcademic Medicine, 93
D. Mcniel, E. Hung, R. Cramer, S. Hall, R. Binder (2011)
An approach to evaluating competence in assessing and managing violence risk.Psychiatric services, 62 1
E. Hung, R. Binder, S. Fordwood, S. Hall, R. Cramer, D. Mcniel (2012)
A Method for Evaluating Competency in Assessment and Management of Suicide RiskAcademic Psychiatry, 36
K. Jöreskog, I. Moustaki (2001)
Factor Analysis of Ordinal Variables: A Comparison of Three ApproachesMultivariate Behavioral Research, 36
M. Jibson, K. Broquet, J. Anzia, E. Beresin, J. Hunt, D. Kaye, N. Rao, A. Rostain, S. Sexson, Richard Summers (2012)
Clinical Skills Verification in General Psychiatry: Recommendations of the ABPN Task Force on Rater TrainingAcademic Psychiatry, 36
R. Mojtabai, M. Olfson (2008)
National trends in psychotherapy by office-based psychiatrists.Archives of general psychiatry, 65 8
A. Olupeliyawa, A. O’Sullivan, Chris Hughes, Chinthaka Balasooriya (2014)
The Teamwork Mini-Clinical Evaluation Exercise (T-MEX): A Workplace-Based Assessment Focusing on Collaborative Competencies in Health CareAcademic Medicine, 89
John Young, J. Merrienboer, S. Durning, O. Cate (2014)
Cognitive Load Theory: Implications for medical education: AMEE Guide No. 86Medical Teacher, 36
W. Gilley, George Uhlig (1993)
Factor Analysis and Ordinal DataEducation 3-13, 114
A. Ansari, S. Ali, Tyrone Donnon (2013)
The Construct and Criterion Validity of the Mini-CEX: A Meta-Analysis of the Published ResearchAcademic Medicine, 88
John Young, J. Nelson (2009)
Reconceptualizing medication management: implications for training and clinical practice.The Journal of clinical psychiatry, 70 12
M. Watson, D. Wong, Roman Kluger, Alwin Chuan, Michael Herrick, I. Ng, Damian Castanelli, L. Lin, A. Lansdown, M. Barrington (2014)
Psychometric evaluation of a direct observation of procedural skills assessment tool for ultrasound‐guided regional anaesthesiaAnaesthesia, 69
A. Feraco, Amy Starmer, T. Sectish, N. Spector, Daniel West, C. Landrigan (2016)
Reliability of Verbal Handoff Assessment and Handoff Quality Before and After Implementation of a Resident Handoff Bundle.Academic pediatrics, 16 6
S. Downing (2003)
Validity: on the meaningful interpretation of assessment dataMedical Education, 37
John Young, Sandra Lieu, P. O’Sullivan, L. Tong (2011)
Development and Initial Testing of a Structured Clinical Observation Tool to Assess Pharmacotherapy CompetenceAcademic Psychiatry, 35
David Cook, Thomas Beckman, Jayawant Mandrekar, V. Pankratz (2010)
Internal structure of mini-CEX scores for internal medicine residents: factor analysis and generalizabilityAdvances in Health Sciences Education, 15
J. Loon, Karlijn Overeem, H. Donkers, C. Vleuten, Erik Driessen (2013)
Composite reliability of a workplace-based assessment toolbox for postgraduate medical educationAdvances in Health Sciences Education, 18
S. Reise, J. Ventura, K. Nuechterlein, Kevin Kim (2005)
An Illustration of Multilevel Factor AnalysisJournal of Personality Assessment, 84
P. Weerasekera, M. Antony, A. Bellissimo, P. Bieling, J. Shurina-Egan, A. Spencer, R. Whyte, Adele Wolpert-Zur (2003)
Competency Assessment in the McMaster Psychotherapy ProgramAcademic Psychiatry, 27
Andrea Hunderfund, D. Rubin, R. Laughlin, E. Sorenson, J. Watson, Lyell Jones, D. Juul, Yoon Park (2016)
Validity and feasibility of the EMG direct observation tool (EMG-DOT)Neurology, 86
Samantha Halman, N. Dudek, Timothy Wood, Debra Pugh, C. Touchie, S. Mcaleer, S. Humphrey-Murto (2016)
Direct Observation of Clinical Skills Feedback Scale: Development and Validity EvidenceTeaching and Learning in Medicine, 28
Objective The Psychopharmacotherapy-Structured Clinical Observation (P-SCO) is a direct observation tool designed to assess resident performance of a medication visit. This study examines two dimensions of validity for the P-SCO: internal structure and how scores correlate with another variable associated with competence (experience). Methods The faculty completed 601 P-SCOs over 4 years. Multilevel exploratory factor analysis was performed with minimum thresholds for eigenvalue (≥ 1.0) and proportion of variance explained (≥ 5.0%). Internal reliability was assessed with Cronbach alpha. To examine how scores changed with experience, mean ratings (1–4 scale) were calculated for each factor by quarter of the academic year. Separate linear mixed models were also performed. Results The analysis yielded three factors that explained 50% of the variance and demonstrated high internal reliability: affective tasks (alpha = 0.90), cognitive tasks (alpha = 0.84), and hard tasks (alpha = 0.74). Items within “hard tasks” were assessment of substance use, violence risk, and adherence, and inquiry about interactions with other providers. Monitoring adverse effects did not load on the hard task factor but also had overall low mean ratings. Compared to the first quarter, fourth quarter scores for affective tasks (b =0.54, p < 0.01) and hard tasks (b
Academic Psychiatry – Springer Journals
Published: Jun 27, 2018
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.