PMID- 32059622 OWN - NLM STAT- MEDLINE DCOM- 20210423 LR - 20210423 IS - 1557-900X (Electronic) IS - 0892-7790 (Linking) VI - 34 IP - 4 DP - 2020 Apr TI - Objective Assessment and Standard Setting for Basic Flexible Ureterorenoscopy Skills Among Urology Trainees Using Simulation-Based Methods. PG - 495-501 LID - 10.1089/end.2019.0626 [doi] AB - Objective: To objectively assess the performance of graduating urology residents performing flexible ureterorenoscopy (fURS) using a simulation-based model and to set an entrustability standard or benchmark for use across the educational spectrum. Methods: Chief urology residents and attending endourologists performed a standardized fURS task (ureterorenoscopy and repositioning of stones) using a Boston Scientific((c)) Lithovue ureteroscope on a Cook Medical((c)) URS model. All performances were video-recorded and blindly scored by both endourology experts and crowd-workers (C-SATS) using the Ureteroscopic Global Rating Scale, plus an overall entrustability score. Validity evidence supporting the scores was collected and categorized. The Borderline Group (BG) method was used to set absolute performance standards for the expert and crowdsourced ratings. Results: A total of 44 participants (40 chief residents, 4 faculties) completed testing. Eighty-three percent of participants had performed >50 fURS cases at the time of the study. Only 47.7% (mean score 12.6/20) and 61.4% (mean score 12.4/20) of participants were deemed "entrustable" by experts and crowd-workers, respectively. The BG method produced entrustability benchmarks of 11.8/20 for experts and 11.4/20 for crowd-worker ratings, resulting in pass rates of 56.9% and 61.4%. Conclusion: Using absolute standard setting methods, benchmark scores were set to identify trainees who could safely carry out fURS in the simulated setting. Only 60% of residents in our cohort were rated as entrustable. These findings support the use of benchmarks to earlier identify trainees requiring remediation. FAU - Goldenberg, Mitchell AU - Goldenberg M AD - Division of Urology, Department of Surgery, St. Michael's Hospital, University of Toronto, Toronto, Canada. FAU - Ordon, Michael AU - Ordon M AD - Division of Urology, Department of Surgery, St. Michael's Hospital, University of Toronto, Toronto, Canada. FAU - Honey, John R D'A AU - Honey JRD AD - Division of Urology, Department of Surgery, St. Michael's Hospital, University of Toronto, Toronto, Canada. FAU - Andonian, Sero AU - Andonian S AD - Division of Urology, McGill University Health Centre, McGill University, Quebec, Canada. FAU - Lee, Jason Y AU - Lee JY AD - Division of Urology, Department of Surgery, University Health Network-Toronto General Hospital, University of Toronto, Toronto, Canada. LA - eng PT - Journal Article DEP - 20200331 PL - United States TA - J Endourol JT - Journal of endourology JID - 8807503 SB - IM CIN - Int Braz J Urol. 2021 Mar-Apr;47(2):462-463. PMID: 33284554 MH - Clinical Competence MH - Humans MH - *Internship and Residency MH - Reference Standards MH - Ureteroscopes MH - Ureteroscopy MH - *Urology/education OTO - NOTNLM OT - assessment OT - education OT - minimally invasive surgery OT - surgery simulation OT - urology EDAT- 2020/02/16 06:00 MHDA- 2021/04/24 06:00 CRDT- 2020/02/16 06:00 PHST- 2020/02/16 06:00 [pubmed] PHST- 2021/04/24 06:00 [medline] PHST- 2020/02/16 06:00 [entrez] AID - 10.1089/end.2019.0626 [doi] PST - ppublish SO - J Endourol. 2020 Apr;34(4):495-501. doi: 10.1089/end.2019.0626. Epub 2020 Mar 31.