PMID- 20190257
OWN - NLM
STAT- MEDLINE
DCOM- 20100414
LR  - 20220408
IS  - 1471-6771 (Electronic)
IS  - 0007-0912 (Linking)
VI  - 104
IP  - 4
DP  - 2010 Apr
TI  - Anaesthesia non-technical skills: Can anaesthetists be trained to reliably use 
      this behavioural marker system in 1 day?
PG  - 440-5
LID - 10.1093/bja/aeq032 [doi]
AB  - BACKGROUND: Performance assessment is becoming increasingly necessary in the 
      medical workplace. Hospitals and patients expect safety, and under-performance by 
      a doctor can compromise standards. By describing and quantifying performance, 
      positive behaviour can be encouraged and unsafe behaviour remedied. Anaesthesia 
      Non-Technical Skills (ANTS) is a behavioural marker system that can be used to 
      assess non-technical skills in the workplace. METHODS: We determined whether 
      specialist anaesthetists could be reliably trained to use ANTS at an assessor 
      level in an 8 h programme. Unscripted videos of routine anaesthesia were produced 
      for training and assessment purposes. Twenty-six participants attended rater 
      training. Exercises in behaviour observation, rater error, frame of reference and 
      performance dimension, and the use of ANTS were conducted throughout the day. 
      Five videos were selected for formal assessment and data collected. Intra-class 
      correlations (ICCs) were calculated for each element. RESULTS: The accepted value 
      of r>0.7 was not reached. ICC calculated for each element was 0.11-0.62. 
      Comparison of participants scores with those of expert raters showed poor 
      agreement. CONCLUSIONS: Anaesthetists could not be trained to reliably use ANTS 
      as a summative assessment tool using our 1 day programme. There was an inadequate 
      correlation of scores between participants and experts. Two major problems 
      contributed to the lack of agreement. Observed behaviours were often 
      misclassified into the incorrect element and safety beliefs varied among 
      anaesthetists. Other reasons for the failure to achieve success and potential 
      future direction are discussed.
FAU - Graham, J
AU  - Graham J
AD  - Department of Anaesthesia, Sir Charles Gairdner Hospital, Perth, WA 6009, 
      Australia. jgraham@meddent.uwa.edu.au
FAU - Hocking, G
AU  - Hocking G
FAU - Giles, E
AU  - Giles E
LA  - eng
PT  - Evaluation Study
PT  - Journal Article
PT  - Research Support, Non-U.S. Gov't
DEP - 20100226
PL  - England
TA  - Br J Anaesth
JT  - British journal of anaesthesia
JID - 0372541
SB  - IM
MH  - Anesthesiology/*education
MH  - Behavior
MH  - Clinical Competence
MH  - Decision Making
MH  - Education, Medical, Graduate/*methods
MH  - Educational Measurement/*methods
MH  - Humans
MH  - Interprofessional Relations
MH  - Observer Variation
MH  - Task Performance and Analysis
MH  - Time Factors
MH  - Video Recording
MH  - Western Australia
EDAT- 2010/03/02 06:00
MHDA- 2010/04/15 06:00
CRDT- 2010/03/02 06:00
PHST- 2010/03/02 06:00 [entrez]
PHST- 2010/03/02 06:00 [pubmed]
PHST- 2010/04/15 06:00 [medline]
AID - S0007-0912(17)33647-4 [pii]
AID - 10.1093/bja/aeq032 [doi]
PST - ppublish
SO  - Br J Anaesth. 2010 Apr;104(4):440-5. doi: 10.1093/bja/aeq032. Epub 2010 Feb 26.