PMID- 24290888 OWN - NLM STAT- MEDLINE DCOM- 20140515 LR - 20211021 IS - 1879-1883 (Electronic) IS - 0002-9610 (Print) IS - 0002-9610 (Linking) VI - 207 IP - 4 DP - 2014 Apr TI - Detecting adverse events in surgery: comparing events detected by the Veterans Health Administration Surgical Quality Improvement Program and the Patient Safety Indicators. PG - 584-95 LID - S0002-9610(13)00643-0 [pii] LID - 10.1016/j.amjsurg.2013.08.031 [doi] AB - BACKGROUND: The Patient Safety Indicators (PSIs) use administrative data to screen for select adverse events (AEs). In this study, VA Surgical Quality Improvement Program (VASQIP) chart review data were used as the gold standard to measure the criterion validity of 5 surgical PSIs. Independent chart review was also used to determine reasons for PSI errors. METHODS: The sensitivity, specificity, and positive predictive value of PSI software version 4.1a were calculated among Veterans Health Administration hospitalizations (2003-2007) reviewed by VASQIP (n = 268,771). Nurses re-reviewed a sample of hospitalizations for which PSI and VASQIP AE detection disagreed. RESULTS: Sensitivities ranged from 31% to 68%, specificities from 99.1% to 99.8%, and positive predictive values from 31% to 72%. Reviewers found that coding errors accounted for some PSI-VASQIP disagreement; some disagreement was also the result of differences in AE definitions. CONCLUSIONS: These results suggest that the PSIs have moderate criterion validity; however, some surgical PSIs detect different AEs than VASQIP. Future research should explore using both methods to evaluate surgical quality. CI - Published by Elsevier Inc. FAU - Mull, Hillary J AU - Mull HJ AD - Center for Organization, Leadership, and Management Research, VA Boston Healthcare System, 150 S Huntington Avenue (152M), Boston, MA 02130, USA; Department of Surgery, Boston University School of Medicine, Boston, MA, USA. Electronic address: hillary.mull@va.gov. FAU - Borzecki, Ann M AU - Borzecki AM AD - Center for Health Quality, Outcomes and Economic Research, Bedford VA Medical Center, Bedford, MA, USA; Department of Health Policy and Management, Boston University School of Public Health, Boston, MA, USA. FAU - Loveland, Susan AU - Loveland S AD - Center for Organization, Leadership, and Management Research, VA Boston Healthcare System, 150 S Huntington Avenue (152M), Boston, MA 02130, USA. FAU - Hickson, Kathleen AU - Hickson K AD - Center for Health Quality, Outcomes and Economic Research, Bedford VA Medical Center, Bedford, MA, USA; Harvard Medical School, Boston, MA, USA. FAU - Chen, Qi AU - Chen Q AD - Center for Organization, Leadership, and Management Research, VA Boston Healthcare System, 150 S Huntington Avenue (152M), Boston, MA 02130, USA. FAU - MacDonald, Sally AU - MacDonald S AD - Center for Health Quality, Outcomes and Economic Research, Bedford VA Medical Center, Bedford, MA, USA. FAU - Shin, Marlena H AU - Shin MH AD - Center for Organization, Leadership, and Management Research, VA Boston Healthcare System, 150 S Huntington Avenue (152M), Boston, MA 02130, USA. FAU - Cevasco, Marisa AU - Cevasco M AD - VA Boston Healthcare System, Boston, MA, USA; Harvard Medical School, Boston, MA, USA. FAU - Itani, Kamal M F AU - Itani KM AD - Department of Surgery, Boston University School of Medicine, Boston, MA, USA; VA Boston Healthcare System, Boston, MA, USA; Harvard Medical School, Boston, MA, USA. FAU - Rosen, Amy K AU - Rosen AK AD - Center for Organization, Leadership, and Management Research, VA Boston Healthcare System, 150 S Huntington Avenue (152M), Boston, MA 02130, USA; Department of Surgery, Boston University School of Medicine, Boston, MA, USA. LA - eng GR - VA999999/Intramural VA/United States PT - Comparative Study PT - Journal Article DEP - 20131107 PL - United States TA - Am J Surg JT - American journal of surgery JID - 0370473 SB - IM MH - Hospital Records MH - *Hospitals, Veterans MH - Humans MH - Incidence MH - Postoperative Complications/diagnosis/*epidemiology MH - Predictive Value of Tests MH - Quality Assurance, Health Care/*methods MH - *Quality Improvement MH - Surgical Procedures, Operative/adverse effects MH - United States/epidemiology MH - *United States Department of Veterans Affairs PMC - PMC4557788 MID - NIHMS719231 OTO - NOTNLM OT - Administrative data OT - Adverse surgical events OT - Patient Safety Indicators OT - VA Surgical Quality Improvement Program OT - Veterans Health Administration EDAT- 2013/12/03 06:00 MHDA- 2014/05/16 06:00 PMCR- 2015/09/02 CRDT- 2013/12/03 06:00 PHST- 2013/04/11 00:00 [received] PHST- 2013/07/19 00:00 [revised] PHST- 2013/08/01 00:00 [accepted] PHST- 2013/12/03 06:00 [entrez] PHST- 2013/12/03 06:00 [pubmed] PHST- 2014/05/16 06:00 [medline] PHST- 2015/09/02 00:00 [pmc-release] AID - S0002-9610(13)00643-0 [pii] AID - 10.1016/j.amjsurg.2013.08.031 [doi] PST - ppublish SO - Am J Surg. 2014 Apr;207(4):584-95. doi: 10.1016/j.amjsurg.2013.08.031. Epub 2013 Nov 7.