PMID- 27485293 OWN - NLM STAT- MEDLINE DCOM- 20170626 LR - 20181113 IS - 1878-5921 (Electronic) IS - 0895-4356 (Print) IS - 0895-4356 (Linking) VI - 80 DP - 2016 Dec TI - The Moses-Littenberg meta-analytical method generates systematic differences in test accuracy compared to hierarchical meta-analytical models. PG - 77-87 LID - S0895-4356(16)30258-X [pii] LID - 10.1016/j.jclinepi.2016.07.011 [doi] AB - OBJECTIVE: To compare meta-analyses of diagnostic test accuracy using the Moses-Littenberg summary receiver operating characteristic (SROC) approach with those of the hierarchical SROC (HSROC) model. STUDY DESIGN AND SETTING: Twenty-six data sets from existing test accuracy systematic reviews were reanalyzed with the Moses-Littenberg model, using equal weighting ("E-ML") and weighting by the inverse variance of the log DOR ("W-ML"), and with the HSROC model. The diagnostic odds ratios (DORs) were estimated and covariates added to both models to estimate relative DORs (RDORs) between subgroups. Models were compared by calculating the ratio of DORs, the ratio of RDORs, and P-values for detecting asymmetry and effects of covariates on DOR. RESULTS: Compared to the HSROC model, the Moses-Littenberg model DOR estimates were a median of 22% ("E-ML") and 47% ("W-ML") lower at Q*, and 7% and 42% lower at the central point in the data. Instances of the ML models giving estimates higher than the HSROC model also occurred. Investigations of heterogeneity also differed; the Moses-Littenberg models on average estimating smaller differences in RDOR. CONCLUSIONS: Moses-Littenberg meta-analyses can generate lower estimates of test accuracy, and smaller differences in accuracy, compared to mathematically superior hierarchical models. This has implications for the usefulness of meta-analyses using this approach. We recommend meta-analysis of diagnostic test accuracy studies to be conducted using available hierarchical model-based approaches. CI - Copyright (c) 2016 The Authors. Published by Elsevier Inc. All rights reserved. FAU - Dinnes, Jacqueline AU - Dinnes J AD - Biostatistics, Evidence Synthesis and Test Evaluation Research Group, Institute for Applied Health Research, University of Birmingham, Edgbaston, Birmingham B15 2TT, UK. FAU - Mallett, Susan AU - Mallett S AD - Biostatistics, Evidence Synthesis and Test Evaluation Research Group, Institute for Applied Health Research, University of Birmingham, Edgbaston, Birmingham B15 2TT, UK. FAU - Hopewell, Sally AU - Hopewell S AD - Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford/Botnar Research Centre, Windmill Road, Oxford OX3 7LD, UK. FAU - Roderick, Paul J AU - Roderick PJ AD - Department of Public Health Sciences and Medical Statistics, University of Southampton, Southampton General Hospital, Tremona Road, Southampton SO16 6YD, UK. FAU - Deeks, Jonathan J AU - Deeks JJ AD - Biostatistics, Evidence Synthesis and Test Evaluation Research Group, Institute for Applied Health Research, University of Birmingham, Edgbaston, Birmingham B15 2TT, UK. Electronic address: j.deeks@bham.ac.uk. LA - eng PT - Journal Article PT - Research Support, Non-U.S. Gov't DEP - 20160730 PL - United States TA - J Clin Epidemiol JT - Journal of clinical epidemiology JID - 8801383 SB - IM MH - Diagnostic Tests, Routine/*standards/statistics & numerical data MH - Humans MH - *Meta-Analysis as Topic MH - Odds Ratio MH - ROC Curve MH - *Reproducibility of Results PMC - PMC5176007 OTO - NOTNLM OT - Diagnostic odds ratio OT - Diagnostic test accuracy OT - Hierarchical models OT - Meta-analysis OT - Summary ROC curves OT - Systematic review EDAT- 2016/10/30 06:00 MHDA- 2017/06/27 06:00 PMCR- 2016/12/01 CRDT- 2016/08/04 06:00 PHST- 2016/02/26 00:00 [received] PHST- 2016/06/18 00:00 [revised] PHST- 2016/07/23 00:00 [accepted] PHST- 2016/10/30 06:00 [pubmed] PHST- 2017/06/27 06:00 [medline] PHST- 2016/08/04 06:00 [entrez] PHST- 2016/12/01 00:00 [pmc-release] AID - S0895-4356(16)30258-X [pii] AID - 10.1016/j.jclinepi.2016.07.011 [doi] PST - ppublish SO - J Clin Epidemiol. 2016 Dec;80:77-87. doi: 10.1016/j.jclinepi.2016.07.011. Epub 2016 Jul 30.