PMID- 29569403 OWN - NLM STAT- MEDLINE DCOM- 20190614 LR - 20200225 IS - 1521-0391 (Electronic) IS - 1055-0496 (Print) IS - 1055-0496 (Linking) VI - 27 IP - 3 DP - 2018 Apr TI - Generalizability of the findings from a randomized controlled trial of a web-based substance use disorder intervention. PG - 231-237 LID - 10.1111/ajad.12714 [doi] AB - BACKGROUND AND OBJECTIVES: There is growing concern regarding the generalizability of findings from randomized controlled trials (RCTs) of interventions for substance use disorders (SUDs). This study used a selection model approach to assess and improve the generalizability of an evaluation for a web-based SUD intervention by making the trial sample resemble the target population. METHODS: The sample of the web-based SUD intervention (Therapeutic Education System vs. Treatment-as-usual; n = 507) was compared with the target population of SUD treatment-seeking individuals from the Treatment Episodes Data Set-Admissions (TEDS-A). Using weights based on the probabilities of RCT participation, we computed weighted treatment effects on retention and abstinence. RESULTS: Substantial differences between the RCT sample and the target population was demonstrated in significant difference in the mean propensity scores (1.62 standard deviations at p < .001). The population effect on abstinence (12 weeks and 6 months) was statistically insignificant after weighting the data with the generalizability weight. DISCUSSIONS AND CONCLUSIONS: Generalizability of the findings from the RCT could be limited when the RCT sample does not well represent the target population. SCIENTIFIC SIGNIFICANCE: Application of generalizability weights can be a potentially useful tool to improve generalizability of RCT findings. (Am J Addict 2018;27:231-237). CI - (c) 2018 American Academy of Addiction Psychiatry. FAU - Susukida, Ryoko AU - Susukida R AUID- ORCID: 0000-0003-0444-5368 AD - Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Baltimore, Maryland 21205. AD - Department of Mental Health Policy and Evaluation, National Center of Neurology and Psychiatry, National Institute of Mental Health, 4-1-1 Ogawa-Higashi, Kodaira, Tokyo 187-8551, Japan. FAU - Crum, Rosa M AU - Crum RM AD - Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Baltimore, Maryland 21205. AD - Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe St., Baltimore, Maryland 21205. AD - Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, 600 N. Wolfe St., Baltimore, Maryland 21287. FAU - Stuart, Elizabeth A AU - Stuart EA AD - Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Baltimore, Maryland 21205. AD - Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, 615 N. Broadway, Baltimore, Maryland 21205. AD - Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Baltimore, Maryland 21205. FAU - Mojtabai, Ramin AU - Mojtabai R AD - Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Baltimore, Maryland 21205. AD - Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, 600 N. Wolfe St., Baltimore, Maryland 21287. LA - eng GR - R01 DA036520/DA/NIDA NIH HHS/United States PT - Journal Article PT - Randomized Controlled Trial PT - Research Support, N.I.H., Extramural DEP - 20180323 PL - England TA - Am J Addict JT - The American journal on addictions JID - 9208821 SB - IM MH - Adult MH - Bias MH - Computer Communication Networks MH - Data Collection/methods MH - Education, Distance/*methods MH - Female MH - Generalization, Psychological MH - *Help-Seeking Behavior MH - Humans MH - Male MH - Middle Aged MH - Patient Education as Topic/*methods MH - Patient Selection MH - *Substance-Related Disorders/psychology/therapy MH - Treatment Outcome PMC - PMC6548718 MID - NIHMS1032354 EDAT- 2018/03/24 06:00 MHDA- 2019/06/15 06:00 PMCR- 2019/06/05 CRDT- 2018/03/24 06:00 PHST- 2017/08/25 00:00 [received] PHST- 2017/12/22 00:00 [revised] PHST- 2018/03/03 00:00 [accepted] PHST- 2018/03/24 06:00 [pubmed] PHST- 2019/06/15 06:00 [medline] PHST- 2018/03/24 06:00 [entrez] PHST- 2019/06/05 00:00 [pmc-release] AID - 10.1111/ajad.12714 [doi] PST - ppublish SO - Am J Addict. 2018 Apr;27(3):231-237. doi: 10.1111/ajad.12714. Epub 2018 Mar 23.