PMID- 32014693
OWN - NLM
STAT- MEDLINE
DCOM- 20210813
LR  - 20210813
IS  - 1873-622X (Electronic)
IS  - 0005-7967 (Linking)
VI  - 126
DP  - 2020 Mar
TI  - Rigor and reproducibility for data analysis and design in the behavioral 
      sciences.
PG  - 103552
LID - S0005-7967(20)30003-6 [pii]
LID - 10.1016/j.brat.2020.103552 [doi]
AB  - The rigor and reproducibility of science methods depends heavily on the 
      appropriate use of statistical methods to answer research questions and make 
      meaningful and accurate inferences based on data. The increasing analytic 
      complexity and valuation of novel statistical and methodological approaches to 
      data place greater emphasis on statistical review. We will outline the 
      controversies within statistical sciences that threaten rigor and reproducibility 
      of research published in the behavioral sciences and discuss ongoing approaches 
      to generate reliable and valid inferences from data. We outline nine major areas 
      to consider for generally evaluating the rigor and reproducibility of published 
      articles and apply this framework to the 116 Behaviour Research and Therapy 
      (BRAT) articles published in 2018. The results of our analysis highlight a 
      pattern of missing rigor and reproducibility elements, especially 
      pre-registration of study hypotheses, links to statistical code/output, and 
      explicit archiving or sharing data used in analyses. We recommend reviewers 
      consider these elements in their peer review and that journals consider 
      publishing results of these rigor and reproducibility ratings with manuscripts to 
      incentivize authors to publish these elements with their manuscript.
CI  - Copyright (c) 2020 Elsevier Ltd. All rights reserved.
FAU - Hildebrandt, Tom
AU  - Hildebrandt T
AD  - Eating and Weight Disorders Program, Department of Psychiatry, Icahn School of 
      Medicine at Mount Sinai, New York, NY, USA. Electronic address: 
      tom.hildebrandt@mssm.edu.
FAU - Prenoveau, Jason M
AU  - Prenoveau JM
AD  - Department of Psychology, Loyola University, Maryland, USA.
LA  - eng
PT  - Journal Article
DEP - 20200116
PL  - England
TA  - Behav Res Ther
JT  - Behaviour research and therapy
JID - 0372477
SB  - IM
MH  - *Behavioral Sciences
MH  - *Data Analysis
MH  - Humans
MH  - Reproducibility of Results
MH  - *Research Design
OTO - NOTNLM
OT  - Big data
OT  - P-hacking
OT  - Reliability
OT  - Reproducibility
OT  - Statistics
COIS- Declaration of competing interest The authors declare no conflict of interest.
EDAT- 2020/02/06 06:00
MHDA- 2021/08/14 06:00
CRDT- 2020/02/05 06:00
PHST- 2019/02/09 00:00 [received]
PHST- 2020/01/02 00:00 [revised]
PHST- 2020/01/13 00:00 [accepted]
PHST- 2020/02/06 06:00 [pubmed]
PHST- 2021/08/14 06:00 [medline]
PHST- 2020/02/05 06:00 [entrez]
AID - S0005-7967(20)30003-6 [pii]
AID - 10.1016/j.brat.2020.103552 [doi]
PST - ppublish
SO  - Behav Res Ther. 2020 Mar;126:103552. doi: 10.1016/j.brat.2020.103552. Epub 2020 
      Jan 16.