PMID- 11591433
OWN - NLM
STAT- MEDLINE
DCOM- 20011211
LR  - 20191210
IS  - 0022-3956 (Print)
IS  - 0022-3956 (Linking)
VI  - 35
IP  - 5
DP  - 2001 Sep-Oct
TI  - Maintaining reliability in a long-term psychiatric study: an ongoing inter-rater 
      reliability monitoring program using the longitudinal interval follow-up 
      evaluation.
PG  - 297-305
AB  - The Longitudinal Interval Follow-up Evaluation (LIFE), has been shown to be a 
      valid and reliable instrument for characterizing the week-by-week course of 
      anxiety disorders examined retrospectively over the period of 1 year. Due to the 
      chronic nature of these disorders, there is a need for reliable, valid 
      instruments for measuring course over periods of several years if we are to learn 
      more about the natural history of these disorders. This paper describes a 
      rater-monitoring program designed to ensure long-term inter-rater reliability and 
      prevent "rater drift". In this program, clinical interviewers score taped 
      interviews and are required to maintain a median intra-class correlation 
      coefficient (ICC) of at least 0.80 with the other raters. Raters also assess 
      tapes from previous years, to ensure that they are using the same diagnostic 
      criteria as earlier generations of interviewers. A reliability study was 
      conducted to compare psychiatric status ratings (PSRs) collected using biweekly 
      telephone interviews with the semi-annual interviews. The ICCs for panic, 
      agoraphobia, social phobia, and generalized anxiety disorder were very good to 
      excellent. Another reliability study examined the PSRs of subjects who had been 
      previously lost to follow-up. ICCs for panic, agoraphobia, generalized anxiety 
      disorder and depression were good to excellent. These results show that the LIFE, 
      when used in conjunction with an intensive training and rater monitoring system, 
      is a reliable instrument for use in longitudinal studies of the course of anxiety 
      disorders.
FAU - Warshaw, M G
AU  - Warshaw MG
AD  - Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA 
      Boston Healthcare System (151MAV), Jamaica Plain, MA 02130, USA. 
      mwarshaw@alum.mit.edu
FAU - Dyck, I
AU  - Dyck I
FAU - Allsworth, J
AU  - Allsworth J
FAU - Stout, R L
AU  - Stout RL
FAU - Keller, M B
AU  - Keller MB
LA  - eng
GR  - R01 MH025478/MH/NIMH NIH HHS/United States
GR  - R01 MH051415/MH/NIMH NIH HHS/United States
GR  - R01 MH059691/MH/NIMH NIH HHS/United States
PT  - Evaluation Study
PT  - Journal Article
PT  - Research Support, Non-U.S. Gov't
PL  - England
TA  - J Psychiatr Res
JT  - Journal of psychiatric research
JID - 0376331
SB  - IM
MH  - Adult
MH  - Anxiety Disorders/diagnosis/*psychology
MH  - Humans
MH  - Interviews as Topic
MH  - *Longitudinal Studies
MH  - Observer Variation
MH  - Reproducibility of Results
MH  - Research Design
MH  - Retrospective Studies
MH  - Telephone
EDAT- 2001/10/10 10:00
MHDA- 2002/01/05 10:01
CRDT- 2001/10/10 10:00
PHST- 2001/10/10 10:00 [pubmed]
PHST- 2002/01/05 10:01 [medline]
PHST- 2001/10/10 10:00 [entrez]
AID - S0022-3956(01)00030-9 [pii]
AID - 10.1016/s0022-3956(01)00030-9 [doi]
PST - ppublish
SO  - J Psychiatr Res. 2001 Sep-Oct;35(5):297-305. doi: 10.1016/s0022-3956(01)00030-9.