PMID- 24463334 OWN - NLM STAT- MEDLINE DCOM- 20161114 LR - 20171116 IS - 1460-2237 (Electronic) IS - 0268-1080 (Linking) VI - 30 IP - 2 DP - 2015 Mar TI - Can health workers reliably assess their own work? A test-retest study of bias among data collectors conducting a Lot Quality Assurance Sampling survey in Uganda. PG - 181-6 LID - 10.1093/heapol/czt110 [doi] AB - BACKGROUND: Lot Quality Assurance Sampling (LQAS) is a classification method that enables local health staff to assess health programmes for which they are responsible. While LQAS has been favourably reviewed by the World Bank and World Health Organization (WHO), questions remain about whether using local health staff as data collectors can lead to biased data. METHODS: In this test-retest research, Pallisa Health District in Uganda is subdivided into four administrative units called supervision areas (SA). Data collectors from each SA conducted an LQAS survey. A week later, the data collectors were swapped to a different SA, outside their area of responsibility, to repeat the LQAS survey with the same respondents. The two data sets were analysed for agreement using Cohens' kappa coefficient and disagreements were analysed. RESULTS: Kappa values ranged from 0.19 to 0.97. On average, there was a moderate degree of agreement for knowledge indicators and a substantial level for practice indicators. Respondents were found to be systematically more knowledgeable on retest indicating bias favouring the retest, although no evidence of bias was found for practices indicators. CONCLUSIONS: In this initial study, using local health care providers to collect data did not bias data collection. The bias observed in the knowledge indicators is most likely due to the 'practice effect', whereby respondents increased their knowledge as a result of completing the first survey, as no corresponding effect was seen in the practices indicators. CI - Published by Oxford University Press in association with The London School of Hygiene and Tropical Medicine (c) The Author 2014; all rights reserved. FAU - Beckworth, Colin A AU - Beckworth CA AD - Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, L3 5QA, UK cab@liverpool.ac.uk. FAU - Davis, Rosemary H AU - Davis RH AD - Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, L3 5QA, UK. FAU - Faragher, Brian AU - Faragher B AD - Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, L3 5QA, UK. FAU - Valadez, Joseph J AU - Valadez JJ AD - Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, L3 5QA, UK. LA - eng PT - Journal Article PT - Research Support, U.S. Gov't, Non-P.H.S. DEP - 20140124 PL - England TA - Health Policy Plan JT - Health policy and planning JID - 8610614 MH - Bias MH - Data Collection MH - Delivery of Health Care/*standards/statistics & numerical data MH - Health Personnel/psychology/*standards MH - Humans MH - Lot Quality Assurance Sampling MH - Reproducibility of Results MH - Uganda OTO - NOTNLM OT - Cohen's kappa OT - Lot Quality Assurance Sampling OT - bias OT - test-retest EDAT- 2014/01/28 06:00 MHDA- 2016/11/15 06:00 CRDT- 2014/01/28 06:00 PHST- 2014/01/28 06:00 [entrez] PHST- 2014/01/28 06:00 [pubmed] PHST- 2016/11/15 06:00 [medline] AID - czt110 [pii] AID - 10.1093/heapol/czt110 [doi] PST - ppublish SO - Health Policy Plan. 2015 Mar;30(2):181-6. doi: 10.1093/heapol/czt110. Epub 2014 Jan 24.