PMID- 29889227 OWN - NLM STAT- MEDLINE DCOM- 20190723 LR - 20190723 IS - 1464-3677 (Electronic) IS - 1353-4505 (Linking) VI - 31 IP - 3 DP - 2019 Apr 1 TI - Establishing gold standards for System-Level Measures: a modified Delphi consensus process. PG - 205-211 LID - 10.1093/intqhc/mzy122 [doi] AB - OBJECTIVE: To establish aspirational 'gold standards' for a suite of System-Level Measures (SLMs) being used by Counties Manukau Health (CM Health), a New Zealand (NZ) District Health Board. DESIGN: This study employed a multi-stage, multi-method modified Delphi consensus process. SETTING: The Delphi consensus process involved virtual (email) communication between participants (Round 1) and a structured face-to-face meeting (Round 2) held in Auckland, NZ. PARTICIPANTS: Participants comprised of health professionals, managers, academics and quality improvement experts with an interest in the use of SLMs. INTERVENTIONS: Participants in the first round received a letter requesting their participation in an anonymous Delphi. The second round involved national and international health system experts taking part in a structured, facilitated face-to-face meeting. Participants reviewed 15 SLMs in total. The SLMs all related to the three domains of the Triple Aim: Population Health, e.g. life expectancy at birth; Patient Experience of Care, e.g. rate of adverse events; and Cost and Productivity, e.g. healthcare expenditure per capita. MAIN OUTCOME MEASURES: For a proposed gold standard to be agreed and established for each SLM. RESULTS: Twelve participants took part in Round 1, with 19 participating in Round 2. The process established agreement on a gold standard for each of the 15 reviewed SLMs. CONCLUSION: We demonstrated that the Delphi consensus process can be used to establish gold standards for a suite of SLMs used by a NZ Health Board (CM Health). CI - (c) The Author(s) 2018. Published by Oxford University Press in association with the International Society for Quality in Health Care. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com. FAU - Doolan-Noble, Fiona AU - Doolan-Noble F AD - Department of General Practice and Rural Health, Dunedin School of Medicine, University of Otago, Dunedin, New Zealand. FAU - Barson, Stuart AU - Barson S AD - Dean's Office, Otago Business School, University of Otago, Dunedin, New Zealand. FAU - Lyndon, M AU - Lyndon M AD - Ko Awatea, Middlemore Hospital, Counties Manukau Health, Auckland, New Zealand. FAU - Cullinane, F AU - Cullinane F AD - Operations Manager ORL/Audiology, Waitemata District Health Board, 15 Shea Terrace, Takapuna, Auckland, New Zealand. FAU - Gray, J AU - Gray J AD - Ko Awatea, Middlemore Hospital, Counties Manukau Health, Auckland, New Zealand. FAU - Stokes, T AU - Stokes T AD - Department of General Practice and Rural Health, Dunedin School of Medicine, University of Otago, Dunedin, New Zealand. FAU - Gauld, R AU - Gauld R AD - Dean's Office, Otago Business School, University of Otago, Dunedin, New Zealand. LA - eng PT - Journal Article PL - England TA - Int J Qual Health Care JT - International journal for quality in health care : journal of the International Society for Quality in Health Care JID - 9434628 MH - Consensus MH - Delivery of Health Care/*standards MH - *Delphi Technique MH - Humans MH - New Zealand MH - Quality Improvement MH - Quality Indicators, Health Care/*standards OTO - NOTNLM OT - benchmarking OT - health policy OT - healthcare system OT - measurement of quality OT - quality indicators EDAT- 2018/06/12 06:00 MHDA- 2019/07/25 06:00 CRDT- 2018/06/12 06:00 PHST- 2017/04/04 00:00 [received] PHST- 2018/02/04 00:00 [revised] PHST- 2018/05/17 00:00 [accepted] PHST- 2018/06/12 06:00 [pubmed] PHST- 2019/07/25 06:00 [medline] PHST- 2018/06/12 06:00 [entrez] AID - 5034838 [pii] AID - 10.1093/intqhc/mzy122 [doi] PST - ppublish SO - Int J Qual Health Care. 2019 Apr 1;31(3):205-211. doi: 10.1093/intqhc/mzy122.