PMID- 9112469 OWN - NLM STAT- MEDLINE DCOM- 19970508 LR - 20190708 IS - 0360-3016 (Print) IS - 0360-3016 (Linking) VI - 37 IP - 3 DP - 1997 Feb 1 TI - Automated planning target volume generation: an evaluation pitting a computer-based tool against human experts. PG - 697-704 AB - PURPOSE: Software tools are seeing increased use in three-dimensional treatment planning. However, the development of these tools frequently omits careful evaluation before placing them in clinical use. This study demonstrates the application of a rigorous evaluation methodology using blinded peer review to an automated software tool that produces ICRU-50 planning target volumes (PTVs). METHODS AND MATERIALS: Seven physicians from three different institutions involved in three-dimensional treatment planning participated in the evaluation. Four physicians drew partial PTVs on nine test cases, consisting of four nasopharynx and five lung primaries. Using the same information provided to the human experts, the computer tool generated PTVs for comparison. The remaining three physicians, designated evaluators, individually reviewed the PTVs for acceptability. To exclude bias, the evaluators were blinded to the source (human or computer) of the PTVs they reviewed. Their scorings of the PTVs were statistically examined to determine if the computer tool performed as well as the human experts. RESULTS: The computer tool was as successful as the human experts in generating PTVs. Failures were primarily attributable to insufficient margins around the clinical target volume and to encroachment upon critical structures. In a qualitative analysis, the human and computer experts displayed similar types and distributions of errors. CONCLUSIONS: Rigorous evaluation of computer-based radiotherapy tools requires comparison to current practice and can reveal areas for improvement before the tool enters clinical practice. FAU - Ketting, C H AU - Ketting CH AD - Department of Radiation Medicine, Loma Linda University Medical Center, CA, USA. FAU - Austin-Seymour, M AU - Austin-Seymour M FAU - Kalet, I AU - Kalet I FAU - Jacky, J AU - Jacky J FAU - Kromhout-Schiro, S AU - Kromhout-Schiro S FAU - Hummel, S AU - Hummel S FAU - Unger, J AU - Unger J FAU - Fagan, L M AU - Fagan LM FAU - Griffin, T AU - Griffin T LA - eng GR - LM04174-08/LM/NLM NIH HHS/United States GR - N01-CM97566/CM/NCI NIH HHS/United States PT - Comparative Study PT - Journal Article PT - Research Support, U.S. Gov't, P.H.S. PL - United States TA - Int J Radiat Oncol Biol Phys JT - International journal of radiation oncology, biology, physics JID - 7603616 SB - IM MH - *Expert Systems MH - Humans MH - Lung Neoplasms/radiotherapy MH - Nasopharyngeal Neoplasms/radiotherapy MH - Observer Variation MH - *Radiotherapy Dosage MH - Radiotherapy Planning, Computer-Assisted/*methods MH - Regression Analysis MH - Reproducibility of Results EDAT- 1997/02/01 00:00 MHDA- 1997/02/01 00:01 CRDT- 1997/02/01 00:00 PHST- 1997/02/01 00:00 [pubmed] PHST- 1997/02/01 00:01 [medline] PHST- 1997/02/01 00:00 [entrez] AID - S0360301696005627 [pii] AID - 10.1016/s0360-3016(96)00562-7 [doi] PST - ppublish SO - Int J Radiat Oncol Biol Phys. 1997 Feb 1;37(3):697-704. doi: 10.1016/s0360-3016(96)00562-7.