PMID- 30852856 OWN - NLM STAT- MEDLINE DCOM- 20191216 LR - 20200225 IS - 2005-7288 (Electronic) IS - 2005-727X (Print) IS - 2005-727X (Linking) VI - 31 IP - 1 DP - 2019 Mar TI - The relationship between classical item characteristics and item response time on computer-based testing. PG - 1-9 LID - 10.3946/kjme.2019.113 [doi] AB - PURPOSE: This study investigated the relationship between the item response time (iRT) and classic item analysis indicators obtained from computer-based test (CBT) results and deduce students' problem-solving behavior using the relationship. METHODS: We retrospectively analyzed the results of the Comprehensive Basic Medical Sciences Examination conducted for 5 years by a CBT system in Dankook University College of Medicine. iRT is defined as the time spent to answer the question. The discrimination index and the difficulty level were used to analyze the items using classical test theory (CTT). The relationship of iRT and the CTT were investigated using a correlation analysis. An analysis of variance was performed to identify the difference between iRT and difficulty level. A regression analysis was conducted to examine the effect of the difficulty index and discrimination index on iRT. RESULTS: iRT increases with increasing difficulty index, and iRT tends to decrease with increasing discrimination index. The students' effort is increased when they solve difficult items but reduced when they are confronted with items with a high discrimination. The students' test effort represented by iRT was properly maintained when the items have a 'desirable' difficulty and a 'good' discrimination. CONCLUSION: The results of our study show that an adequate degree of item difficulty and discrimination is required to increase students' motivation. It might be inferred that with the combination of CTT and iRT, we can gain insights about the quality of the examination and test behaviors of the students, which can provide us with more powerful tools to improve them. FAU - Chae, Yoo-Mi AU - Chae YM AD - Department of Medical Education, Dankook University College of Medicine, Cheonan, Korea. FAU - Park, Seok Gun AU - Park SG AD - Department of Medical Education, Dankook University College of Medicine, Cheonan, Korea. AD - Department of Nuclear Medicine, Dankook University College of Medicine, Cheonan, Korea. FAU - Park, Ilyong AU - Park I AD - Department of Biomedical Engineering, Dankook University College of Medicine, Cheonan, Korea. LA - eng PT - Journal Article DEP - 20190301 PL - Korea (South) TA - Korean J Med Educ JT - Korean journal of medical education JID - 101503071 SB - IM MH - *Computers MH - *Education, Medical MH - Educational Measurement/*methods/standards MH - Female MH - Humans MH - Male MH - Motivation MH - *Problem Solving MH - Psychometrics MH - *Reaction Time MH - Republic of Korea MH - Retrospective Studies MH - *Schools, Medical MH - Students/*psychology MH - Universities PMC - PMC6589631 OTO - NOTNLM OT - Computer-based test OT - Difficulty index OT - Discrimination index OT - Item response time COIS- Conflicts of interest No potential conflict of interest relevant to this article was reported. The authors alone are responsible for the content and writing of the paper. EDAT- 2019/03/12 06:00 MHDA- 2019/12/18 06:00 PMCR- 2019/03/01 CRDT- 2019/03/12 06:00 PHST- 2018/10/31 00:00 [received] PHST- 2019/01/09 00:00 [accepted] PHST- 2019/03/12 06:00 [entrez] PHST- 2019/03/12 06:00 [pubmed] PHST- 2019/12/18 06:00 [medline] PHST- 2019/03/01 00:00 [pmc-release] AID - kjme.2019.113 [pii] AID - kjme-2019-113 [pii] AID - 10.3946/kjme.2019.113 [doi] PST - ppublish SO - Korean J Med Educ. 2019 Mar;31(1):1-9. doi: 10.3946/kjme.2019.113. Epub 2019 Mar 1.