Performance of ChatGPT-3.5 and ChatGPT-4 in the Taiwan National Pharmacist Licensing Examination: Comparative Evaluation Study

Performance of ChatGPT-3.5 and ChatGPT-4 in the Taiwan National Pharmacist Licensing Examination: Comparative Evaluation Study

Blog Article

Abstract BackgroundOpenAI released versions ChatGPT-3.5 and GPT-4 between 2022 and 2023.GPT-3.

5 has demonstrated proficiency in various examinations, particularly the United States Medical Licensing Examination.However, GPT-4 has more advanced capabilities.ObjectiveThis study aims to examine the efficacy of GPT-3.

5 and GPT-4 within the Taiwan National Pharmacist Licensing Examination and to ascertain their utility and potential application in clinical pharmacy and education.MethodsThe pharmacist examination in Taiwan consists of 2 stages: basic subjects and clinical subjects.In this study, exam questions were canine spectra kc 3 intranasal single dose manually fed into the GPT-3.

5 and GPT-4 models, and their responses were recorded; graphic-based questions were excluded.This study encompassed three steps: (1) determining the answering accuracy of GPT-3.5 and GPT-4, (2) categorizing question types and observing differences in model performance across these categories, and (3) comparing model performance on calculation and situational questions.

Microsoft Excel and R software were used for statistical analyses.ResultsGPT-4 achieved an accuracy rate of 72.9%, overshadowing GPT-3.

5, which achieved 59.1% (PP ConclusionsThis study demonstrates that GPT-4 outperforms GPT-3.5 in the Taiwan National Pharmacist Licensing Examination, particularly in basic subjects.

While GPT-4 shows potential for use in clinical practice and pharmacy education, ilootpaperie its limitations warrant caution.Future research should focus on refining prompts, improving model stability, integrating medical databases, and designing questions that better assess student competence and minimize guessing.