Chat Generated Pre-Trained Transformer를 통해 얻은 알레르기 비염 정보를 믿을 수 있을까? (Can We Trust the Information on Allergic Rhinitis From Chat Generated Pre-Trained Transformer?)

서지정보

· 발행기관 : 대한이비인후과학회
· 수록지 정보 : 대한이비인후-두경부외과학회지 / 67권 / 3호 / 146 ~ 151페이지
· 저자명 : 이상재, 나형균, 최윤석, 배창훈, 송시연, 김용대

초록

Background and Objectives Chat Generated Pre-Trained Transformer (ChatGPT) is alarge language model, which allows consumers to get information with one simple questionfor free. There are few studies that reported the reliability and usefullness of ChatGPT in thefield of otorhinolarynoglogy, so we would like to investigate the reliability of informationabout allergic rhinitis generated by ChatGPT.
Materials and Method We asked ChatGPT 35 questions related to allergic rhinitis based onthe textbook from Korean Society of Otorhinolaryngology-Head and Neck Surgery, the clini-cal guidelines of American Academy of Otolaryngology-Head and Neck Surgery, and theguidelines of Allergic Rhinitis and Its impact on Asthma, and recorded the generated answers.
Five specialists from our department were shown the answers in a blind test to assess their re-liability. Each question was rated either ‘accurate’ or ‘inaccurate,’ and if the contents were notfound in the textbook or the guideline, it was rated as ‘unreliable.’Results Of the 35 questions, 26 (74%) were identified as ‘accurate,’ 9 (26%) were ‘inaccu-rate,’ and 0 (0%) were ‘unreliable.’ Questions about epidemiology, causes, diagnosis, andprognosis were found to be more accurate than the average, whereas definitions and treat-ments were less accurate than the average.
Conclusion The information about allergic rhinitis generated by ChatGPT was quite reli-able, showing that ChatGPT can be helpful in understanding and treating the disease. It isnecessary to use the developing medical artificial intelligence wisely.

영어초록

Background and Objectives Chat Generated Pre-Trained Transformer (ChatGPT) is alarge language model, which allows consumers to get information with one simple questionfor free. There are few studies that reported the reliability and usefullness of ChatGPT in thefield of otorhinolarynoglogy, so we would like to investigate the reliability of informationabout allergic rhinitis generated by ChatGPT.
Materials and Method We asked ChatGPT 35 questions related to allergic rhinitis based onthe textbook from Korean Society of Otorhinolaryngology-Head and Neck Surgery, the clini-cal guidelines of American Academy of Otolaryngology-Head and Neck Surgery, and theguidelines of Allergic Rhinitis and Its impact on Asthma, and recorded the generated answers.
Five specialists from our department were shown the answers in a blind test to assess their re-liability. Each question was rated either ‘accurate’ or ‘inaccurate,’ and if the contents were notfound in the textbook or the guideline, it was rated as ‘unreliable.’Results Of the 35 questions, 26 (74%) were identified as ‘accurate,’ 9 (26%) were ‘inaccu-rate,’ and 0 (0%) were ‘unreliable.’ Questions about epidemiology, causes, diagnosis, andprognosis were found to be more accurate than the average, whereas definitions and treat-ments were less accurate than the average.
Conclusion The information about allergic rhinitis generated by ChatGPT was quite reli-able, showing that ChatGPT can be helpful in understanding and treating the disease. It isnecessary to use the developing medical artificial intelligence wisely.

참고자료

· 없음