Hostname: page-component-669899f699-b58lm Total loading time: 0 Render date: 2025-05-01T20:45:53.568Z Has data issue: false hasContentIssue false
  • English
  • Français

The utility of Chat Generative Pre-trained Transformer as a patient resource in paediatric otolaryngology

Published online by Cambridge University Press:  04 December 2024

Walter M Jongbloed Open the ORCID record for Walter M Jongbloed [Opens in a new window]  and
Nancy Grover
Walter M Jongbloed*
Affiliation:
Department of Otolaryngology – Head & Neck Surgery, UConn Health, Farmington, CT, USA
Nancy Grover
Affiliation:
Connecticut Children's Department of Otolaryngology, Hartford, CT 06106, USA
*
Corresponding author: Walter M. Jongbloed; Email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Objectives

This study aimed to determine the feasibility of using Chat Generative Pre-trained Transformer (ChatGPT) (https://chatgpt.com) as a patient resource for paediatric otolaryngology conditions and assess the quality of responses generated by ChatGPT when compared with information available on the internet.

Method

ChatGPT responses to common paediatric otolaryngology conditions were compared with top internet pages for readability (Flesch Reading Ease score, word count), expediency (time taken to generate response), validity (comparison of recommendations to the American Academy of Otolaryngology Head and Neck Surgery guidelines) and consistency (changes in recommendations based on question variation).

Results

ChatGPT was more expeditious in generating responses with fewer words, albeit with higher reading scores. When compared with accredited guidelines, there was no difference in validity between these sources (internet sources and ChatGPT). Consistent responses were obtained with question variation.

Conclusion

ChatGPT may be a valuable source for patients and families in providing valid information comparable to internet materials.

Keywords

artificial intelligencepatient education as topicobstructive sleep apnea
Type
Main Article
Information
The Journal of Laryngology & Otology , Volume 138 , Issue 11 , November 2024 , pp. 1115 - 1118
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press on behalf of J.L.O. (1984) LIMITED

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

Nancy Grover takes responsibility for the integrity of the content of the paper

Presented at the 2023 Society of Ear, Nose and Throat Advancement in Children Annual Meeting, 1 December 2023, Charleston, SC, USA.

References

Open AI. ChatGPT. In: https://chat.openai.com [17 October 2023]Google Scholar
Gilson, A, Safranek, CW, Huang, T, Socrates, V, Chi, L, Taylor, RA et al. How does ChatGPT perform on the United States Medical Licensing Examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ 2023;9:e45312CrossRefGoogle ScholarPubMed
Milmo, D. ChatGPT reaches 100 million users two months after launch. The Guardian, 2 February 2013. In: https://www.theguardian.com/technology/2023/feb/02/chatgpt-100-million-users-open-ai-fastest-growing-app#:~:text=ChatGPT%2C%20the%20popular%20artificial%20intelligence,analysis%20by%20data%20firm%20SimilarwebGoogle Scholar
Yee, D, Modiri, O, Shi, VY, Hsiao, JL. Readability, quality, and timeliness of online health resources for rosacea. Int J Dermatol 2021;60(3):e90–2CrossRefGoogle ScholarPubMed
Li, H, Moon, JT, Purkayastha, S, Celi, LA, Trivedi, H, Gichoya, JW. Ethics of large language models in medicine and medical research. Lancet Digital Health 2023;5(6):e333–5CrossRefGoogle Scholar
Lucy, L, Bamman, D. Gender and representation bias in GPT-3 generated stories. In: Proceedings of the Third Workshop on Narrative Understanding. : Association for Computational Linguistics, 2021;48–55CrossRefGoogle Scholar
Abid, A, Farooqi, M, Zou, J. Large language models associate Muslims with violence. Nat Mach Intell 2021;3:461–3CrossRefGoogle Scholar
Qu, RW, Qureshi, U, Petersen, G, Lee, SC. Diagnostic and management applications of ChatGPT in structured otolaryngology clinical scenarios. OTO Open 2023;7(3):e67CrossRefGoogle ScholarPubMed
Ayoub, NF, Lee, YJ, Grimm, D, Balakrishnan, K. Comparison between ChatGPT and Google search as sources of postoperative patient instructions. JAMA Otolaryngol Head Neck Surg 2023;149:556–8CrossRefGoogle ScholarPubMed
Vaira, LA, Lechien, JR, Abbate, V, Allevi, F, Audino, G, Beltramini, GA et al. Accuracy of ChatGPT-generated information on head and neck and oromaxillofacial surgery: a multicenter collaborative analysis. Otolaryngol Head Neck Surg 2024;170(6):1492–503CrossRefGoogle ScholarPubMed
Zhang, J, Zhang, Z. Ethics and governance of trustworthy medical artificial intelligence. BMC Med Inform Decis Mak 2023;23:7CrossRefGoogle ScholarPubMed
Dave, T, Athaluri, SA, Singh, S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell 2023;6:1169595CrossRefGoogle Scholar