A Comparative Evaluation of ChatGPT and Google Search Output for Caregiver Education in Tetralogy of Fallot.

IF 3.2 Q2 CARDIAC & CARDIOVASCULAR SYSTEMS

Cardiology and Therapy Pub Date : 2026-10-07 DOI:10.1007/s40119-026-00481-5

Shreyas V Menon, Armaun D Rouhi, Jason J Han

{"title":"A Comparative Evaluation of ChatGPT and Google Search Output for Caregiver Education in Tetralogy of Fallot.","authors":"Shreyas V Menon, Armaun D Rouhi, Jason J Han","doi":"10.1007/s40119-026-00481-5","DOIUrl":null,"url":null,"abstract":"Introduction: Caregivers of children with tetralogy of Fallot (TOF) frequently seek medical information online to better understand their child's diagnosis, treatment, and long-term care. Recently, generative artificial intelligence (AI) tools, including Google AI Overview and ChatGPT, have emerged as widely accessible sources of health information. However, the quality, readability, and accuracy of these platforms for caregiver education in congenital heart disease remain poorly characterized.Methods: Forty frequently asked caregiver questions regarding TOF were identified using Google's \"People Also Ask\" feature. Each question was submitted to ChatGPT-5.5 and entered as a Google search query, generating 80 total responses. Google search output comprised 37 AI Overviews and three organic search excerpts. Responses were evaluated for word count, Flesch Reading Ease (FRE), and Flesch-Kincaid grade level (FKGL). Two independent reviewers assessed response accuracy using a 5-point Likert scale, while one reviewer evaluated educational quality using a modified Ensuring Quality Information for Patients (EQIP) instrument.Results: Compared with Google search output (37 AI Overviews and three organic search excerpts), ChatGPT-5.5 generated significantly longer responses (327.9 ± 117.0 vs. 192.5 ± 85.9 words, p < 0.001), with a higher reading level (FKGL: 23.7 ± 8.5 vs. 15.4 ± 3.6, p < 0.001) and lower readability (FRE: 17.3 ± 14.9 vs. 27.4 ± 11.7, p < 0.001). ChatGPT-5.5 demonstrated higher reviewer-rated accuracy (4.95 ± 0.19 vs. 4.40 ± 0.44, p < 0.001) and higher modified EQIP scores (86.44% ± 7.01% vs. 59.62% ± 13.99%, p < 0.001).Conclusions: Under the study's prompting conditions, ChatGPT-5.5 responses received higher reviewer-rated accuracy and modified EQIP scores than Google search output but were longer and had higher calculated reading-grade levels. These findings do not establish improved caregiver comprehension, which was not directly assessed.","PeriodicalId":9561,"journal":{"name":"Cardiology and Therapy","volume":" ","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2026-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cardiology and Therapy","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s40119-026-00481-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CARDIAC & CARDIOVASCULAR SYSTEMS","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction: Caregivers of children with tetralogy of Fallot (TOF) frequently seek medical information online to better understand their child's diagnosis, treatment, and long-term care. Recently, generative artificial intelligence (AI) tools, including Google AI Overview and ChatGPT, have emerged as widely accessible sources of health information. However, the quality, readability, and accuracy of these platforms for caregiver education in congenital heart disease remain poorly characterized.

Methods: Forty frequently asked caregiver questions regarding TOF were identified using Google's "People Also Ask" feature. Each question was submitted to ChatGPT-5.5 and entered as a Google search query, generating 80 total responses. Google search output comprised 37 AI Overviews and three organic search excerpts. Responses were evaluated for word count, Flesch Reading Ease (FRE), and Flesch-Kincaid grade level (FKGL). Two independent reviewers assessed response accuracy using a 5-point Likert scale, while one reviewer evaluated educational quality using a modified Ensuring Quality Information for Patients (EQIP) instrument.

Results: Compared with Google search output (37 AI Overviews and three organic search excerpts), ChatGPT-5.5 generated significantly longer responses (327.9 ± 117.0 vs. 192.5 ± 85.9 words, p < 0.001), with a higher reading level (FKGL: 23.7 ± 8.5 vs. 15.4 ± 3.6, p < 0.001) and lower readability (FRE: 17.3 ± 14.9 vs. 27.4 ± 11.7, p < 0.001). ChatGPT-5.5 demonstrated higher reviewer-rated accuracy (4.95 ± 0.19 vs. 4.40 ± 0.44, p < 0.001) and higher modified EQIP scores (86.44% ± 7.01% vs. 59.62% ± 13.99%, p < 0.001).

Conclusions: Under the study's prompting conditions, ChatGPT-5.5 responses received higher reviewer-rated accuracy and modified EQIP scores than Google search output but were longer and had higher calculated reading-grade levels. These findings do not establish improved caregiver comprehension, which was not directly assessed.

查看原文本刊更多论文

ChatGPT与谷歌搜索输出在法洛四联症护理者教育中的比较评价。

儿童法洛四联症（TOF）的照顾者经常在网上寻找医疗信息，以更好地了解他们孩子的诊断、治疗和长期护理。最近，包括b谷歌AI Overview和ChatGPT在内的生成式人工智能（AI）工具已成为可广泛获取的卫生信息来源。然而，这些平台对先天性心脏病护理人员教育的质量、可读性和准确性仍然很差。方法：使用b谷歌的“人们也问”功能确定了40个关于TOF的常见护理问题。每个问题都提交给ChatGPT-5.5，并作为谷歌搜索查询输入，总共产生80个回答。谷歌搜索输出包括37个AI概述和3个有机搜索摘录。通过字数、Flesch Reading Ease （FRE）和Flesch- kincaid grade level （FKGL）对应答进行评估。两名独立审稿人使用5分李克特量表评估反应准确性，而一名审稿人使用改进的确保患者质量信息（EQIP）工具评估教育质量。结果：与谷歌搜索输出（37个AI概述和3个有机搜索摘要）相比，ChatGPT-5.5产生的回答明显更长（327.9±117.0 vs. 192.5±85.9单词），p结论：在研究的提示条件下，ChatGPT-5.5的回答比谷歌搜索输出具有更高的审稿人评分准确性和修改后的EQIP分数，但更长，计算阅读等级水平更高。这些发现并没有建立改善照顾者的理解，这不是直接评估。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Cardiology and Therapy CARDIAC & CARDIOVASCULAR SYSTEMS-

CiteScore

5.30

自引率

0.00%

发文量

审稿时长

6 weeks

期刊介绍： Aims and Scope Cardiology and Therapy is an international, open access, peer reviewed (single-blind), rapid-publication journal dedicated to the publication of high-quality clinical (all phases), observational, real-world, and health outcomes research around the discovery, development, and use of cardiovascular therapies and interventions, including devices. Studies relating to diagnosis and diagnostics, pharmacoeconomics, public health, quality of life, as well as patient care, management and education are also encouraged. Areas of focus include, but are not limited to, ischaemic heart disease and acute cardiac care, myocardial, valvular, pericardial and congenital heart disease, vascular and pulmonary disease (including hypertension), arrhythmias, heart failure, non-invasive diagnostic techniques, and invasive and interventional cardiology as well as cardiovascular surgery. The journal is of interest to a broad audience of pharmaceutical and healthcare professionals and publishes original research, reviews, case reports/case series, trial protocols and short communications such as commentaries and editorials. Cardiolology and Therapy will consider all scientifically sound research be it positive, confirmatory or negative data. Submissions are welcomed whether they relate to an international and/or a country-specific audience, something that is crucially important when researchers are trying to target more specific patient populations. This inclusive approach allows the journal to assist in the dissemination of quality research, which may be considered of insufficient interest by other journals. Rapid Publication The journal’s publication timelines aim for a rapid peer review of 2 weeks. If an article is accepted it will be published 3–4 weeks from acceptance. The rapid timelines are achieved through the combination of a dedicated in-house editorial team, who manage article workflow, and an extensive Editorial and Advisory Board who assist with peer review. This allows the journal to support the rapid dissemination of research, whilst still providing robust peer review. Combined with the journal’s open access model this allows for the rapid, efficient communication of the latest research and reviews, fostering the advancement of cardiovascular therapies. Personal Service The journal’s dedicated in-house editorial team offer a personal “concierge service” meaning authors will always have an editorial contact able to update them on the status of their manuscript. The editorial team check all manuscripts to ensure that articles conform to the most recent COPE, GPP and ICMJE publishing guidelines. This supports the publication of ethically sound and transparent research. Digital Features and Plain Language Summaries Cardiology and Therapy offers a range of additional features designed to increase the visibility, readership and educational value of the journal’s content. Each article is accompanied by key summary points, giving a time-efficient overview of the content to a wide readership. Articles may be accompanied by plain language summaries to assist readers who have some knowledge of, but not in-depth expertise in, the area to understand the scientific content and overall implications of the article. The journal also provides the option to include various types of digital features including animated abstracts, video abstracts, slide decks, audio slides, instructional videos, infographics, podcasts and animations. All additional features are peer reviewed to the same high standard as the article itself. If you consider that your paper would benefit from the inclusion of a digital feature, please let us know. Our editorial team are able to create high-quality slide decks and infographics in-house, and video abstracts through our partner Research Square, and would be happy to assist in any way we can. For further information about digital features, please contact the journal editor (see ‘Contact the Journal’ for email address), and see the ‘Guidelines for digital features and plain language summaries’ document under ‘Submission guidelines’. For examples of digital features please visit our showcase page https://springerhealthcare.com/expertise/publishing-digital-features/ Publication Fees Upon acceptance of your article for publication, authors will be required to pay the mandatory Rapid Service Fee of £3650/€4500/$5100. The journal will consider fee discounts for developing countries and this is decided on a case by case basis. Open Access All articles published by Cardiology and Therapy are published open access. Peer Review Process Upon submission, manuscripts are assessed by the editorial team to ensure they fit within the aims and scope of the journal and are also checked for plagiarism. All suitable submissions are then subject to a comprehensive single-blind peer review. Reviewers are selected based on their relevant expertise and publication history in the subject area. The journal has an extensive pool of editorial and advisory board members who have been selected to assist with peer review based on the afore-mentioned criteria. At least two extensive reviews are required to make the editorial decision, with the exception of some article types such as Commentaries, Editorials and Letters which are generally reviewed by one member of the Editorial Board. Where reviewer recommendations are conflicted, the editorial board will be contacted for further advice and a presiding decision. Manuscripts are then either accepted, rejected or authors are required to make major or minor revisions (both reviewer comments and editorial comments may need to be addressed). Once a revised manuscript is re-submitted, it is assessed along with the responses to reviewer comments and if it has been adequately revised it will be accepted for publication. Accepted manuscripts are then copyedited and typeset by the production team before online publication. Appeals against decisions following peer review are considered on a case by case basis and should be sent to the journal editor. Preprints We encourage posting of preprints of primary research manuscripts on preprint servers, authors’ or institutional websites, and open communications between researchers whether on community preprint servers or preprint commenting platforms. Posting of preprints is not considered prior publication and will not jeopardize consideration in our journals. Authors should disclose details of preprint posting during the submission process or at any other point during consideration in one of our journals. Once the preprint is published, it is the author’s responsibility to ensure that the preprint record is updated with a publication reference, including the DOI and a URL link to the published version of the article on the journal website. Copyright Cardiology and Therapy is published under the Creative Commons Attribution-Noncommercial License, which allows users to read, copy, distribute, and make derivative works for non-commercial purposes from the material, as long as the author of the original work is cited. The author assigns the exclusive right to any commercial use of the article to Springer. For more information about the Creative Commons Attribution-Noncommercial License, click here: http://creativecommons.org/licenses/by-nc/4.0. Contact For more information about the journal, including pre-submission enquiries, please contact matthew.evans@springer.com