Evaluation of information provided to patients by ChatGPT about chronic diseases in Spanish language

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

Introduction: Artificial intelligence has presented exponential growth in medicine. The ChatGPT language model has been highlighted as a possible source of patient information. This study evaluates the reliability and readability of ChatGPT-generated patient information on chronic diseases in Spanish. Methods: Questions frequently asked by patients on the internet about diabetes mellitus, heart failure, rheumatoid arthritis (RA), chronic kidney disease (CKD), and systemic lupus erythematosus (SLE) were submitted to ChatGPT. Reliability was assessed by rating responses as (1) comprehensive, (2) correct but inadequate, (3) some correct and some incorrect, (4) completely incorrect, and divided between “good” (1 and 2) and “bad” (3 and 4). Readability was evaluated with the adapted Flesch and Szigriszt formulas. Results: And 71.67% of the answers were “good,” with none qualified as “completely incorrect.” Better reliability was observed in questions on diabetes and RA versus heart failure (p = 0.02). In readability, responses were “moderately difficult” (54.73, interquartile range (IQR) 51.59–58.58), with better results for CKD (median 56.1, IQR 53.5–59.1) and RA (56.4, IQR 53.7–60.7), than for heart failure responses (median 50.6, IQR 46.3–53.8). Conclusion: Our study suggests that the ChatGPT tool can be a reliable source of information in spanish for patients with chronic diseases with different reliability for some of them, however, it needs to improve the readability of its answers to be recommended as a useful tool for patients.

Original languageEnglish
Pages (from-to)1-7
Number of pages7
JournalDigital Health
Volume10
DOIs
StatePublished - 02 Jan 2024

Keywords

  • Artificial intelligence
  • ChatGPT
  • chronic diseases
  • readability
  • reliability

Fingerprint

Dive into the research topics of 'Evaluation of information provided to patients by ChatGPT about chronic diseases in Spanish language'. Together they form a unique fingerprint.

Cite this