Use of GenAI to Obtain Public Information on Plastic and Reconstructive Surgery Procedures: A Focus on Migraine Surgery

Abstract

Background: In recent years, Generative Artificial Intelligence (GenAI) technologies have seen rapid development and widespread public release. These tools are now accessible to both professional researchers and the general public, offering new ways to obtain information across a wide range of disciplines, including medicine. Given their growing presence in clinical and academic environments, it is important to understand the reliability and scientific rigor of the information these platforms provide. The aim of this study was to evaluate the quality, accuracy, depth and readability of responses generated by nine widely available GenAI tools when asked to describe the indications, outcomes, potential complications of migraine surgery and the available alternatives. Methods: Nine most prominent and widely used GenAI platforms—ChatGPT, Gemini, Perplexity, Elicit, Scispace, Consensus, PaperPal, Julius, and Mistral AI—were prompted with the same standardized questions: “Detail the outcomes and complications of migraine surgery.”, “What are the indications for migraine surgery?” and “What are the alternatives to migraine surgery?”. The responses were then assessed in terms of scientific credibility, clarity, readability, depth of information, and the presence of references to peer-reviewed literature or established medical knowledge. Results: Overall, the responses received were highly satisfactory. All tools delivered prompt replies that were logical and scientifically credible. However, the level of detail, specificity, and accuracy varied across platforms. The most comprehensive and detailed answers were provided, in order, by Mistral, Julius, Scispace and Consensus, while the most readable ones were given by Mistral, ChatGPT and Elicit. Readability analysis indicated that content generally required a college-level education. Conclusions: Across all platforms, the core principles of migraine surgery were accurately outlined, including the indications, the expected outcomes, the incidence and severity of possible complications and the possible alternatives. In terms of results, the consistently high success rate of the procedure was clearly emphasized and conveyed an accurate overview of its clinical relevance.