AI-generated guidance for non-specialist physicians managing inflammatory bowel disease: evaluation of GPT-4 and DeepSeek
The study assessed the accuracy and completeness of AI-generated guidance for inflammatory bowel disease (IBD) using GPT-4 and DeepSeek. Seven IBD specialists rated responses from 20 real-world questions and a standardized vignette, while 12 non-specialist physicians evaluated clinical usefulness and completed a two‑round case‑based test. Results showed both models produced generally accurate answers (median scores ≥4/5) and improved non‑specialist physicians’ test scores from 5.5–6.0 to 8.0, with no harmful recommendations identified.
The study assessed the accuracy and completeness of AI-generated guidance for inflammatory bowel disease (IBD) using GPT-4 and DeepSeek. Seven IBD specialists rated responses from 20 real-world questions and a standardized vignette, while 12 non-specialist physicians evaluated clinical usefulness and completed a two‑round case‑based test. Results showed both models produced generally accurate answers (median scores ≥4/5) and improved non‑specialist physicians’ test scores from 5.5–6.0 to 8.0, with no harmful recommendations identified.
The findings support the potential of AI tools like GPT-4 and DeepSeek to enhance clinical decision support for non‑specialist physicians in Switzerland, where specialist shortages may affect IBD care.
Original source record. Open the original record to verify the underlying announcement.