❌

Normal view

First, do NOHARM: towards clinically safe large language models

arXiv:2512.01241v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are routinely used by physicians and patients for medical advice, yet their clinical safety profiles remain poorly characterized. We present NOHARM (Numerous Options Harm Assessment for Risk in Medicine), a benchmark using 100 real primary care-to-specialist consultation cases to measure frequency and severity of harm from LLM-generated medical recommendations. NOHARM covers 10 specialties, with 12,747 expert annotations for 4,249 clinical management options. Across 31 LLMs, potential for severe harm from LLM recommendations occurs in up to 22.2% (95% CI 21.6-22.8%) of cases, with harm of omission accounting for 76.6% (95% CI 76.4-76.8%) of errors. Safety performance is only moderately correlated (r = 0.61-0.64) with existing AI and medical knowledge benchmarks. The best models outperform generalist physicians on safety (mean difference 9.7%, 95% CI 7.0-12.5%), and a diverse multi-agent approach improves safety compared to solo models (mean difference 8.0%, 95% CI 4.0-12.1%). Therefore, despite strong performance on existing evaluations, widely used AI models can produce severely harmful medical advice at nontrivial rates, underscoring clinical safety as a distinct performance dimension necessitating explicit measurement.

Graph AI generates neurological hypotheses validated in molecular, organoid, and clinical systems

arXiv:2512.13724v1 Announce Type: cross Abstract: Neurological diseases are the leading global cause of disability, yet most lack disease-modifying treatments. We present PROTON, a heterogeneous graph transformer that generates testable hypotheses across molecular, organoid, and clinical systems. To evaluate PROTON, we apply it to Parkinson's disease (PD), bipolar disorder (BD), and Alzheimer's disease (AD). In PD, PROTON linked genetic risk loci to genes essential for dopaminergic neuron survival and predicted pesticides toxic to patient-derived neurons, including the insecticide endosulfan, which ranked within the top 1.29% of predictions. In silico screens performed by PROTON reproduced six genome-wide $\alpha$-synuclein experiments, including a split-ubiquitin yeast two-hybrid system (normalized enrichment score [NES] = 2.30, FDR-adjusted $p

Explainable AI as a Double-Edged Sword in Dermatology: The Impact on Clinicians versus The Public

arXiv:2512.12500v1 Announce Type: cross Abstract: Artificial intelligence (AI) is increasingly permeating healthcare, from physician assistants to consumer applications. Since AI algorithm's opacity challenges human interaction, explainable AI (XAI) addresses this by providing AI decision-making insight, but evidence suggests XAI can paradoxically induce over-reliance or bias. We present results from two large-scale experiments (623 lay people; 153 primary care physicians, PCPs) combining a fairness-based diagnosis AI model and different XAI explanations to examine how XAI assistance, particularly multimodal large language models (LLMs), influences diagnostic performance. AI assistance balanced across skin tones improved accuracy and reduced diagnostic disparities. However, LLM explanations yielded divergent effects: lay users showed higher automation bias - accuracy boosted when AI was correct, reduced when AI erred - while experienced PCPs remained resilient, benefiting irrespective of AI accuracy. Presenting AI suggestions first also led to worse outcomes when the AI was incorrect for both groups. These findings highlight XAI's varying impact based on expertise and timing, underscoring LLMs as a "double-edged sword" in medical AI and informing future human-AI collaborative system design.

Grounding Large Language Models in Clinical Evidence: A Retrieval-Augmented Generation System for Querying UK NICE Clinical Guidelines

arXiv:2510.02967v3 Announce Type: replace-cross Abstract: This paper presents the development and evaluation of a Retrieval-Augmented Generation (RAG) system for querying the United Kingdom's National Institute for Health and Care Excellence (NICE) clinical guidelines using Large Language Models (LLMs). The extensive length and volume of these guidelines can impede their utilisation within a time-constrained healthcare system, a challenge this project addresses through the creation of a system capable of providing users with precisely matched information in response to natural language queries. The system's retrieval architecture, composed of a hybrid embedding mechanism, was evaluated against a corpus of 10,195 text chunks derived from three hundred guidelines. It demonstrates high performance, with a Mean Reciprocal Rank (MRR) of 0.814, a Recall of 81% at the first chunk and of 99.1% within the top ten retrieved chunks, when evaluated on 7901 queries. The most significant impact of the RAG system was observed during the generation phase. When evaluated on a manually curated dataset of seventy question-answer pairs, RAG-enhanced models showed substantial gains in performance. Faithfulness, the measure of whether an answer is supported by the source text, was increased by 64.7 percentage points to 99.5% for the RAG-enhanced O4-Mini model and significantly outperformed the medical-focused Meditron3-8B LLM, which scored 43%. Clinical evaluation by seven Subject Matter Experts (SMEs) further validated these findings, with GPT-4.1 achieving 98.7% accuracy while reducing unsafe responses by 67% compared to O4-Mini (from 3.0 to 1.0 per evaluator). This study thus establishes RAG as an effective, reliable, and scalable approach for applying generative AI in healthcare, enabling cost-effective access to medical guidelines.

Development of a Hospital-at-Home Digital Twin for Patients With Frailty: Scoping Review

Background: Increasing demand on healthcare systems requires innovative and transformative solutions to deliver efficient, high-quality care. One promising approach is Digital Twin (DT) technology, which leverages real time data to create dynamic virtual representations of a physical entity (individuals or space) to anticipate future scenarios and support care decisions. While DTs have been explored in various sectors, their application in Hospital at Home (HaH), which delivers acute level care in home environments, remains unexplored. Objective: This review bridges a critical knowledge gap and examines the existing evidence on DT-enabling tools for managing patients with frailty in home settings. This will identify the underpinning architectural components required to inform a HaH-DT system which can support clinical decision-making. Methods: Six electronic databases (Embase, MEDLINE, Cochrane CENTRAL, CINAHL, Web of Science and Scopus) were searched, along with grey literature, to identifying primary studies published in English, between January 2019 and September 2025. Included studies had to report on the monitoring or management of patients with frailty within their own home, and information was charted on a pre-defined data collection form to answer the research objectives. Review articles, protocols, and conference abstracts were excluded. Results: Sixty-nine reports were included, of which 54% (n=37) used quantitative approaches, and 36% (n=25) were pilot or feasibility studies. Reports were analysed for DT-enabling tools and systematically mapped across the proposed five-layered DT architecture: sensing, communication, storage, analytics, and visualisation. Taxonomies of DT layers, their interconnections, and the classifications of the types of data collected (e.g., about the patient, the home environment, the use of medical equipment) are presented. This evidence identifies DT-enabling tools used for a variety of functions and a range of sensing technologies that exist (e.g., passive sensing via wearables, active physiological sensors, ambient sensors to detect motion/environmental changes). The most prevalent modes of communication were wireless and network-based (n=36), with the majority using Bluetooth (n=12). This review highlights better understanding of data management, in particular secure storage, is required within local healthcare systems. The emerging potential of predictive and prescriptive analytics, which can enable clinicians to predict risk, support clinical decision-making, or activate alert-triggered health interventions were mapped. Existing evidence suggests analytics methods are currently largely descriptive with a lack of advanced methods such as prescriptive analytics to enable recommendations of an optimal course of action, and the absence of diagnostic analytics which can highlight why a situation has occurred. Reported DT-enabling tools demonstrate patient-centered benefits, including enhanced motivation, reassurance, and personalised care. However, concerns persist regarding device accuracy, user acceptability, and implications for carers and organisational workflows. Conclusions: This review is among the first to systematically map DT-enabling tools to inform a potential HaH-DT in patients with frailty and organised by a 5-layered conceptual model. Understanding these architectural layers provides the foundations to enable stakeholders advance research and development in areas where there are knowledge gaps and consider how a HaH DT can effectively operate within current healthcare systems. By leveraging technology-enabled care in complex home-based settings, there is great potential to deliver safer, personalised and timely care.

Somatic evolution following cancer treatment in normal tissue

Nature, Published online: 10 December 2025; doi:10.1038/s41586-025-09792-4

High-depth sequencing of non-cancerous tissue from patients with metastatic cancer reveals single-base mutational signatures of alcohol, smoking and cancer treatments, and reveals how exogenous factors, including cancer therapies, affect somatic cell evolution.

A Field Guide to Deploying AI Agents in Clinical Practice

arXiv:2509.26153v3 Announce Type: replace Abstract: Large language models (LLMs) integrated into agent-driven workflows hold immense promise for healthcare, yet a significant gap exists between their potential and practical implementation within clinical settings. To address this, we present a practitioner-oriented field manual for deploying generative agents that use electronic health record (EHR) data. This guide is informed by our experience deploying the "irAE-Agent", an automated system to detect immune-related adverse events from clinical notes at Mass General Brigham, and by structured interviews with 21 clinicians, engineers, and informatics leaders involved in the project. Our analysis reveals a critical misalignment in clinical AI development: less than 20% of our effort was dedicated to prompt engineering and model development, while over 80% was consumed by the sociotechnical work of implementation. We distill this effort into five "heavy lifts": data integration, model validation, ensuring economic value, managing system drift, and governance. By providing actionable solutions for each of these challenges, this field manual shifts the focus from algorithmic development to the essential infrastructure and implementation work required to bridge the "valley of death" and successfully translate generative AI from pilot projects into routine clinical care.

Cognitive bias in LLM reasoning compromises interpretation of clinical oncology notes

arXiv:2511.20680v1 Announce Type: cross Abstract: Despite high performance on clinical benchmarks, large language models may reach correct conclusions through faulty reasoning, a failure mode with safety implications for oncology decision support that is not captured by accuracy-based evaluation. In this two-cohort retrospective study, we developed a hierarchical taxonomy of reasoning errors from GPT-4 chain-of-thought responses to real oncology notes and tested its clinical relevance. Using breast and pancreatic cancer notes from the CORAL dataset, we annotated 600 reasoning traces to define a three-tier taxonomy mapping computational failures to cognitive bias frameworks. We validated the taxonomy on 822 responses from prostate cancer consult notes spanning localized through metastatic disease, simulating extraction, analysis, and clinical recommendation tasks. Reasoning errors occurred in 23 percent of interpretations and dominated overall errors, with confirmation bias and anchoring bias most common. Reasoning failures were associated with guideline-discordant and potentially harmful recommendations, particularly in advanced disease management. Automated evaluators using state-of-the-art language models detected error presence but could not reliably classify subtypes. These findings show that large language models may provide fluent but clinically unsafe recommendations when reasoning is flawed. The taxonomy provides a generalizable framework for evaluating and improving reasoning fidelity before clinical deployment.

Human Experts' Evaluation of Generative AI for Contextualizing STEAM Education in the Global South

arXiv:2511.19482v2 Announce Type: replace-cross Abstract: This study investigates how human experts evaluate the capacity of Generative AI (GenAI) to contextualize STEAM education in the Global South, with a focus on Ghana. Using a convergent mixed-methods design, four STEAM specialists assessed GenAI-generated lesson plans created with a customized Culturally Responsive Lesson Planner (CRLP) and compared them to standardized lesson plans from the Ghana National Council for Curriculum and Assessment (NaCCA). Quantitative ratings were based on a validated 25-item Culturally Responsive Pedagogy Rubric measuring bias awareness, cultural representation, contextual relevance, linguistic responsiveness, and teacher agency. Qualitative reflections provided additional insight into how GenAI handles cultural and pedagogical appropriateness. Findings show that GenAI, when paired with the CRLP tool, can support contextualized STEAM instruction by linking abstract curriculum standards to learners' cultural knowledge, community practices, and everyday experiences. Experts rated GenAI-assisted lessons as more culturally grounded and pedagogically responsive than NaCCA plans, integrating Indigenous knowledge, bilingual elements, and locally relevant examples. However, GenAI struggled to represent Ghana's cultural pluralism, often offering surface-level references to language, history, and identity. These weaknesses were most evident in Mathematics and Computing, where cultural nuance was limited. The results highlight the need for continued teacher mediation, community involvement, and culturally attuned refinement of AI outputs. Future work should include classroom trials, expanded expert participation, and model fine-tuning using Indigenous language corpora to strengthen cultural fidelity in Global South contexts.

Multi-agent Self-triage System with Medical Flowcharts

arXiv:2511.12439v1 Announce Type: new Abstract: Online health resources and large language models (LLMs) are increasingly used as a first point of contact for medical decision-making, yet their reliability in healthcare remains limited by low accuracy, lack of transparency, and susceptibility to unverified information. We introduce a proof-of-concept conversational self-triage system that guides LLMs with 100 clinically validated flowcharts from the American Medical Association, providing a structured and auditable framework for patient decision support. The system leverages a multi-agent framework consisting of a retrieval agent, a decision agent, and a chat agent to identify the most relevant flowchart, interpret patient responses, and deliver personalized, patient-friendly recommendations, respectively. Performance was evaluated at scale using synthetic datasets of simulated conversations. The system achieved 95.29% top-3 accuracy in flowchart retrieval (N=2,000) and 99.10% accuracy in flowchart navigation across varied conversational styles and conditions (N=37,200). By combining the flexibility of free-text interaction with the rigor of standardized clinical protocols, this approach demonstrates the feasibility of transparent, accurate, and generalizable AI-assisted self-triage, with potential to support informed patient decision-making while improving healthcare resource utilization.

Improving dataset transparency in dermatologic Artificial Intelligence using a dataset nutrition label

npj Digital Medicine, Published online: 05 November 2025; doi:10.1038/s41746-025-02125-9

Biased and poorly documented dermatology datasets pose risks to the development of safe and generalizable artificial intelligence (AI) tools. We created a Dataset Nutrition Label (DNL) for multiple dermatology datasets to support transparent and responsible data use. The DNL offers a structured, digestible summary of key attributes, including metadata, limitations, and risks, enabling data users to better assess suitability and proactively address potential sources of bias in datasets.

Fair human-centric image dataset for ethical AI benchmarking

Nature, Published online: 05 November 2025; doi:10.1038/s41586-025-09716-2

The Fair Human-Centric Image Benchmark (FHIBE, pronounced ‘Feebee’)—an image dataset that implements best practices for consent, privacy, compensation, safety, diversity and utility—can be used responsibly as a fairness evaluation dataset for many human-centric computer vision applications.
  • ✇STAT
  • STAT+: Moderna says key study of its CMV vaccine, expected to be its next big win, failed Jason Mast and Matthew Herper
    Moderna said Wednesday afternoon that its experimental vaccine for cytomegalovirus, a cause of disability in newborns, failed in a Phase 3 trial, a significant setback for a company already facing pressure from Wall Street and the federal government. The CMV vaccine had been the company’s lead program prior to the Covid-19 pandemic. Leadership had repeatedly said it could bring in between $2 billion and $5 billion in peak annual sales. Analysts polled by Visible Alpha forecast peak sales of $
     

STAT+: Moderna says key study of its CMV vaccine, expected to be its next big win, failed

23 October 2025 at 04:05

Moderna said Wednesday afternoon that its experimental vaccine for cytomegalovirus, a cause of disability in newborns, failed in a Phase 3 trial, a significant setback for a company already facing pressure from Wall Street and the federal government.

The CMV vaccine had been the company’s lead program prior to the Covid-19 pandemic. Leadership had repeatedly said it could bring in between $2 billion and $5 billion in peak annual sales. Analysts polled by Visible Alpha forecast peak sales of $1.6 billion for the product.

“It’s obviously disappointing,” said Stephen Hoge, Moderna’s president, in an interview.

Continue to STAT+ to read the full story…

© Ruby Wallau for STAT

Circulating tumor DNA in Non-Viral head and neck squamous cell Carcinoma: A systematic review and Meta-Analysis

Oral Oncol. 2025 Nov;170:107760. doi: 10.1016/j.oraloncology.2025.107760. Epub 2025 Oct 17.

ABSTRACT

Non-viral head and neck squamous cell carcinoma (HNSCC) has poor survival and high recurrence rates. Circulating tumor DNA (ctDNA) is a promising biomarker for understanding tumor biology, assessing treatment response, and monitoring disease progression. While extensively studied in virally mediated HNSCC, its role in non-viral HNSCC remains underexplored. This systematic review and meta-analysis consolidates evidence on the diagnostic, prognostic, and therapeutic value of ctDNA in non-viral HNSCC. A systematic search across Medline, PubMed, Embase, and the Cochrane Library identified 1,915 records, of which 47 were included. Data extraction followed PRISMA guidelines, with overall survival (OS), progression-free survival (PFS), and recurrence-free survival (RFS), pooled as hazard ratios (HRs) with 95% confidence intervals (CIs) using a fixed-effect model. Among 3,574 patients, the most common tumor sites were the oral cavity (35 %) and oropharynx (22 %), with the majority presenting with stage IVA/IVB disease (29 %). Pre-treatment ctDNA detection rates ranged from 50 % to 100 % (median: 83 %), while post-treatment detection rates varied between 28 % and 100 % (median: 48 %). ctDNA detected recurrence in 80 % of patients, with a median lead time of 4.6 months. ctDNA detection was significantly associated with worse OS (HR 10.26, 95 % CI 3.58-29.40; P < 0.0001). Residual ctDNA was strongly correlated with worse PFS (HR 7.32, 95 % CI 4.17-12.86; P < 0.00001) and RFS (HR 7.33, 95 % CI 2.75-19.58; P < 0.0001). ctDNA holds potential for improving diagnostic accuracy, monitoring progression, and predicting survival outcomes in non-viral HNSCC. However, further large-scale studies and standardized guidelines are needed for validation and clinical implementation.

PMID:41108912 | DOI:10.1016/j.oraloncology.2025.107760

Clinical validation of an AI-based blood testing device for diagnosis and prognosis of acute infection and sepsis

Nature Medicine, Published online: 30 September 2025; doi:10.1038/s41591-025-03933-y

In a prospective study enrolling 1,222 patients from 22 emergency departments, a device using a machine-learning-based signature of blood mRNAs demonstrated clinically acceptable performance to diagnose bacterial and viral infections and to predict the all-cause need for critical care interventions within 7 days, with benchmark to established biomarkers and risk scores.

Integrative Spatial Omics for Systems-Level Mapping of Pathological Niches

bioRxiv [Preprint]. 2025 Sep 17:2025.09.12.675904. doi: 10.1101/2025.09.12.675904.

ABSTRACT

Spatial 'omics technologies are a powerful tool for mapping the relationship between cellular organization and molecular distributions in healthy and diseased tissue microenvironments. Here, we describe a novel multimodal pipeline that represents experimental and computational advances for spatiomolecular analysis of tissue samples across molecular classes. This adaptable method integrates matrix-assisted laser desorption/ionization (MALDI) imaging mass spectrometry (IMS) lipidomics, spatial transcriptomics (ST), multiplexed immunofluorescence microscopy (MxIF), and histopathological staining to uncover spatiomolecular profiles associated with unique cellular niches and pathological features. We demonstrate the power of this approach using two different complex human disease systems: Alzheimer's disease in human brain tissue and type 2 diabetes mellitus in the human pancreas. By identifying molecular markers associated with disease pathology in the pancreas and brain, we shed light on biologically significant pathways that are impacted in these two spatially complex diseases and highlight the powerful potential of accurate, high-resolution multimodal integration approaches.

PMID:41000710 | PMC:PMC12458195 | DOI:10.1101/2025.09.12.675904

❌