❌

Reading view

A Multi-faceted Analysis of Cognitive Abilities: Evaluating Prompt Methods with Large Language Models on the CONSORT Checklist

arXiv:2510.19139v1 Announce Type: new Abstract: Despite the rapid expansion of Large Language Models (LLMs) in healthcare, the ability of these systems to assess clinical trial reporting according to CONSORT standards remains unclear, particularly with respect to their cognitive and reasoning strategies. This study applies a behavioral and metacognitive analytic approach with expert-validated data, systematically comparing two representative LLMs under three prompt conditions. Clear differences emerged in how the models approached various CONSORT items, and prompt types, including shifts in reasoning style, explicit uncertainty, and alternative interpretations shaped response patterns. Our results highlight the current limitations of these systems in clinical compliance automation and underscore the importance of understanding their cognitive adaptations and strategic behavior in developing more explainable and reliable medical AI.
  •  

MSC-Bench: A Rigorous Benchmark for Multi-Server Tool Orchestration

arXiv:2510.19423v1 Announce Type: new Abstract: We introduce MSC-Bench, a large-scale benchmark for evaluating multi-hop, end-to-end tool orchestration by LLM agents in a hierarchical Model-Context Protocol (MCP) ecosystem. Existing benchmarks often evaluate tools in isolation, ignoring challenges such as functional overlap and cross-server orchestration, leading to overly optimistic assessments. MSC-Bench addresses these gaps by constructing ground truth through 'equal function sets', allowing objective metrics such as F1 score and reducing the dependency on LLM-as-a-judge evaluation. Organized as a five-level curriculum, it systematically tests agent capabilities from single-tool orchestration to complex cross-server planning, and robustness to out-of-scope requests. Experiments reveal that rigid hierarchies can hinder performance without co-designed strategies, and even state-of-the-art agents exhibit systemic weaknesses in robustness. MSC-Bench provides a diagnostic framework to expose these limitations and guide the development of more capable and efficient tool-using agents. The benchmark and resources are publicly available at https://github.com/snooow1029/MSC_Bench.
  •  

KnowMol: Advancing Molecular Large Language Models with Multi-Level Chemical Knowledge

arXiv:2510.19484v1 Announce Type: cross Abstract: The molecular large language models have garnered widespread attention due to their promising potential on molecular applications. However, current molecular large language models face significant limitations in understanding molecules due to inadequate textual descriptions and suboptimal molecular representation strategies during pretraining. To address these challenges, we introduce KnowMol-100K, a large-scale dataset with 100K fine-grained molecular annotations across multiple levels, bridging the gap between molecules and textual descriptions. Additionally, we propose chemically-informative molecular representation, effectively addressing limitations in existing molecular representation strategies. Building upon these innovations, we develop KnowMol, a state-of-the-art multi-modal molecular large language model. Extensive experiments demonstrate that KnowMol achieves superior performance across molecular understanding and generation tasks. GitHub: https://github.com/yzf-code/KnowMol Huggingface: https://hf.co/datasets/yzf1102/KnowMol-100K
  •  

RoboGPT-R1: Enhancing Robot Planning with Reinforcement Learning

arXiv:2510.14828v2 Announce Type: replace Abstract: Improving the reasoning capabilities of embodied agents is crucial for robots to complete complex human instructions in long-view manipulation tasks successfully. Despite the success of large language models and vision language models based on Supervised Fine-Tuning (SFT) in planning tasks, they continue facing challenges in performing long-horizon manipulation tasks in complex real-world environments, owing to their restricted common sense and reasoning capabilities. Considering that aligning general-purpose vision language models to robotic planning tasks via supervised fine-tuning suffers from poor generalization and insufficient physical understanding, we propose RoboGPT-R1, a two-stage fine-tuning framework for embodied planning. In this framework, supervised training acquires foundational knowledge through expert sequences, followed by RL to address the model's shortcomings in visual-spatial understanding and reasoning. To achieve physical understanding and action sequence consistency in multi-step reasoning tasks, we design a rule-based reward function that simultaneously considers long-horizon performance and action constraint in the environment. The reasoning model, trained on Qwen2.5-VL-3B, significantly outperforms the larger-scale model, GPT-4o-mini, by 21.33% and surpasses other work trained on Qwen2.5-VL-7B by 20.33% on the EmbodiedBench benchmark.
  •  

ScholaWrite: A Dataset of End-to-End Scholarly Writing Process

arXiv:2502.02904v4 Announce Type: replace-cross Abstract: Writing is a cognitively demanding activity that requires constant decision-making, heavy reliance on working memory, and frequent shifts between tasks of different goals. To build writing assistants that truly align with writers' cognition, we must capture and decode the complete thought process behind how writers transform ideas into final texts. We present ScholaWrite, the first dataset of end-to-end scholarly writing, tracing the multi-month journey from initial drafts to final manuscripts. We contribute three key advances: (1) a Chrome extension that unobtrusively records keystrokes on Overleaf, enabling the collection of realistic, in-situ writing data; (2) a novel corpus of full scholarly manuscripts, enriched with fine-grained annotations of cognitive writing intentions. The dataset includes \LaTeX-based edits from five computer science preprints, capturing nearly 62K text changes over four months; and (3) analyses and insights into the micro-dynamics of scholarly writing, highlighting gaps between human writing processes and the current capabilities of large language models (LLMs) in providing meaningful assistance. ScholaWrite underscores the value of capturing end-to-end writing data to develop future writing assistants that support, not replace, the cognitive work of scientists.
  •  

Landscape of T-cell exhaustion heterogeneity and HBV integration in virus-related HCC revealed by whole-exome, transcriptome, and single-cell sequencing

JHEP Rep. 2025 Jul 10;7(11):101518. doi: 10.1016/j.jhepr.2025.101518. eCollection 2025 Nov.

ABSTRACT

BACKGROUND & AIMS: To enhance our understanding of the tumor immune microenvironment (TIME) in hepatocellular carcinoma (HCC), we investigated the heterogeneity of T-cell exhaustion and its association with HBV integrations and direct oncogenic potential in HCC.

METHODS: We conducted a multi-omics analysis, including single-cell RNA sequencing, whole-exome sequencing, whole-transcriptome sequencing, and next-generation sequencing (NGS)-based HBV integration analysis, in eight patients with virus-related HCC. For validation, bulk RNA sequencing and NGS-based HBV integration analysis were performed in an independent cohort (n = 106).

RESULTS: Based on the expression scores of exhaustion markers in effector CD8+ T cells, patients were classified into high (n = 2) and low (n = 6) exhaustion groups (p <0.001). The high-exhaustion group exhibited higher clonal expansion (Gini index: 0.83 vs. 0.48, p = 0.006) and sharing of CD8+ T effector memory and cycling T cells with elevated exhaustion markers. This group also showed increased clonal expansion of CD4+ regulatory T cells and follicular helper T cells (p <0.001) with higher PDCD1 expression. In addition, the high-exhaustion group had higher TP53 mutation rates and signature scores for proliferation subtypes compared with the low-exhaustion group, who predominantly harbored TERT mutations. Moreover, the high-exhaustion group demonstrated more pronounced HBV integrations with elevated intrahepatic covalently closed circular DNA (cccDNA) and pregenomic (pg)RNA levels. Similarly, in the validation cohort, the high-exhaustion group (n = 28) demonstrated stronger proliferation subtype signatures (p <0.001), along with higher HBV integrations, S-fusion transcripts, and an increased intrahepatic viral reservoir (cccDNA/pgRNA) (p <0.05) compared with the low-exhaustion group (n = 78).

CONCLUSIONS: Our study revealed the heterogeneity in T-cell exhaustion in the TIME of HCC, along with differences in HBV integrations and molecular subtypes. These findings provide insight into the intricate relationship between high exhaustion, proliferation subtype, increased HBV integrations, and enhanced HBV-induced oncogenic potential in virus-related HCC.

IMPACT AND IMPLICATIONS: This study provides a comprehensive immune landscape of T-cell exhaustion using multi-omics analysis, offering critical insights into T cell heterogeneity in virus-related HCC. It establishes a strong association between higher HBV integration, enhanced oncogenic potential, T-cell exhaustion, and proliferation subtypes in HCC. Our results also establish a basis for personalized therapies tailored to the immune-exhaustion status within the TIME of each patient with HCC.

PMID:41113120 | PMC:PMC12529496 | DOI:10.1016/j.jhepr.2025.101518

  •  

Single-cell multi-omics analysis reveals cancer regulatory elements of transcriptional programs and clinical implications

Cell Death Dis. 2025 Oct 21;16(1):746. doi: 10.1038/s41419-025-08060-7.

ABSTRACT

The regulatory mechanisms governing transcriptional programs in the cancer genome remain elusive, particularly those concerning cell-type specificity. We carefully curated single-cell assay for transposase-accessible chromatin sequencing (scATAC-seq) and single-cell RNA sequencing (scRNA-seq) data from eight distinct carcinoma tissues, including breast, skin, colon, endometrium, lung, ovary, liver, and kidney. Using single-cell multi-omics analysis, we identified extensive open chromatin regions and constructed peak-gene link networks, which can reveal distinct cancer gene regulation and genetic risks. We further explored conserved epigenetic regulation across cell types within cancer and elucidated their functional implications. Moreover, we identified cell-type-associated transcription factors (TFs) that regulate key cellular functions, such as the TEAD family of TFs, which widely control cancer-related signaling pathways in tumor cells. In colon cancer, we further identified tumor-specific TFs that are more highly activated in tumor cells than in normal epithelial cells, including CEBPG, LEF1, SOX4, TCF7, and TEAD4, which are pivotal in driving malignant transcriptional programs and represent potential therapeutic targets, as corroborated by single-cell sequencing data from multiple sources and in vitro experiments. Our findings provide a comprehensive understanding of the regulatory dynamics underlying carcinomas and offer valuable insights into potential therapeutic interventions.

PMID:41120274 | PMC:PMC12541060 | DOI:10.1038/s41419-025-08060-7

  •  

Exploring Patient Perspectives, Engagement, and Output Quality in Doctor-Supervised Use of Artificial Intelligence During Informed Consent Consultation With ChatGPT and Retrieval Augmented Generation (RAG): Quantitative Exploratory Study

Background: Comprehensive preoperative education is essential for optimizing outcomes and ensuring informed consent in patients undergoing total hip arthroplasty (THA). Emerging artificial intelligence (AI) tools, such as ChatGPT, offer scalable support for patient education, but their clinical application requires rigorous evaluation to ensure accuracy, safety, and trust. Objective: This study assessed patients’ preferences and satisfaction with AI-assisted informed consent in THA, comparing traditional physician consultations to those supported by native ChatGPT and a customized version enhanced with retrieval-augmented generation (RAG). It also examined how state anxiety and general attitudes toward AI affect preferences for AI-supported consent and whether RAG integration improves ChatGPT response quality. Methods: A total of 36 patients scheduled for elective THA were assigned to one of three groups (12 each): (1) standard physician-only consultations (control), (2) physician-assisted consultations supported by native ChatGPT, and (3) supported by ChatGPT enhanced through RAG. Data collection involved standardized Likert scale questionnaires assessing patient satisfaction with the consent process, perceived informedness, anxiety levels, and attitudes toward AI. The ChatGPT responses were independently evaluated by physicians for relevance, accuracy, clarity, completeness, adherence to evidence-based guidelines, and appropriate length. Instances of hallucinations, factually incorrect or misleading outputs, were identified and rated by severity. Statistical analyses compared outcomes across groups and explored associations. Results: Patients interacting with the ChatGPT+RAG model reported significantly higher satisfaction levels with information delivery (P=.01) and perceived level of informedness (P=.01) than those using the native ChatGPT model. The mean number of patient questions in the control group was 20, compared with 39 in the native ChatGPT group (P=.06) and 52 in the ChatGPT+RAG group (P=.002). The majority of participants across all groups preferred a human clinician providing less accurate information over a more accurate AI-only assistant. These preferences were not influenced by sociodemographic variables (age, gender, and education), health literacy, state anxiety, or general attitudes toward AI. The ChatGPT+RAG model outperformed the native ChatGPT model across all evaluated response quality dimensions (all P<.01) and exhibited a significantly lower hallucination rate (5/52, 10% versus 15/39, 38%; P=.002). Conclusions: Integrating RAG with ChatGPT significantly improves the quality, clarity, and reliability of preoperative information, enhancing patient satisfaction and engagement beyond native ChatGPT. However, patients maintain a strong preference for physician-led informed consent, underscoring the role of AI chatbots as complementary tools rather than replacements. These findings support the cautious adoption of customized AI assistants to augment, not substitute, human interaction in surgical consent processes. Trial Registration:
  •  

Assessing Large Language Models in Building a Structured Dataset From AskDocs Subreddit Data: Methodological Study

Background: In an era marked by the blooming reliance on digital platforms for healthcare consultation, the subreddit r/AskDocs has emerged as a pivotal forum. However, the vast, unstructured nature of forum data presents a formidable challenge; the extraction and meaningful analysis of such data require advanced tools that can navigate the complexities of language and context inherent in user-generated content. Objective: Our objective was to evaluate employing Large Language Models (LLMs) to systematically transform the rich, unstructured textual data from AskDocs into a structured dataset, an approach that aligns more closely with human cognitive processes compared to traditional data extraction methods. Methods: We developed a dataset of Reddit posts from r/AskDocs by extracting key information via human annotators. Then using specially engineered prompts we used state-of-the-art Large Language Models (LLMs) to extract data from posts and compared the results. The variation in the LLMs were further compared to the humans to show similarity. Results: Our findings indicate that LLMs not only match but, in several aspects, surpass even highly educated humans in extracting information, including both demographic and context details, from unstructured texts. Conclusions: This study not only validates the use of LLMs for analyzing digital healthcare communications but also opens new avenues for understanding online behaviors and interactions, signaling a shift towards more sophisticated methodologies in digital research and practice.
  •  

Multi-omics analyses inform mechanisms of immunotherapy response in pancreatic cancer

Front Immunol. 2025 Oct 2;16:1673098. doi: 10.3389/fimmu.2025.1673098. eCollection 2025.

ABSTRACT

INTRODUCTION: Pancreatic ductal adenocarcinoma (PDAC) continues to exhibit resistance to immunotherapy. In this study, we evaluated the efficacy of combining immunotherapy with chemotherapy for the treatment of advanced pancreatic cancer. Additionally, we employed a multimodal analytical approach to elucidate the immune landscape and conduct transcriptomic profiling in PDAC.

METHODS: A retrospective analysis was conducted on the clinical data of 52 patients diagnosed with advanced PDAC who underwent a combined treatment regimen of immunotherapy and chemotherapy. The study evaluated the objective response rate (ORR), disease control rate (DCR), and progression-free survival (PFS). To characterize the immune landscape in treatment-naive pancreatic ductal adenocarcinoma (PDAC) tumors and in the systemic circulation, flow cytometry, multiplex immunohistochemistry (mIHC), and whole transcriptome sequencing were employed.

RESULTS: The study reported an ORR of 32.7%, a DCR of 67.3%, and a 6-month PFS rate of 38.5%, with a median PFS of 5.5 months. Patients treated with a combination of immunotherapy and gemcitabine achieved the longest PFS. The first-line treatment cohort exhibited a significantly higher DCR (79.3% vs. 52.2%, P = 0.038) and a longer median PFS (6.6 vs. 3.5 months, P = 0.032) compared to the second-line treatment cohort. The efficacy of treatment varied depending on the drug combinations used. Flow cytometry analysis revealed a greater frequency of CD45- CD64+ cells in the peripheral blood of patients with progressive disease (PD) compared to those with a partial response (PR). Multiplex immunofluorescence (MIF) analysis indicated an increased intratumoral infiltration of CD8+ T cells and CD137+ CD8+ T cells in patients with PR. Whole transcriptome sequencing (WTSS) identified key genes involved in immune regulation, signal transduction, and digestive function. Hemopexin (HPX) and regulatory factor X-associated protein (RFXAP) were upregulated in PR patients and showed a positive correlation with survival, whereas Interleukin-6 (IL-6) expression was linked to poor prognosis.

CONCLUSIONS: These findings indicate that immunochemotherapy shows potential for the treatment of advanced PDAC. Our study elucidates the immune landscape associated with PDAC and provides critical insights for the identification of prospective therapeutic targets, which could guide the development of innovative combination immunotherapy strategies.

PMID:41112307 | PMC:PMC12528169 | DOI:10.3389/fimmu.2025.1673098

  •  

Alternatives to animal testing are the future — it’s time that journals, funders and scientists embrace them

Nature, Published online: 20 October 2025; doi:10.1038/d41586-025-03344-6

Biomedical research techniques that don’t involve the use of animals are gaining momentum, but those using innovative approaches still face resistance from some quarters.
  •  

R-loops in hepatocellular carcinoma: Bridging genomic instability and therapeutic opportunity (Review)

Mol Med Rep. 2026 Jan;33(1):6. doi: 10.3892/mmr.2025.13716. Epub 2025 Oct 17.

ABSTRACT

R‑loops, three‑stranded nucleic acid structures composed of an RNA:DNA hybrid and displaced single‑stranded DNA, have emerged as important regulators of gene expression and genome maintenance. Although physiological R‑loops participate in normal cellular processes, their dysregulation can threaten genomic integrity by inducing DNA damage and replication stress. The present review explores the role of R‑loops in hepatocellular carcinoma (HCC), a malignancy characterized by marked genomic instability. In the present review, the formation mechanisms of R‑loops, their dual functions in transcriptional regulation and DNA damage, and their specific implications for HCC pathophysiology were discussed. HCC cells exhibit altered R‑loop homeostasis with aberrant accumulation linked to hepatitis B virus infection, inflammatory signaling and oncogene activation. The present review highlighted how HCC cells exploit or manage R‑loops to promote tumor progression, particularly through the epigenetic silencing of differentiation genes and modulation of replication stress responses. Furthermore, emerging therapeutic strategies targeting R‑loop biology were examined, including small molecules that induce synthetic lethality, gene‑based interventions and combination approaches that exploit R‑loop vulnerabilities. Challenges in targeting R‑loops and future directions, including multi‑omics profiling and biomarker development, were also addressed. Understanding the complex interplay between R‑loops and HCC offers promising avenues for novel diagnostic and therapeutic approaches for this malignancy.

PMID:41104860 | DOI:10.3892/mmr.2025.13716

  •  

When helpfulness backfires: LLMs and the risk of false medical information due to sycophantic behavior

npj Digital Medicine, Published online: 17 October 2025; doi:10.1038/s41746-025-02008-z

When helpfulness backfires: LLMs and the risk of false medical information due to sycophantic behavior
  •  

Semi-automated surveillance of surgical site infections using machine learning and rule-based classification models

npj Digital Medicine, Published online: 17 October 2025; doi:10.1038/s41746-025-01989-1

Semi-automated surveillance of surgical site infections using machine learning and rule-based classification models
  •  

Use of Artificial Intelligence-Assisted Conversational Agents to Improve Patient Experience Related to Physicians: Cross-Sectional Study in China

Background: Artificial intelligence-assisted conversational agents have been applied and developed in outpatient departments to improve health services in China. However, there has been little research that evaluates the effect of artificial intelligence-assisted conversational agents on the patient experience related to physicians during outpatient visits. Objective: This aim of this study was to examine whether the use of artificial intelligence-assisted conversational agents improves the patient experience related to physicians during outpatient visits and to further find out the difference in the patient experience between conversational agent users and nonusers. Methods: We used the Chinese Outpatient Experience Questionnaire to survey the patient experience related to physicians during outpatient visits. A sample of 392 adult residents who sought outpatient services from tertiary public hospitals in China was selected by random sampling. The t tests were used to test the mean difference in the patient experience scores between conversational agent users and nonusers. Multiple linear regression analysis was further performed to determine whether the use of artificial intelligence-assisted conversational agents during outpatient visits was associated with a better patient experience related to physicians. Results: Conversational agent user reported significantly higher scores than nonusers in the total patient experience scores (t392=5.589, P<.001 the items and dimensions of physician-patient communication p=".006)," health information short-term outcome general satisfaction multiple linear regression results further showed that after controlling for other factors on participant characteristics use artificial intelligence-assisted conversational agents during outpatient visits significantly influenced total patient experience scores related to physicians averagely increased by conclusions: could improve especially in terms making better accessing more targeted ameliorating outcomes increasing satisfaction. therefore we suggest public hospitals should consider benefits actively deploy departments so as continuously visits.>
  •  
  •  
❌