❌

Normal view

Development and multi-center evaluation of domain-adapted speech recognition for human-AI teaming in real-world gastrointestinal endoscopy

arXiv:2604.01705v1 Announce Type: cross Abstract: Automatic speech recognition (ASR) is a critical interface for human-AI interaction in gastrointestinal endoscopy, yet its reliability in real-world clinical settings is limited by domain-specific terminology and complex acoustic conditions. Here, we present EndoASR, a domain-adapted ASR system designed for real-time deployment in endoscopic workflows. We develop a two-stage adaptation strategy based on synthetic endoscopy reports, targeting domain-specific language modeling and noise robustness. In retrospective evaluation across six endoscopists, EndoASR substantially improves both transcription accuracy and clinical usability, reducing character error rate (CER) from 20.52% to 14.14% and increasing medical term accuracy (Med ACC) from 54.30% to 87.59%. In a prospective multi-center study spanning five independent endoscopy centers, EndoASR demonstrates consistent generalization under heterogeneous real-world conditions. Compared with the baseline Paraformer model, CER is reduced from 16.20% to 14.97%, while Med ACC is improved from 61.63% to 84.16%, confirming its robustness in practical deployment scenarios. Notably, EndoASR achieves a real-time factor (RTF) of 0.005, significantly faster than Whisper-large-v3 (RTF 0.055), while maintaining a compact model size of 220M parameters, enabling efficient edge deployment. Furthermore, integration with large language models demonstrates that improved ASR quality directly enhances downstream structured information extraction and clinician-AI interaction. These results demonstrate that domain-adapted ASR can serve as a reliable interface for human-AI teaming in gastrointestinal endoscopy, with consistent performance validated across multi-center real-world clinical settings.

Unified modeling of 3D molecular generation via atomic interactions with PocketXMol

A versatile, atom-level generative AI model enables unified pocket-interacting tasks, from docking to de novo design, and demonstrates robust experimental validation for both small-molecule and peptide therapeutics.

Dual function of DOT1L suppresses tumor cell-intrinsic immunogenicity in hepatocellular carcinoma

Oncogene, Published online: 31 March 2026; doi:10.1038/s41388-026-03744-6

Dual function of DOT1L suppresses tumor cell-intrinsic immunogenicity in hepatocellular carcinoma

Trem1 regulates neutrophil metabolism and recruitment in lung ischemia-reperfusion injury

Redox Biol. 2026 Jan 14;92:104026. doi: 10.1016/j.redox.2026.104026. Online ahead of print.

ABSTRACT

Primary graft dysfunction (PGD) caused by ischemia-reperfusion injury (IRI) is a major complication after lung transplantation, yet its underlying mechanisms remain unclear. Triggering receptor expressed on myeloid cells 1 (Trem1) is an important mediator of inflammation, but its role in neutrophil function and metabolic reprogramming during lung IRI is not well understood. In this study, we used a murine orthotopic lung transplantation model with cold ischemia and reperfusion, and Trem1 knockout (Trem1-/-) and myeloid-specific Trem1 conditional knockout mice (LysmCreTrem1fl) to explore the role of Trem1 in neutrophil recruitment, neutrophil extracellular trap (NET) formation, and metabolism. Our results show that Trem1 expression increases in both mouse and human lungs after reperfusion and correlates with neutrophil infiltration and lung injury. Trem1 deficiency significantly reduced neutrophil and macrophage recruitment, NET formation, and tissue damage. Multi-omics analysis revealed that Trem1 deletion suppressed oxidative phosphorylation (OXPHOS) and induced a metabolic shift in neutrophils toward glycolysis. In clinical samples, the abundance of TREM1+ neutrophils was correlated with PGD severity and OXPHOS activity. These findings identify Trem1 as a key regulator of neutrophil metabolism and recruitment in lung IRI, and suggest that targeting Trem1 may provide a novel therapeutic strategy to mitigate PGD and improve lung transplant outcomes.

PMID:41861599 | DOI:10.1016/j.redox.2026.104026

Reallocating Attention Across Layers to Reduce Multimodal Hallucination

arXiv:2510.10285v3 Announce Type: replace Abstract: Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent interpretability findings suggesting a staged division of attention across layers, we analyze how this functional misalignment leads to two complementary failure modes: perceptual bias in shallow layers and reasoning drift in deeper layers. To alleviate these issues, we propose Functional Head Identification and Class-Conditioned Rescaling , a lightweight, training-free plugin that identifies perception- and reasoning-oriented heads and adaptively rebalances their layerwise contributions. Our method improves reasoning consistency and visual faithfulness without retraining or any architectural modification. Evaluations across three representative MLRMs and five multimodal reasoning benchmarks show an average 4.2% point gain, with less than 1% additional computation and only 9% baseline latency. Beyond empirical improvements, our study provides an interpretable perspective on regulating cross-layer functional dynamics to enhance the reliability of multimodal reasoning.

JPmHC Dynamical Isometry via Orthogonal Hyper-Connections

arXiv:2602.18308v2 Announce Type: replace-cross Abstract: Recent advances in deep learning, exemplified by Hyper-Connections (HC), have expanded the residual connection paradigm by introducing wider residual streams and diverse connectivity patterns. While these innovations yield significant performance gains, they compromise the identity mapping property of residual connections, leading to training instability, limited scalability, and increased memory overhead. To address these challenges, we propose JPmHC (Jacobian-spectrum Preserving manifold-constrained Hyper-Connections), a framework that replaces identity skips with a trainable linear mixer acting on n parallel streams while explicitly controlling gradient conditioning. By constraining the mixer M on operator-norm-bounded manifolds (e.g., bistochastic, Stiefel, Grassmann), JPmHC prevents gradient pathologies and enhances stability. JPmHC introduces three key contributions: (i) a free-probability analysis that predicts Jacobian spectra for structured skips, providing actionable design rules for mixer selection; (ii) memory-efficient implicit differentiation for fixed-point projections, reducing activation memory and synchronization overhead; and (iii) a Stiefel-constrained mixer via Cayley transforms, ensuring orthogonality without post-hoc normalization. Empirical evaluations on ARC-AGI demonstrate that JPmHC achieves faster convergence, higher accuracy, and lower computational cost compared to bistochastic baselines, with a rank-$p$ Grassmannian variant tracking between the two -- consistent with the spectral theory predictions. As a flexible and scalable extension of HC, JPmHC advances spectrum-aware, stable, and efficient deep learning, offering insights into topological architecture design and foundational model evolution. \newline \newline

A Secure and Private Distributed Bayesian Federated Learning Design

arXiv:2602.20003v1 Announce Type: cross Abstract: Distributed Federated Learning (DFL) enables decentralized model training across large-scale systems without a central parameter server. However, DFL faces three critical challenges: privacy leakage from honest-but-curious neighbors, slow convergence due to the lack of central coordination, and vulnerability to Byzantine adversaries aiming to degrade model accuracy. To address these issues, we propose a novel DFL framework that integrates Byzantine robustness, privacy preservation, and convergence acceleration. Within this framework, each device trains a local model using a Bayesian approach and independently selects an optimal subset of neighbors for posterior exchange. We formulate this neighbor selection as an optimization problem to minimize the global loss function under security and privacy constraints. Solving this problem is challenging because devices only possess partial network information, and the complex coupling between topology, security, and convergence remains unclear. To bridge this gap, we first analytically characterize the trade-offs between dynamic connectivity, Byzantine detection, privacy levels, and convergence speed. Leveraging these insights, we develop a fully distributed Graph Neural Network (GNN)-based Reinforcement Learning (RL) algorithm. This approach enables devices to make autonomous connection decisions based on local observations. Simulation results demonstrate that our method achieves superior robustness and efficiency with significantly lower overhead compared to traditional security and privacy schemes.

From Pixels to Words -- Towards Native Vision-Language Primitives at Scale

arXiv:2510.14979v2 Announce Type: replace-cross Abstract: The edifice of native Vision-Language Models (VLMs) has emerged as a rising contender to typical modular VLMs, shaped by evolving model architectures and training paradigms. Yet, two lingering clouds cast shadows over its widespread exploration and promotion: (-) What fundamental constraints set native VLMs apart from modular ones, and to what extent can these barriers be overcome? (-) How to make research in native VLMs more accessible and democratized, thereby accelerating progress in the field. In this paper, we clarify these challenges and outline guiding principles for constructing native VLMs. Specifically, one native VLM primitive should: (i) effectively align pixel and word representations within a shared semantic space; (ii) seamlessly integrate the strengths of formerly separate vision and language modules; (iii) inherently embody various cross-modal properties that support unified vision-language encoding, aligning, and reasoning. Hence, we launch NEO, a novel family of native VLMs built from first principles, greatly narrowing the gap with top-tier modular counterparts across diverse real-world scenarios. With 390M image-text examples, NEO efficiently develops visual perception from scratch while mitigating vision-language conflicts inside a dense and monolithic model crafted from our elaborate primitives. We position NEO as a cornerstone for scalable and powerful native VLM development, paired with a rich set of reusable components that foster a cost-effective and extensible ecosystem. Our code and models are publicly available at: https://github.com/EvolvingLMMs-Lab/NEO.
❌