❌

Normal view

Disentangled Double Machine Learning for Accurate Causal Effect Estimation

arXiv:2605.24808v1 Announce Type: cross Abstract: Confounding bias is a key challenge in causal effect estimation from observational data. Double Machine Learning (DML) addresses this issue by estimating treatment and outcome nuisance functions, constructing treatment and outcome residuals, and estimating causal effects from the residuals. However, DML often produces biased and unstable estimates in highdimensional or finite-sample scenarios. One reason is that DML estimates nuisance functions using all covariates without disentangling distinct latent factors, resulting in unreliable nuisance function estimation. Another is that imprecise nuisance estimation further introduces residual dependence between the treatment residual and the remaining outcome error, undermining the accuracy of causal effect estimates. To address these issues, in this paper, we propose Disentangled Double Machine Learning (DDML), a novel algorithm that integrates two key strategies. First, a causal role disentanglement strategy decomposes covariates into confounders, treatment-specific factors, and outcomespecific factors for enabling reliable nuisance function estimation. And second, a residual dependence orthogonalization strategy mitigates residual dependence caused by nuisance estimation errors for enhancing the precision of causal effect estimates. Experimental results on synthetic, semi-synthetic, and real-world datasets demonstrate that DDML significantly outperforms 13 state-of-the-art baseline algorithms in both MAE and RMSE.

PageLLM: A Multi-Grained Reward Framework for Whole-Page Optimization with Large Language Models

arXiv:2506.09084v2 Announce Type: replace-cross Abstract: Whole-page optimization (WPO) decides how search and recommendation results are surfaced to users, and large language models (LLMs) open a new route to it by treating page generation as sequence generation. Adapting LLMs to web-scale WPO, however, remains bottlenecked by the need for costly human annotations and by the mismatched granularity between page-level coherence and item-level placement. In this work we show that these two challenges are coupled: implicit user feedback alone suffices for alignment, provided the reward signal is decoupled into two complementary granularities. We propose PageLLM, a reward-based fine-tuning framework that (i) turns implicit feedback into four contrastive preference-pair families covering relevance, ranking, diversity, and redundancy, (ii) learns a coarse page-level reward and a fine item-level reward that captures engagement-sensitive position swaps, and (iii) combines both rewards in PPO-based RLHF over a pre-trained LLM. Extensive experiments on seven Amazon categories against eleven baselines show that neither reward alone is sufficient -- dropping the page-level or item-level signal reduces NDCG@100 by 17.8% and 15.2% respectively, whereas the joint reward improves NDCG@100 by up to 46.8%. Deployed in a 10M-user online A/B test, PageLLM raises GMV by 0.44% and click-through rate by 0.14%, confirming that multi-grained rewards from implicit feedback scale to production WPO. Code and data are available at an anonymized repository.

ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference

arXiv:2510.02361v2 Announce Type: replace-cross Abstract: Transformer-based large models excel in natural language processing and computer vision, but face severe computational inefficiencies due to the self-attention's quadratic complexity with input tokens. Recently, researchers have proposed a series of methods based on block selection and compression to alleviate this problem, but they either have issues with semantic incompleteness or poor training-inference efficiency. To comprehensively address these challenges, we propose ChunkLLM, a lightweight and pluggable training framework. Specifically, we introduce two components: QK Adapter (Q-Adapter and K-Adapter) and Chunk Adapter. The former is attached to each Transformer layer, serving dual purposes of feature compression and chunk attention acquisition. The latter operates at the bottommost layer of the model, functioning to detect chunk boundaries by leveraging contextual semantic information. During the training phase, the parameters of the backbone remain frozen, with only the QK Adapter and Chunk Adapter undergoing training. Notably, we design an attention distillation method for training the QK Adapter, which enhances the recall rate of key chunks. During the inference phase, chunk selection is triggered exclusively when the current token is detected as a chunk boundary, thereby accelerating model inference. Experimental evaluations are conducted on a diverse set of long-text and short-text benchmark datasets spanning multiple tasks. ChunkLLM not only attains comparable performance on short-text benchmarks but also maintains 98.64% of the performance on long-context benchmarks while preserving a 48.58% key-value cache retention rate. Particularly, ChunkLLM attains a maximum speedup of 4.48x in comparison to the vanilla Transformer in the processing of 120K long texts.

SSDAU: Structured Semantic Data Augmentation for Joint Entity and Relation Extraction

arXiv:2605.23440v2 Announce Type: replace-cross Abstract: Joint Entity and Relation Extraction (JERE) is highly susceptible to weak generalization due to low-quality training data. Data augmentation is a common strategy to enhance model generalization across different domains. However, existing data augmentation methods often overlook text relevance and may disrupt semantic structures and dependencies, making it difficult to generate effective augmented data for improving model generalization. In this paper, we propose Structured Semantic Data Augmentation (SSDAU), a novel method designed to preserve the semantic structure of text during augmentation. SSDAU segments text based on entity labels and employs an encoder to capture semantic features of entities through context awareness. It then performs entity semantic restructuring to generate augmented data. To distinguish semantically similar entities, SSDAU fuses contextualized embeddings with traditional similarity scores. To mitigate potential topic ambiguity and information loss, we apply the BERTTopic model to filter out irrelevant topics, ensuring topic consistency. We evaluate SSDAU on datasets with different annotation types and compare its performance on five representative JERE models against seven popular data augmentation baselines. Experiments demonstrate that SSDAU generates semantically consistent data with superior robustness against ambiguity (8.26% F1 decrease vs. 31.91% for baselines), significantly outperforming all existing methods across all metrics.

circPARPBP promotes cancer stemness and chemoresistance in triple-negative breast cancer through recruiting SRCAP complex to activate CCL20 transcription

Oncogene, Published online: 21 May 2026; doi:10.1038/s41388-026-03819-4

circPARPBP promotes cancer stemness and chemoresistance in triple-negative breast cancer through recruiting SRCAP complex to activate CCL20 transcription

Integrative multi-omics and experimental validation reveal UBE2C as a central hub gene and prognostic biomarker in hepatocellular carcinoma

Int Immunopharmacol. 2026 May 19;183:116866. doi: 10.1016/j.intimp.2026.116866. Online ahead of print.

ABSTRACT

Hepatocellular carcinoma (HCC) is a lethal malignancy with a high recurrence rate and limited treatment options. Ubiquitin-conjugating enzyme E2 C (UBE2C) is implicated in various cancers, yet its impact on the HCC immune landscape remains incompletely understood. Herein, hub genes in HCC were identified, by integrating co-expression networks and protein-protein interaction analyses, from the TCGA, GEO, and CPTAC databases. Their expression was analysed using a single-cell transcriptomic database and verified in HCC tissues and cell lines via quantitative reverse transcription-PCR and immunoblotting. Functional roles of UBE2C were assessed using in vitro knockdown experiments and an in vivo subcutaneous tumour model. The tumour immune microenvironment was profiled using spatial transcriptomics, RNA-seq data, and ssGSEA. A prognostic nomogram was constructed based on multivariate Cox regression. UBE2C was identified as a significantly upregulated hub gene in HCC. Single-cell RNA-seq revealed predominant expression of UBE2C in hepatocytes, with dynamic upregulation along differentiation trajectories. UBE2C knockdown suppressed proliferation, induced apoptosis, and inhibited tumour growth. Spatial transcriptomics highlighted UBE2C-high regions within proliferative niches exhibiting immunosuppressive traits-including TGFB1 enrichment, impaired CXCL9-CXCR3 signalling, and exclusion of cytotoxic T cells-which were reduced in immunotherapy responders. UBE2C expression correlated with immune checkpoint genes and specific immune cell subsets. A UBE2C-based nomogram integrating T stage and tumour stage robustly predicted patient survival, and miR-300 and miR-381-3p were identified as potential upstream regulators. These findings establish UBE2C as a key driver of HCC progression and a biomarker for prognosis and immunotherapy stratification.

PMID:42155390 | DOI:10.1016/j.intimp.2026.116866

❌