JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition

By: Zixiang Chen · Yuheng Lu · Zihao Cheng · Zeming Liu · Jizeng Bai · Ziye Huang · Zhiyin Lin · Zihan Li · Yuhang Guo · Yunhong Wang · Haifeng Wang

10 September 2026 at 12:00

arXiv:2609.10451v1 Announce Type: new Abstract: Real-world GUI usage frequently involves workflows that span multiple devices and platforms, requiring the transfer of intermediate results, maintenance of shared state, and coordination across heterogeneous environments. However, existing GUI benchmarks overwhelmingly evaluate agents on single-device, statically defined tasks, thus leaving such cross-device capabilities largely unexamined, resulting in an overly optimistic assessment of agents' readiness for real-world usage. We introduce JarvisGUI, a dynamic benchmark that evaluates GUI agents on cross-device workflows requiring coordinated interaction across heterogeneous platforms, including Android, Windows, and Ubuntu. Specifically, JarvisGUI formulates GUI tasks as input-output transformations under a lightweight type system, which allows us to automatically compose multi-step, cross-device workflows and dynamically evaluate agent performance within a unified framework. By evaluating agents in virtual environments spanning multiple operating systems, JarvisGUI reveals that state-of-the-art open-source GUI agents struggle with the state-transfer awareness, cross-platform contextual reasoning, and long-horizon dependency management required for real-world workflows, exposing a critical capability gap invisible to existing benchmarks.

Grouter: Decoupling Routing from Representation for Accelerated MoE Training

cs.AI, q-bio.NC updates on arXiv.org

By: Yuqi Xu · Rizhen Hu · Zihan Liu · Mou Sun · Kun Yuan

26 May 2026 at 12:00

arXiv:2603.06626v2 Announce Type: replace-cross Abstract: Traditional Mixture-of-Experts (MoE) training typically proceeds without any structural priors, effectively requiring the model to simultaneously train expert weights while searching for an optimal routing policy within a vast combinatorial space. This entanglement often leads to sluggish convergence and training instabilities. This paper introduces Grouter, a preemptive routing method that by distilling high-quality structures from fully-trained MoE models and serving as a fixed router for target models. By decoupling structural optimization from weight updates, Grouter significantly accelerates both the speed and quality of model convergence. To ensure the framework's versatility, we also introduce expert folding to adapt Grouter across varying model configurations and expert tuning to rebalance workloads across different data distributions. Furthermore, by leveraging the structural priors provided by preemptive routing, we can implement targeted optimizations to further enhance training throughput. Experiments demonstrate that Grouter achieves superior performance and efficiency which boosts pre-training data utilization by 4.28x and achieves up to 33.5% throughput acceleration, establishing preemptive routing as a fundamental paradigm for scalable MoE training. We publicly release our code and pretrained Grouter checkpoints at https://github.com/JimmyAwoe/Grouter.

Functional-based multi-omics early prediction of radiation pneumonitis in NSCLC using AI-generated perfusion and ventilation from planning CT

(Multiomics OR Omics) AND (Lung OR gastric OR Hepatocellular)

By: Mayang Zhao · Tao Peng · Zhi Chen · Tianyu Xiong · Bing Li · Xiaoli Zheng · Yu-Hua Huang · Liming Song · Yao Pu · Zihan Li · Jing Cai · Ge Ren

13 March 2026 at 18:00

Phys Med Biol. 2026 Mar 13. doi: 10.1088/1361-6560/ae5209. Online ahead of print.

ABSTRACT

ObjectiveThis study aims to develop a functional-based multi-omics model for early prediction of radiation pneumonitis (RP) by extracting radiomic and dosiomic features from functionally defined lung regions, using generated perfusion (Q) and ventilation (V) from pre-radiotherapy planning computed tomography (CT).ApproachWe retrospectively analyzed data from 121 patients with locally advanced non-small cell lung cancer (NSCLC) treated with curative-intent IMRT between 2015 and 2019, including pre-treatment CT and dose maps. Q and V maps were generated from CT with deep learning-based and supervoxel-based approaches, respectively. Regions of interest (ROIs) combined the planning target volume (PTV) with each of three functional lung regions-high functional lung (HFL), low functional lung (LFL), and whole lung (WL)-defined by thresholds on Q and V maps. Radiomic and dosiomic features were extracted from CT and dose distributions within each ROI. For each ROI, For each ROI, three methods-radiomics (R), dosiomics (D), and dual-omics (RD)-were constructed. 13 machine learning algorithms were trained and evaluated using 10-fold cross-validation, and model performance was assessed by the average area under the receiver operating characteristic curve (AUC), accuracy, precision, recall, and F1 score. RP was defined as CTCAE grade ≥ 2.Main resultsOf the 35 selected features, 20 were from HFL. In dual-omics models, using HFL features improved predictive performance for RP (AUC 0.879±0.105) compared to WL (AUC 0.778 ± 0.100). In HFL, the RD method outperformed both R (AUC 0.786± 0.076) and D (AUC 0.791 ± 0.107) methods. Decision curve analysis showed the dual-omics model based on HFL provided the highest net benefit across threshold probabilities.SignificanceThis study is the first to systematically demonstrate that features extracted from CT-derived HFL capture important functional differences and provide strong predictive value for RP. Compared to conventional methods, integrating radiomics, dosiomics, and CT-based functional information further improves predictive performance.&#xD.

PMID:41825133 | DOI:10.1088/1361-6560/ae5209

Functional-based multi-omics early prediction of radiation pneumonitis in NSCLC using AI-generated perfusion and ventilation from planning CT

Omics In Lung

By: Mayang Zhao · Tao Peng · Zhi Chen · Tianyu Xiong · Bing Li · Xiaoli Zheng · Yu-Hua Huang · Liming Song · Yao Pu · Zihan Li · Jing Cai · Ge Ren

13 March 2026 at 18:00

Phys Med Biol. 2026 Mar 13. doi: 10.1088/1361-6560/ae5209. Online ahead of print.

ABSTRACT

ObjectiveThis study aims to develop a functional-based multi-omics model for early prediction of radiation pneumonitis (RP) by extracting radiomic and dosiomic features from functionally defined lung regions, using generated perfusion (Q) and ventilation (V) from pre-radiotherapy planning computed tomography (CT).ApproachWe retrospectively analyzed data from 121 patients with locally advanced non-small cell lung cancer (NSCLC) treated with curative-intent IMRT between 2015 and 2019, including pre-treatment CT and dose maps. Q and V maps were generated from CT with deep learning-based and supervoxel-based approaches, respectively. Regions of interest (ROIs) combined the planning target volume (PTV) with each of three functional lung regions-high functional lung (HFL), low functional lung (LFL), and whole lung (WL)-defined by thresholds on Q and V maps. Radiomic and dosiomic features were extracted from CT and dose distributions within each ROI. For each ROI, For each ROI, three methods-radiomics (R), dosiomics (D), and dual-omics (RD)-were constructed. 13 machine learning algorithms were trained and evaluated using 10-fold cross-validation, and model performance was assessed by the average area under the receiver operating characteristic curve (AUC), accuracy, precision, recall, and F1 score. RP was defined as CTCAE grade ≥ 2.Main resultsOf the 35 selected features, 20 were from HFL. In dual-omics models, using HFL features improved predictive performance for RP (AUC 0.879±0.105) compared to WL (AUC 0.778 ± 0.100). In HFL, the RD method outperformed both R (AUC 0.786± 0.076) and D (AUC 0.791 ± 0.107) methods. Decision curve analysis showed the dual-omics model based on HFL provided the highest net benefit across threshold probabilities.SignificanceThis study is the first to systematically demonstrate that features extracted from CT-derived HFL capture important functional differences and provide strong predictive value for RP. Compared to conventional methods, integrating radiomics, dosiomics, and CT-based functional information further improves predictive performance.&#xD.

PMID:41825133 | DOI:10.1088/1361-6560/ae5209

Grouter: Decoupling Routing from Representation for Accelerated MoE Training

cs.AI, q-bio.NC updates on arXiv.org

By: Yuqi Xu · Rizhen Hu · Zihan Liu · Mou Sun · Kun Yuan

10 March 2026 at 12:00

arXiv:2603.06626v1 Announce Type: cross Abstract: Traditional Mixture-of-Experts (MoE) training typically proceeds without any structural priors, effectively requiring the model to simultaneously train expert weights while searching for an optimal routing policy within a vast combinatorial space. This entanglement often leads to sluggish convergence and training instabilities. This paper introduces Grouter, a preemptive routing method that by distilling high-quality structures from fully-trained MoE models and serving as a fixed router for target models. By decoupling structural optimization from weight updates, Grouter significantly accelerates both the speed and quality of model convergence. To ensure the framework's versatility, we also introduce expert folding to adapt Grouter across varying model configurations and expert tuning to rebalance workloads across different data distributions. Furthermore, by leveraging the structural priors provided by preemptive routing, we can implement targeted optimizations to further enhance training throughput. Experiments demonstrate that Grouter achieves superior performance and efficiency which boosts pre-training data utilization by 4.28x and achieves up to 33.5% throughput acceleration, establishing preemptive routing as a fundamental paradigm for scalable MoE training.

Reading view