❌

Reading view

MovieTeller: Tool-augmented Movie Synopsis with ID Consistent Progressive Abstraction

arXiv:2602.23228v2 Announce Type: replace-cross Abstract: With the explosive growth of digital entertainment, automated video summarization has become indispensable for applications such as content indexing, personalized recommendation, and efficient media archiving. Automatic synopsis generation for long-form videos, such as movies and TV series, presents a significant challenge for existing Vision-Language Models (VLMs). While proficient at single-image captioning, these general-purpose models often exhibit critical failures in long-duration contexts, primarily a lack of ID-consistent character identification and a fractured narrative coherence. To overcome these limitations, we propose MovieTeller, a novel framework for generating movie synopses via tool-augmented progressive abstraction. Our core contribution is a training-free, tool-augmented, fact-grounded generation process. Instead of requiring costly model fine-tuning, our framework directly leverages off-the-shelf models in a plug-and-play manner. We first invoke a specialized face recognition model as an external "tool" to establish Factual Groundings--precise character identities and their corresponding bounding boxes. These groundings are then injected into the prompt to steer the VLM's reasoning, ensuring the generated scene descriptions are anchored to verifiable facts. Furthermore, our progressive abstraction pipeline decomposes the summarization of a full-length movie into a multi-stage process, effectively mitigating the context length limitations of current VLMs. Experiments demonstrate that our approach yields significant improvements in factual accuracy, character consistency, and overall narrative coherence compared to end-to-end baselines.
  •  

Narrative Weaver: Towards Controllable Long-Range Visual Consistency with Multi-Modal Conditioning

arXiv:2603.06688v2 Announce Type: replace-cross Abstract: We present "Narrative Weaver", a novel framework that addresses a fundamental challenge in generative AI: achieving multi-modal controllable, long-range, and consistent visual content generation. While existing models excel at generating high-fidelity short-form visual content, they struggle to maintain narrative coherence and visual consistency across extended sequences - a critical limitation for real-world applications such as filmmaking and e-commerce advertising. Narrative Weaver introduces the first holistic solution that seamlessly integrates three essential capabilities: fine-grained control, automatic narrative planning, and long-range coherence. Our architecture combines a Multimodal Large Language Model (MLLM) for high-level narrative planning with a novel fine-grained control module featuring a dynamic Memory Bank that prevents visual drift. To enable practical deployment, we develop a progressive, multi-stage training strategy that efficiently leverages existing pre-trained models, achieving state-of-the-art performance even with limited training data. Recognizing the absence of suitable evaluation benchmarks, we construct and release the E-commerce Advertising Video Storyboard Dataset (EAVSD) - the first comprehensive dataset for this task, containing over 330K high-quality images with rich narrative annotations. Through extensive experiments across three distinct scenarios (controllable multi-scene generation, autonomous storytelling, and e-commerce advertising), we demonstrate our method's superiority while opening new possibilities for AI-driven content creation.
  •  

Unraveling the Link Between Azathioprine and Acute Pancreatitis: Integrating Network Toxicology, Machine Learning, and Mendelian Randomization

CPT Pharmacometrics Syst Pharmacol. 2026 Mar;15(3):e70178. doi: 10.1002/psp4.70178.

ABSTRACT

Azathioprine (AZA), a widely used immunosuppressant, can induce acute pancreatitis (AP), yet the underlying molecular mechanisms remain unclear. This study employed an integrative multiomics strategy-combining network toxicology, machine learning, Mendelian randomization (MR), and molecular docking-to elucidate the biological basis of AZA-induced AP. AZA-associated genes were first identified through bioinformatics databases and analyzed using protein-protein interaction networks and GO/KEGG functional enrichment. Least absolute shrinkage and selection operator (LASSO) regression and support vector machine recursive feature elimination (SVM-RFE) were applied to prioritize key differentially expressed genes for diagnostic modeling. MR was then used to examine potential causal links between gene expression and AP risk, followed by molecular docking to assess AZA-protein interactions. Sixty-eight candidate genes related to AZA-induced AP were identified. Enrichment analyses indicated involvement in lipid metabolic regulation, inflammatory pathways, and energy homeostasis. Machine learning highlighted seven key genes-CES1, CTSK, JAK1, NR3C2, PLIN5, WEE1, and RORA-as central to AP development. MR analysis further demonstrated that decreased expression of CES1 and CTSK may mediate AZA-related AP susceptibility. Docking simulations revealed strong, specific binding between AZA and both CES1 and CTSK. Overall, this study identifies CES1 and CTSK as genetically protective factors and mechanistic mediators in AZA-triggered AP. These findings offer new molecular insights into the genomic and biochemical pathways underlying this adverse drug reaction.

PMID:41832938 | DOI:10.1002/psp4.70178

  •  
❌