arXiv Science⌕ Search

arXiv subjects

Peng Li

Publications and source records attributed to Peng Li.

At least 91 records · Page 5Linked to original sources
arXiv2026

Sparse Forcing: Native Trainable Sparse Attention for Real-time Autoregressive Diffusion Video Generation

We introduce Sparse Forcing, a training-and-inference paradigm for autoregressive video diffusion models that improves long-horizon generation quality while reducing decoding latency. Sparse Forcing is motivated by an empirical observation in autoregressive diffusion rollouts: attention concentrates on a persistent subset of salient visual blocks, forming an implicit spatiotemporal memory in the KV cache, and exhibits a locally structured block-sparse pattern within sliding windows. Building on this observation, we propose a trainable native sparsity mechanism that learns to compress, preserve, and update these persistent blocks while restricting computation within each local window to a dynamically selected local neighborhood. To make the approach practical at scale for both training and inference, we further propose Persistent Block-Sparse Attention (PBSA), an efficient GPU kernel that accelerates sparse attention and memory updates for low-latency, memory-efficient decoding. Experiments show that Sparse Forcing improves the VBench score by +0.26 over Self-Forcing on 5-second text-to-video generation while delivering a 1.11-1.17x decoding speedup and 42% lower peak KV-cache footprint. The gains are more pronounced on longer-horizon rollouts, delivering improved visual quality with +0.68 and +2.74 VBench improvements, and 1.22x and 1.27x speedups on 20-second and 1-minute generations, respectively.

cs.CV↗
arXiv2026

Electronic structures across superconductor-insulator transition in Ruddlesden-Popper bilayer nickelate films

High-transition-temperature ($T_{C}$) superconductivity is recently discovered in Ruddlesden-Popper (RP) nickelate films with extraordinarily strong oxidation. While investigating phase diagrams is essential for uncovering the superconducting mechanism, the oxygen-tuned superconductor-insulator transition (SIT) in RP nickelates differs fundamentally from that in cuprates or iron-based systems. Here, we unveil the evolution of electronic structure in RP bilayer nickelate thin films across the SIT, combining angle-resolved photoemission spectroscopy (ARPES) and X-ray absorption spectroscopy (XAS) for both occupied and unoccupied states. In the superconducting state, a coherent quasiparticle band near Fermi level ($E_{F}$) coexists with an incoherent waterfall feature at high energy, paralleling that in cuprates. Approaching the insulating state with oxygen deficiency, the spectral weight of the occupied coherent quasiparticle band is gradually suppressed, accompanied by pronounced density of states redistribution and orbital reconfiguration in unoccupied states. These results reveal the electronic origin of the SIT in the phase diagram, which transcends carrier doping effects and oxygen vacancy states. Our findings point to a decisive role of oxygen in shaping the essential electronic landscape of RP bilayer nickelates, offering crucial insights into the superconducting mechanism.

cond-mat.supr-con↗
arXiv2026

Cluster Vertex Deletion on Chordal Graphs

We present a polynomial-time algorithm for the cluster vertex deletion problem on chordal graphs, resolving an open question posed in different contexts by Cao et al. [Theoretical Computer Science, 2018], Aprile et al. [Mathematical Programming, 2023], Chakraborty et al. [Discrete Applied Mathematics, 2024], and Hsieh et al. [Algorithmica, 2024]. We use dynamic programming over clique trees and reduce the computation of the optimal subproblem value to the minimization of a submodular set function.

cs.DS↗
arXiv2026

Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learning

Recent advances in Large Language Models(LLMs) have enabled strong performance in long-form writing, but current training paradigms remain limited: Supervised Fine-Tuning (SFT) remains constrained by data saturation and performance ceilings, while Reinforcement Learning with Verifiable Reward (RLVR), though successful in verifiable domains like math and code, cannot be directly migrated to open-ended long-form writing due to a lack of ground-truths. To further advance long-form writing, we present Writing-RL: an Adaptive Curriculum Reinforcement Learning framework to advance long-form writing capabilities beyond SFT. The framework consists of three key components: Margin-aware Data Selection strategy that prioritizes samples with high learning potential, Pairwise Comparison Reward mechanism that provides discriminative learning signals in the absence of verifiable rewards, and Dynamic Reference Scheduling approach, which plays a critical role by adaptively adjusting task difficulty based on evolving model performance. Experiments on 7B-scale writer models show that Writing-RL effectively improves long-form writing performance over strong SFT baselines. Furthermore, we observe that models trained with long-output RL generalize surprisingly well to long-input reasoning tasks, potentially offering a promising perspective for rethinking long-context training.

cs.CL↗
arXiv2026

MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding

Video temporal understanding is crucial for multimodal large language models (MLLMs) to reason over events in videos. Despite recent advances in general video understanding, current MLLMs still struggle with fine-grained temporal reasoning. While reinforcement learning (RL) has been explored to address this issue recently, existing RL approaches remain limited in performance on time-sensitive tasks. In this work, we propose MUSEG, a novel RL-based method that enhances temporal understanding by introducing timestamp-aware multi-segment grounding. MUSEG enables MLLMs to align queries with multiple relevant video segments, promoting more comprehensive temporal reasoning. To facilitate effective learning, we design a customized RL training recipe with phased rewards that progressively guides the model toward temporally grounded reasoning. Extensive experiments on temporal grounding and time-sensitive video question answering (QA) tasks demonstrate that MUSEG significantly outperforms existing methods and generalizes well across diverse temporal understanding scenarios. View our project at https://github.com/THUNLP-MT/MUSEG.

cs.CV↗
arXiv2026

Scaling External Knowledge Input Beyond Context Windows of LLMs via Multi-Agent Collaboration

With the rapid advancement of post-training techniques for reasoning and information seeking, large language models (LLMs) can incorporate a large quantity of retrieved knowledge to solve complex tasks. However, the limited context window of LLMs obstructs scaling the amount of external knowledge input, prohibiting further improvement. Existing context window extension methods inevitably cause information loss. LLM-based multi-agent methods emerge as a new paradigm to handle massive input in a distributional manner, where we identify two core bottlenecks in existing agent orchestration designs. In this work, we develop a multi-agent framework, \textbf{\ExtAgents}, to overcome the bottlenecks and enable better scalability in inference-time knowledge integration without longer-context training. Benchmarked with our enhanced multi-hop question answering test, \textbf{$\boldsymbol{\infty}$Bench+}, and other public test sets including long survey generation, \ExtAgents significantly enhances the performance over existing non-training methods with the same amount of external knowledge input, regardless of whether it falls \emph{within or exceeds the context window}. Moreover, the method maintains efficiency due to high parallelism. We believe further study in the coordination of LLM agents on increasing external knowledge input could benefit real-world applications.

cs.CL↗
arXiv2026

Enabling Stroke-Level Structural Analysis of Hieroglyphic Scripts without Language-Specific Priors

Hieroglyphs, as logographic writing systems, encode rich semantic and cultural information within their internal structural composition. Yet, current advanced Large Language Models (LLMs) and Multimodal LLMs (MLLMs) usually remain structurally blind to this information. LLMs process characters as textual tokens, while MLLMs additionally view them as raw pixel grids. Both fall short to model the underlying logic of character strokes. Furthermore, existing structural analysis methods are often script-specific and labor-intensive. In this paper, we propose Hieroglyphic Stroke Analyzer (HieroSA), a novel and generalizable framework that enables MLLMs to automatically derive stroke-level structures from character bitmaps without handcrafted data. It transforms modern logographic and ancient hieroglyphs character images into explicit, interpretable line-segment representations in a normalized coordinate space, allowing for cross-lingual generalization. Extensive experiments demonstrate that HieroSA effectively captures character-internal structures and semantics, bypassing the need for language-specific priors. Experimental results highlight the potential of our work as a graphematics analysis tool for a deeper understanding of hieroglyphic scripts. View our code at https://github.com/THUNLP-MT/HieroSA.

cs.CV↗
arXiv2026

Pulse Shape Discrimination Algorithms: Survey and Benchmark

This review presents a comprehensive survey and benchmark of pulse shape discrimination (PSD) algorithms for radiation detection, classifying nearly sixty methods into statistical (time-domain, frequency-domain, neural network-based) and prior-knowledge (machine learning, deep learning) paradigms. We implement and evaluate all algorithms on two standardized datasets: an unlabeled set from a 241Am-9Be source and a time-of-flight labeled set from a 238Pu-9Be source, using metrics including Figure of Merit (FOM), F1-score, ROC-AUC, and inter-method correlations. Our analysis reveals that deep learning models, particularly Multi-Layer Perceptrons (MLPs) and hybrid approaches combining statistical features with neural regression, often outperform traditional methods. We discuss architectural suitabilities, the limitations of FOM, alternative evaluation metrics, and performance across energy thresholds. Accompanying this work, we release an open-source toolbox in Python and MATLAB, along with the datasets, to promote reproducibility and advance PSD research.

cs.LG↗
arXiv2026

Superconductivity and Electronic Structures of Nickelate Thin Film Superstructures

Ruddlesden-Popper (RP) nickelates have emerged as a crucial platform for exploring the mechanisms of high-temperature superconductivity. However, the Fermi surface topology required for superconductivity remains elusive. Here, beyond the superconducting pure bilayer (2222) phase, we report the thin film growth and ambient-pressure superconductivity of monolayer-bilayer (1212) and bilayer-trilayer (2323) superstructures, together with the absence of superconductivity in monolayer-trilayer (1313) superstructure, under identical compressive epitaxial strain. The onset superconducting transition temperatures range from 46 to 50 K, exceeding the McMillan limit. Angle-resolved photoemission spectroscopy reveals key Fermi surface differences in these atomically-engineered structures. In superconducting 1212 and 2222 films, a dispersive hole-like band ($γ^{\mathrm{II}}$) forms an underlying Fermi pocket, surrounding the Brillouin zone corner. In contrast, the top of the flat band ($γ^{\mathrm{III}}$) is observed ~70 meV below $E_\text{F}$ in the non-superconducting 1313 films. Particularly, the superconducting 2323 films host both $γ^{\mathrm{II}}$ and $γ^{\mathrm{III}}$ bands. The polarization dependence of the $γ$ bands reveals their Ni $d_{z^2}$ origin. Our findings expand the family of ambient-pressure nickelate superconductors and establish a connection between structural configuration, electronic structure, and the emergence of superconductivity in nickelates.

cond-mat.supr-con↗
arXiv2026

Three-Dimensional Electronic Structures in Superconducting Ruddlesden-Popper Bilayer Nickelate Films

Beyond the quasi-two-dimensional (2D) paradigm of cuprates, the role of the third dimension of the Ruddlesden-Popper bilayer nickelates is essential to decoding their superconducting mechanism. Here, using angle-resolved photoemission spectroscopy (ARPES) with varied photon energies, we systematically investigate the electronic band structures in three dimensions for superconducting (La,Pr,Sm)$_3$Ni$_2$O$_7$/SrLaAlO$_4$ thin films (superconducting onset temperature $T_c^{\text{onset}} \sim 48$ K) transferred via a cryogenic ultra-high vacuum suitcase. We reveal an orbital-dependent dimensionality: while the $d{x^2-y^2}$-dominant bands exhibit a quasi-2D character, the $d{z^2}$-dominant band displays a finite $k_z$ dispersion. Finite energy gaps are identified on all observed bands across multiple high-symmetry directions. Systematic temperature-dependent analysis characterizes the superconducting nature of the gap on the $d{z^2}$-derived band, revealing a large gap $Δ\sim 18$ meV and a ratio $2Δ/k_BT_c\sim 8$ exceeding the weak-coupling BCS limit. The suppression of spectral weight near the Fermi level persists above the superconducting transition temperature. Ubiquitous waterfall-like spectral features evidence the presence of electron interactions. These results underscore the role of the $d_{z^2}$ orbital and correlations, placing constraints on theoretical models for nickelate superconductivity.

cond-mat.supr-con↗
arXiv2026

SPPO: Sequence-Level PPO for Long-Horizon Reasoning Tasks

Proximal Policy Optimization (PPO) is central to aligning Large Language Models (LLMs) in reasoning tasks with verifiable rewards. However, standard token-level PPO struggles in this setting due to the instability of temporal credit assignment over long Chain-of-Thought (CoT) horizons and the prohibitive memory cost of the value model. While critic-free alternatives like GRPO mitigate these issues, they incur significant computational overhead by requiring multiple samples for baseline estimation, severely limiting training throughput. In this paper, we introduce Sequence-Level PPO (SPPO), a scalable algorithm that harmonizes the sample efficiency of PPO with the stability of outcome-based updates. SPPO reformulates the reasoning process as a Sequence-Level Contextual Bandit problem, employing a decoupled scalar value function to derive low-variance advantage signals without multi-sampling. Extensive experiments on mathematical benchmarks demonstrate that SPPO significantly surpasses standard PPO and matches the performance of computation-heavy group-based methods, offering a resource-efficient framework for aligning reasoning LLMs.

cs.AI↗
arXiv2026

LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios

Recent advances in autonomous driving research towards motion planners that are robust, safe, and adaptive. However, existing rule-based and data-driven planners lack adaptability to long-tail scenarios, while knowledge-driven methods offer strong reasoning but face challenges in representation, control, and real-world evaluation. To address these challenges, we present LiloDriver, a lifelong learning framework for closed-loop motion planning in long-tail autonomous driving scenarios. By integrating large language models (LLMs) with a memory-augmented planner generation system, LiloDriver continuously adapts to new scenarios without retraining. It features a four-stage architecture including perception, scene encoding, memory-based strategy refinement, and LLM-guided reasoning. Evaluated on the nuPlan benchmark, LiloDriver achieves superior performance in both common and rare driving scenarios, outperforming static rule-based and learning-based planners. Our results highlight the effectiveness of combining structured memory and LLM reasoning to enable scalable, human-like motion planning in real-world autonomous driving. Our code is available at https://github.com/Hyan-Yao/LiloDriver.

cs.RO↗
arXiv2026

AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editing

Generative video models have significantly advanced the photorealistic synthesis of adverse weather for autonomous driving; however, they consistently demand massive datasets to learn rare weather scenarios. While 3D-aware editing methods alleviate these data constraints by augmenting existing video footage, they are fundamentally bottlenecked by costly per-scene optimization and suffer from inherent geometric and illumination entanglement. In this work, we introduce AutoWeather4D, a feed-forward 3D-aware weather editing framework designed to explicitly decouple geometry and illumination. At the core of our approach is a G-buffer Dual-pass Editing mechanism. The Geometry Pass leverages explicit structural foundations to enable surface-anchored physical interactions, while the Light Pass analytically resolves light transport, accumulating the contributions of local illuminants into the global illumination to enable dynamic 3D local relighting. Extensive experiments demonstrate that AutoWeather4D achieves comparable photorealism and structural consistency to generative baselines while enabling fine-grained parametric physical control, serving as a practical data engine for autonomous driving.

cs.CV↗
arXiv2026

Flat Band Generation through Interlayer Geometric Frustration in Intercalated Transition Metal Dichalcogenides

Electronic flat bands can lead to rich many-body quantum phases by quenching the electron's kinetic energy and enhancing many-body correlation. The reduced bandwidth can be realized by either destructive quantum interference in frustrated lattices, or by generating heavy band folding with avoided band crossing in Moire superlattices. Here we propose a general approach to introduce flat bands into widely studied transition metal dichalcogenide (TMD) materials by dilute intercalation. A flat band with vanishing dispersion is observed by angle-resolved photoemission spectroscopy (ARPES) over the entire momentum space in intercalated Mn1/4TaS2. Polarization dependent ARPES measurements combined with symmetry analysis reveals the orbital characters of the flat band. Supercell tight-binding simulations suggest that such flat bands arising from destructive interference between Mn and Ta on S through hopping pathways, are ubiquitous in a range of TMD families as well as for different intercalation configurations. Our findings establish a new material platform to manipulate flat band structures and explore their corresponding emergent correlated properties.

cond-mat.mtrl-sci↗
arXiv2026

GigaWorld-Policy: An Efficient Action-Centered World--Action Model

World-Action Models (WAM) initialized from pre-trained video generation backbones have demonstrated remarkable potential for robot policy learning. However, existing approaches face two critical bottlenecks that hinder performance and deployment. First, jointly reasoning over future visual dynamics and corresponding actions incurs substantial inference overhead. Second, joint modeling often entangles visual and motion representations, making motion prediction accuracy heavily dependent on the quality of future video forecasts. To address these issues, we introduce GigaWorld-Policy, an action-centered WAM that learns 2D pixel-action dynamics while enabling efficient action decoding, with optional video generation. Specifically, we formulate policy training into two coupled components: the model predicts future action sequences conditioned on the current observation, and simultaneously generates future videos conditioned on the predicted actions and the same observation. The policy is supervised by both action prediction and video generation, providing richer learning signals and encouraging physically plausible actions through visual-dynamics constraints. With a causal design that prevents future-video tokens from influencing action tokens, explicit future-video generation is optional at inference time, allowing faster action prediction during deployment. To support this paradigm, we curate a diverse, large-scale robot dataset to pre-train an action-centered video generation model, which is then adapted as the backbone for robot policy learning. Experimental results on real-world robotic platforms show that GigaWorld-Policy runs 9x faster than the leading WAM baseline, Motus, while improving task success rates by 7%. Moreover, compared with pi-0.5, GigaWorld-Policy improves performance by 95% on RoboTwin 2.0.

cs.CV↗
arXiv2026

Evaluating Time Awareness and Cross-modal Active Perception of Large Models via 4D Escape Room Task

Multimodal Large Language Models (MLLMs) have recently made rapid progress toward unified Omni models that integrate vision, language, and audio. However, existing environments largely focus on 2D or 3D visual context and vision-language tasks, offering limited support for temporally dependent auditory signals and selective cross-modal integration, where different modalities may provide complementary or interfering information, which are essential capabilities for realistic multimodal reasoning. As a result, whether models can actively coordinate modalities and reason under time-varying, irreversible conditions remains underexplored. To this end, we introduce \textbf{EscapeCraft-4D}, a customizable 4D environment for assessing selective cross-modal perception and time awareness in Omni models. It incorporates trigger-based auditory sources, temporally transient evidence, and location-dependent cues, requiring agents to perform spatio-temporal reasoning and proactive multimodal integration under time constraints. Building on this environment, we curate a benchmark to evaluate corresponding abilities across powerful models. Evaluation results suggest that models struggle with modality bias, and reveal significant gaps in current model's ability to integrate multiple modalities under time constraints. Further in-depth analysis uncovers how multiple modalities interact and jointly influence model decisions in complex multimodal reasoning environments.

cs.CV↗