arXiv Science⌕ Search

arXiv subjects

Hao Lin

Publications and source records attributed to Hao Lin.

At least 19 recordsLinked to original sources

Focused Forcing: Content-Aware Per-Frame KV Selection for Efficient Autoregressive Video Diffusion

Recent advances in autoregressive video diffusion have enabled sequential and streaming video generation. However, long-horizon generation requires increasingly large KV caches, making efficient compression without sacrificing quality challenging. Existing methods mostly select historical frames based on attention scores, but their context decisions remain coarse. When multiple frames are generated in the same chunk, these methods often apply a shared history selection to the whole chunk, score historical frames solely by attention, and assign head-wise budgets either uniformly or by attention-pattern heuristics rather than explicit head-importance estimation. We show that frames within the same generated chunk can depend on distinct historical frames, that the same historical frame can receive different attention scores as its relative temporal distance to the current frames changes, and that masking different heads induces unequal generation degradation. Motivated by these findings, we propose Focused Forcing, a training-free KV selection method that focuses cached history along both generated-frame and head dimensions. For each generated frame, Focused Forcing preserves the most relevant and distinctive historical frames by combining attention scores with diversity scores of historical frames, while assigning larger budgets to heads with higher estimated importance. Across multiple autoregressive generation paradigms, Focused Forcing achieves up to 1.48x end-to-end acceleration without training, while improving visual quality and text alignment. Our code is available at https://github.com/caipeiliang2004/Focused-Forcing.

cs.CV↗

Large tight components and Dirac thresholds for tight Hamilton cycles

For every odd integer $r\ge1$, let $q_r=1-2^{-r}\binom r{(r-1)/2}$. We show that, for every odd $r\ge3$ and sufficiently large $n$, every $n$-vertex $r$-uniform hypergraph with at least $q_r\binom nr$ edges contains a tight component with at least $(1/2-o(1))\binom nr$ edges. This confirms a conjecture posed by Lang and Sanhueza-Matamala in 2024. As an application, for every odd $r\ge1$ and every integer $k\ge\lceil r(3-2q_r)\rceil$, we prove that the asymptotic minimum $(k-r)$-degree threshold for a tight Hamilton cycle in a $k$-uniform hypergraph is $q_r$, which settles, in this range, another conjecture of Lang and Sanhueza-Matamala in 2022 stating that the lower-bound construction due to Han and Zhao is asymptotically optimal. Our proof combines an isoperimetric inequality for Johnson graphs with a Kruskal-Katona-type theorem, which is of independent interest.

math.CO↗

Intrinsic Raman Modes and Crystal Symmetry of Altermagnetic $α$-MnTe

Crystal symmetry governs the physical properties of materials and provides the framework for interpreting their microscopic excitations and macroscopic responses. In altermagnets, the crystal symmetries that relate opposite-spin sublattices give rise to momentum-dependent spin splitting despite compensated magnetization. Determining the real crystal symmetry is therefore essential for understanding the intrinsic electronic and magnetic properties. For the altermagnetic semiconductor $α$-MnTe, conflicting Raman assignments have left both its intrinsic lattice excitations and its crystal symmetry unresolved. Here we combine high-resolution Raman and second-harmonic generation (SHG) spectroscopy with first-principles calculations to distinguish intrinsic lattice excitations from Te-derived spectral contributions and to examine bulk inversion symmetry of $α$-MnTe. We show that several prominent Raman features previously assigned to $α$-MnTe instead originate from segregated Te clusters or precipitates. The remaining intrinsic Raman response consists of a single Raman-active mode assigned to the calculated $E_{2g}$ phonon, consistent with the centrosymmetric $D_{6h}$ symmetry. The SHG response agrees with surface electric-dipole and bulk electric-quadrupole contributions expected for a centrosymmetric $D_{6h}$ crystal, supporting the preservation of bulk inversion symmetry in $α$-MnTe. Our findings revise the Raman assignments in $α$-MnTe and provide a basis for interpreting its altermagnetic properties within the appropriate crystal-symmetry framework.

cond-mat.mtrl-sci↗

Learning from Fleet Experience: Collective Experience Learning Across 96 Robots

Robot deployment generates experience that can support policy improvement, but continued reliance on expert corrective actions makes learning difficult to scale across growing fleets. We propose learning from fleet experience: using deployed robots' own executions as a source of supervision for further policy improvement. We call this paradigm Collective Experience Learning (CEL), in which robots pool execution experience to update a shared policy that returns to the fleet. Following expert-supervised initialization, we realize CEL through failure-guided experience retrieval fine-tuning (FERT). FERT uses failure contexts to retrieve relevant segments from successful trajectories and prioritizes their recorded actions for supervised updates, without collecting additional expert demonstrations or corrective actions. Operators provide binary episode-outcome labels and environment resets. A fault-tolerant asynchronous training system (FATS) coordinates robot execution, cloud inference and policy optimization despite local interruptions. Across five real-world manipulation tasks, the resulting policies achieve success rates of 93.3-99.2%, evaluated over 120 trials per task on robots excluded from training data collection. With collection time per robot held fixed, larger fleets provide more experience and generally improve performance across the evaluated sizes. On multi-stage phone packaging, learning with 96 robots raises success from 79.2% to 98.3%. These results support CEL as a scalable approach to improving robot policy reliability through experience generated during deployment.

cs.RO↗

Vanishing Uniform Turán Densities: Characterization and Jumps

Uniform Turán density problems ask for the minimum density threshold that guarantees a copy of a fixed 3-uniform hypergraph $F$ in every sufficiently large 3-uniform hypergraph whose edges are uniformly distributed. This line of research was initiated by Erdős and Sós in the 1980s, who introduced the notion of \emph{vertex-set Turán density} $π_{vvv}(F)$. Reiher, Rödl and Schacht later defined two related concepts, namely, the \emph{vertex-pair Turán density} $π_{ve}(F)$ and the \emph{cherry Turán density} $π_{ee}(F)$, which satisfy the chain of inequalities $π_{vvv}(F)\geπ_{ve}(F)\geπ_{ee}(F)$. In this paper, we investigate the problem for their vanishing densities. First, we characterize the 3-uniform hypergraphs $F$ for which $π_{ee}(F)=0$, thereby answering a question posed by Schacht. We show that these are precisely the so-called \emph{max-layered} 3-uniform hypergraphs recently introduced by Lamaison. Furthermore, we answer an analogous question of Lamaison for the \emph{minimum-codegree palette density} $π_{ee}^{\rm pal}$. Together, these results imply that the following are equivalent: $π_{ee}(F)=0$, $π_{ee}^{\rm pal}(F)=0$, and $F$ is a max-layered 3-uniform hypergraph. Let $\star \in \{vvv, ve, ee \}$. We say that zero is a \emph{jump} for $π_{\star}$ if there exists $c>0$ such that no $3$-uniform hypergraph $F$ satisfies $π_{\star}(F)\in(0,c)$. A famous result of Reiher, Rödl and Schacht asserts that zero is a jump for $π_{vvv}$. In contrast, we prove that zero is not a jump for either $π_{ve}$ or $π_{ee}$. This also yields a negative answer to Schacht's well-ordering question for $π_{ve}$. Together with existing results, these findings complete the picture for all three notions of uniform Turán density at zero.

math.CO↗

OmniGround: Strengthening Omni-Modal Temporal Grounding via Attention-Consistency Training

Omni-modal large language models can jointly understand video, audio, and text, yet they remain weak at temporal grounding, a capability essential for real-world audio-visual applications. To understand this limitation, we look beyond final predictions and examine the model's internal temporal evidence. We identify a temporal generation gap: the internal attention of the model localizes the target moment more accurately than the timestamps it generates. To close this gap, we propose TACG (Temporal Attention-Consistency Grounding), a post-training method that treats internal attention as a reliable temporal pivot and aligns it with both the model prediction and the ground-truth annotation through attention-consistency training. We further build a 580K-sample training dataset by reconstructing temporal QA from dense audio-visual annotations and organizing general omni-modal instruction data. Using TACG and this training dataset, we train OmniGround, a general-purpose omni-modal model with stronger temporal grounding capability, without injecting any additional temporal cues. OmniGround reaches state-of-the-art omni-modal temporal grounding, including 37.5 mIoU on LongVALE and 35.7 mIoU on UnAV-100, while staying competitive on both general audio-visual understanding and vision-only grounding.

cs.CV↗

The $\ell$-degree Turán densities of hypergraphs: infinite families and their finite subfamilies

Let $k>\ell\ge 1$ be integers. For a family $\mathcal{F}$ of $k$-uniform hypergraphs ($k$-graphs), its $\ell$-degree Turán density $γ^{(k)}_\ell(\mathcal{F})$ is the asymptotic maximum of the normalized minimum $\ell$-degree over all $\mathcal{F}$-free $k$-graphs. In this paper, we prove that for all integers $k>\ell>2$ and every $α\in[0,1)$, there exists an infinite family $\mathcal{F}$ of $k$-graphs such that $γ^{(k)}_\ell(\mathcal{F})=α$, while every finite subfamily $\mathcal{F}'\subset \mathcal{F}$ satisfies $γ^{(k)}_\ell(\mathcal{F}')>α$. This confirms the conjecture of Mubayi and Zhao on codegree Turán densities for every $k > 3$. As an immediate consequence, the set $Γ^{k,\ell}_{\infty}$ of $\ell$-degree Turán densities of nonempty $k$-graph families is $[0,1)$ whenever $k>\ell>2$, which answers a question of Lo and Markström from 2014.

math.CO↗

USER: A Unified and Extensible System for Real-World Online Policy Learning in Embodied AI

Online policy learning directly in the physical world is a promising yet challenging direction for embodied intelligence. Unlike simulation, real-world systems cannot be arbitrarily accelerated, cheaply reset, or massively replicated, suggesting that real-world policy learning is not merely an algorithmic problem, but inherently a systems problem. We present USER, a \underline{U}nified and extensible \underline{S}yst\underline{E}m for real-world online policy lea\underline{R}ning. On the systems side, USER introduces a hardware abstraction layer for unified robot management and an adaptive communication plane that enables efficient cloud-edge training. On the learning side, USER adopts a fully asynchronous training framework, designs a persistent and cache-aware replay buffer, and provides extensible abstractions for rewards, algorithms, and policies. Experiments in both simulation and the real world demonstrate that USER supports multi-robot coordination, heterogeneous manipulators, cloud-edge training with large models, and long-running asynchronous training. Together, these capabilities establish USER as a unified and extensible systems foundation for real-world online policy learning.

cs.RO↗

CV-OPD: Contrastive Vision On-policy Distillation

On-policy distillation (OPD) reveals versatility and convenience during VLM post-training, providing dense supervision for student from teacher. However, we observed an anomaly that the distilled VLM could still answer the questions accurately even when the related visual regions were masked or replaced with noise. Building on this observation, our quantitative and qualitative experiments demonstrate that OPD, which uses the answer as a hint, has failed to teach students to genuinely seek out and rely on visual evidence. Our theoretical analysis suggests that this failure arises from a shortcut enabled by the lack of visual constraints during distillation. To address the issue, we introduce Contrastive Vision On-policy Distillation (CV-OPD), which compares teacher distributions induced by positive and negative crops while conditioning on the same student prefix and augments optimization with a margin-based contrastive constraint, which is modulated with discrepancy gating across token and sample level. Specifically, CV-OPD first introduces a negative teacher unrelated to the answer and designs a Contrastive Divergence Loss (CDL) that constrains the feature distribution of student by contrasting the positive and negative teachers, correcting how the student exploits visual regions. The CV-OPD introduces a Discrepancy Aware Gate (DAG) that uses token-level and sample-level discrepancies to select visually relevant tokens for optimization, directing the student's attention toward visual content. Extensive experiments across a broad range of fine-grained visual benchmarks demonstrate that CV-OPD substantially alleviates shortcut and consistently improves the visual reasoning capabilities of existing VLMs.

cs.CV↗

SparseDesign: Scaling Exact Coding-Sequence Design

Exact optimization of synonymous coding sequences under a joint folding-energy and codon-usage objective is limited by expensive dynamic-programming splits and large working sets. \textsc{SparseDesign} applies candidate sparsification to the multiloop recurrence of a Turner~2004 dangle-0 solver over a weighted codon automaton. A direct branch is retained only when it strictly improves on every partitionable or endpoint-unpaired realization of the same endpoint states. We prove equivalence to the dense recurrence in real arithmetic, under an explicit scalar branch-interface assumption. With $N$ automaton states, edge set $E$ and $Z$ retained candidates, multiloop work is $O(N^2+N|E|+NZ)$; worst-case time remains cubic for bounded-width automata and total memory remains quadratic. Endpoint ownership permits parallel candidate construction without locks. While synthetic stress families can benefit little from sparsification and exhibit near-quadratic candidate growth, natural proteins show substantial candidate-count reductions. In our 7,600-task campaign, the 2,000-protein human-table panel has median retention of only 3.53\% at $λ=0$ and 2.15\% at $λ=4$, corresponding to approximately 28.3-fold and 46.4-fold reductions relative to all feasible direct intervals. The primary performance experiments use an AMD EPYC 7313 server. For human Dp427c (11,031 nt, $λ=0$), 16-thread packed \textsc{SparseDesign} achieves five-run medians of 236.54 seconds wall-clock time and 14.43 GiB peak RSS. Compared with the single-thread local dense LinearDesign fork on the same server (4,912 seconds, 402.10 GiB RSS), this gives a 20.8-fold wall-clock speedup and a 27.9-fold peak-memory reduction. On a Core i9-14900KF commodity PC with 64 GiB RAM, the same input, layout and thread count achieve 126.42 seconds and 14.43 GiB RSS.

cs.DS↗

RIS-Enabled Integrated Access and Relay: Empowering Collaboration Among BSs

The increasing number of Internet of Things (IoT) devices and applications leads to severe access congestion in conventional base station (BS) networks. Meanwhile, the low transmit power of IoT devices requires larger diversity gains from the system design. Therefore, low-cost traffic management and signal enhancement mechanisms become essential. Reconfigurable intelligent surfaces (RISs) are increasingly significant due to their flexibility and efficiency. Using reflection, refraction, and amplification, RISs can act as innovative relay nodes to overcome spatial limitations caused by blockages, and improve the coverage range of existing infrastructure. However, more extensive applications of RISs remain to be explored. In this paper, we propose to deploy co-sited RISs on BSs and use the integrated access and relay (IAR) architecture to enable wave-domain task-offloading between BSs, without requiring extra infrastructure or incurring extra decoding latency. Considering the fixed and dynamic sub-carrier schemes, we show the performance improvement in cell-free networks and cellular networks. In addition, we investigate the effect of RIS elements allocated to each IoT device in both cell-free and cellular networks. Finally, we discuss the opportunities and challenges of IAR BSs for future communications design.

cs.NI↗

Virtual Backhaul Connectivity for Enhanced Coverage in Fiber-Less Areas

This article provides an overview of potential alternatives for providing wireless backhaul in regions that suffer from the lack of fiber optic-connectivity to the core network. These regions can be rural and remote locations, low-income neighborhoods in urban and suburban regions, and post-disaster locations suffering from the destruction of cellular infrastructure. For these scenarios, extending fiber optic cables to such locations might be extremely expensive, impractical, or simply not feasible. Hence, in order to enhance the backhaul connectivity in these scenarios, we study the potential and applicability of the integrated access and backhaul (IAB) technique, and a hybrid combination of IAB and non-terrestrial networks (NTN) that includes high/low altitude platforms (HAPs/LAPs) and low earth orbit (LEO) satellites. We conclude this article by discussing the design considerations and potential research problems that would enable efficient deployment of such solutions.

cs.NI↗

AVID: A Benchmark for Omni-Modal Audio-Visual Inconsistency Understanding via Agent-Driven Construction

We present AVID, the first large-scale benchmark for audio-visual inconsistency understanding in videos. While omni-modal large language models excel at temporally aligned tasks such as captioning and question answering, they struggle to perceive cross-modal conflicts, a fundamental human capability that is critical for trustworthy AI. Existing benchmarks predominantly focus on aligned events or deepfake detection, leaving a significant gap in evaluating inconsistency perception in long-form video contexts. AVID addresses this with: (1) a scalable construction pipeline comprising temporal segmentation that classifies video content into Active Speaker, Voiceover, and Scenic categories; an agent-driven strategy planner that selects semantically appropriate inconsistency categories; and five specialized injectors for diverse audio-visual conflict injection; (2) 11.2K long videos (avg. 235.5s) with 39.4K annotated inconsistency events and 78.7K segment clips, supporting evaluation across detection, temporal grounding, classification, and reasoning with 8 fine-grained inconsistency categories. Comprehensive evaluations of state-of-the-art omni-models reveal significant limitations in temporal grounding and reasoning. Our fine-tuned baseline, AVID-Qwen, achieves substantial improvements over the base model (2.8$\times$ higher BLEU-4 in segment reasoning) and surpasses all compared models in temporal grounding (mIoU: 36.1\% vs 26.2\%) and holistic understanding (SODA-m: 7.47 vs 6.15), validating AVID as an effective testbed for advancing trustworthy omni-modal AI systems.

cs.MM↗

CoSTAR: Data Synthesis-Driven Constraint-Aware COBOL Section Summarization for Legacy System Modernization

COBOL remains critical to governments, financial institutions, and large enterprises; yet, aging technologies, shrinking expertise, and missing documentation make modernization of COBOL-based legacy systems increasingly urgent. Before migration, code summarization is a common practice to support legacy system understanding. However, COBOL code summarization, especially on section-level, faces two key challenges: data scarcity and migration constraint preservation. To address these challenges, we propose CoSTAR, an integrated framework that combines execution-validated data synthesis with constraint-aware model training. CoSTAR repurposes general-purpose programming tasks to synthesize execution-validated COBOL code-summary data through LLM-based generation to overcome data scarcity. Based on the synthesized data, CoSTAR augments target sections with relevant data declarations and natural-language explanations, and uses constraint-guided structured rationales to train smaller base LLMs. The trained LLMs preserve the migration constraints for COBOL section summarization. We evaluate CoSTAR on both public and confidential enterprise COBOL systems. CoSTAR effectively synthesizes 3,764 execution-validated training instances. Based on these instances, CoSTAR built on 7B/8B base LLMs can improve these LLMs with average relative gains of 25.38% on ROUGE-L, 53.84% on METEOR, and 37.22% on chrF. In real-world enterprise evaluation, CoSTAR built on only Qwen3-8B, outperforms the enterprise-deployed Qwen3-235B in accuracy, completeness, and conciseness. These results show that CoSTAR enables small, locally deployable LLMs to achieve performance competitive with substantially larger LLMs for privacy-sensitive COBOL legacy systems.

cs.SE↗

CAM: Question Answering on Entity-Centric Videos with Continuous Extraction and Adaptive Querying

Memory facilitates question answering over long videos by extracting and retrieving facts to fit within the limited context windows of multimodal LLMs (MLLMs). Existing solutions typically extract independent memory entries from fixed-length video clips and thus cannot capture high-level semantics that need to be summarized over extended time periods, such as character traits and relations. Moreover, they rely solely on similarity-based retrieval and may fail to retrieve the fine-grained details required for question answering. To tackle these problems, we propose CAM, featuring continuous extraction for high-level semantics and adaptive querying for fine-grained details. In particular, CAM stores the entities and relations extracted from video clips in a knowledge graph. To capture the high-level semantics of each entity or relation, CAM summarizes the local subgraph of the target entity or relation once the subgraph reaches a predefined size. To retrieve the fine-grained details required for question answering, CAM supports multiple search methods, including knowledge graph traversal, video re-watching, and audio listening. It utilizes a planner-executor-verifier pipeline to adaptively compose these search methods according to question intent. Evaluations on three benchmarks show that CAM outperforms SOTA baselines and improves their accuracy by up to 23 percentage points. Code is available at https://github.com/Jake-Tian/CAM.

cs.CV↗

Performance Evaluation of HAPS-enabled Coverage Enhancement in Hard-to-Reach Areas

High altitude platform stations (HAPSs) are becoming a key component of future non-terrestrial networks (NTNs). HAPSs can serve a larger area than uncrewed aerial vehicles (UAVs) and offer lower propagation latency, maintenance expense, and energy costs than satellites. A major application of HAPSs is to serve the areas where terrestrial network (TN) deployment is infeasible, especially in hard-to-reach areas and post-disaster areas. For instance, in the Amazon rainforest, the Mediterranean region, and deserts, TN deployment is severely constrained by geographical and environmental conditions. Only areas close to transportation networks or coastlines can be covered, while large areas remain uncovered. Such coverage holes in hard-to-reach areas are typically overlooked in existing literature. Motivated by these realistic cases, in this paper, we use tools from stochastic geometry to mathematically model hard-to-reach areas where cellular terrestrial infrastructure only exists at their perimeter. We propose to deploy a HAPS constellation over this hard-to-reach area to enhance connectivity. For that setup, we derive the downlink (DL) and uplink (UL) coverage performance of the considered user equipment (UE) as a function of the location of the UE inside the coverage hole. Our results show how the number of HAPSs, beamwidth, and HAPS altitude affect the DL and UL coverage probabilities. Finally, we provide multiple useful guidelines for future HAPS deployment.

cs.NI↗

Connectivity of HAPS-Based Solutions for Large-Scale Wireless Networks: A Percolation Theory Analysis

In the era of sixth-generation (6G) wireless communication, numerous applications are expected to be realized, including environmental monitoring, smart agriculture, remote education, security protection, and intelligent transportation systems. These scenarios require large-scale, continuous Internet services in forests, rivers, oceans, and road networks, to name a few, where optical cables are difficult to deploy. High-altitude platform stations (HAPSs) emerge as a promising solution, offering low-latency, high-capacity services while facilitating the establishment of vertical heterogeneous networks (vHetNets) in fiber-less areas. This article investigates three HAPS-based solutions, where HAPSs can serve wireless devices directly or via gateway (GW) networks: the HAPS-to-device (H2D) scheme, the HAPS-to-GW-to-device (H2G2D) scheme, and the hybrid scheme. Leveraging percolation theory, we study the feasibility of large-scale continuous Internet coverage, where the key performance indicator (KPI) is the percolation probability. We discuss the subcritical and supercritical cases in different coverage schemes, and prove that the phase transition from zero to nonzero percolation probability appears when increasing the HAPS density or GW density. Numerical results verify that the curve of the critical condition of the phase transition exists between the derived lower bound and upper bound, which can help reduce the upfront cost of HAPS-based vHetNet solutions.

cs.NI↗

VISD: Enhancing Video Reasoning via Structured Self-Distillation

Training VideoLLMs for complex reasoning remains challenging due to sparse sequence level rewards and the lack of fine grained credit assignment over long, temporally grounded reasoning trajectories. While reinforcement learning with verifiable rewards (RLVR) provides reliable supervision, it fails to capture token level contributions, leading to inefficient learning. Conversely, existing self distillation methods offer dense supervision but lack structure and diagnostic specificity, and often interact unstably with reinforcement learning. In this work, we propose VISD, a structured self distillation framework that introduces diagnostically meaningful privileged information for video reasoning. VISD employs a video aware judge model to decompose reasoning quality into multiple dimensions, including answer correctness, logical consistency, and spatio-temporal grounding, and uses this structured feedback to guide a teacher policy for token level supervision. To stably integrate dense supervision with RL, we introduce a direction magnitude decoupling mechanism, where rollout level advantages computed from rewards determine update direction, while structured privileged signals modulate token level update magnitudes. This design enables semantically aligned and fine grained credit assignment, improving both reasoning faithfulness and training efficiency. Additionally, VISD incorporates curriculum scheduling and EMA based teacher stabilization to support robust optimization over long video sequences. Experiments on diverse benchmarks show that VISD consistently outperforms strong baselines, improving answer accuracy and spatio temporal grounding quality. Notably, VISD reaches these gains with nearly 2x faster convergence in optimization steps, highlighting the effectiveness of structured self supervision in improving both performance and sample efficiency for VideoLLMs.

cs.CV↗