arXiv Science⌕ Search

arXiv subjects

Fan Jiang

Publications and source records attributed to Fan Jiang.

At least 19 recordsLinked to original sources

LISA: Linear-Indexed Sparse Attention for Efficient Long-Context Reasoning

Long chain-of-thought (CoT) reasoning models such as DeepSeek-R1 keep lengthening their inference chains under test-time scaling, yet standard self-attention incurs quadratic cost in context length, making long-CoT deployment costly in production. We therefore introduce LISA (Linear-Indexed Sparse Attention), a plug-and-play replacement for self-attention that requires no full pretraining. LISA combines a linear-attention branch for long-range memory with a Lightning Indexer that dynamically selects the most relevant tokens for a sparse self-attention branch. The two branches are fused through a learned gate, so the model retains broad context while focusing computation on informative tokens. We train LISA in two stages. In Stage 1, a linear-attention branch is integrated with sliding-window attention and distilled from a frozen teacher's full-attention distribution. In Stage 2, the Lightning Indexer replaces the static window and is trained with a per-head KL-divergence objective to mimic teacher attention patterns. The resulting model reduces eager-mode self-attention computation from quadratic in sequence length to linear in the number of generated tokens and the selected context budget. Experiments on DeepSeek-distilled Qwen models show that LISA cuts measured eager-mode mean sample latency by 23.9% at 16K context without degrading long-context reasoning quality. Across nine mathematical and code reasoning benchmarks, the gated LISA-1.5B model improves the equal-weight benchmark average by 4.2 percentage points relative to the full-attention baseline.

cs.AI↗

Graph Neural Network Prediction of Frequency Nadir and RoCoF Under Topology Variations

Accurate prediction of frequency dynamics under varying network topologies is essential for rapid frequency security assessment, whereas repeated electromagnetic transient (EMT) simulations are computationally intensive. This paper develops a topology-aware graph neural network with a radial basis function Kolmogorov-Arnold network (RBF-KAN) regression head, termed RK-GNN, to predict frequency nadir and maximum absolute rate of change of frequency (RoCoF). Scenarios combine load scaling, regional load redistribution, and generator redispatch with intact, N-1, and N-2 transmission topologies. After checks for network connectivity, generator reference limits, and numerical consistency, the retained scenarios are simulated in PSCAD to construct the reference dataset. The RK-GNN is evaluated against a conventional deep neural network (DNN) and a baseline GNN. On the IEEE 39-bus system, the RK-GNN reduces the mean absolute errors (MAEs) of nadir and RoCoF by 48% and 59% relative to the DNN and by 42% and 61% relative to the baseline GNN. Incorporating the bridge indicator and disturbance hop distance yields further MAE reductions of 27% and 54%. These results show that the proposed topology-aware architecture provides accurate prediction of both frequency metrics under varying topologies and substantially reduces the need for repeated EMT simulations.

eess.SY↗

Assessing Data Center Hosting Capacity Considering Electromagnetic Transient Dynamics

Hosting capacity is commonly assessed with steady-state optimization, which leaves the dynamic response of the data center and the grid at the resulting operating point untested. This paper assesses candidate data center capacities by coupling a unit commitment (UC) model with electromagnetic transient (EMT) simulation. During the capacity search, the UC model determines the economic dispatch for each tested data center capacity, and the resulting operating points are tested for settling with the generators committed online by the UC model and after a selected synchronous generator outage. Three nested capacities are obtained: the optimization-based steady-state capacity, the dynamic pre-outage capacity, and the post-outage dynamic capacity, each bounded by the previous one. On a test system with a detailed data center model, both dynamic capacities fall well below the optimization capacity, and the ranking of connection locations changes with the assessment stage and with the outage. In the most severe outage case at each candidate bus, the capacity is about 30% below the steady-state capacity. Thus, the dynamic response of the data center and the grid should be part of the hosting capacity assessment, and the comparison of connection locations should be made on the post-outage dynamic capacity.

eess.SY↗

Neural Network-Enhanced Frequency-Constrained Optimal Power Flow With Worst RoCoF and Frequency Deviation

Frequency-constrained optimal power flow (FCOPF) should keep the rate of change of frequency (RoCoF) and the frequency deviation (FD) within their limits after a specified generator out-age. The linearized frequency constraints commonly used in FCOPF are derived from aggregated system frequency response (SFR) models, which describe the center of inertia (COI) fre-quency with simplified governor dynamics and can underesti-mate the frequency excursions experienced by individual genera-tors. To address this issue, this paper develops a neural network-based frequency predictor (NN-FP) trained on electromagnetic transient (EMT) simulations in PSCAD/EMTDC. The NN-FP predicts the worst RoCoF and the worst FD over the monitored generators, namely the generators at all buses other than the contingency bus. The trained NN-FP is reformulated and embed-ded into FCOPF with tightened frequency limits obtained from the test set prediction errors of NN-FP, leading to the proposed NN-FCOPF. The proposed model is compared with a traditional optimal power flow and a linearized FCOPF. EMT validation of 24-hour dispatches on the IEEE 9-bus and 39-bus systems shows that NN-FCOPF satisfies both limits in all hourly cases for the specified contingency, whereas the linearized FCOPF violates the limits in some hours because it underestimates the worst genera-tor RoCoF and FD.

eess.SY↗

HISA: Efficient Hierarchical Indexing for Fine-Grained Sparse Attention

Token-level sparse attention mechanisms, exemplified by DeepSeek Sparse Attention (DSA), achieve fine-grained key selection by scoring every historical key for each query through a lightweight indexer, then computing attention only on the selected subset. While the downstream sparse attention itself scales favorably, the indexer must still scan the entire prefix for every query, introducing an per-layer bottleneck that grows prohibitively with context length. We propose HISA (Hierarchical Indexed Sparse Attention), a plug-and-play replacement for the indexer that rewrites the search path from a flat token scan into a two-stage hierarchical procedure: (1) a block-level coarse filtering stage that scores pooled block representations to discard irrelevant regions, followed by (2) a token-level refinement stage that applies the original indexer exclusively within the retained candidate blocks. HISA preserves the identical token-level top-sparse pattern consumed by the downstream Sparse MLA operator and requires no additional training. On kernel-level benchmarks, HISA achieves up to speedup at 64K context. On Needle-in-a-Haystack and LongBench, we directly replace the indexer in DeepSeek-V3.2 and GLM-5 with our HISA indexer, without any finetuning. HISA closely matches the original DSA in quality, while substantially outperforming block-sparse baselines.

cs.LG↗

Difficulty-Estimated Policy Optimization

Recent advancements in Large Reasoning Models (LRMs), exemplified by DeepSeek-R1, have underscored the potential of scaling inference-time compute through Group Relative Policy Optimization (GRPO). However, GRPO frequently suffers from gradient signal attenuation when encountering problems that are either too trivial or overly complex. In these scenarios, the disappearance of inter-group advantages makes the gradient signal susceptible to noise, thereby jeopardizing convergence stability. While variants like DAPO attempt to rectify gradient vanishing, they do not alleviate the substantial computational overhead incurred by exhaustive rollouts on low-utility samples. In this paper, we propose Difficulty-Estimated Policy Optimization (DEPO), a novel framework designed to optimize the efficiency and robustness of reasoning alignment. DEPO integrates an online Difficulty Estimator that dynamically assesses and filters training data before the rollout phase. This mechanism ensures that computational resources are prioritized for samples with high learning potential. Empirical results show that DEPO achieves approximately 1.86x faster rollouts than DAPO in the profiled configuration, while improving benchmark performance over GRPO at comparable training cost. Our approach significantly lowers the computational barrier for training high-performance reasoning models, offering a more sustainable path for reasoning scaling.

cs.AI↗

A Topology-Aware Neural Network for Fault Location With Missing Measurements

This paper proposes a topology-aware neural network-based fault locator (TANFL) for radial distribution feeders, which uses voltage and current phasors obtained after the decay of fault induced transients, as well as feeder connection relationships and line parameters, as inputs. The shared bus encoder, bus readout module, and gated line readout module work together to identify the faulty bus or line and estimate the continuous fault location on the selected line. During training, explicit missing data indicators and random bus data block masking are introduced, enabling a single trained model to handle both complete measurement sets and scenarios where any permitted bus measurement device fails. On the IEEE 15 bus feeder, this paper compares TANFL with a conventional multilayer perceptron (MLP) and the formula-based localization method under identical data, measurement availability scenarios, and evaluation metrics. On the test partition, TANFL outperforms the conventional MLP; with complete measurements, its line fault location performance is slightly lower than that of the formula-based method, but in the average results for scenarios with one missing bus measurement block, its accuracy is the highest among the three methods at a 5% tolerance.

eess.SY↗

TriFold: Folding irregular 3D Gaussians into structured latents for 3D Scene Generation

Recent progress in 3D generation has motivated growing interest in compact generative representations of complex 3D scenes. For native 3D Gaussian scenes, however, learning such representations remains challenging due to widely varying primitive counts, nonuniform spatial density, and differences in geometry and appearance even among spatially neighboring primitives. In this work, we introduce TriFold, a native 3D Gaussian VAE that encodes Gaussian scenes into a fixed-layout triplane latent and jointly reconstructs their geometry and appearance. The key insight is to impose structural regularity on the latent space while preserving the spatial adaptivity of the underlying Gaussians. During encoding, we use cell-wise learned queries to aggregate projected Gaussians into multiple slots per cell, reducing the information loss caused by single-feature pooling. During decoding, occupancy prediction identifies active regions, where query-based set prediction and candidate selection reconstruct local Gaussian sets with spatially varying primitive counts. Building on this representation, we train a latent flow-matching model for conditional scene-level 3DGS generation, enabling point-cloud-conditioned synthesis and single-image-conditioned amodal generation. Experiments demonstrate that TriFold achieves high-fidelity reconstruction and generation from a single image that provides only a partial observation of the scene, validating its effectiveness for native 3D Gaussian representation learning. https://fantasy-amap.github.io/TriFold

cs.CV↗

Magnetic Structures Database from Symmetry-aided High-Throughput Calculations

Magnetic structures-the spatial arrangement of magnetic moments-underpin the diverse functionalities of magnetic materials, yet they have been experimentally determined for only a small fraction of known compounds. Conventional first-principles prediction requires candidate magnetic configurations as input, but the number of possible configurations is in principle infinite. Although the classic Landau-theory based symmetry analysis is widely used to classify magnetic ordering, their direct application to generate input magnetic configurations remains a major challenge due to unavoidable residual degrees of freedom. Here we turn this classification language into a practical predictive framework by resolving these freedoms through a two-step symmetry-aided strategy: an irrep-compatible maximal-magnetic-subgroup selection, followed by the physically motivated high-symmetry-direction construction. This highly efficient scheme is justified within the newly developed oriented spin space group framework. Benchmarked against 1,043 Landau-compatible experimental structures in MAGNDATA, our candidate sets reproduce 90% of the experimentally reported magnetic structures in the four high-symmetry crystal systems with only ~51 candidates per material on average, and subsequent first-principles calculations with material-specific Hubbard U parameters recover the experimental ground state with 83% accuracy. Applying the validated workflow to 19,808 transition-metal compounds, we construct a database of more than 5,000 magnetic materials-nearly twice the size of the experimental MAGNDATA. The database reveals statistical regularities accessible only at scale, including the occurrence rate of magnetism, the prevalence of competing magnetic states, and enables the identification of hundreds of magnetic topological materials, altermagnets, and other emerging magnetic phases and functionalities.

cond-mat.mtrl-sci↗

OneLA: Learning Many Worlds from Latent Actions

Learning world models across diverse domains calls for a unified control space, yet ac- tion interfaces vary across domains and action annotations are often scarce. Latent ac- tions learned directly from videos offer a promising way to establish such a space without explicit action supervision. However, learning shared latent actions across domains re- mains challenging, as variations in appearance, embodiment, and dynamics can entangle domain-specific visual cues with transferable transition structure. To this end, we intro- duce OneLA, a simple framework that learns continuous latent actions through a shared orthogonal dictionary and a common predictive objective, without task-specific designs or cross-domain alignment losses during latent action pretraining. These latent actions pro- vide a shared conditioning interface for world models, with lightweight adapters mapping native control commands into the same space. Conditioned on latent actions and the cur- rent visual state, the world model predicts context-dependent transitions for controllable rollout. OneLA improves action readout across domains and reduces action cycle-transfer rotation error by 24.8% over the strongest evaluated baseline. A joint-training comparison further shows a 20.5% improvement in Human Preference Score v3 (HPSv3) for real- scene generation. These results suggest a path toward general-purpose world models that learn from diverse videos and support flexible control through latent action space.

cs.CV↗

LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rollout

Autoregressive video diffusion models have emerged as a foundation for long-horizon world rollout. However, when extended far beyond their training windows, these models suffer from progressive drift: visual quality deteriorates, motion becomes inconsistent, and object identity gradually collapses as generated frames are recursively reused as context. We study a supervision-horizon gap: short-horizon distillation leaves later rollout states without direct supervision. We show that matching short-window marginals need not determine long-horizon behavior, while longer on-policy trajectories expose delayed failures to training. This motivates temporal manifold matching at scale for long-horizon world models. Building on this insight, we introduce LongForcing, a distillation approach that scales teacher supervision to long student self-rollouts. LongForcing preserves the short-horizon teacher-forcing and causal ODE-distillation stages, while replacing the realscore teacher in the final distribution-matching stage with an extended-horizon bidirectional teacher. The long-horizon teacher supervises extended student self-rollouts using the standard distribution-matching formulation, without modifying the student architecture or increasing inference cost. We evaluate LongForcing on text-to-video generation and interactive action-conditioned world models, achieving a VBench Quality score of 85.52 and improving WorldRoamBench 60s action score by 23.9 points in first-person ablations. Qualitative stress tests further sample interactive rollouts up to 24 hours, far beyond the training horizon. These results suggest that scaling supervision along the temporal axis is a practical step toward long-horizon world models. The project website and code are at https://github.com/Fantasy-AMAP/LongForcing.

cs.CV↗

Impact of Security Modeling Fidelity on Hyperscale Data Center Hosting Capacity Assessment

This paper assesses hyperscale data center hosting capacity in transmission grids. Hosting capacity (HC) analysis quantifies the maximum additional load a bus can accommodate without violating operational constraints. This paper defines data center HC as the maximum time-invariant active power demand at a single target bus over a 24-hour peak-day horizon, and evaluates it under four models of increasing fidelity (i.e., the extent to which the model enforces real-world operational security requirements) on the modified IEEE 24-bus system: (i) DC optimal power flow (DC-OPF) without unit commitment (UC), (ii) basic SCUC (security-constrained unit commitment) without reliability constraints, (iii) SCUC with spinning reserve, and (iv) N-SCUC with both reserve and branch-contingency security. Comparing these models quantifies the impact of unit commitment, reserve requirements, and N-1 security on bus-level HC estimates. The N-SCUC yields an average HC of 444 MW; omitting N-1 security raises this to 532 MW, a 19.8% overestimation. The DC-OPF and basic SCUC models further overestimate HC, indicating a trade-off between model complexity and estimation accuracy.

eess.SY↗

GAD: Geometry Attention Distillation for Consistent Video Generation

Video diffusion models generate visually compelling short-term sequences but often struggle to preserve scene geometry and object structure over time. In this paper, we first demonstrate that current video attention cannot identify reliable correspondences across frames, with responses dispersed across multiple regions even after recognizable scene structure has emerged. We argue that reliable cross-frame associations are essential for information exchange as scene structure forms in video generation. Thus, we introduce Geometry Attention Distillation (GAD), which transfers correspondences from a frozen geometry model's attention to video attention. Extracted from clean videos, these correspondences link the same static surface or moving object across frames. Since structure formation begins in deeper layers at higher noise and shallower layers at lower noise, we apply attention distillation at a student layer selected according to the noise timestep. After training, video attention focuses more consistently on corresponding locations. Experiments across all three video backbones demonstrate improved long-range scene consistency and dynamic temporal consistency, with geometric gains across generation lengths. On Wan2.2 5B, GAD improves cross-frame matching accuracy by at least 30% over the Wan baseline on both long-range benchmarks. Notably, GAD achieves these gains without additional inference modules, offering a promising approach to efficient and consistent video-based world simulation. Project page: https://fantasy-amap.github.io/GAD/.

cs.CV↗

Integer-Forcing Precoding: A Geometric Perspective and Low-Complexity Algorithm Design

The joint coefficient--scaling design of integer-forcing (IF) precoding couples a full-rank integer coefficient matrix with a positive diagonal scaling matrix, resulting in a mixed discrete--continuous optimization problem. We first distinguish the original full-rank formulation and its finite-field invertibility requirement from the unimodular restriction studied in the subsequent analysis. Under this restriction, we formulate coefficient selection as the unimodular minimum-sum basis problem (UMSBP). By parameterizing the scaling matrix with its normalized diagonal vector, we define a deterministic exact single-output UMSBP oracle whose preimages partition the scaling manifold into disjoint coefficient-labelled regions. The restricted objective is consequently represented as the lower envelope of fixed-coefficient quadratic functions. Based on this formulation, we derive an exact decomposition into fixed-coefficient scaling optimization, coefficient-consistency verification, cross-region exploration, and candidate comparison. We prove that exact UMSBP evaluation is NP-hard through a polynomial-time reduction from exact Euclidean CVP. For a fixed coefficient matrix, we derive an equivalent convex formulation, its normalized stationarity condition, and a matrix-balancing interpretation. Under the stated positivity and finite-projective-diameter condition

cs.IT↗

CLEAN: Psychometrically Consistent Incremental Cognitive Diagnosis under Concept-Space Expansion via Architectural Isolation

Cognitive diagnosis (CD) is a fundamental task in intelligent education that profiles learner proficiency over knowledge concepts. In real-world learning platforms, newly added items continually introduce previously unseen concepts, necessitating dynamic expansion of the underlying concept space. Yet existing incremental CD models assume a fixed concept space, allowing gradients from new items to overwrite historical pathways and induce catastrophic forgetting. More critically, these methods rely solely on soft constraints to preserve historical diagnoses. Such constraints may fail to satisfy the requirement of diagnostic invariance after incremental updates, a requirement known as psychometric consistency in cognitive diagnosis. Therefore, we propose CLEAN (Continual Learning with Expandable and Architecturally Isolated Networks), a novel incremental CD framework supporting concept-space expansion while providing structural guarantees for pointwise invariance of historical diagnoses. Specifically, CLEAN first introduces a strict topological bipartition protocol, freezes historical diagnostic functions and applies deterministic orthogonal column masking to sever gradient interference. Second, to accommodate concept expansion, expandable full-rank branches with micro-variance initialization are deployed to learn novel concepts. Finally, to verify that this architectural design achieves invariance by construction, we formalize Representation Drift (RD) to quantify the perturbation of historical traits. Extensive experiments on three large-scale educational datasets demonstrate that CLEAN achieves zero RD, preserving old-item metrics identically to static anchors through architectural isolation while remaining competitive with or superior to strong continual-learning baselines on new items.

cs.LG↗

WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models

Despite rapid progress in interactive world models (IWMs), short-horizon performance does not establish sustained action following, visual stability, physical plausibility, or memory. We introduce WorldRoamBench, an open-world benchmark for long-horizon stability across four dimensions, each with innovations: (i) Action: per-frame action metric bypassing cross-model semantic scale disparity and exposing failures hidden by trajectory; (ii) Vision: sliding-window drift metric capturing non-monotonic mid-sequence collapse missed by start-vs-end comparisons; (iii) Physics: evaluation of physical plausibility across mechanics, optics, and 3D consistency, gated by camera-motion and subject-tracking checks; (iv) Memory: a trajectory-aware protocol reducing confounding from action-following errors, evaluating scene memory via transition-localized 3D point-cloud reconstruction and subject memory via tracking-plus-VLM reasoning. The benchmark comprises 1000+ test cases across Nature, Urban, and Indoor scenes in first/third-person views with WASD 10-60 s continuous interaction. Evaluating 10+ open/closed-source models reveals none reliably satisfies all dimensions; even the best achieves only moderate scores. Advances on WorldRoamBench are steps toward IWMs that are stable, physically grounded, memory-faithful, and deployable in real-world applications.

cs.CV↗

ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

We present ABot-World-0, an action-conditioned video world model for real-time, long-horizon closed-loop interaction, supported by a multi-source data infrastructure spanning AAA games, simulation engines, and internet videos to learn controllable world dynamics. WorldExplorer performs agent-driven collection guided by training feedback, while a unified pipeline applies 14 deterministic quality checks, VLM-based assessment, and synchronized action and text annotation. We progressively distill a bidirectional action-conditioned teacher into a causal student through teacher forcing and ODE distillation, and introduce LongForcing to align long student self-rollouts with an extended-horizon teacher, mitigating accumulated distribution shift and autoregressive drift. Raw keyboard actions provide a unified control interface for scene roaming and third-person character interaction, while reference-character memory provides persistent appearance cues for identity consistency during third-person rollouts. For deployment, we co-design a streaming inference stack with a lightweight VAE decoder, efficient attention, memory-aware scheduling, and low-bit DiT inference. Across optimized low-bit configurations, ABot-World-0 streams 720P video at up to 16 FPS on a single NVIDIA RTX 5090 desktop GPU, with 1.2s action-to-first-frame latency and approximately 19GiB peak VRAM. Experiments on WorldRoamBench and extended interactive rollouts demonstrate competitive controllability and coherent long-horizon world evolution.

cs.CV↗

Mid-infrared-to-ultraviolet supercontinuum generation in low-loss tantalum pentoxide nanophotonic waveguides

Optical frequency combs on photonic integrated platforms are revolutionizing precision metrology, bio-imaging, atomic and molecular sensing, and ultrafast photonics, yet most remain confined to the near-infrared. This restriction prevents access to the ultraviolet, visible, and mid-infrared bands critical for a vast array of quantum, atomic, and molecular systems. The fundamental obstacle has been the lack of a nanophotonic waveguide that simultaneously provides an ultra-broad transparency window, engineered dispersion, ultra-low propagation loss, and a strong Kerr nonlinearity, all while suppressing detrimental two-photon absorption at short wavelengths. Here, we overcome this challenge by exploring tantalum pentoxide for ultra-broadband supercontinuum spanning continuously from the ultraviolet to the mid-infrared, leveraging its broad transparency window (300-8000 nm), a high nonlinear refractive index three times larger than that of silicon nitride, and a wide bandgap that suppresses two-photon absorption. Critically, by using a photolithography assisted chemo-mechanical etching process that avoids a lossy SiO2 upper cladding, we achieve dispersion engineered waveguides with record-low propagation losses of 0.066 dB/cm at telecom wavelengths and 0.43 dB/cm at 780 nm, significantly facilitating the supercontinuum spectral extension into the ultraviolet and the mid-infrared. Pumping these anomalous-dispersion waveguides with femtosecond pulses at 1550 nm yields a gap-free, 3.2-octave supercontinuum spanning from 350 to 3200 nm via a soliton-based dynamics at only 54 pJ pulse energy, representing the broadest comb spectrum on this platform. We further demonstrate a relatively flat spectrum with a -30 dB bandwidth of 1182 nm by engineering normal dispersion, validate the comb coherence via heterodyne detection, and achieve soliton-effect pulse self-compression from 126.7 fs to 19.2 fs.

physics.optics↗