arXiv subjects

Peng Hu

Publications and source records attributed to Peng Hu.

At least 19 recordsLinked to original sources

arXiv2026

RAMA: Retrieval-Augmented Multi-Agent Routing with Episodic Memory for LEO Satellite Networks

Low-Earth orbit (LEO) satellite networks present a challenging routing environment due to rapidly changing topology, traffic, and link conditions. Existing deep reinforcement learning (DRL) routing methods typically rely on current observations and information encoded in network weights, limiting their ability to exploit successful past experiences. We propose RAMA, a retrieval-augmented multi-agent DRL framework with Approximate Information State (AIS), in which each satellite combines its local observation, recent routing history, neighboring state information, and retrieved entries from a per-satellite episodic memory. Retrieved experiences are integrated through a Transformer-based decision network trained with AIS-based auxiliary objectives. With weights frozen in a 140-satellite Kepler constellation, RAMA reduces mean end-to-end latency by 13.4% and 99th-percentile latency by 66.7% relative to the state-of-theart double deep Q-network (DDQN) routing method, mainly by avoiding long detours. Updated online, RAMA remains stable while DDQN degrades. On the 1,584-satellite Starlink shell 1, the reduction in mean latency grows to 93.2%, and updating RAMA online lowers its mean latency by a further 25.5%. These results demonstrate the effectiveness of retrieval-augmented memory for scalable decentralized routing in LEO satellite networks.

cs.NI↗

arXiv2026

Heterogeneous Space Data Centers: A Key Paradigm for Future Non-Terrestrial and In-Orbit Services

Lower space-launch cost and advances in AI are driving space-based data centers (SDCs) that provide AI-centric computing and communication services to in-orbit and non-terrestrial assets. However, architectural principles, service models, and energy provisioning for such SDCs, particularly in low-Earth orbit (LEO), remain largely unexplored. We introduce heterogeneous SDCs composed of large and small nodes, differentiated by computing capability, size, and power budget, to support applications spanning ground, aerial, and in-orbit users. We define use cases, node sizing and placement strategies, and interconnection topologies integrating space-to-space and space-to-ground links. Focusing on dawn-dusk LEO configurations, we analyze solar power availability, visibility windows, and latency-aware coverage. Using baseline workloads for typical scenarios, we evaluate latency and service reliability. We quantify energy requirements of different SDC roles and deployment scales, highlighting trade-offs among node size, orbit selection, and service portfolio, and provide design guidance and future research directions for AI infrastructure in space.

eess.SY↗

arXiv2026

Attention Transfer Is Not Universally Effective for Vision Transformers

A recent work shows that Attention Transfer, which transfers only the attention patterns from a pre-trained teacher Vision Transformer (ViT) to a randomly initialized standard student ViT, is sufficient to recover the full benefit of the teacher's pre-trained weights. We revisit this finding on a comprehensive benchmark of 20 teachers from 11 well-known ViT families and reveal that Attention Transfer is not universally effective. While 7 families transfer successfully, 4 consistently fail, falling up to 5.1\% below the from-scratch no-transfer baseline. Further results demonstrate that this failure is family-consistent across model sizes, and persists under extended training durations, different transfer datasets, and out-of-distribution evaluations. Controlled analyses then consistently localize the problem to the attention-routing channel, indicating that the key issue is not whether the student can match the teacher's attention patterns, but whether the matched patterns remain functional for the student. Crucially, we identify architectural mismatch between the pre-trained teacher and the standard student as the primary mechanism. By adding only the teacher's native architectural components to the student in a randomly initialized state, we completely reverse the failure for all 4 families. Notably, these components alone do not improve from-scratch training, confirming that they specifically unlock the usability of the teacher's attention. We further show that this failure is not explained by the inadequate choice of transfer loss, differences in pre-training recipes, or the intrinsic quality of attention maps. Our findings refine the prevailing understanding of attention in ViT representations: attention is sufficient \textit{only} when the student architecture matches the teacher.

cs.CV↗

arXiv2026

Visual Sufficiency Landscapes: Understanding Query-Conditioned Reliability in Visual Token Pruning

Different visual token pruning strategies retain different subsets while maintaining similar task performance. This motivates a combinatorial question: how many visual subsets can preserve model behavior, and how does their abundance depend on the query? We introduce visual sufficiency landscapes to characterize this abundance. At a fixed layer and budget, visual sufficiency probability is the fraction of uniformly sampled subsets that jointly preserve the dense model's answer, reference-answer likelihood, and output distribution. Independent sampling replicates separate input variation from estimation noise. Across Qwen2.5-VL-7B, InternVL2-8B, and LLaVA-v1.5-7B, differences between inputs on GQA and TextVQA exceed replication error, and different questions about the same GQA image produce distinct landscapes. Sufficiency probability also improves failure prediction for full pruning methods. On LLaVA, adding this probability increases AUC by 0.1151 for FastV, 0.0683 for VisionZip, and 0.1401 for SparseVLM, while reducing log loss and Brier score. Several architecture-adapted configurations on the other two models reproduce these gains. Under controlled selection rules, predictors trained on the original images reduce log loss on new images by 9.0%, 13.0%, and 14.1%, respectively. These results establish successful-subset abundance as a measurable dimension of local prunability and connect it to the identification of high-risk pruning conditions.

cs.CV↗

arXiv2026

NAS Timers for Non-Terrestrial Networks: Current Standards and Directions

Response-supervision timers in the 5G Non-Access Stratum (NAS) bound the time allowed for signaling exchanges before retransmission or abnormal-case handling begins. In non-terrestrial networks, that interval can include satellite propagation, terrestrial transport, and processing by multiple core-network functions. Under current 3GPP specifications, the applicable timer value for satellite access is selected according to the satellite NG-RAN radio access technology (RAT) type. However, control paths within the same low Earth orbit (LEO) network can differ in propagation delay and processing load. This article reviews the relevant 3GPP timer semantics and traces the delay components covered by different timers through 5G registration. It organizes candidate refinements along two dimensions: configuration granularity and information scope. A registration case study illustrates the trade-off between avoiding premature timer expiry and recovering promptly from message loss. The article identifies the information and coordination that future specifications would need to address to support interoperable timer configuration.

cs.NI↗

arXiv2026

RA-CAD: Learning Post-Execution Critique for State-Aware Text-to-CAD Generation

Text-to-CAD generation translates natural-language design intent into editable and executable parametric computer-aided design (CAD) codes, reducing the expertise and effort required for manual modeling. Existing methods incorporate fixed, externally supplied, prompt-induced, or separately optimized critique mechanisms to optimize the generation process, but they do not necessarily optimize how feedback is interpreted and translated into effective corrective actions throughout the generation process. To bridge this feedback-utilization gap, we present RA-CAD (ReAct Agent for CAD), a state-aware agent that interacts with the CAD environment through a Generate--Execute--Critique--Rewrite loop. At each iteration, RA-CAD executes the current code and observes its outcome. Conditioned on the design instruction, current code, and execution feedback, the agent then generates an explicit post-execution critique as an intermediate policy action. This critique either validates the current result for termination or provides revision-oriented guidance that conditions the next rewrite. CAD Code Bootstrapping (CCB) first establishes fundamental parametric CAD coding capabilities through supervised fine-tuning. Feedback-Driven Agent Optimization (FAO) subsequently applies trajectory-level Group Relative Policy Optimization to both policy-generated code and critique sequences, assigning terminal F1 and Chamfer Distance rewards to the complete interaction trajectory. This formulation makes critique an outcome-aligned, learnable policy decision rather than an unoptimized auxiliary output. Experiments on CADFusion and Text2CAD show that RA-CAD achieves state-of-the-art execution validity and geometric quality compared with existing methods and strong proprietary language models, demonstrating the effectiveness of the proposed state-aware text-to-CAD agent.

cs.AI↗

arXiv2026

Copy the Same, Distill the Difference: Initializing Linear Vision Transformers

Linear Vision Transformers (ViTs) are designed to replace the attention in Softmax ViTs with the linear-complexity attention operator for more efficient token routing, but they require from-scratch pre-training and typically underperform the original Softmax version. How to initialize linear ViTs both efficiently and effectively still remains unclear. In this work, we explicitly ask: given that most foundation ViTs are built on the mainstream Softmax attention, can linear ViTs benefit from their pre-trained weights? Recent works on Attention Transfer show that attention is the effective transferable component between Softmax ViTs, suggesting attention alone suffices for such reuse. However, we find the opposite for Softmax-to-linear transfer. The attention weights are operator-specific: copying them barely helps, and is sometimes even worse than random initialization. Instead, the attention's token routing behavior can be recovered through distillation with a proper loss design, letting linear ViTs reduce the gap and even match Softmax ones. In contrast, the MLP weights, which carry the learned representation, are operator-agnostic: they can be transferred by simple direct copying, which already carries most of the benefit of the pre-trained weights. Thus, copying MLPs can serve as an effective foundation for Softmax-to-linear transfer: paired with the distilled attention, linear ViTs eventually close the remaining gap and even surpass Softmax ones. These findings hold consistently across various linear ViT variants, different model sizes, and diverse datasets. We hope this study deepens the understanding of reusing pre-trained weights across attention operators: copy what stays the same and distill what differs, to recover the benefit across the Softmax-to-linear boundary.

cs.CV↗

arXiv2026

SPBench: A Multi-Task Evaluation Benchmark for Exploration Seismic Processing

Exploration seismic processing underpins subsurface imaging and resource exploration, but learning-based methods remain difficult to compare across studies. Our survey of 368 papers finds widespread reliance on private or difficult-to-reproduce datasets, with only 25 providing public code. This obscures whether reported gains arise from model design or experimental settings. We introduce the Seismic Processing Benchmark (SPBench), covering six tasks: random noise attenuation, trace interpolation, ground-roll suppression, multiple suppression, deblending, and first-arrival picking. We reproduce 24 supervised methods on 10 datasets under 43 standardized settings and release datasets, implementations, configurations, evaluation scripts, and results. To complement global scores and per-trace pick errors, we introduce signal-component-resolved evaluation (SCoRE) for reconstruction and a reference-free ridge-curvature score (RC_norm) for first-arrival picking. Our analyses show that synthetic rankings do not reliably predict field rankings, with task-dependent agreement when models train within each setting. As degradation strengthens, rankings reorder more under coherent ground roll than under random-like interference. The ridge score agrees with MAE-based model rankings in the evaluated settings, with a mean Kendall correlation of 0.881 across three field surveys, while SCoRE reveals frequency- and energy-dependent differences hidden by global scores. SPBench provides a reproducible basis for comparing learning-based seismic processing methods and characterizes how their relative advantages vary across data settings, degradation strengths, and evaluation criteria.

physics.geo-ph↗

arXiv2026

NeuCME: Toward Dynamic Multimodal Continual Learning via Neural Combinatorics of Multiple Experts

Multimodal continual learning has recently shown great potential for developing agents with human-like intelligence by continuously learning new tasks across multiple modalities. However, existing methods typically assume that the set of modalities per task is predefined and fixed. In this paper, we investigate a more realistic learning setting, referred to as dynamic multimodal continual learning, in which the set of modalities may vary across tasks rather than remaining fixed. This setting involves two primary challenges: (i) spatio-temporal catastrophic forgetting and (ii) adaptive multimodal fusion. To address these challenges, we propose NeuCME (as shorthand for \textbf{Neu}ral \textbf{C}ombinatorics of \textbf{M}ultiple \textbf{E}xperts), a novel framework designed to effectively learn and integrate knowledge across tasks with varying modalities. The proposed NeuCME model comprises three key components, namely modality-combinational rehearsal, multi-gated mixture-of-experts, and task relevance-guided distillation. Furthermore, we formulate an evaluation metric to quantify the dynamism of task sequences and then set up a comprehensive benchmark with different degrees of dynamism. Extensive experiments using four real-world datasets demonstrate that the proposed NeuCME outperforms state-of-the-art methods markedly.

cs.LG↗

arXiv2026

Addressing bedload flux variability due to grain shape effects and experimental channel geometry

The study-to-study variability of bedload flux measurements in turbulent sediment transport borders an order of magnitude, even for idealized laboratory conditions. This uncertainty stems from physically poorly supported, empirical methods to account for channel geometry effects in the determination of the transport-driving bed shear stress, and from study-to-study grain-shape variations. Here, we derive a universal method of bed shear stress determination. It consists of a granular-physics-based definition of the bed surface and a channel sidewall correction based on linking Reynolds stress to bulk flow properties via Kolmogorov's theory of turbulence. Application of this method to bedload transport of spherical grains---to rule out grain-shape effects---collapses data from existing laboratory measurements and grain-resolved computation fluid dynamics (CFD) and discrete element method (DEM) simulations for various channel geometries onto a single curve. In contrast, classical sidewall corrections, as well as an alternative bed surface definition, are unable to universally capture these data, especially those from shallow or very narrow channel flows. We then apply our method to an extended grain-shape-controlled data compilation, complemented by literature data for non-spherical grains and from grain-unresolved CFD-DEM simulations. This compilation covers a very diverse range of transport conditions, ranging from very narrow to infinitely wide channels, from shallow to deep channel flows, from mild to steep bed slopes, and from weak to intense transport. We generalize an existing physical bedload flux model to account for grain-shape effects and show that it explains almost all the compiled data within a factor of only $1.3$.

physics.geo-ph↗

arXiv2026

Large Language Model for Verilog Code Generation: Literature Review and the Road Ahead

Code generation has emerged as a critical research area at the intersection of Software Engineering (SE) and Artificial Intelligence (AI), attracting significant attention from both academia and industry. Within this broader landscape, Verilog, as a representative hardware description language (HDL), plays a fundamental role in digital circuit design and verification, making its automated generation particularly significant for Electronic Design Automation (EDA). Consequently, recent research has increasingly focused on applying Large Language Models (LLMs) to Verilog code generation, particularly at the Register Transfer Level (RTL), exploring how these AI-driven techniques can be effectively integrated into hardware design workflows. Despite substantial research efforts have explored LLM applications in this domain, a comprehensive survey synthesizing these developments remains absent from the literature. This review fill addresses this gap by providing a systematic literature review of LLM-based methods for Verilog code generation, examining their effectiveness, limitations, and potential for advancing automated hardware design. The review encompasses research work from conferences and journals in the fields of SE, AI, and EDA, encompassing 70 papers published on venues, along with 32 high-quality preprint papers, bringing the total to 102 papers. By answering four key research questions, we aim to (1) identify the LLMs used for Verilog generation, (2) examine the datasets and metrics employed in evaluation, (3) categorize the techniques proposed for Verilog generation, and (4) analyze LLM alignment approaches for Verilog generation. Based on our findings, we have identified a series of limitations of existing studies. Finally, we have outlined a roadmap highlighting potential opportunities for future research endeavors in LLM-assisted hardware design.

cs.AR↗

arXiv2026

Digital Twin Satellite Networks: A Paradigm for Intelligent, Efficient, and Resilient Operations

Satellite mega-constellations in Low Earth Orbit (LEO) are becoming an important part of next-generation non-terrestrial networks, but their operation remains challenging because of fast network topology variation, intermittent inter-satellite links, hardware disturbances, and strict Size, Weight, and Power (SWaP) constraints. Existing approaches based on Digital Twin (DT), Digital Twin Network (DTN), Software-Defined Networking (SDN), and Open Radio Access Network (O-RAN) provide useful building blocks for intelligent satellite networking, but they do not fully support real-time, predictive, and platform-aware network operation. In this paper, we propose a Digital Twin Satellite Network (DTSN) framework as a closed-loop architecture for reliable and intelligent management of LEO satellite constellations. The proposed framework connects the physical satellite network with a synchronized virtual twin and combines real-time telemetry, Integrated Sensing and Communication (ISAC), predictive intelligence, and resilience-oriented control. To validate the concept, we develop a constellation-scale cross-domain co-simulation using the NASA 42 spacecraft simulator and a Python-based DT bridge for a LEO constellation. The DT continuously ingests physical telemetry to manage a multi-domain threat environment, encompassing kinematic drift, hardware failures, and adversarial jamming over a 600-second flight window. By leveraging a predictive lookahead mechanism and an exponential sensor recovery model, the framework successfully isolates compromised nodes and triggers proactive network reconfiguration, thereby ensuring uninterrupted service and dynamic network resilience. These results show the potential of DTSN to support predictive and resilience-oriented satellite network operations.

cs.NI↗

arXiv2026

Multi-Branch Policy Optimization for Multimodal Large Language Models

Group-based reinforcement learning methods for multimodal large language models typically rely on trajectory-level credit assignment that applies a single advantage to all tokens in a response. However, multimodal reasoning involves substantially higher perceptual uncertainty than text-only settings, where the model must repeatedly re-examine visual information to verify intermediate interpretations, and different visual groundings can lead to divergent reasoning paths, making such uniform credit assignment particularly inadequate and causing relative advantages to progressively degenerate toward zero. To address these challenges, we propose Multi-Branch Policy Optimization (MBPO), a tree-based framework that constructs reasoning trees at vision-language decision boundaries, enabling sibling branches to explore diverse visual hypotheses and assigning segment-level credit through branch-relative advantages. We further introduce a temporal replay buffer to reuse informative segments while controlling policy staleness. Experiments on several multimodal reasoning benchmarks show that MBPO outperforms representative baselines, improving both learning signal quality and optimization efficiency. The code is publicly available at https://github.com/ShuaiLyu0110/MBPO.

cs.CV↗

arXiv2026

Constellation-Level Power Allocation for LEO Space-Based Solar Power

Space-based solar power (SBSP) has recently gained renewed attention as an appealing technological advancement for providing continuous clean energy using space-based infrastructure. However, the potential of low-Earth orbit (LEO) satellite constellations for SBSP remains largely unexplored and lacks detailed simulation-based studies. In this paper, we introduce a novel LEO SBSP system model and conduct a 24-hour system-level simulation of a Walker 4x5 LEO SBSP constellation at an altitude of 450 km, beaming 2.45 GHz microwave power to eight ground stations (GSs) under a greedy allocation policy. The model includes orbital propagation, eclipse cycles, the satellite power chain, Goubau-Brown beam coupling, ITU-R P.618 atmospheric attenuation, and onboard battery dynamics. The results confirm that the peak DC power delivered reaches 1.986 MW, while the mean per-site delivery at the served GS ranged from 40 to 75 kW. Two of the eight GSs received no service during the run, as their passes were consistently ranked lower under the greedy policy than competing links at the same step. The incident peak power density (PD) at the rectenna remained within the 3.35-5.72 W/m$^2$ range, below the International Commission on Non-Ionizing Radiation Protection (ICNIRP) general-public exposure limit. For a 20-satellite Walker LEO at this altitude, realistic per-site delivery is 50-100 kW, and the rectenna should be sized to the operational incident PD of order 5 W/m$^2$ rather than to a Geostationary Earth Orbit (GEO)-era 100 W/m$^2$ rating.

eess.SY↗

arXiv2026

Location-Aware NAS Timer Optimization in NTN-TN Integrated Networks

Efficient Non-Access Stratum (NAS) timer configuration is critical for reliable and energy-efficient Fifth Generation (5G) registration in Non-Terrestrial Network (NTN)-Terrestrial Network (TN) integrated systems, where Low Earth Orbit (LEO) satellite access introduces large registration bursts, heterogeneous propagation paths, and multi-hop satellite routing. Existing 3GPP NAS timers use fixed values, while prior closed-form timer models compute a global timer under network-level assumptions; both fail to capture user equipment (UE)-level differences in propagation delay, Access and Mobility Management Function (AMF) arrival position, and path reliability. In this paper, we propose a location-aware, UE-specific NAS timer optimization method for LEO NTN-TN integrated networks. The proposed method models the path-delay component using service-link geometry, ground-station distance, and Inter-Satellite Link (ISL) hop count, and adapts the endpoint-delay component according to each UE's expected AMF queue exposure and path reliability. Simulation results show that our method reduces registration latency, UE energy consumption, and avoidable registration attempts compared with fixed and global timer configurations, especially when timer over-provisioning causes unnecessary waiting.

cs.NI↗

arXiv2026

Robust Losses from Univariate Base Functions for Noisy-Label Learning

Learning with noisy labels is a fundamental problem in training reliable deep neural networks. Robust loss functions provide a direct and effective way to mitigate the adverse effects of label noise. However, most existing robust losses are designed directly at the level of the final multiclass objective, which makes it difficult to systematically characterize and extend their robustness properties. In this paper, we propose a general framework that constructs robust multiclass losses from univariate base functions. By defining mapping operators from base functions to multiclass losses, the robustness of the induced losses can be characterized through simple properties of the base functions. We develop two complementary construction schemes, Target Separation and Binary Reduction, corresponding to inter-class independent and inter-class dependent formulations, respectively. For both schemes, we analyze their symmetry and asymmetry properties and derive corresponding sufficient conditions, which provide theoretical criteria for noise-robust loss design. The proposed framework also provides a new route to constructing symmetric losses, serving as a complement to normalization-based symmetric loss designs. Extensive experiments on synthetic and real-world noisy-label benchmarks demonstrate that the proposed losses achieve competitive or superior performance under various noise settings.

cs.LG↗

arXiv2026

Toward Deployable Satellite Anomaly Detection: A Benchmark Study on Large-Scale ESA-ADB Telemetry

Satellite anomaly detection is essential for maintaining mission reliability and spacecraft health, yet remains challenging due to the high-dimensional, irregular, and imbalanced nature of spacecraft telemetry data. This paper presents a systematic benchmark study evaluating supervised and unsupervised anomaly detection approaches on the large-scale ESA-ADB dataset across two mission settings of varying temporal scales. Supervised models, including Multiscale Convolutional Neural Networks (Multiscale CNN), Graph Convolutional Networks (GCN), and Graph Attention Networks (GAT), are compared against unsupervised methods, namely Elliptic Envelope (EE) and Empirical Cumulative Distribution Function-based Outlier Detection (ECOD). Beyond detection performance, we rigorously analyze computational runtime and scalability, which are critical for practical deployment in spacecraft operations. Results show that supervised models achieve stronger overall performance, while unsupervised methods offer competitive precision with significantly lower computational overhead. These findings underscore a fundamental trade-off between detection capacity and operational efficiency, offering practical guidance for mission engineers designing scalable satellite health monitoring systems.

cs.CE↗

arXiv2026

Toward LEO Satellite Network Systems for Instantaneous Detection of Environmental Changes

The rapid deployment of Low Earth Orbit (LEO) satellite constellations has enabled the emergence of in-orbit edge computing and data centers, where satellites with onboard processing and high-speed inter-satellite links can collaboratively process data in space. This paper investigates whether such architectures, integrated with a deep learning-based computer vision pipeline, can achieve sub-minute information freshness suitable for real-time wildfire detection. To evaluate this hypothesis, we develop a simulation framework that models orbital dynamics, distributed processing, and network routing, using Age of Information (AoI) as the primary performance metric. A total of 720 simulation trials are conducted across 12 real-world constellation configurations, including Starlink, Kuiper, Telesat, and OneWeb. The results demonstrate that constellation design has a significant impact on AoI performance, with average AoI values ranging from 66.5 s to over 6300 s. The best-performing configurations achieve an average AoI below 70 s and a peak AoI under 100 s, indicating that orbital edge computing systems can provide the level of timeliness required for near-instantaneous environmental monitoring.

eess.SY↗