arXiv Science⌕ Search

arXiv subjects

Shuo Yuan

Publications and source records attributed to Shuo Yuan.

At least 19 recordsLinked to original sources

D-Skill: Distilling Teacher Knowledge through Agent Skills

Frontier language-model agents excel at complex tasks, but high inference costs make transferring their capabilities to smaller models essential. Traditional knowledge distillation achieves this through parameter updates, requiring access to the student's weights and additional training compute while encoding the transferred knowledge implicitly in the parameters. We introduce D-Skill, a framework that treats the teacher as a black box and distills its behavioral advantage into an interpretable natural-language skill by analyzing paired rollouts and identifying behavioral divergences and agreements. The resulting lessons are consolidated offline, with any compatible skill-update backend, into a skill document that is provided to the student at inference time. D-Skill constructs the skill entirely offline from fixed trajectories, without labels, further environment interaction, or weight updates after rollout collection. Across SpreadsheetBench-Verified, ALFWorld, and chess puzzles spanning multiple teacher-student pairs, D-Skill closes 75%-95% of the teacher-student gap without touching model weights. After a single offline pass over the paired traces, D-Skill outperforms one-epoch SFT baselines and remains competitive with multi-epoch SFT. Under the same model family, the resulting student also incurs 5.7x-8.3x lower inference cost per task than the teacher. Our results demonstrate that natural-language skill distillation offers a performant, interpretable, and efficient alternative to weight-based capability transfer.

cs.AI↗

Headroom-Aware Stochastic Adaptive Model Predictive Control for Load Frequency Control in Microgrids

As the penetration of inverter-based resources (IBRs) increases in microgrids, they are increasingly expected to play a greater role in load frequency control (LFC). Model predictive control (MPC) is attractive for LFC because it incorporates system dynamics and operational constraints. However, most MPC-based LFC formulations rely on fixed reserve headroom based on forecasted renewable availability or storage systems. Under short-term renewable intermittency, IBR headroom is stochastic and time-varying, causing optimal control commands to exceed the physically deliverable regulation capability and cause stochastic saturation. This control-actuator mismatch degrades LFC performance. Accordingly, this study develops two headroom-aware strategies for PV-dominated microgrids. First, stochastic headroom constrained MPC (SHCMPC) incorporates headroom predictions through time-varying input constraints to enforce control feasibility. Second, stochastic adaptive MPC (SAMPC) embeds headroom awareness into the MPC objective function by adaptively penalizing control actions based on predicted headroom, reducing reliance on units with limited headroom without hard time-varying constraints. Simulation results show that stochastic saturation degrades conventional MPC-based LFC, particularly under tight reserve margins. Both strategies improve regulation performance. SHCMPC eliminates saturation events, while SAMPC achieves substantial saturation mitigation with lower computational effort, offering a computationally efficient alternative for real-time LFC under stochastic renewable availability.

eess.SY↗

First application of weak lensing peak steepness statistics to HSC Y1 data: effectively probing halo density profiles

As a new probe, the weak lensing (WL) peak steepness statistics is sensitive to the density profile of halos that encodes important information of baryonic feedback and dark matter properties, leading to a promising means to statistically constrain these effects using WL data. In this article, we present its first application to HSC Y1 data to demonstrate the great potential of this new statistics. Within the phenomenological framework of HMcode2016 that attributes the baryonic feedback solely to the reduction of the halo concentration parameter and focusing on high peaks originated dominantly from massive clusters, our analyses by combining WL peak height and steepness statistics resulted in $S_8=0.76^{+0.08}_{-0.07}$ with the maximum-a-posteriori (MAP) of $0.79$ and low concentrations. Taking the form of the concentration-mass relation as $c(M,z)=A(1+z_{\rm f})/(1+z)$ with $z_{\rm f}$ being the formation redshift of halos with mass $M$ at redshift $z$, we obtain $A=1.93^{+1.33}_{-1.16}$ (MAP=$1.70$) in comparison with $A=3.34^{+1.52}_{-1.74}$ (MAP=3.31) from dark matter only simulated mocks. The result tends to support phenomenologically strong baryonic feedback effects at cluster scales.

astro-ph.CO↗

Joint constraints on gravity and stellar orbital anisotropy in massive galaxies

Strong gravitational lensing combined with stellar dynamics provides a complementary route for testing gravity on kiloparsec scales and probing the internal structure of massive galaxies. However, such studies remain limited by degeneracies among the mass-density profile, stellar orbital anisotropy and external convergence, and by modelling assumptions, especially when only single-aperture velocity dispersions are available. Here we develop a hierarchical Bayesian framework to disentangle gravity and stellar orbital anisotropy from other effects at the population level. By reconstructing the lens mass distribution with a flexible broken power-law model and propagating its posterior uncertainty into the predicted velocity dispersion, we obtain a likelihood for each lens in the plane of stellar orbital anisotropy and an effective mismatch parameter. This parameter encapsulates projection bias, external convergence, cosmological distance ratios and deviations from general relativity via the post-Newtonian parameter $γ_{\rm PPN}$. Applying this framework to 121 galaxy-scale lenses, we find $γ_{\rm PPN}=1.027^{+0.099}_{-0.095}$, consistent with general relativity, and obtain $2σ$ evidence that the stellar orbits of massive galaxies have become more radially biased over the past $\sim6$ Gyr. Forecasts show that future samples of order $10^5$ lenses could enable sub-percent tests of gravity, precise measurements of orbital-structure evolution and complementary constraints on the cosmological matter-density parameter.

astro-ph.GA↗

Nonlinear Information from DESI Luminous Red Galaxies: An Emulator-Based Analysis of Pre- and Post-Reconstruction Power Spectra

We present joint measurements of the pre- and post-reconstruction power spectra, $P_{\rm pre}$ and $P_{\rm post}$, together with their cross-power spectrum, $P_{\rm cross}$, for the Luminous Red Galaxies (LRGs) in the DESI Data Release 1 (DR1). We jointly analyse these observables with an emulator-based full-shape modeling framework, thereby, for the first time, we extract complementary nonlinear information from the galaxy density field before and after reconstruction in real survey data. Specifically, including $P_{\rm post}$ and $P_{\rm cross}$ in addition to $P_{\rm pre}$ (hereafter $P_{\rm all}$) yields an improvement of approximately $18$-$27\%$ in the $σ_8$ constraint in both $Λ$CDM and $w$CDM, depending on the redshift bin, relative to the $P_{\rm pre}$-only analysis with the cosmic microwave background distance priors (hereafter CMB). In $w$CDM, the joint CMB+$P_{\rm all}$ analysis can tighten the constraints on $w$ by approximately $5$-$15\%$ across the two LRG redshift bins, compared to the CMB+$P_{\rm pre}$ combination. Further incorporating the Type Ia supernova dataset and comparing the cosmological constraints in $w$CDM from each individual power-spectrum component with those from the full combination, we find that $P_{\rm all}$ consistently provides the tightest constraints. From the joint CMB+$P_{\rm all}$+DES-Dovekie dataset, we obtain $Ω_m = 0.314 \pm 0.0048$ and $w = -0.988 \pm 0.023$ for the \texttt{LRG1} sample, and $Ω_m = 0.318 \pm 0.0046$ and $w = -0.988 \pm 0.025$ for \texttt{LRG2}. These results demonstrate that combining pre- and post-reconstruction power spectra with their cross-correlation enables DESI to harvest additional nonlinear information, leading to tighter constraints on cosmological parameters.

astro-ph.CO↗

Supporting Our AI Overlords: Redesigning Data Systems to be Agent-First

Large Language Model (LLM) agents, acting on their users' behalf to manipulate and analyze data, are likely to become the dominant workload for data systems in the future. When working with data, agents employ a high-throughput process of exploration and solution formulation for the given task, one we call agentic speculation. The sheer volume and inefficiencies of agentic speculation can pose challenges for present-day data systems. We argue that data systems need to adapt to more natively support agentic workloads. We take advantage of the characteristics of agentic speculation that we identify, i.e., scale, heterogeneity, redundancy, and steerability - to outline a number of new research opportunities for a new agent-first data systems architecture, ranging from new query interfaces, to new query processing techniques, to new agentic memory stores.

cs.AI↗

SkyRL-Agent: Efficient RL Training for Multi-turn LLM Agent

We introduce SkyRL-Agent, a framework for efficient, multi-turn, long-horizon agent training and evaluation. It provides efficient asynchronous dispatching, lightweight tool integration, and flexible backend interoperability, enabling seamless use with existing RL frameworks such as SkyRL-train, VeRL, and Tinker. Using SkyRL-Agent, we train SA-SWE-32B, a software engineering agent trained from Qwen3-32B (24.4% Pass@1) purely with reinforcement learning. We introduce two key components: an optimized asynchronous pipeline dispatcher that achieves a 1.55x speedup over naive asynchronous batching, and a tool-enhanced training recipe leveraging an AST-based search tool to facilitate code navigation, boost rollout Pass@K, and improve training efficiency. Together, these optimizations enable SA-SWE-32B to reach 39.4% Pass@1 on SWE-Bench Verified with more than 2x cost reduction compared to prior models reaching similar performance. Despite being trained solely on SWE tasks, SA-SWE-32B generalizes effectively to other agentic tasks, including Terminal-Bench, BrowseComp-Plus, and WebArena. We further demonstrate SkyRL-Agent's extensibility through case studies on deep research, computer use, and memory agents, each trained using a different training backend.

cs.AI↗

MUVR: A Multi-Modal Untrimmed Video Retrieval Benchmark with Multi-Level Visual Correspondence

We propose the Multi-modal Untrimmed Video Retrieval task, along with a new benchmark (MUVR) to advance video retrieval for long-video platforms. MUVR aims to retrieve untrimmed videos containing relevant segments using multi-modal queries. It has the following features: 1) Practical retrieval paradigm: MUVR supports video-centric multi-modal queries, expressing fine-grained retrieval needs through long text descriptions, video tag prompts, and mask prompts. It adopts a one-to-many retrieval paradigm and focuses on untrimmed videos, tailored for long-video platform applications. 2) Multi-level visual correspondence: To cover common video categories (e.g., news, travel, dance) and precisely define retrieval matching criteria, we construct multi-level visual correspondence based on core video content (e.g., news events, travel locations, dance moves) which users are interested in and want to retrieve. It covers six levels: copy, event, scene, instance, action, and others. 3) Comprehensive evaluation criteria: We develop 3 versions of MUVR (i.e., Base, Filter, QA). MUVR-Base/Filter evaluates retrieval models, while MUVR-QA assesses MLLMs in a question-answering format. We also propose a Reranking Score to evaluate the reranking ability of MLLMs. MUVR consists of 53K untrimmed videos from the video platform Bilibili, with 1,050 multi-modal queries and 84K matches. Extensive evaluations of 3 state-of-the-art video retrieval models, 6 image-based VLMs, and 10 MLLMs are conducted. MUVR reveals the limitations of retrieval methods in processing untrimmed videos and multi-modal queries, as well as MLLMs in multi-video understanding and reranking. Our code and benchmark is available at https://github.com/debby-0527/MUVR.

cs.CV↗

HALO: Hindsight-Augmented Learning for Online Auto-Bidding

Digital advertising platforms operate millisecond-level auctions through Real-Time Bidding (RTB) systems, where advertisers compete for ad impressions through algorithmic bids. This dynamic mechanism enables precise audience targeting but introduces profound operational complexity due to advertiser heterogeneity: budgets and ROI targets span orders of magnitude across advertisers, from individual merchants to multinational brands. This diversity creates a demanding adaptation landscape for Multi-Constraint Bidding (MCB). Traditional auto-bidding solutions fail in this environment due to two critical flaws: 1) severe sample inefficiency, where failed explorations under specific constraints yield no transferable knowledge for new budget-ROI combinations, and 2) limited generalization under constraint shifts, as they ignore physical relationships between constraints and bidding coefficients. To address this, we propose HALO: Hindsight-Augmented Learning for Online Auto-Bidding. HALO introduces a theoretically grounded hindsight mechanism that repurposes all explorations into training data for arbitrary constraint configuration via trajectory reorientation. Further, it employs B-spline functional representation, enabling continuous, derivative-aware bid mapping across constraint spaces. HALO ensures robust adaptation even when budget/ROI requirements differ drastically from training scenarios. Industrial dataset evaluations demonstrate the superiority of HALO in handling multi-scale constraints, reducing constraint violations while improving GMV.

cs.LG↗

Satellite-Terrestrial Integrated Fog Networks: Architecture, Technologies, and Challenges

In the evolution of sixth-generation (6G) mobile communication networks, satellite-terrestrial integrated networks emerge as a promising paradigm, characterized by their wide coverage and reliable transmission capabilities. By integrating with cloud-based terrestrial mobile communication networks, the limitations of low Earth orbit (LEO) satellites, such as insufficient onboard computing capabilities and limited inter-satellite link capacity, can be addressed. In addition, to efficiently respond to the diverse integrated tasks of communication, remote sensing, and navigation, LEO constellations need to be capable of autonomous networking. To this end, this article presents a satellite-terrestrial integrated fog network for 6G. Its system architecture and key technologies are introduced to achieve flexible collaboration between fog satellites and terrestrial cloud computing centers. In particular, key techniques with diverse challenges and their corresponding solutions are discussed, including integrated waveform design and resource management based on fog satellite onboard processing, as well as mobility management and native artificial intelligence based on cloud-fog collaboration. Finally, future challenges and open issues are outlined.

cs.NI↗

Cache-Aware Cooperative Multicast Beamforming in Dynamic Satellite-Terrestrial Networks

With the burgeoning demand for data-intensive services, satellite-terrestrial networks (STNs) face increasing backhaul link congestion, deteriorating user quality of service (QoS), and escalating power consumption. Cache-aided STNs are acknowledged as a promising paradigm for accelerating content delivery to users and alleviating the load of backhaul links. However, the dynamic nature of low earth orbit (LEO) satellites and the complex interference among satellite beams and terrestrial base stations pose challenges in effectively managing limited edge resources. To address these issues, this paper proposes a method for dynamically scheduling caching and communication resources, aiming to reduce network costs in terms of transmission power consumption and backhaul traffic, while meeting user QoS demands and resource constraints. We formulate a mixed timescale problem to jointly optimize cache placement, LEO satellite beam direction, and cooperative multicast beamforming among satellite beams and base stations. To tackle this intricate problem, we propose a two-stage solution framework, where the primary problem is decoupled into a short-term content delivery subproblem and a long-term cache placement subproblem. The former subproblem is solved by designing an alternating optimization approach with whale optimization and successive convex approximation methods according to the cache placement state, while cache content in STNs is updated using an iterative algorithm that utilizes historical information. Simulation results demonstrate the effectiveness of our proposed algorithms, showcasing their convergence and significantly reducing transmission power consumption and backhaul traffic by up to 52%.

cs.NI↗

Graph-based Simulation Framework for Power Resilience Estimation and Enhancement

The increasing frequency of extreme weather events poses significant risks to power distribution systems, leading to widespread outages and severe economic and social consequences. This paper presents a novel simulation framework for assessing and enhancing the resilience of power distribution networks under such conditions. Resilience is estimated through Monte Carlo simulations, which simulate extreme weather scenarios and evaluate the impact on infrastructure fragility. Due to the proprietary nature of power network topology, a distribution network is synthesized using publicly available data. To generate the weather scenarios, an extreme weather generation method is developed. To enhance resilience, renewable resources such as solar panels and energy storage systems (batteries in this study) are incorporated. A customized Genetic Algorithm is proposed to determine the optimal locations and capacities for solar panels and battery installations, maximizing resilience while balancing cost constraints. Experiment results demonstrate that on a large-scale synthetic distribution network with more than 300,000 nodes and 300,000 edges, the proposed framework can efficiently evaluate the resilience, and enhance the resilience through the installations of distributed energy resources (DERs), providing utilities with valuable insights for community-level power system resilience estimation and enhancement.

eess.SY↗

Deep Uncertainty-Based Explore for Index Construction and Retrieval in Recommendation System

In recommendation systems, the relevance and novelty of the final results are selected through a cascade system of Matching -> Ranking -> Strategy. The matching model serves as the starting point of the pipeline and determines the upper bound of the subsequent stages. Balancing the relevance and novelty of matching results is a crucial step in the design and optimization of recommendation systems, contributing significantly to improving recommendation quality. However, the typical matching algorithms have not simultaneously addressed the relevance and novelty perfectly. One main reason is that deep matching algorithms exhibit significant uncertainty when estimating items in the long tail (e.g., due to insufficient training samples) items.The uncertainty not only affects the training of the models but also influences the confidence in the index construction and beam search retrieval process of these models. This paper proposes the UICR (Uncertainty-based explore for Index Construction and Retrieval) algorithm, which introduces the concept of uncertainty modeling in the matching stage and achieves multi-task modeling of model uncertainty and index uncertainty. The final matching results are obtained by combining the relevance score and uncertainty score infered by the model. Experimental results demonstrate that the UICR improves novelty without sacrificing relevance on realworld industrial productive environments and multiple open-source datasets. Remarkably, online A/B test results of display advertising in Shopee demonstrates the effectiveness of the proposed algorithm.

cs.IR↗

Deep Ensemble Shape Calibration: Multi-Field Post-hoc Calibration in Online Advertising

In the e-commerce advertising scenario, estimating the true probabilities (known as a calibrated estimate) on Click-Through Rate (CTR) and Conversion Rate (CVR) is critical. Previous research has introduced numerous solutions for addressing the calibration problem. These methods typically involve the training of calibrators using a validation set and subsequently applying these calibrators to correct the original estimated values during online inference. However, what sets e-commerce advertising scenarios apart is the challenge of multi-field calibration. Multi-field calibration requires achieving calibration in each field. In order to achieve multi-field calibration, it is necessary to have a strong data utilization ability. Because the quantity of pCTR specified range for a single field-value (such as user ID and item ID) sample is relatively small, this makes the calibrator more difficult to train. However, existing methods have difficulty effectively addressing these issues. To solve these problems, we propose a new method named Deep Ensemble Shape Calibration (DESC). In terms of business understanding and interpretability, we decompose multi-field calibration into value calibration and shape calibration. We introduce innovative basis calibration functions, which enhance both function expression capabilities and data utilization by combining these basis calibration functions. A significant advancement lies in the development of an allocator capable of allocating the most suitable calibrators to different estimation error distributions within diverse fields and values. We achieve significant improvements in both public and industrial datasets. In online experiments, we observe a +2.5% increase in CVR and +4.0% in GMV (Gross Merchandise Volume). Our code is now available at: https://github.com/HaoYang0123/DESC.

cs.LG↗

Dynamical dark energy in light of cosmic distance measurements I: a demonstration using simulated datasets

We develop methods to extract key dark energy information from cosmic distance measurements including the BAO scales and supernovae luminosity distances. Demonstrated using simulated datasets of the complete DESI, LSST and Roman surveys designed for BAO and SNe distance measurements, we show that using our method, the dynamical behaviour of the energy, pressure, equation of state (with its time derivative) of dark energy and the cosmic deceleration function can all be accurately recovered from high-quality data, which allows for robust diagnostic tests for dark energy models.

astro-ph.CO↗

Contingency Detection in Modern Power Systems: A Stochastic Hybrid System Method

This paper introduces a new stochastic hybrid system (SHS) framework for contingency detection in modern power systems (MPS). The framework uses stochastic hybrid system representations in state space models to expand and facilitate capability of contingency detection. In typical microgrids (MGs), buses may contain various synchronous generators, renewable generators, controllable loads, battery systems, regular loads, etc. For development of SHS models in power systems, this paper introduces the concept of dynamic and non-dynamic buses. By converting a physical power grid into a virtual linearized state space model and representing contingencies as random switching of system structures and parameters, this paper formulates the contingency detection problem as a joint estimation problem of discrete event and continuous states in stochastic hybrid systems. This method offers unique advantages, including using common measurement signals on voltage and current synchrophasors to detect different types and locations of contingencies, avoiding expensive local direct fault measurements and detecting certain contingencies that cannot be directly measured. The method employs a small and suitably-designed probing signal to sustain the ability of persistent contingency detection. Joint estimation algorithms are presented with their proven convergence and reliability properties. Examples that use an IEEE 5-bus system demonstrate the main ideas and derivation steps. Simulation case studies on an IEEE 33-bus system are used for detecting transmission line faults and sensor interruptions.

eess.SY↗

Secure and Efficient Federated Learning Through Layering and Sharding Blockchain

Introducing blockchain into Federated Learning (FL) to build a trusted edge computing environment for transmission and learning has attracted widespread attention as a new decentralized learning pattern. However, traditional consensus mechanisms and architectures of blockchain systems face significant challenges in handling large-scale FL tasks, especially on Internet of Things (IoT) devices, due to their substantial resource consumption, limited transaction throughput, and complex communication requirements. To address these challenges, this paper proposes ChainFL, a novel two-layer blockchain-driven FL system. It splits the IoT network into multiple shards within the subchain layer, effectively reducing the scale of information exchange, and employs a Direct Acyclic Graph (DAG)-based mainchain as the mainchain layer, enabling parallel and asynchronous cross-shard validation. Furthermore, the FL procedure is customized to integrate deeply with blockchain technology, and a modified DAG consensus mechanism is designed to mitigate distortion caused by abnormal models. To provide a proof-of-concept implementation and evaluation, multiple subchains based on Hyperledger Fabric and a self-developed DAG-based mainchain are deployed. Extensive experiments demonstrate that ChainFL significantly surpasses conventional FL systems, showing up to a 14% improvement in training efficiency and a threefold increase in robustness.

cs.CR↗