arXiv subjects

Yihui Zhang

Publications and source records attributed to Yihui Zhang.

11 recordsLinked to original sources

arXiv2026

Latency-Aware Orchestration for Multi-Agent LLM Workflows on Heterogeneous GPUs

Concurrent multi-agent workflows expose future dependencies and serving-state requirements while running on heterogeneous GPU pools with time-varying load, model residency, and resource availability. The logical workflow defines the required computation, whereas its physical scheduling units, model-lifecycle actions, resource ordering, and placement must be selected according to the observed pool state. We present a prediction-guided runtime that uses workflow forecasts to construct and optimize a physical execution graph. Predictor estimates device-specific activation latency, peak memory, and model-loading cost, then propagates these predictions through workflow dependencies to forecast activation readiness and future model demand. Constructor builds semantics-preserving fusion and model-lifecycle alternatives, while Scheduler jointly optimizes their selection, placement, and execution order based on the live pool state. Across a workload spanning three workflow scenarios on a heterogeneous GPU pool, our system reduces end-to-end makespan and overall p95 completion latency under burst arrivals by up to 36.8% and 25.9%, respectively, over state-of-the-art workflow schedulers. It also saves up to 24.63 GPU-s per completed session.

cs.DC↗

arXiv2026

SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving

As LLM agents increasingly rely on the Model Context Protocol (MCP) to invoke isolated external sandboxes, disaggregated sandbox deployment introduces a fundamental tension between resource utilization and interactive tail latency. Persistent long-lived sandbox reservations incur excessive memory overhead at scale, while lazy on-demand instantiation generates severe cold-start penalties that degrade response performance under multi-tenant, multi-turn agent workloads. To resolve this dilemma, we present SpecBox, a runtime built around speculative sandbox preallocation tailored for dynamic LLM agent execution pipelines. At its core, SpecBox implements keyword matching and streaming semantic embedding to enable intent-driven sandbox prewarming, which identifies pending tool execution demands mid-LLM token generation and fully overlaps sandbox bootstrapping with model inference. To extend prewarming windows across sequential agent steps, the framework leverages context-aware stochastic prefetching atop a sandbox dependency graph to probabilistically forecast future sandbox switches ahead of execution. We complement these speculative mechanisms with two orthogonal optimizations: a semantic result cache that prunes redundant repeated sandbox invocations, and a dedicated out-of-band shared-memory transport plane that bypasses conventional network serialization to deliver zero-copy artifact transfers. Evaluated on high-concurrency multi-turn agent traces, our prototype demonstrates that SpecBox cuts P99 end-to-end latency by up to $2.9\times$ relative to the on-demand sandbox baseline, while slashing peak memory consumption by $45.9\%$ compared to permanently reserved sandbox deployments.

cs.DC↗

arXiv2026

Maestro: Workload-Aware Cross-Cluster Scheduling for LLM-Based Multi-Agent Systems

Large Language Model based Multi-Agent Systems (LLM-MAS) have emerged as a powerful paradigm for tackling complex tasks by breaking them into collaborative workflows of specialized LLM-powered agents. However, deploying such multi-agent workloads at scale poses significant system challenges. Each user query spawns an iterative pipeline of LLM calls, greatly amplifying resource consumption compared to single-turn queries. In resource-constrained cloud settings, these workflows face non-deterministic and input-dependent costs at decode stage, heavy-tailed multi-model requirements with memory fragmentation and over-provisioning, and cross-cluster scheduling trade-offs. We present Maestro, a workload-aware scheduling system designed for LLM-MAS serving under strict GPU budgets. Maestro explicitly leverages agent semantics and roles: it predicts the output length and memory usage of each stage and uses this prediction to drive a hierarchical scheduler. At the node level, Maestro enables dynamic multi-model co-location via hierarchical weight caching and elastic memory provisioning. At the cluster level, it performs latency-aware routing to avoid cold-start delays and memory overloads. At the global level, it enforces workflow-aware prioritization to minimize head-of-line blocking for interactive tasks. Across prototype experiments and trace-driven simulations, Maestro reduces KV-reservation HBM by 67.2% and improves high-contention SLO attainment over EDF by 23.6 percentage points.

cs.DC↗

arXiv2025

Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing

Large language models (LLMs) exhibit impressive language capabilities but remain vulnerable to malicious prompts and jailbreaking attacks. Existing knowledge editing methods for LLM detoxification face two major challenges. First, they often rely on entity-specific localization, making them ineffective against adversarial inputs without explicit entities. Second, these methods suffer from over-editing, where detoxified models reject legitimate queries, compromising overall performance. In this paper, we propose ToxEdit, a toxicity-aware knowledge editing approach that dynamically detects toxic activation patterns during forward propagation. It then routes computations through adaptive inter-layer pathways to mitigate toxicity effectively. This design ensures precise toxicity mitigation while preserving LLMs' general capabilities. To more accurately assess over-editing, we also enhance the SafeEdit benchmark by incorporating instruction-following evaluation tasks. Experimental results on multiple LLMs demonstrate that our ToxEdit outperforms previous state-of-the-art methods in both detoxification performance and safeguarding general capabilities of LLMs.

cs.CL↗

arXiv2023

A Machine Vision Method for Correction of Eccentric Error: Based on Adaptive Enhancement Algorithm

In the procedure of surface defects detection for large-aperture aspherical optical elements, it is of vital significance to adjust the optical axis of the element to be coaxial with the mechanical spin axis accurately. Therefore, a machine vision method for eccentric error correction is proposed in this paper. Focusing on the severe defocus blur of reference crosshair image caused by the imaging characteristic of the aspherical optical element, which may lead to the failure of correction, an Adaptive Enhancement Algorithm (AEA) is proposed to strengthen the crosshair image. AEA is consisted of existed Guided Filter Dark Channel Dehazing Algorithm (GFA) and proposed lightweight Multi-scale Densely Connected Network (MDC-Net). The enhancement effect of GFA is excellent but time-consuming, and the enhancement effect of MDC-Net is slightly inferior but strongly real-time. As AEA will be executed dozens of times during each correction procedure, its real-time performance is very important. Therefore, by setting the empirical threshold of definition evaluation function SMD2, GFA and MDC-Net are respectively applied to highly and slightly blurred crosshair images so as to ensure the enhancement effect while saving as much time as possible. AEA has certain robustness in time-consuming performance, which takes an average time of 0.2721s and 0.0963s to execute GFA and MDC-Net separately on ten 200pixels 200pixels Region of Interest (ROI) images with different degrees of blur. And the eccentricity error can be reduced to within 10um by our method.

cs.CV↗

arXiv2022

Planar Hall effect induced spin rectification effect and its strong impact on spin pumping measurements

Spin pumping is a technique widely used to generate the pure spin current and characterize the spin-charge conversion in various systems. The reversing sign of the symmetric Lorentzian charge current with respect to opposite magnetic field is generally accepted as the key criterion to identify its pure spin current origin. However, we herein find that the rectified voltage due to the planar Hall effect can exhibit similar spurious signal, complicating and even misleading the analysis. The distribution of microwave magnetic field and induction current has strong influence on the magnetic field symmetry and lineshape of the obtained signal. We further demonstrate a geometry where the spin-charge conversion and the rectified voltage can be readily distinguished with a straightforward symmetry analysis.

cond-mat.mes-hall↗

arXiv2021

A De-raining semantic segmentation network for real-time foreground segmentation

Few researches have been proposed specifically for real-time semantic segmentation in rainy environments. However, the demand in this area is huge and it is challenging for lightweight networks. Therefore, this paper proposes a lightweight network which is specially designed for the foreground segmentation in rainy environments, named De-raining Semantic Segmentation Network (DRSNet). By analyzing the characteristics of raindrops, the MultiScaleSE Block is targetedly designed to encode the input image, it uses multi-scale dilated convolutions to increase the receptive field, and SE attention mechanism to learn the weights of each channels. In order to combine semantic information between different encoder and decoder layers, it is proposed to use Asymmetric Skip, that is, the higher semantic layer of encoder employs bilinear interpolation and the output passes through pointwise convolution, then added element-wise to the lower semantic layer of decoder. According to the control experiments, the performances of MultiScaleSE Block and Asymmetric Skip compared with SEResNet18 and Symmetric Skip respectively are improved to a certain degree on the Foreground Accuracy index. The parameters and the floating point of operations (FLOPs) of DRSNet is only 0.54M and 0.20GFLOPs separately. The state-of-the-art results and real-time performances are achieved on both the UESTC all-day Scenery add rain (UAS-add-rain) and the Baidu People Segmentation add rain (BPS-add-rain) benchmarks with the input sizes of 192*128, 384*256 and 768*512. The speed of DRSNet exceeds all the networks within 1GFLOPs, and Foreground Accuracy index is also the best among the similar magnitude networks on both benchmarks.

cs.CV↗

arXiv2019

Quantifying Inactive Lithium in Lithium Metal Batteries

Inactive lithium (Li) formation is the immediate cause of capacity loss and catastrophic failure of Li metal batteries. However, the chemical component and the atomic level structure of inactive Li have rarely been studied due to the lack of effective diagnosis tools to accurately differentiate and quantify Li+ in solid electrolyte interphase (SEI) components and the electrically isolated unreacted metallic Li0, which together comprise the inactive Li. Here, by introducing a new analytical method, Titration Gas Chromatography (TGC), we can accurately quantify the contribution from metallic Li0 to the total amount of inactive Li. We uncover that the Li0, rather than the electrochemically formed SEI, dominates the inactive Li and capacity loss. Using cryogenic electron microscopies to further study the microstructure and nanostructure of inactive Li, we find that the Li0 is surrounded by insulating SEI, losing the electronic conductive pathway to the bulk electrode. Coupling the measurements of the Li0 global content to observations of its local atomic structure, we reveal the formation mechanism of inactive Li in different types of electrolytes, and identify the true underlying cause of low Coulombic efficiency in Li metal deposition and stripping. We ultimately propose strategies to enable the highly efficient Li deposition and stripping to enable Li metal anode for next generation high energy batteries.

cond-mat.mtrl-sci↗

arXiv2013

High Performance Piezoelectric Devices Based on Aligned Arrays of Nanofibers of Poly[(vinylidenefluoride-co-trifluoroethylene]

Multifunctional capability, flexible design, rugged lightweight construction, and self-powered operation are desired attributes for electronics that directly interface with the human body or with advanced robotic systems. For these and related applications, piezoelectric materials, in forms that offer the ability to bend and stretch, are attractive for pressure/force sensors and mechanical energy harvesters. In this paper we introduce a large area, flexible piezoelectric material that consists of sheets of electrospun fibers of the polymer poly[(vinylidenefluoride-co-trifluoroethylene]. The flow and mechanical conditions associated with the spinning process yield free-standing, three-dimensional architectures of aligned arrangements of such fibers, in which the polymer chains adopt strongly preferential orientations. The resulting material offers exceptional piezoelectric characteristics, to enable, as an example, ultra-high sensitivity for measuring pressure, even at exceptionally small values (0.1 Pa). Quantitative analysis provides detailed insights into the pressure sensing mechanisms, and engineering design rules. Applications range from self-powered micro-mechanical elements, to self-balancing robots and sensitive impact detectors.

cond-mat.mtrl-sci↗

arXiv2012

External uniform electric field removing flexoelectric effect in epitaxial ferroelectric thin films

Using the modified Landau-Ginsburg-Devonshire thermodynamic theory, it is found that the coupling between stress gradient and polarization, or flexoelectricity, has significant effect on ferroelectric properties of epitaxial thin films, such as polarization, free energy profile and hysteresis loop. However, this effect can be completely eliminated by applying an optimized external, uniform electric field. The role of such uniform electric field is shown to be the same as that of an ideal gradient electric field which can suppress the flexoelectricty effect completely based on the present theory. Since the uniform electric field is more convenient to apply and control than gradient electric field, it can be potentially used to remove the flexoelectric effect induced by stress gradient in epitaxial thin films and enhance the ferroelectric properties.

cond-mat.mtrl-sci↗

arXiv2012

Flexoelectricity induced increase of critical thickness in epitaxial ferroelectric thin films

Flexoelectricity describes the coupling between polarization and strain/stress gradients in insulating crystals. In this paper, using the Landau-Ginsburg-Devonshire phenomenological approach, we found that flexoelectricity could increase the theoretical critical thickness in epitaxial BaTiO3 thin films, below which the switchable spontaneous polarization vanishes. This increase is remarkable in tensile films while trivial in compressive films due to the electrostriction caused decrease of potential barrier, which can be easily destroyed by the flexoelectricity, between the ferroelectric state and the paraelectric state in tensile films. In addition, the films are still in a uni-polar state even below the critical thickness due to the flexoelectric effect.

cond-mat.mtrl-sci↗