arXiv ScienceSearch

arXiv subjects

Mingyu Zhao

Publications and source records attributed to Mingyu Zhao.

At least 19 recordsLinked to original sources

UniStream: Multi-Expert Residual Vector Quantization for 48 kHz Causal Streaming Audio Coding

We present UniStream, a fully causal 48 kHz neural audio codec for streaming speech, music, and environmental sounds. At its core is Multi-Expert Residual Vector Quantization (ME-RVQ), which replaces the single shared codebook in each residual quantization layer with four expert codebooks controlled by a deterministic Top-K router. Because routing decisions are derived solely from previously decoded quantized states, the decoder can reproduce the selected experts without transmitting expert identifiers, thereby expanding quantization capacity while adding 5.5M parameters. We further introduce an auxiliary Optimal Transport Conditional Flow Matching (OT-CFM) objective to regularize the quantized latent space during training. The flow module is removed entirely at inference and therefore incurs no runtime overhead. UniStream supports a 12 kbps Top-1 mode and a 22.5 kbps Top-2 mode within a causal 48 kHz encoder-decoder framework, while achieving real-time GPU inference. To complement narrow-band speech metrics, we report 48 kHz ViSQOL audio mode, ViSQOL speech mode, standard VGGish-FAD, DNSMOS P.835, and higher-rate reference comparisons with Opus and EnCodec. At 12 kbps, UniStream-Top1 achieves PESQ and UTMOS scores comparable to EnCodec while reducing speech Mel-D from 13.07 to 8.21. At 22.5 kbps, UniStream-Top2 achieves a ViSQOL speech-mode score of 4.67 and an environmental audio-mode score of 3.96, exceeding all evaluated systems operating at 12 kbps or below in the latter setting. It also comes within 0.03 MOS-LQO of Opus at 24 kbps on speech in ViSQOL audio mode. Ablation studies confirm that ME-RVQ is the primary source of quality improvement, whereas OT-CFM provides perceptual gains on speech with a mild trade-off in spectral distortion.

eess.AS

BAMU: Bitstream-Aware Marginal-Utility Allocation for Frozen Pretrained Neural Speech Codecs

Pretrained neural speech codecs typically use a fixed residual vector quantization (RVQ) depth for all frames, ignoring temporal variation in quantization difficulty. We propose BAMU, a bitstream-aware dynamic RVQ allocation framework for frozen pretrained codecs. A lightweight, rate-independent predictor estimates frame- and layer-wise marginal latent-distortion reductions, while a constrained allocator selects prefix-valid depths under an exact serialized-size budget. Experiments on EnCodec and DAC over LibriSpeech, together with VCTK evaluation, show consistent EnCodec gains and DAC improvements mainly at medium and high rates. A 30-listener study confirms a MOS improvement from 3.449 to 3.780 over matched fixed-depth coding.

eess.AS

PIT-SUN: A Deployable Empirical Marginal Transform Framework with Expectation-Consistent Recovery for Regression in Recommender Systems

Estimating original-space conditional expectations is central to value-driven recommender systems, including dwell time, GMV, and LTV forecasting. Standard MSE is expectation-consistent in principle, but its gradients become unstable on heavy-tailed, zero-inflated, and multimodal targets, causing mean collapse and tail shrinkage. Target transformation alleviates this scale conflict, yet any useful nonlinear marginal transform loses expectation consistency under direct inversion. This is not an implementation oversight: a direct inverse-transform estimator is universally expectation-consistent only when the inverse transform is affine, which cannot simultaneously provide bounded tail compression. Existing conditionally linear recovery methods restore expectation consistency, but still leave open which coordinate, inverse lookup, recovery base, and deployment monitor should be selected for sparse complex marginals. We propose \textbf{P}robability-\textbf{I}ntegral-\textbf{TranS}formed \textbf{Un}biased recovery (\textbf{PIT-SUN}), a deployable empirical marginal recovery framework. PIT-SUN uses one empirical marginal table to define a bounded normal-score coordinate, its inverse-quantile lookup, a variance-controlled recovery base, and drift monitoring, then applies multiplicative SUN recovery to estimate the original-space expectation instead of directly inverting transformed predictions. Experiments on synthetic distributions, public benchmarks, large-scale industrial datasets, and online deployment show robust improvements in point accuracy, calibration, and ranking quality with lightweight deployment overhead.

cs.LG

Research on the Flat Field Measurement Method of Coronagraph

The solar corona has an extremely low density, and its brightness is only about one millionth of that of the photosphere. High-dynamic-range imaging of its faint structure is therefore essential for studying coronal heating, coronal mass ejections, and space weather. Quantitative coronagraph imaging requires flat-field measurement and calibration, which underpin intensity calibration, small-scale feature detection, and long-term cyclic analysis. This paper analyzes the coronagraph imaging chain and the origins of flat-field errors, including optical aberrations, stray light, and pixel-response non-uniformity, and summarizes the resulting calibration requirements of next-generation coronagraphs. On this basis, ground-based and space-based flat-fielding methods are systematically reviewed: the ground-based methods include integrating-sphere uniform light sources, opal glass/diffuser plates, clear-sky and thin-cloud backgrounds, and solar-disk scanning, while the space-based methods include internal light sources and diffuser plates, attitude-roll and off-corona offset observations, and multi-phase statistical self-consistent flat-fielding. Their accuracy, resource cost, and applicability are compared. The review shows that no single method is simultaneously high-precision, easy to update, and engineer-friendly; a hierarchical, multi-method calibration framework is therefore recommended. Finally, a new method is proposed in which lithographically generated structured light fields, combined with Fourier-optics and machine-learning inversion, are used to estimate the pixel-response function. Preliminary experiments show that this method achieves a lower residual error than the integrating-sphere and opal-glass methods, providing a high-precision reference for future wide-band, high-resolution coronagraph calibration.

astro-ph.SR

Observational Technological Innovations and Future Development of the Lijiang Coronagraph

As a core ground-based coronal observation facility in China's low-latitude high-altitude regions, the Lijiang Coronagraph leverages the natural advantages of Lijiang Astronomical Observation Station, including its 3200 m altitude and low atmospheric turbulence. It has undergone a full development process, from introduction via Chinese-Japanese cooperation to independent innovation and iteration. This paper systematically summarizes its core technological innovations: upgrade of the automatic operating system, integration of the dual-band observation system, stray light suppression based on image differencing before and after cleaning, and high-precision image calibration and registration. These advances have significantly improved observation efficiency and data quality, laying a solid foundation for high-quality observations. Scientifically, the data reveal that 1.1 solar radii is a highly correlated region between coronal green line brightness and magnetic field intensity. The study also confirms a strong correlation between the coronal green line and the SDO/AIA 21.1 nm extreme ultraviolet band (correlation coefficient: 0.89-0.99), supporting early warning research on Coronal Mass Ejections (CMEs). These results provide key data for verifying coronal heating mechanisms and exploring the origin of the slow solar wind. The experience from the Lijiang Coronagraph not only lays a foundation for China's next-generation large-aperture coronagraphs, but also accelerates progress in low coronal observation capabilities, enabling the country to build internationally competitive capabilities in this field. The system is also an important part of the global coronal observation network.

astro-ph.SR

SimGym: A Framework for A/B Test Simulation in E-Commerce with Traffic-Grounded VLM Agents

A/B testing remains the gold standard for evaluating modifications to e-commerce storefronts, yet it diverts traffic, requires weeks to reach statistical significance, and risks degrading user experience. We present SimGym, a framework for simulating A/B tests on e-commerce storefronts using vision-language model (VLM) agents operating in a live browser. The framework comprises three key components: (a) a traffic-grounded persona generation pipeline that derives per-shop buyer archetypes and intents from production clickstream data; (b) a live-browser agent architecture that combines multimodal perception over visual and browser-structured observations with episodic memory and guardrails to conduct coherent shopping sessions across control and treatment storefronts; and (c) an evaluation protocol that compares simulated outcome shifts with observed shifts in real buyer behavior. We validate SimGym on A/B tests of visually driven UI theme changes from a major e-commerce platform across diverse storefronts and product categories. Empirical results show that SimGym agents achieve strong agreement with observed outcome shifts, attaining 77% directional alignment with add-to-cart shifts observed across interface variants in real-buyer traffic. It reduces experimental cycles from weeks to under an hour, enabling rapid experimentation without exposing real buyers to candidate variants.

cs.AI

ShopGym: An Integrated Framework for Realistic Simulation and Scalable Benchmarking of E-Commerce Web Agents

Developing and evaluating e-commerce web agents requires environments that preserve meaningful task structure while enabling controllable, reproducible, and scalable scientific comparison. Existing methodologies force a tradeoff: live storefronts provide realism but are non-stationary, difficult to inspect, and irreproducible, while hand-built sandbox benchmarks provide control but cover only a narrow range of layouts, catalogs, policies, and interaction patterns. We argue that the core bottleneck is methodological: the field lacks a scalable way to construct evaluation settings that are simultaneously realistic, diverse, controllable, inspectable, and reproducible. We introduce ShopGym, an integrated framework for realistic simulation and scalable benchmarking of e-commerce web agents. ShopGym is a framework for constructing e-commerce simulation environments and grounded benchmark tasks. Its simulation layer, ShopArena, converts live seed storefronts into self-contained sandbox shops through anonymized shop specifications and a staged, validated generation process. On top of these simulated storefronts, ShopGuru synthesizes benchmark tasks across seven skill categories, grounding each task in the shop's catalog, navigation structure, policies, and interaction affordances. Together, ShopArena and ShopGuru produce self-contained, resettable, inspectable, and stable evaluation artifacts that preserve structural properties and agent-evaluation signals relevant to shopping tasks. We validate the framework through graph-based structural analysis and agent-based behavioral evaluation with 224 generated tasks across six sandbox shops: three constructed with synthetic data and three with real data. Our results show that the synthetic shops preserve key structural properties of live storefronts, with agent performance on synthetic shops positively correlated with performance on live storefronts.

cs.AI

Forward Modeling of Dust-Induced Stray Light in Ground-Based Coronagraphs: A Dual-Path Monitoring Approach for High-Precision Inner Corona Observations

High-precision ground-based observations of the inner corona (1.05-2.0 R_sun) are fundamentally constrained by instrumental stray light, particularly the additive background from dynamic dust accumulation on the objective lens. To address this issue, we propose a correction method for the Spectral Imaging Coronagraph (SICG) based on dual-path real-time monitoring and forward physical modeling. By simultaneously imaging the objective lens surface, we obtain deterministic prior information on dust distribution. We construct a physical point-spread function using optical defocus parameters and reconstruct the nonuniform scattering background via convolution. Model parameters are retrieved through data-driven inversion constrained by polar coronal holes. The method demonstrates excellent robustness under varying contamination conditions. After correction, the rms noise in the polar background is reduced by approximately 67% on average, and the signal-to-background ratio improves by a factor of up to 3.7 under heavy contamination conditions. Comparisons with space-based Solar Dynamics Observatory/Atmospheric Imaging Assembly observations indicate that the corrected images recover the morphological structures of streamers with high fidelity. Further radial intensity analysis reveals that the correction process successfully restores the hydrostatic exponential decay characteristic of inner coronal radiation. The fitted decay coefficient corresponds to a plasma temperature of approximately 2.0 MK, consistent with the characteristic formation temperature of the Fe XIV 530.3 nm line. These results demonstrate that the method effectively eliminates the dominant systematic bias in ground-based observations, providing a reliable data foundation for high-precision coronal thermodynamic and dynamic research with the SICG.

astro-ph.SR

Atmospheric turbulence profiling with the Multistar Turbulence Monitor

Accurate characterization of atmospheric optical turbulence is essential for evaluating astronomical sites and optimizing adaptive optics systems. The Multistar Turbulence Monitor (MTM) infers the vertical distribution of the refractive-index structure constant Cn2(z) from differential image motion measured between multiple stellar pairs in short-exposure frames. We present a comprehensive investigation of the MTM method, combining theoretical analysis, instrument-performance assessment, numerical simulations, and on-sky observations obtained at the Daocheng Astronomical Site. Simulations based on a standard HV turbulence model demonstrate that the inversion pipeline robustly recovers both the integrated seeing and the vertical turbulence profile under realistic centroiding noise and varying pixel scales. The Markov Chain Monte Carlo (MCMC) inversion achieves stable results with thirteen discrete height nodes and provides reliable uncertainties. Three nights of MTM measurements at the Daocheng Astronomical Site show that MTM-derived seeing closely tracks simultaneous Differential Image Motion Monitor (DIMM) results, accurately reproducing both short-term fluctuations and nightly averages. These results confirm that MTM provides a simple, portable, and versatile solution for atmospheric turbulence profiling and routine seeing monitoring.

astro-ph.IM

SPG-Codec: Exploring the Role and Boundaries of Semantic Priors in Ultra-Low-Bitrate Neural Speech Coding

Conventional neural speech codecs suffer from severe intelligibility degradation at ultra-low bitrates, where the bottleneck transitions from acoustic distortion to semantic loss. To address this issue, this paper conducts a systematic investigation into the role and fundamental limits of integrating frozen semantic priors -- specifically HuBERT and Whisper -- into neural speech coding. We introduce and quantitatively validate a novel Semantic Retirement phenomenon: while semantic constraints reduce the Word Error Rate (WER) by up to ~10% relatively at 1.5 kbps, their benefits rapidly diminish beyond 6 kbps, indicating a practical capacity boundary. We further uncover a clear trade-off between different prior types: acoustic-rich priors (HuBERT) better preserve prosodic and timbral details, whereas high-level linguistic priors (Whisper) effectively suppress phonetic hallucinations in noisy environments (reducing hallucination rates by 26 percent) and substantially narrow the generalization gap for unseen speakers. Building on these findings, we propose a bitrate-aware regulation strategy that dynamically adjusts prior strength to optimize the trade-off between semantic consistency and perceptual naturalness. Extensive experimental evaluations confirm that our approach achieves competitive intelligibility and noise robustness compared to existing baselines, offering a principled pathway toward ultra-low-bitrate generative speech coding.

eess.AS

SimGym: Traffic-Grounded Browser Agents for Offline A/B Testing in E-Commerce

A/B testing remains the gold standard for evaluating e-commerce UI changes, yet it diverts traffic, takes weeks to reach significance, and risks harming user experience. We introduce SimGym, a scalable system for rapid offline A/B testing using traffic-grounded synthetic buyers powered by Large Language Model agents operating in a live browser. SimGym extracts per-shop buyer profiles and intents from production interaction data, identifies distinct behavioral archetypes, and simulates cohort-weighted sessions across control and treatment storefronts. We validate SimGym against real human outcomes from real UI changes on a major e-commerce platform under confounder control. Even without alignment post training, SimGym agents achieve state of the art alignment with observed outcome shifts and reduces experiment cycles from weeks to under an hour , enabling rapid experimentation without exposure to real buyers.

cs.AI

CC-OR-Net: A Unified Framework for LTV Prediction through Structural Decoupling

Customer Lifetime Value (LTV) prediction, a central problem in modern marketing, is characterized by a unique zero-inflated and long-tail data distribution. This distribution presents two fundamental challenges: (1) the vast majority of low-to-medium value users numerically overwhelm the small but critically important segment of high-value "whale" users, and (2) significant value heterogeneity exists even within the low-to-medium value user base. Common approaches either rely on rigid statistical assumptions or attempt to decouple ranking and regression using ordered buckets; however, they often enforce ordinality through loss-based constraints rather than inherent architectural design, failing to balance global accuracy with high-value precision. To address this gap, we propose \textbf{C}onditional \textbf{C}ascaded \textbf{O}rdinal-\textbf{R}esidual Networks \textbf{(CC-OR-Net)}, a novel unified framework that achieves a more robust decoupling through \textbf{structural decomposition}, where ranking is architecturally guaranteed. CC-OR-Net integrates three specialized components: a \textit{structural ordinal decomposition module} for robust ranking, an \textit{intra-bucket residual module} for fine-grained regression, and a \textit{targeted high-value augmentation module} for precision on top-tier users. Evaluated on real-world datasets with over 300M users, CC-OR-Net achieves a superior trade-off across all key business metrics, outperforming state-of-the-art methods in creating a holistic and commercially valuable LTV prediction solution.

cs.LG

The First Scientific Flight and Observations of the 50-mm Balloon-Borne White-Light Coronagraph

A 50-mm balloon-borne white-light coronagraph (BBWLC) to observe whitelight solar corona over the altitude range from 1.08 to 1.50 solar radii has recently been indigenously developed by Yunnan Observatories in collaboration with Shangdong University (in Weihai) and Changchun Institute of Optics, Fine Mechanics and Physics, which will significantly improve the ability of China to detect and measure inner corona. On 2022 October 4, its first scientific flight took place at the Dachaidan area in Qinghai province of China. We describe briefly the BBWLC mission including its optical design, mechanical structure, pointing system, the first flight and results associated with the data processing approach. Preliminary analysis of the data shows that BBWLC imaged the Kcorona with three streamer structures on the west limb of the Sun. To further confirm the coronal signals obtained by BBWLC, comparisonswere made with observations of the Kcoronagraph of the High Altitude Observatory and the Atmospheric ImagingAssembly on board the Solar Dynamics Observatory. We conclude that BBWLC eventually observed the white-light corona in its first scientific flight.

astro-ph.SR

MHB: Multimodal Handshape-aware Boundary Detection for Continuous Sign Language Recognition

This paper employs a multimodal approach for continuous sign recognition by first using ML for detecting the start and end frames of signs in videos of American Sign Language (ASL) sentences, and then by recognizing the segmented signs. For improved robustness we use 3D skeletal features extracted from sign language videos to take into account the convergence of sign properties and their dynamics that tend to cluster at sign boundaries. Another focus of this paper is the incorporation of information from 3D handshape for boundary detection. To detect handshapes normally expected at the beginning and end of signs, we pretrain a handshape classifier for detection of 87 linguistically defined canonical handshape categories using a dataset that we created by integrating and normalizing several existing datasets. A multimodal fusion module is then used to unify the pretrained sign video segmentation framework and handshape classification models. Finally, the estimated boundaries are used for sign recognition, where the recognition model is trained on a large database containing both citation-form isolated signs and signs pre-segmented (based on manual annotations) from continuous signing-as such signs often differ a bit in certain respects. We evaluate our method on the ASLLRP corpus and demonstrate significant improvements over previous work.

cs.CV

M^3-Bench: Multi-Modal, Multi-Hop, Multi-Threaded Tool-Using MLLM Agent Benchmark

We present M^3-Bench, the first benchmark for evaluating multimodal tool use under the Model Context Protocol. The benchmark targets realistic, multi-hop and multi-threaded workflows that require visual grounding and textual reasoning, cross-tool dependencies, and persistence of intermediate resources across steps. We introduce a similarity-driven alignment that serializes each tool call, embeds signatures with a sentence encoder, and performs similarity-bucketed Hungarian matching to obtain auditable one-to-one correspondences. On top of this alignment, we report interpretable metrics that decouple semantic fidelity from workflow consistency. The benchmark spans 28 servers with 231 tools, and provides standardized trajectories curated through an Executor & Judge pipeline with human verification; an auxiliary four large language models (LLMs) judge ensemble reports end-task Task Completion and information grounding. Evaluations of representative state-of-the-art Multimodal LLMs (MLLMs) reveal persistent gaps in multimodal MCP tool use, particularly in argument fidelity and structure consistency, underscoring the need for methods that jointly reason over images, text, and tool graphs. Our Benchmark's anonymous repository is at https://github.com/EtaYang10th/Open-M3-Bench

cs.AI

Large Sign Language Models: Toward 3D American Sign Language Translation

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual communication. Unlike existing sign language recognition methods that rely on 2D video, our approach directly utilizes 3D sign language data to capture rich spatial, gestural, and depth information in 3D scenes. This enables more accurate and resilient translation, enhancing digital communication accessibility for the hearing-impaired community. Beyond the task of ASL translation, our work explores the integration of complex, embodied multimodal languages into the processing capabilities of LLMs, moving beyond purely text-based inputs to broaden their understanding of human communication. We investigate both direct translation from 3D gesture features to text and an instruction-guided setting where translations can be modulated by external prompts, offering greater flexibility. This work provides a foundational step toward inclusive, multimodal intelligent systems capable of understanding diverse forms of language.

cs.CV

A Robust EDM Optimization Approach for 3D Single-Source Localization with Angle and Range Measurements

Accurate source localization in Multi-Platform Radar Networks (MPRNs) benefits from exploiting both range and angle measurements under robust estimation. In this paper, we propose a robust Euclidean distance matrix (EDM) optimization model that simultaneously integrates range measurements, angle information, and the least absolute deviation ($\ell_1$-norm) criterion for the case of 3D single-source localization (3DSSL). A key theoretical contribution of this work is the rigorous reformulation of {existing} 3D angle measurements into simple box constraints on the Euclidean distances. Unlike previous approximations, we achieve this by reducing each of the 3D angle measurements to a two-dimensional nonlinear optimization problem, whose global minimum and maximum solutions can be characterized and utilized to get the lower and upper bounds of the distances from the unknown source to the sensors. To solve the resulting rank-constrained EDM problem, we develop an efficient algorithm based on the majorization penalty method. Extensive numerical experiments confirm that the new EDM model significantly outperforms leading solvers in terms of localization accuracy and computational efficiency, particularly in low Signal-to-Noise Ratio (SNR) scenarios.

eess.SP

CAPAA: Classifier-Agnostic Projector-Based Adversarial Attack

Projector-based adversarial attack aims to project carefully designed light patterns (i.e., adversarial projections) onto scenes to deceive deep image classifiers. It has potential applications in privacy protection and the development of more robust classifiers. However, existing approaches primarily focus on individual classifiers and fixed camera poses, often neglecting the complexities of multi-classifier systems and scenarios with varying camera poses. This limitation reduces their effectiveness when introducing new classifiers or camera poses. In this paper, we introduce Classifier-Agnostic Projector-Based Adversarial Attack (CAPAA) to address these issues. First, we develop a novel classifier-agnostic adversarial loss and optimization framework that aggregates adversarial and stealthiness loss gradients from multiple classifiers. Then, we propose an attention-based gradient weighting mechanism that concentrates perturbations on regions of high classification activation, thereby improving the robustness of adversarial projections when applied to scenes with varying camera poses. Our extensive experimental evaluations demonstrate that CAPAA achieves both a higher attack success rate and greater stealthiness compared to existing baselines. Codes are available at: https://github.com/ZhanLiQxQ/CAPAA.

cs.CV