arXiv subjects

Yuanzhe Ma

Publications and source records attributed to Yuanzhe Ma.

6 recordsLinked to original sources

arXiv2026

Assortment and Procurement Design in Dual-Mode Content Platforms

We study assortment and procurement design for a digital content platform offering both ad-supported and subscription access. Users are heterogeneous in content preferences and ad tolerance and self-select between the two modes or an outside option. For a fixed common subscription price and ad load, the platform chooses assortment distributions specific to each user type and access mode, together with content-family-level buy-versus-rent decisions to maximize profit. Rental costs scale with realized consumption, whereas buying provides a reusable pool of titles whose cost depends on the largest induced requirement across user types and modes. We show that the resulting problem is NP-hard. We then develop a scalable approximation framework based on a candidate buy set, a relaxation of the procurement coupling, and a decomposition into linear programs with a single equality constraint. These subproblems are solved by dual bisection with cardinality-constrained assortment optimization, followed by restricted-master postprocessing to recover primal feasibility. The method yields computable optimality-gap bounds, an interpretable threshold-based procurement heuristic, and asymptotic optimality under proportional market scaling as market size and grid resolution increase. Numerical experiments show strong performance at moderate market scales and grid sizes.

cs.DS↗

arXiv2026

Convergence Rate of the Join-the-Shortest-Queue System

The Join-the-Shortest-Queue (JSQ) policy is among the most widely used load balancing algorithms and has been extensively studied. However, an exact characterization of the system behavior remains challenging. Most prior research has focused on analyzing its performance in the steady state in certain asymptotic regimes, such as the heavy-traffic regime. However, convergence to the steady state in these regimes is often slow, so steady-state and heavy-traffic characterizations may be less informative over practical time horizons. To address this limitation, we provide a finite-time convergence rate analysis of a JSQ system with two symmetric servers. In sharp contrast to the existing literature, we directly study the original system rather than an approximate limiting system such as a diffusion approximation. Our results demonstrate that for such a system, the convergence rate to its steady state, measured in the total variation distance, is $O \left(\frac{1}{(1-ρ)^3} \frac{1}{t} \right)$, where $ρ\in (0,1)$ is the traffic intensity.

math.PR↗

arXiv2026

A Sensitivity Approach to Causal Inference Under Limited Overlap

Limited overlap between treated and control groups is a key challenge in observational analysis. Standard approaches like trimming importance weights can reduce variance but introduce a fundamental bias. We propose a sensitivity framework for contextualizing findings under limited overlap, where we assess how irregular the outcome function has to be in order for the main finding to be invalidated. Our approach is based on worst-case confidence bounds on the bias introduced by standard trimming practices, under explicit assumptions necessary to extrapolate counterfactual estimates from regions of overlap to those without. Empirically, we demonstrate how our sensitivity framework protects against spurious findings by quantifying uncertainty in regions with limited overlap.

stat.ML↗

arXiv2025

A Planning Framework for Adaptive Labeling

Ground truth labels/outcomes are critical for advancing scientific and engineering applications, e.g., evaluating the treatment effect of an intervention or performance of a predictive model. Since randomly sampling inputs for labeling can be prohibitively expensive, we introduce an adaptive labeling framework where measurement effort can be reallocated in batches. We formulate this problem as a Markov decision process where posterior beliefs evolve over time as batches of labels are collected (state transition), and batches (actions) are chosen to minimize uncertainty at the end of data collection. We design a computational framework that is agnostic to different uncertainty quantification approaches including those based on deep learning, and allows a diverse array of policy gradient approaches by relying on continuous policy parameterizations. On real and synthetic datasets, we demonstrate even a one-step lookahead policy can substantially outperform common adaptive labeling heuristics, highlighting the virtue of planning. On the methodological side, we note that standard REINFORCE-style policy gradient estimators can suffer high variance since they rely only on zeroth order information. We propose a direct backpropagation-based approach, Smoothed-Autodiff, based on a carefully smoothed version of the original non-differentiable MDP. Our method enjoys low variance at the price of introducing bias, and we theoretically and empirically show that this trade-off can be favorable.

cs.LG↗

arXiv2024

Minimax Optimal Estimation of Stability Under Distribution Shift

The performance of decision policies and prediction models often deteriorates when applied to environments different from the ones seen during training. To ensure reliable operation, we analyze the stability of a system under distribution shift, which is defined as the smallest change in the underlying environment that causes the system's performance to deteriorate beyond a permissible threshold. In contrast to standard tail risk measures and distributionally robust losses that require the specification of a plausible magnitude of distribution shift, the stability measure is defined in terms of a more intuitive quantity: the level of acceptable performance degradation. We develop a minimax optimal estimator of stability and analyze its convergence rate, which exhibits a fundamental phase shift behavior. Our characterization of the minimax convergence rate shows that evaluating stability against large performance degradation incurs a statistical cost. Empirically, we demonstrate the practical utility of our stability framework by using it to compare system designs on problems where robustness to distribution shift is critical.

stat.ML↗

arXiv2022

Hybrid Random Features

We propose a new class of random feature methods for linearizing softmax and Gaussian kernels called hybrid random features (HRFs) that automatically adapt the quality of kernel estimation to provide most accurate approximation in the defined regions of interest. Special instantiations of HRFs lead to well-known methods such as trigonometric (Rahimi and Recht, 2007) or (recently introduced in the context of linear-attention Transformers) positive random features (Choromanski et al., 2021). By generalizing Bochner's Theorem for softmax/Gaussian kernels and leveraging random features for compositional kernels, the HRF-mechanism provides strong theoretical guarantees - unbiased approximation and strictly smaller worst-case relative errors than its counterparts. We conduct exhaustive empirical evaluation of HRF ranging from pointwise kernel estimation experiments, through tests on data admitting clustering structure to benchmarking implicit-attention Transformers (also for downstream Robotics applications), demonstrating its quality in a wide spectrum of machine learning problems.

cs.LG↗