arXiv Science⌕ Search

arXiv subjects

Xiang Yu

Publications and source records attributed to Xiang Yu.

At least 19 recordsLinked to original sources

Optimal Annuitization, Consumption, and Investment with Costly Capital Injections

We study a joint optimal decision of portfolio, consumption, and annuitization for a pension-plan manager who balances retirement consumption benefits against the cost of maintaining the solvency of pension account. The pension sponsor provides costly capital injection to prevent negative wealth. Annuity purchases are irreversible, and injected funds remain in the liquid account and earn interest. Using the Legendre transform, we derive a semi-explicit solution to the associated free-boundary problem and verify the optimality of the resulting strategies. We identify an endogenous annuity-income threshold separating injection-active and injection-inactive regions and characterize six policy regimes arising from the interplay between capital injections and consumption constraints. Compared with the no-injection benchmark, capital injections delay annuitization, alter the structure of the annuitization boundary, and permit positive holdings in risky assets even at zero liquid wealth. Numerical results further reveal that cheaper annuities may increase the expected capital contributions required from the pension sponsor.

math.OC↗

Power-Optimal Risk Control via Standardized Margin Calibration

Machine learning can screen far more candidates than can be experimentally validated, creating a need for selection procedures that identify promising candidates while controlling risk before costly experimental validation. We propose Uncertainty-Normalized Empirical Calibration (UNEC), a p-value-free framework that ranks candidates by uncertainty-normalized predictive margins and directly calibrates a selection cutoff using held-out losses. UNEC supports flexible prediction models, general bounded losses, and diverse selection targets. We study marginal discovery risk (MDR) and selective discovery risk (SDR), with SDR reducing to the false discovery rate under binary loss. We establish finite-sample MDR control for an adjusted rule and asymptotic SDR control with explicit limiting risk and power. Under a location--scale model with a common one-sided binary target, we further show that UNEC asymptotically attains the oracle power benchmark among observation-wise selection rules. Simulations and molecular screening applications in solubility, toxicity, and lipophilicity demonstrate favorable risk--power trade-offs and substantial computational gains across binary and graded-loss settings.

stat.ME↗

Optimal portfolio and consumption under no-shorting constraints: The exploratory formulation and reinforcement learning

We develop a reinforcement-learning framework for the continuous-time optimal portfolio-consumption via utility maximization under no-shorting portfolio constraints. We adopt the exploratory formulation under entropy regularization and impose no-shorting constraint through a componentwise nonnegative conditional-mean constraint on the class of admissible randomized policies, while the sampled actions are allowed to be negative during the training. For CRRA utility, we derive the homothetic value function and the optimal Gaussian portfolio and Gibbs consumption policies under some model conditions and establish a verification theorem. These results allow compatible parameterizations in actor, critic, and $q$ functions for a constrained policy-iteration algorithm. Policy evaluation uses trajectory-based moment conditions, and policy improvement uses fitted coefficients to solve a convex quadratic program over the nonnegative orthant without requiring market coefficients as inputs. The mean constraint preserves tractable Gaussian exploration throughout parameter learning, while modal deployment converts the learned randomized policies into deterministic controls. In particular, the Gaussian mode coincides with its constrained mean and hence satisfies no-shorting constraint, and the Gibbs mode determines the deployed consumption rule.

q-fin.PM↗

CAPTURER: A Dexterous Aerial Manipulator for Dynamic and Precise Grasping across Diverse Environments

As a representative form of embodied robotic interaction, aerial grasping requires close coordination between the aerial platform and manipulator. Most existing systems perform aerial grasping with static or slowly moving targets under fixed scenarios. Dynamic and precise grasping across different conditions introduces additional challenges, including target motion, localization drift, dynamic coupling, and external disturbances. In this work, we present CAPTURER, a dexterous aerial manipulator for centimeter-level grasping across diverse environments. To achieve the challenging goal, we first develop an onboard perception system for state estimation and target detection. Drift correction and global pose transformation are introduced to improve target localization during flight. A cooperative motion planner is proposed to coordinate the mobility of the aerial platform with the dexterity of the manipulator according to the relative target state. To maintain grasping accuracy under disturbances, we design a disturbance-rejection controller to compensate for dynamic coupling, model uncertainty, and external disturbances. The capability of CAPTURER is validated through indoor and outdoor experiments with both static and moving targets. The results demonstrate that CAPTURER achieves centimeter-level grasping accuracy for a marker pen measuring only 1.5 cm in diameter at flight speeds exceeding 1.5 m/s.

cs.RO↗

Towards Root Memory: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs

Memory systems are essential for personalized Large Language Models (LLMs). However, retrieval within these systems primarily relies on semantic similarity, potentially missing logically critical memories with limited semantic overlap. We refer to this failure as semantic deflection, which remains insufficiently evaluated by existing benchmarks. To address this gap, we construct IMLogic, a benchmark for implicit logical memory retrieval in long dialogues. Each question is designed around the divergence between semantic and logical relevance, with diagnostic response options that probe semantic deflection, hallucination, and lack of personalization. To help systems utilize associations that are difficult to discover through semantic matching, we introduce root memory, a structured representation that distills reusable, response-guiding logic from user histories through LLM reasoning and grounds it in supporting evidence. We further develop RootMem, a plug-and-play framework that constructs and routes root memories to complement semantic retrieval. Extensive experiments reveal persistent challenges across retrieval methods and memory systems, including substantial preference-driven errors even under full-memory access. RootMem consistently improves performance, demonstrating the potential of structured personalized logic while leaving considerable challenges unresolved. Our benchmark and code are available at https://github.com/ThisIsCosine/IMLogic.

cs.CL↗

Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing

External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state. Existing frameworks typically place a general-purpose large language model behind framework-specific prompts. This raises serving cost, and a writer specialized for one protocol does not transfer directly to another; a unified model that can operate across established memory frameworks remains largely unexplored. We present Hy-Memory-30B-A3B, a compact long-term-memory writer trained across Mem0, MemOS, and Hy-Memory. Memory On-Policy Distillation teaches framework-specific write protocols on student-generated states; Memory RL then optimizes downstream answerability using dense per-chunk probes, attributed cross-chunk rewards, over-storage controls, and chunk-level GRPO. Carrying policy-written banks across windows keeps training aligned with deployment. On fixed 20% benchmark subsamples, Hy-Memory-30B-A3B ranks first on all four evaluated harnesses, including held-out EverMemOS, with a 55.49% macro average versus 54.62% for Claude Opus 5.

cs.CL↗

Local $W^{2,1}_{p}$ convergence of penalization for time-inconsistent stopping problems

This paper studies the penalization method for a general class of time-inconsistent stopping problems. Inspired by some existing results on penalization for optimal stopping problems, we introduce the penalized PDE problem and the penalized control problem for time-inconsistent stopping problems, uncovering some interesting discrepancy stemming from the time-inconsistency. As the penalization tends to infinity, we develop some novel arguments to rigorously establish the local $W^{2,1}_{p}$ convergence results for the solution of the penalized PDE problem to a solution of the variational inequality associated to the time-inconsistent stopping problem. Under an additional concavity assumption, we further derive the convergence of the penalized time-inconsistent control problem to the time-inconsistent stopping problem. We revisit two examples of time-inconsistent stopping to numerically illustrate the convergence theory.

math.OC↗

Aerial GRIPPER: A Gradient-based Real-time Inverse-game Predictor and Planner

Accurate capture of non-cooperative targets is critical. In an attempt to tackle this intractable challenge, an aerial gripper system integrated with a Gradient-based Real-time Inverse-game Predictor and PlannER (GRIPPER) framework is proposed. The interaction is formulated as a general-sum pursuit-evasion game under incomplete information. Specifically, underlying cost parameters of the target are inferred online, and the open-loop Nash equilibrium (OLNE) strategy is iteratively refined within a receding-horizon loop. To ensure high-frequency execution, a computationally friendly gradient-based inverse-game solver is developed. Without explicit computation of the Hessian inverse, the optimized solution is updated (> 50 Hz) based on implicit differentiation and fast Hessian-vector products. Meanwhile, an anti-disturbance controller is developed to overcome disturbances of uncertain payload and gripper actuation, enabling precise tracking of the planned trajectory and accurate grasping of the target. Simulations and real-world experiments illustrate the superior computational efficiency and task performance of GRIPPER. The task of capturing and delivering a non-cooperative target is accomplished, highlighting the robustness, adaptability, and real-time performance of the framework in highly adversarial scenarios.

cs.RO↗

Elastic localization in finite structures: assessment of the infinite-domain approximation and validity of weakly nonlinear analysis

A common approach to studying elastic localization is to pose the problem on an infinite domain, avoiding explicit treatment of the end conditions. For a finite structure, this approach raises a natural question: how long must the structure be for the infinite-domain approximation to become accurate, and how large is the resulting error? To address this question, we develop a constructive method that provides an explicit length threshold beyond which the approximation error is small and explicitly bounded. Applied to a prototypical model arising from localized buckling of a twisted rod, the method yields the threshold and error bounds analytically. The threshold is found to vary with loading, showing that whether the infinite-domain approximation is appropriate depends on both structural length and loading state. The load-dependent length threshold also clarifies the validity of weakly nonlinear analysis: the finite-domain expansion is appropriate only over a limited range near bifurcation, beyond which the infinite-domain expansion is more appropriate. The method is then applied to the fully nonlinear problem of localized bulging in cylindrical membrane tubes. Numerical evaluation of the model-dependent estimates yields a length threshold and an upper bound on the approximation error, while direct comparisons of the finite- and infinite-domain solutions support these predictions. Together, these results characterize the applicability of the infinite-domain approximation and weakly nonlinear description to elastic localization in finite structures.

cond-mat.soft↗

Inhomogeneous thinning of dielectric membranes under uniaxial tension and electric fields

Dielectric elastomers exhibit rich electromechanical instabilities arising from the coupling between mechanical deformations and electric fields. A widely used approach for analyzing instabilities in dielectric elastomers is the Hessian stability criterion proposed by Zhao and Suo (2007), which identifies the onset of instability of a homogeneous deformation but does not determine how the deformation develops beyond the instability threshold. To address this problem, we investigate dielectric membranes subjected to uniaxial tension and an electric field. Starting from a three-dimensional nonlinear electroelastic formulation, we derive asymptotically consistent reduced models, including a membrane model and a plate model, using the variational-asymptotic method. A linear bifurcation analysis first shows that the Hessian stability criterion is equivalent to a zero-wavenumber bifurcation condition, thereby establishing a direct connection between energy-based stability analysis and bifurcation theory. A subsequent weakly nonlinear analysis demonstrates that the zero-wavenumber bifurcation gives rise to localized necking, manifested as inhomogeneous thinning of the membrane. The weakly nonlinear predictions are further validated by numerical simulations. Furthermore, for the plane-stress configuration considered here, the membrane model accurately captures both the onset of instability and the associated localization behavior, while bending effects remain small. These results identify the deformation associated with the Hessian instability and provide a framework for understanding electromechanical instabilities in dielectric membranes.

cond-mat.soft↗

CARO: Contact-Agnostic Residual Observation for Zero-Shot Robust Quadruped Locomotion

We propose CARO, a contact-agnostic residual observation framework for policy adaptation. CARO embeds a fixed-base Euler--Lagrange model into the reinforcement learning control loop and constructs a torque-level residual observation without requiring torque sensors, explicit contact estimation, or vision-based measurements of the floating-base position and linear velocity. A disturbance observer extracts a structured signal representing dynamics mismatch, while the policy learns to exploit this feedback for online adaptation. CARO is trained under the same terrain, command, and domain-randomization conditions as the nominal policy, without specialized disturbance curricula or additional adaptation supervision. Nevertheless, it achieves substantially improved zero-shot robustness in simulation and sim-to-real transfer tasks involving out-of-distribution payloads, center-of-mass shifts, terrain geometries, abrupt dynamics changes, and elevated-platform landings.

cs.RO↗

A Reinforcement Learning Framework for Some Singular Stochastic Control Problems

We develop a continuous-time reinforcement learning framework for a class of singular stochastic control problems without entropy regularization. The optimal singular control is characterized as the optimal singular control law, which is a pair of regions of time and the augmented states. The goal of learning is to identify such an optimal region via the trial-and-error procedure. In this context, we generalize the existing policy evaluation theories with regular controls to learn our optimal singular control law and develop a policy improvement theorem via the region iteration. To facilitate the model-free policy iteration procedure, we further introduce the zero-order and first-order q-functions arising from singular control problems and establish the martingale characterization for the pair of q-functions together with the value function. Based on our theoretical findings, some q-learning algorithms are devised accordingly and a numerical example based on simulation experiment is presented.

math.OC↗

Physics Filtering Favors the Generalization of Robot Learning

Living organisms exhibit extraordinary adaptability to unseen environments through their intrinsic physical structures and lifelong feedback-driven learning. Endowing robots with comparable generalization is critical for reliable operation in the real world. While recent approaches attempt to improve generalization by scaling training data, such strategies remain impractical for robotics, where collecting real-world demonstrations at the scale of large language models is prohibitively costly and slow. Contrary to this reliance on massive datasets, we show that robots can generalize effectively under dynamics uncertainties even with limited training data by leveraging a feedback mechanism, namely PhyFilter, that corrects learning outputs with physics-filtered learning residuals. PhyFilter operates as a lightweight, model-agnostic module whose parameters can be automatically optimized through an auto-learning algorithm, eliminating manual tuning and enabling seamless integration with diverse robot policies. We validate PhyFilter across four representative robotic systems, demonstrating that it enables quadruped robots to generalize to unseen terrains, payload variations, and speed ranges; drones to flight under unseen wind disturbances; aerial manipulators to achieve centimeter-level in-air capture despite wind and mass uncertainties; and acceleration differentiators to remain robust with distribution shift. These results show that physics-filtered feedback can serve as a powerful alternative to massive data scaling.

cs.RO↗

Unified continuous-time q-learning for mean-field game and mean-field control problems

This paper studies the continuous-time q-learning in mean-field jump-diffusion models in a setting where the environment simulator does not provide direct access to the population distribution. We propose the integrated q-function in decoupled form (decoupled Iq-function) and establish its martingale characterization, which provides a unified policy evaluation rule for both mean-field game (MFG) and mean-field control (MFC) problems. Moreover, we consider the learning procedure where population distribution is updated based on the representative agent's state values. Depending on the task to solve the MFG or MFC problem, we can employ the decoupled Iq-function differently to characterize the mean-field equilibrium policy or the mean-field optimal policy respectively. Based on these theoretical findings, we devise a unified parametric q-learning algorithm for both MFG and MFC problems by utilizing test policies and the averaged martingale orthogonality condition. In two applications within and beyond LQ framework, we illustrate the effectiveness and efficiency of our unified parametric q-learning algorithm for both MFG and MFC learning tasks.

math.OC↗

Continuous-time reinforcement learning for optimal switching over multiple regimes

This paper studies the continuous-time reinforcement learning (RL) for optimal switching problems across multiple regimes. We consider a type of exploratory formulation under entropy regularization where the agent randomizes both the timing of switches and the selection of regimes through the generator matrix of an associated continuous-time finite-state Markov chain. We establish the well-posedness of the associated system of Hamilton-Jacobi-Bellman (HJB) equations and provide a characterization of the optimal policy. The policy improvement and the convergence of the policy iterations are rigorously established by analyzing the system of equations. We also show that the value function in the exploratory formulation converges to the one in the classical formulation as the temperature parameter vanishes. Finally, a model-free reinforcement learning algorithm is devised and implemented by invoking the policy evaluation based on the martingale characterization. Our numerical examples with financial applications illustrate the effectiveness and efficiency of the proposed RL algorithm.

math.OC↗

Mean-field game of mean-variance portfolio optimization with peer-based risk aversion

This paper investigates a class of mean-field game (MFG) for mean-variance (MV) portfolio optimization, highlighting a new type of relative performance encoded by the peer-based risk aversion. Specifically, the risk aversion is formulated as a piecewise form that depends on whether the individual's wealth is above or below the population average, leading to a time-inconsistent MFG. Our goal is to seek a mean-field equilibrium, characterized by a forward-backward stochastic differential equation (FBSDE) system and a mean-field consistency condition. The new challenge stems from the discontinuous coefficients induced by the piecewise risk aversion. In response, we first introduce a smooth regularization technique to establish the existence of a solution to the discontinuous multidimensional FBSDE; this solution then yields the existence of an intra-personal equilibrium for the representative agent. Finally, we conclude the existence of the mean-field equilibrium in the time-inconsistent MFG by invoking fixed-point arguments and convergence analysis as the smoothing regularization vanishes.

q-fin.MF↗

Reinforcement learning for irreversible reinsurance problems: the randomized singular control approach

This paper studies the continuous-time reinforcement learning for stochastic singular control with the application to an infinite-horizon irreversible reinsurance problem. The singular control is equivalently characterized as a pair of regions of time and the augmented states, called the singular control law. To encourage the exploration in the learning procedure, we propose a randomization method by considering an auxiliary singular control and entropy regularization. The exploratory singular control problem is formulated as a two-stage optimal control problem, in which the time-inconsistency issue arises in the outer problem. Existence of equilibrium singular control law for the time-inconsistent outer problem is rigorously established. Taking advantage of the solution structure, we utilize a proper parameterization and neural networks to devise the actor-critic reinforcement learning algorithm. In the numerical experiment, we show the superior convergence of parameter iterations based on the randomized equilibrium policy and illustrate how the exploration may advance the learning performance.

math.OC↗

A VLM-Enhanced Framework for Comprehensive Traffic Sign Condition Assessment Integrating Daytime Visual Performance and Nighttime Retroreflectivity Evaluation

Traffic signs are crucial components of road safety, serving as visual tools under all lighting conditions. The Manual on Uniform Traffic Control Devices (MUTCD) specifies daytime visual factors such as legibility and color contrast, and nighttime retroreflectivity requirements. Traditional assessment methods rely on manual inspections, which the Federal Highway Administration (FHWA) notes are subjective, labor-intensive and pose safety concerns, while retroreflectometers are expensive and unaffordable for smaller agencies. Most existing studies focus on either daytime factors or nighttime retroreflectivity but rarely integrate both aspects comprehensively. This study develops a novel framework that systematically evaluates traffic signs through integrated daytime-nighttime assessment. The methodology employs three fine-tuned Vision Language Models (VLMs) for daytime visual performance assessment across four key factors: legibility, color, surface and shape integrity, and surrounding environment conditions. VLM predictions are converted to numerical scores through sentiment analysis and Contrastive Language-Image Pre-Training (CLIP) scoring, while nighttime performance is assessed using LiDAR-derived retroreflectivity following established calibration procedures. The framework integrates these components into a comprehensive Sign Condition Index (SCI) for maintenance guidance. Evaluation results demonstrated that LLaVA and Qwen outperformed InternVL, achieving bidirectional cosine similarity scores of 0.67-0.76 across all factors. Among 462 validated traffic signs, 68 were flagged by the proposed framework as requiring immediate replacement due to inadequate retroreflectivity performance. This research provides a cost-effective alternative to traditional manual inspections for comprehensive traffic sign condition assessment.

cs.CV↗