arXiv Science⌕ Search

arXiv subjects

Zipeng Chen

Publications and source records attributed to Zipeng Chen.

7 recordsLinked to original sources

More Than a Score: Reinforcement Learning with Verbalized Feedback for Generative Recommendation

Large language models (LLMs) are increasingly used for generative recommendation, where recommended items are generated directly from users' interaction histories. To further improve recommendation quality, reinforcement learning (RL) has been applied to align these models with recommendation objectives. However, existing RL methods rely on scalar rewards to implicitly guide exploration. These rewards do not specify which aspects of a candidate conflict with the user's preferences or how the next candidate should differ. To address this gap, we propose VerRec, a verbalized feedback-guided RL framework for generative recommendation. Specifically, a user simulator generates personalized verbalized feedback based on the user's historical preferences and the candidate item profile. The policy uses this feedback to produce refined recommendations. Original and refined candidates form an expanded group and are jointly optimized with group relative policy optimization. The user simulator is only required during training and is removed at inference time. Experiments on three Amazon review datasets with two generative recommendation backbones demonstrate that VerRec improves recommendation accuracy and ranking quality. Further analyses show that verbalized guidance encourages exploration of more diverse candidates and helps the policy discover more rewarding recommendations during training.

cs.IR↗

Diverse-Teacher On-Policy Distillation for Generative Recommendation

Generative recommendation generates the semantic ID (SID) of the next item from a user's interaction history. Existing training objectives mainly supervise target SID tokens, while on-policy distillation (OPD) provides denser supervision through a teacher's probability distribution over all tokens for more effective and efficient training. However, OPD can aggravate popularity bias: teacher feedback favors popular-item tokens, transferring this preference to the student, while student rollout favors popular items, leaving unpopular-item SID paths rarely generated and supervised. These two sources of bias reinforce each other and reduce recommendation diversity. We propose HERO, a diversity-aware OPD framework. Heterogeneous teacher distillation trains two teachers specializing in popular and unpopular items and routes each training sample to the teacher matching the popularity group of its ground-truth item. The student learns from the routed teacher's probability distribution along its own generated SIDs. Diversity-aware item rollout incorporates ground-truth SIDs of unpopular items into training, covering SID paths that the student rarely generates. Only the student is used for inference. Offline experiments on an industrial dataset and three public datasets further demonstrate its effectiveness, diversity, and robustness. Moreover, we deploy HERO in the "Guess What You Like" module on the 1688 homepage, where a 15-day online A/B test shows a 3.412% increase in gross merchandise value (GMV).

cs.IR↗

Beyond Action Imitation: Learning a Decision-Aware User Simulator for Online Advertising

Recent advances in LLM-based user simulation have shown promise for offline evaluation of recommendation and advertising systems. However, existing simulators typically infer user preferences from single-domain interaction histories and are primarily optimized to reproduce observable actions such as clicks. Consequently, they capture only a partial view of user preferences, while action-only prediction easily induces model shortcuts and limits both the fidelity and diagnostic value of simulation. To address these challenges, we propose DASH, a decision-aware user simulator that jointly generates thinking traces and predicts behavioral actions from heterogeneous cross-domain histories. DASH first introduces a Context Engineering stage that folds heterogeneous cross-domain histories into decision-relevant context, together with prompt optimization for effective reasoning over the folded context. To train a user simulator, DASH distills thinking trajectories from strong LLMs as SFT data, and further tailors a rubric-based reward model that evaluates thinking traces along form, content, and logic for RL training. Combined with the action reward, these signals jointly improve action prediction and thinking quality. Extensive experiments on real-world Tencent advertising data spanning five heterogeneous content domains demonstrate the effectiveness, efficiency, fidelity, and diagnostic value of DASH.

cs.IR↗

Non-uniqueness for the hyperdissipative Navier-Stokes equations with arbitrarily small subcritical data

In this paper, we consider the hyperdissipative Navier-Stokes equations with fractional dissipation $(-Δ)^β$ with $β>1$. We prove that smooth solutions of the hyperdissipative Navier-Stokes equations are non-unique with arbitrarily small initial data in ${B}^{-β-α}_{\infty,1}(\mathbb{T}^d)$ for any $α>0$. Moreover, we show the existence of a solution with arbitrarily small initial data in ${B}^{-β-α}_{\infty,1}(\mathbb{T}^d)$ ($α>0$) that grows arbitrarily large in $\dot{B}^{-s}_{\infty,\infty}(\mathbb{T}^d)$ for all $s\in\mathbb{R}$ in arbitrarily small time. It is worth pointing out that ${B}^{-β-α}_{\infty,1}(\mathbb{T}^d)$ lies in the subcritical regime when $0<α<β-1$. To the best of our knowledge, this is the first non-uniqueness result of the Navier-Stokes equations with initial data at the subcritical regularity. To show the sharpness of the above results, we establish the local well-posedness of the hyperdissipative Navier-Stokes equations with initial data in $\dot{B}^{-β-α}_{\infty,\infty}(\mathbb{T}^d)$ with $α< 0$.

math.AP↗

Non-uniqueness of smooth solutions of the 5D magnetohydrodynamic equations from critical data

Recently, Coiculescu and Palasek \cite{Coiculescu2025} shows the non-uniqueness of solutions for the 3D incompressible Navier-Stokes equations with initial data in $BMO^{-1}$. Inspired by their breakthrough work, we develop their schemes for the incompressible magnetohydrodynamic equations and obtain a similar result in 5 dimensional case. More precisely, we construct two distinct global solutions with a initial data, which has nonvanishing velocity and magnetic fields in $BMO^{-1}(\mathbb{T}^5)$.

math.AP↗

Sharp non-uniqueness for the Boussinesq equation with fractional dissipation

This paper focuses on the $d$-dimensional ($d\geq2$) Boussinesq equation with fractional dissipation $(-Δ)^α$ on the torus. We show that the uniqueness property breaks down within the function space $L^p_tL^\infty_x$ for any $p<\frac{2α}{2α-1}$ when $1\leqα<\frac{d+1}{2}$ and the function space $L^\frac{2α}{2α-1}_tL^q_x$ for any $q<\infty$ when $1<α<\frac{d+1}{2}$. Moreover, the weak solutions we construct are smooth outside a set of singular times with Hausdorff dimension arbitrarily small. This result is sharp, as weak-strong uniqueness holds in the space $L^{\frac{2α}{2α-1}}_TL^\infty_x$.

math.AP↗

Hölder continuous weak solutions of the 3D Boussinesq equation with thermal diffusion

In this paper, we show the existence of Hölder continuous periodic weak solutions of the 3D Boussinesq equation with thermal diffusion, which apprroximate the Onsager's critical spatial regularity and satisfy the prescribed kinetic energy. More precisely, for any smooth $e(t):[0,T]\rightarrow \mathbb{R}_+$ and $β\in (0, \frac{1}{3})$, there exist $v\in C^β([0,T]\times {\mathbb{T} }^3)$ and $ θ\in C_t^{1,\fracβ{2}}C_x^{2,β}([0,T]\times {\mathbb{T} }^3)$ which solve (\ref{e:boussinesq equation}) in the sense of distribution and satisfy \begin{align} e(t)=\int_{{{\mathbb{T} }^3}}|v(t,x)|^2dx, \quad \forall t\in [0,T].\nonumber \end{align}

math.AP↗