arXiv Science⌕ Search

arXiv subjects

Yuhao Wang

Publications and source records attributed to Yuhao Wang.

At least 37 records · Page 2Linked to original sources

Multi-Task Deep Recommender Systems: A Survey

Multi-task learning (MTL) aims at learning related tasks in a unified model to achieve mutual improvement among tasks considering their shared knowledge. It is an important topic in recommendation due to the demand for multi-task prediction considering performance and efficiency. Although MTL has been well studied and developed, there is still a lack of systematic review in the recommendation community. To fill the gap, we provide a comprehensive review of existing multi-task deep recommender systems (MTDRS) in this survey. To be specific, the problem definition of MTDRS is first given, and it is compared with other related areas. Next, the development of MTDRS is depicted and the taxonomy is introduced from the task relation and methodology aspects. Specifically, the task relation is categorized into parallel, cascaded, and auxiliary with main, while the methodology is grouped into parameter sharing, optimization, and training mechanism. The survey concludes by summarizing the application and public datasets of MTDRS and highlighting the challenges and future directions of the field.

cs.IR↗

Learning a Single Token to Replace Long System Prompts in LLMs

Long system prompts are widely used to steer Large Language Models (LLMs), but repeatedly processing them at inference time is inefficient and consumes valuable context budget. This motivates a central question: can the behavioral effect of a long system prompt be retained using only a minimal learned representation? To enable this, we propose a lightweight training framework that learns a single Behavior-Equivalent Token ([BE]). The framework first trains [BE] to encode the semantic content of the original system prompt via reconstruction, and then distills the prompt's downstream behavior into this single token. Importantly, our method requires no update to the pretrained LLM weights, no auxiliary compression models, and no labeled responses. Empirical evaluations on three datasets show that replacing long prompts with a single [BE] token yields up to a $3000\times$ prompt compression ratio, while retaining about 98% of the downstream performance of the original system prompts. This substantially reduces inference cost and frees nearly the entire context window for user inputs and model outputs.

cs.CL↗

GraphMemix: Query-Aware Evidence Forests for Long-Term Multimodal Agent Memory

Organizing long-term memory for multimodal agents remains challenging because existing methods either suffer from expensive question-agnostic offline summaries or naive embedding similarity matching that introduces incomplete and redundant context. To address these issues, we propose GraphMemix, a combinatorial-optimization graph memory framework that models memory organization as query-aware evidence-forest construction. Specifically, our method consists of three key components:(1) candidate graph construction, which expands multi-view seed memories through schema and semantic relations to acquire query-aware original context; (2) evidence utility and activation costs, which decouples direct memory support from anchor-conditioned relation verification to suppress redundant or conflicting information; and (3) forest optimization, which jointly selects a forest-format memory context under a maximum evidence budget and its reliable relational structure. By organizing memory into a query-relevant subgraph, the method avoids substantial lifecycle cost and recovers low-similarity complementary evidence. Experimental results across four long-term multimodal memory benchmarks demonstrate significant improvements with different foundation models and establish a new Pareto frontier between accuracy and lifecycle cost.

cs.AI↗

Minimax estimation of functionals in sparse vector model with correlated observations

We consider the observations of an unknown $s$-sparse vector ${\boldsymbol θ}$ corrupted by Gaussian noise with zero mean and unknown covariance matrix ${\boldsymbol Σ}$. We propose minimax optimal methods of estimating the $\ell_2$ norm of ${\boldsymbol θ}$ and testing the hypothesis $H_0: {\boldsymbol θ}=0$ against sparse alternatives when only partial information about ${\boldsymbol Σ}$ is available, such as an upper bound on its Frobenius norm and the values of its diagonal entries to within an unknown scaling factor. We show that the minimax rates of the estimation and testing are leveraged not by the dimension of the problem but by the value of the Frobenius norm of ${\boldsymbol Σ}$.

math.ST↗

Parallel single-pixel imaging based on modulation region expansion and overlapping reconstruction

Parallel single-pixel imaging (PSPI) enhances the data acquisition efficiency of single-pixel imaging, but its reconstruction quality depends on a cumbersome and noise-sensitive calibration process. To address this challenge, a PSPI strategy was introduced that leverages modulation region expansion and overlapping reconstruction. This method results in the calibration of modulation of the subregion for each detector, enabling robust operations with undersampled data. It compensates for misalignment via modulation region expansion and overlapping reconstruction, achieving seamless and high-quality imaging that surpasses conventional PSPI in simulations and experiments. Furthermore, this strategy exhibits remarkable robustness, maintaining high imaging quality under extremely nonideal conditions, such as large deflection angles between the array detector and the modulator. This work provides a simple, efficient, and robust framework that simplifies the PSPI workflow and offers broad applicability in high-resolution, high-speed computational imaging.

physics.optics↗

MoE-Enhanced Explainable Deep Manifold Transformation for Complex Data Embedding and Visualization

Dimensionality reduction (DR) plays a crucial role in various fields, including data engineering and visualization, by simplifying complex datasets while retaining essential information. However, achieving both high DR accuracy and strong explainability remains a fundamental challenge, especially for users dealing with high-dimensional data. Traditional DR methods often face a trade-off between precision and transparency, where optimizing for performance can lead to reduced explainability, and vice versa. This limitation is especially prominent in real-world applications such as image, tabular, and text data analysis, where both accuracy and explainability are critical. To address these challenges, this work introduces the MoE-based Explainable Deep Manifold Transformation (DMT-ME). The proposed approach combines a geometry-aware hyperbolic mapper with Mixture of Experts (MoE) models, where sparse expert specialization provides the main representational gain and the hyperbolic component offers an additional refinement for structurally complex data. DMT-ME enhances DR accuracy primarily through MoE-based sparse routing and structure-aware matching, while also improving explainability by explicitly linking input data, embedding outcomes, and key features through the MoE structure. Extensive experiments demonstrate that DMT-ME consistently achieves superior performance in both DR accuracy and model explainability, making it a robust solution for complex data analysis. The code is available at https://github.com/zangzelin/code_dmtme.

cs.LG↗

Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation

Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at https://github.com/zw-absin/DSGM upon acceptance.

cs.CV↗

Intrinsic Tangential Hadamard Differentiability of Rough-BSDE Solution Maps

We study first-order sensitivity of a scalar backward stochastic differential equation with a deterministic rough driver. The driver belongs to the nonlinear space of step-two weakly geometric $p$-rough paths, $2<p<3$, so an ordinary Banach-space difference quotient is not available. At a fixed rough path $x$, we use a weakly geometric, finite-$(p,p/2)$-variation tensor realization of the Qian-Tudor tangent structure, represented intrinsically by a first-level direction $h$ and a compatible second-level direction $κ$. Admissible rough-path secants are required to converge in a strong levelwise variation topology. Under bounded smooth rough vector fields, a bounded terminal condition, and a globally Lipschitz generator, we construct a continuous linear map $A_x:T_x^p\to S^\infty\times H^2_{\mathrm{BMO}}$. The proof first establishes a uniform four-jet expansion for reset rough flows along bounded realizations of full rough tangents. A Doss-Sussmann transformation transfers this expansion to quadratic generators. Uniform BMO and reverse-Holder estimates then yield a local difference-quotient theorem, which is propagated over a fixed deterministic partition and reconstructed in the original coordinates. The resulting derivative is independent of the joint lift, central decomposition, and radial realization. Consequently, solution difference quotients converge to $A_x(h,κ)$ for varying directions and arbitrary admissible secants with strong levelwise variation contact. This is intrinsic tangential Hadamard differentiability on that tensor-coordinate tangent class. Locally bounded ray-homogeneous selections give Frechet-differentiable chart pullbacks at the parameter origin. The latter statement is chartwise; it is not Frechet differentiability of the solution map in the homogeneous rough-path metric.

math.PR↗

Multi-Modal Object Re-Identification with Prompt-S6 and Semantic-Aware Knowledge Guidance

Multi-modal object Re-Identification (ReID) aims to retrieve specific objects by integrating complementary information from multiple modalities. However, existing multi-modal ReID methods do not effectively address background interference suppression or achieve tri-modal alignment, instead focusing on pairwise feature fusion. Moreover, many current aggregation approaches suffer from high computational complexity. To address these limitations, we propose PRISM, a novel multi-modal ReID framework built upon Prompt-S6 (PS6) and semantic-aware knowledge guidance. PS6 maintains the linear complexity and strong sequence modeling capability of Mamba while enabling efficient cross-modal interaction. Leveraging these advantages, we design two key components: Semantic-Driven Token Pruning (SDTP) and Progressive Fusion Network (PFN). Parsing semantic priors from the segmentation foundation models, the SDTP then leverages these priors and applies dynamic token pruning to suppress background noise and refine feature representations. The PFN progressively aggregates multi-modal features to achieve tri-modal alignment and fully exploit modality complementarity. With the proposed modules, PRISM generates more robust multi-modal representations under complex scenarios. Extensive experiments on four multi-modal object ReID benchmarks demonstrate the effectiveness and efficiency of our approach. The source code is available at https://github.com/zw-absin/PRISM.

cs.CV↗

TeaRAG: A Token-Efficient Agentic Retrieval-Augmented Generation Framework

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries. Although recent agentic RAG has improved via reinforcement learning, they often incur substantial token overhead from search and reasoning processes. This trade-off prioritizes accuracy over efficiency. To address this issue, this work proposes TeaRAG, a token-efficient agentic RAG framework capable of compressing both retrieval content and reasoning steps. 1) First, the retrieved content is compressed by augmenting chunk-based semantic retrieval with a graph retrieval using concise triplets. A knowledge association graph is then built from semantic similarity and co-occurrence. Finally, Personalized PageRank is leveraged to highlight key knowledge within this graph, reducing the number of tokens per retrieval. 2) Besides, to reduce reasoning steps, Iterative Process-aware Direct Preference Optimization (IP-DPO) is proposed. Specifically, our reward function evaluates the knowledge sufficiency by a knowledge matching mechanism, while penalizing excessive reasoning steps. This design can produce high-quality preference-pair datasets, supporting iterative DPO to improve reasoning conciseness. Across six datasets, TeaRAG improves the average Exact Match by 4% and 2% while reducing output tokens by 61% and 59% on Llama3-8B-Instruct and Qwen2.5-14B-Instruct, respectively. Code is available at https://github.com/Applied-Machine-Learning-Lab/TeaRAG.

cs.IR↗

VISTA-Bench: Do Vision-Language Models Really Understand Visualized Text as Well as Pure Text?

Vision-Language Models (VLMs) have achieved impressive performance in cross-modal understanding across textual and visual inputs, yet existing benchmarks predominantly focus on pure-text queries. In real-world scenarios, language also frequently appears as visualized text embedded in images, raising the question of whether current VLMs handle such input requests comparably. We introduce VISTA-Bench, a systematic benchmark from multimodal perception, reasoning, to unimodal understanding domains. It evaluates visualized text understanding by contrasting pure-text and visualized-text questions under controlled rendering conditions. Extensive evaluation of over 30 representative VLMs reveals a pronounced modality gap: models that perform well on pure-text queries often degrade substantially when equivalent semantic content is presented as visualized text. This gap is further amplified by increased perceptual difficulty, highlighting sensitivity to rendering variations despite unchanged semantics. Overall, VISTA-Bench provides a principled evaluation framework to diagnose this limitation and to guide progress toward more unified language representations across tokenized text and pixels. The source dataset and code are publicly available at https://github.com/QingAnLiu/VISTA-Bench.

cs.CV↗

Wavenumber-explicit stability and preasymptotic error analysis of UPML finite element method for obstacle scattering problems

This paper develops a wavenumber-explicit stability and preasymptotic error analysis for finite element approximation of the two-dimensional Helmholtz scattering problem with a uniaxial perfectly matched layer (UPML) truncation. The analysis is based on direct estimates of the stretched Green kernel associated with the Cartesian complex coordinate transformation. We establish explicit stability for the truncated UPML problem. In particular, we prove that the inf-sup constant of the truncated UPML formulation is $μ_L = O(k^{-1})$ in a natural $k$-weighted $H^1$ norm. As a consequence, we also obtain an exponential decay estimate for the PML truncation error. Based on this stability estimate, we formulate a linear continuous interior penalty finite element method (CIP-FEM) on the truncated UPML domain. A key ingredient of the analysis is to establish a piecewise $H^{1+s}$-regularity result (for any $0<s<1$), which accounts for coefficient jumps across PML interfaces and singularities induced by Cartesian corner geometries. This fractional regularity is sufficient to derive wavenumber-explicit preasymptotic error estimates. Numerical experiments confirm the theoretical predictions and illustrate the effectiveness of the UPML CIP-FEM in the high-frequency regime.

math.NA↗

Empowering Cross-Domain Sequential Recommendation with Hybrid Tokenization and Serial-Parallel Decoding

Cross-domain sequential recommendation (CDSR) aims to model users' dynamic interest transitions and sequential patterns across multiple domains. Recently, generative recommendation (GR) has emerged. It first learns semantic identifiers (SIDs) from item semantics and formulates recommendation as autoregressive generation. However, existing methods face two critical issues: (1) they ignore collaborative correlations across domains during tokenization, and (2) they adopt inefficient decoding strategies, such as beam search, during generation, which hinders real-time deployment. To address these limitations, we propose GenCDSR, an effective and efficient generative framework for CDSR. Specifically, we design a cross-domain hybrid tokenization mechanism with a multi-tower architecture to jointly capture cross-domain commonalities and domain-specific distinctions through hierarchical shared-specific and fine-grained codebooks. Furthermore, we develop a cross-domain serial-parallel decoding strategy that leverages the hierarchical SID structure to partially parallelize generation, significantly reducing inference latency while preserving generation consistency. Experiments on three public datasets show that GenCDSR achieves an average accuracy improvement of 1.5 percent and an average inference latency reduction of 85.1 percent compared with state-of-the-art baselines. The implementation code and datasets are available online: https://github.com/Applied-Machine-Learning-Lab/RecSys2026_GenCDSR.

cs.AI↗

Whole-Body Semantic-to-Actuation Grounding of Elephant-Inspired Soft-Trunk Motion via Lightweight Flow Matching

For close-contact human-robot interaction (HRI), trunk-like continuum manipulators provide a physical channel for diverse whole-body expression, but grounding open-vocabulary responses into such robots is difficult: end-effector motion underspecifies body shape, whereas direct whole-body commands are high-dimensional and hard to keep feasible. We propose a whole-body semantic-to-actuation grounding framework for elephant-inspired soft-trunk HRI based on lightweight flow matching. The framework converts responses from a multimodal large language model into bounded, morphology-aligned intent-intensity tuples, parameterizes tendon-actuation trajectories with compact Catmull-Rom spline controls, and uses a rectified-flow generator to sample feasible whole-body trunk motions. Experiments show that the proposed framework improves held-out grounding correctness from 25.0% to 77.2% over a raw-response dense-regression baseline. Compared with a denoising-diffusion baseline, it improves correctness from 71.9% to 77.2% and reduces inference time from 7.86 ms to 4.87 ms while preserving motion diversity. A 100-participant physical HRI study further shows that adding the generated soft-trunk motion channel increases the positive overall-satisfaction rating from 46% to 82% over the audiovisual-only baseline.

cs.RO↗

ERA: Entropy-Guided Visual Token Pruning with Rectified Attention for Efficient MLLMs

Multimodal Large Language Models (MLLMs) incur prohibitive inference costs due to long visual token sequences. Training-free visual token reduction provides an efficient solution. However, existing methods distort attention distributions, giving rise to a phenomenon we term Attention Logit Collapse. To address this issue, we propose ERA, an Entropy-guided visual token pruning framework with Rectified Attention for efficient MLLMs. Specifically, ERA comprises three crucial components: Dual-view Entropy Pruning (DEP), Bias-aware Token Recycling (BTR), and Logit-preserving Attention Rectification (LAR). First, DEP identifies representative anchor tokens by jointly modeling visual diversity and head-wise saliency. BTR then recycles pruned tokens into their corresponding anchors while estimating a cluster-level logit bias. Building upon this, LAR injects the estimated bias into attention logits, effectively rectifying the collapse induced by token reduction. Together, these components preserve visual evidence even under aggressive compression, enabling robust performance across single-image, multi-image, and video settings on a wide range of MLLMs. Beyond delivering practical acceleration, ERA establishes logit-preserving visual token pruning as a principled framework for efficient MLLMs, unifying theoretical foundation, algorithmic design, and practical deployment. The code is at https://github.com/924973292/ERA.

cs.CV↗

Presence versus absence of charging energies in PbTe quantum dots

Charging energy ($E_C$) is essential in quantum dot (QD) devices. Previous studies on PbTe QDs have reported both the presence and absence of $E_C$. To resolve this ambiguity, we vary the QD size, i.e. the cross-sectional area of PbTe nanowires, and track the evolution of $E_C$. For large crosssectional areas ($\sim$ 16000 nm$^2$), the PbTe QDs exhibit no measurable $E_C$, while quantized levels are well resolved. Decreasing this area successively to 5000, 1500, and 460 nm$^2$, $E_C$ becomes finite and increases to 80, 160, and 210 $μ$eV, respectively. We further demonstrate the strong tunability of local gates, which can tune the PbTe device from the QD regime to the regime of ballistic transport. These results address concerns regarding the large dielectric constant of PbTe and provide key insights in engineering advanced PbTe quantum devices.

cond-mat.mes-hall↗

Flow-polarity decoupling and universal mobility enhancement in dense bacterial active fluids with mesoscale order

Active fluids consisting of living cells or synthetic microswimmers display rich emergent behavior and nonequilibrium mechanical properties, which not only shed light on various biological processes but also inform the engineering of autonomous fluidics and self-driven materials. The individual behavior of microswimmers and their interaction with self-generated mesoscale solvent flows underlie the emergent properties of active fluids. Here we studied the microscopic dynamics in dense 3D bacterial active fluids by simultaneous imaging of cell body, flagella, and flow field. A surprising finding is that the polarity of cells was randomly distributed in mesoscale flow regimes, and yet the system displays mesoscale order in the self-generated solvent flows. Despite the apparent flow-polarity decoupling, the motion of cells relative to local solvent flows predominantly navigated upstream, with the self-advection speed universally enhanced by a flow-controlled constant. Numerical modeling with full hydrodynamic interactions reveals that the observed flow-polarity decoupling arises from the breakdown of the commonly held force-dipole assumption for anisotropic microswimmers: in the presence of flow gradient and near-field hydrodynamic interactions, the direction of total active forcing exerted by a swimming bacterium to the surrounding fluid no longer aligns with its polarity. The simulations suggest that near-field interactions serve as a new type of emergent, configuration-dependent active forcing, which profoundly impact self-organization and transport in dense bacterial suspensions. Taken together, our work establishes fundamental knowledge for faithfully understanding the collective behavior of dense polar active fluids.

physics.bio-ph↗

MotionAtlas: Detailed Region Captioning for Motion-Centric Videos

We propose MotionAtlas, a system for detailed captioning of motion-centric videos, comprising (1) a dedicated human-annotated benchmark, (2) a scalable, high-quality pipeline to construct training samples, and (3) a family of powerful Video-MLLMs. Unlike conventional global motion captioning datasets, we focus on region-aware motion captioning: given a video and a spatiotemporal mask, the model generates precise descriptions of motion within the target region, thereby alleviating visual clutter and motion entanglement and enabling reliable, quantifiable evaluation. Concretely, we first build MotionAtlas-Bench, a comprehensive benchmark comprising 2,073 multiple-choice questions, meticulously annotated for a curated set of high-quality, motion-centric videos, to evaluate fine-grained motion understanding of the objects in question. Second, we design a rigorous and scalable data pipeline that leverages self-bootstrap refinement to suppress fine-grained hallucinations, yielding 159k high-quality motion captioning data. Third, we design a tailored training data composition strategy, which achieves consistent and substantial performance gains across diverse baseline Video-MLLMs, including Molmo2 and Qwen3-VL. For instance, MotionAtlas-4B surpasses Qwen3-VL-4B by an average of 5.2 percentage points across general motion benchmarks. The benchmark, dataset, and code have been released.

cs.CV↗