arXiv subjects

Yi Shen

Publications and source records attributed to Yi Shen.

At least 55 records · Page 3Linked to original sources

arXiv2025

Partial Law Invariance and Risk Measures

We introduce the concept of partial law invariance, generalizing the concepts of law invariance and probabilistic sophistication widely used in decision theory, as well as statistical and financial applications. This new concept is motivated by practical considerations of decision making under uncertainty, thus connecting the literature on decision theory and that on financial risk management. We fully characterize partially law-invariant coherent risk measures via a novel representation formula. Strong partial law invariance is defined to bridge the gap between the above characterization and the classic representation formula of Kusuoka. We propose a few classes of new risk measures, including partially law-invariant versions of the Expected Shortfall and the entropic risk measures, and illustrate their applications in risk assessment under different types of uncertainty. We provide a tractable optimization formula for computing a class of partially law-invariant coherent risk measures and give a numerical example.

q-fin.RM↗

arXiv2025

YOLO-MARL: You Only LLM Once for Multi-Agent Reinforcement Learning

Advancements in deep multi-agent reinforcement learning (MARL) have positioned it as a promising approach for decision-making in cooperative games. However, it still remains challenging for MARL agents to learn cooperative strategies for some game environments. Recently, large language models (LLMs) have demonstrated emergent reasoning capabilities, making them promising candidates for enhancing coordination among the agents. However, due to the model size of LLMs, it can be expensive to frequently infer LLMs for actions that agents can take. In this work, we propose You Only LLM Once for MARL (YOLO-MARL), a novel framework that leverages the high-level task planning capabilities of LLMs to improve the policy learning process of multi-agents in cooperative games. Notably, for each game environment, YOLO-MARL only requires one time interaction with LLMs in the proposed strategy generation, state interpretation and planning function generation modules, before the MARL policy training process. This avoids the ongoing costs and computational time associated with frequent LLMs API calls during training. Moreover, trained decentralized policies based on normal-sized neural networks operate independently of the LLM. We evaluate our method across two different environments and demonstrate that YOLO-MARL outperforms traditional MARL algorithms.

cs.MA↗

arXiv2025

Next-User Retrieval: Enhancing Cold-Start Recommendations via Generative Next-User Modeling

The item cold-start problem is critical for online recommendation systems, as the success of this phase determines whether high-quality new items can transition to popular ones, receive essential feedback to inspire creators, and thus lead to the long-term retention of creators. However, modern recommendation systems still struggle to address item cold-start challenges due to the heavy reliance on item and historical interactions, which are non-trivial for cold-start items lacking sufficient exposure and feedback. Lookalike algorithms provide a promising solution by extending feedback for new items based on lookalike users. Traditional lookalike algorithms face such limitations: (1) failing to effectively model the lookalike users and further improve recommendations with the existing rule- or model-based methods; and (2) struggling to utilize the interaction signals and incorporate diverse features in modern recommendation systems. Inspired by lookalike algorithms, we propose Next-User Retrieval, a novel framework for enhancing cold-start recommendations via generative next-user modeling. Specifically, we employ a transformer-based model to capture the unidirectional relationships among recently interacted users and utilize these sequences to generate the next potential user who is most likely to interact with the item. The additional item features are also integrated as prefix prompt embeddings to assist the next-user generation. The effectiveness of Next-User Retrieval is evaluated through both offline experiments and online A/B tests. Our method achieves significant improvements with increases of 0.0142% in daily active users and +0.1144% in publications in Douyin, showcasing its practical applicability and scalability.

cs.IR↗

arXiv2025

Quantitative Analysis of Performance Drop in DeepSeek Model Quantization

Recently, there is a high demand for deploying DeepSeek-R1 and V3 locally, possibly because the official service often suffers from being busy and some organizations have data privacy concerns. While single-machine deployment offers infrastructure simplicity, the models' 671B FP8 parameter configuration exceeds the practical memory limits of a standard 8-GPU machine. Quantization is a widely used technique that helps reduce model memory consumption. However, it is unclear what the performance of DeepSeek-R1 and V3 will be after being quantized. This technical report presents the first quantitative evaluation of multi-bitwidth quantization across the complete DeepSeek model spectrum. Key findings reveal that 4-bit quantization maintains little performance degradation versus FP8 while enabling single-machine deployment on standard NVIDIA GPU devices. We further propose DQ3_K_M, a dynamic 3-bit quantization method that significantly outperforms traditional Q3_K_M variant on various benchmarks, which is also comparable with 4-bit quantization (Q4_K_M) approach in most tasks. Moreover, DQ3_K_M supports single-machine deployment configurations for both NVIDIA H100/A100 and Huawei 910B. Our implementation of DQ3\_K\_M is released at https://github.com/UnicomAI/DeepSeek-Eval, containing optimized 3-bit quantized variants of both DeepSeek-R1 and DeepSeek-V3.

cs.LG↗

arXiv2025

Enhancing Cooperative Multi-Agent Reinforcement Learning with State Modelling and Adversarial Exploration

Learning to cooperate in distributed partially observable environments with no communication abilities poses significant challenges for multi-agent deep reinforcement learning (MARL). This paper addresses key concerns in this domain, focusing on inferring state representations from individual agent observations and leveraging these representations to enhance agents' exploration and collaborative task execution policies. To this end, we propose a novel state modelling framework for cooperative MARL, where agents infer meaningful belief representations of the non-observable state, with respect to optimizing their own policies, while filtering redundant and less informative joint state information. Building upon this framework, we propose the MARL SMPE algorithm. In SMPE, agents enhance their own policy's discriminative abilities under partial observability, explicitly by incorporating their beliefs into the policy network, and implicitly by adopting an adversarial type of exploration policies which encourages agents to discover novel, high-value states while improving the discriminative abilities of others. Experimentally, we show that SMPE outperforms state-of-the-art MARL algorithms in complex fully cooperative tasks from the MPE, LBF, and RWARE benchmarks.

cs.LG↗

arXiv2025

Decidabilities of local unitary equivalence for entanglement witnesses and states

The problem of determining whether two states are equivalent by local unitary (LU) operations is important for quantum information processing. In this paper we propose an alternative perspective to study this problem by comparing the decidabilities of LU equivalence (also known as LU decidabilities for short) between entanglement witnesses and states. We introduce a relation between sets of Hermitian operators in terms of the LU decidability. Then we compare the LU decidability for the set of entanglement witness to those decidabilities for several sets of states, and establish a hierarchy on LU decidabilities for these sets. Moreover, we realize that the simultaneous LU (SLU) equivalence between tuples of mutually orthogonal projectors is crucial to LU equivalent operators. We reveal by examples that for two tuples of projectors, the partial SLU equivalence cannot ensure the overall SLU equivalence. Generally, we present a necessary and sufficient condition such that two tuples of states are SLU equivalent.

quant-ph↗

arXiv2025

Reflection-mode diffraction tomography of multiple-scattering samples on a reflective substrate from intensity images

We introduce a novel reflection-mode diffraction tomography technique that enables simultaneous recovery of forward and backward scattering information for high-resolution 3D refractive index reconstruction. Our technique works by imaging a sample on a highly reflective substrate and employing a novel multiple-scattering model and reconstruction algorithm. It combines the modified Born series as the forward model, Bloch and perfect electric conductor boundary conditions to handle oblique incidence and substrate reflections, and the adjoint method for efficient gradient computation in solving the inverse-scattering problem. We validate the technique through simulations and experiments, achieving accurate reconstructions in samples with high refractive index contrasts and complex geometries. Forward scattering captures smooth axial features, while backward scattering reveals complementary interfacial details. Experimental results on dual-layer resolution targets, 3D randomly distributed beads, phase structures obscured by highly scattering fibers, fixed breast cancer cells, and fixed \emph{C. elegans} demonstrate its robustness and versatility. This technique holds promise for applications in semiconductor metrology and biomedical imaging.

physics.optics↗

arXiv2025

An approach for improving the distorted structured light in holographic optical tweezers

Optical tweezers have been widely used for optical manipulation of various particles. At present, there are different type of optical tweezers. Among them, holographic optical tweezers have attracted growing attention as a powerful tools for optical trapping, optical transportation and optical sorting in many fields, due to its excellent properties including great flexibility and high convenience. Experimentally, however, the structured light has been easily distorted, which would lead to serious degradation of optical manipulation performance. In this work, the distortion of structured light is theoretically analyzed. In the following, the distortion of structured light are numerically simulated and experimentally measured. It shows that the simulated results are in consistent with the experimental ones. Then, an approach for decreasing its optical distortion is proposed, and the results reveal that the distortion of structured light can be effectively corrected. Accordingly, our study provides a way for improving the distorted structured light, which is useful for optically manipulating various particles in optical tweezers.

physics.optics↗

arXiv2025

Improve Decoding Factuality by Token-wise Cross Layer Entropy of Large Language Models

Despite their impressive capacities, Large language models (LLMs) often struggle with the hallucination issue of generating inaccurate or fabricated content even when they possess correct knowledge. In this paper, we extend the exploration of the correlation between hidden-state prediction changes and output factuality into a deeper, token-wise level. Based on the insights , we propose cross-layer Entropy eNhanced Decoding (END), a decoding method that mitigates hallucinations without requiring extra training. END leverages inner probability changes across layers to individually quantify the factual knowledge required for each candidate token, and adjusts the final predicting distribution to prioritize tokens with higher factuality. Experiments on both hallucination and QA benchmarks demonstrate that END significantly enhances the truthfulness and informativeness of generated content while maintaining robust QA accuracy. Moreover, our work provides a deeper perspective on understanding the correlations between inherent knowledge and output factuality.

cs.CL↗

arXiv2025

Quantum Metrology via Floquet-Engineered Two-axis Twisting and Turn Dynamics

One core of quantum metrology is the utilization of entanglement to enhance measurement precision beyond the standard quantum limit. Here, we utilize the Floquet-engineered two-axis twisting (TAT) and turn dynamics to generate GHZ-like states for quantum metrology. Using both analytical semi-classical and quantum approaches, we find that the desired $N$-particle GHZ-like state can be produced in a remarkably short time $t_\mathrm{opt}\propto \ln{N}/{N}$, and its quantum Fisher information $F^\mathrm{opt}_\mathrm{Q}\propto N^2$ approaches the Heisenberg limit. Owing to the rapid state preparation, it shows outstanding robustness against decoherence. Moreover, using the Floquet-engineered anti-TAT-and-turn, one may implement an efficient interaction-based readout protocol to extract the signal encoded in this GHZ-like state. This Floquet-engineered anti-TAT-and-turn approach offers a viable method to achieve effective time-reversal dynamics to improve measurement precision and resilience against detection noise, all without the need to invert the sign of the nonlinear interaction. This study paves a way for achieving entanglement-enhanced quantum metrology via rapid generation of GHZ-like states at high particle numbers through continuous Floquet engineering.

quant-ph↗

arXiv2024

An experimental proposal certification for any three-qubit generalized Greenberger-Horne-Zeilinger states based on the fine-grained steering inequality

Multi-party quantum steering is an important concept in quantum information theory and quantum mechanics, typically related to quantum entanglement and quantum nonlocality. It enables precise manipulation of large quantum systems, which is essential for large-scale quantum computing, simulations, and quantum communication. Recently, a quantum steering certification for any three-qubit generalized Greenberger-Horne-Zeilinger (GGHZ) states based on the fine-grained steering inequality was proved [Quantum Studies: Mathematics and Foundations, 2022, 9(2): 175-198]. Here we provide an experimental proposal to prepare the GGHZ states in photon system. The measurement observalbes in each party can be realized by different polarization optical elements. By choosing the angles of the waveplates, our experiment proposal can observe the maximum quantum violation for any three-qubit GGHZ states. Our proposal can be easily extended to high-dimensional qubits and multi-photon GHZ states, which provides a method to study the complex multi-party quantum protocols.

quant-ph↗

arXiv2024

Hierarchical Plant Protein Microcapsules for Hydrophilic and Hydrophobic Cargo Molecules

Microscale hydrogels comprised of macromolecular networks have increasingly been used for applications involving cell encapsulation, tissue engineering and for the storage and release of active cargo molecules. However, the majority of such microgels are formed from nonbiodegradable synthetic polymers, involving harmful solvents, or using animal proteins, such as silk and gelatin, which can have a negative environmental impact and lack sustainability. Furthermore, most encapsulation techniques involve either protecting hydrophobic or hydrophilic cargo, but rarely both. In order to address these issues, we employed droplet-microfluidics to develop novel, plant protein microcapsules capable of containing both hydrophilic and hydrophobic cargo molecules. The microcapsule structure and cargo release rates were controlled by balancing osmotic pressures between the outer and inner phases of the capsules. Moreover, the digestibility of the microcapsules was comparable with that of pure pea protein, thereby enabling the use of these microcapsules for food and beverage applications. In addition, digestive enzymes can trigger the release of the encapsulated active ingredients, and hence, these microcapsules are well suited for the controlled delivery of active nutraceutical or pharmaceutical ingredients. Finally, we investigated the biodegradability of the microcapsules. It was determined that the plant protein microcapsules exhibited 98.0% biodegradability (as compared with cellulose), thereby fulfilling the biodegradability standards stipulated by the International Organization for Standardization (ISO 14851) for microplastics in freshwater conditions (90%). Hence, the plant protein microcapsules can have numerous applications in the food, nutraceutical, pharmaceutical, cosmetic, personal care, and agriculture industries.

physics.bio-ph↗

arXiv2024

Towards Efficient Motion Planning for UAVs: Lazy A* Search with Motion Primitives

Search-based motion planning algorithms have been widely utilized for unmanned aerial vehicles (UAVs). However, deploying these algorithms on real UAVs faces challenges due to limited onboard computational resources. The algorithms struggle to find solutions in high-dimensional search spaces and require considerable time to ensure that the trajectories are dynamically feasible. This paper incorporates the lazy search concept into search-based planning algorithms to address the critical issue of real-time planning for collision-free and dynamically feasible trajectories on UAVs. We demonstrate that the lazy search motion planning algorithm can efficiently find optimal trajectories and significantly improve computational efficiency.

cs.RO↗

arXiv2024

Grid-Mapping Pseudo-Count Constraint for Offline Reinforcement Learning

Offline reinforcement learning learns from a static dataset without interacting with environments, which ensures security and thus owns a good application prospect. However, directly applying naive reinforcement learning algorithm usually fails in an offline environment due to inaccurate Q value approximation caused by out-of-distribution (OOD) state-actions. It is an effective way to solve this problem by penalizing the Q-value of OOD state-actions. Among the methods of punishing OOD state-actions, count-based methods have achieved good results in discrete domains in a simple form. Inspired by it, a novel pseudo-count method for continuous domains called Grid-Mapping Pseudo-Count method (GPC) is proposed by extending the count-based method from discrete to continuous domains. Firstly, the continuous state and action space are mapped to discrete space using Grid-Mapping, then the Q-values of OOD state-actions are constrained through pseudo-count. Secondly, the theoretical proof is given to show that GPC can obtain appropriate uncertainty constraints under fewer assumptions than other pseudo-count methods. Thirdly, GPC is combined with Soft Actor-Critic algorithm (SAC) to get a new algorithm called GPC-SAC. Lastly, experiments on D4RL datasets are given to show that GPC-SAC has better performance and less computational cost than other algorithms that constrain the Q-value.

cs.LG↗

arXiv2024

Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent

In this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of handling up to 256K tokens. We conduct a thorough evaluation of Hunyuan-Large's superior performance across various benchmarks including language understanding and generation, logical reasoning, mathematical problem-solving, coding, long-context, and aggregated tasks, where it outperforms LLama3.1-70B and exhibits comparable performance when compared to the significantly larger LLama3.1-405B model. Key practice of Hunyuan-Large include large-scale synthetic data that is orders larger than in previous literature, a mixed expert routing strategy, a key-value cache compression technique, and an expert-specific learning rate strategy. Additionally, we also investigate the scaling laws and learning rate schedule of mixture of experts models, providing valuable insights and guidances for future model development and optimization. The code and checkpoints of Hunyuan-Large are released to facilitate future innovations and applications. Codes: https://github.com/Tencent/Hunyuan-Large Models: https://huggingface.co/tencent/Tencent-Hunyuan-Large

cs.CL↗

arXiv2024

Real-Time Summarization of Twitter

In this paper, we describe our approaches to TREC Real-Time Summarization of Twitter. We focus on real time push notification scenario, which requires a system monitors the stream of sampled tweets and returns the tweets relevant and novel to given interest profiles. Dirichlet score with and with very little smoothing (baseline) are employed to classify whether a tweet is relevant to a given interest profile. Using metrics including Mean Average Precision (MAP, cumulative gain (CG) and discount cumulative gain (DCG), the experiment indicates that our approach has a good performance. It is also desired to remove the redundant tweets from the pushing queue. Due to the precision limit, we only describe the algorithm in this paper.

cs.LG↗

arXiv2024

Inverse Reinforcement Learning from Non-Stationary Learning Agents

In this paper, we study an inverse reinforcement learning problem that involves learning the reward function of a learning agent using trajectory data collected while this agent is learning its optimal policy. To address this problem, we propose an inverse reinforcement learning method that allows us to estimate the policy parameters of the learning agent which can then be used to estimate its reward function. Our method relies on a new variant of the behavior cloning algorithm, which we call bundle behavior cloning, and uses a small number of trajectories generated by the learning agent's policy at different points in time to learn a set of policies that match the distribution of actions observed in the sampled trajectories. We then use the cloned policies to train a neural network model that estimates the reward function of the learning agent. We provide a theoretical analysis to show a complexity result on bound guarantees for our method that beats standard behavior cloning as well as numerical experiments for a reinforcement learning problem that validate the proposed method.

cs.LG↗

arXiv2024

Distributionally Robust Clustered Federated Learning: A Case Study in Healthcare

In this paper, we address the challenge of heterogeneous data distributions in cross-silo federated learning by introducing a novel algorithm, which we term Cross-silo Robust Clustered Federated Learning (CS-RCFL). Our approach leverages the Wasserstein distance to construct ambiguity sets around each client's empirical distribution that capture possible distribution shifts in the local data, enabling evaluation of worst-case model performance. We then propose a model-agnostic integer fractional program to determine the optimal distributionally robust clustering of clients into coalitions so that possible biases in the local models caused by statistically heterogeneous client datasets are avoided, and analyze our method for linear and logistic regression models. Finally, we discuss a federated learning protocol that ensures the privacy of client distributions, a critical consideration, for instance, when clients are healthcare institutions. We evaluate our algorithm on synthetic and real-world healthcare data.

cs.LG↗