arXiv subjects

Wei He

Publications and source records attributed to Wei He.

At least 109 records · Page 6Linked to original sources

arXiv2025

Cost Reducing Adiabatic Compressed Air Energy Storage for Long Duration Energy Storage Applications

Long-duration energy storage (LDES) is vital for decarbonizing the energy system but faces economic challenges, including high upfront costs, low trading frequency, and limited revenue in current electricity markets. Compressed Air Energy Storage (CAES) is a promising LDES solution, though its economic viability, especially for long storage durations beyond lithium-ion battery capabilities, remains unclear. To address this, here we compiled and analyzed a global emerging adiabatic CAES cost database, showing a continuous cost reduction with an experience rate of 15% as capacities scaled from 10MW to 100MW. Our lifecycle discounted cash flow analysis suggests that adiabatic CAES could achieve economic viability for 10-100 hour storage durations, particularly with optimal geological siting to lower storage costs. This economically viable LDES option will enable large-scale grid balancing and support renewable integration over multi-day periods, making it a valuable asset for advancing deep decarbonization of energy systems.

physics.soc-ph↗

arXiv2025

Payload trajectory tracking control for aerial transportation systems with cable length online optimization

Cable-suspended aerial transportation systems are employed extensively across various industries. The capability to flexibly adjust the relative position between the multirotor and the payload has spurred growing interest in the system equipped with variable-length cable, promising broader application potential. Compared to systems with fixed-length cables, introducing the variable-length cable adds a new degree of freedom. However, it also results in increased nonlinearity and more complex dynamic coupling among the multirotor, the cable and the payload, posing significant challenges in control design. This paper introduces a backstepping control strategy tailored for aerial transportation systems with variable-length cable, designed to precisely track the payload trajectory while dynamically adjusting cable length. Then, a cable length generator has been developed that achieves online optimization of the cable length while satisfying state constraints, thus balancing the multirotor's motion and cable length changes without the need for manual trajectory planning. The asymptotic stability of the closed-loop system is guaranteed through Lyapunov techniques and the growth restriction condition. Finally, simulation results confirm the efficacy of the proposed method in managing trajectory tracking and cable length adjustments effectively.

eess.SY↗

arXiv2025

R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?

Recent trends in test-time scaling for reasoning models (e.g., OpenAI o1, DeepSeek-R1) have led to remarkable improvements through long Chain-of-Thought (CoT). However, existing benchmarks mainly focus on immediate, single-horizon tasks, failing to adequately evaluate models' ability to understand and respond to complex, long-horizon scenarios. To address this incomplete evaluation of Large Reasoning Models (LRMs), we propose R-HORIZON, a method designed to stimulate long-horizon reasoning behaviors in LRMs through query composition. Based on R-HORIZON, we construct a long-horizon reasoning benchmark, comprising complex multi-step reasoning tasks with interdependent problems that span long reasoning horizons. Through comprehensive evaluation of LRMs using the R-HORIZON benchmark, we find that even the most advanced LRMs suffer significant performance degradation. Our analysis reveals that LRMs exhibit limited effective reasoning length and struggle to allocate thinking budget across multiple problems appropriately. Recognizing these limitations, we use R-HORIZON to construct long-horizon reasoning data for reinforcement learning with verified rewards (RLVR). Compared to training with single-horizon data, RLVR with R-HORIZON not only substantially improves performance on the multi-horizon reasoning tasks, but also promotes accuracy on standard reasoning tasks, with an increase of 7.5 on AIME2024. These results position R-HORIZON as a scalable, controllable, and low-cost paradigm for enhancing and evaluating the long-horizon reasoning capabilities of LRMs.

cs.AI↗

arXiv2025

The Structure of Sequentially Complete Locally Minimal Groups

Generalizing results from \cite{DTk,DU} we study the fine structure of locally minimal (locally) precompact Abelian groups (these are the locally essential subgroups $G$ of LCA groups $L$, i.e., such that $G$ non-trivially meets all ``small" closed subgroup of $L$). More precisely we prove that if $G$ is a dense locally minimal and sequentially closed subgroup of a LCA group $L$, then the connected component $c(G)$ of $G$ has the same weight as $c(L)$. Moreover, when $w(c(G))$ is not Ulam measurable, then $c(G) = c(L)$. We provide an extended discussion illustrating how this result fails in various ways in the non-abelian case (even for nilpotent groups of class 2). Motivated by the above result, we study further those locally minimal precompact Abelian groups $G$, termed {\em critical locally minimal},such that $c(G) =c(K)$ (where $K$ is the compact completion of $G$) and $G/c(G)$ is not locally minimal. Such a group cannot be compact, neither connected, nor totally disconnected. We provide a proper class of critical locally minimal groups with additional compactness-like properties and we study the class $\CCC$ of compact Abelian groups with a dense critical locally minimal subgroup. In particular, we completely describe the connected components of the finite-dimensional groups belonging to $\CCC$.

math.GR↗

arXiv2025

VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications

As LLM-based agents are increasingly deployed in real-life scenarios, existing benchmarks fail to capture their inherent complexity of handling extensive information, leveraging diverse resources, and managing dynamic user interactions. To address this gap, we introduce VitaBench, a challenging benchmark that evaluates agents on versatile interactive tasks grounded in real-world settings. Drawing from daily applications in food delivery, in-store consumption, and online travel services, VitaBench presents agents with the most complex life-serving simulation environment to date, comprising 66 tools. Through a framework that eliminates domain-specific policies, we enable flexible composition of these scenarios and tools, yielding 100 cross-scenario tasks (main results) and 300 single-scenario tasks. Each task is derived from multiple real user requests and requires agents to reason across temporal and spatial dimensions, utilize complex tool sets, proactively clarify ambiguous instructions, and track shifting user intent throughout multi-turn conversations. Moreover, we propose a rubric-based sliding window evaluator, enabling robust assessment of diverse solution pathways in complex environments and stochastic interactions. Our comprehensive evaluation reveals that even the most advanced models achieve only 30% success rate on cross-scenario tasks, and less than 50% success rate on others. Overall, we believe VitaBench will serve as a valuable resource for advancing the development of AI agents in practical real-world applications. The code, dataset, and leaderboard are available at https://vitabench.github.io/

cs.CL↗

arXiv2025

Globally Stable Discrete Time PID Passivity-based Control of Power Converters: Simulation and Experimental Results

The key idea behind PID Passivity-based Control (PID-PBC) is to leverage the passivity property of PIDs (for all positive gains) and wrap the PID controller around a passive output to ensure global stability in closed-loop. However, the practical applicability of PID-PBC is stymied by two key facts: (i) the vast majority of practical implementations of PIDs is carried-out in discrete time -- discretizing the continuous time dynamical system of the PID; (ii) the well-known problem that passivity is not preserved upon discretization, even with small sampling times. Therefore, two aspects of the PID-PBC must be revisited for its safe practical application. First, we propose a discretization of the PID that ensures its passivity. Second, since the output that is identified as passive for the continuous time system is not necessarily passive for its discrete time version, we construct a new output that ensures the passivity property for the discretization of the system. In this paper, we provide a constructive answer to both issues for the case of power converter models. Instrumental to achieve this objective is the use of the implicit midpoint discretization method -- which is a symplectic integration technique that preserves system invariants. Since the reference value for the output to be regulated in power converters is non-zero, we are henceforth interested in the property of passivity of the incremental model -- currently known as shifted passivity. Therefore, we demonstrate that the resulting discrete-time PID-PBC defines a passive map for the incremental model and establish shifted passivity for the discretized power converter model. Combining these properties, we prove global stability for the feedback interconnection of the power converter with the discretized PID-PBC. The paper also presents simulations and experiments that demonstrate the performance of the proposed discretization.

eess.SY↗

arXiv2025

A New Partial State-Feedback IDA-PBC for Two-Dimensional Nonlinear Systems: Application to Power Converters with Experimental Results

In this paper we propose a variation of the widely popular Interconnection-and-Damping-Assigment Passivity-Based Control (IDA-PBC) based on Poincare's Lemma to design output feedback globally stabilizing controllers for two dimensional systems. The procedure is constructive and, in comparison with the classical IDA-PBC, whose application is often stymied by the need to solve the (infamous) matching partial differential equation (PDE), in this new method the PDE is replaced by an ordinary differential equation, whose solution is far simpler. The procedure is then applied for the design of voltage-feedback controllers for the three most typical DC-to-DC power converter topologies: the Buck, Boost and Buck-Boost. It is assumed that these converters feed an uncertain load, which is characterized by a static relation between its voltage and current. In the case when the load consists of the parallel connection of a resistive term and a constant power load we propose an adaptive version of the design, adding an identification scheme for the load parameters. This allows the controller to regulate the converter output when the load varies-that is a typical scenario in these applications. Extensive numerical simulations and experimental results validate the approach.

eess.SY↗

arXiv2025

AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learning

Developing autonomous LLM agents capable of making a series of intelligent decisions to solve complex, real-world tasks is a fast-evolving frontier. Like human cognitive development, agents are expected to acquire knowledge and skills through exploration and interaction with the environment. Despite advances, the community still lacks a unified, interactive reinforcement learning (RL) framework that can effectively train such agents from scratch -- without relying on supervised fine-tuning (SFT) -- across diverse and realistic environments. To bridge this gap, we introduce AgentGym-RL, a new framework to train LLM agents for multi-turn interactive decision-making through RL. The framework features a modular and decoupled architecture, ensuring high flexibility and extensibility. It encompasses a wide variety of real-world scenarios, and supports mainstream RL algorithms. Furthermore, we propose ScalingInter-RL, a training approach designed for exploration-exploitation balance and stable RL optimization. In early stages, it emphasizes exploitation by restricting the number of interactions, and gradually shifts towards exploration with larger horizons to encourage diverse problem-solving strategies. In this way, the agent develops more diverse behaviors and is less prone to collapse under long horizons. We perform extensive experiments to validate the stability and effectiveness of both the AgentGym-RL framework and the ScalingInter-RL approach. Our agents match or surpass commercial models on 27 tasks across diverse environments. We offer key insights and will open-source the complete AgentGym-RL framework -- including code and datasets -- to empower the research community in developing the next generation of intelligent agents.

cs.LG↗

arXiv2025

Distill Visual Chart Reasoning Ability from LLMs to MLLMs

Solving complex chart Q&A tasks requires advanced visual reasoning abilities in multimodal large language models (MLLMs), including recognizing key information from visual inputs and conducting reasoning over it. While fine-tuning MLLMs for reasoning is critical, collecting and annotating charts and questions is expensive, hard to scale, and often results in low-quality annotations. To address this, we propose Code-as-Intermediary Translation (CIT), a cost-effective, efficient and scalable data synthesis method for distilling visual reasoning abilities from LLMs to MLLMs. The code serves as an intermediary that translates visual chart representations into textual representations, enabling language models to understand cross-modal information and generate reasoning chains accordingly. In this way, we can employ text-based synthesizing techniques to expand chart-plotting code and generate high-quality Q&A pairs for training models. This produces ReachQA, a dataset containing 3k reasoning-intensive charts and 20k Q&A pairs to enhance both recognition and reasoning abilities of MLLMs. Experiments show that models fine-tuned with ReachQA not only perform well on chart-related tasks but also show performance gains on general reasoning benchmarks. The code and dataset are publicly available at https://github.com/hewei2001/ReachQA.

cs.CL↗

arXiv2025

Quadratic BSDEs with double constraints driven by G-Brownian motion

In this paper, we investigate the well-posedness of quadratic backward stochastic differential equations driven by G-Brownian motion (referred to as G-BSDEs) with double mean reflections. By employing a representation of the solution via G-BMO martingale techniques, along with fixed point arguments, the Skorokhod problem, the backward Skorokhod problem, and the θ-method, we establish existence and uniqueness results for such G-BSDEs under both bounded and unbounded terminal conditions.

math.PR↗

arXiv2025

Maximum principle for discrete-time robust stochastic optimal control problem

This paper firstly presents the necessary and sufficient conditions for a kind of discrete-time robust stochastic optimal control problem with convex control domains. As it is an "inf sup problem", the classical variational method is invalid. We obtain the variational inequality with a common reference probability by systematically using weak convergence approach and the minimax theorem. Moreover, a discrete-time robust investment problem is also studied where the explicit optimal control is given.

math.OC↗

arXiv2025

Enhancing LLM Reasoning with Iterative DPO: A Comprehensive Empirical Investigation

Recent advancements in post-training methodologies for large language models (LLMs) have highlighted reinforcement learning (RL) as a critical component for enhancing reasoning. However, the substantial computational costs associated with RL-based approaches have led to growing interest in alternative paradigms, such as Direct Preference Optimization (DPO). In this study, we investigate the effectiveness of DPO in facilitating self-improvement for LLMs through iterative preference-based learning. We demonstrate that a single round of DPO with coarse filtering significantly enhances mathematical reasoning performance, particularly for strong base model. Furthermore, we design an iterative enhancement framework for both the generator and the reward model (RM), enabling their mutual improvement through online interaction across multiple rounds of DPO. Finally, with simple verifiable rewards, our model DPO-VP achieves RL-level performance with significantly lower computational overhead. These findings highlight DPO as a scalable and cost-effective alternative to RL, offering a practical solution for enhancing LLM reasoning in resource-constrained situations.

cs.CL↗

arXiv2025

DAG-AFL:Directed Acyclic Graph-based Asynchronous Federated Learning

Due to the distributed nature of federated learning (FL), the vulnerability of the global model and the need for coordination among many client devices pose significant challenges. As a promising decentralized, scalable and secure solution, blockchain-based FL methods have attracted widespread attention in recent years. However, traditional consensus mechanisms designed for Proof of Work (PoW) similar to blockchain incur substantial resource consumption and compromise the efficiency of FL, particularly when participating devices are wireless and resource-limited. To address asynchronous client participation and data heterogeneity in FL, while limiting the additional resource overhead introduced by blockchain, we propose the Directed Acyclic Graph-based Asynchronous Federated Learning (DAG-AFL) framework. We develop a tip selection algorithm that considers temporal freshness, node reachability and model accuracy, with a DAG-based trusted verification strategy. Extensive experiments on 3 benchmarking datasets against eight state-of-the-art approaches demonstrate that DAG-AFL significantly improves training efficiency and model accuracy by 22.7% and 6.5% on average, respectively.

cs.LG↗

arXiv2025

Assess Space-Based Solar Power in European-Scale Power System Decarbonization

Meeting net-zero targets remains formidable as terrestrial renewables grapple with intermittency and regional variability. Here, we integrate space-based solar power (SBSP) -- a potential near-constant, orbital solar technology -- into a high-resolution, Europe-wide capacity-expansion and dispatch model to quantify its contribution under net-zero constraints. We examine two advanced SBSP designs: (1) a near-baseload, low Technology Readiness Level (TRL) concept (heliostat-based Representative Design RD1) and (2) a partially intermittent, higher-TRL concept (planar-based RD2), both drawing on NASA's 2050 cost and performance projections. Our results show that RD1 can reduce total system costs by 7--15%, displace up to 80% of intermittent wind and solar, and cut battery usage by over 70%, if it meets its forecast cost reductions -- though long-duration storage (e.g., hydrogen) remains essential for seasonal balancing. By contrast, RD2 is economically unattractive at its projected 2050 costs. Through extensive sensitivity analyses, we identify cost thresholds at which SBSP shifts from cost-prohibitive to complementary and ultimately to a dominant baseload technology. Specifically, RD1 becomes complementary at roughly 14x and dominant at 9x the 2050 solar PV capital cost, benefiting from its continuous power generation. Meanwhile, RD2 must achieve even lower cost levels (9x to be complementary and 6x to dominate) and would rely on short-duration storage to mitigate its partial intermittency. These findings provide quantified techno-economic benchmarks and reveal alternative net-zero pathways, offering critical guidance for policymakers and industry stakeholders seeking large-scale, centrally coordinated renewable solutions with non- or low-intermittency.

physics.soc-ph↗

arXiv2025

LangTime: A Language-Guided Unified Model for Time Series Forecasting with Proximal Policy Optimization

Recent research has shown an increasing interest in utilizing pre-trained large language models (LLMs) for a variety of time series applications. However, there are three main challenges when using LLMs as foundational models for time series forecasting: (1) Cross-domain generalization. (2) Cross-modality alignment. (3) Error accumulation in autoregressive frameworks. To address these challenges, we proposed LangTime, a language-guided unified model for time series forecasting that incorporates cross-domain pre-training with reinforcement learning-based fine-tuning. Specifically, LangTime constructs Temporal Comprehension Prompts (TCPs), which include dataset-wise and channel-wise instructions, to facilitate domain adaptation and condense time series into a single token, enabling LLMs to understand better and align temporal data. To improve autoregressive forecasting, we introduce TimePPO, a reinforcement learning-based fine-tuning algorithm. TimePPO mitigates error accumulation by leveraging a multidimensional rewards function tailored for time series and a repeat-based value estimation strategy. Extensive experiments demonstrate that LangTime achieves state-of-the-art cross-domain forecasting performance, while TimePPO fine-tuning effectively enhances the stability and accuracy of autoregressive forecasting.

cs.LG↗

arXiv2025

OmniEval: A Benchmark for Evaluating Omni-modal Models with Visual, Auditory, and Textual Inputs

In this paper, we introduce OmniEval, a benchmark for evaluating omni-modality models like MiniCPM-O 2.6, which encompasses visual, auditory, and textual inputs. Compared with existing benchmarks, our OmniEval has several distinctive features: (i) Full-modal collaboration: We design evaluation tasks that highlight the strong coupling between audio and video, requiring models to effectively leverage the collaborative perception of all modalities; (ii) Diversity of videos: OmniEval includes 810 audio-visual synchronized videos, 285 Chinese videos and 525 English videos; (iii) Diversity and granularity of tasks: OmniEval contains 2617 question-answer pairs, comprising 1412 open-ended questions and 1205 multiple-choice questions. These questions are divided into 3 major task types and 12 sub-task types to achieve comprehensive evaluation. Among them, we introduce a more granular video localization task named Grounding. Then we conduct experiments on OmniEval with several omni-modality models. We hope that our OmniEval can provide a platform for evaluating the ability to construct and understand coherence from the context of all modalities. Codes and data could be found at https://omnieval-benchmark.github.io/.

cs.CV↗

arXiv2025

iDiT-HOI: Inpainting-based Hand Object Interaction Reenactment via Video Diffusion Transformer

Digital human video generation is gaining traction in fields like education and e-commerce, driven by advancements in head-body animation and lip-syncing technologies. However, realistic Hand-Object Interaction (HOI) - the complex dynamics between human hands and objects - continues to pose challenges. Generating natural and believable HOI reenactments is difficult due to issues such as occlusion between hands and objects, variations in object shapes and orientations, and the necessity for precise physical interactions, and importantly, the ability to generalize to unseen humans and objects. This paper presents a novel framework iDiT-HOI that enables in-the-wild HOI reenactment generation. Specifically, we propose a unified inpainting-based token process method, called Inp-TPU, with a two-stage video diffusion transformer (DiT) model. The first stage generates a key frame by inserting the designated object into the hand region, providing a reference for subsequent frames. The second stage ensures temporal coherence and fluidity in hand-object interactions. The key contribution of our method is to reuse the pretrained model's context perception capabilities without introducing additional parameters, enabling strong generalization to unseen objects and scenarios, and our proposed paradigm naturally supports long video generation. Comprehensive evaluations demonstrate that our approach outperforms existing methods, particularly in challenging real-world scenes, offering enhanced realism and more seamless hand-object interactions.

cs.GR↗

arXiv2025

SemEval-2025 Task 1: AdMIRe -- Advancing Multimodal Idiomaticity Representation

Idiomatic expressions present a unique challenge in NLP, as their meanings are often not directly inferable from their constituent words. Despite recent advancements in Large Language Models (LLMs), idiomaticity remains a significant obstacle to robust semantic representation. We present datasets and tasks for SemEval-2025 Task 1: AdMiRe (Advancing Multimodal Idiomaticity Representation), which challenges the community to assess and improve models' ability to interpret idiomatic expressions in multimodal contexts and in multiple languages. Participants competed in two subtasks: ranking images based on their alignment with idiomatic or literal meanings, and predicting the next image in a sequence. The most effective methods achieved human-level performance by leveraging pretrained LLMs and vision-language models in mixture-of-experts settings, with multiple queries used to smooth over the weaknesses in these models' representations of idiomaticity.

cs.CL↗