arXiv Science⌕ Search

arXiv subjects

Haitao Li

Publications and source records attributed to Haitao Li.

At least 55 records · Page 3Linked to original sources

MulFeRL: Enhancing Reinforcement Learning with Verbal Feedback in a Multi-turn Loop

Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning across domains, but outcome-only scalar rewards are often sparse and uninformative. This limitation is especially severe for failed samples, where scalar rewards indicate only that a solution is incorrect without explaining why the reasoning breaks down. In this paper, we leverage richer verbal feedback to guide RLVR on failed samples and convert feedback-induced progress into trainable learning signals. We propose MulFeRL (Multi-turn Feedback-guided Reinforcement Learning), a multi-turn, event-triggered RLVR framework that combines progress induction for feedback-guided regeneration of failed samples, progress credit assignment for learning from verifier-confirmed progress, and structured feedback injection for integrating feedback into the model's reasoning process. Trained on sampled OpenR1-Math, MulFeRL outperforms supervised, self-distillation-based, and RLVR baselines in-domain, while also showing strong out-of-domain generalization.

cs.AI↗

UnityMAS-O: A General RL Optimization Framework for LLM-Based Multi-Agent Systems

LLM-based multi-agent systems decompose complex tasks into interacting roles, but most remain manually orchestrated by prompts, tools, and control rules, while agents are rarely optimized through a unified reinforcement learning interface. Existing RL post-training frameworks mainly target single-policy optimization and lack abstractions for user-defined multi-agent workflows, structured interaction, role-specific credit assignment, and configurable parameter sharing. We present UnityMAS-O, a general RL optimization framework for LLM-based multi-agent systems. UnityMAS-O treats the complete workflow as the optimization unit, rather than a single response or policy trajectory. It represents workflows through four first-class objects: logical agent roles, graph trajectories, user-defined rewards, and agent--model mappings. This decouples logical agents from physical model parameters, supporting full sharing, full separation, and partial sharing, with rewards assigned at role, turn, and trajectory levels. UnityMAS-O extends verl with a Ray-based star-topology runtime. A central controller executes workflows, invokes tools, records structured trajectories, and assembles rewards; model-local worker groups handle rollout, buffering, advantage computation, and distributed PPO-style updates. Users can define agents, workflows, model mappings, and rewards without rewriting the optimization infrastructure. We instantiate UnityMAS-O on retrieval-augmented QA, iterative agentic search, and reflective code generation. Across Natural Questions, HotpotQA, and held-out code tasks, multi-agent RL improves manually specified workflows after optimization, with especially large gains for smaller models and strict code all-passed metrics. These results show that UnityMAS-O can serve as a reusable substrate for converting diverse LLM-based multi-agent workflows into trainable multi-agent RL systems.

cs.AI↗

X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloning

In this paper, we present X-Voice, a 0.4B multilingual zero-shot voice cloning model that clones arbitrary voices and enables everyone to speak 30 languages. X-Voice is trained on a 420K-hour multilingual corpus using the International Phonetic Alphabet (IPA) as a unified representation. To eliminate the reliance on prompt text without complex preprocessing like forced alignment, we design a two-stage training paradigm. In Stage 1, we establish X-Voice$_{\text{s1}}$ through standard conditional flow-matching training and use it to synthesize 10K hours of speaker-consistent segments as audio prompts. In Stage 2, we fine-tune on these audio pairs with prompt text masked to derive X-Voice$_{\text{s2}}$, which enables zero-shot voice cloning without requiring transcripts of audio prompts. Architecturally, we extend F5-TTS by implementing a dual-level injection of language identifiers and decoupling and scheduling of Classifier-Free Guidance to facilitate multilingual speech synthesis. Subjective and objective evaluation results demonstrate that X-Voice outperforms existing flow-matching based multilingual systems like LEMAS-TTS and achieves zero-shot cross-lingual cloning capabilities comparable to billion-scale models such as Qwen3-TTS. To facilitate research transparency and community advancement, we open-source all related resources.

cs.SD↗

Beyond Experience Retrieval: Learning to Generate Utility-Optimized Structured Experience for Frozen LLMs

Large language models (LLMs) are largely static and often redo reasoning or repeat mistakes. Prior experience reuse typically relies on external retrieval, which is similarity-based, can introduce noise, and adds latency. We introduce SEAM (Structured Experience Adapter Module), a lightweight, executor-specific plug-in that stores experience in its parameters and generates a structured, instance-tailored experience entry in a single forward pass to guide a frozen LLM executor. SEAM is trained for utility via executor rollouts and GRPO while keeping the executor frozen, and it can be further improved after deployment with supervised fine-tuning on logged successful trajectories. Experiments on mathematical reasoning benchmarks show consistent accuracy gains across executors with low overhead. Extensive ablations and analyses further elucidate the mechanisms underlying SEAM's effectiveness and robustness.

cs.LG↗

ReStyle-TTS: Relative and Continuous Style Control for Zero-Shot Speech Synthesis

Zero-shot text-to-speech models can clone a speaker's timbre from a short reference audio, but they also strongly inherit the speaking style present in the reference. As a result, synthesizing speech with a desired style often requires carefully selecting reference audio, which is impractical when only limited or mismatched references are available. While recent controllable TTS methods attempt to address this issue, they typically rely on absolute style targets and discrete textual prompts, and therefore do not support continuous and reference-relative style control. We propose ReStyle-TTS, a framework that enables continuous and reference-relative style control in zero-shot TTS. Our key insight is that effective style control requires first reducing the model's implicit dependence on reference style before introducing explicit control mechanisms. To this end, we introduce Decoupled Classifier-Free Guidance (DCFG), which independently controls text and reference guidance, reducing reliance on reference style while preserving text fidelity. On top of this, we apply style-specific LoRAs together with Orthogonal LoRA Fusion to enable continuous and disentangled multi-attribute control, and introduce a Timbre Consistency Optimization module to mitigate timbre drift caused by weakened reference guidance. Experiments show that ReStyle-TTS enables user-friendly, continuous, and relative control over pitch, energy, and multiple emotions while maintaining intelligibility and speaker timbre, and performs robustly in challenging mismatched reference-target style scenarios.

eess.AS↗

Closeby Habitable Exoplanet Survey (CHES). V. Planetary Parameters Derived from Angular Separation Variations

The Closeby Habitable Exoplanet Survey (CHES) aims to achieve microarcsecond-level astrometry of about one hundred nearby FGK-type stars within 10 parsecs to detect Earth-like planets. Such precision exceeds the capability of absolute astrometry relying on Gaia catalogs, whose positional accuracy degrades over time due to error propagation from stellar motion and epoch offsets, limiting their use in microarcsecond-level detection. Traditional relative astrometry depends on positional components along right ascension and declination, requiring precise knowledge of field rotation and satellite attitude, which introduces additional errors. To address this, we propose a new relative measurement model based solely on variations in the length of angular separation between the target and reference stars, independent of direction. The model incorporates effects such as proper motion, parallax, radial velocity, light aberration, gravitational lensing, and planetary perturbations, enabling reconstruction of planetary orbits and masses. This approach enhances measurement stability and precision, providing a framework that is not entirely dependent on the Gaia catalog and suitable for CHES and other future high-accuracy astrometric missions.

astro-ph.EP↗

A Contrastive Learning Foundation Model Based on Perfectly Aligned Sample Pairs for Remote Sensing Images

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference. However, due to the significant domain gap, while CL methods have achieved great success in many computer vision tasks, they still require specific adaptation for Remote Sensing (RS) images. To this end, we present a novel self-supervised method called PerA, which produces all-purpose RS features through semantically Perfectly Aligned sample pairs. Specifically, PerA obtains features from sampled views by applying spatially disjoint masks to augmented images rather than random cropping. Our framework provides high-quality features by ensuring consistency between teacher and student and predicting learnable mask tokens. Compared to previous contrastive methods, our method demonstrates higher memory efficiency and can be trained with larger batches due to its sparse inputs. Additionally, the proposed method demonstrates remarkable adaptability to uncurated RS data and reduce the impact of the potential semantic inconsistency. We also collect an unlabeled pre-training dataset, which contains about 5 million RS images. We conducted experiments on multiple downstream task datasets and achieved performance comparable to previous state-of-the-art methods with a limited model scale, demonstrating the effectiveness of our approach. We hope this work will contribute to practical remote sensing interpretation works.

eess.IV↗

LegalOne: A Family of Foundation Models for Reliable Legal Reasoning

While Large Language Models (LLMs) have demonstrated impressive general capabilities, their direct application in the legal domain is often hindered by a lack of precise domain knowledge and complexity of performing rigorous multi-step judicial reasoning. To address this gap, we present LegalOne, a family of foundational models specifically tailored for the Chinese legal domain. LegalOne is developed through a comprehensive three-phase pipeline designed to master legal reasoning. First, during mid-training phase, we propose Plasticity-Adjusted Sampling (PAS) to address the challenge of domain adaptation. This perplexity-based scheduler strikes a balance between the acquisition of new knowledge and the retention of original capabilities, effectively establishing a robust legal foundation. Second, during supervised fine-tuning, we employ Legal Agentic CoT Distillation (LEAD) to distill explicit reasoning from raw legal texts. Unlike naive distillation, LEAD utilizes an agentic workflow to convert complex judicial processes into structured reasoning trajectories, thereby enforcing factual grounding and logical rigor. Finally, we implement a Curriculum Reinforcement Learning (RL) strategy. Through a progressive reinforcement process spanning memorization, understanding, and reasoning, LegalOne evolves from simple pattern matching to autonomous and reliable legal reasoning. Experimental results demonstrate that LegalOne achieves state-of-the-art performance across a wide range of legal tasks, surpassing general-purpose LLMs with vastly larger parameter counts through enhanced knowledge density and efficiency. We publicly release the LegalOne weights and the LegalKit evaluation framework to advance the field of Legal AI, paving the way for deploying trustworthy and interpretable foundation models in high-stakes judicial applications.

cs.CL↗

ATACompressor: Adaptive Task-Aware Compression for Efficient Long-Context Processing in LLMs

Long-context inputs in large language models (LLMs) often suffer from the "lost in the middle" problem, where critical information becomes diluted or ignored due to excessive length. Context compression methods aim to address this by reducing input size, but existing approaches struggle with balancing information preservation and compression efficiency. We propose Adaptive Task-Aware Compressor (ATACompressor), which dynamically adjusts compression based on the specific requirements of the task. ATACompressor employs a selective encoder that compresses only the task-relevant portions of long contexts, ensuring that essential information is preserved while reducing unnecessary content. Its adaptive allocation controller perceives the length of relevant content and adjusts the compression rate accordingly, optimizing resource utilization. We evaluate ATACompressor on three QA datasets: HotpotQA, MSMARCO, and SQUAD-showing that it outperforms existing methods in terms of both compression efficiency and task performance. Our approach provides a scalable solution for long-context processing in LLMs. Furthermore, we perform a range of ablation studies and analysis experiments to gain deeper insights into the key components of ATACompressor.

cs.CL↗

VideoPro: Adaptive Program Reasoning for Long Video Understanding

Large language models (LLMs) have shown promise in generating program workflows for visual tasks. However, previous approaches often rely on closed-source models, lack systematic reasoning, and struggle with long-form video question answering (videoQA). To address these challenges, we introduce the FS-VisPR framework, an adaptive visual program reasoning approach that balances fast reasoning for simple queries with slow reasoning for difficult ones. First, we design efficient visual modules (e.g., key clip retrieval and subtitle retrieval) to support long-form video tasks. Then, we construct a diverse and high-quality fast-slow reasoning dataset with a strong LLM to align open-source language models' ability to generate visual program workflows as FS-LLM. Next, we design a fast-slow reasoning framework with FS-LLM: Simple queries are directly solved by VideoLLMs, while difficult ones invoke visual program reasoning, motivated by human-like reasoning processes. During this process, low-confidence fast-thinking answers will trigger a second-stage slow-reasoning process, and a fallback mechanism to fast reasoning is activated if the program execution fails. Moreover, we improve visual programs through parameter search during both training and inference. By adjusting the parameters of the visual modules within the program, multiple variants are generated: during training, programs that yield correct answers are selected, while during inference, the program with the highest confidence result is applied. Experiments show that FS-VisPR improves both efficiency and reliability in visual program workflows. It achieves 50.4% accuracy on LVBench, surpassing GPT-4o, matching the performance of Qwen2.5VL-72B on VideoMME.

cs.CV↗

Evaluation of Large Language Models in Legal Applications: Challenges, Methods, and Future Directions

Large language models (LLMs) are being increasingly integrated into legal applications, including judicial decision support, legal practice assistance, and public-facing legal services. While LLMs show strong potential in handling legal knowledge and tasks, their deployment in real-world legal settings raises critical concerns beyond surface-level accuracy, involving the soundness of legal reasoning processes and trustworthy issues such as fairness and reliability. Systematic evaluation of LLM performance in legal tasks has therefore become essential for their responsible adoption. This survey identifies key challenges in evaluating LLMs for legal tasks grounded in real-world legal practice. We analyze the major difficulties involved in assessing LLM performance in the legal domain, including outcome correctness, reasoning reliability, and trustworthiness. Building on these challenges, we review and categorize existing evaluation methods and benchmarks according to their task design, datasets, and evaluation metrics. We further discuss the extent to which current approaches address these challenges, highlight their limitations, and outline future research directions toward more realistic, reliable, and legally grounded evaluation frameworks for LLMs in legal domains.

cs.CY↗

Unveiling spin-orbital angular momentum locking in photonic Dirac vortex cavities

Dirac vortices, originally studied in quantum field theories to predict localized zero-energy modes, were recently realized in photonics, leading to Dirac vortex cavities. With topological protection, Dirac vortex cavities offer robust single-mode large-area localized modes appealing for high-performance micro-lasers and other applications. As a spectrally-isolated single mode, the radiation of a Dirac vortex cavity mode was believed as having vanishing orbital angular momentum due to time-reversal symmetry. Here, we report the direct observation of orbital angular momentum radiation of a Dirac vortex cavity through spin-resolved measurements. Remarkably, we confirm the spin-orbital angular momentum locking in such radiation due to the spin-valley locking and inter-valley couplings. We demonstrate that the spin-orbital angular momentum locking is controlled by the chirality of the Kekulé modulation and propose design schemes for arbitrary-order single-mode OAM radiation.

physics.optics↗

Giant and Rapidly Switching Intrinsic Chirality Enabled by Toroidal Quasi-Bound States in the Continuum

Circular dichroism (CD), arising from spin-selective light-matter interactions controlled by chirality, is critical for advanced applications such as chiral imaging and ultrasensitive biosensing. However, CD of chiral natural materials is inherently constrained owing to molecular symmetry and thermodynamic stability. Recently, artificially engineered metasurfaces incorporating chiral quasi-bound states in the continuum (Q-BICs) have emerged as a promising solution, which enables near-unity CD responses. However, their current designs heavily rely on complex three-dimensional geometries, posing significant challenges for integration with planar on-chip platforms. To address the stringent challenges, we demonstrate a truly planar metasurface that achieves giant intrinsic chiral responses by utilizing a chiral Q-BIC dominated by out-of-plane toroidal dipoles (Tz). With deep-subwavelength (λ/20) thickness, our metasurface exhibits outstanding intrinsic CD values in both simulations (>0.90) and experiments (~0.80). Moreover, in contrast to previous electric or magnetic chiral Q-BICs, the toroidal Q-BIC produces a rapidly switching CD response - transitioning sharply between positive and negative giant CD values within ~0.2 GHz, and the switching is highly sensitive to small oblique incidence of opposite angles. Therefore, our scheme provides a planar platform for studying chiral light-matter interactions involving toroidal dipoles, important for future development of polarization- and angle-sensitive photonic and optoelectronic devices.

physics.optics↗

Kirigami-based Flexible Metasurface with Reconfigurable Intrinsic Chirality from Zero to Near-unity

Chiral responses in electromagnetic metasurfaces are typically categorized as extrinsic, resulting from asymmetric interactions between the structure and incident waves, and intrinsic, arising from three-dimensional symmetry breaking of the unit cell. However, most existing metasurface designs target only one type of chirality and lack a unified, continuously tunable platform for broader chiroptical control. To address this limitation, the designed kirigami-based flexible metasurface is proposed for dynamic, continuous modulation of chirality, which expands the control scope to both extrinsic and intrinsic chiral responses within a single, reconfigurable platform. Initially, the unfolded metasurface exhibits extrinsic chirality under oblique incidence. By introducing well-designed kirigami-based cuts and folds, the metasurface transitions from a planar and achiral configuration to a three-dimensional chiral geometry that breaks the mirror symmetry, thereby exhibiting tunable intrinsic chirality and asymmetric extrinsic chirality. As the folding angle increases, the resulting deformation enables continuous tuning of the chiral response, with circular dichroism and its asymmetry under oblique incidences progressively increasing and reaching pronounced levels across the X-band. Our work provides a lightweight, easy-fabricated, and mechanically reconfigurable metasurface, which offers strong potential for future development in adaptive photonic systems and advanced chiroptical technologies.

physics.optics↗

Hybrid Cavity from Tunable Coupling between Anapole and Fabry-Perot Resonance or Anti-resonance

Enhancing light-matter interactions depends critically on the ability to tailor photonic modes at subwavelength scales, and combining distinct resonant modes has shown remarkable potential unattainable by individual resonances alone. Despite recent advances in anapole metasurfaces for energy confinement and Fabry-Perot (FP) cavities for spectral control, their synergistic coupling and resulting opportunities remain largely unexplored due to challenges such as precise nanoscale assembly. Here, we demonstrate that embedding a terahertz (THz) anapole metasurface within a tunable FP cavity results in a hybrid cavity that demonstrates exotic properties as the anapole transitions between coupling to FP resonances and anti-resonances via cavity-length tuning. At room temperature, we observe ultrastrong coupling (> 30% of the anapole frequency) between anapoles and FP resonances, generating tunable-dispersion polaritons that blend favorable properties of both modes. Meanwhile, anapole spectrally aligns with FP anti-resonances, leading to weak coupling that narrows the linewidth of the anapole's transmission peak by two orders of magnitude and enhances its local density of states (LDOS) near the metasurface correspondingly. With exceptional capabilities including formation of polaritons and significant enhancement of LDOS, the hybrid cavity enables strong interaction with functional materials, paving the way for exploration of quantum optics, molecular sensing, and ultrafast nonlinear photonics.

physics.optics↗

Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study

Cardiovascular diseases (CVDs) are the leading cause of global mortality, necessitating accessible and accurate diagnostic tools. While cardiac magnetic resonance imaging (CMR) provides gold-standard insights into cardiac structure and function, its clinical utility is limited by high cost and complexity. In contrast, electrocardiography (ECG) is inexpensive and widely available but lacks the granularity of CMR. We propose CardioNets, a deep learning framework that translates 12-lead ECG signals into CMR-level functional parameters and synthetic images, enabling scalable cardiac assessment. CardioNets integrates cross-modal contrastive learning and generative pretraining, aligning ECG with CMR-derived cardiac phenotypes and synthesizing high-resolution CMR images via a masked autoregressive model. Trained on 159,819 samples from five cohorts, including the UK Biobank (n=42,483) and MIMIC-IV-ECG (n=164,550), and externally validated on independent clinical datasets (n=3,767), CardioNets achieved strong performance across disease screening and phenotype estimation tasks. In the UK Biobank, it improved cardiac phenotype regression R2 by 24.8% and cardiomyopathy AUC by up to 39.3% over baseline models. In MIMIC, it increased AUC for pulmonary hypertension detection by 5.6%. Generated CMR images showed 36.6% higher SSIM and 8.7% higher PSNR than prior approaches. In a reader study, ECG-only CardioNets achieved 13.9% higher accuracy than human physicians using both ECG and real CMR. These results suggest that CardioNets offers a promising, low-cost alternative to CMR for large-scale CVD screening, particularly in resource-limited settings. Future efforts will focus on clinical deployment and regulatory validation of ECG-based synthetic imaging.

eess.IV↗

STCTS: Generative Semantic Compression for Ultra-Low Bitrate Speech via Explicit Text-Prosody-Timbre Decomposition

Voice communication in bandwidth-constrained environments--maritime, satellite, and tactical networks--remains prohibitively expensive. Traditional codecs struggle below 1 kbps, while existing semantic approaches (STT-TTS) sacrifice prosody and speaker identity. We present STCTS, a generative semantic compression framework enabling natural voice communication at 80 bps. STCTS explicitly decomposes speech into linguistic content, prosodic expression, and speaker timbre, applying tailored compression: context-aware text encoding (70 bps), sparse prosody transmission via TTS interpolation (<14 bps at 0.1-1 Hz), and amortized speaker embedding. Evaluations on LibriSpeech demonstrate a 75x bitrate reduction versus Opus (6 kbps) and 12x versus EnCodec (1 kbps), while maintaining perceptual quality (NISQA MOS > 4.26), graceful degradation under packet loss and noise resilience. We also discover a bimodal quality distribution with prosody sampling rate: sparse and dense updates both achieve high quality, while mid-range rates degrade due to perceptual discontinuities--guiding optimal configuration design. Beyond efficiency, our modular architecture supports privacy-preserving encryption, human-interpretable transmission, and flexible deployment on edge devices, offering a robust solution for ultra-low bandwidth scenarios.

cs.SD↗

Modeling Atmospheric Ion Escape from Kepler-1649 b and c over Time

Rocky planets orbiting M-dwarf stars are prime targets for atmospheric characterization, yet their long-term evolution under intense stellar winds and high-energy radiation remains poorly constrained. The Kepler-1649 system, hosting two terrestrial exoplanets orbiting an M5V star, provides a valuable laboratory for studying atmospheric evolution in the extreme environments typical of M-dwarf systems. In this Letter we show that both planets could have retained atmospheres over gigayear timescales. Using a multi-species magnetohydrodynamic model, we simulate atmospheric ion escape driven by stellar winds and extreme ultraviolet radiation from 0.8 to 4.0 Gyr. The results reveal a clear decline in total ion escape rates with stellar age, as captured by a nonparametric LOWESS regression, with O$^{+}$ comprising 98.3%-99.9% of the total loss. Escape rates at 4.0 Gyr are two to three orders of magnitude lower than during early epochs. At 0.8 Gyr, planet b exhibits 3.79$\times$ higher O$^{+}$ escape rates than planet c, whereas by 4.0 Gyr its O$^{+}$ escape rate becomes 39.5$\times$ lower. This reversal arises from a transition to sub-magnetosonic star-planet interactions, where the fast magnetosonic Mach number, $M_f$, falls below unity. Despite substantial early atmospheric erosion, both planets may have retained significant atmospheres, suggesting potential long-term habitability. These findings offer predictive insight into atmospheric retention in the Kepler-1649 system and inform future JWST observations of similar M-dwarf terrestrial exoplanets aimed at refining habitability assessments.

astro-ph.EP↗