arXiv Science⌕ Search

arXiv subjects

Peng Wei

Publications and source records attributed to Peng Wei.

At least 73 records · Page 4Linked to original sources

Self-Rewarding Rubric-Based Reinforcement Learning for Open-Ended Reasoning

Open-ended evaluation is essential for deploying large language models in real-world settings. In studying HealthBench, we observe that using the model itself as a grader and generating rubric-based reward signals substantially improves reasoning performance. Remarkably, the trained model also becomes a stronger grader. Motivated by this, we introduce Self-Rewarding Rubric-Based Reinforcement Learning for Open-Ended Reasoning, a lightweight framework that enables faster and more resource-efficient training while surpassing baselines. Remarkably, on Qwen3-32B, training with just the 4000-sample HealthBench Easy subset is sufficient to obtain a model that exceeds GPT-5 on HealthBench Hard. Incorporating a small amount of teacher-graded data further enhances performance for less capable models.

cs.CL↗

HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation

Retrieval-augmented generation (RAG) has become a fundamental paradigm for addressing the challenges faced by large language models in handling real-time information and domain-specific problems. Traditional RAG systems primarily rely on the in-context learning (ICL) capabilities of the large language model itself. Still, in-depth research on the specific capabilities needed by the RAG generation model is lacking, leading to challenges with inconsistent document quality and retrieval system imperfections. Even the limited studies that fine-tune RAG generative models often \textit{lack a granular focus on RAG task} or \textit{a deeper utilization of chain-of-thought processes}. To address this, we propose that RAG models should possess three progressively hierarchical abilities (1) Filtering: the ability to select relevant information; (2) Combination: the ability to combine semantic information across paragraphs; and (3) RAG-specific reasoning: the ability to further process external knowledge using internal knowledge. Thus, we introduce our new RAG instruction fine-tuning method, Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation (HIRAG) incorporates a "think before answering" strategy. This method enhances the model's open-book examination capability by utilizing multi-level progressive chain-of-thought. Experiments show that the HIRAG training strategy significantly improves the model's performance on datasets such as RGB, PopQA, MuSiQue, HotpotQA, and PubmedQA.

cs.CL↗

HANRAG: Heuristic Accurate Noise-resistant Retrieval-Augmented Generation for Multi-hop Question Answering

The Retrieval-Augmented Generation (RAG) approach enhances question-answering systems and dialogue generation tasks by integrating information retrieval (IR) technologies with large language models (LLMs). This strategy, which retrieves information from external knowledge bases to bolster the response capabilities of generative models, has achieved certain successes. However, current RAG methods still face numerous challenges when dealing with multi-hop queries. For instance, some approaches overly rely on iterative retrieval, wasting too many retrieval steps on compound queries. Additionally, using the original complex query for retrieval may fail to capture content relevant to specific sub-queries, resulting in noisy retrieved content. If the noise is not managed, it can lead to the problem of noise accumulation. To address these issues, we introduce HANRAG, a novel heuristic-based framework designed to efficiently tackle problems of varying complexity. Driven by a powerful revelator, HANRAG routes queries, decomposes them into sub-queries, and filters noise from retrieved documents. This enhances the system's adaptability and noise resistance, making it highly capable of handling diverse queries. We compare the proposed framework against other leading industry methods across various benchmarks. The results demonstrate that our framework obtains superior performance in both single-hop and multi-hop question-answering tasks.

cs.CL↗

Toward High-Precision Astrometry with CSST Using Multi-Gaussian Fitting of PSF

The Chinese Space Station Survey Telescope (CSST) presents significant potential for high-precision astrometry. In this study, we show that the point spread function (PSF) modeled by the discrete PSF with Multi-Gaussian function can effectively enhance the astrometric accuracy. We determine that the PSF profile can be accurately modeled by three Gaussians, which takes advantage of reduced computational complexity in PSF convolution. In sparse star fields, the lowest centering accuracy we obtain after aberration correction can be below 1 mas. We find that the proper motion errors remain below 1.0 mas/yr for point sources with five observations and approximately 0.8 mas/yr for seven observations with a time baseline of around 3.5 years. We finally demonstrate that the precision of our position measurements for stars fainter than 21 mag in the simulated CSST crowded field is better than the results from both SExtractor and DOLPHOT.

astro-ph.IM↗

M-learner:A Flexible And Powerful Framework To Study Heterogeneous Treatment Effect In Mediation Model

We propose a novel method, termed the M-learner, for estimating heterogeneous indirect and total treatment effects and identifying relevant subgroups within a mediation framework. The procedure comprises four key steps. First, we compute individual-level conditional average indirect/total treatment effect Second, we construct a distance matrix based on pairwise differences. Third, we apply tSNE to project this matrix into a low-dimensional Euclidean space, followed by K-means clustering to identify subgroup structures. Finally, we calibrate and refine the clusters using a threshold-based procedure to determine the optimal configuration. To the best of our knowledge, this is the first approach specifically designed to capture treatment effect heterogeneity in the presence of mediation. Experimental results validate the robustness and effectiveness of the proposed framework. Application to the real-world Jobs II dataset highlights the broad adaptability and potential applicability of our method.Code is available at https: //anonymous.4open.science/r/M-learner-C4BB.

stat.ML↗

Learning to Align, Aligning to Learn: A Unified Approach for Self-Optimized Alignment

Alignment methodologies have emerged as a critical pathway for enhancing language model alignment capabilities. While SFT (supervised fine-tuning) accelerates convergence through direct token-level loss intervention, its efficacy is constrained by offline policy trajectory. In contrast, RL(reinforcement learning) facilitates exploratory policy optimization, but suffers from low sample efficiency and stringent dependency on high-quality base models. To address these dual challenges, we propose GRAO (Group Relative Alignment Optimization), a unified framework that synergizes the respective strengths of SFT and RL through three key innovations: 1) A multi-sample generation strategy enabling comparative quality assessment via reward feedback; 2) A novel Group Direct Alignment Loss formulation leveraging intra-group relative advantage weighting; 3) Reference-aware parameter updates guided by pairwise preference dynamics. Our theoretical analysis establishes GRAO's convergence guarantees and sample efficiency advantages over conventional approaches. Comprehensive evaluations across complex human alignment tasks demonstrate GRAO's superior performance, achieving 57.70\%,17.65\% 7.95\% and 5.18\% relative improvements over SFT, DPO, PPO and GRPO baselines respectively. This work provides both a theoretically grounded alignment framework and empirical evidence for efficient capability evolution in language models.

cs.LG↗

Vision-based Navigation of Unmanned Aerial Vehicles in Orchards: An Imitation Learning Approach

Autonomous unmanned aerial vehicle (UAV) navigation in orchards presents significant challenges due to obstacles and GPS-deprived environments. In this work, we introduce a learning-based approach to achieve vision-based navigation of UAVs within orchard rows. Our method employs a variational autoencoder (VAE)-based controller, trained with an intervention-based learning framework that allows the UAV to learn a visuomotor policy from human experience. We validate our approach in real orchard environments with a custom-built quadrotor platform. Field experiments demonstrate that after only a few iterations of training, the proposed VAE-based controller can autonomously navigate the UAV based on a front-mounted camera stream. The controller exhibits strong obstacle avoidance performance, achieves longer flying distances with less human assistance, and outperforms existing algorithms. Furthermore, we show that the policy generalizes effectively to novel environments and maintains competitive performance across varying conditions and speeds. This research not only advances UAV autonomy but also holds significant potential for precision agriculture, improving efficiency in orchard monitoring and management.

cs.RO↗

PRGB Benchmark: A Robust Placeholder-Assisted Algorithm for Benchmarking Retrieval-Augmented Generation

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge, where the LLM's ability to generate responses based on the combination of a given query and retrieved documents is crucial. However, most benchmarks focus on overall RAG system performance, rarely assessing LLM-specific capabilities. Current benchmarks emphasize broad aspects such as noise robustness, but lack a systematic and granular evaluation framework on document utilization. To this end, we introduce \textit{Placeholder-RAG-Benchmark}, a multi-level fine-grained benchmark, emphasizing the following progressive dimensions: (1) multi-level filtering abilities, (2) combination abilities, and (3) reference reasoning. To provide a more nuanced understanding of LLMs' roles in RAG systems, we formulate an innovative placeholder-based approach to decouple the contributions of the LLM's parametric knowledge and the external knowledge. Experiments demonstrate the limitations of representative LLMs in the RAG system's generation capabilities, particularly in error resilience and context faithfulness. Our benchmark provides a reproducible framework for developing more reliable and efficient RAG systems. Our code is available in https://github.com/Alipay-Med/PRGB.

cs.CL↗

GalaxyGenius: Mock galaxy image generator for various telescopes from hydrodynamical simulations

We introduce GalaxyGenius, a Python package designed to produce synthetic galaxy images tailored to different telescopes based on hydrodynamical simulations. Its implementation will support and advance research on galaxies in the era of large-scale sky surveys. The package comprises three main modules: data preprocessing, ideal data cube generation, and mock observation. Specifically, the preprocessing module extracts necessary properties of star and gas particles for a selected subhalo from hydrodynamical simulations and creates the execution file for the following radiative transfer procedure. Subsequently, building on the above information, the ideal data cube generation module executes a widely used radiative transfer project, specifically the SKIRT, to perform the SED assignment for each particle and the radiative transfer procedure to produce an IFU-like ideal data cube. Lastly, the mock observation module takes the ideal data cube and applies the throughputs of aiming telescopes, while also incorporating the relevant instrumental effects, point spread functions (PSFs), and background noise to generate the required mock observational images of galaxies. To showcase the outcomes of GalaxyGenius, we created a series of mock images of galaxies based on the IllustrisTNG and EAGLE simulations for both space and ground-based surveys, spanning ultraviolet (UV) to infrared (IR) wavelength coverage, including CSST, Euclid, HST, JWST, Roman, and HSC. GalaxyGenius offers a flexible framework to generate mock galaxy images with customizable recipes. These generated images can serve as valuable references for verifying and validating new approaches in astronomical research. They can also serve as training sets for relevant studies using deep learning in cases where real observational data are insufficient.

astro-ph.IM↗

An H$α$ Cloud in the HI Tail: Recent Star Formation in the Outskirts of NGC 4258 Revealed by Nanshan 1-m Telescope

We present first-light deep H$α$ imaging taken with the Nanshan 1-meter wide-field telescope on the local galaxy NGC 4258, alongside archival data from Hubble Space telescope (HST), Westerbork Synthesis Radio Telescope, and The Dark Energy Camera Legacy Survey. The H$α$ image shows ongoing star formation not only inside the galaxy but also in an HI cloud in the eastern HI tail, which is roughly 16 kpc away from the main galaxy. The HST images reveal several ultra-blue compact objects ($\rm F555W - F814W <-0.5 mag,\, FWHM\sim 0.2''$) in the H$α$ bright region, aligned with the HI tail, suggesting the presence of young open cluster candidate in the HI tail. Our results suggest that wide field H$α$ imaging is a valuable tool for investigating recent star formation in the extended regions of NGC 4258. Furthermore, the star formation in diffuse HI tails could highlight an potential aspect of galaxy stellar halo formation, warranting further investigation of the impact of star formation in halos on galaxy evolution.

astro-ph.GA↗

High Pressure Growth of Transition-Metal Monosilicide RhGe Single Crystals

Transition-metal monosilicide RhGe has been reported to exhibit weak itinerant ferromagnetism, superconductivity, and topological properties. In this study, we report the high-pressure growth of high-quality RhGe single crystals up to millimeter size using flux method. Transport measurements reveal the metallic behavior of RhGe between 2-300 K with Fermi liquid behavior at low temperature region. However, no superconductivity was observed with variations in Ge composition. Magnetic characterizations indicate that RhGe exhibits a paramagnetic behavior between 2-300 K. The high-quality, large-size RhGe single crystals pave the way for further investigation of their topological properties using spectroscopic techniques.

cond-mat.str-el↗

A Confounding Factors-Inhibition Adversarial Learning Framework for Multi-site fMRI Mental Disorder Identification

In open data sets of functional magnetic resonance imaging (fMRI), the heterogeneity of the data is typically attributed to a combination of factors, including differences in scanning procedures, the presence of confounding effects, and population diversities between multiple sites. These factors contribute to the diminished effectiveness of representation learning, which in turn affects the overall efficacy of subsequent classification procedures. To address these limitations, we propose a novel multi-site adversarial learning network (MSalNET) for fMRI-based mental disorder detection. Firstly, a representation learning module is introduced with a node information assembly (NIA) mechanism to better extract features from functional connectivity (FC). This mechanism aggregates edge information from both horizontal and vertical directions, effectively assembling node information. Secondly, to generalize the feature across sites, we proposed a site-level feature extraction module that can learn from individual FC data, which circumvents additional prior information. Lastly, an adversarial learning network is proposed as a means of balancing the trade-off between individual classification and site regression tasks, with the introduction of a novel loss function. The proposed method was evaluated on two multi-site fMRI datasets, i.e., Autism Brain Imaging Data Exchange (ABIDE) and ADHD-200. The results indicate that the proposed method achieves a better performance than other related algorithms with the accuracy of 75.56 and 68.92 in ABIDE and ADHD-200 datasets, respectively. Furthermore, the result of the site regression indicates that the proposed method reduces site variability from a data-driven perspective. The most discriminative brain regions revealed by NIA are consistent with statistical findings, uncovering the "black box" of deep learning to a certain extent.

cs.LG↗

A Navigation System for ROV's inspection on Fish Net Cage

Autonomous Remotely Operated Vehicles (ROVs) offer a promising solution for automating fishnet inspection, reducing labor dependency, and improving operational efficiency. In this paper, we modify an off-the-shelf ROV, the BlueROV2, into a ROS-based framework and develop a localization module, a path planning system, and a control framework. For real-time, local localization, we employ the open-source TagSLAM library. Additionally, we propose a control strategy based on a Nominal Feedback Controller (NFC) to achieve precise trajectory tracking. The proposed system has been implemented and validated through experiments in a controlled laboratory environment, demonstrating its effectiveness for real-world applications.

cs.RO↗

CSST Large Scale Structure Analysis Pipeline: III. Emission-line Redshift Measurement for Slitless Spectra

The China Space Station Telescope (CSST) is a forthcoming space-based optical telescope designed to co-orbit with the Chinese Space Station. With a planned slitless spectroscopic survey spanning a broad wavelength range of $255-1000$nm and an average spectral resolution exceeding 200, the CSST holds significant potential for cosmic large-scale structure analysis. In this study, we focus on redshift determinations from slitless spectra through emission line analysis within the CSST framework. Our tailored redshift measurement process involves identifying emission lines in one-dimensional slitless spectra, aligning observed wavelengths with their rest-frame counterparts from prominent galaxy emissions, and calculating wavelength shifts to determine redshifts accurately. To validate our redshift measurement algorithm, we leverage simulated spectra generated by the CSST emulator for slitless spectroscopy. The outcomes demonstrate a remarkable redshift completeness exceeding 95 per cent for emission line galaxies (ELGs), alongside a purity surpassing 85 per cent. The redshift uncertainty remains impressively below than $\sim 0.001$. Notably, when concentrating on galaxies with more than three matched emission lines, the completeness of ELGs and the purity of measurable galaxies can reach 98 per cent and 97 per cent, respectively. Furthermore, we explore the influence of parameters like magnitude, spectral signal-to-noise ratio, and redshift on redshift completeness and purity. The discussion also delves into redshift degeneracies stemming from emission-line matching confusion. Our developed redshift measurement process will be applied to extensive simulated datasets and forthcoming CSST slitless spectroscopic observations for further cosmological and extragalactic analyses.

astro-ph.CO↗

Two Stage Segmentation of Cervical Tumors using PocketNet

Cervical cancer remains the fourth most common malignancy amongst women worldwide.1 Concurrent chemoradiotherapy (CRT) serves as the mainstay definitive treatment regimen for locally advanced cervical cancers and includes external beam radiation followed by brachytherapy.2 Integral to radiotherapy treatment planning is the routine contouring of both the target tumor at the level of the cervix, associated gynecologic anatomy and the adjacent organs at risk (OARs). However, manual contouring of these structures is both time and labor intensive and associated with known interobserver variability that can impact treatment outcomes. While multiple tools have been developed to automatically segment OARs and the high-risk clinical tumor volume (HR-CTV) using computed tomography (CT) images,3,4,5,6 the development of deep learning-based tumor segmentation tools using routine T2-weighted (T2w) magnetic resonance imaging (MRI) addresses an unmet clinical need to improve the routine contouring of both anatomical structures and cervical cancers, thereby increasing quality and consistency of radiotherapy planning. This work applied a novel deep-learning model (PocketNet) to segment the cervix, vagina, uterus, and tumor(s) on T2w MRI. The performance of the PocketNet architecture was evaluated, when trained on data via five-fold cross validation. PocketNet achieved a mean Dice-Sorensen similarity coefficient (DSC) exceeding 70% for tumor segmentation and 80% for organ segmentation. Validation on a publicly available dataset from The Cancer Imaging Archive (TCIA) demonstrated the models robustness, achieving DSC scores of 67.3% for tumor segmentation and 80.8% for organ segmentation. These results suggest that PocketNet is robust to variations in contrast protocols, providing reliable segmentation of the regions of interest.

cs.CV↗

Efficient and Safe Trajectory Planning for Autonomous Agricultural Vehicle Headland Turning in Cluttered Orchard Environments

Autonomous agricultural vehicles (AAVs), including field robots and autonomous tractors, are becoming essential in modern farming by improving efficiency and reducing labor costs. A critical task in AAV operations is headland turning between crop rows. This task is challenging in orchards with limited headland space, irregular boundaries, operational constraints, and static obstacles. While traditional trajectory planning methods work well in arable farming, they often fail in cluttered orchard environments. This letter presents a novel trajectory planner that enhances the safety and efficiency of AAV headland maneuvers, leveraging advancements in autonomous driving. Our approach includes an efficient front-end algorithm and a high-performance back-end optimization. Applied to vehicles with various implements, it outperforms state-of-the-art methods in both standard and challenging orchard fields. This work bridges agricultural and autonomous driving technologies, facilitating a broader adoption of AAVs in complex orchards.

cs.RO↗

Separation Assurance in Urban Air Mobility Systems using Shared Scheduling Protocols

Ensuring safe separation between aircraft is a critical challenge in air traffic management, particularly in urban air mobility (UAM) environments where high traffic density and low altitudes require precise control. In these environments, conflicts often arise at the intersections of flight corridors, posing significant risks. We propose a tactical separation approach leveraging shared scheduling protocols, originally designed for Ethernet networks and operating systems, to coordinate access to these intersections. Using a decentralized Markov decision process framework, the proposed approach enables aircraft to autonomously adjust their speed and timing as they navigate these critical areas, maintaining safe separation without a central controller. We evaluate the effectiveness of this approach in simulated UAM scenarios, demonstrating its ability to reduce separation violations to zero while acknowledging trade-offs in flight times as traffic density increases. Additionally, we explore the impact of non-compliant aircraft, showing that while shared scheduling protocols can no longer guarantee safe separation, they still provide significant improvements over systems without scheduling protocols.

cs.MA↗

SMTL: A Stratified Logic for Expressive Multi-Level Temporal Specifications

We present Stratified Metric Temporal Logic (SMTL), a novel formalism for specifying and verifying properties of complex cyber-physical systems that exhibit behaviors across multiple temporal and abstraction scales. SMTL extends existing temporal logics by incorporating a stratification operator, enabling the association of temporal properties with specific abstraction levels. This allows for the natural expression of multi-scale requirements while maintaining formal reasoning about inter-level relationships. We formalize the syntax and semantics of SMTL, proving that it strictly subsumes metric temporal logic (MTL) and offers enhanced expressiveness by capturing properties unattainable in existing logics. Numerical simulations comparing agents operating under MTL and SMTL specifications show that SMTL enhances agent coordination and safety, reducing collision rates without substantial computational overhead or compromising path efficiency. These findings underscore SMTL's potential as a valuable tool for designing and verifying complex multi-agent systems operating across diverse temporal and abstraction scales.

eess.SY↗