arXiv subjects

Rui Ge

Publications and source records attributed to Rui Ge.

At least 19 recordsLinked to original sources

arXiv2026

Internalizing Agency from Reflective Experience

Large language models are increasingly deployed as autonomous agents that must plan, act, and recover from mistakes through long-horizon interaction with environments that provide rich feedback. However, prevailing outcome-driven post-training methods (e.g., RL with verifiable rewards) primarily optimize final success signals, leaving rich environment feedback underutilized. Consequently, they often lead to distribution sharpening: the policy becomes better at reproducing a narrow set of already-successful behaviors, while failing to improve the feedback-grounded agency needed to expand problem-solving capacity (e.g., Pass@k) in long-horizon settings. To address this, we propose LEAFE (Learning Feedback-Grounded Agency from Reflective Experience), a framework that internalizes recovery agency from reflective experience. Specifically, during exploration, the agent summarizes environment feedback into actionable experience, backtracks to earlier decision points, and explores alternative branches with revised actions. We then distill these experience-guided corrections into the model through supervised fine-tuning, enabling the policy to recover more effectively in future interactions. Across a diverse set of interactive coding and agentic tasks under fixed interaction budgets, LEAFE consistently improves Pass@1 over the base model and achieves higher Pass@k than outcome-driven baselines (GRPO) and experience-based methods such as Early Experience, with gains of up to 14% on Pass@128.

cs.AI↗

arXiv2025

SUPERChem: A Multimodal Reasoning Benchmark in Chemistry

Current benchmarks for evaluating the chemical reasoning capabilities of Large Language Models (LLMs) are limited by oversimplified tasks, lack of process-level evaluation, and misalignment with expert-level chemistry skills. To address these issues, we introduce SUPERChem, a benchmark of 500 expert-curated reasoning-intensive chemistry problems, covering diverse subfields and provided in both multimodal and text-only formats. Original content and an iterative curation pipeline eliminate flawed items and mitigate data contamination. Each problem is paired with an expert-authored solution path, enabling Reasoning Path Fidelity (RPF) scoring to evaluate reasoning quality beyond final-answer accuracy. Evaluations against a human baseline of 40.3% accuracy show that even the best-performing model, GPT-5 (High), reaches only 38.5%, followed closely by Gemini 2.5 Pro (37.9%) and DeepSeek-V3.1-Think (37.3%). SUPERChem elicits multi-step, multimodal reasoning, reveals model-dependent effects of visual information, and distinguishes high-fidelity reasoners from heuristic ones. By providing a challenging benchmark and a reliable evaluation framework, SUPERChem aims to facilitate the advancement of LLMs toward expert-level chemical intelligence. The dataset of the benchmark is available at https://huggingface.co/datasets/ZehuaZhao/SUPERChem.

cs.CL↗

arXiv2025

The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution

Real-world language agents must handle complex, multi-step workflows across diverse Apps. For instance, an agent may manage emails by coordinating with calendars and file systems, or monitor a production database to detect anomalies and generate reports following an operating manual. However, existing language agent benchmarks often focus on narrow domains or simplified tasks that lack the diversity, realism, and long-horizon complexity required to evaluate agents' real-world performance. To address this gap, we introduce the Tool Decathlon (dubbed as Toolathlon), a benchmark for language agents offering diverse Apps and tools, realistic environment setup, and reliable execution-based evaluation. Toolathlon spans 32 software applications and 604 tools, ranging from everyday platforms such as Google Calendar and Notion to professional ones like WooCommerce, Kubernetes, and BigQuery. Most of the tools are based on a high-quality set of Model Context Protocol (MCP) servers that we may have revised or implemented ourselves. Unlike prior works, which primarily ensure functional realism but offer limited environment state diversity, we provide realistic initial environment states from real software, such as Canvas courses with dozens of students or real financial spreadsheets. This benchmark includes 108 manually sourced or crafted tasks in total, requiring interacting with multiple Apps over around 20 turns on average to complete. Each task is strictly verifiable through dedicated evaluation scripts. Comprehensive evaluation of SOTA models highlights their significant shortcomings: the best-performing model, Claude-4.5-Sonnet, achieves only a 38.6% success rate with 20.2 tool calling turns on average, while the top open-weights model DeepSeek-V3.2-Exp reaches 20.1%. We expect Toolathlon to drive the development of more capable language agents for real-world, long-horizon task execution.

cs.CL↗

arXiv2025

Scaling Speculative Decoding with Lookahead Reasoning

Reasoning models excel by generating long chain-of-thoughts, but decoding the resulting thousands of tokens is slow. Token-level speculative decoding (SD) helps, but its benefit is capped, because the chance that an entire $\gamma$-token guess is correct falls exponentially as $\gamma$ grows. This means allocating more compute for longer token drafts faces an algorithmic ceiling -- making the speedup modest and hardware-agnostic. We raise this ceiling with Lookahead Reasoning, which exploits a second, step-level layer of parallelism. Our key insight is that reasoning models generate step-by-step, and each step needs only to be semantically correct, not exact token matching. In Lookahead Reasoning, a lightweight draft model proposes several future steps; the target model expands each proposal in one batched pass, and a verifier keeps semantically correct steps while letting the target regenerate any that fail. Token-level SD still operates within each reasoning step, so the two layers of parallelism multiply. We show Lookahead Reasoning lifts the peak speedup of SD both theoretically and empirically. Across GSM8K, AIME, and other benchmarks, Lookahead Reasoning improves the speedup of SD from 1.4x to 2.1x while preserving answer quality, and its speedup scales better with additional GPU throughput. Our code is available at https://github.com/hao-ai-lab/LookaheadReasoning

cs.LG↗

arXiv2025

MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems

LLM-based multi-agent systems (MAS) have shown significant potential in tackling diverse tasks. However, to design effective MAS, existing approaches heavily rely on manual configurations or multiple calls of advanced LLMs, resulting in inadaptability and high inference costs. In this paper, we simplify the process of building an MAS by reframing it as a generative language task, where the input is a user query and the output is a corresponding MAS. To address this novel task, we unify the representation of MAS as executable code and propose a consistency-oriented data construction pipeline to create a high-quality dataset comprising coherent and consistent query-MAS pairs. Using this dataset, we train MAS-GPT, an open-source medium-sized LLM that is capable of generating query-adaptive MAS within a single LLM inference. The generated MAS can be seamlessly applied to process user queries and deliver high-quality responses. Extensive experiments on 9 benchmarks and 5 LLMs show that the proposed MAS-GPT consistently outperforms 10+ baseline MAS methods on diverse settings, indicating MAS-GPT's high effectiveness, efficiency and strong generalization ability. Code will be available at https://github.com/rui-ye/MAS-GPT.

cs.CL↗

arXiv2024

Leveraging Unstructured Text Data for Federated Instruction Tuning of Large Language Models

Federated instruction tuning enables multiple clients to collaboratively fine-tune a shared large language model (LLM) that can follow humans' instructions without directly sharing raw data. However, existing literature impractically requires that all the clients readily hold instruction-tuning data (i.e., structured instruction-response pairs), which necessitates massive human annotations since clients' data is usually unstructured text instead. Addressing this, we propose a novel and flexible framework FedIT-U2S, which can automatically transform unstructured corpus into structured data for federated instruction tuning. FedIT-U2S consists two key steps: (1) few-shot instruction-tuning data generation, where each unstructured data piece together with several examples is combined to prompt an LLM in generating an instruction-response pair. To further enhance the flexibility, a retrieval-based example selection technique is proposed, where the examples are automatically selected based on the relatedness between the client's data piece and example pool, bypassing the need of determining examples in advance. (2) A typical federated instruction tuning process based on the generated data. Overall, FedIT-U2S can be applied to diverse scenarios as long as the client holds valuable text corpus, broadening the application scope of federated instruction tuning. We conduct a series of experiments on three domains (medicine, knowledge, and math), showing that our proposed FedIT-U2S can consistently and significantly brings improvement over the base LLM.

cs.CL↗

arXiv2024

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

Federated learning has enabled multiple parties to collaboratively train large language models without directly sharing their data (FedLLM). Following this training paradigm, the community has put massive efforts from diverse aspects including framework, performance, and privacy. However, an unpleasant fact is that there are currently no realistic datasets and benchmarks for FedLLM and previous works all rely on artificially constructed datasets, failing to capture properties in real-world scenarios. Addressing this, we propose FedLLM-Bench, which involves 8 training methods, 4 training datasets, and 6 evaluation metrics, to offer a comprehensive testbed for the FedLLM community. FedLLM-Bench encompasses three datasets (e.g., user-annotated multilingual dataset) for federated instruction tuning and one dataset (e.g., user-annotated preference dataset) for federated preference alignment, whose scale of client number ranges from 38 to 747. Our datasets incorporate several representative diversities: language, quality, quantity, instruction, length, embedding, and preference, capturing properties in real-world scenarios. Based on FedLLM-Bench, we conduct experiments on all datasets to benchmark existing FL methods and provide empirical insights (e.g., multilingual collaboration). We believe that our FedLLM-Bench can benefit the FedLLM community by reducing required efforts, providing a practical testbed, and promoting fair comparisons. Code and datasets are available at https://github.com/rui-ye/FedLLM-Bench.

cs.CL↗

arXiv2024

A Formal Model to Prove Instantiation Termination for E-matching-Based Axiomatisations (Extended Version)

SMT-based program analysis and verification often involve reasoning about program features that have been specified using quantifiers; incorporating quantifiers into SMT-based reasoning is, however, known to be challenging. If quantifier instantiation is not carefully controlled, then runtime and outcomes can be brittle and hard to predict. In particular, uncontrolled quantifier instantiation can lead to unexpected incompleteness and even non-termination. E-matching is the most widely-used approach for controlling quantifier instantiation, but when axiomatisations are complex, even experts cannot tell if their use of E-matching guarantees completeness or termination. This paper presents a new formal model that facilitates the proof, once and for all, that giving a complex E-matching-based axiomatisation to an SMT solver, such as Z3 or cvc5, will not cause non-termination. Key to our technique is an operational semantics for solver behaviour that models how the E-matching rules common to most solvers are used to determine when quantifier instantiations are enabled, but abstracts over irrelevant details of individual solvers. We demonstrate the effectiveness of our technique by presenting a termination proof for a set theory axiomatisation adapted from those used in the Dafny and Viper verifiers.

cs.LO↗

arXiv2023

On-chip Lithium Niobate Heterogeneous Photonic Crystal Nanocavity Laser

Thin film lithium niobate (TFLN) has become an platform for modern integrated circuits due to its excellent optical properties. With the development of rare earth ion doped TFLN, important breakthroughs of on-chip microlasers has emerged and show significant application for optical communication, computing and quantum photonics. However, challenges still remain in developing compact lasers with small mode volumes and low threshold on rare earth ion doped TFLN for highly efficient dense integration. In this letter, we fabricated a heterogeneous photonic crystal (PhC) nanobeam cavity on erbium-doped TFLN with a quality factor of 1.2\times10^4 and firstly demonstrated a single-mode integrated PhC laser with submicron mode volume on TFLN platform. Laser at 1559.63 nm is achieved with the 974 nm single-mode pump. The effective mode volume is 1.44 ({\lambda}/n)^3 (~ 0.645 {\mu}m^3) and the threshold power is 163 {\mu}W. Enhanced photorefractive effect in the PhC cavity is measured. This lithium niobate photonic crystal nanocavity laser, as a compact telecommunication C-band on-chip light source, would benefit the progress of high-speed and low-cost optical community on TFLN integrated photonics.

physics.optics↗

arXiv2023

High Q and high gradient performance of the first medium-temperature baking 1.3 GHz cryomodule

World's first 1.3 GHz cryomodule containing eight 9-cell superconducting radio-frequency (RF) cavities treated by medium-temperature furnace baking (mid-T bake) was developed, assembled and tested at IHEP for the Dalian Advanced Light Source (DALS) and CEPC R&D. The 9-cell cavities in the cryomodule achieved an unprecedented highest average Q0 of 3.8E10 at 16 MV/m and 3.6E10 at 21 MV/m in the horizontal test. The cryomodule can operate stably up to a total CW RF voltage greater than 191 MV, with an average cavity CW accelerating gradient of more than 23 MV/m. The results significantly exceed the specifications of CEPC, DALS and the other high repetition rate free electron laser facilities (LCLS-II, LCLS-II-HE, SHINE, S3FEL). There is evidence that the mid-T bake cavity may not require fast cool-down or long processing time in the cryomodule. This paper reviews the cryomodule performance and discusses some important issues in cryomodule assembly and testing.

physics.acc-ph↗

arXiv2022

Simultaneous $ \chi^{(2)} $- $ \chi^{(2)} $ and $ \chi^{(2)} $-$ \chi^{(3)} $ nonlinear processes generation in thin film lithium tantalate microcavity

On-chip efficient nonlinear functions are instrumental in escalating the utilities and performance of photonic integrated circuits (PICs), especially for a wide range of classical and quantum applications, such as tunable coherent radiation, optical frequency conversion, spectroscopy, quantum science, etc. Lithium tantalate (LT) has been widely used in nonlinear wavelength converters, surface acoustic wave resonators, and electro-optic, acoustic-optic devices owing to its excellent optical properties. Here, we fabricated a Z-cut lithium tantalate on insulator (LTOI) microdisk with high quality(Q) factors in both telecom (10$^{6}$) and visible (10$^{5}$) bands by optimizing the fabrication. With the Q factor of the LTOI microdisk increasing, we can obtain higher pump light intensity in the cavity which is beneficial to get more optical nonlinear effect easily. By making use of the mode phase matching of interacting waves and inputting high pump power, we experimentally observed on-chip near-infrared light, visible (red, green), and ultraviolet (UV) from microresonator-based $ \chi^{(2)}-\chi^{(2)}$, $ \chi^{(2)}-\chi^{(3)}$, and $\chi^{(2)}$ nonlinear processes such as cascaded four-wave mixing (cFWM), cascaded sum-frequency generation (cSFG), third harmonic generation (THG), second harmonic generation (SHG). It is believed that the LTOI can support a variety of on-chip optical nonlinear processes, which heralds its new application potential in integrated nonlinear photonics.

physics.optics↗

arXiv2022

Doubly resonant photonic crystal cavity using merged bound states in the continuum

In this work, a doubly resonant photonic crystal (PhC) cavity using the merged bound states in the continuum (BICs) is proposed to obtain a higher second harmonic generation (SHG) efficiency. Firstly by scanning geometry parameters the accidental BICs and a band-edge mode outside the light cone can be obtained. Then as the lattice constant or the thickness of the slab is adjusted the accidental BICs will merge. A supercell with large and small holes is constructed and the band-edge mode outside the light cone can be mode-matched with the merged BICs mode. Finally the heterostructure PhC cavity is designed. The merged BICs show a high quality factor for the photonic crystal with finite size. Consequently, the SHG efficiency of the lattice constant near merged BICs of ~6000% W-1 is higher than the one of the isolated BIC.

physics.optics↗

arXiv2022

Large Quality Factor Enhancement Based on Cascaded Uniform Lithium Niobate Bichromatic Photonic Crystal Cavities

In this paper, by cascading several bichromatic photonic crystals we demonstrate that the quality factor can be much larger compared with that in an isolated cavity without increasing the total size of the device. We take lithium niobate photonic crystal as an example to illustrate that the simulated quality factor of the cascaded cavity can attain 10^5 with a 70{\deg} slant angle, which is an order of magnitude larger than that in isolated cavity. The device can be fabricated easily by current etching technique for lithium niobate. We have fabricated the proposed device experimentally including holes with 70{\deg} slant angle. This work is expected to provide guidance to the design of photonic crystal cavity with high-quality factor.

physics.optics↗

arXiv2021

Chip-scale Spontaneous Quasi-Phase-Matched Micro-Racetrack Resonator

Due to their capacity for non-classical light generation, high-efficiency second-order nonlinear parametric processes play an important role in quantum photonic technology, and chip-scale realization of these processes is recognized as the key to building efficient light sources for integrated quantum photonic circuits. To achieve ultra-high nonlinear conversion efficiency, traditional method uses quasi-phase matching (QPM) technology. However, QPM requires electric field poling, which is incompatible with the CMOS fabrication process, and this hinders the wafer-scale production of integrated photonic circuits. In this paper, we demonstrate efficient spontaneous quasi-phase matched (SQPM) frequency conversion in a micro-racetrack resonator. Our approach does not involve poling, but exploits the anisotropy of the ferroelectric crystals to allow the phase-matching condition to be fulfilled spontaneously as the TE-polarized light circulates in a specifically designed racetrack resonator. SQPM second harmonic generation is observed with a normalized intracavity conversion efficiency of 0.85%/W, corresponding to the 111st-order QPM. This could theoretically reach 186,000%/W by first-order QPM. In this case such high intracavity conversion efficiency can be implemented in practice with an optimized outward coupling. Our configurable SQPM approach will benefit the application of nonlinear frequency conversion in chip-scale integrated photonics with CMOS-compatible fabrication processes, and is applicable to other on-chip nonlinear processes such as quantum frequency conversion or frequency-comb generation.

physics.optics↗

arXiv2020

Coupled cavity-waveguide system based on topological corner state and edge state

Topological corner state (TCS) and topological edge state (TES) have provided new approaches to control the propagation of light. The construction of topological coupled cavity-waveguide system (TCCWS) based on TCS and TES is worth looking forward to, due to its research prospects in realizing high-performance micro-nano integrated photonic devices. In this Letter, TCCWS is proposed in two-dimensional (2D) photonic crystal (PC), which possesses strong optical localization, high quality factor and excellent robustness compared with the conventional coupled cavity-waveguide system (CCCWS). This work will provide the possibility to design high-performance logic gates, lasers, filters and other micro-nano integrated photonics devices and expand their applications.

physics.optics↗

arXiv2020

Medium-temperature furnace bake of Superconducting Radio-Frequency cavities at IHEP

Recently, heat treatment between 250 C and 500 C has been attempted to improve quality factor of superconducting radio-frequency cavities at FNAL and KEK. Experiments of such medium temperature (mid-T) bake with furnaces have also been carried out at IHEP. Firstly, eleven 1.3 GHz 1-cell cavities were treated with different temperatures at a small furnace. The average quality factor has reached 3.6E10 when the gradient is 16 MV/m. Then, the recipe of mid-T furnace bake at 300 C for 3 hours has been applied to six 1.3 GHz 9-cell cavities at a new big furnace. The average quality factor has reached 3.8E10 when the gradient is 16 MV/m.

physics.acc-ph↗

arXiv2020

Mid-infrared single photon detector with superconductor Mo$_{80}$Si$_{20}$ nanowire

A mid-infrared single photon detector (MIR-SNSPD) was reported based on 30 nm-wide superconductor molybdenum silicide nanowires in this work. Saturated quantum efficiencies (QEs) were achieved at the wavelength ranging from 1.55 to 5.07 micrometer in experiments. At the same time, the intrinsic dark count rate (DCR) was below 100 cps. Thus, this device produced a noise equivalent power (NEP) of 4.5 * 10-19 W/sqrt(Hz). The results provide the foundation of developing 10 micrometer-SNSPD for the applications of infrared astronomy observation.

physics.app-ph↗

arXiv2020

High-Order Nonreciprocal Add-Drop Filter

Topological photonics have led to the robust optical behavior of the device, which has solved the problem of the influence of manufacturing defects and perturbations on the device performance. Meanwhile, temporal coupled-mode theory (t-CMT) has been developed and applied widely. However, the t-CMT of cascaded coupling cavities (CCC) system and its corresponding high-order filter has yet to be established. Here the t-CMT of CCC system is established based on the existing t-CMT. By combining the CCC with the topological waveguides, a versatile design scheme of the high-order nonreciprocal add-drop filter (HONAF) is proposed. The relationship between coupling effect of cavities and transmission and filtering performance of HONAF is analyzed quantitatively, then a method to improve the transmission efficiency and quality factor of the filter is given. Based on the combination of gyromagnetic photonic crystals and decagonal Penrose-type photonic quasicrystals, a HONAF is proposed. The transmission and filtering performance of the HONAF are numerically analyzed, which verifies the consistency between the theoretical prediction and the numerical simulation. The t-CMT of CCC system established can be widely used in the coupled resonator optical waveguides and their related systems. The designed HONAF can also be applied and compatible to microwave communication system.

physics.optics↗