arXiv subjects

Jun Gao

Publications and source records attributed to Jun Gao.

At least 109 records · Page 6Linked to original sources

arXiv2025

\texttt{ReMind}: Understanding Deductive Code Reasoning in LLMs

Large Language Models (LLMs) have achieved remarkable progress in code-related tasks. Despite their advancement, empirical evidence reveals that they still struggle with \emph{deductive code reasoning}, the ability to reason about the program execution process. While prior studies have recognized this limitation, the underlying causes remain largely underexplored. In this paper, we begin by presenting a comprehensive empirical study that reveals three key challenges undermining deductive code reasoning: (1) an intrinsic gap between generation and reasoning abilities, (2) a consistent bias towards code sources, and (3) weak zero-shot generalization on complex benchmarks. In light of these challenges, we propose \texttt{ReMind}, a multi-agent framework composed of \texttt{Mutator}, \texttt{Executor}, and \texttt{Inspector}. The \texttt{Mutator} generates code variants to mitigate bias towards code sources, the \texttt{Executor} traces variable states step-by-step to expose inconsistency, and the \texttt{Inspector} identifies problematic reasoning steps and provides control-flow refinement to bridge the intrinsic reasoning gap. Through their coordinated collaboration, \texttt{ReMind} systematically identifies and refines reasoning flaws, achieving outstanding performance and enabling robust zero-shot generalization. Extensive experiments on two benchmarks with five LLMs demonstrate the superior advantages of \texttt{ReMind} compared to baseline approaches in deductive code reasoning.

cs.PL↗

arXiv2025

On cliques in hypergraphs

We prove that for any $k \ge 3$, every $k$-uniform hypergraph on $n$ vertices contains at most $n - ω(1)$ different sizes of cliques (maximal complete subgraphs). In particular, the 3-uniform case answers a question of Erdős.

math.CO↗

arXiv2025

NNLO QCD calculation of hadron multiplicities in light-quark jets at lepton colliders

We present the calculation of next-to-next-to-leading-order (NNLO) QCD corrections to hadron multiplicities in light-quark jets at lepton colliders, employing the ``projection-to-Born" (P2B) method implemented in the FMNLO program. Taking the next-to-leading-order result as an example, we rigorously establish the validity of our P2B-based calculation. We then present NNLO predictions for the normalized asymmetry $D_{K^{-}}$ between hadron and antihadron production in light-quark jets and compare them with SLD data. We find that a suppression of these SLD measurements relative to NPC23 predictions for $D_{K^{-}}$ emerges in the intermediate $z_h$ domain ($0.2 \lesssim z_h \lesssim 0.7$). We expect that incorporating these SLD data into global QCD fits will enable improved determination of fragmentation functions.

hep-ph↗

arXiv2025

SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversations

As large language models (LLMs) develop anthropomorphic abilities, they are increasingly being deployed as autonomous agents to interact with humans. However, evaluating their performance in realistic and complex social interactions remains a significant challenge. Most previous research built datasets through simulated agent-to-agent interactions, which fails to capture the authentic linguistic styles and relational dynamics found in real human conversations. To address this gap, we introduce SI-Bench, a novel benchmark designed to evaluate aspects of social intelligence in LLMs. Grounded in broad social science theories, SI-Bench contains 2,221 authentic multi-turn dialogues collected from a social networking application. We further selected a subset of 312 dialogues for manual annotation across 8 major models. The experiments show that SOTA models have surpassed the human expert in process reasoning under complex social situations, yet they still fall behind humans in reply quality. Moreover, introducing Chain-of-Thought (CoT) reasoning may degrade the performance of LLMs in social dialogue tasks. All datasets are openly available at https://github.com/SI-Bench/SI-Bench.git.

cs.CL↗

arXiv2025

Emulation of Coherent Absorption of Quantum Light in a Programmable Linear Photonic Circuit

Non-Hermitian quantum systems, governed by nonunitary evolution, offer powerful tools for manipulating quantum states through engineered loss. A prime example is coherent absorption, where quantum states undergo phase-dependent partial or complete absorption in a lossy medium. Here, we demonstrate a fully programmable implementation of nonunitary transformations that emulate coherent absorption of quantum light using a programmable integrated linear photonic circuit, with loss introduced via coupling to an ancilla mode [Phys. Rev. X 8, 021017; 2018]. Probing the circuit with a single-photon dual-rail state reveals phase-controlled coherent tunability between perfect transmission and perfect absorption. A two-photon NOON state input, by contrast, exhibits switching between deterministic single-photon and probabilistic two-photon absorption. Across a range of input phases and circuit configurations, we observe nonclassical effects such as anti-coalescence and bunching, along with continuous and coherent tuning of output Fock state probability amplitudes. Classical Fisher information analysis reveals phase sensitivity peaks of 1 for single-photon states and 3.4 for NOON states, the latter exceeding the shot-noise limit of 2 and approaching the Heisenberg limit of 4 for two-photon states. The experiment integrates quantum state generation, programmable photonic circuitry, and photon-number-resolving detection, establishing ancilla-assisted circuits as powerful tools for programmable quantum state engineering, filtering, multiplexed sensing, and nonunitary quantum simulation.

quant-ph↗

arXiv2025

ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation

Recent advances in large generative models have greatly enhanced both image editing and in-context image generation, yet a critical gap remains in ensuring physical consistency, where edited objects must remain coherent. This capability is especially vital for world simulation related tasks. In this paper, we present ChronoEdit, a framework that reframes image editing as a video generation problem. First, ChronoEdit treats the input and edited images as the first and last frames of a video, allowing it to leverage large pretrained video generative models that capture not only object appearance but also the implicit physics of motion and interaction through learned temporal consistency. Second, ChronoEdit introduces a temporal reasoning stage that explicitly performs editing at inference time. Under this setting, target frame is jointly denoised with reasoning tokens to imagine a plausible editing trajectory that constrains the solution space to physically viable transformations. The reasoning tokens are then dropped after a few steps to avoid the high computational cost of rendering a full video. To validate ChronoEdit, we introduce PBench-Edit, a new benchmark of image-prompt pairs for contexts that require physical consistency, and demonstrate that ChronoEdit surpasses state-of-the-art baselines in both visual fidelity and physical plausibility. Project page for code and models: https://research.nvidia.com/labs/toronto-ai/chronoedit

cs.CV↗

arXiv2025

Global analysis of fragmentation functions to light neutral hadrons

Fragmentation functions (FFs) are crucial non-perturbative components in quantum chromodynamics (QCD), playing a vital role in predictions and understanding of the hadronization process. In this paper, we present the FFs for $K_S^0$, $η$, $π^0$ mesons, and $Λ$ baryons in the context of global QCD analysis. The data included in the fit are from single inclusive $e^+ e^-$ annihilation (SIA), semi-inclusive deep-inelastic scattering (SIDIS) and proton-proton collisions, with kinematic cuts carefully applied to ensure validity of collinear factorization and perturbative QCD expansion. For the first time, data from SIDIS and hadron-in-jet production in SIA have been incorporated into the extraction of FFs for light-flavor neutral hadrons. Our analysis reveals that these data play a critical role in constraining the gluon distribution, and in distinguishing between different quark flavors. Pulls from different datasets are also studied by performing alternative fits with systematically subtracting groups of data from the nominal fit. For the quality of the fit, good $χ^2$ values are achieved for most of the datasets, and FFs are generally well constrained within the momentum fraction region $\pqty{0.1, 0.5}$. The extracted $K_S^0$ fragmentation functions, together with the $K_S^0$ FFs constructed from $K^{\pm}$ FFs via isospin symmetry, are used to test isospin symmetry in kaon fragmentation. Although a definitive conclusion cannot be reached yet, these studies have identified several potential measurements that can be performed at existing facilities, which may ultimately help us to arrive at a conclusive answer. With the comprehensive species of FFs extracted within the NPC framework, we are able to perform a test on the momentum sum rule with the light-flavor charged and neutral hadrons.

hep-ph↗

arXiv2025

SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understanding

Paralinguistic sounds, like laughter and sighs, are crucial for synthesizing more realistic and engaging speech. However, existing methods typically depend on proprietary datasets, while publicly available resources often suffer from incomplete speech, inaccurate or missing timestamps, and limited real-world relevance. To address these problems, we propose an automated framework for generating large-scale paralinguistic data and apply it to construct the SynParaSpeech dataset. The dataset comprises 6 paralinguistic categories with 118.75 hours of data and precise timestamps, all derived from natural conversational speech. Our contributions lie in introducing the first automated method for constructing large-scale paralinguistic datasets and releasing the SynParaSpeech corpus, which advances speech generation through more natural paralinguistic synthesis and enhances speech understanding by improving paralinguistic event detection. The dataset and audio samples are available at https://github.com/ShawnPi233/SynParaSpeech.

eess.AS↗

arXiv2025

Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation

The ability to generate virtual environments is crucial for applications ranging from gaming to physical AI domains such as robotics, autonomous driving, and industrial AI. Current learning-based 3D reconstruction methods rely on the availability of captured real-world multi-view data, which is not always readily available. Recent advancements in video diffusion models have shown remarkable imagination capabilities, yet their 2D nature limits the applications to simulation where a robot needs to navigate and interact with the environment. In this paper, we propose a self-distillation framework that aims to distill the implicit 3D knowledge in the video diffusion models into an explicit 3D Gaussian Splatting (3DGS) representation, eliminating the need for multi-view training data. Specifically, we augment the typical RGB decoder with a 3DGS decoder, which is supervised by the output of the RGB decoder. In this approach, the 3DGS decoder can be purely trained with synthetic data generated by video diffusion models. At inference time, our model can synthesize 3D scenes from either a text prompt or a single image for real-time rendering. Our framework further extends to dynamic 3D scene generation from a monocular input video. Experimental results show that our framework achieves state-of-the-art performance in static and dynamic 3D scene generation.

cs.CV↗

arXiv2025

TeraSim-World: Worldwide Safety-Critical Data Synthesis for End-to-End Autonomous Driving

Safe and scalable deployment of end-to-end (E2E) autonomous driving requires extensive and diverse data, particularly safety-critical events. Existing data are mostly generated from simulators with a significant sim-to-real gap or collected from on-road testing that is costly and unsafe. This paper presents TeraSim-World, an automated pipeline that synthesizes realistic and geographically diverse safety-critical data for E2E autonomous driving at anywhere in the world. Starting from an arbitrary location, TeraSim-World retrieves real-world maps and traffic demand from geospatial data sources. Then, it simulates agent behaviors from naturalistic driving datasets, and orchestrates diverse adversities to create corner cases. Informed by street views of the same location, it achieves photorealistic, geographically grounded sensor rendering via the frontier video generation model Cosmos-Drive. By bridging agent and sensor simulations, TeraSim-World provides a scalable and critical data synthesis framework for training and evaluation of E2E autonomous driving systems. Codes and videos are available at https://wjiawei.com/terasim-world-web/ .

cs.RO↗

arXiv2025

Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations

Large Vision-Language Models (LVLMs) suffer from serious hallucination problems, where the model-generated responses are inconsistent with the visual inputs. Existing hallucination mitigation methods are mainly based on preference alignment and require external human annotations or auxiliary models for preference data collection, which increase costs and limit sustainable improvement. To tackle these challenges, we propose Autonomous Preference Alignment via Self-Injection (APASI), a novel and generalizable method that mitigates hallucinations without external dependencies. APASI leverages the target LVLM to self-inject hallucinations into a generated response, creating a pair of responses with varying preference levels. During the self-injection process, the dis-preferred response is generated based on three key observations of hallucinations, ensuring it simulates real hallucination patterns. This fidelity offers an accurate learning signal for hallucination mitigation. Moreover, APASI incorporates an iterative alignment training strategy combined with curriculum learning to periodically update the preference data with increasing challenge, enabling stable and continuous enhancement of the LVLM. Extensive experiments across six benchmarks show that APASI not only effectively mitigates hallucinations for three baseline models but also achieves comparable or even superior performance to alignment-based methods with external dependency, thereby demonstrating its effectiveness and generalization capability. The code is available at https://github.com/davidluciolu/APASI.

cs.CV↗

arXiv2025

FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domain

Retrieval-Augmented Generation (RAG) plays a vital role in the financial domain, powering applications such as real-time market analysis, trend forecasting, and interest rate computation. However, most existing RAG research in finance focuses predominantly on textual data, overlooking the rich visual content in financial documents, resulting in the loss of key analytical insights. To bridge this gap, we present FinRAGBench-V, a comprehensive visual RAG benchmark tailored for finance which effectively integrates multimodal data and provides visual citation to ensure traceability. It includes a bilingual retrieval corpus with 60,780 Chinese and 51,219 English pages, along with a high-quality, human-annotated question-answering (QA) dataset spanning heterogeneous data types and seven question categories. Moreover, we introduce RGenCite, an RAG baseline that seamlessly integrates visual citation with generation. Furthermore, we propose an automatic citation evaluation method to systematically assess the visual citation capabilities of Multimodal Large Language Models (MLLMs). Extensive experiments on RGenCite underscore the challenging nature of FinRAGBench-V, providing valuable insights for the development of multimodal RAG systems in finance.

cs.CL↗

arXiv2025

Private Queries with Sigma-Counting

Many data applications involve counting queries, where a client specifies a feasible range of variables and a database returns the corresponding item counts. A program that produces the counts of different queries often risks leaking sensitive individual-level information. A popular approach to enhance data privacy is to return a noisy version of the actual count. It is typically achieved by adding independent noise to each query and then control the total privacy budget within a period. This approach may be limited in the number of queries and output accuracy in practice. Also, the returned counts do not maintain the total order for nested queries, an important feature in many applications. This work presents the design and analysis of a new method, sigma-counting, that addresses these challenges. Sigma-counting uses the notion of sigma-algebra to construct privacy-preserving counting queries. We show that the proposed concepts and methods can significantly improve output accuracy while maintaining a desired privacy level in the presence of massive queries to the same data. We also discuss how the technique can be applied to address large and time-varying datasets.

cs.DB↗

arXiv2025

ProtTeX-CC: Activating In-Context Learning in Protein LLM via Two-Stage Instruction Compression

Recent advances in protein large language models, such as ProtTeX, represent both side-chain amino acids and backbone structure as discrete token sequences of residue length. While this design enables unified modeling of multimodal protein information, it suffers from two major limitations: (1) The concatenation of sequence and structure tokens approximately doubles the protein length and breaks the intrinsic residue-level alignment between modalities. (2) Constrained by the training corpus and limited context window, ProtTeX is typically trained on single-protein inputs, rendering it incompatible with in-context learning (ICL) and thus limiting its generalization capability. To address these issues, we propose ProtTeX-CC, a lightweight two-stage compression framework designed to enhance ProtTeX under few-shot settings. We first design a joint embedding compression mechanism that fuses sequence and structure representations at the residue level, effectively reducing the protein input length by half without sacrificing performance. Then we propose a self-compression module that aggregates each full demonstration into the latent space of the last few linguistic tokens, reducing the average demonstration length from 751 tokens to less than 16 tokens. Compared to the original ProtTeX, our self-compression approach achieves a compression ratio of approximately 93.68% in the total prompt length under the 16-shot setting. Without modifying the backbone model, ProtTeX-CC introduces only a small number of additional parameters through PEFT-based tuning in the joint embedding compression stage and a single trainable projection layer in the self-compression stage. Extensive experiments on protein function prediction show that ProtTeX-CC improves performance on the in-domain benchmark by 2%, and generalizes well to the out-of-domain dataset with a performance gain of 11%.

cs.LG↗

arXiv2025

ViPE: Video Pose Engine for 3D Geometric Perception

Accurate 3D geometric perception is an important prerequisite for a wide range of spatial AI systems. While state-of-the-art methods depend on large-scale training data, acquiring consistent and precise 3D annotations from in-the-wild videos remains a key challenge. In this work, we introduce ViPE, a handy and versatile video processing engine designed to bridge this gap. ViPE efficiently estimates camera intrinsics, camera motion, and dense, near-metric depth maps from unconstrained raw videos. It is robust to diverse scenarios, including dynamic selfie videos, cinematic shots, or dashcams, and supports various camera models such as pinhole, wide-angle, and 360° panoramas. We have benchmarked ViPE on multiple benchmarks. Notably, it outperforms existing uncalibrated pose estimation baselines by 18%/50% on TUM/KITTI sequences, and runs at 3-5FPS on a single GPU for standard input resolutions. We use ViPE to annotate a large-scale collection of videos. This collection includes around 100K real-world internet videos, 1M high-quality AI-generated videos, and 2K panoramic videos, totaling approximately 96M frames -- all annotated with accurate camera poses and dense depth maps. We open-source ViPE and the annotated dataset with the hope of accelerating the development of spatial AI systems.

cs.CV↗

arXiv2025

New upper bound for lattice covering by spheres

We show that there exists a lattice covering of $\mathbb{R}^n$ by Eucledian spheres of equal radius with density $O\big(n \ln^β n \big)$ as $n\to\infty$, where \begin{align*} β:= \frac{1}{2} \log_2 \left(\frac{8 π\mathrm{e}}{3\sqrt 3}\right)=1.85837...\,. \end{align*} This improves upon the previously best known upper bound by Rogers from 1959 of $O\big(n \ln^α n \big)$, where $α:= \frac{1}{2} \log_{2}(2π\mathrm{e})=2.0471...\,.$

math.MG↗

arXiv2025

Fragmentation Functions of Charged Hadrons at Next-to-Next-to-Leading Order and Constraints on the Proton Parton Distribution Functions

We present the first global analysis of fragmentation functions (FFs) for light charged hadrons ($π^{\pm}$, $K^{\pm}$) at full next-to-next-to-leading order in Quantum Chromodynamics (QCD), incorporating world data from both single-inclusive electron-positron annihilation and semi-inclusive deep-inelastic scattering. The collinear factorization has been tested with low-momentum-transfer data and has demonstrated success at high hadron momenta. Additionally, we study the impact of current global data on hadron production to the parton distribution functions (PDFs), and find they favor a reduced asymmetry in the strange (anti-) quark PDFs, as compared to the asymmetry predicted by state-of-the-art PDFs derived from inclusive data.

hep-ph↗

arXiv2025

Heterogeneous integration of silicon nitride and amorphous silicon carbide photonics

Amorphous silicon carbide (a-SiC) has emerged as a compelling candidate for applications in integrated photonics, known for its high refractive index, high optical quality, high thermo-optic coefficient, and strong third-order nonlinearities. Furthermore, a-SiC can be easily deposited via CMOS-compatible chemical vapor deposition (CVD) techniques, allowing for precise thickness control and adjustable material properties on arbitrary substrates. Silicon nitride (SiN) is an industrial well-established and well-matured platform, which exhibits ultra-low propagation loss, but it is suboptimal for high-density reconfigurable photonics due to the large minimum bending radius and constrained tunability. In this work, we monolithically combine a-SiC with SiN photonics, leveraging the merits of both platforms, and achieve the a-SiC/SiN heterogeneous integration with an on-chip interconnection loss of 0.32$\pm$0.10 dB, and integration density increment exceeding 4,444-fold. By implementing active devices on a-SiC, we achieve 27 times higher thermo-optic tuning efficiency, with respect to the SiN photonic platform. In addition, the a-SiC/SiN platform gives the flexibility to choose the optimal fiber-to-chip coupling strategy depending on the interfacing platform, with efficient side-coupling on SiN and grating-coupling on a-SiC platform. The proposed a-SiC/SiN photonic platform can foster versatile applications in programmable and quantum photonics, nonlinear optics, and beyond.

physics.optics↗