arXiv subjects

Yong Liu

Publications and source records attributed to Yong Liu.

At least 307 records · Page 17Linked to original sources

arXiv2025

DynamicControl: Adaptive Condition Selection for Improved Text-to-Image Generation

To enhance the controllability of text-to-image diffusion models, current ControlNet-like models have explored various control signals to dictate image attributes. However, existing methods either handle conditions inefficiently or use a fixed number of conditions, which does not fully address the complexity of multiple conditions and their potential conflicts. This underscores the need for innovative approaches to manage multiple conditions effectively for more reliable and detailed image synthesis. To address this issue, we propose a novel framework, DynamicControl, which supports dynamic combinations of diverse control signals, allowing adaptive selection of different numbers and types of conditions. Our approach begins with a double-cycle controller that generates an initial real score sorting for all input conditions by leveraging pre-trained conditional generation models and discriminative models. This controller evaluates the similarity between extracted conditions and input conditions, as well as the pixel-level similarity with the source image. Then, we integrate a Multimodal Large Language Model (MLLM) to build an efficient condition evaluator. This evaluator optimizes the ordering of conditions based on the double-cycle controller's score ranking. Our method jointly optimizes MLLMs and diffusion models, utilizing MLLMs' reasoning capabilities to facilitate multi-condition text-to-image (T2I) tasks. The final sorted conditions are fed into a parallel multi-control adapter, which learns feature maps from dynamic visual conditions and integrates them to modulate ControlNet, thereby enhancing control over generated images. Through both quantitative and qualitative comparisons, DynamicControl demonstrates its superiority over existing methods in terms of controllability, generation quality and composability under various conditional controls.

cs.CV↗

arXiv2025

LiT: Delving into a Simple Linear Diffusion Transformer for Image Generation

In this paper, we investigate how to convert a pre-trained Diffusion Transformer (DiT) into a linear DiT, as its simplicity, parallelism, and efficiency for image generation. Through detailed exploration, we offer a suite of ready-to-use solutions, ranging from linear attention design to optimization strategies. Our core contributions include 5 practical guidelines: 1) Applying depth-wise convolution within simple linear attention is sufficient for image generation. 2) Using fewer heads in linear attention provides a free-lunch performance boost without increasing latency. 3) Inheriting weights from a fully converged, pre-trained DiT. 4) Loading all parameters except those related to linear attention. 5) Hybrid knowledge distillation: using a pre-trained teacher DiT to help the training of the student linear DiT, supervising not only the predicted noise but also the variance of the reverse diffusion process. These guidelines lead to our proposed \underline{L}inear D\underline{i}ffusion \underline{T}ransformer (LiT), which serves as a safe and efficient alternative baseline for DiT with pure linear attention. In class-conditional 256$\times$256 and 512$\times$512 ImageNet generation, LiT can be quickly adapted from DiT using only $20\%$ and $33\%$ of DiT's training steps, respectively, while achieving comparable performance. LiT also rivals methods based on Mamba or Gated Linear Attention. Moreover, the same guidelines generalize to text-to-image generation: LiT can be swiftly converted from PixArt-$Σ$ to generate high-quality images, maintaining comparable GenEval scores.

cs.CV↗

arXiv2025

RuN: Residual Policy for Natural Humanoid Locomotion

Enabling humanoid robots to achieve natural and dynamic locomotion across a wide range of speeds, including smooth transitions from walking to running, presents a significant challenge. Existing deep reinforcement learning methods typically require the policy to directly track a reference motion, forcing a single policy to simultaneously learn motion imitation, velocity tracking, and stability maintenance. To address this, we introduce RuN, a novel decoupled residual learning framework. RuN decomposes the control task by pairing a pre-trained Conditional Motion Generator, which provides a kinematically natural motion prior, with a reinforcement learning policy that learns a lightweight residual correction to handle dynamical interactions. Experiments in simulation and reality on the Unitree G1 humanoid robot demonstrate that RuN achieves stable, natural gaits and smooth walk-run transitions across a broad velocity range (0-2.5 m/s), outperforming state-of-the-art methods in both training efficiency and final performance.

cs.RO↗

arXiv2025

SGMem: Sentence Graph Memory for Long-Term Conversational Agents

Long-term conversational agents require effective memory management to handle dialogue histories that exceed the context window of large language models (LLMs). Existing methods based on fact extraction or summarization reduce redundancy but struggle to organize and retrieve relevant information across different granularities of dialogue and generated memory. We introduce SGMem (Sentence Graph Memory), which represents dialogue as sentence-level graphs within chunked units, capturing associations across turn-, round-, and session-level contexts. By combining retrieved raw dialogue with generated memory such as summaries, facts and insights, SGMem supplies LLMs with coherent and relevant context for response generation. Experiments on LongMemEval and LoCoMo show that SGMem consistently improves accuracy and outperforms strong baselines in long-term conversational question answering.

cs.CL↗

arXiv2025

Query-Centric Graph Retrieval Augmented Generation

Graph-based retrieval-augmented generation (RAG) enriches large language models (LLMs) with external knowledge for long-context understanding and multi-hop reasoning, but existing methods face a granularity dilemma: fine-grained entity-level graphs incur high token costs and lose context, while coarse document-level graphs fail to capture nuanced relations. We introduce QCG-RAG, a query-centric graph RAG framework that enables query-granular indexing and multi-hop chunk retrieval. Our query-centric approach leverages Doc2Query and Doc2Query{-}{-} to construct query-centric graphs with controllable granularity, improving graph quality and interpretability. A tailored multi-hop retrieval mechanism then selects relevant chunks via the generated queries. Experiments on LiHuaWorld and MultiHop-RAG show that QCG-RAG consistently outperforms prior chunk-based and graph-based RAG methods in question answering accuracy, establishing a new paradigm for multi-hop reasoning.

cs.CL↗

arXiv2025

SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs

Large scale pretrained models have revolutionized Natural Language Processing (NLP) and Computer Vision (CV), showcasing remarkable cross domain generalization abilities. However, in graph learning, models are typically trained on individual graph datasets, limiting their capacity to transfer knowledge across different graphs and tasks. This approach also heavily relies on large volumes of annotated data, which presents a significant challenge in resource-constrained settings. Unlike NLP and CV, graph structured data presents unique challenges due to its inherent heterogeneity, including domain specific feature spaces and structural diversity across various applications. To address these challenges, we propose a novel structure aware self supervised learning method for Text Attributed Graphs (SSTAG). By leveraging text as a unified representation medium for graph learning, SSTAG bridges the gap between the semantic reasoning of Large Language Models (LLMs) and the structural modeling capabilities of Graph Neural Networks (GNNs). Our approach introduces a dual knowledge distillation framework that co-distills both LLMs and GNNs into structure-aware multilayer perceptrons (MLPs), enhancing the scalability of large-scale TAGs. Additionally, we introduce an in-memory mechanism that stores typical graph representations, aligning them with memory anchors in an in-memory repository to integrate invariant knowledge, thereby improving the model's generalization ability. Extensive experiments demonstrate that SSTAG outperforms state-of-the-art models on cross-domain transfer learning tasks, achieves exceptional scalability, and reduces inference costs while maintaining competitive performance.

cs.CL↗

arXiv2025

Integration of promising piezoelectric and photocatalytic properties in Janus In$XY$ ($X$ = S, Se, Te; $Y$ = Cl, Br, I) monolayers and their heterojunctions

Two-dimensional (2D) Janus materials show great promise as piezoelectric materials and photocatalysts for water splitting. In this work, we systematically investigated the piezoelectric and photocatalytic properties of the hexagonal Janus In$XY$ ($X$ = S, Se, Te; $Y$ = Cl, Br, I) monolayers (MLs) using first-principles calculations. Except for InSeCl ML, the remaining eight In$XY$ MLs are stable and exhibit exceptionally high in-plane piezoelectric coefficients ($|d_{22}|$ = 6.07--155.27 pm/V), which exceed those of most known 2D materials. In$XY$ MLs possess band edges straddling the water redox potentials at pH = 0. Their intrinsic vertical polarization induces an intralayer polarization field $E_{\rm intra}$, leading to low exciton binding energies (0.44--0.78 eV). Moreover, their strong vertical piezoelectric responses ($|d_{32}|$ = 0.34--0.65 pm/V) suggest that in-plane stress can further enhance $E_{\rm intra}$ to facilitate the separation of photogenerated carriers. Additionally, these In$XY$ MLs exhibit high electron mobility (101--899 cm$^2$/V/s) and a pronounced anisotropy ratio in carrier mobility, which effectively suppresses charge recombination. Among them, several stand out: InSI and InSeBr MLs show high electron mobility and a large carrier mobility anisotropy ratio; InSeBr ML exhibits excellent in-plane and out-of-plane piezoelectricity; and InSeBr, InSeI, and InTe$Y$ ($Y$ = Cl, Br, I) MLs show strong visible-light absorption. To optimize performance, we constructed a van der Waals heterojunction (InSI/InSeBr), which demonstrates remarkable photocatalytic properties, including enhanced redox ability, a direct Z-scheme charge transfer pathway, strong visible-light absorption, high carrier mobility, and excellent photocorrosion resistance.

cond-mat.mtrl-sci↗

arXiv2025

Towards Reliable Medical Image Segmentation by Modeling Evidential Calibrated Uncertainty

Medical image segmentation is critical for disease diagnosis and treatment assessment. However, concerns regarding the reliability of segmentation regions persist among clinicians, mainly attributed to the absence of confidence assessment, robustness, and calibration to accuracy. To address this, we introduce DEviS, an easily implementable foundational model that seamlessly integrates into various medical image segmentation networks. DEviS not only enhances the calibration and robustness of baseline segmentation accuracy but also provides high-efficiency uncertainty estimation for reliable predictions. By leveraging subjective logic theory, we explicitly model probability and uncertainty for medical image segmentation. Here, the Dirichlet distribution parameterizes the distribution of probabilities for different classes of the segmentation results. To generate calibrated predictions and uncertainty, we develop a trainable calibrated uncertainty penalty. Furthermore, DEviS incorporates an uncertainty-aware filtering module, which designs the metric of uncertainty-calibrated error to filter out-of-distribution data. We conducted validation studies on publicly available datasets, including ISIC2018, KiTS2021, LiTS2017, and BraTS2019, to assess the accuracy and robustness of different backbone segmentation models enhanced by DEviS, as well as the efficiency and reliability of uncertainty estimation.

eess.IV↗

arXiv2025

Spec2RTL-Agent: Automated Hardware Code Generation from Complex Specifications Using LLM Agent Systems

Despite recent progress in generating hardware RTL code with LLMs, existing solutions still suffer from a substantial gap between practical application scenarios and the requirements of real-world RTL code development. Prior approaches either focus on overly simplified hardware descriptions or depend on extensive human guidance to process complex specifications, limiting their scalability and automation potential. In this paper, we address this gap by proposing an LLM agent system, termed Spec2RTL-Agent, designed to directly process complex specification documentation and generate corresponding RTL code implementations, advancing LLM-based RTL code generation toward more realistic application settings. To achieve this goal, Spec2RTL-Agent introduces a novel multi-agent collaboration framework that integrates three key enablers: (1) a reasoning and understanding module that translates specifications into structured, step-by-step implementation plans; (2) a progressive coding and prompt optimization module that iteratively refines the code across multiple representations to enhance correctness and synthesisability for RTL conversion; and (3) an adaptive reflection module that identifies and traces the source of errors during generation, ensuring a more robust code generation flow. Instead of directly generating RTL from natural language, our system strategically generates synthesizable C++ code, which is then optimized for HLS. This agent-driven refinement ensures greater correctness and compatibility compared to naive direct RTL generation approaches. We evaluate Spec2RTL-Agent on three specification documents, showing it generates accurate RTL code with up to 75% fewer human interventions than existing methods. This highlights its role as the first fully automated multi-agent system for RTL generation from unstructured specs, reducing reliance on human effort in hardware design.

cs.AR↗

arXiv2025

PAC-Bayesian Generalization Bounds for Graph Convolutional Networks on Inductive Node Classification

Graph neural networks (GNNs) have achieved remarkable success in processing graph-structured data across various applications. A critical aspect of real-world graphs is their dynamic nature, where new nodes are continually added and existing connections may change over time. Previous theoretical studies, largely based on the transductive learning framework, fail to adequately model such temporal evolution and structural dynamics. In this paper, we presents a PAC-Bayesian theoretical analysis of graph convolutional networks (GCNs) for inductive node classification, treating nodes as dependent and non-identically distributed data points. We derive novel generalization bounds for one-layer GCNs that explicitly incorporate the effects of data dependency and non-stationarity, and establish sufficient conditions under which the generalization gap converges to zero as the number of nodes increases. Furthermore, we extend our analysis to two-layer GCNs, and reveal that it requires stronger assumptions on graph topology to guarantee convergence. This work establishes a theoretical foundation for understanding and improving GNN generalization in dynamic graph environments.

cs.LG↗

arXiv2025

From KP-I Lump Solution to Travelling wave of 3D Gravity Capillary Water wave problem

In this paper, we study the three-dimensional gravity-capillary water wave problem involving an irrotational, perfect fluid with gravity and surface tension. We focus on steady waves propagating uniformly in one direction. Assuming constant wave speed and water depth, we analyze the fluid's velocity potential and boundary conditions. Using the Kadomtsev-Petviashvili (KP)-I equation as a simplified model, we show that, within a specific parameter range, the problem admits a fully localized solitary-wave solution resemble lump type solutions of the KP-I equation.

math.AP↗

arXiv2025

First principles study on the oxidation resistance of two-dimensional intrinsic and defective GeO2

Although two-dimensional (2D) oxide semiconductors exhibit remarkable oxidation resistance compared to conventional 2D materials, the microscopic physical processes that govern this behavior at the atomic scale remains elusive. Using first-principles calculations, we investigated the defect formation and oxidation dynamics of the GeO${_2}$ monolayer (ML). The investigations reveal that the intrinsic GeO${_2}$ ML is resistant to oxidation due to strong electrostatic repulsion between surface oxygen ions and approaching O$_2$ molecules, effectively suppressing chemisorption. In contrast, defective GeO$_2$ ML with surface O vacancies shows vulnerability to oxidation with the O$_2$ molecule occupying the vacancy through a low-energy activation energy ($E_a$) of 0.375 eV. Remarkably, the subsequent O$_2$ dissociation into atomic species faces a higher activation barrier ($E_a$ = 1.604 eV), suggesting self-limiting oxidation behavior. Electronic structure analysis demonstrates that oxidation primarily modifies the valence bands of defective GeO${_2}$ MLs through oxygen incorporation, while the conduction bands and electron effective mass recover to pristine-like characteristics. We further proved that the high O$_2$ pressure hinders the formation of the O vacancy, while high temperature increases the oxidation rate in GeO$_2$ ML. These atomic-level insights not only advance our understanding of oxidation resistance in 2D oxides but also provide guidelines for developing stable GeO${_2}$-based nanoelectronic devices.

cond-mat.mtrl-sci↗

arXiv2025

OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization

Watermarking diffusion-generated images is crucial for copyright protection and user tracking. However, current diffusion watermarking methods face significant limitations: zero-bit watermarking systems lack the capacity for large-scale user tracking, while multi-bit methods are highly sensitive to certain image transformations or generative attacks, resulting in a lack of comprehensive robustness. In this paper, we propose OptMark, an optimization-based approach that embeds a robust multi-bit watermark into the intermediate latents of the diffusion denoising process. OptMark strategically inserts a structural watermark early to resist generative attacks and a detail watermark late to withstand image transformations, with tailored regularization terms to preserve image quality and ensure imperceptibility. To address the challenge of memory consumption growing linearly with the number of denoising steps during optimization, OptMark incorporates adjoint gradient methods, reducing memory usage from O(N) to O(1). Experimental results demonstrate that OptMark achieves invisible multi-bit watermarking while ensuring robust resilience against valuemetric transformations, geometric transformations, editing, and regeneration attacks.

cs.CR↗

arXiv2025

MERIT: Maximum-normalized Element-wise Ratio for Language Model Large-batch Training

Large-batch training has become a cornerstone in accelerating the training of deep neural networks, yet it poses challenges in optimization and generalization. Existing optimizers like AdamW present performance degradation during language models' large-batch training, due to the information bottleneck in attention layers caused by the sharp increase of max attention logit. While the LAMB optimizer partially addresses this issue, some attention layers still face this issue. The reason is that $l_2$-norm-based trust ratios in LAMB are less effective in directly influencing the max value of query/key weights. Furthermore, the weight-wise trust ratio in LAMB is error-prone as it overlooks relationships of weight values within rows or columns. Building on these observations, we propose a novel optimizer, MERIT, which leverages the max-norm to calculate the trust ratio to constrain the max attention logit more effectively. Moreover, we further construct element-wise trust ratios to provide more robust update scaling by focusing on local weight structures. Extensive experiments of large-batch training across various sizes of GPT-2 models demonstrate the superior performance of MERIT. Notably, during the training of GPT-2 Medium, MERIT enables a 6k batch size without any performance degradation compared to the standard batch size (480) with 48B training tokens. This work highlights the importance of considering the max attention logit and finer-granularity trust ratio in large-batch training. It successfully improves the training stability and paves the way for larger batch usage, enabling faster development and iteration of large language models. Code is available at https://github.com/NUS-HPC-AI-Lab/MERIT.

cs.LG↗

arXiv2025

1000-Channel Integrated Optical Phased Array with 180° Field of View, High Resolution and High Scalability

Optical phased array (OPA) is a promising technology for compact, solid-state beam steering, with applications ranging from free-space optical communication to LiDAR. However, simultaneously achieving a large field of view (FOV), high resolution, and low side-lobe level (SLL) remains a major challenge. Traditional OPAs face inherent limitations: they exhibit grating lobes when emitter spacing exceeds half the operating wavelength, while at half-wavelength spacing, significant crosstalk issues persist. Previously, we demonstrated a small-scale OPA that harnesses near-field interference and beamforming via a trapezoidal slab grating and a half-wavelength-pitch waveguide array to achieve a 180° FOV. However, its resolution was limited by the small channel count. In this work, we present a 1000-channel OPA that scales this architecture while addressing key challenges in waveguide crosstalk and control complexity. By optimizing waveguide routing, we minimize inter-channel coupling in the dense waveguide array. Additionally, we propose and demonstrate a passive matrix control scheme using 20 row and 50 column pulse-width modulation (PWM) signals to arbitrarily control 1000 thermo-optic phase shifters, significantly simplifying the electronic control and packaging. Our OPA achieves grating-lobe-free beam steering across a full 180° FOV, with a high resolution of 0.07° * 0.17° and a minimum SLL of -18.7 dB at 0°. This large-scale, cost-effective chip-based OPA paves the way for next-generation high-resolution, wide-angle beam steering systems.

physics.optics↗

arXiv2025

Coarse-to-Fine Process Reward Modeling for Mathematical Reasoning

The Process Reward Model (PRM) plays a crucial role in mathematical reasoning tasks, requiring high-quality supervised process data. However, we observe that reasoning steps generated by Large Language Models (LLMs) often fail to exhibit strictly incremental information, leading to redundancy that can hinder effective reasoning. To address this issue, we propose CFPRM, a simple yet effective coarse-to-fine strategy. Instead of focusing on the detection of redundant steps, our approach first establishes a coarse-grained window to merge adjacent reasoning steps into unified, holistic steps. The window size is then progressively reduced to extract fine-grained reasoning steps, enabling data collection at multiple granularities for training. By leveraging this hierarchical refinement process, CFPRM mitigates redundancy while preserving essential fine-grained knowledge. Extensive experiments on two reasoning datasets across three loss criteria validate the CFPRM's effectiveness and versatility.

cs.AI↗

arXiv2025

Gaussian-LIC: Real-Time Photo-Realistic SLAM with Gaussian Splatting and LiDAR-Inertial-Camera Fusion

In this paper, we present a real-time photo-realistic SLAM method based on marrying Gaussian Splatting with LiDAR-Inertial-Camera SLAM. Most existing radiance-field-based SLAM systems mainly focus on bounded indoor environments, equipped with RGB-D or RGB sensors. However, they are prone to decline when expanding to unbounded scenes or encountering adverse conditions, such as violent motions and changing illumination. In contrast, oriented to general scenarios, our approach additionally tightly fuses LiDAR, IMU, and camera for robust pose estimation and photo-realistic online mapping. To compensate for regions unobserved by the LiDAR, we propose to integrate both the triangulated visual points from images and LiDAR points for initializing 3D Gaussians. In addition, the modeling of the sky and varying camera exposure have been realized for high-quality rendering. Notably, we implement our system purely with C++ and CUDA, and meticulously design a series of strategies to accelerate the online optimization of the Gaussian-based scene representation. Extensive experiments demonstrate that our method outperforms its counterparts while maintaining real-time capability. Impressively, regarding photo-realistic mapping, our method with our estimated poses even surpasses all the compared approaches that utilize privileged ground-truth poses for mapping. Our code has been released on https://github.com/APRIL-ZJU/Gaussian-LIC.

cs.RO↗

arXiv2025

A Comprehensive Library for Benchmarking Multi-class Visual Anomaly Detection

Visual anomaly detection aims to identify anomalous regions in images through unsupervised learning paradigms, with increasing application demand and value in fields such as industrial inspection and medical lesion detection. Despite significant progress in recent years, there is a lack of comprehensive benchmarks to adequately evaluate the performance of various mainstream methods across different datasets under the practical multi-class setting. The absence of standardized experimental setups can lead to potential biases in training epochs, resolution, and metric results, resulting in erroneous conclusions. This paper addresses this issue by proposing a comprehensive visual anomaly detection benchmark, ADer, which is a modular framework that is highly extensible for new methods. The benchmark includes multiple datasets from industrial and medical domains, implementing fifteen state-of-the-art methods and nine comprehensive metrics. Additionally, we have proposed the GPU-assisted ADEval package to address the slow evaluation problem of metrics like time-consuming mAU-PRO on large-scale data, significantly reducing evaluation time by more than 1000-fold. Through extensive experimental results, we objectively reveal the strengths and weaknesses of different methods and provide insights into the challenges and future directions of multi-class visual anomaly detection. We hope that ADer will become a valuable resource for researchers and practitioners in the field, promoting the development of more robust and generalizable anomaly detection systems. Full codes are open-sourced at https://github.com/zhangzjn/ader.

cs.CV↗