arXiv subjects

Yu Liu

Publications and source records attributed to Yu Liu.

At least 397 records · Page 22Linked to original sources

arXiv2025

UniFuse: A Unified All-in-One Framework for Multi-Modal Medical Image Fusion Under Diverse Degradations and Misalignments

Current multimodal medical image fusion typically assumes that source images are of high quality and perfectly aligned at the pixel level. Its effectiveness heavily relies on these conditions and often deteriorates when handling misaligned or degraded medical images. To address this, we propose UniFuse, a general fusion framework. By embedding a degradation-aware prompt learning module, UniFuse seamlessly integrates multi-directional information from input images and correlates cross-modal alignment with restoration, enabling joint optimization of both tasks within a unified framework. Additionally, we design an Omni Unified Feature Representation scheme, which leverages Spatial Mamba to encode multi-directional features and mitigate modality differences in feature alignment. To enable simultaneous restoration and fusion within an All-in-One configuration, we propose a Universal Feature Restoration & Fusion module, incorporating the Adaptive LoRA Synergistic Network (ALSN) based on LoRA principles. By leveraging ALSN's adaptive feature representation along with degradation-type guidance, we enable joint restoration and fusion within a single-stage framework. Compared to staged approaches, UniFuse unifies alignment, restoration, and fusion within a single framework. Experimental results across multiple datasets demonstrate the method's effectiveness and significant advantages over existing approaches.

cs.CV↗

arXiv2025

MiCo: Multi-image Contrast for Reinforcement Visual Reasoning

This work explores enabling Chain-of-Thought (CoT) reasoning to link visual cues across multiple images. A straightforward solution is to adapt rule-based reinforcement learning for Vision-Language Models (VLMs). However, such methods typically rely on manually curated question-answer pairs, which can be particularly challenging when dealing with fine grained visual details and complex logic across images. Inspired by self-supervised visual representation learning, we observe that images contain inherent constraints that can serve as supervision. Based on this insight, we construct image triplets comprising two augmented views of the same image and a third, similar but distinct image. During training, the model is prompted to generate a reasoning process to compare these images (i.e., determine same or different). Then we optimize the model with rule-based reinforcement learning. Due to the high visual similarity and the presence of augmentations, the model must attend to subtle visual changes and perform logical reasoning to succeed. Experiments show that, although trained solely on visual comparison tasks, the learned reasoning ability generalizes effectively to a wide range of questions. Without relying on any human-annotated question-answer pairs, our method achieves significant improvements on multi-image reasoning benchmarks and shows strong performance on general vision tasks.

cs.CV↗

arXiv2025

A Survey of Multi-sensor Fusion Perception for Embodied AI: Background, Methods, Challenges and Prospects

Multi-sensor fusion perception (MSFP) is a key technology for embodied AI, which can serve a variety of downstream tasks (e.g., 3D object detection and semantic segmentation) and application scenarios (e.g., autonomous driving and swarm robotics). Recently, impressive achievements on AI-based MSFP methods have been reviewed in relevant surveys. However, we observe that the existing surveys have some limitations after a rigorous and detailed investigation. For one thing, most surveys are oriented to a single task or research field, such as 3D object detection or autonomous driving. Therefore, researchers in other related tasks often find it difficult to benefit directly. For another, most surveys only introduce MSFP from a single perspective of multi-modal fusion, while lacking consideration of the diversity of MSFP methods, such as multi-view fusion and time-series fusion. To this end, in this paper, we hope to organize MSFP research from a task-agnostic perspective, where methods are reported from various technical views. Specifically, we first introduce the background of MSFP. Next, we review multi-modal and multi-agent fusion methods. A step further, time-series fusion methods are analyzed. In the era of LLM, we also investigate multimodal LLM fusion methods. Finally, we discuss open challenges and future directions for MSFP. We hope this survey can help researchers understand the important progress in MSFP and provide possible insights for future research.

cs.MM↗

arXiv2025

ThermalLoc: A Vision Transformer-Based Approach for Robust Thermal Camera Relocalization in Large-Scale Environments

Thermal cameras capture environmental data through heat emission, a fundamentally different mechanism compared to visible light cameras, which rely on pinhole imaging. As a result, traditional visual relocalization methods designed for visible light images are not directly applicable to thermal images. Despite significant advancements in deep learning for camera relocalization, approaches specifically tailored for thermal camera-based relocalization remain underexplored. To address this gap, we introduce ThermalLoc, a novel end-to-end deep learning method for thermal image relocalization. ThermalLoc effectively extracts both local and global features from thermal images by integrating EfficientNet with Transformers, and performs absolute pose regression using two MLP networks. We evaluated ThermalLoc on both the publicly available thermal-odometry dataset and our own dataset. The results demonstrate that ThermalLoc outperforms existing representative methods employed for thermal camera relocalization, including AtLoc, MapNet, PoseNet, and RobustLoc, achieving superior accuracy and robustness.

cs.CV↗

arXiv2025

Instability in Diffusion ODEs: An Explanation for Inaccurate Image Reconstruction

Diffusion reconstruction plays a critical role in various applications such as image editing, restoration, and style transfer. In theory, the reconstruction should be simple - it just inverts and regenerates images by numerically solving the Probability Flow-Ordinary Differential Equation (PF-ODE). Yet in practice, noticeable reconstruction errors have been observed, which cannot be well explained by numerical errors. In this work, we identify a deeper intrinsic property in the PF-ODE generation process, the instability, that can further amplify the reconstruction errors. The root of this instability lies in the sparsity inherent in the generation distribution, which means that the probability is concentrated on scattered and small regions while the vast majority remains almost empty. To demonstrate the existence of instability and its amplification on reconstruction error, we conduct experiments on both toy numerical examples and popular open-sourced diffusion models. Furthermore, based on the characteristics of image data, we theoretically prove that the instability's probability converges to one as the data dimensionality increases. Our findings highlight the inherent challenges in diffusion-based reconstruction and can offer insights for future improvements.

cs.LG↗

arXiv2025

Particle dynamics and optical appearance of charged spherically symmetric black holes in bumblebee gravity

In this paper, we study the particle dynamics, shadow, and optical appearance of charged black holes (BHs) in bumblebee gravity. Firstly, we find that the Lorentz-violation parameter l and charge parameter Q have opposite effects on the peak of the effective potential by analyzing timelike geodesics, and the radius of the innermost stable circular orbit (ISCO) decreases as the BH parameters l and Q increase. We also explore the behaviors of particle energy, angular momentum, and Keplerian frequency. Secondly, for null geodesics, both the photon sphere radius and the shadow radius decrease with increasing l and Q, and are consistently smaller than those of the Reissner-Nordstrom black hole (RNBH) and Schwarzschild-like BH. And based on observational data reported by the Event Horizon Telescope (EHT) Collaboration, we constrain the parameters l and Q by using the shadow radius data of Sgr A*. Thirdly, we explore the observation characteristics of charged BHs under three thin disk accretion models. The results show that, compared to RNBH, the increase of l leads to a greater thickness of the photon rings and lensed rings. However, due to their extremely narrow ranges, the contributions are small, and the observed intensities are mainly contributed by the direct emissions. Moreover, when the parameter l is fixed, the peaks of the observed intensities of rings decrease with increasing Q for the same emission model, and it is always lower than the corresponding value for Schwarzschild-like BH. These findings contribute to distinguishing bumblebee charged black holes (BCBHs) from other types of BHs based on their optical appearance.

gr-qc↗

arXiv2025

Mutation of $n$-cotorsion pairs in extriangulated categories

In this article, we introduce the notion of $n$-cotorsion pairs in extriangulated categories, which extends both the cotorsion pairs established by Nakaoka and Palu and the $n$-cotorsion pairs in triangulated categories developed by Chang and Zhou. We further prove that any mutation of an $n$-cotorsion pair remains an $n$-cotorsion pair. As applications, we provide a geometric characterization of $n$-cotorsion pairs in $n$-cluster categories of type $A_{\infty}$, and we realize mutations of $n$-cotorsion pairs geometrically via rotations of certain configurations of $n$-admissible arcs.

math.RT↗

arXiv2025

A Hierarchical Constructive Heuristic for Large-Scale Survivable Traffic Grooming Problem under Double-Link Failures

This paper studies a survivable traffic grooming problem in large-scale optical transport networks under double-link failures (STG2). Each communication demand must be assigned a route for every possible scenario involving zero, one, or two failed fiber links. Protection against double-link failures is crucial for ensuring reliable telecommunications services while minimizing equipment costs, making it essential for telecommunications companies today. However, this significantly complicates the problem and is rarely addressed in existing studies. Furthermore, current research typically examines networks with fewer than 300 nodes, much smaller than some emerging networks containing thousands of nodes. To address these challenges, we propose a novel hierarchical constructive heuristic for STG2. This heuristic constructs and assigns routes to communication demands across different scenarios by following a hierarchical sequence. It incorporates several innovative optimization techniques and utilizes parallel computing to enhance efficiency. Extensive experiments have been conducted on large-scale STG2 instances provided by our industry partner, encompassing networks with 1,000 to 2,600 nodes. Results demonstrate that within a one-hour time limit and a 16 GB memory limit set by the industry partner, our heuristic improves the objective values of the best-known solutions by 18.5\% on average, highlighting its significant potential for practical applications.

math.CO↗

arXiv2025

How CO Affects the Composition of Titan's Tholins Generated with ECR Plasma

Titan's atmosphere possesses thick haze layers, but their formation mechanisms remain poorly understood, including the influence of oxygen-containing gas components on organic matter synthesis. As the most abundant oxygen-containing gas, the presence of CO has been found to exert a significant impact on the generation of oxygen-containing organic compounds. Therefore, investigating the influence of CO on the production and composition of Tholins through laboratory simulations, holds profound scientific significance in the context of Titan. The work presented here is an experimental simulation designed to evaluate the impact of CO on the atmospheric chemistry of Titan. To this end, CO was introduced into the standard N2/CH4 mixture at varying mixing ratios from 0.2% to 9%, and exposed to Electron Cyclotron Resonance (ECR) plasma to initiate photochemical reactions. Optical emission spectroscopy was employed for gas-phase in situ characterization, while infrared spectroscopy and high-resolution mass spectrometry were used to analyze the resulting solid products (tholins). Our results demonstrate that the addition of CO enriches the complexity of the chemical system. CO not only supplies oxygen to the system, but also enhances nitrogen's reactivity and incorporation, enhancing the number and quantity of the organic products.

physics.chem-ph↗

arXiv2025

M3Depth: Wavelet-Enhanced Depth Estimation on Mars via Mutual Boosting of Dual-Modal Data

Depth estimation plays a great potential role in obstacle avoidance and navigation for further Mars exploration missions. Compared to traditional stereo matching, learning-based stereo depth estimation provides a data-driven approach to infer dense and precise depth maps from stereo image pairs. However, these methods always suffer performance degradation in environments with sparse textures and lacking geometric constraints, such as the unstructured terrain of Mars. To address these challenges, we propose M3Depth, a depth estimation model tailored for Mars rovers. Considering the sparse and smooth texture of Martian terrain, which is primarily composed of low-frequency features, our model incorporates a convolutional kernel based on wavelet transform that effectively captures low-frequency response and expands the receptive field. Additionally, we introduce a consistency loss that explicitly models the complementary relationship between depth map and surface normal map, utilizing the surface normal as a geometric constraint to enhance the accuracy of depth estimation. Besides, a pixel-wise refinement module with mutual boosting mechanism is designed to iteratively refine both depth and surface normal predictions. Experimental results on synthetic Mars datasets with depth annotations show that M3Depth achieves a 16% improvement in depth estimation accuracy compared to other state-of-the-art methods in depth estimation. Furthermore, the model demonstrates strong applicability in real-world Martian scenarios, offering a promising solution for future Mars exploration missions.

cs.CV↗

arXiv2025

Towards Seamless Borders: A Method for Mitigating Inconsistencies in Image Inpainting and Outpainting

Image inpainting is the task of reconstructing missing or damaged parts of an image in a way that seamlessly blends with the surrounding content. With the advent of advanced generative models, especially diffusion models and generative adversarial networks, inpainting has achieved remarkable improvements in visual quality and coherence. However, achieving seamless continuity remains a significant challenge. In this work, we propose two novel methods to address discrepancy issues in diffusion-based inpainting models. First, we introduce a modified Variational Autoencoder that corrects color imbalances, ensuring that the final inpainted results are free of color mismatches. Second, we propose a two-step training strategy that improves the blending of generated and existing image content during the diffusion process. Through extensive experiments, we demonstrate that our methods effectively reduce discontinuity and produce high-quality inpainting results that are coherent and visually appealing.

cs.CV↗

arXiv2025

GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

Visual instruction tuning large language model(LLM) on image-text pairs has achieved general-purpose vision-language abilities. However, the lack of region-text pairs limits their advancements to fine-grained multimodal understanding. In this paper, we propose spatial instruction tuning, which introduces the reference to the region-of-interest(RoI) in the instruction. Before sending to LLM, the reference is replaced by RoI features and interleaved with language embeddings as a sequence. Our model GPT4RoI, trained on 7 region-text pair datasets, brings an unprecedented interactive and conversational experience compared to previous image-level models. (1) Interaction beyond language: Users can interact with our model by both language and drawing bounding boxes to flexibly adjust the referring granularity. (2) Versatile multimodal abilities: A variety of attribute information within each RoI can be mined by GPT4RoI, e.g., color, shape, material, action, etc. Furthermore, it can reason about multiple RoIs based on common sense. On the Visual Commonsense Reasoning(VCR) dataset, GPT4RoI achieves a remarkable accuracy of 81.6%, surpassing all existing models by a significant margin (the second place is 75.6%) and almost reaching human-level performance of 85.0%. The code and model can be found at https://github.com/jshilong/GPT4RoI.

cs.CV↗

arXiv2025

Domain Switching on the Pareto Front: Multi-Objective Deep Kernel Learning in Automated Piezoresponse Force Microscopy

Ferroelectric polarization switching underpins the functional performance of a wide range of materials and devices, yet its dependence on complex local microstructural features renders systematic exploration by manual or grid-based spectroscopic measurements impractical. Here, we introduce a multi-objective kernel-learning workflow that infers the microstructural rules governing switching behavior directly from high-resolution imaging data. Applied to automated piezoresponse force microscopy (PFM) experiments, our framework efficiently identifies the key relationships between domain-wall configurations and local switching kinetics, revealing how specific wall geometries and defect distributions modulate polarization reversal. Post-experiment analysis projects abstract reward functions, such as switching ease and domain symmetry, onto physically interpretable descriptors including domain configuration and proximity to boundaries. This enables not only high-throughput active learning, but also mechanistic insight into the microstructural control of switching phenomena. While demonstrated for ferroelectric domain switching, our approach provides a powerful, generalizable tool for navigating complex, non-differentiable design spaces, from structure-property correlations in molecular discovery to combinatorial optimization across diverse imaging modalities.

cond-mat.mtrl-sci↗

arXiv2025

Germanium Atomic Compton Scattering Measurements and ${ab}$ ${initio}$ Many-Body Calculations: Implications for Electronic recoil Dark Matter Detection

Diverse searches for direct dark matter (DM) in effective electromagnetic and leptophilic interactions resulting from new physics, as well as Weakly Interacting Massive Particles (WIMPs) with unconventional electronic recoils, are intensively pursued. Low-energy backgrounds from radioactive $γ$ rays via Compton scattering and photon coherent scattering are unavoidable in terrestrial detectors. The interpretation of dark matter experimental data is dependent on a better knowledge of the background in the low-energy region. We provide a 2.3% measurement of atomic Compton scattering in the low momentum transfer range of 180 eV/c to 25 keV/c, using a 10-g germanium detector bombarded by a $^{137}\mathrm{Cs}$ source with a 7.2 m-Curie radioactivity and the scatter photon collected by a cylindrical NaI[Tl] detector. The ability to detect Compton scattering's doubly differential cross section (DDCS) gives a special test for clearly identifying the kinematic restraints in atomic many-body systems, notably the Livermore model. Additionally, a low-energy-background comparison is made between coherent photon scattering and Compton scattering replacing the scattering function of ${GEANT4}$@software, which uses a completely relativistic impulse approximation (RIA) together with Multi-Configuration Dirac-Fock (MCDF) wavefunctions. For the purpose of investigating sub-GeV mass and electronic-recoil dark matter theories, signatures including low energy backgrounds via high energy $γ$ rays in germanium targets are discussed.

astro-ph.IM↗

arXiv2025

AuralNet: Hierarchical Attention-based 3D Binaural Localization of Overlapping Speakers

We propose AuralNet, a novel 3D multi-source binaural sound source localization approach that localizes overlapping sources in both azimuth and elevation without prior knowledge of the number of sources. AuralNet employs a gated coarse-tofine architecture, combining a coarse classification stage with a fine-grained regression stage, allowing for flexible spatial resolution through sector partitioning. The model incorporates a multi-head self-attention mechanism to capture spatial cues in binaural signals, enhancing robustness in noisy-reverberant environments. A masked multi-task loss function is designed to jointly optimize sound detection, azimuth, and elevation estimation. Extensive experiments in noisy-reverberant conditions demonstrate the superiority of AuralNet over recent methods

eess.AS↗

arXiv2025

OpenCarbon: A Contrastive Learning-based Cross-Modality Neural Approach for High-Resolution Carbon Emission Prediction Using Open Data

Accurately estimating high-resolution carbon emissions is crucial for effective emission governance and mitigation planning. While conventional methods for precise carbon accounting are hindered by substantial data collection efforts, the rise of open data and advanced learning techniques offers a promising solution. Once an open data-based prediction model is developed and trained, it can easily infer emissions for new areas based on available open data. To address this, we incorporate two modalities of open data, satellite images and point-of-interest (POI) data, to predict high-resolution urban carbon emissions, with satellite images providing macroscopic and static and POI data offering fine-grained and relatively dynamic functionality information. However, estimating high-resolution carbon emissions presents two significant challenges: the intertwined and implicit effects of various functionalities on carbon emissions, and the complex spatial contiguity correlations that give rise to the agglomeration effect. Our model, OpenCarbon, features two major designs that target the challenges: a cross-modality information extraction and fusion module to extract complementary functionality information from two modules and model their interactions, and a neighborhood-informed aggregation module to capture the spatial contiguity correlations. Extensive experiments demonstrate our model's superiority, with a significant performance gain of 26.6\% on R2. Further generalizability tests and case studies also show OpenCarbon's capacity to capture the intrinsic relation between urban functionalities and carbon emissions, validating its potential to empower efficient carbon governance and targeted carbon mitigation planning. Codes and data are available: https://github.com/JinweiZzz/OpenCarbon.

cs.CV↗

arXiv2025

The Jiutian simulations for the CSST extra-galactic surveys

We provide an overview of the Jiutian simulations, a hybrid simulation suite for the China Space Survey Telescope (CSST) extragalactic surveys. It consists of four complementary modules: the primary runs with high resolutions with the fiducial concordance cosmology, the emulator runs exploring the parameter uncertainties around the fiducial cosmology, the reconstruction runs intended for recovering the observed Universe position by position, and the extension runs employing extended cosmologies beyond the standard model. For the primary runs, two independent pipelines are adopted to construct subhaloes and merger trees. On top of them, four sets of mock galaxy light-cone catalogs are produced from semi-analytical models and subhalo abundance matching, providing a variety of observational properties including galaxy SED, emission lines, lensing distortions, and mock images. The 129 emulator runs are used to train the CSST emulator, achieving one percent accuracy in predicting the matter power spectrum over $k\leq 10h{\rm Mpc}^{-1}$ and $z\leq 2$. The reconstruction runs employ a number of subgrid baryonic models to predict the evolution and galaxy population resembling certain regions in the real Universe with constrained initial conditions, enabling controlled investigation of galaxy formation on top of structure formation. The extension runs cover models with warm dark matter, $f(R)$ gravity, interacting dark energy, and nonzero neutrino masses, revealing differences in the cosmic structure under alternative cosmological models. We introduce the specifications for each run, the data products derived from them, the corresponding pipeline developments, and present some main tests. Using the primary runs, we also show that the subhalo peak mass functions of different levels are approximately universal. These simulations form a comprehensive and open library for CSST surveys and beyond.

astro-ph.CO↗

arXiv2025

Exploring Domain Wall Pinning in Ferroelectrics via Automated High Throughput AFM

Domain-wall dynamics in ferroelectric materials are strongly position-dependent since each polar interface is locked into a unique local microstructure. This necessitates spatially resolved studies of the wall-pinning using scanning-probe microscopy techniques. The pinning centers and preexisting domain walls are usually sparse within image plane, precluding the use of dense hyperspectral imaging modes and requiring time-consuming human experimentation. Here, a large area epitaxial PbTiO$_3$ film on cubic KTaO$_3$ were investigated to quantify the electric field driven dynamics of the polar-strain domain structures using ML-controlled automated Piezoresponse Force Microscopy. Analysis of 1500 switching events reveals that domain wall displacement depends not only on field parameters but also on the local ferroelectric-ferroelastic configuration. For example, twin boundaries in polydomains regions like a$_1^-$/$c^+$ $\parallel$ a$_2^-$/$c^-$ stay pinned up to a certain level of bias magnitude and change only marginally as the bias increases from 20V to 30V, whereas single variant boundaries like a$_2^+$/$c^+$ $\parallel$ a$_2^-$/$c^-$ stack are already activated at 20V. These statistics on the possible ferroelectric and ferroelastic wall orientations, together with the automated, high-throughput AFM workflow, can be distilled into a predictive map that links domain configurations to pulse parameters. This microstructure-specific rule set forms the foundation for designing ferroelectric memories.

cond-mat.mtrl-sci↗