arXiv subjects

Min Liu

Publications and source records attributed to Min Liu.

At least 55 records · Page 3Linked to original sources

arXiv2025

LocoFormer: Generalist Locomotion via Long-context Adaptation

Modern locomotion controllers are manually tuned for specific embodiments. We present LocoFormer, a generalist omni-bodied locomotion model that can control previously unseen legged and wheeled robots, even without precise knowledge of their kinematics. LocoFormer is able to adapt to changes in morphology and dynamics at test time. We find that two key choices enable adaptation. First, we train massive scale RL on procedurally generated robots with aggressive domain randomization. Second, in contrast to previous policies that are myopic with short context lengths, we extend context by orders of magnitude to span episode boundaries. We deploy the same LocoFormer to varied robots and show robust control even with large disturbances such as weight change and motor failures. In extreme scenarios, we see emergent adaptation across episodes, LocoFormer learns from falls in early episodes to improve control strategies in later ones. We believe that this simple, yet general recipe can be used to train foundation models for other robotic skills in the future. Videos at generalist-locomotion.github.io.

cs.RO↗

arXiv2025

Audiobook-CC: Controllable Long-context Speech Generation for Multicast Audiobook

Existing text-to-speech systems predominantly focus on single-sentence synthesis and lack adequate contextual modeling as well as fine-grained performance control capabilities for generating coherent multicast audiobooks. To address these limitations, we propose a context-aware and emotion controllable speech synthesis framework specifically engineered for multicast audiobooks with three key innovations: a context mechanism for contextual consistency, a disentanglement paradigm to decouple style control from speech prompts for semantic consistency, and self-distillation to boost emotional expressiveness and instruction controllability. Experimental results show superior performance across the generation of narration, dialogue, and the whole chapter, significantly outperforming existing baselines. Ablation studies are conducted to validate the effectiveness of our proposed methods. Demo samples can be found in https://everest-ai.github.io/.

eess.AS↗

arXiv2025

Ideal Registration? Segmentation is All You Need

Deep learning has revolutionized image registration by its ability to handle diverse tasks while achieving significant speed advantages over conventional approaches. Current approaches, however, often employ globally uniform smoothness constraints that fail to accommodate the complex, regionally varying deformations characteristic of anatomical motion. To address this limitation, we propose SegReg, a Segmentation-driven Registration framework that implements anatomically adaptive regularization by exploiting region-specific deformation patterns. Our SegReg first decomposes input moving and fixed images into anatomically coherent subregions through segmentation. These localized domains are then processed by the same registration backbone to compute optimized partial deformation fields, which are subsequently integrated into a global deformation field. SegReg achieves near-perfect structural alignment (98.23% Dice on critical anatomies) using ground-truth segmentation, and outperforms existing methods by 2-12% across three clinical registration scenarios (cardiac, abdominal, and lung images) even with automatic segmentation. Our SegReg demonstrates a near-linear dependence of registration accuracy on segmentation quality, transforming the registration challenge into a segmentation problem. The source code will be released upon manuscript acceptance.

cs.CV↗

arXiv2025

SAMIR, an efficient registration framework via robust feature learning from SAM

Image registration is a fundamental task in medical image analysis. Deformations are often closely related to the morphological characteristics of tissues, making accurate feature extraction crucial. Recent weakly supervised methods improve registration by incorporating anatomical priors such as segmentation masks or landmarks, either as inputs or in the loss function. However, such weak labels are often not readily available, limiting their practical use. Motivated by the strong representation learning ability of visual foundation models, this paper introduces SAMIR, an efficient medical image registration framework that utilizes the Segment Anything Model (SAM) to enhance feature extraction. SAM is pretrained on large-scale natural image datasets and can learn robust, general-purpose visual representations. Rather than using raw input images, we design a task-specific adaptation pipeline using SAM's image encoder to extract structure-aware feature embeddings, enabling more accurate modeling of anatomical consistency and deformation patterns. We further design a lightweight 3D head to refine features within the embedding space, adapting to local deformations in medical images. Additionally, we introduce a Hierarchical Feature Consistency Loss to guide coarse-to-fine feature matching and improve anatomical alignment. Extensive experiments demonstrate that SAMIR significantly outperforms state-of-the-art methods on benchmark datasets for both intra-subject cardiac image registration and inter-subject abdomen CT image registration, achieving performance improvements of 2.68% on ACDC and 6.44% on the abdomen dataset. The source code will be publicly available on GitHub following the acceptance of this paper.

cs.CV↗

arXiv2025

Confusion is the Final Barrier: Rethinking Jailbreak Evaluation and Investigating the Real Misuse Threat of LLMs

With the development of Large Language Models (LLMs), numerous efforts have revealed their vulnerabilities to jailbreak attacks. Although these studies have driven the progress in LLMs' safety alignment, it remains unclear whether LLMs have internalized authentic knowledge to deal with real-world crimes, or are merely forced to simulate toxic language patterns. This ambiguity raises concerns that jailbreak success is often attributable to a hallucination loop between jailbroken LLM and judger LLM. By decoupling the use of jailbreak techniques, we construct knowledge-intensive Q\&A to investigate the misuse threats of LLMs in terms of dangerous knowledge possession, harmful task planning utility, and harmfulness judgment robustness. Experiments reveal a mismatch between jailbreak success rates and harmful knowledge possession in LLMs, and existing LLM-as-a-judge frameworks tend to anchor harmfulness judgments on toxic language patterns. Our study reveals a gap between existing LLM safety assessments and real-world threat potential.

cs.CR↗

arXiv2025

Global well-posedness and large time behavior of 3D incompressible inhomogeneous magnetohydrodynamic equations in the exterior of a cylinder

When the vaccum is allowed, if the global existence and uniqueness of strong solutions to three dimensional incompressible inhomogeneous magnetohydrodynamic equations holds true or not has always been a challenging open problem, even for the magnetofluids with special structures. In this paper, through deeply exploring the internal structure and characteristic of axisymmetric flows, we obtain some new discoveries and give a partial answer to above issue. More precisely, we prove that the axisymmetric magnetofluids flowing in the exterior of a cylinder will definitely admits a unique strong solution that exists globally in time without any compatibility conditions and small assumptions imposed on the initial data. Furthermore, we establish the algebraic decay rates for the time and spatial derivatives of both velocity and magnetic fields. To the best of our knowledge, this result gives the first unique 3D large solution existing globally in time.

math.AP↗

arXiv2025

Resilient Multimodal Industrial Surface Defect Detection with Uncertain Sensors Availability

Multimodal industrial surface defect detection (MISDD) aims to identify and locate defect in industrial products by fusing RGB and 3D modalities. This article focuses on modality-missing problems caused by uncertain sensors availability in MISDD. In this context, the fusion of multiple modalities encounters several troubles, including learning mode transformation and information vacancy. To this end, we first propose cross-modal prompt learning, which includes: i) the cross-modal consistency prompt serves the establishment of information consistency of dual visual modalities; ii) the modality-specific prompt is inserted to adapt different input patterns; iii) the missing-aware prompt is attached to compensate for the information vacancy caused by dynamic modalities-missing. In addition, we propose symmetric contrastive learning, which utilizes text modality as a bridge for fusion of dual vision modalities. Specifically, a paired antithetical text prompt is designed to generate binary text semantics, and triple-modal contrastive pre-training is offered to accomplish multimodal learning. Experiment results show that our proposed method achieves 73.83% I-AUROC and 93.05% P-AUROC with a total missing rate 0.7 for RGB and 3D modalities (exceeding state-of-the-art methods 3.84% and 5.58% respectively), and outperforms existing approaches to varying degrees under different missing types and rates. The source code will be available at https://github.com/SvyJ/MISDD-MM.

cs.CV↗

arXiv2025

Dual Enhancement on 3D Vision-Language Perception for Monocular 3D Visual Grounding

Monocular 3D visual grounding is a novel task that aims to locate 3D objects in RGB images using text descriptions with explicit geometry information. Despite the inclusion of geometry details in the text, we observe that the text embeddings are sensitive to the magnitude of numerical values but largely ignore the associated measurement units. For example, simply equidistant mapping the length with unit "meter" to "decimeters" or "centimeters" leads to severe performance degradation, even though the physical length remains equivalent. This observation signifies the weak 3D comprehension of pre-trained language model, which generates misguiding text features to hinder 3D perception. Therefore, we propose to enhance the 3D perception of model on text embeddings and geometry features with two simple and effective methods. Firstly, we introduce a pre-processing method named 3D-text Enhancement (3DTE), which enhances the comprehension of mapping relationships between different units by augmenting the diversity of distance descriptors in text queries. Next, we propose a Text-Guided Geometry Enhancement (TGE) module to further enhance the 3D-text information by projecting the basic text features into geometrically consistent space. These 3D-enhanced text features are then leveraged to precisely guide the attention of geometry features. We evaluate the proposed method through extensive comparisons and ablation studies on the Mono3DRefer dataset. Experimental results demonstrate substantial improvements over previous methods, achieving new state-of-the-art results with a notable accuracy gain of 11.94\% in the "Far" scenario. Our code will be made publicly available.

cs.CV↗

arXiv2025

Gaussian Primitive Optimized Deformable Retinal Image Registration

Deformable retinal image registration is notoriously difficult due to large homogeneous regions and sparse but critical vascular features, which cause limited gradient signals in standard learning-based frameworks. In this paper, we introduce Gaussian Primitive Optimization (GPO), a novel iterative framework that performs structured message passing to overcome these challenges. After an initial coarse alignment, we extract keypoints at salient anatomical structures (e.g., major vessels) to serve as a minimal set of descriptor-based control nodes (DCN). Each node is modelled as a Gaussian primitive with trainable position, displacement, and radius, thus adapting its spatial influence to local deformation scales. A K-Nearest Neighbors (KNN) Gaussian interpolation then blends and propagates displacement signals from these information-rich nodes to construct a globally coherent displacement field; focusing interpolation on the top (K) neighbors reduces computational overhead while preserving local detail. By strategically anchoring nodes in high-gradient regions, GPO ensures robust gradient flow, mitigating vanishing gradient signal in textureless areas. The framework is optimized end-to-end via a multi-term loss that enforces both keypoint consistency and intensity alignment. Experiments on the FIRE dataset show that GPO reduces the target registration error from 6.2\,px to ~2.4\,px and increases the AUC at 25\,px from 0.770 to 0.938, substantially outperforming existing methods. The source code can be accessed via https://github.com/xintian-99/GPOreg.

cs.CV↗

arXiv2025

Collaborative Stance Detection via Small-Large Language Model Consistency Verification

Stance detection on social media aims to identify attitudes expressed in tweets towards specific targets. Current studies prioritize Large Language Models (LLMs) over Small Language Models (SLMs) due to the overwhelming performance improving provided by LLMs. However, heavily relying on LLMs for stance detection, regardless of the cost, is impractical for real-world social media monitoring systems that require vast data analysis. To this end, we propose \textbf{\underline{Co}}llaborative Stance Detection via Small-Large Language Model Consistency \textbf{\underline{Ver}}ification (\textbf{CoVer}) framework, which enhances LLM utilization via context-shared batch reasoning and logical verification between LLM and SLM. Specifically, instead of processing each text individually, CoVer processes texts batch-by-batch, obtaining stance predictions and corresponding explanations via LLM reasoning in a shared context. Then, to exclude the bias caused by context noises, CoVer introduces the SLM for logical consistency verification. Finally, texts that repeatedly exhibit low logical consistency are classified using consistency-weighted aggregation of prior LLM stance predictions. Our experiments show that CoVer outperforms state-of-the-art methods across multiple benchmarks in the zero-shot setting, achieving 0.54 LLM queries per tweet while significantly enhancing performance. Our CoVer offers a more practical solution for LLM deploying for social media stance detection.

cs.CL↗

arXiv2025

Band Structure and Pairing Nature of La$_3$Ni$_2$O$_7$ Thin Film at Ambient Pressure

Recently, evidences of superconductivity (SC) with onset $T_c$ above the McMillan limit have been detected in the La$_3$Ni$_2$O$_7$ ultrathin film grown on the LaSrAlO$_4$ substrate at ambient pressure. This progress opens a new era in the field of the nickelate superconductors. Here we perform a density-functional-theory (DFT) based calculation for the band structure of this material. The obtained DFT+$U$ band structure has the feature that the bonding $d_{z^2}$ band crosses the Fermi level, forming the hole pocket $γ$, consistent with the angle-resolved photoemission spectrum (ARPES). Taking the low-energy Ni-$(3d_{z^2},3d_{x^2-y^2})$ orbitals placed on the tetragonal lattice structure, we construct a 2D bilayer four-band tight-binding model which well captures the main features of the DFT+$U$ band structure. Then considering the multi-orbital Hubbard interaction, we adopt the random-phase approximation (RPA) approach to investigate the pairing nature. The obtained pairing symmetry is $s^{\pm}$ or $d_{xy}$ for the hole-doping level $δ$ below or above 0.12, induced by the different Fermi surface nesting situations. For the realistic $δ=0.21$ measured by the ARPES, our RPA calculations obtain the next-nearest-neighbor pairing $d_{xy}$-wave SC dominated by the $d_{z^2}$ orbital, consistent with the experimental observation that the $T_c$ enhances with the shrinking of the in-plane lattice constants. This pairing state is induced by the nesting between the different patches within the $γ$ pocket. Our results appeal for experimental verifications.

cond-mat.supr-con↗

arXiv2025

Pairing without $γ$-Pocket in the La$_3$Ni$_2$O$_7$ Thin Film

The recent discovery of high-temperature superconductivity (HTSC) in the La$_3$Ni$_2$O$_7$ ultrathin film at ambient pressure has aroused great research interest. The $γ$-pocket formed by the bonding $d_{z^2}$ band, which was previously proposed to be crucial in the pairing mechanism of pressurized bulk La$_3$Ni$_2$O$_7$, is reported to be either present or absent here by different experimental groups, giving rise to the problem: what is the pairing mechanism and pairing nature without the $γ$-pocket? Here, we start from a band structure obtained via density-functional-theoretical calculation, which exhibits no $γ$-pocket. Then, equipped with electron interactions, we study the pairing nature via combined weak- and strong- coupling approaches, which provide consistent results. In the weak-coupling study, the nesting between the $α$- and $β$- pockets leads to an $s^\pm$-wave pairing in which the gap signs on the two pockets are opposite, as provided by our random-phase-approximation based calculations. In real-space, the pairing pattern is dominated by the interlayer pairing of the $d_{x^2-y^2}$ orbital. In the strong-coupling study, as the $d_{z^2}$ orbitals are nearly half-filled and hence localized, the $d_{x^2-y^2}$ orbitals carry the HTSC. Driven by the interlayer superexchange transferred from the $d_{z^2}$ orbital through the Hund's rule coupling, the $d_{x^2-y^2}$ orbital electrons form interlayer $s$-wave pairing, as suggested by our slave-boson-mean-field study on the related two-orbital $t$-$J$ model. Projected onto the Fermi surface, this pairing just gives the $s^\pm$-wave pattern consistent with that obtained in the weak-coupling study. Our result is consistent with that obtained in recent scanning tunneling microscopy experiment.

cond-mat.supr-con↗

arXiv2025

Lunar and Terrestrial Time Transformation Based on the Principle of General Relativity

Lunar time metrology necessitates a unified temporal framework beyond Earth, requiring an independent lunar system for timekeeping, dissemination, and calendrics. Recent American publications define Lunar Coordinate Time (LTC) within relativity and propose a Terrestrial Time (TT) to LTC conversion formula. However, this formula's derivation and assumptions are contested. The complex dynamics within the solar system can be simplified by decomposing relationships into hierarchical wide-area (external problem) and local-area (internal problem) levels. Grounded in the symmetry and conservation laws of physics, Einstein's general relativity emphasizes two key principles: (i) Equal weighting: Relationships among multi-level coordinate systems are independent and self-similar (analogous to fractals). (ii) *Locality*: The laws of physics retain invariant forms only in local coordinate systems. Specifically, a non-rotating system corresponds to the Frenet frame along a particle's geodesic. Preserving physical law invariance requires restricting rotating references strictly to the local domain; defining the orientation of an Earth-centered system using distant celestial bodies violates general relativity's locality principle. This work derives the relationship between coordinate time and proper time. Using the Earth-Moon system as an intermediary, it obtains a simplified transformation formula between LTC and TT. An independent and universal lunar standard time framework is proposed. Crucially, the derived coordinate time transformation coefficient exhibits long-term secular variation. This variation can be measured and predicted through precise Earth-Moon time comparisons.

gr-qc↗

arXiv2025

A Structure-Guided Gauss-Newton Method for Shallow ReLU Neural Network

In this paper, we propose a structure-guided Gauss-Newton (SgGN) method for solving least squares problems using a shallow ReLU neural network. The method effectively takes advantage of both the least squares structure and the neural network structure of the objective function. By categorizing the weights and biases of the hidden and output layers of the network as nonlinear and linear parameters, respectively, the method iterates back and forth between the nonlinear and linear parameters. The nonlinear parameters are updated by a damped Gauss-Newton method and the linear ones are updated by a linear solver. Moreover, at the Gauss-Newton step, a special form of the Gauss-Newton matrix is derived for the shallow ReLU neural network and is used for efficient iterations. It is shown that the corresponding mass and Gauss-Newton matrices in the respective linear and nonlinear steps are symmetric and positive definite under reasonable assumptions. Thus, the SgGN method naturally produces an effective search direction without the need of additional techniques like shifting in the Levenberg-Marquardt method to achieve invertibility of the Gauss-Newton matrix. The convergence and accuracy of the method are demonstrated numerically for several challenging function approximation problems, especially those with discontinuities or sharp transition layers that pose significant challenges for commonly used training algorithms in machine learning.

cs.LG↗

arXiv2025

Prompt-driven Transferable Adversarial Attack on Person Re-Identification with Attribute-aware Textual Inversion

Person re-identification (re-id) models are vital in security surveillance systems, requiring transferable adversarial attacks to explore the vulnerabilities of them. Recently, vision-language models (VLM) based attacks have shown superior transferability by attacking generalized image and textual features of VLM, but they lack comprehensive feature disruption due to the overemphasis on discriminative semantics in integral representation. In this paper, we introduce the Attribute-aware Prompt Attack (AP-Attack), a novel method that leverages VLM's image-text alignment capability to explicitly disrupt fine-grained semantic features of pedestrian images by destroying attribute-specific textual embeddings. To obtain personalized textual descriptions for individual attributes, textual inversion networks are designed to map pedestrian images to pseudo tokens that represent semantic embeddings, trained in the contrastive learning manner with images and a predefined prompt template that explicitly describes the pedestrian attributes. Inverted benign and adversarial fine-grained textual semantics facilitate attacker in effectively conducting thorough disruptions, enhancing the transferability of adversarial examples. Extensive experiments show that AP-Attack achieves state-of-the-art transferability, significantly outperforming previous methods by 22.9% on mean Drop Rate in cross-model&dataset attack scenarios.

cs.CV↗

arXiv2025

VoxelOpt: Voxel-Adaptive Message Passing for Discrete Optimization in Deformable Abdominal CT Registration

Recent developments in neural networks have improved deformable image registration (DIR) by amortizing iterative optimization, enabling fast and accurate DIR results. However, learning-based methods often face challenges with limited training data, large deformations, and tend to underperform compared to iterative approaches when label supervision is unavailable. While iterative methods can achieve higher accuracy in such scenarios, they are considerably slower than learning-based methods. To address these limitations, we propose VoxelOpt, a discrete optimization-based DIR framework that combines the strengths of learning-based and iterative methods to achieve a better balance between registration accuracy and runtime. VoxelOpt uses displacement entropy from local cost volumes to measure displacement signal strength at each voxel, which differs from earlier approaches in three key aspects. First, it introduces voxel-wise adaptive message passing, where voxels with lower entropy receives less influence from their neighbors. Second, it employs a multi-level image pyramid with 27-neighbor cost volumes at each level, avoiding exponential complexity growth. Third, it replaces hand-crafted features or contrastive learning with a pretrained foundational segmentation model for feature extraction. In abdominal CT registration, these changes allow VoxelOpt to outperform leading iterative in both efficiency and accuracy, while matching state-of-the-art learning-based methods trained with label supervision. The source code will be available at https://github.com/tinymilky/VoxelOpt

eess.IV↗

arXiv2025

Unsupervised Deformable Image Registration with Structural Nonparametric Smoothing

Learning-based deformable image registration (DIR) accelerates alignment by amortizing traditional optimization via neural networks. Label supervision further enhances accuracy, enabling efficient and precise nonlinear alignment of unseen scans. However, images with sparse features amid large smooth regions, such as retinal vessels, introduce aperture and large-displacement challenges that unsupervised DIR methods struggle to address. This limitation occurs because neural networks predict deformation fields in a single forward pass, leaving fields unconstrained post-training and shifting the regularization burden entirely to network weights. To address these issues, we introduce SmoothProper, a plug-and-play neural module enforcing smoothness and promoting message passing within the network's forward pass. By integrating a duality-based optimization layer with tailored interaction terms, SmoothProper efficiently propagates flow signals across spatial locations, enforces smoothness, and preserves structural consistency. It is model-agnostic, seamlessly integrates into existing registration frameworks with minimal parameter overhead, and eliminates regularizer hyperparameter tuning. Preliminary results on a retinal vessel dataset exhibiting aperture and large-displacement challenges demonstrate our method reduces registration error to 1.88 pixels on 2912x2912 images, marking the first unsupervised DIR approach to effectively address both challenges. The source code will be available at https://github.com/tinymilky/SmoothProper.

cs.CV↗

arXiv2025

Robust Federated Learning against Noisy Clients via Masked Optimization

In recent years, federated learning (FL) has made significant advance in privacy-sensitive applications. However, it can be hard to ensure that FL participants provide well-annotated data for training. The corresponding annotations from different clients often contain complex label noise at varying levels. This label noise issue has a substantial impact on the performance of the trained models, and clients with greater noise levels can be largely attributed for this degradation. To this end, it is necessary to develop an effective optimization strategy to alleviate the adverse effects of these noisy clients.In this study, we present a two-stage optimization framework, MaskedOptim, to address this intricate label noise problem. The first stage is designed to facilitate the detection of noisy clients with higher label noise rates. The second stage focuses on rectifying the labels of the noisy clients' data through an end-to-end label correction mechanism, aiming to mitigate the negative impacts caused by misinformation within datasets. This is achieved by learning the potential ground-truth labels of the noisy clients' datasets via backpropagation. To further enhance the training robustness, we apply the geometric median based model aggregation instead of the commonly-used vanilla averaged model aggregation. We implement sixteen related methods and conduct evaluations on three image datasets and one text dataset with diverse label noise patterns for a comprehensive comparison. Extensive experimental results indicate that our proposed framework shows its robustness in different scenarios. Additionally, our label correction framework effectively enhances the data quality of the detected noisy clients' local datasets. % Our codes will be open-sourced to facilitate related research communities. Our codes are available via https://github.com/Sprinter1999/MaskedOptim .

cs.LG↗