arXiv Science⌕ Search

arXiv subjects

Zhiwei Chen

Publications and source records attributed to Zhiwei Chen.

At least 55 records · Page 3Linked to original sources

GaMi: Geometry-Agnostic Material Identification via Cross-Modal Subtractive Disentanglement

Non-contact material identification enables adaptive interaction for embodied intelligence yet faces challenges from geometry-induced variations (e.g., orientation, shape, distance) and single-modality ambiguities. In this paper, we present GaMi, a multimodal material identification system integrating mmWave and acoustic sensing to robustly operate under unconstrained geometric conditions. By leveraging the insight of shared geometric consistency between co-located bimodal sensors, GaMi employs an intra-sample cross-modal subtractive disentanglement framework. By semantically aligning modalities and subtracting the shared geometric context, it isolates intrinsic material features. Furthermore, GaMi incorporates inter-sample contrastive learning to correct the residual interference caused by cross-modal misalignment. Additionally, a pairing-based adaptation strategy between two modalities enables few-shot generalization across devices. Extensive evaluations on 20 materials show that GaMi achieves 95.2% accuracy, outperforming single-modality baselines across unseen geometric conditions.

cs.ET↗

BISTRO Survey: Gravity-Dominated and Magnetically Regulated Star Formation in M17 SW

We present high-resolution magnetic field maps of the M17 SW molecular cloud using JCMT 850 $μ$m dust polarization at a scale of 14$''$. The magnetic field exhibits a distinct arc-like structure that encircles three dense clumps (C1, C2, and C3). By combining polarization data with ammonia line observations, the plane-of-sky magnetic field strength, measured using the Skalidis-Tassis method to minimize angle dispersion errors, ranges from 0.1 to 2.4 mG (mean: 0.54 mG). Energy budget analysis reveals a hierarchy dominated by gravity ($e_G \approx 10^{-7.8}$ erg cm$^{-3}$), which exceeds both magnetic ($e_B \approx 10^{-8.3}$ erg cm$^{-3}$) and turbulent ($e_k \approx 10^{-8.7}$ erg cm$^{-3}$) energies. Since all three energy densities lie within one order of magnitude, gravitational dominance acts primarily as the global driver, while the system remains in a state of near-equipartition. Structurally, the northeastern boundary shows magnetic field lines perpendicular to the shock front, consistent with compression from the adjacent HII region. Within the cloud, magnetic field lines generally align with gravity to assist collapse, but turn perpendicular to gravity within curved accretion bridges. This configuration provides support against radial collapse while guiding gas flow. Kinematic evidence suggests that these channels transport material from Clump C3 onto the massive Clump C2. Star formation in M17 SW is globally driven by gravity but locally regulated by the magnetic field structure.

astro-ph.GA↗

Gravitational Lensing of Gravitational Waves from Astrophysical Sources: Theory, Detection, and Applications

Gravitational waves (GWs) from distant sources such as inspiralling and merging stellar-mass compact binaries, intermediate-mass and supermassive-binary-black-hole can be gravitationally lensed by intervening objects, ranging from stars and primordial black holes to galaxies and clusters. Depending on the GW wavelength relative to the lens scale, lensing occurs in two regimes: geometric optics, producing multiple images with time delays and magnifications, and wave optics, resulting in frequency-dependent waveform modulations. Lensed signals are identified via parameter overlap between event pairs or characteristic frequency-dependent modulations that distinguish them from unlensed signals. Detection rates depend on the redshift and mass distributions of sources and lenses, with promising prospects for future observatories. Once confirmed, lensed GWs will be powerful probes of fundamental physics and cosmology: they can constrain dark matter, lensing structures, the Hubble constant, and other cosmological parameters. In this review, we provide a concise overview of GW lensing, covering the theoretical framework, predicted detection rates, search strategies, and applications. We conclude with prospects and future directions for observing and exploiting lensed astrophysical GW events.

astro-ph.HE↗

Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation

Multimodal recommendation enhances accuracy by leveraging visual and textual signals, and its success largely depends on learning high-quality cross-modal representations. Recent advances in Large Vision-Language Models (LVLMs) offer unified multimodal representation learning, making them a promising backbone. However, applying LVLMs to recommendation remains challenging due to (i) representation misalignment, where domain gaps between item data and general pre-training lead to unaligned embedding spaces, and (ii) gradient conflicts during fine-tuning, where shared adapters cause interference and a lack of discriminative power. To address this, we propose SDA, a lightweight framework for Structural and Disentangled Adaptation, which integrates two components: Cross-Modal Structural Alignment (CMSA) and Modality-Disentangled Adaptation. CMSA aligns embeddings using intra-modal structures as a soft teacher, while MoDA mitigates gradient conflicts via expertized, gated low-rank paths to disentangle gradient flows. Experiments on three public Amazon datasets show SDA integrates seamlessly with existing multimodal and sequential recommenders, yielding average gains of 6.15% in Hit@10 and 8.64% in NDCG@10. It also achieves up to 12.83% and 18.70% gains on long-tail items with minimal inference overhead. Our code and full experimental results are available at https://github.com/RaoZhongtao/SDA.

cs.IR↗

TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval

Composed Image Retrieval (CIR) is an important image retrieval paradigm that enables users to retrieve a target image using a multimodal query that consists of a reference image and modification text. Although research on CIR has made significant progress, prevailing setups still rely simple modification texts that typically cover only a limited range of salient changes, which induces two limitations highly relevant to practical applications, namely Insufficient Entity Coverage and Clause-Entity Misalignment. In order to address these issues and bring CIR closer to real-world use, we construct two instruction-rich multi-modification datasets, M-FashionIQ and M-CIRR. In addition, we propose TEMA, the Text-oriented Entity Mapping Architecture, which is the first CIR framework designed for multi-modification while also accommodating simple modifications. Extensive experiments on four benchmark datasets demonstrate that TEMA's superiority in both original and multi-modification scenarios, while maintaining an optimal balance between retrieval accuracy and computational efficiency. Our codes and constructed multi-modification dataset (M-FashionIQ and M-CIRR) are available at https://github.com/lee-zixu/ACL26-TEMA/.

cs.CV↗

Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrieval

Composed Image Retrieval (CIR) has attracted significant attention due to its flexible multimodal query method, yet its development is severely constrained by the Noisy Triplet Correspondence (NTC) problem. Most existing robust learning methods rely on the "small loss hypothesis", but the unique semantic ambiguity in NTC, such as "partial matching", invalidates this assumption, leading to unreliable noise identification. This entraps the model in a self dependent vicious cycle where the learner is intertwined with the arbiter, ultimately causing catastrophic "representation pollution". To address this critical challenge, we propose a novel "Expert-Proxy-Diversion" decoupling paradigm, named Air-Know (ArbIteR calibrated Knowledge iNternalizing rObust netWork). Air-Know incorporates three core modules: (1) External Prior Arbitration (EPA), which utilizes Multimodal Large Language Models (MLLMs) as an offline expert to construct a high precision anchor dataset; (2) Expert Knowledge Internalization (EKI), which efficiently guides a lightweight proxy "arbiter" to internalize the expert's discriminative logic; (3) Dual Stream Reconciliation (DSR), which leverages the EKI's matching confidence to divert the training data, achieving a clean alignment stream and a representation feedback reconciliation stream. Extensive experiments on multiple CIR benchmark datasets demonstrate that Air-Know significantly outperforms existing SOTA methods under the NTC setting, while also showing strong competitiveness in traditional CIR.

cs.CV↗

ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval

The Composed Image Retrieval (CIR) task provides a flexible retrieval paradigm via a reference image and modification text, but it heavily relies on expensive and error-prone triplet annotations. This paper systematically investigates the Noisy Triplet Correspondence (NTC) problem introduced by annotations. We find that NTC noise, particularly ``hard noise'' (i.e., the reference and target images are highly similar but the modification text is incorrect), poses a unique challenge to existing Noise Correspondence Learning (NCL) methods because it breaks the traditional ``small loss hypothesis''. We identify and elucidate three key, yet overlooked, challenges in the NTC task, namely (C1) Modality Suppression, (C2) Negative Anchor Deficiency, and (C3) Unlearning Backlash. To address these challenges, we propose a Cone-based robuSt noisE-unlearning comPositional network (ConeSep). Specifically, we first propose Geometric Fidelity Quantization, theoretically establishing and practically estimating a noise boundary to precisely locate noisy correspondence. Next, we introduce Negative Boundary Learning, which learns a ``diagonal negative combination'' for each query as its explicit semantic opposite-anchor in the embedding space. Finally, we design Boundary-based Targeted Unlearning, which models the noisy correction process as an optimal transport problem, elegantly avoiding Unlearning Backlash. Extensive experiments on benchmark datasets (FashionIQ and CIRR) demonstrate that ConeSep significantly outperforms current state-of-the-art methods, which fully demonstrates the effectiveness and robustness of our method.

cs.CV↗

ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrieval

With the rapid growth of video data, Composed Video Retrieval (CVR) has emerged as a novel paradigm in video retrieval and is receiving increasing attention from researchers. Unlike unimodal video retrieval methods, the CVR task takes a multi-modal query consisting of a reference video and a piece of modification text as input. The modification text conveys the user's intended alterations to the reference video. Based on this input, the model aims to retrieve the most relevant target video. In the CVR task, there exists a substantial discrepancy in information density between video and text modalities. Traditional composition methods tend to bias the composed feature toward the reference video, which leads to suboptimal retrieval performance. This limitation is significant due to the presence of three core challenges: (1) modal contribution entanglement, (2) explicit optimization of composed features, and (3) retrieval uncertainty. To address these challenges, we propose the evidence-dRivRn dual-sTream diRectionAl anChor calibration networK (ReTrack). ReTrack is the first CVR framework that improves multi-modal query understanding by calibrating directional bias in composed features. It consists of three key modules: Semantic Contribution Disentanglement, Composition Geometry Calibration, and Reliable Evidence-driven Alignment. Specifically, ReTrack estimates the semantic contribution of each modality to calibrate the directional bias of the composed feature. It then uses the calibrated directional anchors to compute bidirectional evidence that drives reliable composed-to-target similarity estimation. Moreover, ReTrack exhibits strong generalization to the Composed Image Retrieval (CIR) task, achieving SOTA performance across three benchmark datasets in both CVR and CIR scenarios. Codes are available at https://github.com/Lee-zixu/ReTrack

cs.CV↗

HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrieval

Composed Image Retrieval (CIR) is a flexible image retrieval paradigm that enables users to accurately locate the target image through a multimodal query composed of a reference image and modification text. Although this task has demonstrated promising applications in personalized search and recommendation systems, it encounters a severe challenge in practical scenarios known as the Noise Triplet Correspondence (NTC) problem. This issue primarily arises from the high cost and subjectivity involved in annotating triplet data. To address this problem, we identify two central challenges: the precise estimation of composed semantic discrepancy and the insufficient progressive adaptation to modification discrepancy. To tackle these challenges, we propose a cHrono-synergiA roBust progressIve learning framework for composed image reTrieval (HABIT), which consists of two core modules. First, the Mutual Knowledge Estimation Module quantifies sample cleanliness by calculating the Transition Rate of mutual information between the composed feature and the target image, thereby effectively identifying clean samples that align with the intended modification semantics. Second, the Dual-consistency Progressive Learning Module introduces a collaborative mechanism between the historical and current models, simulating human habit formation to retain good habits and calibrate bad habits, ultimately enabling robust learning under the presence of NTC. Extensive experiments conducted on two standard CIR datasets demonstrate that HABIT significantly outperforms most methods under various noise ratios, exhibiting superior robustness and retrieval performance. Codes are available at https://github.com/Lee-zixu/HABIT

cs.CV↗

INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrieval

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm that enables to retrieve target images based on multimodal queries consisting of reference images and modification texts. Although substantial progress has been made in recent years, existing methods assume that all samples are correctly matched. However, in real-world scenarios, due to high triplet annotation costs, CIR datasets inevitably contain annotation errors, resulting in incorrectly matched triplets. To address this issue, the problem of Noisy Triplet Correspondence (NTC) has attracted growing attention. We argue that noise in CIR can be categorized into two types: cross-modal correspondence noise and modality-inherent noise. The former arises from mismatches across modalities, whereas the latter originates from intra-modal background interference or visual factors irrelevant to the coarse-grained modification annotations. However, modality-inherent noise is often overlooked, and research on cross-modal correspondence noise remains nascent. To tackle above issues, we propose the Invariance and discrimiNaTion-awarE Noise neTwork (INTENT), comprising two components: Visual Invariant Composition and Bi-Objective Discriminative Learning, specifically designed to handle the two-aspect noise. The former applies causal intervention on the visual side via Fast Fourier Transform (FFT) to generate intervened composed features, enforcing visual invariance and enabling the model to ignore modality-inherent noise during composition. The latter adopts collaborative optimization with both positive and negative samples, and constructs a scalable decision boundary that dynamically adjusts decisions based on the loyalty degree, enabling robust correspondence discrimination. Extensive experiments on two widely used benchmark datasets demonstrate the superiority and robustness of INTENT.

cs.CV↗

Distances to molecular clouds in the Galactic longitude l=10-20 deg from the MWISP 12CO 1-0 survey

We present distances to 56 molecular clouds within $10\degr \leq l \leq 20\degr$ and $|b| \leq 5.25\degr$ from the Milky Way Imaging Scroll Painting (MWISP) $^{12}$CO survey, 47 of which are first-time determinations. The molecular clouds were identified using the DBSCAN algorithm, and their distances were measured with the model-calibrated color-distance method using $J-K{_s}$ colors and the distances provided by 2MASS and \textit{Gaia} EDR3. The distances range from $\sim$275 pc to $\sim$2118 pc. We also derived the physical properties of molecular clouds and found a moderate correlation between the dust extinction and the $^{12}$CO integrated intensity.

astro-ph.GA↗

An FUor-like Outbursting Class I Protostar in NGC 7538

We report on the discovery of an FUor-like Class I protostar in NGC~7538. The source, named NGC~7538~MIR, exhibited a giant luminosity burst ($ΔK_s\sim5$) and a prolonged high-luminosity state lasting at least five years. Its mid-infrared (mid-IR) light curves, constructed from WISE/NEOWISE multiepoch data, presented a rapid rise and slight fading after the peak, placing this event among long-duration eruptive phenomena observed in protostars, for example, FUor-type events. The evolution of W1/W2 luminosity and $W1-W2$ color can be naturally split into three phases, pre-burst, burst and post-burst, suggesting that different physical processes may dominate in the three phases. The evolution of NGC~7538~MIR is consistent with a transition from variability influenced by circumstellar extinction (pre-burst) to a phase with greatly enhanced accretion luminosity (burst), and followed by a gradual relaxation of the circumstellar environment (post-burst). Overall, the observed IR variability of NGC~7538~MIR is consistent with an FUor-like accretion event occurred at an early evolutionary stage, highlighting the importance of long-term IR monitoring for identifying episodic accretion events in deeply embedded protostars.

astro-ph.SR↗

STABLE: Efficient Hybrid Nearest Neighbor Search via Magnitude-Uniformity and Cardinality-Robustness

Hybrid Approximate Nearest Neighbor Search (Hybrid ANNS) is a foundational search technology for large-scale heterogeneous data and has gained significant attention in both academia and industry. However, current approaches overlook the heterogeneity in data distribution, thus ignoring two major challenges: the Compatibility Barrier for Similarity Magnitude Heterogeneity and the Tolerance Bottleneck to Attribute Cardinality. To overcome these issues, we propose the robuSt heTerogeneity-Aware hyBrid retrievaL framEwork, STABLE, designed for accurate, efficient, and robust hybrid ANNS under datasets with various distributions. Specifically, we introduce an enhAnced heterogeneoUs semanTic perceptiOn (AUTO) metric to achieve a joint measurement of feature similarity and attribute consistency, addressing similarity magnitude heterogeneity and improving robustness to datasets with various attribute cardinalities. Thereafter, we construct our Heterogeneous sEmantic reLation graPh (HELP) index based on AUTO to organize heterogeneous semantic relations. Finally, we employ a novel Dynamic Heterogeneity Routing method to ensure an efficient search. Extensive experiments on five feature vector benchmarks with various attribute cardinalities demonstrate the superior performance of STABLE.

cs.IR↗

MELT: Improve Composed Image Retrieval via the Modification Frequentation-Rarity Balance Network

Composed Image Retrieval (CIR) uses a reference image and a modification text as a query to retrieve a target image satisfying the requirement of ``modifying the reference image according to the text instructions''. However, existing CIR methods face two limitations: (1) frequency bias leading to ``Rare Sample Neglect'', and (2) susceptibility of similarity scores to interference from hard negative samples and noise. To address these limitations, we confront two key challenges: asymmetric rare semantic localization and robust similarity estimation under hard negative samples. To solve these challenges, we propose the Modification frEquentation-rarity baLance neTwork MELT. MELT assigns increased attention to rare modification semantics in multimodal contexts while applying diffusion-based denoising to hard negative samples with high similarity scores, enhancing multimodal fusion and matching. Extensive experiments on two CIR benchmarks validate the superior performance of MELT. Codes are available at https://github.com/luckylittlezhi/MELT.

cs.CV↗

HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Network

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a reference image and modification text. Although existing methods have made significant progress in cross-modal alignment and feature fusion, a key flaw remains: the neglect of contextual information in discriminating matching samples. However, addressing this limitation is not an easy task due to two challenges: 1) implicit dependencies and 2) the lack of a differential amplification mechanism. To address these challenges, we propose a dual-patH composItional coNtextualized neTwork (HINT), which can perform contextualized encoding and amplify the similarity differences between matching and non-matching samples, thus improving the upper performance of CIR models in complex scenarios. Our HINT model achieves optimal performance on all metrics across two CIR benchmark datasets, demonstrating the superiority of our HINT model. Codes are available at https://github.com/zh-mingyu/HINT.

cs.CV↗

OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrieval

Composed Image Retrieval (CIR) represents a novel retrieval paradigm that is capable of expressing users' intricate retrieval requirements flexibly. It enables the user to give a multimodal query, comprising a reference image and a modification text, and subsequently retrieve the target image. Notwithstanding the considerable advances made by prevailing methodologies, CIR remains in its nascent stages due to two limitations: 1) inhomogeneity between dominant and noisy portions in visual data is ignored, leading to query feature degradation, and 2) the priority of textual data in the image modification process is overlooked, which leads to a visual focus bias. To address these two limitations, this work presents a focus mapping-based feature extractor, which consists of two modules: dominant portion segmentation and dual focus mapping. It is designed to identify significant dominant portions in images and guide the extraction of visual and textual data features, thereby reducing the impact of noise interference. Subsequently, we propose a textually guided focus revision module, which can utilize the modification requirements implied in the text to perform adaptive focus revision on the reference image, thereby enhancing the perception of the modification focus on the composed features. The aforementioned modules collectively constitute the segmentatiOn-based Focus shiFt reviSion nETwork (\mbox{OFFSET}), and comprehensive experiments on four benchmark datasets substantiate the superiority of our proposed method. The codes and data are available on https://zivchen-ty.github.io/OFFSET.github.io/

cs.CV↗

NoOVD: Novel Category Discovery and Embedding for Open-Vocabulary Object Detection

Despite the remarkable progress in open-vocabulary object detection (OVD), a significant gap remains between the training and testing phases. During training, the RPN and RoI heads often misclassify unlabeled novel-category objects as background, causing some proposals to be prematurely filtered out by the RPN while others are further misclassified by the RoI head. During testing, these proposals again receive low scores and are removed in post-processing, leading to a significant drop in recall and ultimately weakening novel-category detection performance.To address these issues, we propose a novel training framework-NoOVD-which innovatively integrates a self-distillation mechanism grounded in the knowledge of frozen vision-language models (VLMs). Specifically, we design K-FPN, which leverages the pretrained knowledge of VLMs to guide the model in discovering novel-category objects and facilitates knowledge distillation-without requiring additional data-thus preventing forced alignment of novel objects with background.Additionally, we introduce R-RPN, which adjusts the confidence scores of proposals during inference to improve the recall of novel-category objects. Cross-dataset evaluations on OV-LVIS, OV-COCO, and Objects365 demonstrate that our approach consistently achieves superior performance across multiple metrics.

cs.CV↗

Detectability of Nearby Binary Neutron Stars with Future sub-mHz Gravitational Wave Missions

Binary neutron stars (BNSs) are one of the most important gravitational wave (GW) sources, which provide key insights to evolution of massive binary stars and nuclear physics. Beyond Laser Interferometer Space Antenna (LISA), Taiji, and Tianqin missions, proposed concepts for next generation space-based GW observatories, including LISAmax, Folkner, and eASTROD, aim to explore the sub-millihertz (mHz) to microhertz ($μ$ Hz) frequency band. Because the proposed designs substantially suppress low-frequency noise, these detectors are expected to outperform LISA, Taiji, and Tianqin in detecting eccentric Galactic BNS systems. In this paper, we estimate the detectability of nearby inspiraling BNSs using future sub-mHz GW detectors. By utilizing compact binary population synthesis simulations to generate mock BNS samples and estimate their signal-to-noise ratios (SNRs) correspondingly for each GW detector over an observation period of $5-10$\,years, we find that LISAmax may detect $\sim 520-900$ Galactic BNSs, whereas Folkner and eASTROD may detect $\sim 780-1370$ Galactic BNSs. Notably, LISAmax excels in detecting highly eccentric systems $(e>0.90)$ owing to its higher sensitivity at relatively higher sub-mHz frequencies. We further identify seven observed radio BNSs as viable candidates for validation, in particular J0737-3039, which reaches an SNR of $\sim 100$. The expected detection number of LMC inspiraling BNSs is about $\sim 4-18$ for these sub-mHz detectors over an observation period of $5-10$\,years, while detecting inspiraling BNSs in SMC is challenging. This study highlights the significant potential of future sub-mHz GW missions in unraveling BNS formation and evolution physics.

astro-ph.HE↗