arXiv subjects

Zhe Wang

Publications and source records attributed to Zhe Wang.

At least 217 records · Page 12Linked to original sources

arXiv2025

Deep learning-based interactive segmentation in remote sensing

Interactive segmentation, a computer vision technique where a user provides guidance to help an algorithm segment a feature of interest in an image, has achieved outstanding accuracy and efficient human-computer interaction. However, few studies have discussed its application to remote sensing imagery, where click-based interactive segmentation could greatly facilitate the analysis of complicated landscapes. This study aims to bridge the gap between click-based interactive segmentation and remote sensing image analysis by conducting a benchmark study on various click-based interactive segmentation models. We assessed the performance of five state-of-the-art interactive segmentation methods (Reviving Iterative Training with Mask Guidance for Interactive Segmentation (RITM), FocalClick, SimpleClick, Iterative Click Loss (ICL), and Segment Anything (SAM)) on two high-resolution aerial imagery datasets. The Cascade-Forward Refinement (CFR) approach, an innovative inference strategy for interactive segmentation, was also introduced to enhance the segmentation results without requiring manual efforts. We further integrated CFR into all models for comparison. The performance of these methods on various land cover types, different object sizes, and multiple band combinations in the datasets was evaluated. The SimpleClick-CFR model consistently outperformed the other methods in our experiments. Building upon these findings, we developed a dedicated online tool called SegMap for interactive segmentation of remote sensing data. SegMap incorporates a well-performing interactive model that is fine-tuned with remote sensing data. Unlike existing interactive segmentation tools, SegMap offers robust interactivity, modifiability, and adaptability to analyze remote sensing imagery.

cs.CV↗

arXiv2025

Structure of Dubrovin-Zhang free energy functions and universal identities

We prove a structural theorem relating the higher genera free energy functions of the Dubrovin-Zhang hierarchies to the Witten-Kontsevich free energy function of the Korteweg-de Vries hierarchy. As an important application, for any given genus $g\geq 1$, we construct a set of universal identities valid for the free energy functions of any Dubrovin-Zhang hierarchy. In particular, we present some techniques that can be used to derive universal identities without relying on the geometry of the moduli space of stable curves of higher genus.

math-ph↗

arXiv2025

ROMA: ROtary and Movable Antenna

The rotary and movable antenna (ROMA) architecture represents a next-generation multi-antenna technology that enables flexible adjustment of antenna position and array rotation angles of the transceiver. In this letter, we propose a ROMA-aided multi-user MIMO communication system to fully enhance the efficiency and reliability of system transmissions. By deploying ROMA panels at both the transmitter and receiver sides, and jointly optimizing the three-dimensional (3D) rotation angles of each ROMA panel and the relative positions of antenna elements based on the spatial distribution of users and channel state information (CSI), we can achieve the objective of maximizing the average spectral efficiency (SE). Subsequently, we conduct a detailed analysis of the average SE performance of the system under the consideration of maximum ratio (MR) precoding. Due to the non-convexity of the optimization problem in the ROMA multi-user MIMO system, we propose an efficient solution based on an alternating optimization (AO) algorithm. Finally, simulation results demonstrate that the AO-based ROMA architecture can significantly improve the average SE. Furthermore, the performance improvement becomes more pronounced as the size of the movable region and the transmission power increase.

eess.SP↗

arXiv2025

TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusion

Radar-Camera depth estimation aims to predict dense and accurate metric depth by fusing input images and Radar data. Model efficiency is crucial for this task in pursuit of real-time processing on autonomous vehicles and robotic platforms. However, due to the sparsity of Radar returns, the prevailing methods adopt multi-stage frameworks with intermediate quasi-dense depth, which are time-consuming and not robust. To address these challenges, we propose TacoDepth, an efficient and accurate Radar-Camera depth estimation model with one-stage fusion. Specifically, the graph-based Radar structure extractor and the pyramid-based Radar fusion module are designed to capture and integrate the graph structures of Radar point clouds, delivering superior model efficiency and robustness without relying on the intermediate depth results. Moreover, TacoDepth can be flexible for different inference modes, providing a better balance of speed and accuracy. Extensive experiments are conducted to demonstrate the efficacy of our method. Compared with the previous state-of-the-art approach, TacoDepth improves depth accuracy and processing speed by 12.8% and 91.8%. Our work provides a new perspective on efficient Radar-Camera depth estimation.

cs.CV↗

arXiv2025

LPViT: Low-Power Semi-structured Pruning for Vision Transformers

Vision transformers have emerged as a promising alternative to convolutional neural networks for various image analysis tasks, offering comparable or superior performance. However, one significant drawback of ViTs is their resource-intensive nature, leading to increased memory footprint, computation complexity, and power consumption. To democratize this high-performance technology and make it more environmentally friendly, it is essential to compress ViT models, reducing their resource requirements while maintaining high performance. In this paper, we introduce a new block-structured pruning to address the resource-intensive issue for ViTs, offering a balanced trade-off between accuracy and hardware acceleration. Unlike unstructured pruning or channel-wise structured pruning, block pruning leverages the block-wise structure of linear layers, resulting in more efficient matrix multiplications. To optimize this pruning scheme, our paper proposes a novel hardware-aware learning objective that simultaneously maximizes speedup and minimizes power consumption during inference, tailored to the block sparsity structure. This objective eliminates the need for empirical look-up tables and focuses solely on reducing parametrized layer connections. Moreover, our paper provides a lightweight algorithm to achieve post-training pruning for ViTs, utilizing second-order Taylor approximation and empirical optimization to solve the proposed hardware-aware objective. Extensive experiments on ImageNet are conducted across various ViT architectures, including DeiT-B and DeiT-S, demonstrating competitive performance with other pruning methods and achieving a remarkable balance between accuracy preservation and power savings. Especially, we achieve 3.93x speedup on dedicated hardware and GPUs respectively for DeiT-B, and a power reduction by 1.4x on GPUs. Code released to https://github.com/Akimoto-Cris/LPViT.

cs.CV↗

arXiv2025

Scanning-free three-dimensional fluorescent dipoles imaging by polarization self-interference digital holography (pSIDH)

Polarization microscopy provides insights into the structure and orientational organization of biomolecules and their architectures in cells. The above key functional signatures, which are natively 3D, can be only detected in 2D for a single measurement in conventional polarization microscopy. It is so far a challenging task to capture simultaneously the 3D structure and molecular orientation in a single frame of far-field intensity distribution, within the timescale of rapid-happened spatial organization events of bio-complexes. We report an optical imaging method called pSIDH, to encode multidimensional sample information includes 3D structures and dipole orientations, in their far-field fluorescence-self-interference pattern. The computational reconstruction from the holographic extracted complex-valued light field provides optical-aberration-corrected 3D polarization images of the sample. In pSIDH microscope incorporating planar liquid crystal lens and high numerical aperture objective, we demonstrate scanning-free 3D volumetric polarization imaging of fluorescently-labelled sample, with simultaneously computational-improved system measuring accuracy on the 3D spatial and polarization dimensions. The pSIDH imaging on phalloidin-fluorophore labelling U2OS cells provides rapid tools of capturing simultaneous the 3D structural details and spatial-averaged molecular orientation distributions of biological complex architectures such as actin filaments.

physics.optics↗

arXiv2025

MoEDiff-SR: Mixture of Experts-Guided Diffusion Model for Region-Adaptive MRI Super-Resolution

Magnetic Resonance Imaging (MRI) at lower field strengths (e.g., 3T) suffers from limited spatial resolution, making it challenging to capture fine anatomical details essential for clinical diagnosis and neuroimaging research. To overcome this limitation, we propose MoEDiff-SR, a Mixture of Experts (MoE)-guided diffusion model for region-adaptive MRI Super-Resolution (SR). Unlike conventional diffusion-based SR models that apply a uniform denoising process across the entire image, MoEDiff-SR dynamically selects specialized denoising experts at a fine-grained token level, ensuring region-specific adaptation and enhanced SR performance. Specifically, our approach first employs a Transformer-based feature extractor to compute multi-scale patch embeddings, capturing both global structural information and local texture details. The extracted feature embeddings are then fed into an MoE gating network, which assigns adaptive weights to multiple diffusion-based denoisers, each specializing in different brain MRI characteristics, such as centrum semiovale, sulcal and gyral cortex, and grey-white matter junction. The final output is produced by aggregating the denoised results from these specialized experts according to dynamically assigned gating probabilities. Experimental results demonstrate that MoEDiff-SR outperforms existing state-of-the-art methods in terms of quantitative image quality metrics, perceptual fidelity, and computational efficiency. Difference maps from each expert further highlight their distinct specializations, confirming the effective region-specific denoising capability and the interpretability of expert contributions. Additionally, clinical evaluation validates its superior diagnostic capability in identifying subtle pathological features, emphasizing its practical relevance in clinical neuroimaging. Our code is available at https://github.com/ZWang78/MoEDiff-SR.

eess.IV↗

arXiv2025

NeRFlex: Resource-aware Real-time High-quality Rendering of Complex Scenes on Mobile Devices

Neural Radiance Fields (NeRF) is a cutting-edge neural network-based technique for novel view synthesis in 3D reconstruction. However, its significant computational demands pose challenges for deployment on mobile devices. While mesh-based NeRF solutions have shown potential in achieving real-time rendering on mobile platforms, they often fail to deliver high-quality reconstructions when rendering practical complex scenes. Additionally, the non-negligible memory overhead caused by pre-computed intermediate results complicates their practical application. To overcome these challenges, we present NeRFlex, a resource-aware, high-resolution, real-time rendering framework for complex scenes on mobile devices. NeRFlex integrates mobile NeRF rendering with multi-NeRF representations that decompose a scene into multiple sub-scenes, each represented by an individual NeRF network. Crucially, NeRFlex considers both memory and computation constraints as first-class citizens and redesigns the reconstruction process accordingly. NeRFlex first designs a detail-oriented segmentation module to identify sub-scenes with high-frequency details. For each NeRF network, a lightweight profiler, built on domain knowledge, is used to accurately map configurations to visual quality and memory usage. Based on these insights and the resource constraints on mobile devices, NeRFlex presents a dynamic programming algorithm to efficiently determine configurations for all NeRF representations, despite the NP-hardness of the original decision problem. Extensive experiments on real-world datasets and mobile devices demonstrate that NeRFlex achieves real-time, high-quality rendering on commercial mobile devices.

cs.GR↗

arXiv2025

Single-Molecule Vibrational Characterization of Binding Geometry Effects on Isocyanide-Metal Interactions

Isocyanide-metal binding is governed by sigma-donation and pi-back-bonding, which affects the energy of the isocyanide stretching mode-a characteristic probe for ligand-metal interactions. While extensive correlations exist between structure and spectroscopy in molecular isocyanide-metal systems, isocyanide interactions with metallic crystalline surfaces, where ligands often bind in various geometries, remain poorly understood. Conventional vibrational spectroscopies, such as infrared and Raman, lack the molecular-scale resolution needed to distinguish these inhomogeneous configurations. In contrast, inelastic electron tunneling spectroscopy with scanning tunneling microscopy (STM-IETS) enables direct visualization of ligand adsorption geometries and their vibrational signatures. Using STM-IETS, here we investigate a matal-adsorbed m-terphenyl isocyanie ligand and find that adsorption geometry on Cu(100) induces a significant shift in isocyanide stretching frequency, even greater than replacing Cu(100) with Ag(111). Density functional theory confirms this shift arises from atomic-scale variations in isocyanide-metal binding. This study elucidates how atomic-scale binding influences the vibrational signatures of isocyanide ligands-an often-overlooked factor in understanding isocyanide-metal interactions.

cond-mat.mes-hall↗

arXiv2025

PathOrchestra: A Comprehensive Foundation Model for Computational Pathology with Over 100 Diverse Clinical-Grade Tasks

The complexity and variability inherent in high-resolution pathological images present significant challenges in computational pathology. While pathology foundation models leveraging AI have catalyzed transformative advancements, their development demands large-scale datasets, considerable storage capacity, and substantial computational resources. Furthermore, ensuring their clinical applicability and generalizability requires rigorous validation across a broad spectrum of clinical tasks. Here, we present PathOrchestra, a versatile pathology foundation model trained via self-supervised learning on a dataset comprising 300K pathological slides from 20 tissue and organ types across multiple centers. The model was rigorously evaluated on 112 clinical tasks using a combination of 61 private and 51 public datasets. These tasks encompass digital slide preprocessing, pan-cancer classification, lesion identification, multi-cancer subtype classification, biomarker assessment, gene expression prediction, and the generation of structured reports. PathOrchestra demonstrated exceptional performance across 27,755 WSIs and 9,415,729 ROIs, achieving over 0.950 accuracy in 47 tasks, including pan-cancer classification across various organs, lymphoma subtype diagnosis, and bladder cancer screening. Notably, it is the first model to generate structured reports for high-incidence colorectal cancer and diagnostically complex lymphoma-areas that are infrequently addressed by foundational models but hold immense clinical potential. Overall, PathOrchestra exemplifies the feasibility and efficacy of a large-scale, self-supervised pathology foundation model, validated across a broad range of clinical-grade tasks. Its high accuracy and reduced reliance on extensive data annotation underline its potential for clinical integration, offering a pathway toward more efficient and high-quality medical services.

cs.CV↗

arXiv2025

Convergence of scaled asymptotically-free self-interacting random walks to Brownian motion perturbed at extrema

We consider a family of one-dimensional self interacting walks whose dynamics characterized by a monotone weight function $w$ on $\mathbb{N}\cup \{0\}$. The weight function takes the form $w(n) = (1 + 2^p Bn^{-p} + O(n^{-1-κ}))^{-1}$, for some $B \in \mathbb{R} $, $κ>0$ and $p\in (0,1]$. Our main model parameter is $p$, and for $p\in (0,1/2]$ we show the convergence of the SIRW to Brownian motion perturbed at extrema under the diffusive scaling. This completes the functional limit theorem in [8] for the asymptotically free case and extends the result to the full parameter range $(0,1]$. Our method depends on the generalized Ray-Knight theorems ([T96], [KMP23]) for the rescaled local times of this walk. The directed edge local times, described by the branching-like processes, are used to analyze the total drift experienced by the walker.

math.PR↗

arXiv2025

Goal-oriented Semantic Communications for Metaverse Construction via Generative AI and Optimal Transport

The emergence of the metaverse has boosted productivity and creativity, driving real-time updates and personalized content, which will substantially increase data traffic. However, current bit-oriented communication networks struggle to manage this high volume of dynamic information, restricting metaverse applications interactivity. To address this research gap, we propose a goal-oriented semantic communication (GSC) framework for metaverse. Building on an existing metaverse wireless construction task, our proposed GSC framework includes an hourglass network-based (HgNet) encoder to extract semantic information of objects in the metaverse; and a semantic decoder that uses this extracted information to reconstruct the metaverse content after wireless transmission, enabling efficient communication and real-time object behaviour updates to the scenery for metaverse construction task. To overcome the wireless channel noise at the receiver, we design an optimal transport (OT)-enabled semantic denoiser, which enhances the accuracy of metaverse scenery through wireless communication. Experimental results show that compared to the conventional metaverse construction, our proposed GSC framework significantly reduces wireless metaverse construction latency by 92.6\%, while improving metaverse object status accuracy and viewing experience by 45.6\% and 44.7\%, respectively.

eess.SY↗

arXiv2025

The ScIDEP Muon Radiography Project at the Egyptian Pyramid of Khafre

The ScIDEP Collaboration is constructing muon telescopes based on scintillator technology to investigate the internal structure of the Egyptian Pyramid of Khafre at Giza near Cairo using cosmic-ray muons. The collaboration aims to scan the pyramid from multiple viewpoints, both inside the King's burial chamber that is located centrally at the base of the pyramid, and outside of the pyramid, to potentially identify any new internal structures. An overview of the project is presented, including the development of the data-acquisition system, the simulation framework, and very first detector studies.

physics.ins-det↗

arXiv2025

Sampling reduced density matrix to extract fine levels of entanglement spectrum and restore entanglement Hamiltonian

The reduced density matrix (RDM) plays a key role in quantum entanglement and measurement, as it allows the extraction of almost all physical quantities related to the reduced degrees of freedom. However, restricted by the degrees of freedom in the environment, the total system size is often limited, let alone the subsystem. To address this challenge, we propose a quantum Monte Carlo scheme with a low technical barrier, enabling precise extraction of the RDM. To demonstrate the power of the method, we present the fine levels of the entanglement spectrum (ES), which is the logarithmic eigenvalues of the RDM. We clearly show the ES for a $1$D ladder with a long entangled boundary, and that for the $2$D Heisenberg model with a tower of states. Furthermore, we put forward an efficient way to restore the entanglement Hamiltonian in operator-form from the sampled RDM data. Our simulation results, utilizing unprecedentedly large system sizes, establish a practical computational framework for determining entanglement quantities based on the RDM, such as the ES, particularly in scenarios where the environment has a huge number of degrees of freedom.

quant-ph↗

arXiv2025

Feasibility study for reconstruction of knee MRI from one corresponding X-ray via CNN

Generally, X-ray, as an inexpensive and popular medical imaging technique, is widely chosen by medical practitioners. With the development of medical technology, Magnetic Resonance Imaging (MRI), an advanced medical imaging technique, has already become a supplementary diagnostic option for the diagnosis of KOA. We propose in this paper a deep-learning-based approach for generating MRI from one corresponding X-ray. Our method uses the hidden variables of a Convolutional Auto-Encoder (CAE) model, trained for reconstructing X-ray image, as inputs of a generator model to provide 3D MRI.

eess.IV↗

arXiv2025

Multi-Cue Adaptive Visual Token Pruning for Large Vision-Language Models

As the computational needs of Large Vision-Language Models (LVLMs) increase, visual token pruning has proven effective in improving inference speed and memory efficiency. Traditional pruning methods in LVLMs predominantly focus on attention scores to determine token relevance, overlooking critical aspects such as spatial position and token similarity. To this end, we introduce AdaptPrune, a novel plug-and-play training-free pruning method that builds on conventional attention-based pruning by integrating spatial distance and token similarity with an adaptive NMS approach. Our method is based on several observed phenomena in large models: the positional bias in the model's image attention and the redundancy of token information ignored by previous approaches. By integrating attention, spatial, and similarity information, our approach ensures a comprehensive evaluation of token importance and substantially refines the pruning decisions. Our method has been extensively tested across various LVLMs and benchmarks, confirming its robustness and adaptability. The results demonstrate that AdaptPrune consistently outperforms existing methods across various pruning ratios. Code is available at https://github.com/bzluan/AdaptPrune.

cs.CV↗

arXiv2025

Quantum spin dynamics of the honeycomb magnet K$_2$Co$_2$TeO$_6$ in high magnetic fields

We present terahertz spectroscopic measurements of quantum spin dynamics in the honeycomb magnet K$_2$Co$_2$TeO$_6$ as a function of temperature, polarization and in an external magnetic field applied in the honeycomb plane. Magnetic excitations are resolved below the magnetic ordering temperature of $T_\text{N}$ = 12 K. In the applied magnetic field, we reveal characteristic field dependence not only for the magnetic excitations observed at zero field, but also a rich set of modes emerging in finite fields. The observed magnetic excitations exhibit clear dependence on the terahertz polarization, and characteristic features at field-induced phase transitions consistent with our high-field magnetization data. We cannot evidently resolve a continuumlike feature, even when the long-range magnetic order is presumably suppressed in the strong magnetic field, indicating that a Kitaev-type interaction, if existing, is subleading in this compound.

cond-mat.str-el↗

arXiv2025

An Efficient 3D Convolutional Neural Network with Channel-wise, Spatial-grouped, and Temporal Convolutions

There has been huge progress on video action recognition in recent years. However, many works focus on tweaking existing 2D backbones due to the reliance of ImageNet pretraining, which restrains the models from achieving higher efficiency for video recognition. In this work we introduce a simple and very efficient 3D convolutional neural network for video action recognition. The design of the building block consists of a channel-wise convolution, followed by a spatial group convolution, and finally a temporal convolution. We evaluate the performance and efficiency of our proposed network on several video action recognition datasets by directly training on the target dataset without relying on pertaining. On Something-Something-V1&V2, Kinetics-400 and Multi-Moments in Time, our network can match or even surpass the performance of other models which are several times larger. On the fine-grained action recognition dataset FineGym, we beat the previous state-of-the-art accuracy achieved with 2-stream methods by more than 5% using only RGB input.

cs.CV↗