arXiv subjects

Hao Zheng

Publications and source records attributed to Hao Zheng.

At least 91 records · Page 5Linked to original sources

arXiv2026

OFFSIDE: Benchmarking Unlearning Misinformation in Multimodal Large Language Models

Advances in Multimodal Large Language Models (MLLMs) intensify concerns about data privacy, making Machine Unlearning (MU), the selective removal of learned information, a critical necessity. However, existing MU benchmarks for MLLMs are limited by a lack of image diversity, potential inaccuracies, and insufficient evaluation scenarios, which fail to capture the complexity of real-world applications. To facilitate the development of MLLMs unlearning and alleviate the aforementioned limitations, we introduce OFFSIDE, a novel benchmark for evaluating misinformation unlearning in MLLMs based on football transfer rumors. This manually curated dataset contains 15.68K records for 80 players, providing a comprehensive framework with four test sets to assess forgetting efficacy, generalization, utility, and robustness. OFFSIDE supports advanced settings like selective unlearning and corrective relearning, and crucially, unimodal unlearning (forgetting only text data). Our extensive evaluation of multiple baselines reveals key findings: (1) Unimodal methods (erasing text-based knowledge) fail on multimodal rumors; (2) Unlearning efficacy is largely driven by catastrophic forgetting; (3) All methods struggle with "visual rumors" (rumors appear in the image); (4) The unlearned rumors can be easily recovered and (5) All methods are vulnerable to prompt attacks. These results expose significant vulnerabilities in current approaches, highlighting the need for more robust multimodal unlearning solutions. The code is available at https://github.com/zh121800/OFFSIDE

cs.AI↗

arXiv2025

Coexistence of unconventional spin-orbit torque and in-plane Hall effect in a single ferromagnetic layer

The symmetry of a material fundamentally governs its spin transport properties. While unconventional spin transport phenomena have been predominantly explored in low-symmetry systems (e.g., $C_{1v}$ symmetry), high-symmetry crystals--which constitute the majority of industry-compatible materials--are generally expected to exhibit only conventional spin-transport behavior. Here, we report the coexistence of two unconventional spin transport effects, the crystal spin-orbit torque (CSOT) and the crystal in-plane Hall effect (CIHE), in a CoPt single ferromagnetic layer with $C_{3v}$ symmetry. Leveraging the CSOT, we achieve nearly 100% field-free perpendicular magnetization switching in a 6 nm CoPt layer at room temperature. Simultaneously, the CIHE observed in this material exhibits nearly identical dependencies on both current angle and growth temperature as the CSOT. Symmetry analysis confirms that both effects share a common physical origin. Our work not only establishes CoPt as a high-performance spin-orbit material, but also demonstrates that unconventional spin transport can be realized in high-symmetry systems, thereby opening a broad pathway for their application in practical spintronics.

cond-mat.mes-hall↗

arXiv2025

TB or Not TB: Coverage-Driven Direct Preference Optimization for Verilog Stimulus Generation

With the rapid advancement of Large Language Models (LLMs), there is growing interest in applying them to hardware design and verification. Among these stages, design verification remains the most time-consuming and resource-intensive phase, where generating effective stimuli for the design under test (DUT) is both critical and labor-intensive. We present {\it TB or not TB}, a framework for automated stimulus generation using LLMs fine-tuned through Coverage-Driven Direct Preference Optimization (CD-DPO). To enable preference-based training, we introduce PairaNet, a dataset derived from PyraNet that pairs high- and low-quality testbenches labeled using simulation-derived coverage metrics. The proposed CD-DPO method integrates quantitative coverage feedback directly into the optimization objective, guiding the model toward generating stimuli that maximize verification coverage. Experiments on the CVDP CID12 benchmark show that {\it TB or not TB} outperforms both open-source and commercial baselines, achieving up to 77.27\% improvement in code coverage, demonstrating the effectiveness of Coverage-driven preference optimization for LLM-based hardware verification.

cs.LG↗

arXiv2025

Taiji: A DPU Memory Elasticity Solution for In-production Cloud Environments

The growth of cloud computing drives data centers toward higher density and efficiency. Data processing units (DPUs) enhance server network and storage performance but face challenges such as long hardware upgrade cycles and limited resources. To address these, we propose Taiji, a resource-elasticity architecture for DPUs. Combining hybrid virtualization with parallel memory swapping, Taiji switches the DPU's operating system (OS) into a guest OS and inserts a lightweight virtualization layer, making nearly all DPU memory swappable. It achieves memory overcommitment for the switched guest OS via high-performance memory elasticity, fully transparent to upper-layer applications, and supports hot-switch and hot-upgrade to meet in-production cloud requirements. Experiments show that Taiji expands DPU memory resources by over 50%, maintains virtualization overhead around 5%, and ensures 90% of swap-ins complete within 10 microseconds. Taiji delivers an efficient, reliable, low-overhead elasticity solution for DPUs and is deployed in large-scale production systems across more than 30,000 servers.

cs.OS↗

arXiv2025

TopoPerception: A Shortcut-Free Evaluation of Global Visual Perception in Large Vision-Language Models

Large Vision-Language Models (LVLMs) typically align visual features from an encoder with a pre-trained Large Language Model (LLM). However, this makes the visual perception module a bottleneck, which constrains the overall capabilities of LVLMs. Conventional evaluation benchmarks, while rich in visual semantics, often contain unavoidable local shortcuts that can lead to an overestimation of models' perceptual abilities. Here, we introduce TopoPerception, a benchmark that leverages topological properties to rigorously evaluate the global visual perception capabilities of LVLMs across various granularities. Since topology depends on the global structure of an image and is invariant to local features, TopoPerception enables a shortcut-free assessment of global perception, fundamentally distinguishing it from semantically rich tasks. We evaluate state-of-the-art models on TopoPerception and find that even at the coarsest perceptual granularity, all models perform no better than random chance, indicating a profound inability to perceive global visual features. Notably, a consistent trend emerge within model families: more powerful models with stronger reasoning capabilities exhibit lower accuracy. This suggests that merely scaling up models is insufficient to address this deficit and may even exacerbate it. Progress may require new training paradigms or architectures. TopoPerception not only exposes a critical bottleneck in current LVLMs but also offers a lens and direction for improving their global visual perception. The data and code are publicly available at: https://github.com/Wenhao-Zhou/TopoPerception.

cs.AI↗

arXiv2025

Vmem: A Lightweight Hot-Upgradable Memory Management for In-production Cloud Environment

Traditional memory management suffers from metadata overhead, architectural complexity, and stability degradation, problems intensified in cloud environments. Existing software/hardware optimizations are insufficient for cloud computing's dual demands of flexibility and low overhead. This paper presents Vmem, a memory management architecture for in-production cloud environments that enables flexible, efficient cloud server memory utilization through lightweight reserved memory management. Vmem is the first such architecture to support online upgrades, meeting cloud requirements for high stability and rapid iterative evolution. Experiments show Vmem increases sellable memory rate by about 2%, delivers extreme elasticity and performance, achieves over 3x faster boot time for VFIO-based virtual machines (VMs), and improves network performance by about 10% for DPU-accelerated VMs. Vmem has been deployed at large scale for seven years, demonstrating efficiency and stability on over 300,000 cloud servers supporting hundreds of millions of VMs.

cs.OS↗

arXiv2025

Stacking-orientation and twist-angle control on integer and fractional Chern insulators in moiré rhombohedral graphene

Rhombohedral-stacked multilayer graphene aligned with hexagonal boron nitride has emerged as an excellent platform for investigating exotic quantum phenomena arising from the interplay between electron correlations and nontrivial topology. However, the microscopic mechanism governing the emergence of both the integer and fractional Chern insulator states in this system remains an open question. In this work, we systematically investigate the electrical transport properties of RMG/hBN moiré devices with controlled alignment orientations and twist angles. We demonstrate that alignment orientation strongly modulates correlated phenomena in the moiré-proximal regime, while having negligible influence on the formation of integer and fractional Chern insulators in the moiré-distant regime. Instead, the moiré periodicity, tuned by the twist angle, serves as the key parameter controlling the stability of these correlated topological states in the moiré-distant regime. Furthermore, in the moiré-proximal regime of one specific alignment, we observe anomalous Hall effect and a variety of competing phases near ν = 1, including integer Chern insulator states, extended Chern insulator states, and trivial insulators, whose stability is highly sensitive to both the applied displacement electric field and magnetic field. Our results underscore the critical role of stacking-alignment and twist-angle engineering in exploring novel quantum states based on rhombohedral-stacked multilayer graphene moiré systems.

cond-mat.mes-hall↗

arXiv2025

X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding

Long-form egocentric video understanding provides rich contextual information and unique insights into long-term human behaviors, holding significant potential for applications in embodied intelligence, long-term activity analysis, and personalized assistive technologies. However, existing benchmark datasets primarily focus on single, short (\eg, minutes to tens of minutes) to moderately long videos, leaving a substantial gap in evaluating extensive, ultra-long egocentric video recordings. To address this, we introduce X-LeBench, a novel benchmark dataset meticulously designed to fill this gap by focusing on tasks requiring a comprehensive understanding of extremely long egocentric video recordings. Our X-LeBench develops a life-logging simulation pipeline that produces realistic, coherent daily plans aligned with real-world video data. This approach enables the flexible integration of synthetic daily plans with real-world footage from Ego4D-a massive-scale egocentric video dataset covers a wide range of daily life scenarios-resulting in 432 simulated video life logs spanning from 23 minutes to 16.4 hours. The evaluations of several baseline systems and multimodal large language models (MLLMs) reveal their poor performance across the board, highlighting the inherent challenges of long-form egocentric video understanding, such as temporal localization and reasoning, context aggregation, and memory retention, and underscoring the need for more advanced models.

cs.CV↗

arXiv2025

Generalized Witt and Morita equivalences

In this work, we introduce a family of new equivalence relations among fusion categories that are less refined than the usual Morita equivalence. We obtain abelian groups by quotienting these new equivalence relations from the commutative monoids of the equivalence classes of all fusion categories. Moreover, we upgrade them to equivalence relations among nondegenerate braided fusion categories that are more refined than the usual Witt equivalence. As a consequence, we obtain new abelian groups that are more refined than the usual Witt group. These new groups allow us to access the internal structures within Witt classes. We expect that they are useful in the classification program of (braided) fusion (higher) categories and in the study of gapless edges of 2+1D topological orders.

math.QA↗

arXiv2025

A Hybrid Framework Bridging CNN and ViT based on Theory of Evidence for Diabetic Retinopathy Grading

Diabetic retinopathy (DR) is a leading cause of vision loss among middle-aged and elderly people, which significantly impacts their daily lives and mental health. To improve the efficiency of clinical screening and enable the early detection of DR, a variety of automated DR diagnosis systems have been recently established based on convolutional neural network (CNN) or vision Transformer (ViT). However, due to the own shortages of CNN / ViT, the performance of existing methods using single-type backbone has reached a bottleneck. One potential way for the further improvements is integrating different kinds of backbones, which can fully leverage the respective strengths of them (\emph{i.e.,} the local feature extraction capability of CNN and the global feature capturing ability of ViT). To this end, we propose a novel paradigm to effectively fuse the features extracted by different backbones based on the theory of evidence. Specifically, the proposed evidential fusion paradigm transforms the features from different backbones into supporting evidences via a set of deep evidential networks. With the supporting evidences, the aggregated opinion can be accordingly formed, which can be used to adaptively tune the fusion pattern between different backbones and accordingly boost the performance of our hybrid model. We evaluated our method on two publicly available DR grading datasets. The experimental results demonstrate that our hybrid model not only improves the accuracy of DR grading, compared to the state-of-the-art frameworks, but also provides the excellent interpretability for feature fusion and decision-making.

cs.CV↗

arXiv2025

Label Smoothing Improves Gradient Ascent in LLM Unlearning

LLM unlearning has emerged as a promising approach, aiming to enable models to forget hazardous/undesired knowledge at low cost while preserving as much model utility as possible. Among existing techniques, the most straightforward method is performing Gradient Ascent (GA) w.r.t. the forget data, thereby forcing the model to unlearn the forget dataset. However, GA suffers from severe instability, as it drives updates in a divergent direction, often resulting in drastically degraded model utility. To address this issue, we propose Smoothed Gradient Ascent (SGA). SGA combines the forget data with multiple constructed normal data through a tunable smoothing rate. Intuitively, this extends GA from learning solely on the forget data to jointly learning across both forget and normal data, enabling more stable unlearning while better preserving model utility. Theoretically, we provide the theoretical guidance on the selection of the optimal smoothing rate. Empirically, we evaluate SGA on three benchmarks: TOFU, Harry Potter, and MUSE-NEWS. Experimental results demonstrate that SGA consistently outperforms the original Gradient Ascent (GA) method across all metrics and achieves top-2 performance among all baseline methods on several key metrics.

cs.LG↗

arXiv2025

AeroDiT: Diffusion Transformers for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flows

Real-time and accurate prediction of aerodynamic flow fields around airfoils is crucial for flow control and aerodynamic optimization. However, achieving this remains challenging due to the high computational costs and the non-linear nature of flow physics. Traditional Computational Fluid Dynamics (CFD) methods face limitations in balancing computational efficiency and accuracy, hindering their application in real-time scenarios. To address these challenges, this study presents AeroDiT, a novel surrogate model that integrates scalable diffusion models with transformer architectures to address these challenges. Trained on Reynolds-Averaged Navier-Stokes (RANS) simulation data for high Reynolds-number airfoil flows, AeroDiT accurately captures complex flow patterns while enabling real-time predictions. The model demonstrates impressive performance, with mean relative $L_2$ errors of 0.1, 0.025, and 0.050 for pressure $p$ and velocity components $u_x, u_y$, confirming its reliability. To further enhance physical consistency, we incorporate explicit physics-informed losses based on RANS residuals, including mass and momentum conservation constraints. The transformer-based structure allows for real-time predictions within seconds, enabling efficient aerodynamic simulations. This work underscores the potential of generative machine learning techniques to advance computational fluid dynamics, offering potential solutions to challenges in simulating high-fidelity aerodynamic flows.

physics.flu-dyn↗

arXiv2025

Cell Instance Segmentation: The Devil Is in the Boundaries

State-of-the-art (SOTA) methods for cell instance segmentation are based on deep learning (DL) semantic segmentation approaches, focusing on distinguishing foreground pixels from background pixels. In order to identify cell instances from foreground pixels (e.g., pixel clustering), most methods decompose instance information into pixel-wise objectives, such as distances to foreground-background boundaries (distance maps), heat gradients with the center point as heat source (heat diffusion maps), and distances from the center point to foreground-background boundaries with fixed angles (star-shaped polygons). However, pixel-wise objectives may lose significant geometric properties of the cell instances, such as shape, curvature, and convexity, which require a collection of pixels to represent. To address this challenge, we present a novel pixel clustering method, called Ceb (for Cell boundaries), to leverage cell boundary features and labels to divide foreground pixels into cell instances. Starting with probability maps generated from semantic segmentation, Ceb first extracts potential foreground-foreground boundaries with a revised Watershed algorithm. For each boundary candidate, a boundary feature representation (called boundary signature) is constructed by sampling pixels from the current foreground-foreground boundary as well as the neighboring background-foreground boundaries. Next, a boundary classifier is used to predict its binary boundary label based on the corresponding boundary signature. Finally, cell instances are obtained by dividing or merging neighboring regions based on the predicted boundary labels. Extensive experiments on six datasets demonstrate that Ceb outperforms existing pixel clustering methods on semantic segmentation probability maps. Moreover, Ceb achieves highly competitive performance compared to SOTA cell instance segmentation methods.

cs.CV↗

arXiv2025

PinPoint3D: Fine-Grained 3D Part Segmentation from a Few Clicks

Fine-grained 3D part segmentation is crucial for enabling embodied AI systems to perform complex manipulation tasks, such as interacting with specific functional components of an object. However, existing interactive segmentation methods are largely confined to coarse, instance-level targets, while non-interactive approaches struggle with sparse, real-world scans and suffer from a severe lack of annotated data. To address these limitations, we introduce PinPoint3D, a novel interactive framework for fine-grained, multi-granularity 3D segmentation, capable of generating precise part-level masks from only a few user point clicks. A key component of our work is a new 3D data synthesis pipeline that we developed to create a large-scale, scene-level dataset with dense part annotations, overcoming a critical bottleneck that has hindered progress in this field. Through comprehensive experiments and user studies, we demonstrate that our method significantly outperforms existing approaches, achieving an average IoU of around 55.8% on each object part under first-click settings and surpassing 71.3% IoU with only a few additional clicks. Compared to current state-of-the-art baselines, PinPoint3D yields up to a 16% improvement in IoU and precision, highlighting its effectiveness on challenging, sparse point clouds with high efficiency. Our work represents a significant step towards more nuanced and precise machine perception and interaction in complex 3D environments.

cs.CV↗

arXiv2025

Higher condensation theory

We develop a unified mathematical theory of defect condensations for topological orders in all dimensions based on higher categories, higher algebras and higher representations. A k-codimensional topological defect $A$ in an n+1D (potentially anomalous) topological order $C^{n+1}$ is condensable if it is equipped with the structure of a condensable $E_k$-algebra. Condensing such a defect $A$ amounts to a k-step process. In the first step, we condense the defect $A$ along one of its transversal directions, thus obtaining a (k-1)-codimensional defect $ΣA$, which is naturally equipped with the structure of a condensable $E_{k-1}$-algebra. In the second step, we condense the defect $ΣA$ in one of the remaining transversal directions, thus obtaining a (k-2)-codimensional defect $Σ^2 A$, so on and so forth. In the k-th step, we condense the 1-codimensional defect $Σ^{k-1}A$ along the only transversal direction, thus defining a phase transition from $C^{n+1}$ to a new n+1D topological order $D^{n+1}$. We give precise mathematical descriptions of each step in above process, including the precise mathematical characterization of the condensed phase $D^{n+1}$. When $C^{n+1}$ is anomaly-free, the same phase transition can be alternatively defined by replacing the last two steps by a single step of condensing the $E_2$-algebra $Σ^{k-2}A$ directly along the remaining two transversal directions. When n=2, this modified last step is precisely a usual anyon condensation in a 2+1D topological order. We derive many new mathematical results physically along the way. We also establish the connections among various notions of "gauging" symmetries. We also briefly discuss questions, generalizations and applications that naturally arise from our theory, including higher Morita theory, a theory of integrals and the condensations of liquid-like gapless defects in topological orders.

cond-mat.str-el↗

arXiv2025

Personalized Federated Dictionary Learning for Modeling Heterogeneity in Multi-site fMRI Data

Data privacy constraints pose significant challenges for large-scale neuroimaging analysis, especially in multi-site functional magnetic resonance imaging (fMRI) studies, where site-specific heterogeneity leads to non-independent and identically distributed (non-IID) data. These factors hinder the development of generalizable models. To address these challenges, we propose Personalized Federated Dictionary Learning (PFedDL), a novel federated learning framework that enables collaborative modeling across sites without sharing raw data. PFedDL performs independent dictionary learning at each site, decomposing each site-specific dictionary into a shared global component and a personalized local component. The global atoms are updated via federated aggregation to promote cross-site consistency, while the local atoms are refined independently to capture site-specific variability, thereby enhancing downstream analysis. Experiments on the ABIDE dataset demonstrate that PFedDL outperforms existing methods in accuracy and robustness across non-IID datasets.

cs.LG↗

arXiv2025

Deep Learning Advances in Vision-Based Traffic Accident Anticipation: A Comprehensive Review of Methods, Datasets, and Future Directions

Traffic accident prediction and detection are critical for enhancing road safety, and vision-based traffic accident anticipation (Vision-TAA) has emerged as a promising approach in the era of deep learning. This paper reviews 147 recent studies, focusing on the application of supervised, unsupervised, and hybrid deep learning models for accident prediction, alongside the use of real-world and synthetic datasets. Current methodologies are categorized into four key approaches: image and video feature-based prediction, spatio-temporal feature-based prediction, scene understanding, and multi modal data fusion. While these methods demonstrate significant potential, challenges such as data scarcity, limited generalization to complex scenarios, and real-time performance constraints remain prevalent. This review highlights opportunities for future research, including the integration of multi modal data fusion, self-supervised learning, and Transformer-based architectures to enhance prediction accuracy and scalability. By synthesizing existing advancements and identifying critical gaps, this paper provides a foundational reference for developing robust and adaptive Vision-TAA systems, contributing to road safety and traffic management.

cs.CV↗

arXiv2025

Fabrication and Characterization of the Moiré surface state on a topological insulator

A Moire superlattice on the topological insulator surface is predicted to exhibit many novel properties but has not been experimentally realized. Here, we developed a two-step growth method to successfully fabricate a topological insulator Sb2Te3 thin film with a Moire superlattice, which is generated by a twist of the topmost layer via molecular beam epitaxy. The established Moire topological surface state is characterized by scanning tunneling microscopy and spectroscopy. By application of a magnetic field, new features in Landau levels arise on the Moire region compared to the pristine surface of Sb2Te3, which makes the system a promising platform for pursuing next-generation electronics. Notably, the growth method, which circumvents contamination and the induced interface defects in the manual fabrication method, can be widely applied to other van der Waals materials for fabricating Moire superlattices.

cond-mat.mtrl-sci↗