arXiv Science⌕ Search

arXiv subjects

Tao Wu

Publications and source records attributed to Tao Wu.

At least 91 records · Page 5Linked to original sources

Contrast-Free Ultrasound Microvascular Imaging via Radiality and Similarity Weighting

Microvascular imaging has advanced significantly with ultrafast data acquisition and improved clutter filtering, enhancing the sensitivity of power Doppler imaging to small vessels. However, the image quality remains limited by spatial resolution and elevated background noise, both of which impede visualization and accurate quantification. To address these limitations, this study proposes a high-resolution cross-correlation Power Doppler (HR-XPD) method that integrates spatial radiality weighting with Doppler signal coherence analysis, thereby enhancing spatial resolution while suppressing artifacts and background noise. Quantitative evaluations in simulation and in vivo experiments on healthy human liver, transplanted human kidney, and pig kidney demonstrated that HR-XPD significantly improves microvascular resolvability and contrast compared to conventional PD. In vivo results showed up to a 2 to 3-fold enhancement in spatial resolution and an increase in contrast by up to 20 dB. High-resolution vascular details were clearly depicted within a short acquisition time of only 0.3 s-1.2 s without the use of contrast agents. These findings indicate that HR-XPD provides an effective, contrast-free, and high-resolution microvascular imaging approach with broad applicability in both preclinical and clinical research.

physics.med-ph↗

Unveiling the landscape of Mottness and its proximity to superconductivity in 4Hb-TaS$_2$

Mott physics is at the root of a plethora of many-body quantum phenomena in quantum materials. Recently, the stacked or twisted structures of van der Waals (vdW) materials have emerged as a unique platform for realizing exotic correlated states in the vicinity of the Mott transition. However, the definitive feature of Mottness and how it rules the low-energy electronic state remain elusive and experimentally inaccessible in many interesting regimes. Here, we quantitatively describe a filling-controlled Mott state and its interplay with superconductivity by scanning tunnelling spectroscopy in a vdW bulk heterostructure, 4Hb-TaS$_2$, that interleaves strongly correlated 1T-TaS$_2$ layers with superconducting 1H-Ta$_2$ layers. The fine tunability of electron doping induced by interlayer charge transfer allows us to continuously track the spectral function with unsurpassed energy resolution from a depleted narrow band (0.2 electrons per site) toward a Mott transition at half filling. The gradually emerging Mott-Hubbard bands, followed by the sharpening and vanishing of the central quasiparticle peak as predicted in the Brinkman-Rice scenario, unambiguously demonstrate the Mott physics at play. Importantly, the renormalization of the low-energy electrons acts destructively on the superconducting pairing potential, leaving behind nonsuperconducting, paramagnetic puddles at the nanoscale. Our results reveal a seminal system near the border of the Mott criterion that enables us to illustrate the predictive power of the Hubbard model, and set such heterostructures as promising ground for realizing new correlated states in the heavily doped Mott regime.

cond-mat.supr-con↗

Anomalous narrow-band correlation in a natural superconducting heterostructure

A new frontier in condensed matter physics is to stack atomically thin layered-materials with different properties and create intriguing phenomena which do not exist in any of the constituent layers. Transition metal dichalcogenide 4Hb-TaS$_2$, with an alternating stacking of a spin liquid candidate 1T-TaS$_2$ and a superconductor 1H-TaS$_2$, is a natural heterostructure for such a purpose. Recently, rare phenomena are indeed observed, including chiral superconductivity, two-component nematic superconductivity, topological surface superconductivity and enigmatic magnetic memory. A widely proposed starting point to understand such a mysterious heterostructure requires strong electronic correlation, presumably provided by 1T-TaS$_2$ layers with a narrow flat band near the Fermi level ($E_F$). Here, by using angle-resolved photoemission spectroscopy, we reveal the theoretically expected flat band near $E_F$ in the energy-momentum space for the first time. However, this flat band only exists on the 1T-TaS$_2$ terminated surface layer with broken translational symmetry, but not on the 1T-TaS$_2$ layers buried in the bulk. These results directly challenge the foundation of the current theoretical paradigm. On the 1T-TaS$_2$ terminated surface layer, we further reveal a pseudogap and an anomalous doping effect. These phenomena and the dichotomy between surface and bulk layers also shed new light on the unusual coexistence of distinct electronic orders in this mysterious heterostructure.

cond-mat.supr-con↗

Equivalent of Multivariate Polynomial Matrix

The equivalence of multidimensional systems is closely related to the reduction of multivariate polynomial matrices, with the Smith normal form of matrices playing a key role. So far, the problem of reducing multivariate polynomial matrices into Smith normal form has not been fully solved. This article investigates the Smith normal form of quasi weakly linear multivariate polynomial matrices. Breaking through previous limitations, providing sufficient and necessary conditions.

math.RA↗

Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents

Large language models (LLMs) are revolutionizing education, with LLM-based agents playing a key role in simulating student behavior. A major challenge in student simulation is modeling the diverse learning patterns of students at various cognitive levels. However, current LLMs, typically trained as ``helpful assistants'', target at generating perfect responses. As a result, they struggle to simulate students with diverse cognitive abilities, as they often produce overly advanced answers, missing the natural imperfections that characterize student learning and resulting in unrealistic simulations. To address this issue, we propose a training-free framework for student simulation. We begin by constructing a cognitive prototype for each student using a knowledge graph, which captures their understanding of concepts from past learning records. This prototype is then mapped to new tasks to predict student performance. Next, we simulate student solutions based on these predictions and iteratively refine them using a beam search method to better replicate realistic mistakes. To validate our approach, we construct the \texttt{Student\_100} dataset, consisting of $100$ students working on Python programming and $5,000$ learning records. Experimental results show that our method consistently outperforms baseline models, achieving $100\%$ improvement in simulation accuracy.

cs.LG↗

p-MoD: Building Mixture-of-Depths MLLMs via Progressive Ratio Decay

Despite the remarkable performance of multimodal large language models (MLLMs) across diverse tasks, the substantial training and inference costs impede their advancement. In this paper, we propose p-MoD, an efficient MLLM architecture that significantly reduces training and inference costs while maintaining model performance. The majority of computation in MLLMs stems from the overwhelming volume of vision tokens processed by the transformer-based LLM. Accordingly, we leverage the Mixture-of-Depths (MoD) mechanism, where each LLM layer selects essential vision tokens to process while skipping redundant ones. However, integrating MoD into MLLMs is non-trivial. To address the challenges of training and inference stability as well as limited training data, we adapt the MoD module with two novel designs: tanh-gated weight normalization (TanhNorm) and symmetric token reweighting (STRing). Moreover, we observe that vision tokens exhibit higher redundancy in deeper layers and thus design a progressive ratio decay (PRD) strategy, which gradually reduces the token retention ratio layer by layer, employing a shifted cosine schedule. This crucial design fully unleashes the potential of MoD, significantly boosting the efficiency and performance of our models. Extensive experiments on two baseline models across 15 benchmarks show that our model matches or even surpasses the performance of corresponding baselines, while requiring only 55.6% TFLOPs and 53.7% KV cache storage during inference, and 77.7% GPU hours during training.

cs.CV↗

PMR: Physical Model-Driven Multi-Stage Restoration of Turbulent Dynamic Videos

Geometric distortions and blurring caused by atmospheric turbulence degrade the quality of long-range dynamic scene videos. Existing methods struggle with restoring edge details and eliminating mixed distortions, especially under conditions of strong turbulence and complex dynamics. To address these challenges, we introduce a Dynamic Efficiency Index ($DEI$), which combines turbulence intensity, optical flow, and proportions of dynamic regions to accurately quantify video dynamic intensity under varying turbulence conditions and provide a high-dynamic turbulence training dataset. Additionally, we propose a Physical Model-Driven Multi-Stage Video Restoration ($PMR$) framework that consists of three stages: \textbf{de-tilting} for geometric stabilization, \textbf{motion segmentation enhancement} for dynamic region refinement, and \textbf{de-blurring} for quality restoration. $PMR$ employs lightweight backbones and stage-wise joint training to ensure both efficiency and high restoration quality. Experimental results demonstrate that the proposed method effectively suppresses motion trailing artifacts, restores edge details and exhibits strong generalization capability, especially in real-world scenarios characterized by high-turbulence and complex dynamics. We will make the code and datasets openly available.

cs.CV↗

Deepfake Technology Unveiled: The Commoditization of AI and Its Impact on Digital Trust

Deepfake Technology Unveiled: The Commoditization of AI and Its Impact on Digital Trust. With the increasing accessibility of generative AI, tools for voice cloning, face-swapping, and synthetic media creation have advanced significantly, lowering both financial and technical barriers for their use. While these technologies present innovative opportunities, their rapid growth raises concerns about trust, privacy, and security. This white paper explores the implications of deepfake technology, analyzing its role in enabling fraud, misinformation, and the erosion of authenticity in multimedia. Using cost-effective, easy to use tools such as Runway, Rope, and ElevenLabs, we explore how realistic deepfakes can be created with limited resources, demonstrating the risks posed to individuals and organizations alike. By analyzing the technical and ethical challenges of deepfake mitigation and detection, we emphasize the urgent need for regulatory frameworks, public awareness, and collaborative efforts to maintain trust in digital media.

cs.CY↗

RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Control

Recent advancements in camera-trajectory-guided image-to-video generation offer higher precision and better support for complex camera control compared to text-based approaches. However, they also introduce significant usability challenges, as users often struggle to provide precise camera parameters when working with arbitrary real-world images without knowledge of their depth nor scene scale. To address these real-world application issues, we propose RealCam-I2V, a novel diffusion-based video generation framework that integrates monocular metric depth estimation to establish 3D scene reconstruction in a preprocessing step. During training, the reconstructed 3D scene enables scaling camera parameters from relative to metric scales, ensuring compatibility and scale consistency across diverse real-world images. In inference, RealCam-I2V offers an intuitive interface where users can precisely draw camera trajectories by dragging within the 3D scene. To further enhance precise camera control and scene consistency, we propose scene-constrained noise shaping, which shapes high-level noise and also allows the framework to maintain dynamic and coherent video generation in lower noise stages. RealCam-I2V achieves significant improvements in controllability and video quality on the RealEstate10K and out-of-domain images. We further enables applications like camera-controlled looping video generation and generative frame interpolation. Project page: https://zgctroy.github.io/RealCam-I2V.

cs.CV↗

Piezoelectric-Metal Phononic Crystal Enabling GHz Tunable Ultrahigh $Q$ Quasi-BIC mode

The integration of GHz-frequency, high quality factor ($Q$), and electrically tunable acoustic resonators holds significant potential for advancing applications in quantum information technologies, microwave photonics, and reconfigurable RF systems. However, simultaneously achieving these three characteristics within a single, scalable platform remains a fundamental challenge. Here, we report the experimental demonstration of a GHz quasi-BIC resonator in a piezoelectric thin-film shear horizontal (SH) wave system, achieved through a structurally simple piezoelectric-metal phononic crystal (PnC) architecture on a LiNbO$_3$ thin film. This approach enables leaky Fabry-Perot coupling mode and localized trapping quasi-BIC mode. Without the need for deep etching or intricate patterning, we achieve a room-temperature quality factor of $6\times 10^4$ at ~1 GHz in ambient air, corresponding to an $f\times Q$ product of $6\times 10^{13}$ Hz at quasi-BIC mode. Furthermore, we demonstrate efficient electrical tunability via low-voltage (0.6 V) electrothermal modulation of the PnC structure, enabling a reversible transition between trapped and transmission states and yielding a high-contrast amplitude modulation of 47.75 dB. Our results establish a lithography-friendly, fabrication-tolerant platform for realizing tunable, high-$Q$ acoustic resonators at GHz frequencies, overcoming longstanding barriers in phononic device engineering. This work opens new directions for scalable on-chip phononic circuits in quantum acoustics, reconfigurable RF systems, and signal processing applications.

physics.app-ph↗

ASC-Hook: fast and transparent system call hook for Arm

Intercepting system calls is crucial for tools that aim to modify or monitor application behavior. However, existing system call interception tools on the ARM platform still suffer from limitations in terms of performance and completeness. This paper presents an efficient and comprehensive binary rewriting framework, ASC-Hook, specifically designed for intercepting system calls on the ARM platform. ASC-Hook addresses two key challenges on the ARM architecture: the misalignment of the target address caused by directly replacing the SVC instruction with br x8, and the return to the original control flow after system call interception. This is achieved through a hybrid replacement strategy and our specially designed trampoline mechanism. By implementing multiple completeness strategies specifically for system calls, we ensured comprehensive and thorough interception. Experimental results show that ASC-Hook reduces overhead to at least 1/29 of that of existing system call interception tools. We conducted extensive performance evaluations of ASC-Hook, and the average performance loss for system call-intensive applications is 3.7\% .

cs.AR↗

Understanding the Robustness of Graph Neural Networks against Adversarial Attacks

Recent studies have shown that graph neural networks (GNNs) are vulnerable to adversarial attacks, posing significant challenges to their deployment in safety-critical scenarios. This vulnerability has spurred a growing focus on designing robust GNNs. Despite this interest, current advancements have predominantly relied on empirical trial and error, resulting in a limited understanding of the robustness of GNNs against adversarial attacks. To address this issue, we conduct the first large-scale systematic study on the adversarial robustness of GNNs by considering the patterns of input graphs, the architecture of GNNs, and their model capacity, along with discussions on sensitive neurons and adversarial transferability. This work proposes a comprehensive empirical framework for analyzing the adversarial robustness of GNNs. To support the analysis of adversarial robustness in GNNs, we introduce two evaluation metrics: the confidence-based decision surface and the accuracy-based adversarial transferability rate. Through experimental analysis, we derive 11 actionable guidelines for designing robust GNNs, enabling model developers to gain deeper insights. The code of this study is available at https://github.com/star4455/GraphRE.

cs.LG↗

Origin of local magnetic exchange interaction in infiite-layer nickelates

Significant magnetic exchange interactions have been observed in infinite-layer nickelates RNiO2 (R = La, Pr, Nd), which exhibit unconventional superconductivity upon hole doping. Despite their structural and Fermi surface similarities to cuprates, infinite-layer nickelates possess a larger charge transfer gap, which influences their magnetic exchange interactions via oxygen. In this work, we performed 17O nuclear magnetic resonance (NMR) measurements on LaNiO2 and Sr-doped LaNiO2, revealing glassy spin dynamics originating from Ni-O planes. This indicates that infinite-layer nickelates are in proximity to magnetic ordering and that magnetic correlations play a crucial role in their physics. More importantly, our analysis of the Knight shift and hyperfine coupling of 17O nuclei revealed that the Ni-Ni superexchange interaction, mediated by the σ bond between the Ni-dx2-y2 and O-p orbitals, is one order of magnitude weaker than that in cuprates. This alone cannot account for the total magnetic exchange interaction observed in nickelates. First-principles many-body calculations indicate that an interstitial s orbital near the Fermi level, coupled with the Ni-d3z2-r2 orbital, significantly enhances the superexchange interaction. This contrasts with cuprates, where magnetic interactions are predominantly governed by Cu-dx2-y2 superexchange via oxygen. Our findings provide new insights into the distinct magnetic interactions in infinite-layer nickelates and their potential role in unconventional superconductivity.

cond-mat.supr-con↗

Disentangled Graph Representation Based on Substructure-Aware Graph Optimal Matching Kernel Convolutional Networks

Graphs effectively characterize relational data, driving graph representation learning methods that uncover underlying predictive information. As state-of-the-art approaches, Graph Neural Networks (GNNs) enable end-to-end learning for diverse tasks. Recent disentangled graph representation learning enhances interpretability by decoupling independent factors in graph data. However, existing methods often implicitly and coarsely characterize graph structures, limiting structural pattern analysis within the graph. This paper proposes the Graph Optimal Matching Kernel Convolutional Network (GOMKCN) to address this limitation. We view graphs as node-centric subgraphs, where each subgraph acts as a structural factor encoding position-specific information. This transforms graph prediction into structural pattern recognition. Inspired by CNNs, GOMKCN introduces the Graph Optimal Matching Kernel (GOMK) as a convolutional operator, computing similarities between subgraphs and learnable graph filters. Mathematically, GOMK maps subgraphs and filters into a Hilbert space, representing graphs as point sets. Disentangled representations emerge from projecting subgraphs onto task-optimized filters, which adaptively capture relevant structural patterns via gradient descent. Crucially, GOMK incorporates local correspondences in similarity measurement, resolving the trade-off between differentiability and accuracy in graph kernels. Experiments validate that GOMKCN achieves superior accuracy and interpretability in graph pattern mining and prediction. The framework advances the theoretical foundation for disentangled graph representation learning.

cs.LG↗

Online Video Understanding: OVBench and VideoChat-Online

Multimodal Large Language Models (MLLMs) have significantly progressed in offline video understanding. However, applying these models to real-world scenarios, such as autonomous driving and human-computer interaction, presents unique challenges due to the need for real-time processing of continuous online video streams. To this end, this paper presents systematic efforts from three perspectives: evaluation benchmark, model architecture, and training strategy. First, we introduce OVBench, a comprehensive question-answering benchmark designed to evaluate models' ability to perceive, memorize, and reason within online video contexts. It features 6 core task types across three temporal contexts-past, current, and future-forming 16 subtasks from diverse datasets. Second, we propose a new Pyramid Memory Bank (PMB) that effectively retains key spatiotemporal information in video streams. Third, we proposed an offline-to-online learning paradigm, designing an interleaved dialogue format for online video data and constructing an instruction-tuning dataset tailored for online video training. This framework led to the development of VideoChat-Online, a robust and efficient model for online video understanding. Despite the lower computational cost and higher efficiency, VideoChat-Online outperforms existing state-of-the-art offline and online models across popular offline video benchmarks and OVBench, demonstrating the effectiveness of our model architecture and training strategy. % Our approach surpasses existing state-of-the-art offline models Qwen2-VL 7B and online models Flash-VStream, by 4.19% and 23.7% on OVBench, respectively.

cs.CV↗

Enabling Heterogeneous Adversarial Transferability via Feature Permutation Attacks

Adversarial attacks in black-box settings are highly practical, with transfer-based attacks being the most effective at generating adversarial examples (AEs) that transfer from surrogate models to unseen target models. However, their performance significantly degrades when transferring across heterogeneous architectures -- such as CNNs, MLPs, and Vision Transformers (ViTs) -- due to fundamental architectural differences. To address this, we propose Feature Permutation Attack (FPA), a zero-FLOP, parameter-free method that enhances adversarial transferability across diverse architectures. FPA introduces a novel feature permutation (FP) operation, which rearranges pixel values in selected feature maps to simulate long-range dependencies, effectively making CNNs behave more like ViTs and MLPs. This enhances feature diversity and improves transferability both across heterogeneous architectures and within homogeneous CNNs. Extensive evaluations on 14 state-of-the-art architectures show that FPA achieves maximum absolute gains in attack success rates of 7.68% on CNNs, 14.57% on ViTs, and 14.48% on MLPs, outperforming existing black-box attacks. Additionally, FPA is highly generalizable and can seamlessly integrate with other transfer-based attacks to further boost their performance. Our findings establish FPA as a robust, efficient, and computationally lightweight strategy for enhancing adversarial transferability across heterogeneous architectures.

cs.CV↗

TransiT: Transient Transformer for Non-line-of-sight Videography

High quality and high speed videography using Non-Line-of-Sight (NLOS) imaging benefit autonomous navigation, collision prevention, and post-disaster search and rescue tasks. Current solutions have to balance between the frame rate and image quality. High frame rates, for example, can be achieved by reducing either per-point scanning time or scanning density, but at the cost of lowering the information density at individual frames. Fast scanning process further reduces the signal-to-noise ratio and different scanning systems exhibit different distortion characteristics. In this work, we design and employ a new Transient Transformer architecture called TransiT to achieve real-time NLOS recovery under fast scans. TransiT directly compresses the temporal dimension of input transients to extract features, reducing computation costs and meeting high frame rate requirements. It further adopts a feature fusion mechanism as well as employs a spatial-temporal Transformer to help capture features of NLOS transient videos. Moreover, TransiT applies transfer learning to bridge the gap between synthetic and real-measured data. In real experiments, TransiT manages to reconstruct from sparse transients of $16 \times 16$ measured at an exposure time of 0.4 ms per point to NLOS videos at a $64 \times 64$ resolution at 10 frames per second. We will make our code and dataset available to the community.

cs.CV↗

Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs

In this technical report, we tackle the challenges of training large-scale Mixture of Experts (MoE) models, focusing on overcoming cost inefficiency and resource limitations prevalent in such systems. To address these issues, we present two differently sized MoE large language models (LLMs), namely Ling-Lite and Ling-Plus (referred to as "Bailing" in Chinese, spelled Bǎilíng in Pinyin). Ling-Lite contains 16.8 billion parameters with 2.75 billion activated parameters, while Ling-Plus boasts 290 billion parameters with 28.8 billion activated parameters. Both models exhibit comparable performance to leading industry benchmarks. This report offers actionable insights to improve the efficiency and accessibility of AI development in resource-constrained settings, promoting more scalable and sustainable technologies. Specifically, to reduce training costs for large-scale MoE models, we propose innovative methods for (1) optimization of model architecture and training processes, (2) refinement of training anomaly handling, and (3) enhancement of model evaluation efficiency. Additionally, leveraging high-quality data generated from knowledge graphs, our models demonstrate superior capabilities in tool use compared to other models. Ultimately, our experimental findings demonstrate that a 300B MoE LLM can be effectively trained on lower-performance devices while achieving comparable performance to models of a similar scale, including dense and MoE models. Compared to high-performance devices, utilizing a lower-specification hardware system during the pre-training phase demonstrates significant cost savings, reducing computing costs by approximately 20%. The models can be accessed at https://huggingface.co/inclusionAI.

cs.LG↗