arXiv Science⌕ Search

arXiv subjects

Tao Wu

Publications and source records attributed to Tao Wu.

At least 145 records · Page 8Linked to original sources

LRS: Enhancing Adversarial Transferability through Lipschitz Regularized Surrogate

The transferability of adversarial examples is of central importance to transfer-based black-box adversarial attacks. Previous works for generating transferable adversarial examples focus on attacking \emph{given} pretrained surrogate models while the connections between surrogate models and adversarial trasferability have been overlooked. In this paper, we propose {\em Lipschitz Regularized Surrogate} (LRS) for transfer-based black-box attacks, a novel approach that transforms surrogate models towards favorable adversarial transferability. Using such transformed surrogate models, any existing transfer-based black-box attack can run without any change, yet achieving much better performance. Specifically, we impose Lipschitz regularization on the loss landscape of surrogate models to enable a smoother and more controlled optimization process for generating more transferable adversarial examples. In addition, this paper also sheds light on the connection between the inner properties of surrogate models and adversarial transferability, where three factors are identified: smaller local Lipschitz constant, smoother loss landscape, and stronger adversarial robustness. We evaluate our proposed LRS approach by attacking state-of-the-art standard deep neural networks and defense models. The results demonstrate significant improvement on the attack success rates and transferability. Our code is available at https://github.com/TrustAIoT/LRS.

cs.LG↗

CR-SAM: Curvature Regularized Sharpness-Aware Minimization

The capacity to generalize to future unseen data stands as one of the utmost crucial attributes of deep neural networks. Sharpness-Aware Minimization (SAM) aims to enhance the generalizability by minimizing worst-case loss using one-step gradient ascent as an approximation. However, as training progresses, the non-linearity of the loss landscape increases, rendering one-step gradient ascent less effective. On the other hand, multi-step gradient ascent will incur higher training cost. In this paper, we introduce a normalized Hessian trace to accurately measure the curvature of loss landscape on {\em both} training and test sets. In particular, to counter excessive non-linearity of loss landscape, we propose Curvature Regularized SAM (CR-SAM), integrating the normalized Hessian trace as a SAM regularizer. Additionally, we present an efficient way to compute the trace via finite differences with parallelism. Our theoretical analysis based on PAC-Bayes bounds establishes the regularizer's efficacy in reducing generalization error. Empirical evaluation on CIFAR and ImageNet datasets shows that CR-SAM consistently enhances classification performance for ResNet and Vision Transformer (ViT) models across various datasets. Our code is available at https://github.com/TrustAIoT/CR-SAM.

cs.LG↗

Magnetic-field-induced electronic instability of Weyl-like fermions in compressed black phosphorus

Revealing the role of Coulomb interaction in topological semimetals with Dirac/Weyl-like band dispersion shapes a new frontier in condensed matter physics. Topological node-line semimetals (TNLSMs), anticipated as a fertile ground for exploring electronic correlation effects due to the anisotropy associated with their node-line structure, have recently attracted considerable attention. In this study, we report an experimental observation for correlation effects in TNLSMs realized by black phosphorus (BP) under hydrostatic pressure. By performing a combination of nuclear magnetic resonance measurements and band calculations on compressed BP, a magnetic-field-induced electronic instability of Weyl-like fermions is identified under an external magnetic field parallel to the so-called nodal ring in the reciprocal space. Anomalous spin fluctuations serving as the fingerprint of electronic instability are observed at low temperatures, and they are observed to maximize at approximately 1.0 GPa. This study presents compressed BP as a realistic material platform for exploring the rich physics in strongly coupled Weyl-like fermions.

cond-mat.str-el↗

MFPNet: Multi-scale Feature Propagation Network For Lightweight Semantic Segmentation

In contrast to the abundant research focusing on large-scale models, the progress in lightweight semantic segmentation appears to be advancing at a comparatively slower pace. However, existing compact methods often suffer from limited feature representation capability due to the shallowness of their networks. In this paper, we propose a novel lightweight segmentation architecture, called Multi-scale Feature Propagation Network (MFPNet), to address the dilemma. Specifically, we design a robust Encoder-Decoder structure featuring symmetrical residual blocks that consist of flexible bottleneck residual modules (BRMs) to explore deep and rich muti-scale semantic context. Furthermore, taking benefit from their capacity to model latent long-range contextual relationships, we leverage Graph Convolutional Networks (GCNs) to facilitate multi-scale feature propagation between the BRM blocks. When evaluated on benchmark datasets, our proposed approach shows superior segmentation results.

cs.CV↗

PRO-Face S: Privacy-preserving Reversible Obfuscation of Face Images via Secure Flow

This paper proposes a novel paradigm for facial privacy protection that unifies multiple characteristics including anonymity, diversity, reversibility and security within a single lightweight framework. We name it PRO-Face S, short for Privacy-preserving Reversible Obfuscation of Face images via Secure flow-based model. In the framework, an Invertible Neural Network (INN) is utilized to process the input image along with its pre-obfuscated form, and generate the privacy protected image that visually approximates to the pre-obfuscated one, thus ensuring privacy. The pre-obfuscation applied can be in diversified form with different strengths and styles specified by users. Along protection, a secret key is injected into the network such that the original image can only be recovered from the protection image via the same model given the correct key provided. Two modes of image recovery are devised to deal with malicious recovery attempts in different scenarios. Finally, extensive experiments conducted on three public image datasets demonstrate the superiority of the proposed framework over multiple state-of-the-art approaches.

cs.CV↗

GNP Attack: Transferable Adversarial Examples via Gradient Norm Penalty

Adversarial examples (AE) with good transferability enable practical black-box attacks on diverse target models, where insider knowledge about the target models is not required. Previous methods often generate AE with no or very limited transferability; that is, they easily overfit to the particular architecture and feature representation of the source, white-box model and the generated AE barely work for target, black-box models. In this paper, we propose a novel approach to enhance AE transferability using Gradient Norm Penalty (GNP). It drives the loss function optimization procedure to converge to a flat region of local optima in the loss landscape. By attacking 11 state-of-the-art (SOTA) deep learning models and 6 advanced defense methods, we empirically show that GNP is very effective in generating AE with high transferability. We also demonstrate that it is very flexible in that it can be easily integrated with other gradient based methods for stronger transfer-based attacks.

cs.LG↗

The structure of kagome superconductors CsV$_3$Sb$_5$ in the charge density wave states

The structure of charge density wave states in AV$_3$Sb$_5$ (A = K, Rb, Cs) kagome superconductors remains elusive, with three possible $2a\times2a\times2c$ candidates: tri-hexagonal, star-of-David, and their mixture. In this study, we conducted a systematic first-principles investigation of the nuclear quadrupole resonance (NQR) and nuclear magnetic resonance (NMR) spectra for the $2a\times2a\times2c$ CsV$_3$Sb$_5$ structures. By comparing our simulations with experimental data, we have concluded that the NQR spectrum indicates the tri-hexagonal structure as the proper structure for CsV$_3$Sb$_5$ after its charge density wave phase transition. The NMR calculation results obtained from the tri-hexagonal structure are also consistent with the experimental data.

cond-mat.supr-con↗

STMixer: A One-Stage Sparse Action Detector

Traditional video action detectors typically adopt the two-stage pipeline, where a person detector is first employed to generate actor boxes and then 3D RoIAlign is used to extract actor-specific features for classification. This detection paradigm requires multi-stage training and inference, and cannot capture context information outside the bounding box. Recently, a few query-based action detectors are proposed to predict action instances in an end-to-end manner. However, they still lack adaptability in feature sampling and decoding, thus suffering from the issues of inferior performance or slower convergence. In this paper, we propose a new one-stage sparse action detector, termed STMixer. STMixer is based on two core designs. First, we present a query-based adaptive feature sampling module, which endows our STMixer with the flexibility of mining a set of discriminative features from the entire spatiotemporal domain. Second, we devise a dual-branch feature mixing module, which allows our STMixer to dynamically attend to and mix video features along the spatial and the temporal dimension respectively for better feature decoding. Coupling these two designs with a video backbone yields an efficient end-to-end action detector. Without bells and whistles, our STMixer obtains the state-of-the-art results on the datasets of AVA, UCF101-24, and JHMDB.

cs.CV↗

Unidirectional electron-phonon coupling as a "fingerprint'' of the nematic state in a kagome superconductor

Electronic nematicity has been commonly observed in juxtaposition with unconventional superconductivity. Understanding the nature of the nematic state, as well as its consequence on the electronic band structure and superconductivity, has become a pivotal focus in condensed matter physics. Here we use spectroscopic imaging-scanning tunneling microscopy to visualize how the interacting quasiparticles organize themselves in the nematic state of kagome superconductor CsV$_{3-x}$Ti$_x$Sb$_5$, in which twofold symmetric (C$_2$) quasiparticle scattering interference of the vanadium kagome bands emerges below the bulk nematic transition temperature (T$_{nem}$). Surprisingly, we find that the coupling to collective modes, i.e., the phonon, dramatically alters the electrons self-energy and renormalizes the Fermi velocity of the in-plane vanadium d$_{xy/x^2-y^2}$ bands only along the C$_2$ direction, making the low-energy dispersion and electron dynamics highly nonequivalent along the three lattice directions. The anti-correlation between T$_{nem}$ and the superconducting transition temperature upon Ti substitution further suggests a possible competition between superconductivity and electron nematicity in this series, with a principal superconducting gap opening on the same V bands once the nematic state is totally suppressed. The organizing principle of these quasiparticles provides essential information for understanding the interplay between charge density wave and superconductivity in these kagome superconductors, and also reveals a previously unexplored form that expands the landscape for modelling electronic nematicity in systems where electron correlations and lattice degree of freedom act in concert.

cond-mat.supr-con↗

TESS Asteroseismic Analysis of HD 76920: The Giant Star Hosting An Extremely Eccentric Exoplanet

The Transiting Exoplanet Survey Satellite (TESS) mission searches for new exoplanets. The observing strategy of TESS results in high-precision photometry of millions of stars across the sky, allowing for detailed asteroseismic studies of individual systems. In this work, we present a detailed asteroseismic analysis of the giant star HD 76920 hosting a highly eccentric giant planet ($e = 0.878$) with an orbital period of 415 days, using 5 sectors of TESS light curve that cover around 140 days of data. Solar-like oscillations in HD 76920 are detected around $52 \, μ$Hz by TESS for the first time. By utilizing asteroseismic modeling that takes classical observational parameters and stellar oscillation frequencies as constraints, we determine improved measurements of the stellar mass ($1.22 \pm 0.11\, M_\odot$), radius ($8.68 \pm 0.34\,R_\odot$), and age ($5.2 \pm 1.4\,$Gyr). With the updated parameters of the host star, we update the semi-major axis and mass of the planet as $a=1.165 \pm 0.035$ au and $M_{\rm p}\sin{i} = 3.57 \pm 0.22\,M_{\rm Jup}$. With an orbital pericenter of $0.142 \pm 0.005$ au, we confirm that the planet is currently far away enough from the star to experience negligible tidal decay until being engulfed in the stellar envelope. We also confirm that this event will occur within about 100\,Myr, depending on the stellar model used.

astro-ph.SR↗

Generative Graph Neural Networks for Link Prediction

Inferring missing links or detecting spurious ones based on observed graphs, known as link prediction, is a long-standing challenge in graph data analysis. With the recent advances in deep learning, graph neural networks have been used for link prediction and have achieved state-of-the-art performance. Nevertheless, existing methods developed for this purpose are typically discriminative, computing features of local subgraphs around two neighboring nodes and predicting potential links between them from the perspective of subgraph classification. In this formalism, the selection of enclosing subgraphs and heuristic structural features for subgraph classification significantly affects the performance of the methods. To overcome this limitation, this paper proposes a novel and radically different link prediction algorithm based on the network reconstruction theory, called GraphLP. Instead of sampling positive and negative links and heuristically computing the features of their enclosing subgraphs, GraphLP utilizes the feature learning ability of deep-learning models to automatically extract the structural patterns of graphs for link prediction under the assumption that real-world graphs are not locally isolated. Moreover, GraphLP explores high-order connectivity patterns to utilize the hierarchical organizational structures of graphs for link prediction. Our experimental results on all common benchmark datasets from different applications demonstrate that the proposed method consistently outperforms other state-of-the-art methods. Unlike the discriminative neural network models used for link prediction, GraphLP is generative, which provides a new paradigm for neural-network-based link prediction.

cs.SI↗

Probing complex stacking in a layered material via electron-nuclear quadrupolar coupling

For layered materials, the interlayer stacking is a critical degree of freedom tuning electronic properties, while its microscopic characterization faces great challenges. The transition-metal dichalcogenide 1T-TaS$_2$ represents a novel example, in which the stacking pattern is not only enriched by the spontaneous occurrence of the intralayer charge density wave, but also recognized as a key to understand the nature of the low-temperature insulating phase. We exploit the $^{33}\rm{S}$ nuclei in a 1T-TaS$_2$ single crystal as sensitive probes of the local stacking pattern via quadrupolar coupling to the electron density distribution nearby, by combining nuclear magnetic resonance (NMR) measurements with the state-of-the-art first-principles electric-field gradient calculations. The applicability of our proposal is analyzed through temperature, magnetic-field, and angle dependent NMR spectra. Systematic simulations of a single 1T-TaS$_2$ layer, bilayers with different stacking patterns, and typical stacking orders in three-dimensional (3D) structures unravel distinct NMR characteristics. Particularly, one 3D structure achieves a quantitative agreement with the experimental spectrum, which clearly rationalizes the coexistence of two types of interfacial environments. Our method may find general applications in the studies of layered materials.

cond-mat.mtrl-sci↗

Emergent superconducting fluctuations in a compressed kagome superconductor

The recent discovery of superconductivity (SC) and charge density wave (CDW) in kagome metals AV3Sb5 (A = K, Rb, Cs) provides an ideal playground for the study of emergent electronic orders. Application of moderate pressure leads to a two-dome-shaped SC phase regime in CsV3Sb5 accompanied by the destabilizing of CDW phase; such unconventional evolution of SC may involve the pressure-induced formation of a new stripe-like CDW order resembling that in La-214 cuprate superconductors. Nonetheless, the nature of this pressure-tuned SC state and its interplay with the stripe order are yet to be explored. Here, we perform soft point-contact spectroscopy (SPCS) measurements in CsV3Sb5 to investigate the evolution of superconducting order parameter with pressure. Surprisingly, we find that the superconducting gap is significantly enhanced between the two SC domes, at which the zero-resistance temperature is suppressed and the transition is remarkably broadened. Moreover, the temperature dependence of the SC gap in this pressure range severely deviates from the conventional BCS behavior, evidencing for strong Cooper pair phase fluctuations. These findings reveal the complex intertwining of the stripe-like CDW with SC in the compressed CsV3Sb5, suggesting striking parallel to the cuprate superconductor La2-xBaxCuO4. Our results point to the essential role of charge degree of freedom in the development of intertwining electronic orders, thus provides new constraints for theories.

cond-mat.supr-con↗

FormLM: Recommending Creation Ideas for Online Forms by Modelling Semantic and Structural Information

Online forms are widely used to collect data from human and have a multi-billion market. Many software products provide online services for creating semi-structured forms where questions and descriptions are organized by pre-defined structures. However, the design and creation process of forms is still tedious and requires expert knowledge. To assist form designers, in this work we present FormLM to model online forms (by enhancing pre-trained language model with form structural information) and recommend form creation ideas (including question / options recommendations and block type suggestion). For model training and evaluation, we collect the first public online form dataset with 62K online forms. Experiment results show that FormLM significantly outperforms general-purpose language models on all tasks, with an improvement by 4.71 on Question Recommendation and 10.6 on Block Type Suggestion in terms of ROUGE-1 and Macro-F1, respectively.

cs.CL↗

An 18.9-minute Blue Large-Amplitude Pulsator Crossing the 'Hertzsprung Gap' of Hot Subdwarfs

Blue large-amplitude pulsators (BLAPs) represent a new and rare class of hot pulsating stars with unusually large amplitudes and short periods. Up to now, only 24 confirmed BLAPs have been identified from more than one billion monitored stars, including a group with pulsation period longer than $\sim 20$ min (classical BLAPs, hereafter) and the other group with pulsation period below $\sim 8$ min. The evolutionary path that could give rise to such kinds of stellar configurations is unclear. Here we report on a comprehensive study of the peculiar BLAP discovered by the Tsinghua University - Ma Huateng Telescopes for Survey (TMTS), TMTS J035143.63+584504.2 (TMTS-BLAP-1). This new BLAP has an 18.9 min pulsation period and is similar to the BLAPs with a low surface gravity and an extended helium-enriched envelope, suggesting that it is a low-gravity BLAP at the shortest-period end. In particular, the long-term monitoring data reveal that this pulsating star has an unusually large rate of period change, P_dot/P=2.2e-6/yr. Such a significant and positive value challenges its origins from both helium-core pre-white-dwarfs and core helium-burning subdwarfs, but is consistent with that derived from shell helium-burning subdwarfs. The particular pulsation period and unusual rate of period change indicate that TMTS-BLAP-1 is at a short-lived (~10^6 yr) phase of shell-helium ignition before the stable shell-helium burning; in other words, TMTS-BLAP-1 is going through a "Hertzsprung gap" of hot subdwarfs.

astro-ph.SR↗

Learning Deep Representations via Contrastive Learning for Instance Retrieval

Instance-level Image Retrieval (IIR), or simply Instance Retrieval, deals with the problem of finding all the images within an dataset that contain a query instance (e.g. an object). This paper makes the first attempt that tackles this problem using instance-discrimination based contrastive learning (CL). While CL has shown impressive performance for many computer vision tasks, the similar success has never been found in the field of IIR. In this work, we approach this problem by exploring the capability of deriving discriminative representations from pre-trained and fine-tuned CL models. To begin with, we investigate the efficacy of transfer learning in IIR, by comparing off-the-shelf features learned by a pre-trained deep neural network (DNN) classifier with features learned by a CL model. The findings inspired us to propose a new training strategy that optimizes CL towards learning IIR-oriented features, by using an Average Precision (AP) loss together with a fine-tuning method to learn contrastive feature representations that are tailored to IIR. Our empirical evaluation demonstrates significant performance enhancement over the off-the-shelf features learned from a pre-trained DNN classifier on the challenging Oxford and Paris datasets.

cs.CV↗

Emergent charge order and unconventional superconductivity in pressurized kagome superconductor CsV3Sb5

The discovery of multiple electronic orders in kagome superconductors AV3Sb5 (A = K, Rb, Cs) provides a promising platform for exploring unprecedented emergent physics. Under moderate pressure (< 2.2 GPa), the triple-Q charge density wave (CDW) order is monotonically suppressed by pressure, while the superconductivity displays a two-dome-like behavior, suggesting an unusual interplay between superconductivity and CDW order. Given that time-reversal symmetry breaking and electronic nematicity have been revealed inside the triple-Q CDW phase, understanding this CDW order and its interplay with superconductivity becomes one of the core questions in AV3Sb5. Here, we report the evolution of CDW and superconductivity with pressure in CsV3Sb5 by 51V nuclear magnetic resonance measurements. An emergent CDW phase, ascribed to a possible stripe-like CDW order with a unidirectional 4a0 modulation, is observed between Pc1 ~ 0.58 GPa and Pc2 ~ 2.0 GPa, which explains the two-dome-like superconducting behavior under pressure. Furthermore, the nuclear spin-lattice relaxation measurement reveals evidence for pressure-independent charge fluctuations above the CDW transition temperature and unconventional superconducting pairing above Pc2. Our results not only shed new light on the interplay of superconductivity and CDW but also reveal novel electronic correlation effects in kagome superconductors AV3Sb5.

cond-mat.supr-con↗

EaaS: A Service-Oriented Edge Computing Framework Towards Distributed Intelligence

Edge computing has become a popular paradigm where services and applications are deployed at the network edge closer to the data sources. It provides applications with outstanding benefits, including reduced response latency and enhanced privacy protection. For emerging advanced applications, such as autonomous vehicles, industrial IoT, and metaverse, further research is needed. This is because such applications demand ultra-low latency, hyper-connectivity, and dynamic and reliable service provision, while existing approaches are inadequate to address the new challenges. Hence, we envision that the future edge computing is moving towards distributed intelligence, where heterogeneous edge nodes collaborate to provide services in large-scale and geo-distributed edge infrastructure. We thereby propose Edge-as-a-Service (EaaS) to enable distributed intelligence. EaaS jointly manages large-scale cross-node edge resources and facilitates edge autonomy, edge-to-edge collaboration, and resource elasticity. These features enable flexible deployment of services and ubiquitous computation and intelligence. We first give an overview of existing edge computing studies and discuss their limitations to articulate the motivation for proposing EaaS. Then, we describe the details of EaaS, including the physical architecture, proposed software framework, and benefits of EaaS. Various application scenarios, such as real-time video surveillance, smart building, and metaverse, are presented to illustrate the significance and potential of EaaS. Finally, we discuss several challenging issues of EaaS to inspire more research towards this new edge computing framework.

cs.NI↗