arXiv Science⌕ Search

arXiv subjects

Lei Ding

Publications and source records attributed to Lei Ding.

At least 73 records · Page 4Linked to original sources

AMCAD: Adaptive Mixed-Curvature Representation based Advertisement Retrieval System

Graph embedding based retrieval has become one of the most popular techniques in the information retrieval community and search engine industry. The classical paradigm mainly relies on the flat Euclidean geometry. In recent years, hyperbolic (negative curvature) and spherical (positive curvature) representation methods have shown their superiority to capture hierarchical and cyclic data structures respectively. However, in industrial scenarios such as e-commerce sponsored search platforms, the large-scale heterogeneous query-item-advertisement interaction graphs often have multiple structures coexisting. Existing methods either only consider a single geometry space, or combine several spaces manually, which are incapable and inflexible to model the complexity and heterogeneity in the real scenario. To tackle this challenge, we present a web-scale Adaptive Mixed-Curvature ADvertisement retrieval system (AMCAD) to automatically capture the complex and heterogeneous graph structures in non-Euclidean spaces. Specifically, entities are represented in adaptive mixed-curvature spaces, where the types and curvatures of the subspaces are trained to be optimal combinations. Besides, an attentive edge-wise space projector is designed to model the similarities between heterogeneous nodes according to local graph structures and the relation types. Moreover, to deploy AMCAD in Taobao, one of the largest ecommerce platforms with hundreds of million users, we design an efficient two-layer online retrieval framework for the task of graph based advertisement retrieval. Extensive evaluations on real-world datasets and A/B tests on online traffic are conducted to illustrate the effectiveness of the proposed system.

cs.IR↗

Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Images

Semantic change detection (SCD) extends the multi-class change detection (MCD) task to provide not only the change locations but also the detailed land-cover/land-use (LCLU) categories before and after the observation intervals. This fine-grained semantic change information is very useful in many applications. Recent studies indicate that the SCD can be modeled through a triple-branch Convolutional Neural Network (CNN), which contains two temporal branches and a change branch. However, in this architecture, the communications between the temporal branches and the change branch are insufficient. To overcome the limitations in existing methods, we propose a novel CNN architecture for the SCD, where the semantic temporal features are merged in a deep CD unit. Furthermore, we elaborate on this architecture to reason the bi-temporal semantic correlations. The resulting Bi-temporal Semantic Reasoning Network (Bi-SRNet) contains two types of semantic reasoning blocks to reason both single-temporal and cross-temporal semantic correlations, as well as a novel loss function to improve the semantic consistency of change detection results. Experimental results on a benchmark dataset show that the proposed architecture obtains significant accuracy improvements over the existing approaches, while the added designs in the Bi-SRNet further improves the segmentation of both semantic categories and the changed areas. The codes in this paper are accessible at: github.com/ggsDing/Bi-SRNet.

cs.CV↗

Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images

Building extraction in VHR RSIs remains a challenging task due to occlusion and boundary ambiguity problems. Although conventional convolutional neural networks (CNNs) based methods are capable of exploiting local texture and context information, they fail to capture the shape patterns of buildings, which is a necessary constraint in the human recognition. To address this issue, we propose an adversarial shape learning network (ASLNet) to model the building shape patterns that improve the accuracy of building segmentation. In the proposed ASLNet, we introduce the adversarial learning strategy to explicitly model the shape constraints, as well as a CNN shape regularizer to strengthen the embedding of shape features. To assess the geometric accuracy of building segmentation results, we introduced several object-based quality assessment metrics. Experiments on two open benchmark datasets show that the proposed ASLNet improves both the pixel-based accuracy and the object-based quality measurements by a large margin. The code is available at: https://github.com/ggsDing/ASLNet

cs.CV↗

Word Embeddings via Causal Inference: Gender Bias Reducing and Semantic Information Preserving

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated corpora have strong gender biases that can produce discriminative results in downstream tasks. Previous debiasing methods focus mainly on modeling bias and only implicitly consider semantic information while completely overlooking the complex underlying causal structure among bias and semantic components. To address these issues, we propose a novel methodology that leverages a causal inference framework to effectively remove gender bias. The proposed method allows us to construct and analyze the complex causal mechanisms facilitating gender information flow while retaining oracle semantic information within word embeddings. Our comprehensive experiments show that the proposed method achieves state-of-the-art results in gender-debiasing tasks. In addition, our methods yield better performance in word similarity evaluation and various extrinsic downstream NLP tasks.

cs.CL↗

Realization of an intrinsic, ferromagnetic topological state in MnBi8Te13

The interplay between topology and magnetism is essential for realizing novel topological states including the axion insulator, the magnetic Weyl semimetal, etc. An intrinsically ferromagnetic topological material with only the topological bands at the charge neutrality energy has so far remained elusive. By rationally designing the natural heterostructure consisting of [MnBi2Te4] septuple layers and [Bi2Te3] quintuple layers, we report MnBi8Te13 as the first intrinsic ferromagnetic topological material with clean low-energy band structure. Based on the thermodynamic, transport and neutron diffraction measurements, our data show that despite the adjacent [MnBi2Te4] being 44.1 Å apart, MnBi8Te13 manifests long-range ferromagnetism below 10.5 K with strong coupling between magnetism and charge carriers. Our first-principles calculations and angle-resolved photoemission spectroscopy measurements further demonstrate that MnBi8Te13 is an intrinsic ferromagnetic axion state. Therefore, MnBi8Te13 serves as an ideal system to investigate rich emergent phenomena, including the quantized anomalous Hall effect and quantized topological magnetoelectric effect.

cond-mat.str-el↗

MoP$_3$SiO$_{11}$: a $4d^3$ honeycomb antiferromagnet with disconnected octahedra

We report the crystal structure and magnetic behavior of the $4d^3$ spin-$\frac32$ silicophosphate MoP$_3$SiO$_{11}$ studied by high-resolution synchrotron x-ray diffraction, neutron diffraction, thermodynamic measurements, and ab initio band-structure calculations. Our data revise the crystallographic symmetry of this compound and establish its rhombohedral space group ($R\bar 3c$) along with the geometrically perfect honeycomb lattice of the Mo$^{3+}$ ions residing in disconnected MoO$_6$ octahedra. Long-range antiferromagnetic order with the propagation vector $\mathbf k=0$ observed below $T_N=6.8$ K is a combined effect of the nearest-neighbor in-plane exchange coupling $J\simeq 2.6$ K, easy-plane single-ion anisotropy $D\simeq 2.2 $ K, and a weak interlayer coupling $J_c\simeq 0.8$ K. The 12% reduction in the ordered magnetic moment of the Mo$^{3+}$ ions and the magnon gap of $Δ\simeq 7$ K induced by the single-ion anisotropy further illustrate the impact of spin-orbit coupling on the magnetism. Our analysis puts forward single-ion anisotropy as an important ingredient of $4d^3$ honeycomb antiferromagnets despite their nominally quenched orbital moment.

cond-mat.str-el↗

Fully Distributed Nash Equilibrium Seeking for High-order Players with Bounded Controls and Directed Graphs

This paper explores distributed Nash equilibrium seeking problems for games in which the players have limited knowledge on other players' actions. In particular, the involved players are considered to be high-order integrators with their control inputs constrained within a pre-specified region. A linear transformation for the players' dynamics is firstly utilized to facilitate the design of bounded control inputs incorporating multiple saturation functions. By introducing consensus protocols with adaptive and time-varying gains, the unknown actions for players are distributively estimated. Then, a fully distributed Nash equilibrium seeking strategy is exploited, showcasing its remarkable properties: i) ensuring the boundedness of control inputs; ii) avoiding any global information/parameters; and iii) allowing the graph to be directed. Based on Lyapunov stability analysis, it is theoretically proved that the proposed distributed control strategy can lead all the players' actions to the Nash equilibrium. Finally, an illustrative example is given to validate effectiveness of the proposed method.

math.OC↗

Field-tunable toroidal moment in a chiral-lattice magnet

A toroidal dipole moment appears independent of the electric and magnetic dipole moment in the multipole expansion of electrodynamics. It arises naturally from vortex-like arrangements of spins. Observing and controlling spontaneous long-range orders of toroidal moments are highly promising for spintronics but remain challenging. Here we demonstrate that a vortex-like spin configuration with a staggered arrangement of toroidal moments, a ferritoroidal state, is realized in a chiral triangular-lattice magnet BaCoSiO4. Upon applying a magnetic field, we observe multi-stair toroidal transitions correlating directly with metamagnetic transitions. We establish a first-principles microscopic Hamiltonian that explains both the formation of toroidal states and the metamagnetic toroidal transition as a combined effect of the magnetic frustration and the Dzyaloshinskii-Moriya interactions allowed by the crystallographic chirality in BaCoSiO4.

cond-mat.str-el↗

Neutron diffraction study of magnetism in van der Waals layered MnBi$_{2n}$Te$_{3n+1}$

Two-dimensional van der Waals MnBi$_{2n}$Te$_{3n+1}$ (n = 1, 2, 3, 4) compounds have been recently found to be intrinsic magnetic topological insulators rendering quantum anomalous Hall effect and diverse topological states. Here, we summarize and compare the crystal and magnetic structures of this family, and discuss the effects of chemical composition on their magnetism. We found that a considerable fraction of Bi occupies at the Mn sites in MnBi$_{2n}$Te$_{3n+1}$ (n = 1, 2, 3, 4) while Mn is no detectable at the non-magnetic atomic sites within the resolution of neutron diffraction experiments. The occupancy of Mn monotonically decreases with the increase of n. The polarized neutron diffraction on the representative MnBi$_{4}$Te$_{7}$ reveals that its magnetization density is exclusively accumulated at the Mn site, in good agreement with the results from the unpolarized neutron diffraction. The defects of Bi at the Mn site naturally explain the continuously reduced saturated magnetic moments from n = 1 to n = 4. The experimentally estimated critical exponents of all the compounds generally suggest a three-dimensional character of magnetism. Our work provides material-specified structural parameters that may be useful for band structure calculations to understand the observed topological surface states and for designing quantum magnetic materials through chemical doping.

cond-mat.str-el↗

Reentrance of spin-driven ferroelectricity through rotational tunneling of ammonium

Quantum effects fundamentally engender exotic physical phenomena in macroscopic systems, which advance next-generation technological applications. Rotational tunneling that represents the quantum phenomenon of the librational motion of molecules is ubiquitous in hydrogen-contained materials. However, its direct manifestation in realizing macroscopic physical properties is elusive. Here we report an observation of reentrant ferroelectricity under low pressure that is mediated by the rotational tunneling of ammonium ions in molecule-based (NH$_4$)$_2$FeCl$_5 \cdot$H$_2$O. Applying a small pressure leads to a transition from spin-driven ferroelectricity to paraelectricity coinciding with the stabilization of a collinear magnetic phase. Such a transition is attributed to the hydrogen bond fluctuations via the rotational tunneling of ammonium groups as supported by theoretical calculations. Higher pressure lifts the quantum fluctuations and leads to a reentrant ferroelectric phase concomitant with another incommensurate magnetic phase. These results demonstrate that the rotational tunneling emerges as a new route to control magnetic-related properties in soft magnets, opening avenues for designing multi-functional materials and realizing potential quantum control.

cond-mat.mtrl-sci↗

Active Deep Densely Connected Convolutional Network for Hyperspectral Image Classification

Deep learning based methods have seen a massive rise in popularity for hyperspectral image classification over the past few years. However, the success of deep learning is attributed greatly to numerous labeled samples. It is still very challenging to use only a few labeled samples to train deep learning models to reach a high classification accuracy. An active deep-learning framework trained by an end-to-end manner is, therefore, proposed by this paper in order to minimize the hyperspectral image classification costs. First, a deep densely connected convolutional network is considered for hyperspectral image classification. Different from the traditional active learning methods, an additional network is added to the designed deep densely connected convolutional network to predict the loss of input samples. Then, the additional network could be used to suggest unlabeled samples that the deep densely connected convolutional network is more likely to produce a wrong label. Note that the additional network uses the intermediate features of the deep densely connected convolutional network as input. Therefore, the proposed method is an end-to-end framework. Subsequently, a few of the selected samples are labelled manually and added to the training samples. The deep densely connected convolutional network is therefore trained using the new training set. Finally, the steps above are repeated to train the whole framework iteratively. Extensive experiments illustrates that the method proposed could reach a high accuracy in classification after selecting just a few samples.

cs.CV↗

MP-ResNet: Multi-path Residual Network for the Semantic segmentation of High-Resolution PolSAR Images

There are limited studies on the semantic segmentation of high-resolution Polarimetric Synthetic Aperture Radar (PolSAR) images due to the scarcity of training data and the inference of speckle noises. The Gaofen contest has provided open access of a high-quality PolSAR semantic segmentation dataset. Taking this chance, we propose a Multi-path ResNet (MP-ResNet) architecture for the semantic segmentation of high-resolution PolSAR images. Compared to conventional U-shape encoder-decoder convolutional neural network (CNN) architectures, the MP-ResNet learns semantic context with its parallel multi-scale branches, which greatly enlarges its valid receptive fields and improves the embedding of local discriminative features. In addition, MP-ResNet adopts a multi-level feature fusion design in its decoder to make the best use of the features learned from its different branches. Ablation studies show that the MPResNet has significant advantages over its baseline method (FCN with ResNet34). It also surpasses several classic state-of-the-art methods in terms of overall accuracy (OA), mean F1 and fwIoU, whereas its computational costs are not much increased. This CNN architecture can be used as a baseline method for future studies on the semantic segmentation of PolSAR images. The code is available at: https://github.com/ggsDing/SARSeg.

cs.CV↗

Connecting Web Event Forecasting with Anomaly Detection: A Case Study on Enterprise Web Applications Using Self-Supervised Neural Networks

Recently web applications have been widely used in enterprises to assist employees in providing effective and efficient business processes. Forecasting upcoming web events in enterprise web applications can be beneficial in many ways, such as efficient caching and recommendation. In this paper, we present a web event forecasting approach, DeepEvent, in enterprise web applications for better anomaly detection. DeepEvent includes three key features: web-specific neural networks to take into account the characteristics of sequential web events, self-supervised learning techniques to overcome the scarcity of labeled data, and sequence embedding techniques to integrate contextual events and capture dependencies among web events. We evaluate DeepEvent on web events collected from six real-world enterprise web applications. Our experimental results demonstrate that DeepEvent is effective in forecasting sequential web events and detecting web based anomalies. DeepEvent provides a context-based system for researchers and practitioners to better forecast web events with situational awareness.

cs.CR↗

Are Smart Home Devices Abandoning IPV Victims?

Smart home devices have brought us many benefits such as advanced security, convenience, and entertainment. However, these devices also have made unintended consequences like giving ultimate power for devices' owners over their intimate partners in the same household which might lead to tech-facilitated domestic abuse (tech-abuse) as recent research has shown. In this paper, we systematize findings on tech-abuse in smart homes. We show that domestic abuse and Intimate Partner Violence (IPV) in smart homes is more effective and less risky for abusers. Victims find it more harmful and more challenging to protect themselves from. We articulate a comprehensive analysis of all the phases of abuse in smart homes and categorize risks and needs in each phase. Technical analysis of current smart home technologies is conducted to shed light upon their limitations. We also summarize recent recommendations to combat tech-abuse in smart homes and focus on their potentials and shortcomings. Unsurprisingly, we find that many recommendations conflict with each other due to a lack of understanding of phases of abuse in smart homes. Desirable properties to design abuse-resistant smart home devices are proposed for all the phases of abuse. The research community benefits from our analysis and recommendations to move forward with a focus on filling the blind spots of existing smart home devices' safety measures and building appropriate safety measures that consider tech-abuse threats in smart homes.

cs.CR↗

Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Faces

Deepfake represents a category of face-swapping attacks that leverage machine learning models such as autoencoders or generative adversarial networks. Although the concept of the face-swapping is not new, its recent technical advances make fake content (e.g., images, videos) more realistic and imperceptible to Humans. Various detection techniques for Deepfake attacks have been explored. These methods, however, are passive measures against Deepfakes as they are mitigation strategies after the high-quality fake content is generated. More importantly, we would like to think ahead of the attackers with robust defenses. This work aims to take an offensive measure to impede the generation of high-quality fake images or videos. Specifically, we propose to use novel transformation-aware adversarially perturbed faces as a defense against GAN-based Deepfake attacks. Different from the naive adversarial faces, our proposed approach leverages differentiable random image transformations during the generation. We also propose to use an ensemble-based approach to enhance the defense robustness against GAN-based Deepfake variants under the black-box setting. We show that training a Deepfake model with adversarial faces can lead to a significant degradation in the quality of synthesized faces. This degradation is twofold. On the one hand, the quality of the synthesized faces is reduced with more visual artifacts such that the synthesized faces are more obviously fake or less convincing to human observers. On the other hand, the synthesized faces can easily be detected based on various metrics.

cs.CV↗

DiResNet: Direction-aware Residual Network for Road Extraction in VHR Remote Sensing Images

The binary segmentation of roads in very high resolution (VHR) remote sensing images (RSIs) has always been a challenging task due to factors such as occlusions (caused by shadows, trees, buildings, etc.) and the intra-class variances of road surfaces. The wide use of convolutional neural networks (CNNs) has greatly improved the segmentation accuracy and made the task end-to-end trainable. However, there are still margins to improve in terms of the completeness and connectivity of the results. In this paper, we consider the specific context of road extraction and present a direction-aware residual network (DiResNet) that includes three main contributions: 1) An asymmetric residual segmentation network with deconvolutional layers and a structural supervision to enhance the learning of road topology (DiResSeg); 2) A pixel-level supervision of local directions to enhance the embedding of linear features; 3) A refinement network to optimize the segmentation results (DiResRef). Ablation studies on two benchmark datasets (the Massachusetts dataset and the DeepGlobe dataset) have confirmed the effectiveness of the presented designs. Comparative experiments with other approaches show that the proposed method has advantages in both overall accuracy and F1-score. The code is available at: https://github.com/ggsDing/DiResNet.

cs.CV↗

Crystal and magnetic structures of magnetic topological insulators MnBi$_2$Te$_4$ and MnBi$_4$Te$_7$

Using single crystal neutron diffraction, we present a systematic investigation of the crystal structure and magnetism of van der Waals topological insulators MnBi$_2$Te$_4$ and MnBi$_4$Te$_7$, where rich topological quantum states have been recently predicted and observed. Structural refinements reveal that considerable Bi atoms occupied on the Mn sites in both materials, distinct from the previously reported antisite disorder. We show unambiguously that MnBi$_{2}$Te$_{4}$ orders antiferromagnetically below 24 K featured by a magnetic symmetry $R_I$-${3c}$ while MnBi$_{4}$Te$_{7}$ is antiferromagnetic below 13 K with a magnetic space group $P_c$-${3c1}$. They both present antiferromagnetically coupled ferromagnetic layers with spins along the $c$-axis. We put forward a stacking rule for the crystal structure of an infinitely adaptive series MnBi$_{2n}$Te$_{3n+1}$ (n$\geq$1) with the building unit of [Bi$_2$Te$_3$]. A comparison of magnetic properties between MnBi$_{2}$Te$_{4}$ and MnBi$_{4}$Te$_{7}$, together with the recent density-functional theory calculations, enables us to draw that a two-dimensional magnetism limit might be realized in the derivatives. Our work may promote the theoretical studies of topological magnetic states in the series of MnBi$_{2n}$Te$_{3n+1}$.

cond-mat.str-el↗

Successive incommensurate spin orderings and excitations in multiferroic SrMnGe2O6

Anisotropic multiferroic properties of SrMnGe2O6 pyroxene single crystals were systematically investigated by means of magnetization, heat capacity, pyroelectric current measurement and elastic and inelastic neutron scattering experiments. Single crystal neutron diffraction allows us to unambiguously reveal the presence of two incommensurate magnetic orderings: a non-polar amplitude-modulated collinear sinusoidal magnetic structure emerges at TN1=4.36(2)K followed by a polar elliptical cycloidal spin structure below TN2=4.05(2)K. Pyroelectric current measurements on single crystal confirm the appearance of a spontaneous polarization within the (ac) plane below TN2 associated with the latter magnetic symmetry through extended Dzyaloshinsky-Moriya mechanism. The magnetic phase diagram was calculated considering the three isotropic exchange couplings relevant in this system. The magnetic excitations spectra of SrMnGe2O6 measured by inelastic neutron scattering were successfully modeled using a set of exchange interactions consistent with this phase diagram.

cond-mat.str-el↗