arXiv subjects

Jun Zhou

Publications and source records attributed to Jun Zhou.

At least 415 records · Page 23Linked to original sources

arXiv2021

Role of Magnon-Magnon Scattering in Magnon Polaron Spin Seebeck Effect

The spin Seebeck effect (SSE) signal of magnon polarons in bulk-Y3Fe5O12 (YIG)/Pt heterostructures is found to drastically change as a function of temperature. It appears as a dip in the total SSE signal at low temperatures, but as the temperature increases, the dip gradually decreases before turning to a peak. We attribute the observed dip-to-peak transition to the rapid rise of the four-magnon scattering rate. Our analysis provides important insights into the microscopic origin of the hybridized excitations and the overall temperature dependence of the SSE anomalies.

cond-mat.mtrl-sci↗

arXiv2021

Sliding Ferroelectric Tunnel Junctions

Very recently, ferroelectric polarization in staggered bilayer hexagonal boron nitride (BBN) and its novel sliding inversion mechanism was reported experimentally (Science 2021, 372, 1458; 2021, 372, 1462), which paves a new way to realize van der Waals (vdW) ferroelectric devices with new functionalities. Here, we develop vdW sliding ferroelectric tunnel junctions (FTJs) using the sliding ferroelectric BBN unit as ultrathin barriers and explore their transport properties with different ferroelectric states and metal contacts via the first principles. It is found that the electrode/BBN contact electric field quenches the ferroelectricity in the staggered BBN, resulting a very small tunnelling electroresistance (TER). Inserting high-mobility 2D materials between Au and BN can restore the BBN ferroelectricity, reaching a giant TER of ~10,000% in sliding FTJs. We finally investigate the metal-contact and thickness effect on the tunnelling property of sliding FTJs. The giant TER and multiple non-volatile resistance states in vdW sliding FTJs show the promising applications in voltage-controlled nano-memories with ultrahigh storage density.

cond-mat.mtrl-sci↗

arXiv2021

Dimension reduction induced anisotropic magnetic thermal conductivity in hematite nanowire

The thermophysical properties near the magnetic phase transition point is of great importance in the study of critical phenomenon. Low-dimensional materials are suggested to hold different thermophysical properties comparing to their bulk counterpart due to the dimension induced quantum confinement and anisotropy. In this work, we measured the thermal conductivity of $α$-Fe$_2$O$_3$ nanowires along [110] direction (growing direction) with temperature from 100K to 150K and found a dip of thermal conductivity near the Morin temperature. We found the thermal conductivity near Morin temperature varies with the angle between magnetic field and [110] direction of nanowire. More specifically, an angular-dependent thermal conductivity is observed, due to the magnetic field induced movement of magnetic domain wall. The angle corresponding to the maximum of thermal conductivity varies near the Morin transition temperature, due to the different magnetic easy axis as suggested by our calculation based on magnetic anisotropy energy. This angular dependence of thermal conductivity indicates that the easy axis of $α$-Fe$_2$O$_3$ nanowires is different from bulk $α$-Fe$_2$O$_3$ due to the geometric anisotropy.

cond-mat.mes-hall↗

arXiv2021

SMDS-Net: Model Guided Spectral-Spatial Network for Hyperspectral Image Denoising

Deep learning (DL) based hyperspectral images (HSIs) denoising approaches directly learn the nonlinear mapping between observed noisy images and underlying clean images. They normally do not consider the physical characteristics of HSIs, therefore making them lack of interpretability that is key to understand their denoising mechanism.. In order to tackle this problem, we introduce a novel model guided interpretable network for HSI denoising. Specifically, fully considering the spatial redundancy, spectral low-rankness and spectral-spatial properties of HSIs, we first establish a subspace based multi-dimensional sparse model. This model first projects the observed HSIs into a low-dimensional orthogonal subspace, and then represents the projected image with a multidimensional dictionary. After that, the model is unfolded into an end-to-end network named SMDS-Net whose fundamental modules are seamlessly connected with the denoising procedure and optimization of the model. This makes SMDS-Net convey clear physical meanings, i.e., learning the low-rankness and sparsity of HSIs. Finally, all key variables including dictionaries and thresholding parameters are obtained by the end-to-end training. Extensive experiments and comprehensive analysis confirm the denoising ability and interpretability of our method against the state-of-the-art HSI denoising methods.

eess.IV↗

arXiv2021

Multi-Interactive Attention Network for Fine-grained Feature Learning in CTR Prediction

In the Click-Through Rate (CTR) prediction scenario, user's sequential behaviors are well utilized to capture the user interest in the recent literature. However, despite being extensively studied, these sequential methods still suffer from three limitations. First, existing methods mostly utilize attention on the behavior of users, which is not always suitable for CTR prediction, because users often click on new products that are irrelevant to any historical behaviors. Second, in the real scenario, there exist numerous users that have operations a long time ago, but turn relatively inactive in recent times. Thus, it is hard to precisely capture user's current preferences through early behaviors. Third, multiple representations of user's historical behaviors in different feature subspaces are largely ignored. To remedy these issues, we propose a Multi-Interactive Attention Network (MIAN) to comprehensively extract the latent relationship among all kinds of fine-grained features (e.g., gender, age and occupation in user-profile). Specifically, MIAN contains a Multi-Interactive Layer (MIL) that integrates three local interaction modules to capture multiple representations of user preference through sequential behaviors and simultaneously utilize the fine-grained user-specific as well as context information. In addition, we design a Global Interaction Module (GIM) to learn the high-order interactions and balance the different impacts of multiple features. Finally, Offline experiment results from three datasets, together with an Online A/B test in a large-scale recommendation system, demonstrate the effectiveness of our proposed approach.

cs.IR↗

arXiv2021

Conditional Attention Networks for Distilling Knowledge Graphs in Recommendation

Knowledge graph is generally incorporated into recommender systems to improve overall performance. Due to the generalization and scale of the knowledge graph, most knowledge relationships are not helpful for a target user-item prediction. To exploit the knowledge graph to capture target-specific knowledge relationships in recommender systems, we need to distill the knowledge graph to reserve the useful information and refine the knowledge to capture the users' preferences. To address the issues, we propose Knowledge-aware Conditional Attention Networks (KCAN), which is an end-to-end model to incorporate knowledge graph into a recommender system. Specifically, we use a knowledge-aware attention propagation manner to obtain the node representation first, which captures the global semantic similarity on the user-item network and the knowledge graph. Then given a target, i.e., a user-item pair, we automatically distill the knowledge graph into the target-specific subgraph based on the knowledge-aware attention. Afterward, by applying a conditional attention aggregation on the subgraph, we refine the knowledge graph to obtain target-specific node representations. Therefore, we can gain both representability and personalization to achieve overall performance. Experimental results on real-world datasets demonstrate the effectiveness of our framework over the state-of-the-art algorithms.

cs.LG↗

arXiv2021

MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data

Time series forecasting is widely used in business intelligence, e.g., forecast stock market price, sales, and help the analysis of data trend. Most time series of interest are macroscopic time series that are aggregated from microscopic data. However, instead of directly modeling the macroscopic time series, rare literature studied the forecasting of macroscopic time series by leveraging data on the microscopic level. In this paper, we assume that the microscopic time series follow some unknown mixture probabilistic distributions. We theoretically show that as we identify the ground truth latent mixture components, the estimation of time series from each component could be improved because of lower variance, thus benefitting the estimation of macroscopic time series as well. Inspired by the power of Seq2seq and its variants on the modeling of time series data, we propose Mixture of Seq2seq (MixSeq), an end2end mixture model to cluster microscopic time series, where all the components come from a family of Seq2seq models parameterized by different parameters. Extensive experiments on both synthetic and real-world data show the superiority of our approach.

cs.LG↗

arXiv2021

Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretable

Multi-hop QA requires the machine to answer complex questions through finding multiple clues and reasoning, and provide explanatory evidence to demonstrate the machine reasoning process. We propose Relation Extractor-Reader and Comparator (RERC), a three-stage framework based on complex question decomposition, which is the first work that the RERC model has been proposed and applied in solving the multi-hop QA challenges. The Relation Extractor decomposes the complex question, and then the Reader answers the sub-questions in turn, and finally the Comparator performs numerical comparison and summarizes all to get the final answer, where the entire process itself constitutes a complete reasoning evidence path. In the 2WikiMultiHopQA dataset, our RERC model has achieved the most advanced performance, with a winning joint F1 score of 53.58 on the leaderboard. All indicators of our RERC are close to human performance, with only 1.95 behind the human level in F1 score of support fact. At the same time, the evidence path provided by our RERC framework has excellent readability and faithfulness.

cs.CL↗

arXiv2021

A Bi-Level Framework for Learning to Solve Combinatorial Optimization on Graphs

Combinatorial Optimization (CO) has been a long-standing challenging research topic featured by its NP-hard nature. Traditionally such problems are approximately solved with heuristic algorithms which are usually fast but may sacrifice the solution quality. Currently, machine learning for combinatorial optimization (MLCO) has become a trending research topic, but most existing MLCO methods treat CO as a single-level optimization by directly learning the end-to-end solutions, which are hard to scale up and mostly limited by the capacity of ML models given the high complexity of CO. In this paper, we propose a hybrid approach to combine the best of the two worlds, in which a bi-level framework is developed with an upper-level learning method to optimize the graph (e.g. add, delete or modify edges in a graph), fused with a lower-level heuristic algorithm solving on the optimized graph. Such a bi-level approach simplifies the learning on the original hard CO and can effectively mitigate the demand for model capacity. The experiments and results on several popular CO problems like Directed Acyclic Graph scheduling, Graph Edit Distance and Hamiltonian Cycle Problem show its effectiveness over manually designed heuristics and single-level learning methods.

cs.LG↗

arXiv2021

Reminding the Incremental Language Model via Data-Free Self-Distillation

Incremental language learning with pseudo-data can alleviate catastrophic forgetting in neural networks. However, to obtain better performance, former methods have higher demands for pseudo-data of the previous tasks. The performance dramatically decreases when fewer pseudo-data are employed. In addition, the distribution of pseudo-data gradually deviates from the real data with the sequential learning of different tasks. The deviation will be greater with more tasks learned, which results in more serious catastrophic forgetting. To address these issues, we propose reminding incremental language model via data-free self-distillation (DFSD), which includes self-distillation based on the Earth Mover's Distance and hidden data augmentation. By estimating the knowledge distribution in all layers of GPT-2 and transforming it from teacher model to student model, the Self-distillation based on the Earth Mover's Distance can significantly reduce the demand for pseudo-data. Hidden data augmentation can greatly alleviate the catastrophic forgetting caused by deviations via modeling the generation of pseudo-data as a hidden data augmentation process, where each sample is a mixture of all trained task data. The experimental results demonstrate that our DFSD can exceed the previous state-of-the-art methods even if the maximum decrease in pseudo-data is 90%.

cs.CL↗

arXiv2021

Selective hydrogenation improves interface properties of high-k dielectrics on 2D semiconductors

The integration of high-k dielectrics with two-dimensional (2D) semiconductors is a critical step towards high-performance nanoelectronics, which however remains challenging due to high density of interface states and the damage to the monolayer 2D semiconductors. In this study, we propose a selective hydrogenation strategy to improve the interface properties while do not affect the 2D semiconductors. Using the interface of monolayer MoS2 and silicon nitride as an example, we show substantially improved interface properties for electronic applications after the interfacial hydrogenation, as evidenced by reduced inhomogeneous charge redistribution, increased band offset, and untouched electronic properties of MoS2. Interestingly, this hydrogenation process selectively occurs only at the silicon nitride surface and is compatible with the current semiconductor fabrication process. We further show that this strategy is general and applicable to other interfaces between high-k dielectrics and 2D semiconductors such as HfO2 on the monolayer MoS2. Our results demonstrate a simple yet viable way to improve the interfacial properties for integrating many high-k dielectrics on a broad range of two-dimensional transition metal disulfide semiconductors.

cond-mat.mtrl-sci↗

arXiv2021

PP-OCRv2: Bag of Tricks for Ultra Lightweight OCR System

Optical Character Recognition (OCR) systems have been widely used in various of application scenarios. Designing an OCR system is still a challenging task. In previous work, we proposed a practical ultra lightweight OCR system (PP-OCR) to balance the accuracy against the efficiency. In order to improve the accuracy of PP-OCR and keep high efficiency, in this paper, we propose a more robust OCR system, i.e. PP-OCRv2. We introduce bag of tricks to train a better text detector and a better text recognizer, which include Collaborative Mutual Learning (CML), CopyPaste, Lightweight CPUNetwork (LCNet), Unified-Deep Mutual Learning (U-DML) and Enhanced CTCLoss. Experiments on real data show that the precision of PP-OCRv2 is 7% higher than PP-OCR under the same inference cost. It is also comparable to the server models of the PP-OCR which uses ResNet series as backbones. All of the above mentioned models are open-sourced and the code is available in the GitHub repository PaddleOCR which is powered by PaddlePaddle.

cs.CV↗

arXiv2021

Thermal percolation and electrical insulation in composite materials with partially metallic coated fillers

We propose a type of thermal interface materials incorporating insulating nanowires with partially metallic coating in insulating polymer matrix.Large thermal conductivity can be obtained due to thermal percolation while the electrical insulation is maintained by controlling $C_{\rm M}φ< φ_{\rm c}^{\rm e}$ and $φ> φ_{\rm c}^{\rm th}$, where $φ$ is the volume fraction of filler, $C_{\rm M}$ is the metallic coating fraction, $φ_{\rm c}^{\rm e}$ and $φ_{\rm c}^{\rm th}$ are the electrical and thermal percolation thresholds, respectively. The electrical conductivity of such composite materials can further be regulated by coating configuration. In this regard, we propose the concept of "thermal-percolation electrical-insulation", providing a guide to design efficient hybrid thermal interface materials.

physics.app-ph↗

arXiv2021

Large-Scale Secure XGB for Vertical Federated Learning

Privacy-preserving machine learning has drawn increasingly attention recently, especially with kinds of privacy regulations come into force. Under such situation, Federated Learning (FL) appears to facilitate privacy-preserving joint modeling among multiple parties. Although many federated algorithms have been extensively studied, there is still a lack of secure and practical gradient tree boosting models (e.g., XGB) in literature. In this paper, we aim to build large-scale secure XGB under vertically federated learning setting. We guarantee data privacy from three aspects. Specifically, (i) we employ secure multi-party computation techniques to avoid leaking intermediate information during training, (ii) we store the output model in a distributed manner in order to minimize information release, and (iii) we provide a novel algorithm for secure XGB predict with the distributed model. Furthermore, by proposing secure permutation protocols, we can improve the training efficiency and make the framework scale to large dataset. We conduct extensive experiments on both public datasets and real-world datasets, and the results demonstrate that our proposed XGB models provide not only competitive accuracy but also practical performance.

cs.LG↗

arXiv2021

Improving Transferability of Adversarial Patches on Face Recognition with Generative Models

Face recognition is greatly improved by deep convolutional neural networks (CNNs). Recently, these face recognition models have been used for identity authentication in security sensitive applications. However, deep CNNs are vulnerable to adversarial patches, which are physically realizable and stealthy, raising new security concerns on the real-world applications of these models. In this paper, we evaluate the robustness of face recognition models using adversarial patches based on transferability, where the attacker has limited accessibility to the target models. First, we extend the existing transfer-based attack techniques to generate transferable adversarial patches. However, we observe that the transferability is sensitive to initialization and degrades when the perturbation magnitude is large, indicating the overfitting to the substitute models. Second, we propose to regularize the adversarial patches on the low dimensional data manifold. The manifold is represented by generative models pre-trained on legitimate human face images. Using face-like features as adversarial perturbations through optimization on the manifold, we show that the gaps between the responses of substitute models and the target models dramatically decrease, exhibiting a better transferability. Extensive digital world experiments are conducted to demonstrate the superiority of the proposed method in the black-box setting. We apply the proposed method in the physical world as well.

cs.CV↗

arXiv2021

A Unified Framework for Cross-Domain and Cross-System Recommendations

Cross-Domain Recommendation (CDR) and Cross-System Recommendation (CSR) have been proposed to improve the recommendation accuracy in a target dataset (domain/system) with the help of a source one with relatively richer information. However, most existing CDR and CSR approaches are single-target, namely, there is a single target dataset, which can only help the target dataset and thus cannot benefit the source dataset. In this paper, we focus on three new scenarios, i.e., Dual-Target CDR (DTCDR), Multi-Target CDR (MTCDR), and CDR+CSR, and aim to improve the recommendation accuracy in all datasets simultaneously for all scenarios. To do this, we propose a unified framework, called GA (based on Graph embedding and Attention techniques), for all three scenarios. In GA, we first construct separate heterogeneous graphs to generate more representative user and item embeddings. Then, we propose an element-wise attention mechanism to effectively combine the embeddings of common entities (users/items) learned from different datasets. Moreover, to avoid negative transfer, we further propose a Personalized training strategy to minimize the embedding difference of common entities between a richer dataset and a sparser dataset, deriving three new models, i.e., GA-DTCDR-P, GA-MTCDR-P, and GA-CDR+CSR-P, for the three scenarios respectively. Extensive experiments conducted on four real-world datasets demonstrate that our proposed GA models significantly outperform the state-of-the-art approaches.

cs.IR↗

arXiv2021

SIFN: A Sentiment-aware Interactive Fusion Network for Review-based Item Recommendation

Recent studies in recommender systems have managed to achieve significantly improved performance by leveraging reviews for rating prediction. However, despite being extensively studied, these methods still suffer from some limitations. First, previous studies either encode the document or extract latent sentiment via neural networks, which are difficult to interpret the sentiment of reviewers intuitively. Second, they neglect the personalized interaction of reviews with user/item, i.e., each review has different contributions when modeling the sentiment preference of user/item. To remedy these issues, we propose a Sentiment-aware Interactive Fusion Network (SIFN) for review-based item recommendation. Specifically, we first encode user/item reviews via BERT and propose a light-weighted sentiment learner to extract semantic features of each review. Then, we propose a sentiment prediction task that guides the sentiment learner to extract sentiment-aware features via explicit sentiment labels. Finally, we design a rating prediction task that contains a rating learner with an interactive and fusion module to fuse the identity (i.e., user and item ID) and each review representation so that various interactive features can synergistically influence the final rating score. Experimental results on five real-world datasets demonstrate that the proposed model is superior to state-of-the-art models.

cs.IR↗

arXiv2021

Structure dependent and strain tunable magnetic ordering in ultrathin chromium telluride

Two-dimensional (2D) chromium tellurides have attracted considerable research interest for their high Curie temperatures. Their magnetic properties have been found diverse in various experiments, the understanding of which however remains limited. In this work, we report that the magnetic ordering of ultrathin chromium tellurides is structure dependent and can be tuned by external strain. Based on first-principles calculations and Monte Carlo simulations, we show long-range stable magnetism with high and low Curie temperature, and short-range magnetism in 2D Cr5Te8, CrTe2, and Cr2Te3 layers, respectively. We further find that ferromagnetic-to-antiferromagnetic transition can be realized by 2% compressive strain for CrTe2 and 2% tensile strain for Cr2Te3, and their magnetic easy axis is tuned from out-of-plane to in-plane by the medium tensile and compressive strain. This strain dependent magnetic coupling is found to be related to Cr-Cr direct exchange and the change of magnetic anisotropy is understood by the atom and orbital resolved magnetic anisotropy energy and second order perturbation theory. Our results reveal the important roles of the structure and strain in determining the magnetic ordering in 2D chromium telluride, shedding light on understanding of the diverse magnetic properties observed in experiments.

cond-mat.mtrl-sci↗