arXiv subjects

Wei He

Publications and source records attributed to Wei He.

At least 199 records · Page 11Linked to original sources

arXiv2022

Enhancing Sequential Recommendation with Graph Contrastive Learning

The sequential recommendation systems capture users' dynamic behavior patterns to predict their next interaction behaviors. Most existing sequential recommendation methods only exploit the local context information of an individual interaction sequence and learn model parameters solely based on the item prediction loss. Thus, they usually fail to learn appropriate sequence representations. This paper proposes a novel recommendation framework, namely Graph Contrastive Learning for Sequential Recommendation (GCL4SR). Specifically, GCL4SR employs a Weighted Item Transition Graph (WITG), built based on interaction sequences of all users, to provide global context information for each interaction and weaken the noise information in the sequence data. Moreover, GCL4SR uses subgraphs of WITG to augment the representation of each interaction sequence. Two auxiliary learning objectives have also been proposed to maximize the consistency between augmented representations induced by the same interaction sequence on WITG, and minimize the difference between the representations augmented by the global context on WITG and the local representation of the original sequence. Extensive experiments on real-world datasets demonstrate that GCL4SR consistently outperforms state-of-the-art sequential recommendation methods.

cs.IR↗

arXiv2022

Calibration Strategy of the JUNO-TAO Experiment

The Taishan Antineutrino Observatory (JUNO-TAO, or TAO) is a satellite detector for the Jiangmen Underground Neutrino Observatory (JUNO). Located near the Taishan reactor, TAO independently measures the reactor's antineutrino energy spectrum with unprecedented energy resolution. To achieve this goal, energy response must be well calibrated. Using the Automated Calibration Unit (ACU) and the Cable Loop System (CLS) of TAO, multiple radioactive sources are deployed to various positions in the detector to perform a precise calibration of energy response. The non-linear energy response can be controlled within 0.6% with different energy points of these radioactive sources. It can be further improved by using $^{12}\rm B$ decay signals produced by cosmic muons. Through the energy non-uniformity calibration, residual non-uniformity is less than 0.2%. The energy resolution degradation and energy bias caused by the residual non-uniformity can be controlled within 0.05% and 0.3%, respectively. In addition, the stability of other detector parameters, such as the gain of each silicon photo-multiplier, can be monitored with a special ultraviolet LED calibration system.

physics.ins-det↗

arXiv2022

Improving the machine learning based vertex reconstruction for large liquid scintillator detectors with multiple types of PMTs

Precise vertex reconstruction is essential for large liquid scintillator detectors. A novel method based on machine learning has been successfully developed to reconstruct the event vertex in JUNO previously. In this paper, the performance of machine learning based vertex reconstruction is further improved by optimizing the input images of the neural networks. By separating the information of different types of PMTs as well as adding the information of the second hit of PMTs, the vertex resolution is improved by about 9.4 % at 1 MeV and 9.8 % at 11 MeV, respectively.

physics.ins-det↗

arXiv2022

Emergence of spin singlets with inhomogeneous gaps in the kagome Heisenberg antiferromagnets Zn-barlowite and herbertsmithite

The kagome Heisenberg antiferromagnet formed by frustrated spins arranged in a lattice of corner-sharing triangles is a prime candidate for hosting a quantum spin liquid (QSL) ground state consisting of entangled spin singlets. But the existence of various competing states makes a convincing theoretical prediction of the QSL ground state difficult, calling for experimental clues from model materials. The kagome lattice materials Zn-barlowite ZnCu$_{3}$(OD)$_{6}$FBr and herbertsmithite ZnCu$_{3}$(OD)$_{6}$Cl$_2$ do not exhibit long range order, and they are considered the best realizations of the kagome Heisenberg antiferromagnet known to date. Here we use $^{63}$Cu nuclear quadrupole resonance combined with the inverse Laplace transform (ILT) to probe locally the inhomogeneity of delicate quantum ground states affected by disorder. We present direct evidence for the gradual emergence of spin singlets with spatially varying excitation gaps, but even at temperatures far below the super-exchange energy scale their fraction is limited to approximately 60\% of the total spins. Theoretical models need to incorporate the role of disorder to account for the observed inhomogeneously gapped behaviour.

cond-mat.str-el↗

arXiv2022

Freezing of the Lattice in the Kagome Lattice Heisenberg Antiferromagnet Zn-barlowite ZnCu$_3$(OD)$_6$FBr

We use $^{79}$Br nuclear quadrupole resonance (NQR) to demonstrate that ultra slow lattice dynamics set in below the temperature scale set by the Cu-Cu super-exchange interaction $J$~($\simeq160$~K) in the kagome lattice Heisenberg antiferromagnet Zn-barlowite. The lattice completely freezes below 50~K, and $^{79}$Br NQR lineshapes become twice broader due to increased lattice distortions. Moreover, the frozen lattice exhibits an oscillatory component in the transverse spin echo decay, a typical signature of pairing of nuclear spins by indirect nuclear spin-spin interaction. This indicates that some Br sites form structural dimers via a pair of kagome Cu sites prior to the gradual emergence of spin singlets below $\sim30$~K. Our findings underscore the significant roles played by subtle structural distortions in determining the nature of the disordered magnetic ground state of the kagome lattice.

cond-mat.str-el↗

arXiv2022

Uncovering the dynamic effects of DEX treatment on lung cancer by integrating bioinformatic inference and multiscale modeling of scRNA-seq and proteomics data

Motivation: Lung cancer is one of the leading causes for cancer-related death, with a five-year survival rate of 18%. It is a priority for us to understand the underlying mechanisms that affect the implementation and effectiveness of lung cancer therapeutics. In this study, we combine the power of Bioinformatics and Systems Biology to comprehensively uncover functional and signaling pathways of drug treatment using bioinformatics inference and multiscale modeling of both scRNA-seq data and proteomics data. The innovative and cross-disciplinary approach can be further applied to other computational studies in tumorigenesis and oncotherapy. Results: A time series of lung adenocarcinoma-derived A549 cells after DEX treatment were analysed. (1) We first discovered the differentially expressed genes in those lung cancer cells. Then through the interrogation of their regulatory network, we identified key hub genes including TGF-\b{eta}, MYC, and SMAD3 varied underlie DEX treatment. Further enrichment analysis revealed the TGF-\b{eta} signaling pathway as the top enriched term. Those genes involved in the TGF-\b{eta} pathway and their crosstalk with the ERBB pathway presented a strong survival prognosis in clinical lung cancer samples. (2) Based on biological validation and further curation, a multiscale model of tumor regulation centered on both TGF-\b{eta}-induced and ERBB-amplified signaling pathways was developed to characterize the dynamics effects of DEX therapy on lung cancer cells. Our simulation results were well matched to available data of SMAD2, FOXO3, TGF\b{eta}1, and TGF\b{eta}R1 over the time course. Moreover, we provided predictions of different doses to illustrate the trend and therapeutic potential of DEX treatment.

q-bio.QM↗

arXiv2021

SoftTRR: Protect Page Tables Against RowHammer Attacks using Software-only Target Row Refresh

Rowhammer attacks that corrupt level-1 page tables to gain kernel privilege are the most detrimental to system security and hard to mitigate. However, recently proposed software-only mitigations are not effective against such kernel privilege escalation attacks. In this paper, we propose an effective and practical software-only defense, called SoftTRR, to protect page tables from all existing rowhammer attacks on x86. The key idea of SoftTRR is to refresh the rows occupied by page tables when a suspicious rowhammer activity is detected. SoftTRR is motivated by DRAM-chip-based target row refresh (ChipTRR) but eliminates its main security limitation (i.e., ChipTRR tracks a limited number of rows and thus can be bypassed by many-sided hammer). Specifically, SoftTRR protects an unlimited number of page tables by tracking memory accesses to the rows that are in close proximity to page-table rows and refreshing the page-table rows once the tracked access count exceeds a pre-defined threshold. We implement a prototype of SoftTRR as a loadable kernel module, and evaluate its security effectiveness, performance overhead, and memory consumption. The experimental results show that SoftTRR protects page tables from real-world rowhammer attacks and incurs small performance overhead as well as memory cost.

cs.CR↗

arXiv2021

A Miniature Biological Eagle-Eye Vision System for Small Target Detection

Small target detection is known to be a challenging problem. Inspired by the structural characteristics and physiological mechanism of eagle-eye, a miniature vision system is designed for small target detection in this paper. First, a hardware platform is established, which consists of a pan-tilt, a short-focus camera and a long-focus camera. Then, based on the visual attention mechanism of eagle-eye, the cameras with different focal lengths are controlled cooperatively to achieve small target detection. Experimental results show that the designed biological eagle-eye vision system can accurately detect small targets, which has a strong adaptive ability.

cs.CV↗

arXiv2021

Vision-Based Target Localization for a Flapping-Wing Aerial Vehicle

The flapping-wing aerial vehicle (FWAV) is a new type of flying robot that mimics the flight mode of birds and insects. However, FWAVs have their special characteristics of less load capacity and short endurance time, so that most existing systems of ground target localization are not suitable for them. In this paper, a vision-based target localization algorithm is proposed for FWAVs based on a generic camera model. Since sensors exist measurement error and the camera exists jitter and motion blur during flight, Gaussian noises are introduced in the simulation experiment, and then a first-order low-pass filter is used to stabilize the localization values. Moreover, in order to verify the feasibility and accuracy of the target localization algorithm, we design a set of simulation experiments where various noises are added. From the simulation results, it is found that the target localization algorithm has a good performance.

cs.RO↗

arXiv2021

AlterSGD: Finding Flat Minima for Continual Learning by Alternative Training

Deep neural networks suffer from catastrophic forgetting when learning multiple knowledge sequentially, and a growing number of approaches have been proposed to mitigate this problem. Some of these methods achieved considerable performance by associating the flat local minima with forgetting mitigation in continual learning. However, they inevitably need (1) tedious hyperparameters tuning, and (2) additional computational cost. To alleviate these problems, in this paper, we propose a simple yet effective optimization method, called AlterSGD, to search for a flat minima in the loss landscape. In AlterSGD, we conduct gradient descent and ascent alternatively when the network tends to converge at each session of learning new knowledge. Moreover, we theoretically prove that such a strategy can encourage the optimization to converge to a flat minima. We verify AlterSGD on continual learning benchmark for semantic segmentation and the empirical results show that we can significantly mitigate the forgetting and outperform the state-of-the-art methods with a large margin under challenging continual learning protocols.

cs.LG↗

arXiv2021

Efficient Attention Network: Accelerate Attention by Searching Where to Plug

Recently, many plug-and-play self-attention modules are proposed to enhance the model generalization by exploiting the internal information of deep convolutional neural networks (CNNs). Previous works lay an emphasis on the design of attention module for specific functionality, e.g., light-weighted or task-oriented attention. However, they ignore the importance of where to plug in the attention module since they connect the modules individually with each block of the entire CNN backbone for granted, leading to incremental computational cost and number of parameters with the growth of network depth. Thus, we propose a framework called Efficient Attention Network (EAN) to improve the efficiency for the existing attention modules. In EAN, we leverage the sharing mechanism (Huang et al. 2020) to share the attention module within the backbone and search where to connect the shared attention module via reinforcement learning. Finally, we obtain the attention network with sparse connections between the backbone and modules, while (1) maintaining accuracy (2) reducing extra parameter increment and (3) accelerating inference. Extensive experiments on widely-used benchmarks and popular attention networks show the effectiveness of EAN. Furthermore, we empirically illustrate that our EAN has the capacity of transferring to other tasks and capturing the informative features. The code is available at https://github.com/gbup-group/EAN-efficient-attention-network.

cs.CV↗

arXiv2021

Blending Pruning Criteria for Convolutional Neural Networks

The advancement of convolutional neural networks (CNNs) on various vision applications has attracted lots of attention. Yet the majority of CNNs are unable to satisfy the strict requirement for real-world deployment. To overcome this, the recent popular network pruning is an effective method to reduce the redundancy of the models. However, the ranking of filters according to their "importance" on different pruning criteria may be inconsistent. One filter could be important according to a certain criterion, while it is unnecessary according to another one, which indicates that each criterion is only a partial view of the comprehensive "importance". From this motivation, we propose a novel framework to integrate the existing filter pruning criteria by exploring the criteria diversity. The proposed framework contains two stages: Criteria Clustering and Filters Importance Calibration. First, we condense the pruning criteria via layerwise clustering based on the rank of "importance" score. Second, within each cluster, we propose a calibration factor to adjust their significance for each selected blending candidates and search for the optimal blending criterion via Evolutionary Algorithm. Quantitative results on the CIFAR-100 and ImageNet benchmarks show that our framework outperforms the state-of-the-art baselines, regrading to the compact model performance after pruning.

cs.CV↗

arXiv2021

Unmixing Convolutional Features for Crisp Edge Detection

This paper presents a context-aware tracing strategy (CATS) for crisp edge detection with deep edge detectors, based on an observation that the localization ambiguity of deep edge detectors is mainly caused by the mixing phenomenon of convolutional neural networks: feature mixing in edge classification and side mixing during fusing side predictions. The CATS consists of two modules: a novel tracing loss that performs feature unmixing by tracing boundaries for better side edge learning, and a context-aware fusion block that tackles the side mixing by aggregating the complementary merits of learned side edges. Experiments demonstrate that the proposed CATS can be integrated into modern deep edge detectors to improve localization accuracy. With the vanilla VGG16 backbone, in terms of BSDS500 dataset, our CATS improves the F-measure (ODS) of the RCF and BDCN deep edge detectors by 12% and 6% respectively when evaluating without using the morphological non-maximal suppression scheme for edge detection.

cs.CV↗

arXiv2021

Exact tensor closures for the three dimensional Jeffery's equation

This paper presents an exact formula for calculating the fourth-moment tensor from the second-moment tensor for the three dimensional Jeffery's equation. Although this approach falls within the category of a moment tensor closure, it does not rely upon an approximation, either analytic or curve fit, of the fourth-moment tensor as do previous closures. This closure is orthotropic in the sense of \cite{cintra:95}, or equivalently, a natural closure in the sense of \cite{verleye:93}. The existence of these explicit formulae has been asserted previously, but as far as the authors know, the explicit forms have yet to be published. The formulae involve elliptic integrals, and are valid whenever fiber orientation was isotropic at some point in time. Finally, this paper presents the Fast Exact Closure (FEC), a fast and in principle exact method for solving Jeffery's equation, which does not require approximate closures, nor the elliptic integral computation.

physics.flu-dyn↗

arXiv2021

Characterization of equilibrium existence and purification in general Bayesian games

This paper studies Bayesian games with general action spaces, correlated types and interdependent payoffs. We introduce the condition of ``decomposable coarser payoff-relevant information'', and show that this condition is both sufficient and necessary for the existence of pure-strategy equilibria and purification from behavioral strategies. As a consequence of our purification method, a new existence result on pure-strategy equilibria is also obtained for discontinuous Bayesian games. Illustrative applications of our results to oligopolistic competitions and all-pay auctions are provided.

econ.GN↗

arXiv2021

Conditional Expectation of Banach Valued Correspondences

We present some regularity properties (convexity, weak/weak* compactness and preservation of weak/weak* upper hemicontinuity) for Bochner/Gelfand conditional expectation of Banach valued correspondences under the nowhere equivalence condition. These regularity properties for Bochner/Gelfand integral of Banach valued correspondences are obtained as corollaries. Similar properties for regular conditional distributions are also covered by the corresponding results for Gelfand conditional expectation of correspondences. We prove the necessity of the nowhere equivalence condition for any of these properties to hold. As an application, we show that the nowhere equivalence condition is satisfied on the space of players if and only if a pure-strategy Nash equilibrium exists in a general class of large games.

math.PR↗

arXiv2021

Anisotropic magnon-magnon coupling in synthetic antiferromagnets

The magnon-magnon coupling in synthetic antiferromagnets advances it as hybrid magnonic systems to explore the quantum information technologies. To induce the magnon-magnon coupling, the parity symmetry between two magnetization needs to be broken. Here we experimentally demonstrate a convenient method to break the parity symmetry by the asymmetric thickness of two magnetic layers and thus introduce a magnon-magnon coupling in Ir-based synthetic antiferromagnets CoFeB(10 nm)/Ir(tIr=0.6 nm, 1.2 nm)/CoFeB(13 nm). Remarkably, we find that the weakly uniaxial anisotropy field (~ 20 Oe) makes the magnon-magnon coupling anisotropic. The coupling strength presented by a characteristic anticrossing gap varies in the range between 0.54 GHz and 0.90 GHz for tIr =0.6 nm, and between nearly zero to 1.4 GHz for tIr = 1.2 nm, respectively. Our results demonstrate a feasible way to induce the magnon-magnon coupling by an asymmetric structure and tune the coupling strength by varying the direction of in-plane magnetic field. The magnon-magnon coupling in this highly tunable material system could open exciting perspectives for exploring quantum-mechanical coupling phenomena.

cond-mat.mtrl-sci↗

arXiv2021

From Semantic Retrieval to Pairwise Ranking: Applying Deep Learning in E-commerce Search

We introduce deep learning models to the two most important stages in product search at JD.com, one of the largest e-commerce platforms in the world. Specifically, we outline the design of a deep learning system that retrieves semantically relevant items to a query within milliseconds, and a pairwise deep re-ranking system, which learns subtle user preferences. Compared to traditional search systems, the proposed approaches are better at semantic retrieval and personalized ranking, achieving significant improvements.

cs.IR↗