arXiv Science⌕ Search

arXiv subjects

Wei Cheng

Publications and source records attributed to Wei Cheng.

At least 217 records · Page 12Linked to original sources
arXiv2021

Recommend for a Reason: Unlocking the Power of Unsupervised Aspect-Sentiment Co-Extraction

Compliments and concerns in reviews are valuable for understanding users' shopping interests and their opinions with respect to specific aspects of certain items. Existing review-based recommenders favor large and complex language encoders that can only learn latent and uninterpretable text representations. They lack explicit user attention and item property modeling, which however could provide valuable information beyond the ability to recommend items. Therefore, we propose a tightly coupled two-stage approach, including an Aspect-Sentiment Pair Extractor (ASPE) and an Attention-Property-aware Rating Estimator (APRE). Unsupervised ASPE mines Aspect-Sentiment pairs (AS-pairs) and APRE predicts ratings using AS-pairs as concrete aspect-level evidence. Extensive experiments on seven real-world Amazon Review Datasets demonstrate that ASPE can effectively extract AS-pairs which enable APRE to deliver superior accuracy over the leading baselines.

cs.IR↗
arXiv2021

A new way to test the WIMP dark matter models

In this paper, we investigate the possibility of testing the weakly interacting massive particle (WIMP) dark matter (DM) models by applying the simplest phenomenological model which introduces an interaction term between dark energy (DE) and WIMP DM, i.e., $Q = 3γ_{DM} Hρ_{DM}$. In general, the coupling strength $γ_{DE}$ is close to $0$ as the interaction between DE and WIMP DM is very weak, thus the effect of $γ_ {DE}$ on the evolution of $Y$ associated with DM energy density can be safely neglected. Meanwhile, our numerical calculation also indicates that $x_f\approx20$ is associated with DM freeze-out temperature, which is the same as the vanishing interaction scenario. As for DM relic density, it will be magnified by $\frac{2-3γ_{DM}}{2}[{2πg_* m_{DM}^3}/{(45 s_0 x_f^3})]^{γ_{DM}}$ times, which provides a new way to test WIMP DM models. As an example, we analyze the case in which WIMP DM is a scalar DM. (SGL+SNe+Hz) and (CMB+BAO+SNe) cosmological observations will give $γ_{DM}=0.134^{+0.17}_{-0.069}$ and $γ_{DM}=-0.0008\pm0.0016$, respectively. After further considering the constraints from DM direct detection experiment, DM indirect detection experiment, and DM relic density, we find that the allowed parameter space of the scalar DM model will be completely excluded for the former cosmological observations, while it will increase for the latter ones. Those two cosmological observations lead to an almost paradoxical conclusion. Therefore, one could expect more stringent constraints on the WMIP DM models, with the accumulation of more accurate cosmological observations in the near future.

astro-ph.CO↗
arXiv2021

Gravitational Wave From Axion-like Particle Inflation

In this paper, we investigate the Axion-like Particle inflation by applying the multi-nature inflation model, where the end of inflation is achieved through the phase transition (PT). The events of PT should not be less than $200$, which results in the free parameter $n\geq404$. Under the latest CMB restrictions, we found that the inflation energy is fixed at $10^{15} \rm{GeV}$. Then, we deeply discussed the corresponding stochastic background of the primordial gravitational wave (GW) during inflation. We study the two kinds of $n$ cases, i.e., $n=404, 2000$. We observe that the magnitude of $n$ is negligible for the physical observations, such as $n_s$, $r$, $Λ$, and $Ω_{\rm{GW}}h^2$. In the low-frequency regions, the GW is dominated by the quantum fluctuations, and this GW can be detected by Decigo at $10^{-1}~\rm{Hz}$. However, GW generated by PT dominates the high-frequency regions, which is expected to be detected by future 3DSR detector.

hep-ph↗
arXiv2021

Insight from NLP Analysis: COVID-19 Vaccines Sentiments on Social Media

Social media is an appropriate source for analyzing public attitudes towards the COVID-19 vaccine and various brands. Nevertheless, there are few relevant studies. In the research, we collected tweet posts by the UK and US residents from the Twitter API during the pandemic and designed experiments to answer three main questions concerning vaccination. To get the dominant sentiment of the civics, we performed sentiment analysis by VADER and proposed a new method that can count the individual's influence. This allows us to go a step further in sentiment analysis and explain some of the fluctuations in the data changing. The results indicated that celebrities could lead the opinion shift on social media in vaccination progress. Moreover, at the peak, nearly 40\% of the population in both countries have a negative attitude towards COVID-19 vaccines. Besides, we investigated how people's opinions toward different vaccine brands are. We found that the Pfizer vaccine enjoys the most popular among people. By applying the sentiment analysis tool, we discovered most people hold positive views toward the COVID-19 vaccine manufactured by most brands. In the end, we carried out topic modelling by using the LDA model. We found residents in the two countries are willing to share their views and feelings concerning the vaccine. Several death cases have occurred after vaccination. Due to these negative events, US residents are more worried about the side effects and safety of the vaccine.

cs.CL↗
arXiv2021

On Conditional $α$-Information and its Application to Side-Channel Analysis

A conditional version of Sibson's $α$-information is defined using a simple closed-form "log-expectation" expression, which satisfies important properties such as consistency, uniform expansion, and data processing inequalities. This definition is compared to previous ones, which in contrast do not satisfy all of these properties. Based on our proposal and on a generalized Fano inequality, we extend the case $α= 1$ of previous works to obtain sharp universal upper bounds for the probability of success of any type side-channel attack, particularly when $α= 2$.

cs.IT↗
arXiv2021

Multi-objective Herglotz' variational principle and cooperative Hamilton-Jacobi systems

We study a multi-objective variational problem of Herglotz' type with cooperative linear coupling. We established the associated Euler-Lagrange equations and the characteristic system for cooperative weakly coupled systems of Hamilton-Jacobi equations. We also established the relation of the value functions of this variational problem with the viscosity solutions of cooperative weakly coupled systems of Hamilton-Jacobi equations. Comparing to the previous work in stochastic frame, this approach affords a pure deterministic explanation of this problem under more general conditions. We also showed this approach is valid for general linearly coupling matrix for short time.

math.AP↗
arXiv2021

Axion-like particle inflation and dark matter

In this paper, we propose a generalized natural inflation (GNI) model to study axion-like particle (ALP) inflation and dark matter (DM). GNI contains two additional parameters $(n_1, n_2)$ in comparison with the natural inflation, that make GNI more general. The $n_1$ build the connection between GNI and other ALP inflation model, $n_2$ controls the inflaton mass. After considering the cosmic microwave background and other cosmological observation limits, the model can realize small-field inflation with a wide mass range, and the ALP inflaton considering here can serve as the DM candidate for certain parameter spaces.

hep-ph↗
arXiv2021

FACESEC: A Fine-grained Robustness Evaluation Framework for Face Recognition Systems

We present FACESEC, a framework for fine-grained robustness evaluation of face recognition systems. FACESEC evaluation is performed along four dimensions of adversarial modeling: the nature of perturbation (e.g., pixel-level or face accessories), the attacker's system knowledge (about training data and learning architecture), goals (dodging or impersonation), and capability (tailored to individual inputs or across sets of these). We use FACESEC to study five face recognition systems in both closed-set and open-set settings, and to evaluate the state-of-the-art approach for defending against physically realizable attacks on these. We find that accurate knowledge of neural architecture is significantly more important than knowledge of the training data in black-box attacks. Moreover, we observe that open-set face recognition systems are more vulnerable than closed-set systems under different types of attacks. The efficacy of attacks for other threat model variations, however, appears highly dependent on both the nature of perturbation and the neural network architecture. For example, attacks that involve adversarial face masks are usually more potent, even against adversarially trained models, and the ArcFace architecture tends to be more robust than the others.

cs.CV↗
arXiv2021

The $D_s$-meson leading-twist distribution amplitude within the QCD sum rules and its application to the $B_s \to D_s$ transition form factor

We make a detailed study on the $D_s$ meson leading-twist LCDA $ϕ_{2;D_s}$ by using the QCD sum rules within the framework of the background field theory. To improve the precision, its moments $\langle ξ^n\rangle _{2;D_s}$ are calculated up to dimension-six condensates. At the scale $μ= 2{\rm GeV}$, we obtain: $\langle ξ^1\rangle _{2;D_s}= -0.261^{+0.020}_{-0.020}$, $\langle ξ^2\rangle _{2;D_s} = 0.184^{+0.012}_{-0.012}$, $\langle ξ^3\rangle _{2;D_s} = -0.111 ^{+0.007}_{-0.012}$ and $\langle ξ^4\rangle _{2;D_s} = 0.075^{+0.005}_{-0.005}$. Using those moments, the $ϕ_{2;D_s}$ is then constructed by using the light-cone harmonic oscillator model. As an application, we calculate the transition form factor $f^{B_s\to D_s}_+(q^2)$ within the light-cone sum rules (LCSR) approach by using a right-handed chiral current, in which the terms involving $ϕ_{2;D_s}$ dominates the LCSR. It is noted that the extrapolated $f^{B_s\to D_s}_+(q^2)$ agrees with the Lattice QCD prediction. After extrapolating the transition form factor to the physically allowable $q^2$-region, we calculate the branching ratio and the CKM matrix element, which give $\mathcal{B}(\bar B_s^0 \to D_s^+ \ellν_\ell) = (2.03^{+0.35}_{-0.49}) \times 10^{-2}$ and $|V_{cb}|=(40.00_{-4.08}^{+4.93})\times 10^{-3}$.

hep-ph↗
arXiv2021

Unsupervised Document Embedding via Contrastive Augmentation

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining, we hypothesize that high-quality document embedding should be invariant to diverse paraphrases that preserve the semantics of the original document. With different backbones and contrastive learning frameworks, our study reveals the enormous benefits of contrastive augmentation for document representation learning with two additional insights: 1) including data augmentation in a contrastive way can substantially improve the embedding quality in unsupervised document representation learning, and 2) in general, stochastic augmentations generated by simple word-level manipulation work much better than sentence-level and document-level ones. We plug our method into a classifier and compare it with a broad range of baseline methods on six benchmark datasets. Our method can decrease the classification error rate by up to 6.4% over the SOTA approaches on the document classification task, matching or even surpassing fully-supervised methods.

cs.CL↗
arXiv2021

Local strict singular characteristics: Cauchy problem with smooth initial data

Main purpose of this paper is to study the local propagation of singularities of viscosity solution to contact type evolutionary Hamilton-Jacobi equation $$ D_tu(t,x)+H(t,x,D_xu(t,x),u(t,x))=0. $$ An important issue of this topic is the existence, uniqueness and regularity of the strict singular characteristic. We apply the recent existence and regularity results on the Herglotz' type variational problem to the aforementioned Hamilton-Jacobi equation with smooth initial data. We obtain some new results on the local structure of the cut set of the viscosity solution near non-conjugate singular points. Especially, we obtain an existence result of smooth strict singular characteristic from and to non-conjugate singular initial point based on the structure of the superdifferential of the solution, which is even new in the classical time-dependent case. We also get a global propagation result for the $C^1$ singular support in the contact case.

math.AP↗
arXiv2021

Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time Series

Forecasting on sparse multivariate time series (MTS) aims to model the predictors of future values of time series given their incomplete past, which is important for many emerging applications. However, most existing methods process MTS's individually, and do not leverage the dynamic distributions underlying the MTS's, leading to sub-optimal results when the sparsity is high. To address this challenge, we propose a novel generative model, which tracks the transition of latent clusters, instead of isolated feature representations, to achieve robust modeling. It is characterized by a newly designed dynamic Gaussian mixture distribution, which captures the dynamics of clustering structures, and is used for emitting timeseries. The generative model is parameterized by neural networks. A structured inference network is also designed for enabling inductive analysis. A gating mechanism is further introduced to dynamically tune the Gaussian mixture distributions. Extensive experimental results on a variety of real-life datasets demonstrate the effectiveness of our method.

cs.LG↗
arXiv2021

Revisiting the production of $J/ψ+η_c$ via the $e^+e^-$ annihilation within the QCD light-cone sum rules

We make a detailed study on the typical production channel of double charmoniums, $e^+e^-\to J/ψ+η_c$, at the center-of-mass collision energy $\sqrt{s}=10.58$ GeV. The key component of the process is the form factor $F_{\rm VP}(q^2)$, which has been calculated within the QCD light-cone sum rules (LCSR). To improve the accuracy of the derived LCSR, we keep the $J/ψ$ light-cone distribution amplitude up to twist-4 accuracy. Total cross sections for $e^+e^-\to J/ψ+η_c$ at three typical factorization scales are $σ|_{μ_s} = 22.53^{+3.46}_{-3.49}~{\rm fb}$, $σ|_{μ_k} = 21.98^{+3.35}_{-3.38}~{\rm fb}$ and $σ|_{μ_0} = 21.74^{+3.29}_{-3.33}~{\rm fb}$, respectively. The factorization scale dependence is small, and those predictions are consistent with the BABAR and Belle measurements within errors.

hep-ph↗
arXiv2021

Singularities of solutions of Hamilton-Jacobi equations

This is a survey paper on the quantitative analysis of the propagation of singularities for the viscosity solutions to Hamilton-Jacobi equations in the past decades. We also review further applications of the theory to various fields such as Riemannian geometry, Hamiltonian dynamical systems and partial differential equations.

math.AP↗
arXiv2020

SimpleChrome: Encoding of Combinatorial Effects for Predicting Gene Expression

Due to recent breakthroughs in state-of-the-art DNA sequencing technology, genomics data sets have become ubiquitous. The emergence of large-scale data sets provides great opportunities for better understanding of genomics, especially gene regulation. Although each cell in the human body contains the same set of DNA information, gene expression controls the functions of these cells by either turning genes on or off, known as gene expression levels. There are two important factors that control the expression level of each gene: (1) Gene regulation such as histone modifications can directly regulate gene expression. (2) Neighboring genes that are functionally related to or interact with each other that can also affect gene expression level. Previous efforts have tried to address the former using Attention-based model. However, addressing the second problem requires the incorporation of all potentially related gene information into the model. Though modern machine learning and deep learning models have been able to capture gene expression signals when applied to moderately sized data, they have struggled to recover the underlying signals of the data due to the nature of the data's higher dimensionality. To remedy this issue, we present SimpleChrome, a deep learning model that learns the latent histone modification representations of genes. The features learned from the model allow us to better understand the combinatorial effects of cross-gene interactions and direct gene regulation on the target gene expression. The results of this paper show outstanding improvements on the predictive capabilities of downstream models and greatly relaxes the need for a large data set to learn a robust, generalized neural network. These results have immediate downstream effects in epigenomics research and drug development.

q-bio.GN↗
arXiv2020

Learning to Drop: Robust Graph Neural Network via Topological Denoising

Graph Neural Networks (GNNs) have shown to be powerful tools for graph analytics. The key idea is to recursively propagate and aggregate information along edges of the given graph. Despite their success, however, the existing GNNs are usually sensitive to the quality of the input graph. Real-world graphs are often noisy and contain task-irrelevant edges, which may lead to suboptimal generalization performance in the learned GNN models. In this paper, we propose PTDNet, a parameterized topological denoising network, to improve the robustness and generalization performance of GNNs by learning to drop task-irrelevant edges. PTDNet prunes task-irrelevant edges by penalizing the number of edges in the sparsified graph with parameterized networks. To take into consideration of the topology of the entire graph, the nuclear norm regularization is applied to impose the low-rank constraint on the resulting sparsified graph for better generalization. PTDNet can be used as a key component in GNN models to improve their performances on various tasks, such as node classification and link prediction. Experimental studies on both synthetic and benchmark datasets show that PTDNet can improve the performance of GNNs significantly and the performance gain becomes larger for more noisy datasets.

cs.LG↗
arXiv2020

Parameterized Explainer for Graph Neural Network

Despite recent progress in Graph Neural Networks (GNNs), explaining predictions made by GNNs remains a challenging open problem. The leading method independently addresses the local explanations (i.e., important subgraph structure and node features) to interpret why a GNN model makes the prediction for a single instance, e.g. a node or a graph. As a result, the explanation generated is painstakingly customized for each instance. The unique explanation interpreting each instance independently is not sufficient to provide a global understanding of the learned GNN model, leading to a lack of generalizability and hindering it from being used in the inductive setting. Besides, as it is designed for explaining a single instance, it is challenging to explain a set of instances naturally (e.g., graphs of a given class). In this study, we address these key challenges and propose PGExplainer, a parameterized explainer for GNNs. PGExplainer adopts a deep neural network to parameterize the generation process of explanations, which enables PGExplainer a natural approach to explaining multiple instances collectively. Compared to the existing work, PGExplainer has better generalization ability and can be utilized in an inductive setting easily. Experiments on both synthetic and real-life datasets show highly competitive performance with up to 24.7\% relative improvement in AUC on explaining graph classification over the leading baseline.

cs.LG↗