arXiv subjects

Liang He

Publications and source records attributed to Liang He.

At least 253 records · Page 14Linked to original sources

arXiv2022

A Knowledge-Enhanced Adversarial Model for Cross-lingual Structured Sentiment Analysis

Structured sentiment analysis, which aims to extract the complex semantic structures such as holders, expressions, targets, and polarities, has obtained widespread attention from both industry and academia. Unfortunately, the existing structured sentiment analysis datasets refer to a few languages and are relatively small, limiting neural network models' performance. In this paper, we focus on the cross-lingual structured sentiment analysis task, which aims to transfer the knowledge from the source language to the target one. Notably, we propose a Knowledge-Enhanced Adversarial Model (\texttt{KEAM}) with both implicit distributed and explicit structural knowledge to enhance the cross-lingual transfer. First, we design an adversarial embedding adapter for learning an informative and robust representation by capturing implicit semantic information from diverse multi-lingual embeddings adaptively. Then, we propose a syntax GCN encoder to transfer the explicit semantic information (e.g., universal dependency tree) among multiple languages. We conduct experiments on five datasets and compare \texttt{KEAM} with both the supervised and unsupervised methods. The extensive experimental results show that our \texttt{KEAM} model outperforms all the unsupervised baselines in various metrics.

cs.CL↗

arXiv2022

Enhancing Event-Level Sentiment Analysis with Structured Arguments

Previous studies about event-level sentiment analysis (SA) usually model the event as a topic, a category or target terms, while the structured arguments (e.g., subject, object, time and location) that have potential effects on the sentiment are not well studied. In this paper, we redefine the task as structured event-level SA and propose an End-to-End Event-level Sentiment Analysis ($\textit{E}^{3}\textit{SA}$) approach to solve this issue. Specifically, we explicitly extract and model the event structure information for enhancing event-level SA. Extensive experiments demonstrate the great advantages of our proposed approach over the state-of-the-art methods. Noting the lack of the dataset, we also release a large-scale real-world dataset with event arguments and sentiment labelling for promoting more researches\footnote{The dataset is available at https://github.com/zhangqi-here/E3SA}.

cs.CL↗

arXiv2022

Long-Tail Session-based Recommendation from Calibration

Accurate predictions in session-based recommendations have progressed, but a few studies have focused on skewed recommendation lists caused by popularity bias. Existing models for mitigating popularity bias have attempted to reduce the overconcentration of popular items by amplifying scores of less popular items. However, they normally ignore the users' different preferences toward long-tail items. Thus, we incorporate calibration, where calibrated recommendations reflect the users' interests in recommendation lists with appropriate proportions, to mitigate the popularity bias from the user's perspective. Specifically, we propose a calibration module to predict the ratio of tail items in the recommendation list from the session representation, and align it to the ongoing session. Additionally, we utilize a two-stage curriculum training strategy to improve prediction in the calibration module. Experiments on benchmark datasets show that our model can both achieve the competitive accuracy of recommendation and provide more tail items.

cs.IR↗

arXiv2022

A Survey of Human-in-the-loop for Machine Learning

Human-in-the-loop aims to train an accurate prediction model with minimum cost by integrating human knowledge and experience. Humans can provide training data for machine learning applications and directly accomplish tasks that are hard for computers in the pipeline with the help of machine-based approaches. In this paper, we survey existing works on human-in-the-loop from a data perspective and classify them into three categories with a progressive relationship: (1) the work of improving model performance from data processing, (2) the work of improving model performance through interventional model training, and (3) the design of the system independent human-in-the-loop. Using the above categorization, we summarize major approaches in the field; along with their technical strengths/ weaknesses, we have simple classification and discussion in natural language processing, computer vision, and others. Besides, we provide some open challenges and opportunities. This survey intends to provide a high-level summarization for human-in-the-loop and motivates interested readers to consider approaches for designing effective human-in-the-loop solutions.

cs.LG↗

arXiv2022

First Identification of New X-Ray Spectra of Mo39+, Mo40+, W43+, W44+ and W45+ on EAST

New high-resolution x-ray spectra of Mo39+, Mo40+, W43+, W44+ and W45+ have been carefully confirmed for the first time by use of the x-ray imaging crystal spectrometer (XCS) in Experimental Advanced Superconducting Tokamak (EAST) under various combined auxiliary heating plasmas conditions. Wavelength of these new x-ray spectra is ranged from 3.895 Å to 3.986 Å. When core electron temperature (Te0) reaches 6.0 keV, Mo39+ and Mo40+ lines of 3.9727, 3.9294 and 3.9480 Å can be effectively detected on XCS for EAST; meanwhile, line-integrated brightness of these spectral lines of Mo39+ and Mo40+ is very considerable when electron temperature reaches 12.9 keV. Multi-components spectral lines for W43+, W44+ and W45+ have also been identified when Te0 reaches 6 keV. Parts of spectral lines, such as Zn-1, Cu-2, Cu-4a, Cu-4d and Cu-5 lines of tungsten, are first observed experimentally. When electron temperature reaches 12.9 keV, line-integrated intensity for part of these spectral lines of W43+, W44+ and W45+ are considerable. These experimental results and theoretical predictions from FAC and FLYCHK codes are in good general agreement. These new spectral lines, obtained on XCS for EAST, are vital for deeply uncovering the mechanisms of ion and electron thermal, high-Z impurity and momentum (anomalous) transport to achieve the advanced steady-state operation scenarios for ITER and CFETR.

physics.plasm-ph↗

arXiv2022

Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Grounding

Visual grounding focuses on establishing fine-grained alignment between vision and natural language, which has essential applications in multimodal reasoning systems. Existing methods use pre-trained query-agnostic visual backbones to extract visual feature maps independently without considering the query information. We argue that the visual features extracted from the visual backbones and the features really needed for multimodal reasoning are inconsistent. One reason is that there are differences between pre-training tasks and visual grounding. Moreover, since the backbones are query-agnostic, it is difficult to completely avoid the inconsistency issue by training the visual backbone end-to-end in the visual grounding framework. In this paper, we propose a Query-modulated Refinement Network (QRNet) to address the inconsistent issue by adjusting intermediate features in the visual backbone with a novel Query-aware Dynamic Attention (QD-ATT) mechanism and query-aware multiscale fusion. The QD-ATT can dynamically compute query-dependent visual attention at the spatial and channel levels of the feature maps produced by the visual backbone. We apply the QRNet to an end-to-end visual grounding framework. Extensive experiments show that the proposed method outperforms state-of-the-art methods on five widely used datasets.

cs.CV↗

arXiv2022

Scanning-probe and information-concealing machine learning intermediate hexatic phase and critical scaling of solid-hexatic phase transition in deformable particles

We investigate the two-dimensional melting of deformable polymeric particles with multi-body interactions described by the Voronoi model. We report machine learning evidence for the existence of the intermediate hexatic phase in this system, and extract the critical exponent $ν\approx0.65$ for the divergence of the correlation length of the associated solid-hexatic phase transition. Moreover, we clarify the discontinuous nature of the hexatic-liquid phase transition in this system. These findings are achieved by directly analyzing system's spatial configurations with two generic machine learning approaches developed in this work, dubbed "scanning-probe" via which the possible existence of intermediate phases can be efficiently detected, and "information-concealing" via which the critical scaling of the correlation length in the vicinity of generic continuous phase transition can be extracted. Our work provides new physical insights into the fundamental nature of the two-dimensional melting of deformable particles, and establishes a new type of generic toolbox to investigate fundamental properties of phase transitions in various complex systems.

cond-mat.soft↗

arXiv2022

Finite temperature mean-field theory with intrinsic non-hermitian structures for Bose gases in optical lattices

We reveal a divergent issue associated with the mean-field theory for Bose gases in optical lattices constructed by the widely used straightforward mean-field decoupling of the hopping term, where the corresponding mean-field Hamiltonian generally assumes no lower energy bound once the spatial dependence of the mean-field superfluid order parameter is taken into account. Via a systematic functional integral approach, we solve this issue by establishing a general finite temperature mean-field theory that can treat any possible spatial dependence of the order parameter without causing the divergent issue. Interestingly, we find the theory generally assumes an intrinsic non-hermitian structure that originates from the indefiniteness of the hopping matrix of the system. Within this theory, we develop an efficient approach for investigating the physics of the system at finite temperature, where properties of the system can be calculated via straightforward investigation on the saddle points of an effective potential function for the order parameter. We illustrate our approach by investigating the finite temperature superfluid transition of Bose gases in optical lattices. Since the underlying finite temperature mean-field theory is quite general, this approach can be straightforwardly applied to investigate the finite temperature properties of related systems with phases possessing complex spatial structures.

cond-mat.quant-gas↗

arXiv2022

Emergent Mott insulators and non-Hermitian conservation laws in an interacting bosonic chain with noninteger filling and nonreciprocal hopping

We investigate the ground state and quantum dynamics of an interacting bosonic chain with the nonreciprocal hopping. In sharp contrast to its Hermitian counterpart, the ground state can support Mott insulators in systems with noninteger filling due to the competition between nonreciprocal hopping and the on-site interaction. For the quantum dynamics, conservation laws for non-Hermitian systems manifest a stark difference from their Hermitian counterpart. In particular, for any Hermitian operator that commutes with the Hamiltonian operator, its expectation value is guaranteed to be nonconserved in the non-Hermitian quantum dynamics. To systematically identify the non-Hermitian conservation law, we establish a generic approach for constructing the conserved quantities in non-Hermitian many-body quantum systems with completely real spectra, and illustrate it concretely by the system under study. The direct experimental observation of Mott insulators in systems with noninteger filling and non-Hermitian conservation laws can be performed by ultracold atoms in optical lattices with the engineered nonreciprocal hopping.

cond-mat.mes-hall↗

arXiv2022

Multi-channel Attentive Graph Convolutional Network With Sentiment Fusion For Multimodal Sentiment Analysis

Nowadays, with the explosive growth of multimodal reviews on social media platforms, multimodal sentiment analysis has recently gained popularity because of its high relevance to these social media posts. Although most previous studies design various fusion frameworks for learning an interactive representation of multiple modalities, they fail to incorporate sentimental knowledge into inter-modality learning. This paper proposes a Multi-channel Attentive Graph Convolutional Network (MAGCN), consisting of two main components: cross-modality interactive learning and sentimental feature fusion. For cross-modality interactive learning, we exploit the self-attention mechanism combined with densely connected graph convolutional networks to learn inter-modality dynamics. For sentimental feature fusion, we utilize multi-head self-attention to merge sentimental knowledge into inter-modality feature representations. Extensive experiments are conducted on three widely-used datasets. The experimental results demonstrate that the proposed model achieves competitive performance on accuracy and F1 scores compared to several state-of-the-art approaches.

cs.CL↗

arXiv2021

Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model

Understanding protein sequences is vital and urgent for biology, healthcare, and medicine. Labeling approaches are expensive yet time-consuming, while the amount of unlabeled data is increasing quite faster than that of the labeled data due to low-cost, high-throughput sequencing methods. In order to extract knowledge from these unlabeled data, representation learning is of significant value for protein-related tasks and has great potential for helping us learn more about protein functions and structures. The key problem in the protein sequence representation learning is to capture the co-evolutionary information reflected by the inter-residue co-variation in the sequences. Instead of leveraging multiple sequence alignment as is usually done, we propose a novel method to capture this information directly by pre-training via a dedicated language model, i.e., Pairwise Masked Language Model (PMLM). In a conventional masked language model, the masked tokens are modeled by conditioning on the unmasked tokens only, but processed independently to each other. However, our proposed PMLM takes the dependency among masked tokens into consideration, i.e., the probability of a token pair is not equal to the product of the probability of the two tokens. By applying this model, the pre-trained encoder is able to generate a better representation for protein sequences. Our result shows that the proposed method can effectively capture the inter-residue correlations and improves the performance of contact prediction by up to 9% compared to the MLM baseline under the same setting. The proposed model also significantly outperforms the MSA baseline by more than 7% on the TAPE contact prediction benchmark when pre-trained on a subset of the sequence database which the MSA is generated from, revealing the potential of the sequence pre-training method to surpass MSA based methods in general.

cs.CL↗

arXiv2021

Data-driven criterion for the solid-liquid transition of two-dimensional self-propelled colloidal particles far from equilibrium

We establish an explicit data-driven criterion for identifying the solid-liquid transition of two-dimensional self-propelled colloidal particles in the far from equilibrium parameter regime, where the transition points predicted by different conventional empirical criteria for melting and freezing diverge. This is achieved by applying a hybrid machine learning approach that combines unsupervised learning with supervised learning to analyze over one million of the system's configurations in the nonequilibrium parameter regime. Furthermore, we establish a generic data-driven evaluation function, according to which the performance of different empirical criteria can be systematically evaluated and improved. In particular, by applying this evaluation function, we identify a new nonequilibrium threshold value for the long-time diffusion coefficient, based on which the predictions of the corresponding empirical criterion are greatly improved in the far from equilibrium parameter regime. These data-driven approaches provide a generic tool for investigating phase transitions in complex systems where conventional empirical ones face difficulties.

cond-mat.soft↗

arXiv2021

Improved Drug-target Interaction Prediction with Intermolecular Graph Transformer

The identification of active binding drugs for target proteins (termed as drug-target interaction prediction) is the key challenge in virtual screening, which plays an essential role in drug discovery. Although recent deep learning-based approaches achieved better performance than molecular docking, existing models often neglect certain aspects of the intermolecular information, hindering the performance of prediction. We recognize this problem and propose a novel approach named Intermolecular Graph Transformer (IGT) that employs a dedicated attention mechanism to model intermolecular information with a three-way Transformer-based architecture. IGT outperforms state-of-the-art approaches by 9.1% and 20.5% over the second best for binding activity and binding pose prediction respectively, and shows superior generalization ability to unseen receptor proteins. Furthermore, IGT exhibits promising drug screening ability against SARS-CoV-2 by identifying 83.1% active drugs that have been validated by wet-lab experiments with near-native predicted binding poses.

cs.LG↗

arXiv2021

Inferring Substitutable and Complementary Products with Knowledge-Aware Path Reasoning based on Dynamic Policy Network

Inferring the substitutable and complementary products for a given product is an essential and fundamental concern for the recommender system. To achieve this, existing approaches take advantage of the knowledge graphs to learn more evidences for inference, whereas they often suffer from invalid reasoning for lack of elegant decision making strategies. Therefore, we propose a novel Knowledge-Aware Path Reasoning (KAPR) model which leverages the dynamic policy network to make explicit reasoning over knowledge graphs, for inferring the substitutable and complementary relationships. Our contributions can be highlighted as three aspects. Firstly, we model this inference scenario as a Markov Decision Process in order to accomplish a knowledge-aware path reasoning over knowledge graphs. Secondly,we integrate both structured and unstructured knowledge to provide adequate evidences for making accurate decision-making. Thirdly, we evaluate our model on a series of real-world datasets, achieving competitive performance compared with state-of-the-art approaches. Our code is released on https://gitee.com/yangzijing flower/kapr/tree/master.

cs.AI↗

arXiv2021

Design and Characterization of a 3D-printed Pneumatically-driven Bistable Valve with Tunable Characteristics

Although research studies in pneumatic soft robots develop rapidly, most pneumatic actuators are still controlled by rigid valves and conventional electronics. The existence of these rigid, electronic components sacrifices the compliance and adaptability of soft robots.} Current electronics-free valve designs based on soft materials are facing challenges in behaviour consistency, design flexibility, and fabrication complexity. Taking advantages of soft material 3D printing, this paper presents a new design of a bi-stable pneumatic valve, which utilises two soft, pneumatically-driven, and symmetrically-oriented conical shells with structural bistability to stabilise and regulate the airflow. The critical pressure required to operate the valve can be adjusted by changing the design features of the soft bi-stable structure. Multi-material printing simplifies the valve fabrication, enhances the flexibility in design feature optimisations, and improves the system repeatability. In this work, both a theoretical model and physical experiments are introduced to examine the relationships between the critical operating pressure and the key design features. Results with valve characteristic tuning via material stiffness changing show better effectiveness compared to the change of geometry design features (demonstrated largest tunable critical pressure range from 15.3 to 65.2 kPa and fastest response time $\leq$ 1.8 s.

cs.RO↗

arXiv2021

Giant Topological Hall Effect in van der Waals Heterostructures of CrTe2/Bi2Te3

Discoveries of interfacial topological Hall effect (THE) provide an ideal platform for exploring physics arising from the interplay between topology and magnetism. The interfacial topological Hall effect is closely related to the Dzyaloshinskii-Moriya interaction (DMI) at interface and topological spin textures. However, it is difficult to achieve a sizable THE in heterostructures due to the stringent constraints on the constituents of THE heterostructures such as strong spin-orbit coupling (SOC). Here we report the observation of a giant THE signal of 1.39 $μΩ\cdot$cm in the van der Waals heterostructures of CrTe2/Bi2Te3 fabricated by molecular beam epitaxy, a prototype of two-dimensional (2D) ferromagnet (FM)/topological insulator (TI). This large magnitude of THE is attributed to an optimized combination of 2D ferromagnetism in CrTe2, strong SOC in Bi2Te3, and an atomically sharp interface. Our work reveals CrTe2/Bi2Te3 as a convenient platform for achieving large interfacial THE in hybrid systems, which could be utilized to develop quantum science and high-density information storage.

cond-mat.mes-hall↗

arXiv2021

Human-In-The-Loop Document Layout Analysis

Document layout analysis (DLA) aims to divide a document image into different types of regions. DLA plays an important role in the document content understanding and information extraction systems. Exploring a method that can use less data for effective training contributes to the development of DLA. We consider a Human-in-the-loop (HITL) collaborative intelligence in the DLA. Our approach was inspired by the fact that the HITL push the model to learn from the unknown problems by adding a small amount of data based on knowledge. The HITL select key samples by using confidence. However, using confidence to find key samples is not suitable for DLA tasks. We propose the Key Samples Selection (KSS) method to find key samples in high-level tasks (semantic segmentation) more accurately through agent collaboration, effectively reducing costs. Once selected, these key samples are passed to human beings for active labeling, then the model will be updated with the labeled samples. Hence, we revisited the learning system from reinforcement learning and designed a sample-based agent update strategy, which effectively improves the agent's ability to accept new samples. It achieves significant improvement results in two benchmarks (DSSE-200 (from 77.1% to 86.3%) and CS-150 (from 88.0% to 95.6%)) by using 10% of labeled data.

cs.CV↗

arXiv2021

Emergent criticality and universality class of the finite temperature charge density wave transition in lattice Bose gases within optical cavities

We investigate the finite temperature charge density wave (CDW) transition of lattice Bose gases within optical cavities in the deep Mott-insulator limit. We find a new critical regime emerges at a temperature around one-half of the on-site interaction energy, where the first order CDW transition at low temperatures terminates at a critical point and changes to a second order one. By directly calculating the critical exponents and constructing the effective theory in the corresponding critical regime, we find the emergent criticality belongs to the five-dimensional Ising universality class. Direct experimental observation of the emergent criticality can be readily performed by current experimental set-ups operated in the temperature regime around half the on-site interaction energy.

cond-mat.quant-gas↗