arXiv subjects

Liang Hu

Publications and source records attributed to Liang Hu.

At least 73 records · Page 4Linked to original sources

arXiv2023

Frequency Spectrum is More Effective for Multimodal Representation and Fusion: A Multimodal Spectrum Rumor Detector

Multimodal content, such as mixing text with images, presents significant challenges to rumor detection in social media. Existing multimodal rumor detection has focused on mixing tokens among spatial and sequential locations for unimodal representation or fusing clues of rumor veracity across modalities. However, they suffer from less discriminative unimodal representation and are vulnerable to intricate location dependencies in the time-consuming fusion of spatial and sequential tokens. This work makes the first attempt at multimodal rumor detection in the frequency domain, which efficiently transforms spatial features into the frequency spectrum and obtains highly discriminative spectrum features for multimodal representation and fusion. A novel Frequency Spectrum Representation and fUsion network (FSRU) with dual contrastive learning reveals the frequency spectrum is more effective for multimodal representation and fusion, extracting the informative components for rumor detection. FSRU involves three novel mechanisms: utilizing the Fourier transform to convert features in the spatial domain to the frequency domain, the unimodal spectrum compression, and the cross-modal spectrum co-selection module in the frequency domain. Substantial experiments show that FSRU achieves satisfactory multimodal rumor detection performance.

cs.MM↗

arXiv2023

FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspective

Multivariate time series (MTS) forecasting has shown great importance in numerous industries. Current state-of-the-art graph neural network (GNN)-based forecasting methods usually require both graph networks (e.g., GCN) and temporal networks (e.g., LSTM) to capture inter-series (spatial) dynamics and intra-series (temporal) dependencies, respectively. However, the uncertain compatibility of the two networks puts an extra burden on handcrafted model designs. Moreover, the separate spatial and temporal modeling naturally violates the unified spatiotemporal inter-dependencies in real world, which largely hinders the forecasting performance. To overcome these problems, we explore an interesting direction of directly applying graph networks and rethink MTS forecasting from a pure graph perspective. We first define a novel data structure, hypervariate graph, which regards each series value (regardless of variates or timestamps) as a graph node, and represents sliding windows as space-time fully-connected graphs. This perspective considers spatiotemporal dynamics unitedly and reformulates classic MTS forecasting into the predictions on hypervariate graphs. Then, we propose a novel architecture Fourier Graph Neural Network (FourierGNN) by stacking our proposed Fourier Graph Operator (FGO) to perform matrix multiplications in Fourier space. FourierGNN accommodates adequate expressiveness and achieves much lower complexity, which can effectively and efficiently accomplish the forecasting. Besides, our theoretical analysis reveals FGO's equivalence to graph convolutions in the time domain, which further verifies the validity of FourierGNN. Extensive experiments on seven datasets have demonstrated our superior performance with higher efficiency and fewer parameters compared with state-of-the-art methods.

cs.LG↗

arXiv2023

Syntax Tree Constrained Graph Network for Visual Question Answering

Visual Question Answering (VQA) aims to automatically answer natural language questions related to given image content. Existing VQA methods integrate vision modeling and language understanding to explore the deep semantics of the question. However, these methods ignore the significant syntax information of the question, which plays a vital role in understanding the essential semantics of the question and guiding the visual feature refinement. To fill the gap, we suggested a novel Syntax Tree Constrained Graph Network (STCGN) for VQA based on entity message passing and syntax tree. This model is able to extract a syntax tree from questions and obtain more precise syntax information. Specifically, we parse questions and obtain the question syntax tree using the Stanford syntax parsing tool. From the word level and phrase level, syntactic phrase features and question features are extracted using a hierarchical tree convolutional network. We then design a message-passing mechanism for phrase-aware visual entities and capture entity features according to a given visual context. Extensive experiments on VQA2.0 datasets demonstrate the superiority of our proposed model.

cs.CV↗

arXiv2023

Rumor Detection with Hierarchical Representation on Bipartite Adhoc Event Trees

The rapid growth of social media has caused tremendous effects on information propagation, raising extreme challenges in detecting rumors. Existing rumor detection methods typically exploit the reposting propagation of a rumor candidate for detection by regarding all reposts to a rumor candidate as a temporal sequence and learning semantics representations of the repost sequence. However, extracting informative support from the topological structure of propagation and the influence of reposting authors for debunking rumors is crucial, which generally has not been well addressed by existing methods. In this paper, we organize a claim post in circulation as an adhoc event tree, extract event elements, and convert it to bipartite adhoc event trees in terms of both posts and authors, i.e., author tree and post tree. Accordingly, we propose a novel rumor detection model with hierarchical representation on the bipartite adhoc event trees called BAET. Specifically, we introduce word embedding and feature encoder for the author and post tree, respectively, and design a root-aware attention module to perform node representation. Then we adopt the tree-like RNN model to capture the structural correlations and propose a tree-aware attention module to learn tree representation for the author tree and post tree, respectively. Extensive experimental results on two public Twitter datasets demonstrate the effectiveness of BAET in exploring and exploiting the rumor propagation structure and the superior detection performance of BAET over state-of-the-art baseline methods.

cs.SI↗

arXiv2022

Edge-Varying Fourier Graph Networks for Multivariate Time Series Forecasting

The key problem in multivariate time series (MTS) analysis and forecasting aims to disclose the underlying couplings between variables that drive the co-movements. Considerable recent successful MTS methods are built with graph neural networks (GNNs) due to their essential capacity for relational modeling. However, previous work often used a static graph structure of time-series variables for modeling MTS failing to capture their ever-changing correlations over time. To this end, a fully-connected supra-graph connecting any two variables at any two timestamps is adaptively learned to capture the high-resolution variable dependencies via an efficient graph convolutional network. Specifically, we construct the Edge-Varying Fourier Graph Networks (EV-FGN) equipped with Fourier Graph Shift Operator (FGSO) which efficiently performs graph convolution in the frequency domain. As a result, a high-efficiency scale-free parameter learning scheme is derived for MTS analysis and forecasting according to the convolution theorem. Extensive experiments show that EV-FGN outperforms state-of-the-art methods on seven real-world MTS datasets.

cs.LG↗

arXiv2022

An Ion Exchange Mechanism Inspired Story Ending Generator for Different Characters

Story ending generation aims at generating reasonable endings for a given story context. Most existing studies in this area focus on generating coherent or diversified story endings, while they ignore that different characters may lead to different endings for a given story. In this paper, we propose a Character-oriented Story Ending Generator (CoSEG) to customize an ending for each character in a story. Specifically, we first propose a character modeling module to learn the personalities of characters from their descriptive experiences extracted from the story context. Then, inspired by the ion exchange mechanism in chemical reactions, we design a novel vector breaking/forming module to learn the intrinsic interactions between each character and the corresponding context through an analogical information exchange procedure. Finally, we leverage the attention mechanism to learn effective character-specific interactions and feed each interaction into a decoder to generate character-orient endings. Extensive experimental results and case studies demonstrate that CoSEG achieves significant improvements in the quality of generated endings compared with state-of-the-art methods, and it effectively customizes the endings for different characters.

cs.CL↗

arXiv2022

Supervised Deep Hashing for High-dimensional and Heterogeneous Case-based Reasoning

Case-based Reasoning (CBR) on high-dimensional and heterogeneous data is a trending yet challenging and computationally expensive task in the real world. A promising approach is to obtain low-dimensional hash codes representing cases and perform a similarity retrieval of cases in Hamming space. However, previous methods based on data-independent hashing rely on random projections or manual construction, inapplicable to address specific data issues (e.g., high-dimensionality and heterogeneity) due to their insensitivity to data characteristics. To address these issues, this work introduces a novel deep hashing network to learn similarity-preserving compact hash codes for efficient case retrieval and proposes a deep-hashing-enabled CBR model HeCBR. Specifically, we introduce position embedding to represent heterogeneous features and utilize a multilinear interaction layer to obtain case embeddings, which effectively filtrates zero-valued features to tackle high-dimensionality and sparsity and captures inter-feature couplings. Then, we feed the case embeddings into fully-connected layers, and subsequently a hash layer generates hash codes with a quantization regularizer to control the quantization loss during relaxation. To cater to incremental learning of CBR, we further propose an adaptive learning strategy to update the hash function. Extensive experiments on public datasets show that HeCBR greatly reduces storage and significantly accelerates case retrieval. HeCBR achieves desirable performance compared with the state-of-the-art CBR methods and performs significantly better than hashing-based CBR methods in classification.

cs.IR↗

arXiv2022

Free-space point-to-multiplepoint optical frequency transfer with lens assisted integrated beam steering

We report on the realization of high-performance silica integrated two-dimensional lens assisted beam-steering (LABS) arrays along with the first-of-their-kind point-to-multiplepoint optical frequency transfer. {The LABS equips with $N$ antennas} and has the capability to produce arbitrary number of output beams with different output angles with the simple control complexity. We demonstrate that the LABS has 16 scanning angles, which can support {the access capability for the maximum of simultaneous 16 user nodes.} The coaxial configuration for transmitting and receiving the light as a monolithic transceiver allows us to reduce the out-of-loop phase noise significantly. Finally, the LABS-based non-blocking point-to-multiplepoint in-door free-space optical frequency transfer links with 24 m and 50 m free-space links are shown. After being compensated for the free-space link up to 50 m, the fractional frequency instability of $4.5\times10^{-17}$ and $7.7\times10^{-20}$ at the averaging time of 1 s and 20,000 s, respectively, can be achieved. The present work proves the potential application of the 2D LABS in free-space optical time-frequency transfer and provides a guidance for developing a chip-scale optical time-frequency transfer system.

physics.ins-det↗

arXiv2022

Sequential/Session-based Recommendations: Challenges, Approaches, Applications and Opportunities

In recent years, sequential recommender systems (SRSs) and session-based recommender systems (SBRSs) have emerged as a new paradigm of RSs to capture users' short-term but dynamic preferences for enabling more timely and accurate recommendations. Although SRSs and SBRSs have been extensively studied, there are many inconsistencies in this area caused by the diverse descriptions, settings, assumptions and application domains. There is no work to provide a unified framework and problem statement to remove the commonly existing and various inconsistencies in the area of SR/SBR. There is a lack of work to provide a comprehensive and systematic demonstration of the data characteristics, key challenges, most representative and state-of-the-art approaches, typical real-world applications and important future research directions in the area. This work aims to fill in these gaps so as to facilitate further research in this exciting and vibrant area.

cs.IR↗

arXiv2022

Multiple-access relay stations for long-haul fiber-optic radio frequency transfer

We report on the realization of a long-haul radio frequency (RF) transfer scheme by using multiple-access relay stations (MARSs). The proposed scheme with independent link noise compensation for each fiber sub-link effectively solves the limitation of compensation bandwidth for long-haul transfer. The MARS can have the capability to share the same modulated optical signal for the front and rear fiber sub-links, simplifying the configuration at the repeater station and enabling the transfer system to have the multiple-access capability. At the same time, we for the first time theoretically model the effect of the MARS position on the fractional frequency instability of the fiber-optic RF transfer, demonstrating that the MARS position has little effect on system's performance when the ratio of the front and rear fiber sub-links is around $1:1$. We experimentally demonstrate a 1 GHz signal transfer by using one MARS connecting 260 and 280 km fiber links with the fractional frequency instabilities of less than $5.9\times10^{-14}$ at 1 s and $8.5\times10^{-17}$ at 10,000 s at the remote site and of $5.6\times10^{-14}$ and $6.6\times10^{-17}$ at the integration times of 1 s and 10,000 s at the MARS. The proposed scalable technique can arbitrarily add the same MARSs in the fiber link, which has great potential in realizing ultra-long-haul RF transfer.

eess.SP↗

arXiv2021

Interlayer Quasi-Bonding Interactions in 2D Layered Materials: A Classification According to the Occupancy of Involved Energy Bands

Recent studies have revealed that the interlayer interaction in two-dimensional (2D) layered materials is not simply of van der Waals character but could coexist with quasi-bonding character. Here we classify the interlayer quasi-bonding interactions into two main categories (I: homo-occupancy interaction, II: hetero-occupancy interaction) according to the occupancy of the involved energy bands near the Fermi level. Then we investigate the quasi-bonding-interaction-induced band structure evolution of several representative 2D materials based on density functional theory calculations. Further calculations confirm that this classification is applicable to generic 2D layered materials and provides a unified understanding of the total strength of interlayer interaction, which is a synergetic effect of the van der Waals attraction and the quasi-bonding interaction. The latter is stabilizing in main category II and destabilizing in main category I. Thus, the total interlayer interaction strength is relatively stronger in category II and weaker in category I.

cond-mat.mtrl-sci↗

arXiv2021

An Optimal Resource Allocator of Elastic Training for Deep Learning Jobs on Cloud

Cloud training platforms, such as Amazon Web Services and Huawei Cloud provide users with computational resources to train their deep learning jobs. Elastic training is a service embedded in cloud training platforms that dynamically scales up or down the resources allocated to a job. The core technique of an elastic training system is to best allocate limited resources among heterogeneous jobs in terms of shorter queueing delay and higher training efficiency. This paper presents an optimal resource allocator for elastic training system that leverages a mixed-integer programming (MIP) model to maximize the training progress of deep learning jobs. We take advantage of the real-world job data obtained from ModelArts, the deep learning training platform of Huawei Cloud and conduct simulation experiments to compare the optimal resource allocator with a greedy one as benchmark. Numerical results show that the proposed allocator can reduce queuing time by up to 32% and accelerate training efficiency by up to 24% relative to the greedy resource allocator, thereby greatly improving user experience with Huawei ModelArts and potentially enabling the realization of higher profits for the product. Also, the optimal resource allocator is fast in decision-making, taking merely 0.4 seconds on average.

eess.SY↗

arXiv2021

Reinforcement Learning Compensated Extended Kalman Filter for Attitude Estimation

Inertial measurement units are widely used in different fields to estimate the attitude. Many algorithms have been proposed to improve estimation performance. However, most of them still suffer from 1) inaccurate initial estimation, 2) inaccurate initial filter gain, and 3) non-Gaussian process and/or measurement noise. In this paper, we leverage reinforcement learning to compensate for the classical extended Kalman filter estimation, i.e., to learn the filter gain from the sensor measurements. We also analyse the convergence of the estimate error. The effectiveness of the proposed algorithm is validated on both simulated data and real data.

cs.RO↗

arXiv2021

Enhanced trion emission in monolayer MoSe2 by constructing a type-I van der Waals heterostructure

Trions, quasi-particles consisting of two electrons combined with one hole or of two holes with one electron, have recently been observed in transition metal dichalcogenides (TMDCs) and drawn increasing attention due to potential applications of these materials in light-emitting diodes, valleytronic devices as well as for being a testbed for understanding many-body phenomena. Therefore, it is important to enhance the trion emission and its stability. In this study, we construct a MoSe2/FePS3 van der Waals heterostructure (vdWH) with type-I band alignment, which allows for carriers injection from FePS3 to MoSe2. At low temperatures, the neutral exciton (X0) emission in this vdWH is almost completely suppressed. The ITrion/Ix0 intensity ratio increases from 0.44 in a single MoSe2 monolayer to 20 in this heterostructure with the trion charging state changing from negative in the monolayer to positive in the heterostructure. The optical pumping with circularly polarized light shows a 14% polarization for the trion emission in MoSe2/FePS3. Moreover, forming such type-I vdWH also gives rise to a 20-fold enhancement of the room temperature photoluminescence from monolayer MoSe2. Our results demonstrate a novel approach to convert excitons to trions in monolayer 2D TMDCs via interlayer doping effect using type-I band alignment in vdWH.

cond-mat.mtrl-sci↗

arXiv2021

Robust optical frequency transfer in a noisy urban fiber network

Optical fibers have been recognized as one of the most promising host material for high phase coherence optical frequency transfer over thousands of kilometers. In the pioneering work, the active phase noise cancellation (ANC) technique has been widely used for suppressing the fiber phase noise introduced by the environmental perturbations, in which an ideal phase detector with high resolution and unlimited detection range is needed to extract the fiber phase noise, in particular for noisy fiber links. We demonstrate the passive phase noise cancellation (PNC) technique without the need of phase detector could be preferable for noisy fiber links. To avoid the effect of the radio frequency (RF) from the time base at the local site in the conventional active or passive phase noise cancellation techniques, here we introduce a fiber-pigtailed acousto-optic modulator (AOM) with two diffraction order outputs (0 and +1 order) with properly allocating the AOM-driving frequencies allowing to cancel the time base effect. Using this technique, we demonstrate transfer of coherent light through a 260 km noisy urban fiber link. The results show the effect of the RF reference can be successfully removed. After being passively compensated, {we demonstrate a fractional frequency instability of $4.9\times10^{-14}$ at the integration time of 1 s and scales down to $10^{-20}$ level at 10,000 s in terms of modified Allan deviation over the 260 km noisy urban fiber link}. The frequency uncertainty of the retrieved light after transferring through this noise-compensated fiber link relative to that of the input light achieves $(0.41\pm4.7)\times10^{-18}$. The proposed technique opens a way to a broad distribution of an ultrastable frequency reference with high coherence without any effects coming from the RF reference and enables a wide range of applications beyond metrology over fiber networks.

physics.ins-det↗

arXiv2021

Reinforcement Learning for Orientation Estimation Using Inertial Sensors with Performance Guarantee

This paper presents a deep reinforcement learning (DRL) algorithm for orientation estimation using inertial sensors combined with magnetometer. The Lyapunov method in control theory is employed to prove the convergence of orientation estimation errors. Based on the theoretical results, the estimator gains and a Lyapunov function are parametrized by deep neural networks and learned from samples. The DRL estimator is compared with three well-known orientation estimation methods on both numerical simulations and real datasets collected from commercially available sensors. The results show that the proposed algorithm is superior for arbitrary estimation initialization and can adapt to very large angular velocities for which other algorithms can be hardly applicable. To the best of our knowledge, this is the first DRL-based orientation estimation method with estimation error boundedness guarantee.

cs.RO↗

arXiv2021

Fiber radio frequency transfer using bidirectional frequency division multiplexing dissemination

We report on the realization of a novel fiber-optic radio frequency (RF) transfer scheme with the bidirectional frequency division multiplexing (FDM) dissemination technique. Here, the proper bidirectional frequency map used in the forward and backward directions for suppressing the backscattering noise and ensuring the symmetry of the bidirectional transfer RF signals within one telecommunication channel. We experimentally demonstrated a 0.9 GHz signal transfer over a 120 km optical link with the relative frequency stabilities of 2.2E-14 at 1 s and 4.6E-17 at 20,000 s. The implementation of phase noise compensation at the remote site has the capability to perform RF transfer over a branching fiber network with the proposed technique as needed by large-scale scientific experiments.

physics.ins-det↗

arXiv2021

Graph Learning based Recommender Systems: A Review

Recent years have witnessed the fast development of the emerging topic of Graph Learning based Recommender Systems (GLRS). GLRS employ advanced graph learning approaches to model users' preferences and intentions as well as items' characteristics for recommendations. Differently from other RS approaches, including content-based filtering and collaborative filtering, GLRS are built on graphs where the important objects, e.g., users, items, and attributes, are either explicitly or implicitly connected. With the rapid development of graph learning techniques, exploring and exploiting homogeneous or heterogeneous relations in graphs are a promising direction for building more effective RS. In this paper, we provide a systematic review of GLRS, by discussing how they extract important knowledge from graph-based representations to improve the accuracy, reliability and explainability of the recommendations. First, we characterize and formalize GLRS, and then summarize and categorize the key challenges and main progress in this novel research area. Finally, we share some new research directions in this vibrant area.

cs.IR↗