arXiv subjects

Yue Hu

Publications and source records attributed to Yue Hu.

At least 235 records · Page 13Linked to original sources

arXiv2022

Multi-level Contrastive Learning Framework for Sequential Recommendation

Sequential recommendation (SR) aims to predict the subsequent behaviors of users by understanding their successive historical behaviors. Recently, some methods for SR are devoted to alleviating the data sparsity problem (i.e., limited supervised signals for training), which take account of contrastive learning to incorporate self-supervised signals into SR. Despite their achievements, it is far from enough to learn informative user/item embeddings due to the inadequacy modeling of complex collaborative information and co-action information, such as user-item relation, user-user relation, and item-item relation. In this paper, we study the problem of SR and propose a novel multi-level contrastive learning framework for sequential recommendation, named MCLSR. Different from the previous contrastive learning-based methods for SR, MCLSR learns the representations of users and items through a cross-view contrastive learning paradigm from four specific views at two different levels (i.e., interest- and feature-level). Specifically, the interest-level contrastive mechanism jointly learns the collaborative information with the sequential transition patterns, and the feature-level contrastive mechanism re-observes the relation between users and items via capturing the co-action information (i.e., co-occurrence). Extensive experiments on four real-world datasets show that the proposed MCLSR outperforms the state-of-the-art methods consistently.

cs.IR↗

arXiv2022

Neural Message Passing for Visual Relationship Detection

Visual relationship detection aims to detect the interactions between objects in an image; however, this task suffers from combinatorial explosion due to the variety of objects and interactions. Since the interactions associated with the same object are dependent, we explore the dependency of interactions to reduce the search space. We explicitly model objects and interactions by an interaction graph and then propose a message-passing-style algorithm to propagate the contextual information. We thus call the proposed method neural message passing (NMP). We further integrate language priors and spatial cues to rule out unrealistic interactions and capture spatial interactions. Experimental results on two benchmark datasets demonstrate the superiority of our proposed method. Our code is available at https://github.com/PhyllisH/NMP.

cs.CV↗

arXiv2022

Latency-Aware Collaborative Perception

Collaborative perception has recently shown great potential to improve perception capabilities over single-agent perception. Existing collaborative perception methods usually consider an ideal communication environment. However, in practice, the communication system inevitably suffers from latency issues, causing potential performance degradation and high risks in safety-critical applications, such as autonomous driving. To mitigate the effect caused by the inevitable latency, from a machine learning perspective, we present the first latency-aware collaborative perception system, which actively adapts asynchronous perceptual features from multiple agents to the same time stamp, promoting the robustness and effectiveness of collaboration. To achieve such a feature-level synchronization, we propose a novel latency compensation module, called SyncNet, which leverages feature-attention symbiotic estimation and time modulation techniques. Experiments results show that the proposed latency aware collaborative perception system with SyncNet can outperforms the state-of-the-art collaborative perception method by 15.6% in the communication latency scenario and keep collaborative perception being superior to single agent perception under severe latency.

cs.CV↗

arXiv2022

Capturing, Reconstructing, and Simulating: the UrbanScene3D Dataset

We present UrbanScene3D, a large-scale data platform for research of urban scene perception and reconstruction. UrbanScene3D contains over 128k high-resolution images covering 16 scenes including large-scale real urban regions and synthetic cities with 136 km^2 area in total. The dataset also contains high-precision LiDAR scans and hundreds of image sets with different observation patterns, which provide a comprehensive benchmark to design and evaluate aerial path planning and 3D reconstruction algorithms. In addition, the dataset, which is built on Unreal Engine and Airsim simulator together with the manually annotated unique instance label for each building in the dataset, enables the generation of all kinds of data, e.g., 2D depth maps, 2D/3D bounding boxes, and 3D point cloud/mesh segmentations, etc. The simulator with physical engine and lighting system not only produce variety of data but also enable users to simulate cars or drones in the proposed urban environment for future research.

cs.CV↗

arXiv2022

Do You Know My Emotion? Emotion-Aware Strategy Recognition towards a Persuasive Dialogue System

Persuasive strategy recognition task requires the system to recognize the adopted strategy of the persuader according to the conversation. However, previous methods mainly focus on the contextual information, little is known about incorporating the psychological feedback, i.e. emotion of the persuadee, to predict the strategy. In this paper, we propose a Cross-channel Feedback memOry Network (CFO-Net) to leverage the emotional feedback to iteratively measure the potential benefits of strategies and incorporate them into the contextual-aware dialogue information. Specifically, CFO-Net designs a feedback memory module, including strategy pool and feedback pool, to obtain emotion-aware strategy representation. The strategy pool aims to store historical strategies and the feedback pool is to obtain updated strategy weight based on feedback emotional information. Furthermore, a cross-channel fusion predictor is developed to make a mutual interaction between the emotion-aware strategy representation and the contextual-aware dialogue information for strategy recognition. Experimental results on \textsc{PersuasionForGood} confirm that the proposed model CFO-Net is effective to improve the performance on M-F1 from 61.74 to 65.41.

cs.CL↗

arXiv2022

FedHiSyn: A Hierarchical Synchronous Federated Learning Framework for Resource and Data Heterogeneity

Federated Learning (FL) enables training a global model without sharing the decentralized raw data stored on multiple devices to protect data privacy. Due to the diverse capacity of the devices, FL frameworks struggle to tackle the problems of straggler effects and outdated models. In addition, the data heterogeneity incurs severe accuracy degradation of the global model in the FL training process. To address aforementioned issues, we propose a hierarchical synchronous FL framework, i.e., FedHiSyn. FedHiSyn first clusters all available devices into a small number of categories based on their computing capacity. After a certain interval of local training, the models trained in different categories are simultaneously uploaded to a central server. Within a single category, the devices communicate the local updated model weights to each other based on a ring topology. As the efficiency of training in the ring topology prefers devices with homogeneous resources, the classification based on the computing capacity mitigates the impact of straggler effects. Besides, the combination of the synchronous update of multiple categories and the device communication within a single category help address the data heterogeneity issue while achieving high accuracy. We evaluate the proposed framework based on MNIST, EMNIST, CIFAR10 and CIFAR100 datasets and diverse heterogeneous settings of devices. Experimental results show that FedHiSyn outperforms six baseline methods, e.g., FedAvg, SCAFFOLD, and FedAT, in terms of training accuracy and efficiency.

cs.DC↗

arXiv2022

Magnetic Field of Molecular Gas Measured with the Velocity Gradient Technique I. Orion A

Magnetic fields play an important role in the evolution of molecular clouds and star formation. Using the Velocity Gradient Technique (VGT) model, we measured the magnetic field in Orion A using the 12CO, 13CO, and C18O (1-0) emission lines at a scale of 0.07 pc. The measured B-field shows an east-west orientation that is perpendicular to the integral shaped filament of Orion A at large scale. The VGT magnetic fields obtained from 13CO and C18O are in agreement with the B-field that is measured from the Planck 353 GHz dust polarization at a scale of 0.55 pc. Removal of density effects by using a Velocity Decomposition Algorithm can significantly improve the accuracy of the VGT in tracing magnetic fields with the 12CO (1-0) line. The magnetic field strength of seven sub-clouds, OMC-1, OMC-2, OMC-3, OMC-4, OMC-5, L 1641-N, and NGC 1999 has also been estimated with the Davis-Chandrasekhar-Fermi (DCF) and MM2 technique, and these are found to be in agreement with previous results obtained from dust polarization at far-infrared and sub-millimeter wavelengths. At smaller scales, the VGT proves a good method to measure magnetic fields.

astro-ph.GA↗

arXiv2022

Dynamic Cardiac MRI Reconstruction Using Combined Tensor Nuclear Norm and Casorati Matrix Nuclear Norm Regularizations

Low-rank tensor models have been applied in accelerating dynamic magnetic resonance imaging (dMRI). Recently, a new tensor nuclear norm based on t-SVD has been proposed and applied to tensor completion. Inspired by the different properties of the tensor nuclear norm (TNN) and the Casorati matrix nuclear norm (MNN), we introduce a combined TNN and Casorati MNN regularizations framework to reconstruct dMRI, which we term as TMNN. The proposed method simultaneously exploits the spatial structure and the temporal correlation of the dynamic MR data. The optimization problem can be efficiently solved by the alternating direction method of multipliers (ADMM). In order to further improve the computational efficiency, we develop a fast algorithm under the Cartesian sampling scenario. Numerical experiments based on cardiac cine MRI and perfusion MRI data demonstrate the performance improvement over the traditional Casorati nuclear norm regularization method.

eess.IV↗

arXiv2022

Testing the parametric form of the conditional variance in regressions based on distance covariance

In this paper, we propose a new test for checking the parametric form of the conditional variance based on distance covariance in nonlinear and nonparametric regression models. Inherit from the nice properties of distance covariance, our test is very easy to implement in practice and less effected by the dimensionality of covariates. The asymptotic properties of the test statistic are investigated under the null and alternative hypotheses. We show that the proposed test is consistent against any alternative and can detect local alternatives converging to the null hypothesis at the parametric rate 1/root(n) in both the nonlinear and nonparametric settings. As the limiting null distribution of the test statistic is intractable, we propose a residual bootstrap to approximate the limiting null distribution. Simulation studies are presented to assess the finite sample performance of the proposed test. We also apply the proposed test to a real data set for illustration.

stat.ME↗

arXiv2022

CogIntAc: Modeling the Relationships between Intention, Emotion and Action in Interactive Process from Cognitive Perspective

Intention, emotion and action are important psychological factors in human activities, which play an important role in the interaction between individuals. How to model the interaction process between individuals by analyzing the relationship of their intentions, emotions, and actions at the cognitive level is challenging. In this paper, we propose a novel cognitive framework of individual interaction. The core of the framework is that individuals achieve interaction through external action driven by their inner intention. Based on this idea, the interactions between individuals can be constructed by establishing relationships between the intention, emotion and action. Furthermore, we conduct analysis on the interaction between individuals and give a reasonable explanation for the predicting results. To verify the effectiveness of the framework, we reconstruct a dataset and propose three tasks as well as the corresponding baseline models, including action abduction, emotion prediction and action generation. The novel framework shows an interesting perspective on mimicking the mental state of human beings in cognitive science.

cs.HC↗

arXiv2022

The Velocity Statistics of Turbulent Clouds in the Presence of Gravity, Magnetic fields, Radiation, and Outflow Feedback

The interaction of turbulence, magnetic fields, self-gravity, and stellar feedback within molecular clouds is crucial for understanding star formation. We study the effects of self-gravity and outflow feedback on the properties of the turbulent velocity via the structure function over length scales from $\sim$ 0.01 pc to 2 pc. We analyze a series of three-dimensional, magnetohydrodynamical (MHD) simulations of star cluster formation. We find outflow feedback can change the scaling of velocity fluctuations but still roughly being in between Kolmogorov and Burgers turbulence. We observe that self-gravity and protostellar outflows increase the velocity fluctuations over all length scales. Outflows can amplify the velocity fluctuations by up to a factor of $\sim$7 on scales $\sim$ 0.01 - 0.2 pc and drive turbulence up to a scale of $\sim$ 1 pc. The amplified velocity fluctuations provide more support against gravity and enhance fragmentation on small scales. The self-gravity's effect is more significant on smaller dense clumps and it increases the fraction of the compressive velocity component up to a scale of $\sim$ 0.2 pc. However, outflow feedback drives both solenoidal and compressive modes, but it induces a higher fraction of solenoidal modes relative to compressive modes. Thus, with outflows, the dense core ends up with a slightly higher fraction of solenoidal modes. We find that the compressible fraction is fairly constant with about 1/3 on scales $\sim$ 0.1 - 0.2 pc. The combined effect of enhanced velocity dispersion and reduced compressive fraction contributes to a reduction in the star formation rate.

astro-ph.GA↗

arXiv2022

Dir-MUSIC Algorithm for DOA Estimation of Partial Discharge Based on Signal Strength represented by Antenna Gain Array Manifold

Inspection robots are widely used in the field of smart grid monitoring in substations, and partial discharge (PD) is an important sign of the insulation state of equipments. PD direction of arrival (DOA) algorithms using conventional beamforming and time difference of arrival (TDOA) require large-scale antenna arrays and high computational complexity, which make them difficult to implement on inspection robots. To address this problem, a novel directional multiple signal classification (Dir-MUSIC) algorithm for PD direction finding based on signal strength is proposed, and a miniaturized directional spiral antenna circular array is designed in this paper. First, the Dir-MUSIC algorithm is derived based on the array manifold characteristics. This method uses strength intensity information rather than the TDOA information, which could reduce the computational difficulty and the requirement of array size. Second, the effects of signal-to-noise ratio (SNR) and array manifold error on the performance of the algorithm are discussed through simulations in detail. Then according to the positioning requirements, the antenna array and its arrangement are developed, optimized, and simulation results suggested that the algorithm has reliable direction-finding performance in the form of 6 elements. Finally, the effectiveness of the algorithm is tested by using the designed spiral circular array in real scenarios. The experimental results show that the PD direction-finding error is 3.39°, which can meet the need for Partial discharge DOA estimation using inspection robots in substations.

eess.SP↗

arXiv2022

Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation

The principal task in supervised neural machine translation (NMT) is to learn to generate target sentences conditioned on the source inputs from a set of parallel sentence pairs, and thus produce a model capable of generalizing to unseen instances. However, it is commonly observed that the generalization performance of the model is highly influenced by the amount of parallel data used in training. Although data augmentation is widely used to enrich the training data, conventional methods with discrete manipulations fail to generate diverse and faithful training samples. In this paper, we present a novel data augmentation paradigm termed Continuous Semantic Augmentation (CsaNMT), which augments each training instance with an adjacency semantic region that could cover adequate variants of literal expression under the same meaning. We conduct extensive experiments on both rich-resource and low-resource settings involving various language pairs, including WMT14 English-{German,French}, NIST Chinese-English and multiple low-resource IWSLT translation tasks. The provided empirical evidences show that CsaNMT sets a new level of performance among existing augmentation techniques, improving on the state-of-the-art by a large margin. The core codes are contained in Appendix E.

cs.CL↗

arXiv2022

Decomposing Magnetic Fields in Three Dimensions over the Central Molecular Zone

Measuring magnetic fields in the interstellar medium and obtaining their distribution along line-of-sight is very challenging with the traditional techniques. The Velocity Gradient Technique (VGT), which utilizes anisotropy of magnetohydrodynamic (MHD) turbulence, provides an attractive solution. Targeting the central molecular zone (CMZ), we test this approach by applying the VGT to $\rm ^{12}CO$ and $\rm ^{13}CO$ (J = 1-0) data cubes. We first used the SCOUSEPY algorithm to decompose the CO line emissions into separate velocity components, and then we constructed pseudo-Stokes parameters via the VGT to map the plane-of-the-sky magnetic fields in three-dimension. We present the decomposed magnetic field maps and investigate their significance. While the line-of-sight integrated magnetic field orientation is shown to be consistent with the polarized dust emission from the Planck survey at 353 GHz, individual velocity components may exhibit different magnetic fields. We present a scheme of magnetic field configuration in the CMZ based on the decomposed magnetic fields. In particular, we observe a nearly vertical magnetic field orientation in the dense clump near the Sgr B2 and a change in the outflow regions around the Sgr A*. Two high-velocity structures associated with an expanding ring in the CMZ show distinct swirling magnetic field structures. These results demonstrate the potential power of the VGT to decompose velocity or density-dependent magnetic structures.

astro-ph.GA↗

arXiv2022

MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering

Knowledge-based visual question answering requires the ability of associating external knowledge for open-ended cross-modal scene understanding. One limitation of existing solutions is that they capture relevant knowledge from text-only knowledge bases, which merely contain facts expressed by first-order predicates or language descriptions while lacking complex but indispensable multimodal knowledge for visual understanding. How to construct vision-relevant and explainable multimodal knowledge for the VQA scenario has been less studied. In this paper, we propose MuKEA to represent multimodal knowledge by an explicit triplet to correlate visual objects and fact answers with implicit relations. To bridge the heterogeneous gap, we propose three objective losses to learn the triplet representations from complementary views: embedding structure, topological relation and semantic space. By adopting a pre-training and fine-tuning learning strategy, both basic and domain-specific multimodal knowledge are progressively accumulated for answer prediction. We outperform the state-of-the-art by 3.35% and 6.08% respectively on two challenging knowledge-required datasets: OK-VQA and KRVQA. Experimental results prove the complementary benefits of the multimodal knowledge with existing knowledge bases and the advantages of our end-to-end framework over the existing pipeline methods. The code is available at https://github.com/AndersonStra/MuKEA.

cs.CV↗

arXiv2022

CLSEG: Contrastive Learning of Story Ending Generation

Story Ending Generation (SEG) is a challenging task in natural language generation. Recently, methods based on Pre-trained Language Models (PLM) have achieved great prosperity, which can produce fluent and coherent story endings. However, the pre-training objective of PLM-based methods is unable to model the consistency between story context and ending. The goal of this paper is to adopt contrastive learning to generate endings more consistent with story context, while there are two main challenges in contrastive learning of SEG. First is the negative sampling of wrong endings inconsistent with story contexts. The second challenge is the adaptation of contrastive learning for SEG. To address these two issues, we propose a novel Contrastive Learning framework for Story Ending Generation (CLSEG), which has two steps: multi-aspect sampling and story-specific contrastive learning. Particularly, for the first issue, we utilize novel multi-aspect sampling mechanisms to obtain wrong endings considering the consistency of order, causality, and sentiment. To solve the second issue, we well-design a story-specific contrastive training strategy that is adapted for SEG. Experiments show that CLSEG outperforms baselines and can produce story endings with stronger consistency and rationality.

cs.CL↗

arXiv2022

Modeling Intention, Emotion and External World in Dialogue Systems

Intention, emotion and action are important elements in human activities. Modeling the interaction process between individuals by analyzing the relationships between these elements is a challenging task. However, previous work mainly focused on modeling intention and emotion independently, and neglected of exploring the mutual relationships between intention and emotion. In this paper, we propose a RelAtion Interaction Network (RAIN), consisting of Intention Relation Module and Emotion Relation Module, to jointly model mutual relationships and explicitly integrate historical intention information. The experiments on the dataset show that our model can take full advantage of the intention, emotion and action between individuals and achieve a remarkable improvement over BERT-style baselines. Qualitative analysis verifies the importance of the mutual interaction between the intention and emotion.

cs.CL↗

arXiv2022

Superdiffusion of Cosmic Rays in Compressible Magnetized Turbulence

Owing to the complexity of turbulent magnetic fields, modeling the diffusion of cosmic rays is challenging. Based on the current understanding of anisotropic magnetohydrodynamic (MHD) turbulence, we use test particles to examine the cosmic rays' superdiffusion in the direction perpendicular to the mean magnetic field. By changing Alfven Mach number $M_A$ and sonic Mach number $M_S$ of compressible MHD simulations, our study covers a wide range of astrophysical conditions including subsonic warm gas phase and supersonic cold molecular gas. We show that freely streaming cosmic rays' perpendicular displacement increases as 3/2 to the power of the time traveled along local magnetic field lines. This power-law index changes to 3/4 if the parallel propagation is diffusive. We find that the cosmic rays' parallel mean free path decreases in a power-law relation of $M_A^{-2}$ in supersonic turbulence. We investigate the energy fraction of slow, fast, and Alfvenic modes and confirm the dominance of Alfvenic modes in the perpendicular superdiffusion. In particular, the energy fraction of fast mode, which is the main agent for pitch-angle scattering, increases with $M_A$ but is insensitive to $M_S \ge 2$. Accordingly, our results suggest that the suppressed diffusion in supersonic molecular clouds arises primarily due to the variations of $M_A$ instead of $M_S$.

astro-ph.GA↗