arXiv subjects

Zijian Li

Publications and source records attributed to Zijian Li.

At least 109 records · Page 6Linked to original sources

arXiv2023

Motif Graph Neural Network

Graphs can model complicated interactions between entities, which naturally emerge in many important applications. These applications can often be cast into standard graph learning tasks, in which a crucial step is to learn low-dimensional graph representations. Graph neural networks (GNNs) are currently the most popular model in graph embedding approaches. However, standard GNNs in the neighborhood aggregation paradigm suffer from limited discriminative power in distinguishing \emph{high-order} graph structures as opposed to \emph{low-order} structures. To capture high-order structures, researchers have resorted to motifs and developed motif-based GNNs. However, existing motif-based GNNs still often suffer from less discriminative power on high-order structures. To overcome the above limitations, we propose Motif Graph Neural Network (MGNN), a novel framework to better capture high-order structures, hinging on our proposed motif redundancy minimization operator and injective motif combination. First, MGNN produces a set of node representations w.r.t. each motif. The next phase is our proposed redundancy minimization among motifs which compares the motifs with each other and distills the features unique to each motif. Finally, MGNN performs the updating of node representations by combining multiple representations from different motifs. In particular, to enhance the discriminative power, MGNN utilizes an injective function to combine the representations w.r.t. different motifs. We further show that our proposed architecture increases the expressive power of GNNs with a theoretical analysis. We demonstrate that MGNN outperforms state-of-the-art methods on seven public benchmarks on both node classification and graph classification tasks.

cs.LG↗

arXiv2022

Towards Hard-Positive Query Mining for DETR-based Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a core task for high-level image understanding. Recently, Detection Transformer (DETR)-based HOI detectors have become popular due to their superior performance and efficient structure. However, these approaches typically adopt fixed HOI queries for all testing images, which is vulnerable to the location change of objects in one specific image. Accordingly, in this paper, we propose to enhance DETR's robustness by mining hard-positive queries, which are forced to make correct predictions using partial visual cues. First, we explicitly compose hard-positive queries according to the ground-truth (GT) position of labeled human-object pairs for each training image. Specifically, we shift the GT bounding boxes of each labeled human-object pair so that the shifted boxes cover only a certain portion of the GT ones. We encode the coordinates of the shifted boxes for each labeled human-object pair into an HOI query. Second, we implicitly construct another set of hard-positive queries by masking the top scores in cross-attention maps of the decoder layers. The masked attention maps then only cover partial important cues for HOI predictions. Finally, an alternate strategy is proposed that efficiently combines both types of hard queries. In each iteration, both DETR's learnable queries and one selected type of hard-positive queries are adopted for loss computation. Experimental results show that our proposed approach can be widely applied to existing DETR-based HOI detectors. Moreover, we consistently achieve state-of-the-art performance on three benchmarks: HICO-DET, V-COCO, and HOI-A. Code is available at https://github.com/MuchHair/HQM.

cs.CV↗

arXiv2022

TEA: A Sequential Recommendation Framework via Temporally Evolving Aggregations

Sequential recommendation aims to choose the most suitable items for a user at a specific timestamp given historical behaviors. Existing methods usually model the user behavior sequence based on the transition-based methods like Markov Chain. However, these methods also implicitly assume that the users are independent of each other without considering the influence between users. In fact, this influence plays an important role in sequence recommendation since the behavior of a user is easily affected by others. Therefore, it is desirable to aggregate both user behaviors and the influence between users, which are evolved temporally and involved in the heterogeneous graph of users and items. In this paper, we incorporate dynamic user-item heterogeneous graphs to propose a novel sequential recommendation framework. As a result, the historical behaviors as well as the influence between users can be taken into consideration. To achieve this, we firstly formalize sequential recommendation as a problem to estimate conditional probability given temporal dynamic heterogeneous graphs and user behavior sequences. After that, we exploit the conditional random field to aggregate the heterogeneous graphs and user behaviors for probability estimation, and employ the pseudo-likelihood approach to derive a tractable objective function. Finally, we provide scalable and flexible implementations of the proposed framework. Experimental results on three real-world datasets not only demonstrate the effectiveness of our proposed method but also provide some insightful discoveries on sequential recommendation.

cs.IR↗

arXiv2022

Federated Learning with GAN-based Data Synthesis for Non-IID Clients

Federated learning (FL) has recently emerged as a popular privacy-preserving collaborative learning paradigm. However, it suffers from the non-independent and identically distributed (non-IID) data among clients. In this paper, we propose a novel framework, named Synthetic Data Aided Federated Learning (SDA-FL), to resolve this non-IID challenge by sharing synthetic data. Specifically, each client pretrains a local generative adversarial network (GAN) to generate differentially private synthetic data, which are uploaded to the parameter server (PS) to construct a global shared synthetic dataset. To generate confident pseudo labels for the synthetic dataset, we also propose an iterative pseudo labeling mechanism performed by the PS. A combination of the local private dataset and synthetic dataset with confident pseudo labels leads to nearly identical data distributions among clients, which improves the consistency among local models and benefits the global aggregation. Extensive experiments evidence that the proposed framework outperforms the baseline methods by a large margin in several benchmark datasets under both the supervised and semi-supervised settings.

cs.LG↗

arXiv2022

Time-Series Domain Adaptation via Sparse Associative Structure Alignment: Learning Invariance and Variance

Domain adaptation on time-series data is often encountered in the industry but received limited attention in academia. Most of the existing domain adaptation methods for time-series data borrow the ideas from the existing methods for non-time series data to extract the domain-invariant representation. However, two peculiar difficulties to time-series data have not been solved. 1) It is not a trivial task to model the domain-invariant and complex dependence among different timestamps. 2) The domain-variant information is important but how to leverage them is almost underexploited. Fortunately, the stableness of causal structures among different domains inspires us to explore the structures behind the time-series data. Based on this inspiration, we investigate the domain-invariant unweighted sparse associative structures and the domain-variant strengths of the structures. To achieve this, we propose Sparse Associative structure alignment by learning Invariance and Variance (SASA-IV in short), a model that simultaneously aligns the invariant unweighted spare associative structures and considers the variant information for time-series unsupervised domain adaptation. Technologically, we extract the domain-invariant unweighted sparse associative structures with a unidirectional alignment restriction and embed the domain-variant strengths via a well-designed autoregressive module. Experimental results not only testify that our model yields state-of-the-art performance on three real-world datasets but also provide some insightful discoveries on knowledge transfer.

cs.LG↗

arXiv2022

HL-Net: Heterophily Learning Network for Scene Graph Generation

Scene graph generation (SGG) aims to detect objects and predict their pairwise relationships within an image. Current SGG methods typically utilize graph neural networks (GNNs) to acquire context information between objects/relationships. Despite their effectiveness, however, current SGG methods only assume scene graph homophily while ignoring heterophily. Accordingly, in this paper, we propose a novel Heterophily Learning Network (HL-Net) to comprehensively explore the homophily and heterophily between objects/relationships in scene graphs. More specifically, HL-Net comprises the following 1) an adaptive reweighting transformer module, which adaptively integrates the information from different layers to exploit both the heterophily and homophily in objects; 2) a relationship feature propagation module that efficiently explores the connections between relationships by considering heterophily in order to refine the relationship representation; 3) a heterophily-aware message-passing scheme to further distinguish the heterophily and homophily between objects/relationships, thereby facilitating improved message passing in graphs. We conducted extensive experiments on two public datasets: Visual Genome (VG) and Open Images (OI). The experimental results demonstrate the superiority of our proposed HL-Net over existing state-of-the-art approaches. In more detail, HL-Net outperforms the second-best competitors by 2.1$\%$ on the VG dataset for scene graph classification and 1.2$\%$ on the IO dataset for the final score. Code is available at https://github.com/siml3/HL-Net.

cs.CV↗

arXiv2022

REST: Debiased Social Recommendation via Reconstructing Exposure Strategies

The recommendation system, relying on historical observational data to model the complex relationships among the users and items, has achieved great success in real-world applications. Selection bias is one of the most important issues of the existing observational data based approaches, which is actually caused by multiple types of unobserved exposure strategies (e.g. promotions and holiday effects). Though various methods have been proposed to address this problem, they are mainly relying on the implicit debiasing techniques but not explicitly modeling the unobserved exposure strategies. By explicitly Reconstructing Exposure STrategies (REST in short), we formalize the recommendation problem as the counterfactual reasoning and propose the debiased social recommendation method. In REST, we assume that the exposure of an item is controlled by the latent exposure strategies, the user, and the item. Based on the above generation process, we first provide the theoretical guarantee of our method via identification analysis. Second, we employ a variational auto-encoder to reconstruct the latent exposure strategies, with the help of the social networks and the items. Third, we devise a counterfactual reasoning based recommendation algorithm by leveraging the recovered exposure strategies. Experiments on four real-world datasets, including three published datasets and one private WeChat Official Account dataset, demonstrate significant improvements over several state-of-the-art methods.

cs.LG↗

arXiv2021

Spectroscopically Identified Emission Line Galaxy Pairs in the WISP survey

We identify a sample of spectroscopically measured emission line galaxy (ELG) pairs up to z=1.6 from the WFC3 Infrared Spectroscopic Parallels (WISP) survey. WISP obtained slitless, near-infrared grism spectroscopy along with direct imaging in the J and H bands by observing in the pure-parallel mode with the Wide Field Camera Three (WFC3) on the Hubble Space Telescope (HST). From our search of 419 WISP fields covering an area of ~0.5 deg$^{2}$, we find 413 ELG pair systems, mostly Halpha emitters. We then derive reliable star formation rates (SFRs) based on the attenuation-corrected Halpha fluxes. Compared to isolated galaxies, we find an average SFR enhancement of 40%-65%, which is stronger for major pairs and pairs with smaller velocity separations (Delta_v < 300 km/s). Based on the stacked spectra from various subsamples, we study the trends of emission line ratios in pairs, and find a general consistency with enhanced lower-ionization lines. We study the pair fraction among ELGs, and find a marginally significant increase with redshift $f \propto (1+z)^α$, where the power-law index α=0.58$\pm$0.17 from $z\sim$0.2 to $z\sim$1.6. The fraction of Active galactic Nuclei (AGNs), is found to be the same in the ELG pairs as compared to isolated ELGs.

astro-ph.GA↗

arXiv2021

Searching for low-redshift faint galaxies with MMT/Hectospec

We present redshifts for 2753 low-redshift galaxies between $0.03 \lesssim z_{\rm spec}\lesssim0.5$ with 18 $\leq$ $r$ $\leq$ 22 obtained with Hectospec at the Multi-Mirror Telescope (MMT). The observations targeted the XMM-LSS, ELAIS-N1 and DEEP2-3 fields, each of which covers $\sim$ 1 deg$^2$. These fields are also part of the recently completed CFHT Large Area U-band Deep Survey (CLAUDS) and on-going Hyper Suprime-Cam deep fields surveys. The efficiency of our technique for selecting low-redshift galaxies is confirmed by the redshift distribution of our sources. In addition to redshifts, these high S/N spectra are used to measure ages, metallicities, and nuclear activity levels. In combination with the photometric catalogue in $u$, $g$, $r$, $i$, $z$, $y$ down to 27 AB mag, we are able to study the galaxy population down to stellar masses of $\sim$ 10$^8 M_\odot$ . This paper presents the observational strategy, the reduction procedure and properties of the galaxy sample.

astro-ph.GA↗

arXiv2021

Spectral energy distribution similarity of the local galaxies and the 3.6um selected galaxies from the Spitzer Extended Deep Survey

The Spitzer Extended Deep Survey (SEDS) as a deep and wide mid-infrared (MIR) survey project provides a sample of 500000+ sources spreading 1.46 square degree and a depth of 26 AB mag (3$σ$). Combining with the previous available data, we build a PSF-matched multi-wavelength photometry catalog from u band to 8$μ$m. We fit the SEDS galaxies spectral energy distributions by the local galaxy templates. The results show that the SEDS galaxy can be fitted well, indicating the high redshift galaxy ($z \sim 1$) shares the same templates with the local galaxies. This study would facilitate the further study of the galaxy luminosity and high redshift mass function.

astro-ph.GA↗

arXiv2021

Time Series Domain Adaptation via Sparse Associative Structure Alignment

Domain adaptation on time series data is an important but challenging task. Most of the existing works in this area are based on the learning of the domain-invariant representation of the data with the help of restrictions like MMD. However, such extraction of the domain-invariant representation is a non-trivial task for time series data, due to the complex dependence among the timestamps. In detail, in the fully dependent time series, a small change of the time lags or the offsets may lead to difficulty in the domain invariant extraction. Fortunately, the stability of the causality inspired us to explore the domain invariant structure of the data. To reduce the difficulty in the discovery of causal structure, we relax it to the sparse associative structure and propose a novel sparse associative structure alignment model for domain adaptation. First, we generate the segment set to exclude the obstacle of offsets. Second, the intra-variables and inter-variables sparse attention mechanisms are devised to extract associative structure time-series data with considering time lags. Finally, the associative structure alignment is used to guide the transfer of knowledge from the source domain to the target one. Experimental studies not only verify the good performance of our methods on three real-world datasets but also provide some insightful discoveries on the transferred knowledge.

cs.LG↗

arXiv2021

Aggregating From Multiple Target-Shifted Sources

Multi-source domain adaptation aims at leveraging the knowledge from multiple tasks for predicting a related target domain. Hence, a crucial aspect is to properly combine different sources based on their relations. In this paper, we analyzed the problem for aggregating source domains with different label distributions, where most recent source selection approaches fail. Our proposed algorithm differs from previous approaches in two key ways: the model aggregates multiple sources mainly through the similarity of semantic conditional distribution rather than marginal distribution; the model proposes a \emph{unified} framework to select relevant sources for three popular scenarios, i.e., domain adaptation with limited label on target domain, unsupervised domain adaptation and label partial unsupervised domain adaption. We evaluate the proposed method through extensive experiments. The empirical results significantly outperform the baselines.

cs.LG↗

arXiv2021

Graph Domain Adaptation: A Generative View

Recent years have witnessed tremendous interest in deep learning on graph-structured data. Due to the high cost of collecting labeled graph-structured data, domain adaptation is important to supervised graph learning tasks with limited samples. However, current graph domain adaptation methods are generally adopted from traditional domain adaptation tasks, and the properties of graph-structured data are not well utilized. For example, the observed social networks on different platforms are controlled not only by the different crowd or communities but also by the domain-specific policies and the background noise. Based on these properties in graph-structured data, we first assume that the graph-structured data generation process is controlled by three independent types of latent variables, i.e., the semantic latent variables, the domain latent variables, and the random latent variables. Based on this assumption, we propose a disentanglement-based unsupervised domain adaptation method for the graph-structured data, which applies variational graph auto-encoders to recover these latent variables and disentangles them via three supervised learning modules. Extensive experimental results on two real-world datasets in the graph classification task reveal that our method not only significantly outperforms the traditional domain adaptation methods and the disentangled-based domain adaptation methods but also outperforms the state-of-the-art graph domain adaptation algorithms.

cs.LG↗

arXiv2020

Semi-Supervised Disentangled Framework for Transferable Named Entity Recognition

Named entity recognition (NER) for identifying proper nouns in unstructured text is one of the most important and fundamental tasks in natural language processing. However, despite the widespread use of NER models, they still require a large-scale labeled data set, which incurs a heavy burden due to manual annotation. Domain adaptation is one of the most promising solutions to this problem, where rich labeled data from the relevant source domain are utilized to strengthen the generalizability of a model based on the target domain. However, the mainstream cross-domain NER models are still affected by the following two challenges (1) Extracting domain-invariant information such as syntactic information for cross-domain transfer. (2) Integrating domain-specific information such as semantic information into the model to improve the performance of NER. In this study, we present a semi-supervised framework for transferable NER, which disentangles the domain-invariant latent variables and domain-specific latent variables. In the proposed framework, the domain-specific information is integrated with the domain-specific latent variables by using a domain predictor. The domain-specific and domain-invariant latent variables are disentangled using three mutual information regularization terms, i.e., maximizing the mutual information between the domain-specific latent variables and the original embedding, maximizing the mutual information between the domain-invariant latent variables and the original embedding, and minimizing the mutual information between the domain-specific and domain-invariant latent variables. Extensive experiments demonstrated that our model can obtain state-of-the-art performance with cross-domain and cross-lingual NER benchmark data sets.

cs.CL↗

arXiv2020

Learning Disentangled Semantic Representation for Domain Adaptation

Domain adaptation is an important but challenging task. Most of the existing domain adaptation methods struggle to extract the domain-invariant representation on the feature space with entangling domain information and semantic information. Different from previous efforts on the entangled feature space, we aim to extract the domain invariant semantic information in the latent disentangled semantic representation (DSR) of the data. In DSR, we assume the data generation process is controlled by two independent sets of variables, i.e., the semantic latent variables and the domain latent variables. Under the above assumption, we employ a variational auto-encoder to reconstruct the semantic latent variables and domain latent variables behind the data. We further devise a dual adversarial network to disentangle these two sets of reconstructed latent variables. The disentangled semantic latent variables are finally adapted across the domains. Experimental studies testify that our model yields state-of-the-art performance on several domain adaptation benchmark datasets.

cs.CV↗

arXiv2020

UV and NIR size of the HI selected low surface brightness galaxies

How does the low surface brightness galaxies (LSBGs) form stars and assemble the stellar mass is one of the most important questions to understand the LSBG population. We select a sample of 381 HI bright LSBGs with both Far Ultraviolet (FUV) and Near Infrared (NIR) observation to investigate the star formation rate (SFR) and stellar mass scales, and the growth mode. We measure the UV and NIR radius of our sample, which represent the star-forming and stellar mass distribution scales. We also compare the UV and H band radius-stellar mass relation with the archive data, to identify the SFR and stellar mass structure difference between the LSBG population and other galaxies. Since galaxy HI mass has a tight correlation with the HI radius, we can also compare the HI and UV radii to understand the distribution of the HI gas and star formation activities. Our results show that most of the HI selected LSBGs have extended star formation structure. The stellar mass distribution of LSBGs may have a similar structure as the disk galaxies at the same stellar mass bins, while the star-forming activity of LSBGs happens at a larger radius than the high surface density galaxies, which may help to select the LSBG sample from the wide-field deep u band image survey. The HI also distributed at a larger radius, implying a steeper (or no) Kennicutt-Schmidt relation for LSBGs.

astro-ph.GA↗

arXiv2020

The atomic gas of star-forming galaxies at z$\sim$0.05 as revealed by the Five-hundred-meter Aperture Spherical Radio Telescope

We report new HI observations of four z$\sim$0.05 star-forming galaxies undertaken during the commissioning phase of the Five-hundred-meter Aperture Spherical Radio Telescope (FAST). FAST is the largest single-dish telescope with a 500 meter aperture and a 19-Beam receiver. Exploiting the unprecedented sensitivity provided by FAST, we aim to study the atomic gas, via the HI 21cm emission line, in low-$z$ star-forming galaxies taken from the Valparaíso ALMA/APEX Line Emission Survey (VALES) project. Together with previous ALMA CO($J=1-0$) observations, the HI data provides crucial information to measure the gas mass and dynamics. As a pilot HI survey, we targeted four local star-forming galaxies at $z\sim0.05$. In particular, one of them has already been detected in HI by the Arecibo Legacy Fast ALFA survey (ALFALFA), allowing a careful comparison. We use an ON-OFF observing approach that allowed us to reach an rms of 0.7mJy/beam at a 1.7km/s velocity resolution within only 20 minutes ON-target integration time. We demonstrate the great capabilities of the FAST 19-beam receiver for pushing the detectability of the HI emission line of extra-galactic sources. The HI emission line detected by FAST shows good consistency with the previous ALFALFA results. Our observations are put in context with previous multi-wavelength data to reveal the physical properties of these low-$z$ galaxies. We find that the CO($J=1-0$) and HI emission line profiles are similar. The dynamical mass estimated from the HI data is an order of magnitude higher than the baryon mass and the dynamical mass derived from the CO observations, implying that the mass probed by dynamics of HI is dominated by the dark matter halo. In one case, a target shows an excess of CO($J=1-0$) in the line centre, which can be explained by an enhanced CO($J=1-0$) emission induced by a nuclear starburst showing high velocity dispersion.

astro-ph.GA↗

arXiv2020

TAG : Type Auxiliary Guiding for Code Comment Generation

Existing leading code comment generation approaches with the structure-to-sequence framework ignores the type information of the interpretation of the code, e.g., operator, string, etc. However, introducing the type information into the existing framework is non-trivial due to the hierarchical dependence among the type information. In order to address the issues above, we propose a Type Auxiliary Guiding encoder-decoder framework for the code comment generation task which considers the source code as an N-ary tree with type information associated with each node. Specifically, our framework is featured with a Type-associated Encoder and a Type-restricted Decoder which enables adaptive summarization of the source code. We further propose a hierarchical reinforcement learning method to resolve the training difficulties of our proposed framework. Extensive evaluations demonstrate the state-of-the-art performance of our framework with both the auto-evaluated metrics and case studies.

cs.CL↗