arXiv subjects

Li Zhang

Publications and source records attributed to Li Zhang.

At least 649 records · Page 36Linked to original sources

arXiv2022

Knowledge-aware Neural Collective Matrix Factorization for Cross-domain Recommendation

Cross-domain recommendation (CDR) can help customers find more satisfying items in different domains. Existing CDR models mainly use common users or mapping functions as bridges between domains but have very limited exploration in fully utilizing extra knowledge across domains. In this paper, we propose to incorporate the knowledge graph (KG) for CDR, which enables items in different domains to share knowledge. To this end, we first construct a new dataset AmazonKG4CDR from the Freebase KG and a subset (two domain pairs: movies-music, movie-book) of Amazon Review Data. This new dataset facilitates linking knowledge to bridge within- and cross-domain items for CDR. Then we propose a new framework, KG-aware Neural Collective Matrix Factorization (KG-NeuCMF), leveraging KG to enrich item representations. It first learns item embeddings by graph convolutional autoencoder to capture both domain-specific and domain-general knowledge from adjacent and higher-order neighbours in the KG. Then, we maximize the mutual information between item embeddings learned from the KG and user-item matrix to establish cross-domain relationships for better CDR. Finally, we conduct extensive experiments on the newly constructed dataset and demonstrate that our model significantly outperforms the best-performing baselines.

cs.IR↗

arXiv2022

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Evaluation in machine learning is usually informed by past choices, for example which datasets or metrics to use. This standardization enables the comparison on equal footing using leaderboards, but the evaluation choices become sub-optimal as better alternatives arise. This problem is especially pertinent in natural language generation which requires ever-improving suites of datasets, metrics, and human evaluation to make definitive claims. To make following best model evaluation practices easier, we introduce GEMv2. The new version of the Generation, Evaluation, and Metrics Benchmark introduces a modular infrastructure for dataset, model, and metric developers to benefit from each others work. GEMv2 supports 40 documented datasets in 51 languages. Models for all datasets can be evaluated online and our interactive data card creation and rendering tools make it easier to add new datasets to the living benchmark.

cs.CL↗

arXiv2022

Intra Encoding Complexity Control with a Time-Cost Model for Versatile Video Coding

For the latest video coding standard Versatile Video Coding (VVC), the encoding complexity is much higher than previous video coding standards to achieve a better coding efficiency, especially for intra coding. The complexity becomes a major barrier of its deployment and use. Even with many fast encoding algorithms, it is still practically important to control the encoding complexity to a given level. Inspired by rate control algorithms, we propose a scheme to precisely control the intra encoding complexity of VVC. In the proposed scheme, a Time-PlanarCost (viz. Time-Cost, or T-C) model is utilized for CTU encoding time estimation. By combining a set of predefined parameters and the T-C model, CTU-level complexity can be roughly controlled. Then to achieve a precise picture-level complexity control, a framework is constructed including uneven complexity pre-allocation, preset selection and feedback. Experimental results show that, for the challenging intra coding scenario, the complexity error quickly converges to under 3.21%, while keeping a reasonable time saving and rate-distortion (RD) performance. This proves the efficiency of the proposed methods.

eess.IV↗

arXiv2022

Accelerating Score-based Generative Models for High-Resolution Image Synthesis

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. The key idea is to produce high-quality images by recurrently adding Gaussian noises and gradients to a Gaussian sample until converging to the target distribution, a.k.a. the diffusion sampling. To ensure stability of convergence in sampling and generation quality, however, this sequential sampling process has to take a small step size and many sampling iterations (e.g., 2000). Several acceleration methods have been proposed with focus on low-resolution generation. In this work, we consider the acceleration of high-resolution generation with SGMs, a more challenging yet more important problem. We prove theoretically that this slow convergence drawback is primarily due to the ignorance of the target distribution. Further, we introduce a novel Target Distribution Aware Sampling (TDAS) method by leveraging the structural priors in space and frequency domains. Extensive experiments on CIFAR-10, CelebA, LSUN, and FFHQ datasets validate that TDAS can consistently accelerate state-of-the-art SGMs, particularly on more challenging high resolution (1024x1024) image generation tasks by up to 18.4x, whilst largely maintaining the synthesis quality. With fewer sampling iterations, TDAS can still generate good quality images. In contrast, the existing methods degrade drastically or even fails completely

cs.CV↗

arXiv2022

Direct observation of moiré flat-band breakdown at the edge of magic-angle twisted bilayer graphene

Low-energy moiré flat bands in magic-angle twisted bilayer graphene (tBG) have demonstrated incredible potentials to exhibit rich exotic quantum phenomena. Theoretically, the moiré flat bands of tBG are based on the extended structures, i.e., the moiré patterns with periodic boundary conditions. However, a fundamental question of whether the flat bands can exist in the graphene moiré patterns with a reduced structure symmetry, such as sample edges, remains unanswered. Here, via scanning tunneling microscopy and spectroscopy, we study the local electronic properties of a magic-angle tBG near the sample terminated edge and report a direct observation of breakdown of the moiré flat bands. We show that the moiré electronic structures, including the low-energy flat bands, can sufficiently exist in a complete moiré spot, i.e., a moiré supercell, right at the edge even the translational symmetry of the moiré patterns is broken in one direction. However, the flat-band characteristic is obviously absent in the incomplete moiré spots that are partly terminated by the edge. Our results indicate that a whole moiré spot is sufficient and indispensable for the generation of the effective moiré flat bands in tBG.

cond-mat.mes-hall↗

arXiv2022

Region-Aware Metric Learning for Open World Semantic Segmentation via Meta-Channel Aggregation

As one of the most challenging and practical segmentation tasks, open-world semantic segmentation requires the model to segment the anomaly regions in the images and incrementally learn to segment out-of-distribution (OOD) objects, especially under a few-shot condition. The current state-of-the-art (SOTA) method, Deep Metric Learning Network (DMLNet), relies on pixel-level metric learning, with which the identification of similar regions having different semantics is difficult. Therefore, we propose a method called region-aware metric learning (RAML), which first separates the regions of the images and generates region-aware features for further metric learning. RAML improves the integrity of the segmented anomaly regions. Moreover, we propose a novel meta-channel aggregation (MCA) module to further separate anomaly regions, forming high-quality sub-region candidates and thereby improving the model performance for OOD objects. To evaluate the proposed RAML, we have conducted extensive experiments and ablation studies on Lost And Found and Road Anomaly datasets for anomaly segmentation and the CityScapes dataset for incremental few-shot learning. The results show that the proposed RAML achieves SOTA performance in both stages of open world segmentation. Our code and appendix are available at https://github.com/czifan/RAML.

cs.CV↗

arXiv2022

Reasoning about Procedures with Natural Language Processing: A Tutorial

This tutorial provides a comprehensive and in-depth view of the research on procedures, primarily in Natural Language Processing. A procedure is a sequence of steps intended to achieve some goal. Understanding procedures in natural language has a long history, with recent breakthroughs made possible by advances in technology. First, we discuss established approaches to collect procedures, by human annotation or extraction from web resources. Then, we examine different angles from which procedures can be reasoned about, as well as ways to represent them. Finally, we enumerate scenarios where procedural knowledge can be applied to the real world.

cs.CL↗

arXiv2022

ONCE-3DLanes: Building Monocular 3D Lane Detection

We present ONCE-3DLanes, a real-world autonomous driving dataset with lane layout annotation in 3D space. Conventional 2D lane detection from a monocular image yields poor performance of following planning and control tasks in autonomous driving due to the case of uneven road. Predicting the 3D lane layout is thus necessary and enables effective and safe driving. However, existing 3D lane detection datasets are either unpublished or synthesized from a simulated environment, severely hampering the development of this field. In this paper, we take steps towards addressing these issues. By exploiting the explicit relationship between point clouds and image pixels, a dataset annotation pipeline is designed to automatically generate high-quality 3D lane locations from 2D lane annotations in 211K road scenes. In addition, we present an extrinsic-free, anchor-free method, called SALAD, regressing the 3D coordinates of lanes in image view without converting the feature map into the bird's-eye view (BEV). To facilitate future research on 3D lane detection, we benchmark the dataset and provide a novel evaluation metric, performing extensive experiments of both existing approaches and our proposed method. The aim of our work is to revive the interest of 3D lane detection in a real-world scenario. We believe our work can lead to the expected and unexpected innovations in both academia and industry.

cs.CV↗

arXiv2022

Is "My Favorite New Movie" My Favorite Movie? Probing the Understanding of Recursive Noun Phrases

Recursive noun phrases (NPs) have interesting semantic properties. For example, "my favorite new movie" is not necessarily my favorite movie, whereas "my new favorite movie" is. This is common sense to humans, yet it is unknown whether language models have such knowledge. We introduce the Recursive Noun Phrase Challenge (RNPC), a dataset of three textual inference tasks involving textual entailment and event plausibility comparison, precisely targeting the understanding of recursive NPs. When evaluated on RNPC, state-of-the-art Transformer models only perform around chance. Still, we show that such knowledge is learnable with appropriate data. We further probe the models for relevant linguistic features that can be learned from our tasks, including modifier semantic category and modifier scope. Finally, models trained on RNPC achieve strong zero-shot performance on an extrinsic Harm Detection evaluation task, showing the usefulness of the understanding of recursive NPs in downstream applications.

cs.CL↗

arXiv2022

PR-PL: A Novel Transfer Learning Framework with Prototypical Representation based Pairwise Learning for EEG-Based Emotion Recognition

Affective brain-computer interfaces based on electroencephalography (EEG) is an important branch in the field of affective computing. However, individual differences and noisy labels seriously limit the effectiveness and generalizability of EEG-based emotion recognition models. In this paper, we propose a novel transfer learning framework with Prototypical Representation based Pairwise Learning (PR-PL) to learn discriminative and generalized prototypical representations for emotion revealing across individuals and formulate emotion recognition as pairwise learning for alleviating the reliance on precise label information. Extensive experiments are conducted on two benchmark databases under four cross-validation evaluation protocols (cross-subject cross-session, cross-subject within-session, within-subject cross-session, and within-subject within-session). The experimental results demonstrate the superiority of the proposed PR-PL against the state-of-the-arts under all four evaluation protocols, which shows the effectiveness and generalizability of PR-PL in dealing with the ambiguity of EEG responses in affective studies. The source code is available at https://github.com/KAZABANA/PR-PL.

cs.HC↗

arXiv2022

Elastic and inelastic $J/ψ$ photoproduction in $p$-$p$ collisions at LHC energies: the feature of Weizsäcker-Williams approximation

The $J/ψ$ production originating from elastic and inelastic photoproduction processes in p-p collisions at LHC energies is investigated, where the fragmentation processes are involved. An exact treatment is performed, which adopts the Martin-Ryskin method to weight the contribution from different channels, and can return to Weizsäcker-Williams approximation (WWA) when $Q^{2}\rightarrow0$. The relevant kinematical relations are also achieved. We present a comprehensive analysis for the feature of WWA by comparing with the exact treatment. The results are expressed in $Q^{2}$, $y$, $z$, $p_{T}$, and $y_{r}$ (rapidity) distributions, and the total cross sections are also estimated. The numerical results indicate that, the incoherent-photon emission can provide the meaningful contribution to elastic photoproduction, and starts to play a very important role in the inelastic processes. The photoproduction and fragmentation processes can improve the contribution of $J/ψ$ production in $p$-$p$ collisions at LHC energies. Moreover, the WWA is only effective in very restricted domains, and the exact treatment is needed to deal accurately with the $J/ψ$ photoproduction, which can naturally avoid double counting and WWA errors.

hep-ph↗

arXiv2022

SOFT: Softmax-free Transformer with Linear Complexity

Vision transformers (ViTs) have pushed the state-of-the-art for various visual recognition tasks by patch-wise image tokenization followed by self-attention. However, the employment of self-attention modules results in a quadratic complexity in both computation and memory usage. Various attempts on approximating the self-attention computation with linear complexity have been made in Natural Language Processing. However, an in-depth analysis in this work shows that they are either theoretically flawed or empirically ineffective for visual recognition. We further identify that their limitations are rooted in keeping the softmax self-attention during approximations. Specifically, conventional self-attention is computed by normalizing the scaled dot-product between token feature vectors. Keeping this softmax operation challenges any subsequent linearization efforts. Based on this insight, for the first time, a softmax-free transformer or SOFT is proposed. To remove softmax in self-attention, Gaussian kernel function is used to replace the dot-product similarity without further normalization. This enables a full self-attention matrix to be approximated via a low-rank matrix decomposition. The robustness of the approximation is achieved by calculating its Moore-Penrose inverse using a Newton-Raphson method. Extensive experiments on ImageNet show that our SOFT significantly improves the computational efficiency of existing ViT variants. Crucially, with a linear complexity, much longer token sequences are permitted in SOFT, resulting in superior trade-off between accuracy and complexity.

cs.CV↗

arXiv2022

Origami-controlled strain engineering of tunable flat bands and correlated states in folded graphene

Flat electronic bands with tunable structures offer opportunities for the exploitation and manipulation of exotic interacting quantum states. Here, we present a controllable route to construct easily tunable flat bands in folded graphene, by nano origami-controlled strain engineering, and discover correlated states in this system. Via tearing and folding graphene monolayer at arbitrary step edges with scanning tunneling microscope manipulation, we create strain-induced pseudo-magnetic fields as well as resulting flat electronic bands in the curved edges of folded graphene. We show that the intensity of the pseudo-magnetic field can be readily tuned by changing the width of the folding edge due to the edge-width-dependent lattice deformation, leading to the well adjustability of the geometry of flat bands in folded graphene. Furthermore, by creating expected dispersionless flat bands using this technique, the correlation-induced splits of flat bands are successfully observed in the density of states when these bands are partially filled. Our experiment provides a feasible and effective pathway to engineer the system with tunable flat band structures, and establishes a new platform that can be used to realize devisable strain and interaction induced quantum phases.

cond-mat.mes-hall↗

arXiv2022

Characterizing the $γ$-Ray Variability of Active Galactic Nuclei with Stochastic Process Method

The $γ$-ray astronomy in time domain has been by now progressed further as the variabilities of Active Galactic Nuclei (AGNs) on different timescales have been reported a lot. We study the $γ$-ray variabilities of 23 jetted AGNs through applying a stochastic process method to the ~12.7 yr long-term light curve (LC) obtained by Fermi-Large Area Telescope (Fermi-LAT). In this method, the stochastically driven damped simple harmonic oscillator (SHO) and the damped random walk (DRW) models are used to model the long-term LCs. Our results show that the long-term variabilities of 23 AGNs can be characterized well by both SHO and DRW models. However, the SHO model is restricted in the over-damped mode and the parameters are poorly constrained. The SHO power spectral densities (PSDs) are same as the typical DRW PSD. In the plot of the rest-frame timescale that corresponds to the broken frequency in the PSD versus black hole mass, the intrinsic $γ$-ray characteristic timescales of 23 AGNs occupy almost the same space with the optical variability timescales obtained from the accretion disk emission. This suggests a connection between the jet and the accretion disk. Same as the optical variability of AGN accretion disk, the $γ$-ray timescale is also consistent with the thermal timescale caused by the thermal instability in the standard accretion disk of AGN.

astro-ph.HE↗

arXiv2022

In Defense of Subspace Tracker: Orthogonal Embedding for Visual Tracking

The paper focuses on a classical tracking model, subspace learning, grounded on the fact that the targets in successive frames are considered to reside in a low-dimensional subspace or manifold due to the similarity in their appearances. In recent years, a number of subspace trackers have been proposed and obtained impressive results. Inspired by the most recent results that the tracking performance is boosted by the subspace with discrimination capability learned over the recently localized targets and their immediately surrounding background, this work aims at solving such a problem: how to learn a robust low-dimensional subspace to accurately and discriminatively represent these target and background samples. To this end, a discriminative approach, which reliably separates the target from its surrounding background, is injected into the subspace learning by means of joint learning, achieving a dimension-adaptive subspace with superior discrimination capability. The proposed approach is extensively evaluated and compared with the state-of-the-art trackers on four popular tracking benchmarks. The experimental results demonstrate that the proposed tracker performs competitively against its counterparts. In particular, it achieves more than 9% performance increase compared with the state-of-the-art subspace trackers.

cs.CV↗

arXiv2022

UIGR: Unified Interactive Garment Retrieval

Interactive garment retrieval (IGR) aims to retrieve a target garment image based on a reference garment image along with user feedback on what to change on the reference garment. Two IGR tasks have been studied extensively: text-guided garment retrieval (TGR) and visually compatible garment retrieval (VCR). The user feedback for the former indicates what semantic attributes to change with the garment category preserved, while the category is the only thing to be changed explicitly for the latter, with an implicit requirement on style preservation. Despite the similarity between these two tasks and the practical need for an efficient system tackling both, they have never been unified and modeled jointly. In this paper, we propose a Unified Interactive Garment Retrieval (UIGR) framework to unify TGR and VCR. To this end, we first contribute a large-scale benchmark suited for both problems. We further propose a strong baseline architecture to integrate TGR and VCR in one model. Extensive experiments suggest that unifying two tasks in one framework is not only more efficient by requiring a single model only, it also leads to better performance. Code and datasets are available at https://github.com/BrandonHanx/CompFashion.

cs.CV↗

arXiv2022

Trajectories and Radiation of Charged Particles in the Pulsar Magnetosphere

Trajectories and radiation of the accelerating electrons are studied in the pulsar magnetosphere approximated as the electromagnetic field of the Deutsch's solutions. Because the electrons are accelerated rapidly to ultra-relativistic velocity near the neutron star surface, the electron velocity vector (and then its trajectory) is derived from the balance between Lorentz force and radiation reaction force, which makes the pitch angle between electron trajectories and magnetic field lines nonzero in most part of the magnetosphere. In such a case, the spectral energy distributions (SEDs) of synchro-curvature radiation for the accelerating electrons with a mono-energetic form are calculated. Our results indicate that: (i) the pitch angle is the function of electron position ($r, θ, ϕ$) in the open field line regions, and increases with increasing $r$ and $θ$ as well as increasing the inclination angle; (ii) the radius of curvature becomes large along the particle trajectory, and (iii) the SED appears a double peak structure depending on the emission position, where the synchrotron radiation plays an important role in X-ray band and curvature radiation mainly works in GeV band, which is only determined by parameters $α$ and $ζ$

hep-ph↗

arXiv2022

Graph Node-Feature Convolution for Representation Learning

Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or features are useful or not. Recent methods have improved solutions by sampling a fixed size set of neighbors, or assigning different weights to different neighbors in the aggregation process, but features within a feature vector are still treated equally in the aggregation process. In this paper, we introduce a new convolution operation on regular size feature maps constructed from features of a fixed node bandwidth via sampling to get the first-level node representation, which is then passed to a standard GCN to learn the second-level node representation. Experiments show that our method outperforms competing methods in semi-supervised node classification tasks. Furthermore, our method opens new doors for exploring new GCN architectures, particularly deeper GCN models.

cs.LG↗