arXiv subjects

Jian Liang

Publications and source records attributed to Jian Liang.

At least 163 records · Page 9Linked to original sources

arXiv2023

Exploiting Semantic Attributes for Transductive Zero-Shot Learning

Zero-shot learning (ZSL) aims to recognize unseen classes by generalizing the relation between visual features and semantic attributes learned from the seen classes. A recent paradigm called transductive zero-shot learning further leverages unlabeled unseen data during training and has obtained impressive results. These methods always synthesize unseen features from attributes through a generative adversarial network to mitigate the bias towards seen classes. However, they neglect the semantic information in the unlabeled unseen data and thus fail to generate high-fidelity attribute-consistent unseen features. To address this issue, we present a novel transductive ZSL method that produces semantic attributes of the unseen data and imposes them on the generative process. In particular, we first train an attribute decoder that learns the mapping from visual features to semantic attributes. Then, from the attribute decoder, we obtain pseudo-attributes of unlabeled data and integrate them into the generative model, which helps capture the detailed differences within unseen classes so as to synthesize more discriminative features. Experiments on five standard benchmarks show that our method yields state-of-the-art results for zero-shot learning.

cs.CV↗

arXiv2023

Transverse-Momentum-Dependent Wave Functions of Pion from Lattice QCD

We present a first lattice QCD calculation of the transverse-momentum-dependent wave functions (TMDWFs) of the pion using large-momentum effective theory. Numerical simulations are based on one ensemble with 2+1+1 flavors of highly improved staggered quarks action with lattice spacing $a=0.121$~fm from the MILC Collaboration, and one with 2 +1 flavor clover fermions and tree-level Symanzik gauge action generated by the CLS Collaboration with $a=0.098$~fm. As a key ingredient, the soft function is first obtained by incorporating the one-loop perturbative contributions and a proper normalization. Based on this and the equal-time quasi-TMDWFs simulated on the lattice, we extract the light-cone TMDWFs. The results are comparable between the two lattice ensembles and a comparison with phenomenological parametrization is made. Our studies provide a first attempt of $ab$ $initio$ calculation of TMDWFs which will eventually lead to crucial theory inputs for making predictions for exclusive processes under QCD factorization.

hep-lat↗

arXiv2023

MAPS: A Noise-Robust Progressive Learning Approach for Source-Free Domain Adaptive Keypoint Detection

Existing cross-domain keypoint detection methods always require accessing the source data during adaptation, which may violate the data privacy law and pose serious security concerns. Instead, this paper considers a realistic problem setting called source-free domain adaptive keypoint detection, where only the well-trained source model is provided to the target domain. For the challenging problem, we first construct a teacher-student learning baseline by stabilizing the predictions under data augmentation and network ensembles. Built on this, we further propose a unified approach, Mixup Augmentation and Progressive Selection (MAPS), to fully exploit the noisy pseudo labels of unlabeled target data during training. On the one hand, MAPS regularizes the model to favor simple linear behavior in-between the target samples via self-mixup augmentation, preventing the model from over-fitting to noisy predictions. On the other hand, MAPS employs the self-paced learning paradigm and progressively selects pseudo-labeled samples from `easy' to `hard' into the training process to reduce noise accumulation. Results on four keypoint detection datasets show that MAPS outperforms the baseline and achieves comparable or even better results in comparison to previous non-source-free counterparts.

cs.CV↗

arXiv2023

Free Lunch for Domain Adversarial Training: Environment Label Smoothing

A fundamental challenge for machine learning models is how to generalize learned models for out-of-distribution (OOD) data. Among various approaches, exploiting invariant features by Domain Adversarial Training (DAT) received widespread attention. Despite its success, we observe training instability from DAT, mostly due to over-confident domain discriminator and environment label noise. To address this issue, we proposed Environment Label Smoothing (ELS), which encourages the discriminator to output soft probability, which thus reduces the confidence of the discriminator and alleviates the impact of noisy environment labels. We demonstrate, both experimentally and theoretically, that ELS can improve training stability, local convergence, and robustness to noisy environment labels. By incorporating ELS with DAT methods, we are able to yield state-of-art results on a wide range of domain generalization/adaptation tasks, particularly when the environment labels are highly noisy.

cs.LG↗

arXiv2023

Nucleon Electric Dipole Moment from the $θ$ Term with Lattice Chiral Fermions

We calculate the nucleon electric dipole moment (EDM) from the $θ$ term with overlap fermions on three domain wall lattices with different sea pion masses at lattice spacing 0.11 fm. Due to the chiral symmetry conserved by the overlap fermions, we have well defined topological charge and chiral limit for the EDM. Thus, the chiral extrapolation can be carried out reliably at nonzero lattice spacings. We use three to four different partially quenched valence pion masses for each sea pion mass and find that the EDM dependence on the valence and sea pion masses behaves oppositely, which can be described by partially quenched chiral perturbation theory. With the help of the cluster decomposition error reduction (CDER) technique, we determine the neutron and proton EDM at the physical pion mass to be $d_{n}=-0.00148\left(14\right)\left(31\right)\barθ$ e$\cdot$fm and $d_{p}=0.0038\left(11\right)\left(8\right)\barθ$ e$\cdot$fm. This work is a clear demonstration of the advantages of using chiral fermions in the nucleon EDM calculation and paves the road to future precise studies of the strong $CP$ violation effects.

hep-lat↗

arXiv2023

Learning Feature Recovery Transformer for Occluded Person Re-identification

One major issue that challenges person re-identification (Re-ID) is the ubiquitous occlusion over the captured persons. There are two main challenges for the occluded person Re-ID problem, i.e., the interference of noise during feature matching and the loss of pedestrian information brought by the occlusions. In this paper, we propose a new approach called Feature Recovery Transformer (FRT) to address the two challenges simultaneously, which mainly consists of visibility graph matching and feature recovery transformer. To reduce the interference of the noise during feature matching, we mainly focus on visible regions that appear in both images and develop a visibility graph to calculate the similarity. In terms of the second challenge, based on the developed graph similarity, for each query image, we propose a recovery transformer that exploits the feature sets of its $k$-nearest neighbors in the gallery to recover the complete features. Extensive experiments across different person Re-ID datasets, including occluded, partial and holistic datasets, demonstrate the effectiveness of FRT. Specifically, FRT significantly outperforms state-of-the-art results by at least 6.2\% Rank-1 accuracy and 7.2\% mAP scores on the challenging Occluded-Duke dataset. The code is available at https://github.com/xbq1994/Feature-Recovery-Transformer.

cs.CV↗

arXiv2022

Connected and Disconnected Sea Partons from CT18 Parametrization of PDFs

The separation of the connected and disconnected sea partons, which were uncovered in the Euclidean path-integral formulation of the hadronic tensor, is accommodated with an alternative parametrization of the non-perturbative parton distribution functions in the CT18 global analysis. This is achieved with the help of the distinct small $x$ behaviours of these two sea partons and the constraint from the lattice calculation of the ratio of the strange momentum fraction to that of the $\bar u$ or $\bar d$ in the disconnected insertion. The whole dataset of CT18 is used in this CT18CS fit. The impact of the recent SeaQuest data on the $\bar{d}(x)-\bar{u}(x)$ distribution of CT18CS is also discussed. The separate momentum fractions for the valence, the connected sea and disconnected sea of $u$ and $d$, the strange and the gluon partons are presented at $μ=1.3$ GeV for the first time. They can be compared term-by-term with systematic error controlled lattice calculations.

hep-ph↗

arXiv2022

Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networks

An off-the-shelf model as a commercial service could be stolen by model stealing attacks, posing great threats to the rights of the model owner. Model fingerprinting aims to verify whether a suspect model is stolen from the victim model, which gains more and more attention nowadays. Previous methods always leverage the transferable adversarial examples as the model fingerprint, which is sensitive to adversarial defense or transfer learning scenarios. To address this issue, we consider the pairwise relationship between samples instead and propose a novel yet simple model stealing detection method based on SAmple Correlation (SAC). Specifically, we present SAC-w that selects wrongly classified normal samples as model inputs and calculates the mean correlation among their model outputs. To reduce the training time, we further develop SAC-m that selects CutMix Augmented samples as model inputs, without the need for training the surrogate models or generating adversarial examples. Extensive results validate that SAC successfully defends against various model stealing attacks, even including adversarial training or transfer learning, and detects the stolen models with the best performance in terms of AUC across different datasets and model architectures. The codes are available at https://github.com/guanjiyang/SAC.

cs.CR↗

arXiv2022

First observation of the hidden-charm pentaquarks on lattice

The s-wave scattering of $Σ_c \bar{D}$ and $Σ_c \bar{D}^*$ in the $I(J^P) = \frac{1}{2}(\frac{1}{2}^-)$ channel is calculated in lattice QCD using two ensembles with different volumes but the same lattice spacing $a\sim 0.08\mathrm{fm}$ and pion mass $M_π\sim 294\mathrm{MeV}$. The scattering amplitudes near threshold are obtained by Lüscher's finite volume method. We find bound state poles in both $Σ_c \bar{D}$ and $Σ_c \bar{D}^*$ channels, which are possibly related to the $P_c(4312)$ and $P_c(4440) / P_c(4457)$ pentaquarks observed in experiments. The binding energy is $6(2)(2)$MeV for $Σ_c \bar{D}$ and $7(3)(1)$MeV for $Σ_c \bar{D}^*$, where the first error is the statistical error and the second is the systematic error due to the lattice artifacts.

hep-lat↗

arXiv2022

NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis

In this paper, we present NUWA-Infinity, a generative model for infinite visual synthesis, which is defined as the task of generating arbitrarily-sized high-resolution images or long-duration videos. An autoregressive over autoregressive generation mechanism is proposed to deal with this variable-size generation task, where a global patch-level autoregressive model considers the dependencies between patches, and a local token-level autoregressive model considers dependencies between visual tokens within each patch. A Nearby Context Pool (NCP) is introduced to cache-related patches already generated as the context for the current patch being generated, which can significantly save computation costs without sacrificing patch-level dependency modeling. An Arbitrary Direction Controller (ADC) is used to decide suitable generation orders for different visual synthesis tasks and learn order-aware positional embeddings. Compared to DALL-E, Imagen and Parti, NUWA-Infinity can generate high-resolution images with arbitrary sizes and support long-duration video generation additionally. Compared to NUWA, which also covers images and videos, NUWA-Infinity has superior visual synthesis capabilities in terms of resolution and variable-size generation. The GitHub link is https://github.com/microsoft/NUWA. The homepage link is https://nuwa-infinity.microsoft.com.

cs.CV↗

arXiv2022

Proton momentum and angular momentum decompositions with overlap fermions

We present a calculation of the proton momentum and angular momentum decompositions using overlap fermions on a $2+1$-flavor RBC/UKQCD domain-wall lattice at 0.143 fm with a pion mass of 171 MeV which is close to the physical one. A complete determination of the momentum and angular momentum fractions carried by up, down, strange and glue inside the proton has been done with valence pion masses varying from 171 to 391 MeV. We have utilized fast Fourier transform on the stochastic-sandwich method for connected-insertion parts and the cluster-decomposition error reduction technique for disconnected-insertion parts has been used to reduce statistical errors. The full nonperturbative renormalization and mixing between the quark and glue operators are carried out. The final results are normalized with the momentum and angular momentum sum rules and reported at the physical valence pion mass at ${\overline{\rm {MS}}}\, (μ= 2\ {\rm{GeV}})$. The renormalized momentum fractions for the quarks and glue are $\langle x \rangle^q = 0.491(20)(23)$ and $\langle x \rangle^g = 0.509(20)(23)$, respectively, and the renormalized total angular momentum fractions for quarks and glue are $2 J^q = 0.539(22)(44)$ and $2 J^g = 0.461(22)(44)$, respectively. The quark spin fraction is $Σ= 0.405(25)(37)$ from our previous work and the quark orbital angular momentum fraction is deduced from $2 L^q = 2 J^q - Σ$ to be $0.134(22)(44)$.

hep-lat↗

arXiv2022

Mimic Embedding via Adaptive Aggregation: Learning Generalizable Person Re-identification

Domain generalizable (DG) person re-identification (ReID) aims to test across unseen domains without access to the target domain data at training time, which is a realistic but challenging problem. In contrast to methods assuming an identical model for different domains, Mixture of Experts (MoE) exploits multiple domain-specific networks for leveraging complementary information between domains, obtaining impressive results. However, prior MoE-based DG ReID methods suffer from a large model size with the increase of the number of source domains, and most of them overlook the exploitation of domain-invariant characteristics. To handle the two issues above, this paper presents a new approach called Mimic Embedding via adapTive Aggregation (META) for DG person ReID. To avoid the large model size, experts in META do not adopt a branch network for each source domain but share all the parameters except for the batch normalization layers. Besides multiple experts, META leverages Instance Normalization (IN) and introduces it into a global branch to pursue invariant features across domains. Meanwhile, META considers the relevance of an unseen target sample and source domains via normalization statistics and develops an aggregation module to adaptively integrate multiple experts for mimicking unseen target domain. Benefiting from a proposed consistency loss and an episodic training algorithm, META is expected to mimic embedding for a truly unseen target domain. Extensive experiments verify that META surpasses state-of-the-art DG person ReID methods by a large margin. Our code is available at https://github.com/xbq1994/META.

cs.CV↗

arXiv2022

Finding Diverse and Predictable Subgraphs for Graph Domain Generalization

This paper focuses on out-of-distribution generalization on graphs where performance drops due to the unseen distribution shift. Previous graph domain generalization works always resort to learning an invariant predictor among different source domains. However, they assume sufficient source domains are available during training, posing huge challenges for realistic applications. By contrast, we propose a new graph domain generalization framework, dubbed as DPS, by constructing multiple populations from the source domains. Specifically, DPS aims to discover multiple \textbf{D}iverse and \textbf{P}redictable \textbf{S}ubgraphs with a set of generators, namely, subgraphs are different from each other but all the them share the same semantics with the input graph. These generated source domains are exploited to learn an \textit{equi-predictive} graph neural network (GNN) across domains, which is expected to generalize well to unseen target domains. Generally, DPS is model-agnostic that can be incorporated with various GNN backbones. Extensive experiments on both node-level and graph-level benchmarks shows that the proposed DPS achieves impressive performance for various graph domain generalization tasks.

cs.LG↗

arXiv2022

Heterogeneous Face Recognition via Face Synthesis with Identity-Attribute Disentanglement

Heterogeneous Face Recognition (HFR) aims to match faces across different domains (e.g., visible to near-infrared images), which has been widely applied in authentication and forensics scenarios. However, HFR is a challenging problem because of the large cross-domain discrepancy, limited heterogeneous data pairs, and large variation of facial attributes. To address these challenges, we propose a new HFR method from the perspective of heterogeneous data augmentation, named Face Synthesis with Identity-Attribute Disentanglement (FSIAD). Firstly, the identity-attribute disentanglement (IAD) decouples face images into identity-related representations and identity-unrelated representations (called attributes), and then decreases the correlation between identities and attributes. Secondly, we devise a face synthesis module (FSM) to generate a large number of images with stochastic combinations of disentangled identities and attributes for enriching the attribute diversity of synthetic images. Both the original images and the synthetic ones are utilized to train the HFR network for tackling the challenges and improving the performance of HFR. Extensive experiments on five HFR databases validate that FSIAD obtains superior performance than previous HFR approaches. Particularly, FSIAD obtains 4.8% improvement over state of the art in terms of VR@FAR=0.01% on LAMP-HQ, the largest HFR database so far.

cs.CV↗

arXiv2022

A sentiment analysis model for car review texts based on adversarial training and whole word mask BERT

In the field of car evaluation, more and more netizens choose to express their opinions on the Internet platform, and these comments will affect the decision-making of buyers and the trend of car word-of-mouth. As an important branch of natural language processing (NLP), sentiment analysis provides an effective research method for analyzing the sentiment types of massive car review texts. However, due to the lexical professionalism and large text noise of review texts in the automotive field, when a general sentiment analysis model is applied to car reviews, the accuracy of the model will be poor. To overcome these above challenges, we aim at the sentiment analysis task of car review texts. From the perspective of word vectors, pre-training is carried out by means of whole word mask of proprietary vocabulary in the automotive field, and then training data is carried out through the strategy of an adversarial training set. Based on this, we propose a car review text sentiment analysis model based on adversarial training and whole word mask BERT(ATWWM-BERT).

cs.CL↗

arXiv2022

Collaboration Equilibrium in Federated Learning

Federated learning (FL) refers to the paradigm of learning models over a collaborative research network involving multiple clients without sacrificing privacy. Recently, there have been rising concerns on the distributional discrepancies across different clients, which could even cause counterproductive consequences when collaborating with others. While it is not necessarily that collaborating with all clients will achieve the best performance, in this paper, we study a rational collaboration called ``collaboration equilibrium'' (CE), where smaller collaboration coalitions are formed. Each client collaborates with certain members who maximally improve the model learning and isolates the others who make little contribution. We propose the concept of benefit graph which describes how each client can benefit from collaborating with other clients and advance a Pareto optimization approach to identify the optimal collaborators. Then we theoretically prove that we can reach a CE from the benefit graph through an iterative graph operation. Our framework provides a new way of setting up collaborations in a research network. Experiments on both synthetic and real world data sets are provided to demonstrate the effectiveness of our method.

cs.LG↗

arXiv2022

DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder

Recently most successful image synthesis models are multi stage process to combine the advantages of different methods, which always includes a VAE-like model for faithfully reconstructing embedding to image and a prior model to generate image embedding. At the same time, diffusion models have shown be capacity to generate high-quality synthetic images. Our work proposes a VQ-VAE architecture model with a diffusion decoder (DiVAE) to work as the reconstructing component in image synthesis. We explore how to input image embedding into diffusion model for excellent performance and find that simple modification on diffusion's UNet can achieve it. Training on ImageNet, Our model achieves state-of-the-art results and generates more photorealistic images specifically. In addition, we apply the DiVAE with an Auto-regressive generator on conditional synthesis tasks to perform more human-feeling and detailed samples.

cs.CV↗

arXiv2022

ProxyMix: Proxy-based Mixup Training with Label Refinery for Source-Free Domain Adaptation

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Owing to privacy concerns and heavy data transmission, source-free UDA, exploiting the pre-trained source models instead of the raw source data for target learning, has been gaining popularity in recent years. Some works attempt to recover unseen source domains with generative models, however introducing additional network parameters. Other works propose to fine-tune the source model by pseudo labels, while noisy pseudo labels may misguide the decision boundary, leading to unsatisfied results. To tackle these issues, we propose an effective method named Proxy-based Mixup training with label refinery (ProxyMix). First of all, to avoid additional parameters and explore the information in the source model, ProxyMix defines the weights of the classifier as the class prototypes and then constructs a class-balanced proxy source domain by the nearest neighbors of the prototypes to bridge the unseen source domain and the target domain. To improve the reliability of pseudo labels, we further propose the frequency-weighted aggregation strategy to generate soft pseudo labels for unlabeled target data. The proposed strategy exploits the internal structure of target features, pulls target features to their semantic neighbors, and increases the weights of low-frequency classes samples during gradient updating. With the proxy domain and the reliable pseudo labels, we employ two kinds of mixup regularization, i.e., inter- and intra-domain mixup, in our framework, to align the proxy and the target domain, enforcing the consistency of predictions, thereby further mitigating the negative impacts of noisy labels. Experiments on three 2D image and one 3D point cloud object recognition benchmarks demonstrate that ProxyMix yields state-of-the-art performance for source-free UDA tasks.

cs.CV↗