arXiv subjects

Liang Li

Publications and source records attributed to Liang Li.

At least 271 records · Page 15Linked to original sources

arXiv2022

An inequality regarding non-radiative linear waves via a geometric method

In this work we consider the operator \[ (\mathbf{T} G) (x)= \int_{\mathbb{S}^2} G(x\cdot ω, ω) dω, \quad x\in \mathbb{R}^3, \; G\in L^2(\mathbb{R}\times \mathbb{S}^2). \] This is the adjoint operator of the Radon transform. We manage to give an optimal $L^6$ decay estimate of $\mathbf{T} G$ near the infinity by a geometric method, if the function $G$ is compactly supported. As an application we give decay estimate of non-radiative solutions to the 3D linear wave equation in the exterior region $\{(x,t)\in \mathbb{R}^3 \times \mathbb{R}: |x|>R+|t|\}$. This kind of decay estimate is useful in the channel of energy method for wave equations

math.AP↗

arXiv2022

Radiation fields and non-radiative solutions to the energy sub-critical wave equations

Radiation field and channel of energy method have become important tools in the study of nonlinear wave equations in recent years. In this work we give basic theory of radiation fields of free waves in the energy sub-critical case. We also show that the asymptotic behaviours of non-radiative solutions to a wide range of non-linear wave equations resemble those of non-radiative free waves. Our theory is completely given in the critical Sobolev spaces of the corresponding nonlinear wave equation and avoids any assumption on the energy of the solutions.

math.AP↗

arXiv2022

Automatic Relation-aware Graph Network Proliferation

Graph neural architecture search has sparked much attention as Graph Neural Networks (GNNs) have shown powerful reasoning capability in many relational tasks. However, the currently used graph search space overemphasizes learning node features and neglects mining hierarchical relational information. Moreover, due to diverse mechanisms in the message passing, the graph search space is much larger than that of CNNs. This hinders the straightforward application of classical search strategies for exploring complicated graph search space. We propose Automatic Relation-aware Graph Network Proliferation (ARGNP) for efficiently searching GNNs with a relation-guided message passing mechanism. Specifically, we first devise a novel dual relation-aware graph search space that comprises both node and relation learning operations. These operations can extract hierarchical node/relational information and provide anisotropic guidance for message passing on a graph. Second, analogous to cell proliferation, we design a network proliferation search paradigm to progressively determine the GNN architectures by iteratively performing network division and differentiation. The experiments on six datasets for four graph learning tasks demonstrate that GNNs produced by our method are superior to the current state-of-the-art hand-crafted and search-based GNNs. Codes are available at https://github.com/phython96/ARGNP.

cs.LG↗

arXiv2022

FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset

We present FaceVerse, a fine-grained 3D Neural Face Model, which is built from hybrid East Asian face datasets containing 60K fused RGB-D images and 2K high-fidelity 3D head scan models. A novel coarse-to-fine structure is proposed to take better advantage of our hybrid dataset. In the coarse module, we generate a base parametric model from large-scale RGB-D images, which is able to predict accurate rough 3D face models in different genders, ages, etc. Then in the fine module, a conditional StyleGAN architecture trained with high-fidelity scan models is introduced to enrich elaborate facial geometric and texture details. Note that different from previous methods, our base and detailed modules are both changeable, which enables an innovative application of adjusting both the basic attributes and the facial details of 3D face models. Furthermore, we propose a single-image fitting framework based on differentiable rendering. Rich experiments show that our method outperforms the state-of-the-art methods.

cs.CV↗

arXiv2022

Ultrahigh ion diffusion in oxide crystal by engineering the interfacial transporter channels

The mass storage and removal in solid conductors always played vital role on the technological applications such as modern batteries, permeation membranes and neuronal computations, which were seriously lying on the ion diffusion and kinetics in bulk lattice. However, the ions transport was kinetically limited by the low diffusional process, which made it a challenge to fabricate applicable conductors with high electronic and ionic conductivities at room temperature. It was known that at essentially all interfaces, the existed space charge layers could modify the charge transport, storage and transfer properties. Thus, in the current study, we proposed an acid solution/WO3/ITO structure and achieved an ultrafast hydrogen transport in WO3 layer by interfacial job-sharing diffusion. In this sandwich structure, the transport pathways of the protons and electrons were spatially separated in acid solution and ITO layer respectively, resulting the pronounced increasing of effective hydrogen diffusion coefficient (Deff) up to 106 times. The experiment and theory simulations also revealed that this accelerated hydrogen transport based on the interfacial job-sharing diffusion was universal and could be extended to other ions and oxide materials as well, which would potentially stimulate systematic studies on ultrafast mixed conductors or faster solid-state electrochemical switching devices in the future.

cond-mat.mtrl-sci↗

arXiv2022

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

Federated learning (FL) is a popular collaborative distributed machine learning paradigm across mobile devices. However, practical FL over resource constrained mobile devices confronts multiple challenges, e.g., the local on-device training and model updates in FL are power hungry and radio resource intensive for mobile devices. To address these challenges, in this paper, we attempt to take FL into the design of future wireless networks and develop a novel joint design of wireless transmission and weight quantization for energy efficient FL over mobile devices. Specifically, we develop flexible weight quantization schemes to facilitate on-device local training over heterogeneous mobile devices. Based on the observation that the energy consumption of local computing is comparable to that of model updates, we formulate the energy efficient FL problem into a mixed-integer programming problem where the quantization and spectrum resource allocation strategies are jointly determined for heterogeneous mobile devices to minimize the overall FL energy consumption (computation + transmissions) while guaranteeing model performance and training latency. Since the optimization variables of the problem are strongly coupled, an efficient iterative algorithm is proposed, where the bandwidth allocation and weight quantization levels are derived. Extensive simulations are conducted to verify the effectiveness of the proposed scheme.

cs.NI↗

arXiv2022

Adaptive actuation of magnetic soft robots using deep reinforcement learning

Magnetic soft robots have attracted growing interest due to their unique advantages in terms of untethered actuation and excellent controllability. However, finding the required magnetization patterns or magnetic fields to achieve the desired functions of these robots is quite challenging in many cases. No unified framework for design has been proposed yet, and existing methods mainly rely on manual heuristics, which are hard to satisfy the high complexity level of the desired robotic motion. Here, we develop an intelligent method to solve the related inverse-design problems, implemented by introducing a novel simulation platform for magnetic soft robots based on Cosserat rod models and a deep reinforcement learning framework based on TD3. We demonstrate that magnetic soft robots with different magnetization patterns can learn to move without human guidance in simulations, and effective magnetic fields can be autonomously generated that can then be applied directly to real magnetic soft robots in an open-loop way.

cs.RO↗

arXiv2022

Superconductivity in the nodal-line compound La$_3$Pt$_3$Bi$_4$

Owing to the specific topological states in nodal-line semimetals, novel topological superconductivity is expected to emerge in these systems. In this letter, by combination of the first-principles calculations and resistivity, susceptibility and specific heat measurements, we demonstrate that La$_3$Pt$_3$Bi$_4$ is a topologically nontrivial nodal-ring semimetal protected by the gliding-mirror symmetry even in the presence of spin-orbit coupling. Meanwhile, we discover bulk superconductivity with a transition temperature of $\sim$1.1 K, and an upper critical field of $\sim$0.41 T. These findings demonstrate that La$_3$Pt$_3$Bi$_4$ provides a material platform for studying novel superconductivity in the nodal-ring system.

cond-mat.supr-con↗

arXiv2022

Unsupervised Coherent Video Cartoonization with Perceptual Motion Consistency

In recent years, creative content generations like style transfer and neural photo editing have attracted more and more attention. Among these, cartoonization of real-world scenes has promising applications in entertainment and industry. Different from image translations focusing on improving the style effect of generated images, video cartoonization has additional requirements on the temporal consistency. In this paper, we propose a spatially-adaptive semantic alignment framework with perceptual motion consistency for coherent video cartoonization in an unsupervised manner. The semantic alignment module is designed to restore deformation of semantic structure caused by spatial information lost in the encoder-decoder architecture. Furthermore, we devise the spatio-temporal correlative map as a style-independent, global-aware regularization on the perceptual motion consistency. Deriving from similarity measurement of high-level features in photo and cartoon frames, it captures global semantic information beyond raw pixel-value in optical flow. Besides, the similarity measurement disentangles temporal relationships from domain-specific style properties, which helps regularize the temporal consistency without hurting style effects of cartoon images. Qualitative and quantitative experiments demonstrate our method is able to generate highly stylistic and temporal consistent cartoon videos.

cs.CV↗

arXiv2022

IR-GAN: Image Manipulation with Linguistic Instruction by Increment Reasoning

Conditional image generation is an active research topic including text2image and image translation. Recently image manipulation with linguistic instruction brings new challenges of multimodal conditional generation. However, traditional conditional image generation models mainly focus on generating high-quality and visually realistic images, and lack resolving the partial consistency between image and instruction. To address this issue, we propose an Increment Reasoning Generative Adversarial Network (IR-GAN), which aims to reason the consistency between visual increment in images and semantic increment in instructions. First, we introduce the word-level and instruction-level instruction encoders to learn user's intention from history-correlated instructions as semantic increment. Second, we embed the representation of semantic increment into that of source image for generating target image, where source image plays the role of referring auxiliary. Finally, we propose a reasoning discriminator to measure the consistency between visual increment and semantic increment, which purifies user's intention and guarantees the good logic of generated target image. Extensive experiments and visualization conducted on two datasets show the effectiveness of IR-GAN.

cs.CV↗

arXiv2022

Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignment

Training a generative adversarial network (GAN) with limited data has been a challenging task. A feasible solution is to start with a GAN well-trained on a large scale source domain and adapt it to the target domain with a few samples, termed as few shot generative model adaption. However, existing methods are prone to model overfitting and collapse in extremely few shot setting (less than 10). To solve this problem, we propose a relaxed spatial structural alignment method to calibrate the target generative models during the adaption. We design a cross-domain spatial structural consistency loss comprising the self-correlation and disturbance correlation consistency loss. It helps align the spatial structural information between the synthesis image pairs of the source and target domains. To relax the cross-domain alignment, we compress the original latent space of generative models to a subspace. Image pairs generated from the subspace are pulled closer. Qualitative and quantitative experiments show that our method consistently surpasses the state-of-the-art methods in few shot setting.

cs.CV↗

arXiv2022

Open-Vocabulary One-Stage Detection with Hierarchical Visual-Language Knowledge Distillation

Open-vocabulary object detection aims to detect novel object categories beyond the training set. The advanced open-vocabulary two-stage detectors employ instance-level visual-to-visual knowledge distillation to align the visual space of the detector with the semantic space of the Pre-trained Visual-Language Model (PVLM). However, in the more efficient one-stage detector, the absence of class-agnostic object proposals hinders the knowledge distillation on unseen objects, leading to severe performance degradation. In this paper, we propose a hierarchical visual-language knowledge distillation method, i.e., HierKD, for open-vocabulary one-stage detection. Specifically, a global-level knowledge distillation is explored to transfer the knowledge of unseen categories from the PVLM to the detector. Moreover, we combine the proposed global-level knowledge distillation and the common instance-level knowledge distillation to learn the knowledge of seen and unseen categories simultaneously. Extensive experiments on MS-COCO show that our method significantly surpasses the previous best one-stage detector with 11.9\% and 6.7\% $AP_{50}$ gains under the zero-shot detection and generalized zero-shot detection settings, and reduces the $AP_{50}$ performance gap from 14\% to 7.3\% compared to the best two-stage detector.

cs.CV↗

arXiv2022

Standard GRB Spectral Models "Misused"?

The standard model characterizing the gamma-ray burst (GRB) spectrum invokes a four-parameter empirical function, the so-called the BAND model. An alternative model named cutoff power law (COMP) implements a power law with an exponential cutoff. These functions achieve almost equally good fits on observed spectra, and are adopted in nearly all of the GRB literature. Here, we reanalyze the sample defined in Li.et al.,2021,ApJS,254,35 (39 bursts including 944 spectra). We classify the spectra by two methods: (1) checking their corner-corner plots of the posteriors to determine well-constrained $β$ (BAND-better) and unconstrained $β$ (COMP-better) categories; and (2) defining the four groups by difference of the deviance information criterion (DIC). We find inconsistent peaks of the parameter distributions between the BAND-better spectra ($α=-0.64\pm0.28$ and $\rm log_{10}(E_{\rm p})=\rm log_{10}(191)\pm0.41$) and the COMP-better spectra ($α=-0.96\pm0.33$ and $\rm log_{10}(E_{\rm p})=\rm log_{10}(249)\pm0.40$). With the statistically preferred model and vice versa the misused model defined based on DIC statistics, we also find that the fitted parameters obtained by the misused model (COMP) significantly deviate from those obtained by the statistically preferred model (BAND). This means that if a spectrum is statistically preferred, described as the BAND, applying COMP to derive the spectral parameters will prominently deviate from their intrinsic shape, therefore affecting the physical interpretation. Our analysis indicates that the better or statistically preferred model should be duly examined during GRB spectral analysis. In addition, the $β$ distribution exhibits a bimodal structure containing the BAND-better and COMP-better spectra, respectively, implying that BAND and COMP both may have physical origin.

hep-ph↗

arXiv2022

Debiased Batch Normalization via Gaussian Process for Generalizable Person Re-Identification

Generalizable person re-identification aims to learn a model with only several labeled source domains that can perform well on unseen domains. Without access to the unseen domain, the feature statistics of the batch normalization (BN) layer learned from a limited number of source domains is doubtlessly biased for unseen domain. This would mislead the feature representation learning for unseen domain and deteriorate the generalizaiton ability of the model. In this paper, we propose a novel Debiased Batch Normalization via Gaussian Process approach (GDNorm) for generalizable person re-identification, which models the feature statistic estimation from BN layers as a dynamically self-refining Gaussian process to alleviate the bias to unseen domain for improving the generalization. Specifically, we establish a lightweight model with multiple set of domain-specific BN layers to capture the discriminability of individual source domain, and learn the corresponding parameters of the domain-specific BN layers. These parameters of different source domains are employed to deduce a Gaussian process. We randomly sample several paths from this Gaussian process served as the BN estimations of potential new domains outside of existing source domains, which can further optimize these learned parameters from source domains, and estimate more accurate Gaussian process by them in return, tending to real data distribution. Even without a large number of source domains, GDNorm can still provide debiased BN estimation by using the mean path of the Gaussian process, while maintaining low computational cost during testing. Extensive experiments demonstrate that our GDNorm effectively improves the generalization ability of the model on unseen domain.

cs.CV↗

arXiv2022

Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification

RGB-infrared person re-identification is an emerging cross-modality re-identification task, which is very challenging due to significant modality discrepancy between RGB and infrared images. In this work, we propose a novel modality-adaptive mixup and invariant decomposition (MID) approach for RGB-infrared person re-identification towards learning modality-invariant and discriminative representations. MID designs a modality-adaptive mixup scheme to generate suitable mixed modality images between RGB and infrared images for mitigating the inherent modality discrepancy at the pixel-level. It formulates modality mixup procedure as Markov decision process, where an actor-critic agent learns dynamical and local linear interpolation policy between different regions of cross-modality images under a deep reinforcement learning framework. Such policy guarantees modality-invariance in a more continuous latent space and avoids manifold intrusion by the corrupted mixed modality samples. Moreover, to further counter modality discrepancy and enforce invariant visual semantics at the feature-level, MID employs modality-adaptive convolution decomposition to disassemble a regular convolution layer into modality-specific basis layers and a modality-shared coefficient layer. Extensive experimental results on two challenging benchmarks demonstrate superior performance of MID over state-of-the-art methods.

cs.CV↗

arXiv2022

Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking

Tracking visual objects from a single initial exemplar in the testing phase has been broadly cast as a one-/few-shot problem, i.e., one-shot learning for initial adaptation and few-shot learning for online adaptation. The recent few-shot online adaptation methods incorporate the prior knowledge from large amounts of annotated training data via complex meta-learning optimization in the offline phase. This helps the online deep trackers to achieve fast adaptation and reduce overfitting risk in tracking. In this paper, we propose a simple yet effective recursive least-squares estimator-aided online learning approach for few-shot online adaptation without requiring offline training. It allows an in-built memory retention mechanism for the model to remember the knowledge about the object seen before, and thus the seen data can be safely removed from training. This also bears certain similarities to the emerging continual learning field in preventing catastrophic forgetting. This mechanism enables us to unveil the power of modern online deep trackers without incurring too much extra computational cost. We evaluate our approach based on two networks in the online learning families for tracking, i.e., multi-layer perceptrons in RT-MDNet and convolutional neural networks in DiMP. The consistent improvements on several challenging tracking benchmarks demonstrate its effectiveness and efficiency.

cs.CV↗

arXiv2022

Fingerprint of the Interbond Electron Hopping in Second-Order Harmonic Generation

We experimentally explore the fingerprint of the microscopic electron dynamics in second-order harmonic generation (SHG). It is shown that the interbond electron hopping induces a novel source of nonlinear polarization and plays an important role even when the driving laser intensity is 2 orders of magnitude lower than the characteristic atomic field. Our model predicts anomalous anisotropic structures of the SHG yield contributed by the interbond electron hopping, which is identified in our experiments with ZnO crystals. Moreover, a generalized second-order susceptibility with an explicit form is proposed, which provides a unified description in both the weak and strong field regimes. Our work reveals the nonlinear responses of materials at the electron scale and extends the nonlinear optics to a previously unexplored regime, where the nonlinearity related to the interbond electron hopping becomes dominant. It paves the way for realizing controllable nonlinearity on an ultrafast time scale.

physics.optics↗

arXiv2022

The concentration of zero-noise limits of invariant measures for stochastic dynamical systems

In this paper, we study concentration phenomena of zero-noise limits of invariant measures for stochastic differential equations defined on $\mathbb{R}^d$ with locally Lipschitz continuous coefficients and more than one ergodic state. Under some dissipative conditions, by using Lyapunov-like functions and large deviations methods, we estimate the invariant measures in neighborhoods of stable sets, neighborhoods of unstable sets and their complement, respectively. Our result illustrates that invariant measures concentrate on the intersection of stable sets where a cost functional $W(K_i)$ is minimized and the Birkhoff center of the corresponding deterministic systems as noise tends down to zero. Furthermore, we prove the large deviations principle of invariant measures. At the end of this paper, we provide some explicit examples and their numerical simulations.

math.PR↗