arXiv subjects

Liang Li

Publications and source records attributed to Liang Li.

At least 253 records · Page 14Linked to original sources

arXiv2022

Cross-Architecture Knowledge Distillation

Transformer attracts much attention because of its ability to learn global relations and superior performance. In order to achieve higher performance, it is natural to distill complementary knowledge from Transformer to convolutional neural network (CNN). However, most existing knowledge distillation methods only consider homologous-architecture distillation, such as distilling knowledge from CNN to CNN. They may not be suitable when applying to cross-architecture scenarios, such as from Transformer to CNN. To deal with this problem, a novel cross-architecture knowledge distillation method is proposed. Specifically, instead of directly mimicking output/intermediate features of the teacher, partially cross attention projector and group-wise linear projector are introduced to align the student features with the teacher's in two projected feature spaces. And a multi-view robust training scheme is further presented to improve the robustness and stability of the framework. Extensive experiments show that the proposed method outperforms 14 state-of-the-arts on both small-scale and large-scale datasets.

cs.CV↗

arXiv2022

Fast-R2D2: A Pretrained Recursive Neural Network based on Pruned CKY for Grammar Induction and Text Representation

Recently CKY-based models show great potential in unsupervised grammar induction thanks to their human-like encoding paradigm, which runs recursively and hierarchically, but requires $O(n^3)$ time-complexity. Recursive Transformer based on Differentiable Trees (R2D2) makes it possible to scale to large language model pre-training even with complex tree encoder by introducing a heuristic pruning method. However, the rule-based pruning approach suffers from local optimum and slow inference issues. In this paper, we fix those issues in a unified method. We propose to use a top-down parser as a model-based pruning method, which also enables parallel encoding during inference. Typically, our parser casts parsing as a split point scoring task, which first scores all split points for a given sentence, and then recursively splits a span into two by picking a split point with the highest score in the current span. The reverse order of the splits is considered as the order of pruning in R2D2 encoder. Beside the bi-directional language model loss, we also optimize the parser by minimizing the KL distance between tree probabilities from parser and R2D2. Our experiments show that our Fast-R2D2 improves performance significantly in grammar induction and achieves competitive results in downstream classification tasks.

cs.CL↗

arXiv2022

On the X-ray, optical and radio afterglows of the BdHN I GRB 180720B generated by the synchrotron emission

Gamma-ray bursts (GRBs) are systems of unprecedented complexity across all the electromagnetic spectrum, including the radio, optical, X-rays, gamma-rays in the megaelectronvolt (MeV) and gigaelectronvolt (GeV) regime, as well as ultrahigh-energy cosmic rays (UHECRs), each manifested in seven specific physical processes with widely different characteristic evolution timescales ranging from $10^{-14}$ s to $10^{7}$ s or longer. We here study the long GRB 180720B originating from a binary system composed of a massive carbon-oxygen (CO) star of about $10 M_\odot$ and a companion neutron star (NS). The gravitational collapse of the CO star gives rise to a spinning newborn NS ($ν$NS), with an initial period of $P_0=1$ ms that powers the synchrotron radiation in the radio, optical, and X-ray wavelengths. We here only investigate the GRB 180720B afterglows and present a detailed treatment of its origin based on the synchrotron radiation released by the interaction of the $ν$NS and the SN ejecta. We show that in parallel to the X-ray afterglow, the spinning $ν$NS also powers the optical and radio afterglows and allows us to infer the $ν$NS and ejecta parameters that fit the observational data.

astro-ph.HE↗

arXiv2022

Graph-to-Text Generation with Dynamic Structure Pruning

Most graph-to-text works are built on the encoder-decoder framework with cross-attention mechanism. Recent studies have shown that explicitly modeling the input graph structure can significantly improve the performance. However, the vanilla structural encoder cannot capture all specialized information in a single forward pass for all decoding steps, resulting in inaccurate semantic representations. Meanwhile, the input graph is flatted as an unordered sequence in the cross attention, ignoring the original graph structure. As a result, the obtained input graph context vector in the decoder may be flawed. To address these issues, we propose a Structure-Aware Cross-Attention (SACA) mechanism to re-encode the input graph representation conditioning on the newly generated context at each decoding step in a structure aware manner. We further adapt SACA and introduce its variant Dynamic Graph Pruning (DGP) mechanism to dynamically drop irrelevant nodes in the decoding process. We achieve new state-of-the-art results on two graph-to-text datasets, LDC2020T02 and ENT-DESC, with only minor increase on computational cost.

cs.CL↗

arXiv2022

YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications

For years, the YOLO series has been the de facto industry-level standard for efficient object detection. The YOLO community has prospered overwhelmingly to enrich its use in a multitude of hardware platforms and abundant scenarios. In this technical report, we strive to push its limits to the next level, stepping forward with an unwavering mindset for industry application. Considering the diverse requirements for speed and accuracy in the real environment, we extensively examine the up-to-date object detection advancements either from industry or academia. Specifically, we heavily assimilate ideas from recent network design, training strategies, testing techniques, quantization, and optimization methods. On top of this, we integrate our thoughts and practice to build a suite of deployment-ready networks at various scales to accommodate diversified use cases. With the generous permission of YOLO authors, we name it YOLOv6. We also express our warm welcome to users and contributors for further enhancement. For a glimpse of performance, our YOLOv6-N hits 35.9% AP on the COCO dataset at a throughput of 1234 FPS on an NVIDIA Tesla T4 GPU. YOLOv6-S strikes 43.5% AP at 495 FPS, outperforming other mainstream detectors at the same scale~(YOLOv5-S, YOLOX-S, and PPYOLOE-S). Our quantized version of YOLOv6-S even brings a new state-of-the-art 43.3% AP at 869 FPS. Furthermore, YOLOv6-M/L also achieves better accuracy performance (i.e., 49.5%/52.3%) than other detectors with a similar inference speed. We carefully conducted experiments to validate the effectiveness of each component. Our code is made available at https://github.com/meituan/YOLOv6.

cs.CV↗

arXiv2022

EpiGNN: Exploring Spatial Transmission with Graph Neural Network for Regional Epidemic Forecasting

Epidemic forecasting is the key to effective control of epidemic transmission and helps the world mitigate the crisis that threatens public health. To better understand the transmission and evolution of epidemics, we propose EpiGNN, a graph neural network-based model for epidemic forecasting. Specifically, we design a transmission risk encoding module to characterize local and global spatial effects of regions in epidemic processes and incorporate them into the model. Meanwhile, we develop a Region-Aware Graph Learner (RAGL) that takes transmission risk, geographical dependencies, and temporal information into account to better explore spatial-temporal dependencies and makes regions aware of related regions' epidemic situations. The RAGL can also combine with external resources, such as human mobility, to further improve prediction performance. Comprehensive experiments on five real-world epidemic-related datasets (including influenza and COVID-19) demonstrate the effectiveness of our proposed method and show that EpiGNN outperforms state-of-the-art baselines by 9.48% in RMSE.

q-bio.QM↗

arXiv2022

The structure of the ultrarelativistic prompt emission phase and the properties of the black hole in GRB 180720B

In analogy with GRB 190114C, we here analyze the ultrarelativistic prompt emission (UPE) of GRB 180720B observed in the rest-frame time interval $t_{\rm rf}=4.84$--$10.89$~s by Fermi-GBM. We reveal the UPE hierarchical structure from the time-resolved spectral analysis performed in time sub-intervals: the spectrum in each shorter time interval is always fitted by a composite blackbody plus cutoff power-law model. We explain this structure with the \textit{inner engine} of binary-driven hypernova (BdHN) model operating in a quantum electrodynamics (QED) regime. In this regime, the electric field induced by the gravitomagnetic interaction of the newborn Kerr BH with the surrounding magnetic field is overcritical, i.e., $|{\bf E}|\geq E_c$, where $E_c=m_e^2 c^3/(e\hbar)$. The overcritical field polarizes the vacuum leading to an $e^+~e^-$ pair plasma that loads baryons from the surroundings during its expansion. We calculate the dynamics of the self-acceleration of the pair-electromagnetic-baryon (PEMB) pulses to their point of transparency. We characterize the quantum vacuum polarization process in the sequences of decreasing time bins of the UPE by determining the radiation timescale, Lorentz factors, and transparency radius of the PEMB pulses. We also estimate the strength of the surrounding magnetic field $\sim 10^{14}$ G, and obtain a lower limit to the BH mass, $M=2.4~M_\odot$, and correspondingly an upper limit to the spin, $α= 0.6$, from the conditions that the UPE is powered by the Kerr BH extractable energy and its mass is bound from below by the NS critical mass.

astro-ph.HE↗

arXiv2022

Nanoscale three-dimensional magnetic sensing with a probabilistic nanomagnet driven by spin-orbit torque

Detection of vector magnetic fields at nanoscale dimensions is critical in applications ranging from basic material science, to medical diagnostic. Meanwhile, an all-electric operation is of great significance for achieving a simple and compact sensing system. Here, we propose and experimentally demonstrate a simple approach to sensing a vector magnetic field at nanoscale dimensions, by monitoring a probabilistic nanomagnet's transition probability from a metastable state, excited by a driving current due to SOT, to a settled state. We achieve sensitivities for Hx, Hy, and Hz of 1.02%/Oe, 1.09%/Oe and 3.43%/Oe, respectively, with a 200 x 200 nm^2 nanomagnet. The minimum detectable field is dependent on the driving pulse events N, and is expected to be as low as 1 uT if N = 3 x 10^6.

cond-mat.mtrl-sci↗

arXiv2022

Energy and Spectrum Efficient Federated Learning via High-Precision Over-the-Air Computation

Federated learning (FL) enables mobile devices to collaboratively learn a shared prediction model while keeping data locally. However, there are two major research challenges to practically deploy FL over mobile devices: (i) frequent wireless updates of huge size gradients v.s. limited spectrum resources, and (ii) energy-hungry FL communication and local computing during training v.s. battery-constrained mobile devices. To address those challenges, in this paper, we propose a novel multi-bit over-the-air computation (M-AirComp) approach for spectrum-efficient aggregation of local model updates in FL and further present an energy-efficient FL design for mobile devices. Specifically, a high-precision digital modulation scheme is designed and incorporated in the M-AirComp, allowing mobile devices to upload model updates at the selected positions simultaneously in the multi-access channel. Moreover, we theoretically analyze the convergence property of our FL algorithm. Guided by FL convergence analysis, we formulate a joint transmission probability and local computing control optimization, aiming to minimize the overall energy consumption (i.e., iterative local computing + multi-round communications) of mobile devices in FL. Extensive simulation results show that our proposed scheme outperforms existing ones in terms of spectrum utilization, energy efficiency, and learning accuracy.

cs.LG↗

arXiv2022

Impact of tensor force on quantum shell effects in quasifission reactions

Quantum shell effects drive many aspects of many-body quantal systems and their interactions. Among these are the quasifission reactions that impede the formation of a compound nucleus in superheavy element (SHE) searches. Fragment production in quasifission is influenced by shell effects as a nontrivial manifestation of microscopic dynamics hindering the full equilibration of the composite system to form the compound nucleus. In this Letter, we use the microscopic time-dependent Hartree-Fock (TDHF) theory to study 48Ca+249Bk collisions to investigate the influence of the tensor component of the effective nucleon-nucleon interaction. The results show that the inclusion of the tensor force causes the spherical shell effect to become more prominent, particularly for the neutron number yield whose peak is exactly at magic number N = 126. This suggests that the tensor force plays a compelling role in the evolution of dynamical shell effects in nuclear reactions, influencing the competition between spherical and deformed shell gaps.

nucl-th↗

arXiv2022

Relativistic Effects and GRB Polarization in Power-Law Evolution

Despite decades of polarization observations and high-significance polarized $γ$-ray, X-ray, optical, and radio emissions in gamma-ray bursts (GRBs) have been accumulating in dozens of cases, people have yet to find a consistent scenario for understanding the globally observed timing properties of GRB polarization to date. Here, we report that the observed properties of GRB polarization exhibit a four-segment timing evolution at the cosmological distance: (I) an initial hump early on (within the first few seconds); (II) a later on power-law decay (from $\sim$10$^{1}$ to $\sim$10$^{4}$ s), which takes the form of $π_{\rm obs} \propto t^{-0.50 \pm 0.02}$; (III) afterwards a late-time rebrightening hump (from $\sim$10$^{4}$ to $\sim$10$^{5}$ s); and (IV) finally a flatting power-law decay (from $\sim$ 10$^{5}$ to $\sim$ 10$^{7}$ s), with the the form of $π_{\rm obs} \propto t^{-0.21 \pm 0.08}$. These findings may present a challenge to the mainstream of polarization models that assume the polarization time evolution change in different emission regions. We show that these results can be explained by relativistic and geometric effects of a highly relativistic and magnetized jet generated by the central engine, and "magnetic patches" distributed as a globally random but locally coherent form. Our analysis suggests that there is a single dominant mechanism that might account for the global observational properties of GRB polarization, and other emission mechanisms and effects might play a role in spatially local and temporally short effects on GRB polarization.

astro-ph.HE↗

arXiv2022

Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression Grounding

Weakly supervised Referring Expression Grounding (REG) aims to ground a particular target in an image described by a language expression while lacking the correspondence between target and expression. Two main problems exist in weakly supervised REG. First, the lack of region-level annotations introduces ambiguities between proposals and queries. Second, most previous weakly supervised REG methods ignore the discriminative location and context of the referent, causing difficulties in distinguishing the target from other same-category objects. To address the above challenges, we design an entity-enhanced adaptive reconstruction network (EARN). Specifically, EARN includes three modules: entity enhancement, adaptive grounding, and collaborative reconstruction. In entity enhancement, we calculate semantic similarity as supervision to select the candidate proposals. Adaptive grounding calculates the ranking score of candidate proposals upon subject, location and context with hierarchical attention. Collaborative reconstruction measures the ranking result from three perspectives: adaptive reconstruction, language reconstruction and attribute classification. The adaptive mechanism helps to alleviate the variance of different referring expressions. Experiments on five datasets show EARN outperforms existing state-of-the-art methods. Qualitative results demonstrate that the proposed EARN can better handle the situation where multiple objects of a particular category are situated together.

cs.CV↗

arXiv2022

Model order reduction for parameterized electromagnetic problems using matrix decomposition and deep neural networks

A non-intrusive model order reduction (MOR) method for solving parameterized electromagnetic scattering problems is proposed in this paper. A database collecting snapshots of high-fidelity solutions is built by solving the parameterized time-domain Maxwell equations for some values of the material parameters using a fullwave solver based on a high order discontinuous Galerkin time-domain (DGTD) method. To perform a prior dimensionality reduction, a set of reduced basis (RB) functions are extracted from the database via a two-step proper orthogonal decomposition (POD) method. Projection coefficients of the reduced basis functions are further compressed through a convolutional autoencoder (CAE) network. Singular value decomposition (SVD) is then used to extract the principal components of the reduced-order matrices generated by CAE, and a cubic spline interpolation-based (CSI) approach is employed for approximating the dominating time- and parameter-modes of the reduced-order matrices. The generation of the reduced basis and the training of the CAE and CSI are accomplished in the offline stage, thus the RB solution for given time/parameter values can be quickly recovered via outputs of the interpolation model and decoder network. In particular, the offline and online stages of the proposed RB method are completely decoupled, which ensures the validity of the method. The performance of the proposed CAE-CSI ROM is illustrated with numerical experiments for scattering of a plane wave by a 2-D dielectric disk and a multi-layer heterogeneous medium.

math.NA↗

arXiv2022

DSPNet: Towards Slimmable Pretrained Networks based on Discriminative Self-supervised Learning

Self-supervised learning (SSL) has achieved promising downstream performance. However, when facing various resource budgets in real-world applications, it costs a huge computation burden to pretrain multiple networks of various sizes one by one. In this paper, we propose Discriminative-SSL-based Slimmable Pretrained Networks (DSPNet), which can be trained at once and then slimmed to multiple sub-networks of various sizes, each of which faithfully learns good representation and can serve as good initialization for downstream tasks with various resource budgets. Specifically, we extend the idea of slimmable networks to a discriminative SSL paradigm, by integrating SSL and knowledge distillation gracefully. We show comparable or improved performance of DSPNet on ImageNet to the networks individually pretrained one by one under the linear evaluation and semi-supervised evaluation protocols, while reducing large training cost. The pretrained models also generalize well on downstream detection and segmentation tasks. Code will be made public.

cs.CV↗

arXiv2022

Multiple Kernel Clustering with Dual Noise Minimization

Clustering is a representative unsupervised method widely applied in multi-modal and multi-view scenarios. Multiple kernel clustering (MKC) aims to group data by integrating complementary information from base kernels. As a representative, late fusion MKC first decomposes the kernels into orthogonal partition matrices, then learns a consensus one from them, achieving promising performance recently. However, these methods fail to consider the noise inside the partition matrix, preventing further improvement of clustering performance. We discover that the noise can be disassembled into separable dual parts, i.e. N-noise and C-noise (Null space noise and Column space noise). In this paper, we rigorously define dual noise and propose a novel parameter-free MKC algorithm by minimizing them. To solve the resultant optimization problem, we design an efficient two-step iterative strategy. To our best knowledge, it is the first time to investigate dual noise within the partition in the kernel space. We observe that dual noise will pollute the block diagonal structures and incur the degeneration of clustering performance, and C-noise exhibits stronger destruction than N-noise. Owing to our efficient mechanism to minimize dual noise, the proposed algorithm surpasses the recent methods by large margins.

cs.LG↗

arXiv2022

GRB 190829A -- A Showcase of Binary Late Evolution

GRB 190829A is the fourth closest gamma-ray burst (GRB) to date ($z=0.0785$). Owing to its wide range of radio, optical, X-ray, and the very-high-energy (VHE) observations by H.E.S.S., it has become an essential new source examined by various models with complementary approaches. We here show in GRB 190829A the double-prompt pulses and the three-multiwavelength afterglows are consistent with the type II binary-driven hypernova (BdHN II) model. The progenitor is a binary composed of a carbon-oxygen (CO) star and a neutron star (NS) companion. The gravitational collapse of the iron core of the CO star produces a supernova (SN) explosion and leaves behind a new neutron star ($ν$NS) at its center. The accretion of the SN ejecta onto the NS companion and onto the $ν$NS via matter fallback spins up the NSs and produces the double-peak prompt emission. The synchrotron emission from the expanding SN ejecta with the energy injection from the rapidly spinning $ν$NS and its subsequently spin-down leads to the afterglow in the radio, optical, and X-ray. We model the sequence of physical and related radiation processes in BdHNe and focus on individuating the binary properties that play the relevant roles.

astro-ph.HE↗

arXiv2022

Adaptive Structural Similarity Preserving for Unsupervised Cross Modal Hashing

Cross-modal hashing is an important approach for multimodal data management and application. Existing unsupervised cross-modal hashing algorithms mainly rely on data features in pre-trained models to mine their similarity relationships. However, their optimization objectives are based on the static metric between the original uni-modal features, without further exploring data correlations during the training. In addition, most of them mainly focus on association mining and alignment among pairwise instances in continuous space but ignore the latent structural correlations contained in the semantic hashing space. In this paper, we propose an unsupervised hash learning framework, namely Adaptive Structural Similarity Preservation Hashing (ASSPH), to solve the above problems. Firstly, we propose an adaptive learning scheme, with limited data and training batches, to enrich semantic correlations of unlabeled instances during the training process and meanwhile to ensure a smooth convergence of the training process. Secondly, we present an asymmetric structural semantic representation learning scheme. We introduce structural semantic metrics based on graph adjacency relations during the semantic reconstruction and correlation mining stage and meanwhile align the structure semantics in the hash space with an asymmetric binary optimization process. Finally, we conduct extensive experiments to validate the enhancements of our work in comparison with existing works.

cs.IR↗

arXiv2022

Local Sample-weighted Multiple Kernel Clustering with Consensus Discriminative Graph

Multiple kernel clustering (MKC) is committed to achieving optimal information fusion from a set of base kernels. Constructing precise and local kernel matrices is proved to be of vital significance in applications since the unreliable distant-distance similarity estimation would degrade clustering per-formance. Although existing localized MKC algorithms exhibit improved performance compared to globally-designed competi-tors, most of them widely adopt KNN mechanism to localize kernel matrix by accounting for τ -nearest neighbors. However, such a coarse manner follows an unreasonable strategy that the ranking importance of different neighbors is equal, which is impractical in applications. To alleviate such problems, this paper proposes a novel local sample-weighted multiple kernel clustering (LSWMKC) model. We first construct a consensus discriminative affinity graph in kernel space, revealing the latent local structures. Further, an optimal neighborhood kernel for the learned affinity graph is output with naturally sparse property and clear block diagonal structure. Moreover, LSWMKC im-plicitly optimizes adaptive weights on different neighbors with corresponding samples. Experimental results demonstrate that our LSWMKC possesses better local manifold representation and outperforms existing kernel or graph-based clustering algo-rithms. The source code of LSWMKC can be publicly accessed from https://github.com/liliangnudt/LSWMKC.

cs.LG↗