arXiv subjects

Liang Li

Publications and source records attributed to Liang Li.

At least 235 records · Page 13Linked to original sources

arXiv2023

CATS: A Pragmatic Chinese Answer-to-Sequence Dataset with Large Scale and High Quality

There are three problems existing in the popular data-to-text datasets. First, the large-scale datasets either contain noise or lack real application scenarios. Second, the datasets close to real applications are relatively small in size. Last, current datasets bias in the English language while leaving other languages underexplored. To alleviate these limitations, in this paper, we present CATS, a pragmatic Chinese answer-to-sequence dataset with large scale and high quality. The dataset aims to generate textual descriptions for the answer in the practical TableQA system. Further, to bridge the structural gap between the input SQL and table and establish better semantic alignments, we propose a Unified Graph Transformation approach to establish a joint encoding space for the two hybrid knowledge resources and convert this task to a graph-to-text problem. The experiment results demonstrate the effectiveness of our proposed method. Further analysis on CATS attests to both the high quality and challenges of the dataset.

cs.CL↗

arXiv2023

An absolutely convergent fixed-point fast sweeping WENO method on triangular meshes for steady state of hyperbolic conservation laws

High order fast sweeping methods for efficiently solving steady state solutions of hyperbolic PDEs were not available yet on unstructured meshes. In this paper, we extend high order fast sweeping methods to unstructured triangular meshes by applying fixed-point iterative sweeping techniques to a fifth-order finite volume unstructured WENO scheme, for solving steady state solutions of hyperbolic conservation laws. An advantage of fixed-point fast sweeping methods which distinguishes them from other fast sweeping methods is that they are explicit and do not require inverse operation of nonlinear local systems. As in the first order fast sweeping methods on triangular meshes, we introduce multiple reference points to determine alternating sweeping directions on unstructured meshes. All the cells on the mesh are ordered according to their centroids' distances to those reference points, and the resulted orderings provide sweeping directions for iterations. To make the residue of the fast sweeping iterations converge to machine zero / round off errors, we follow the approach in our early work of developing the absolutely convergent fixed-point fast sweeping WENO methods on rectangular meshes, and adopt high order WENO scheme with unequal-sized sub-stencils for spatial discretization. Extensive numerical experiments are performed to show the accuracy, computational efficiency, and absolute convergence of the presented fifth-order fast sweeping scheme on triangular meshes. Furthermore, the proposed method is compared with the forward Euler method and the popular third order total variation diminishing Rung-Kutta method for steady state computations. Numerical examples show that the developed fixed-point fast sweeping WENO method is the most efficient scheme among them, and especially it can save up to 70% CPU time costs than TVD-RK3 to converge to steady state solutions.

math.NA↗

arXiv2023

High Harmonic Generation in Solids: Particle and Wave Perspectives

High harmonic generation (HHG) from gas phase atoms (or molecules) has opened up a new frontier in ultrafast optics, where attosecond time resolution and Angstrom spatial resolution are accessible. The fundamental physical pictures of HHG are always explained by the laser-induced recollision of particle-like electron motion, which lay the foundation of attosecond spectroscopy. In recent years, HHG has also been observed in solids. One can expect the extension of attosecond spectroscopy to the condensed matter if a description capable of resolving ultrafast dynamics is provided. Thus, a large number of theoretical studies have been proposed to understand the underlying physics of HHG. Here, we revisit the recollision picture in solid HHG and show some challenges of current methods with particle perspective, and present the recently developed wave perspective Huygens-Fresnel picture in understanding dynamical systems within the ambit of strong-field physics.

physics.optics↗

arXiv2023

Improving Semiconductor Device Modeling for Electronic Design Automation by Machine Learning Techniques

The semiconductors industry benefits greatly from the integration of Machine Learning (ML)-based techniques in Technology Computer-Aided Design (TCAD) methods. The performance of ML models however relies heavily on the quality and quantity of training datasets. They can be particularly difficult to obtain in the semiconductor industry due to the complexity and expense of the device fabrication. In this paper, we propose a self-augmentation strategy for improving ML-based device modeling using variational autoencoder-based techniques. These techniques require a small number of experimental data points and does not rely on TCAD tools. To demonstrate the effectiveness of our approach, we apply it to a deep neural network-based prediction task for the Ohmic resistance value in Gallium Nitride devices. A 70% reduction in mean absolute error when predicting experimental results is achieved. The inherent flexibility of our approach allows easy adaptation to various tasks, thus making it highly relevant to many applications of the semiconductor industry.

cs.LG↗

arXiv2023

Learning to Dub Movies via Hierarchical Prosody Models

Given a piece of text, a video clip and a reference audio, the movie dubbing (also known as visual voice clone V2C) task aims to generate speeches that match the speaker's emotion presented in the video using the desired speaker voice as reference. V2C is more challenging than conventional text-to-speech tasks as it additionally requires the generated speech to exactly match the varying emotions and speaking speed presented in the video. Unlike previous works, we propose a novel movie dubbing architecture to tackle these problems via hierarchical prosody modelling, which bridges the visual information to corresponding speech prosody from three aspects: lip, face, and scene. Specifically, we align lip movement to the speech duration, and convey facial expression to speech energy and pitch via attention mechanism based on valence and arousal representations inspired by recent psychology findings. Moreover, we design an emotion booster to capture the atmosphere from global video scenes. All these embeddings together are used to generate mel-spectrogram and then convert to speech waves via existing vocoder. Extensive experimental results on the Chem and V2C benchmark datasets demonstrate the favorable performance of the proposed method. The source code and trained models will be released to the public.

cs.CL↗

arXiv2023

Recent Progress and Next Steps for the MATHUSLA LLP Detector

We report on recent progress and next steps in the design of the proposed MATHUSLA Long Lived Particle (LLP) detector for the HL-LHC as part of the Snowmass 2021 process. Our understanding of backgrounds has greatly improved, aided by detailed simulation studies, and significant R&D has been performed on designing the scintillator detectors and understanding their performance. The collaboration is on track to complete a Technical Design Report, and there are many opportunities for interested new members to contribute towards the goal of designing and constructing MATHUSLA in time for HL-LHC collisions, which would increase the sensitivity to a large variety of highly motivated LLP signals by orders of magnitude.

hep-ex↗

arXiv2023

Protective Self-Adaptive Pruning to Better Compress DNNs

Adaptive network pruning approach has recently drawn significant attention due to its excellent capability to identify the importance and redundancy of layers and filters and customize a suitable pruning solution. However, it remains unsatisfactory since current adaptive pruning methods rely mostly on an additional monitor to score layer and filter importance, and thus faces high complexity and weak interpretability. To tackle these issues, we have deeply researched the weight reconstruction process in iterative prune-train process and propose a Protective Self-Adaptive Pruning (PSAP) method. First of all, PSAP can utilize its own information, weight sparsity ratio, to adaptively adjust pruning ratio of layers before each pruning step. Moreover, we propose a protective reconstruction mechanism to prevent important filters from being pruned through supervising gradients and to avoid unrecoverable information loss as well. Our PSAP is handy and explicit because it merely depends on weights and gradients of model itself, instead of requiring an additional monitor as in early works. Experiments on ImageNet and CIFAR-10 also demonstrate its superiority to current works in both accuracy and compression ratio, especially for compressing with a high ratio or pruning from scratch.

cs.CV↗

arXiv2023

Revisiting the Spectral-Energy Correlations of GRBs with {\it Fermi} Data I: Model-wise Properties

Gamma-ray bursts (GRBs) exhibit a diversity of spectra. Several spectral models (e.g., Band, cutoff power-law, and blackbody) and their hybrid versions (e.g., Band+blackbody) have been widely used to fit the observed GRB spectra. Here, we attempt to collect all the bursts detected by {\it Fermi}-GBM with known redshifts from July 2008 to May 2022, motivated to (i) provide a parameter catalog independent from the official \emph{Fermi}/GBM team and (ii) achieve a ``clean" model-based GRB spectral-energy correlation analysis. A nearly complete GRB sample was created, containing 153 such bursts (136 long gamma-ray bursts and 17 short gamma-ray bursts). Using the sample and by performing detailed spectral analysis and model comparisons, we investigate two GRB spectral-energy correlations: the cosmological rest-frame peak energy ($E_{\rm p,z}$) of the $νF_ν$ prompt emission spectrum correlated with (i) the isotropic-bolometric-equivalent emission energy $E_{γ, \rm iso}$ (the Amati relation), and (ii) the isotropic-bolometric-equivalent peak luminosity $L_{\rm p, iso}$ (the Yonetoku relation). From a linear regression analysis, a tight correlation between $E_{\rm p,z}$ and $E_{γ, \rm iso}$ (and $L_{γ,\rm iso}$) is found for both the Band-like and CPL-like bursts. More interestingly, the CPL-like bursts do not fall on the Band-like burst Amati and Yonetoku correlations, suggesting distinct radiation processes, and pointing towards the fact that these spectral-energy correlations are tightly reliant on the model-wise properties.

astro-ph.HE↗

arXiv2023

Neighborhood Contrastive Transformer for Change Captioning

Change captioning is to describe the semantic change between a pair of similar images in natural language. It is more challenging than general image captioning, because it requires capturing fine-grained change information while being immune to irrelevant viewpoint changes, and solving syntax ambiguity in change descriptions. In this paper, we propose a neighborhood contrastive transformer to improve the model's perceiving ability for various changes under different scenes and cognition ability for complex syntax structure. Concretely, we first design a neighboring feature aggregating to integrate neighboring context into each feature, which helps quickly locate the inconspicuous changes under the guidance of conspicuous referents. Then, we devise a common feature distilling to compare two images at neighborhood level and extract common properties from each image, so as to learn effective contrastive information between them. Finally, we introduce the explicit dependencies between words to calibrate the transformer decoder, which helps better understand complex syntax structure during training. Extensive experimental results demonstrate that the proposed method achieves the state-of-the-art performance on three public datasets with different change scenarios. The code is available at https://github.com/tuyunbin/NCT.

cs.CV↗

arXiv2023

Age of Information of CSMA/CA Based Wireless Networks

We consider a wireless network where N nodes compete for a shared channel over the CSMA/CA protocol to deliver observed updates to a common remote monitor. For this network, we rate the information freshness of the CSMA/CA based network using the age of information (AoI). Different from previous work, the network we consider is unsaturated. To theoretically analyze the transmission behavior of the CSMA/CA based network, we, therefore, develop an equivalent and tractable Markov transmission model. Based on this newly developed model, the transmission probability, collision probability and average AoI of the network are obtained. Our numerical results show that as the packet rate and the number of nodes increase, both the transmission probability and collision probability are increasing; the average AoI first decreases and then increases as the packet rate increases and increases with the number of nodes.

cs.IT↗

arXiv2023

Plan-then-Seam: Towards Efficient Table-to-Text Generation

Table-to-text generation aims at automatically generating text to help people conveniently obtain salient information in tables. Recent works explicitly decompose the generation process into content planning and surface generation stages, employing two autoregressive networks for them respectively. However, they are computationally expensive due to the non-parallelizable nature of autoregressive decoding and the redundant parameters of two networks. In this paper, we propose the first totally non-autoregressive table-to-text model (Plan-then-Seam, PTS) that produces its outputs in parallel with one single network. PTS firstly writes and calibrates one plan of the content to be generated with a novel rethinking pointer predictor, and then takes the plan as the context for seaming to decode the description. These two steps share parameters and perform iteratively to capture token inter-dependency while keeping parallel decoding. Experiments on two public benchmarks show that PTS achieves 3.0~5.6 times speedup for inference time, reducing 50% parameters, while maintaining as least comparable performance against strong two-stage table-to-text competitors.

cs.CL↗

arXiv2023

A Cosmological Fireball with Sixteen-Percent Gamma-Ray Radiative Efficiency

Gamma-ray bursts (GRBs) are the most powerful explosions in the universe. How efficiently the jet converts its energy to radiation is a long-standing problem and it is poorly constrained. The standard model invokes a relativistic fireball with a bright photosphere emission component. A definitive diagnosis of GRB radiation components and measurement of GRB radiative efficiency require prompt emission and afterglow data with high-resolution and wide-band coverage in time and energy. Here we report a comprehensive temporal and spectral analysis of the TeV-emitting bright GRB 190114C. Its fluence is one of the highest of all GRBs detected so far, which allows us to perform a high-resolution study of the prompt emission spectral properties and their temporal evolution down to a timescale of about 0.1 s. We observe that each of the initial pulses has a thermal component contributing $\sim20\%$ of the total energy, the corresponding temperature and the inferred Lorentz factor of the photosphere evolve following broken power-law shapes. From the observation of the non-thermal spectra and the light curve, the onset of afterglow corresponding to the deceleration of the fireball is considered at $\sim 6$~s. By incorporating the thermal and the non-thermal observations, as well as the photosphere and the synchrotron radiative mechanisms, we can directly derive the fireball energy budget with little dependence on hypothetical parameters and to measure a $\sim 16\%$ radiative efficiency for this GRB. With the fireball energy budget derived, the afterglow microphysics parameters can also be constrained directly from the data.

astro-ph.HE↗

arXiv2023

A simple cognitive model explains movement decisions during schooling in zebrafish

While moving, animals must frequently make decisions about their future travel direction, whether they are alone or in a group. Here we investigate this process for zebrafish (Danio rerio), which naturally move in cohesive groups. Employing state-of-the-art virtual reality, we study how real fish follow one or several moving, virtual conspecifics. These data are used to inform, and test, a model of social response that includes a process of explicit decision-making, whereby the fish can decide which of the virtual conspecifics to follow, or to follow some average direction. This approach is in contrast with previous models where the direction of motion was based on a continuous computation, such as directional averaging. Building upon a simplified version of this model [Sridhar et al. 2021], which was limited to a one-dimensional projection of the fish motion, we present here a model that describes the motion of the real fish as it swims freely in two-dimensions. Motivated by experimental observations, the swim speed of the fish in this model uses a burst-and-coast swimming pattern, with the burst frequency being dependent on the distance of the fish from the followed conspecific(s). We demonstrate that this model is able to explain the observed spatial distribution of the real fish behind the virtual conspecifics in the experiments. In particular, the model naturally explains the observed critical bifurcations for a freely swimming fish, whenever the fish makes a decision to follow only one of the virtual conspecifics, instead of following them as an averaged group. This model can provide the foundation for modeling a cohesive shoal of swimming fish, while explicitly describing their directional decision-making process at the individual level

physics.bio-ph↗

arXiv2023

Hard Sample Aware Network for Contrastive Deep Graph Clustering

Contrastive deep graph clustering, which aims to divide nodes into disjoint groups via contrastive mechanisms, is a challenging research spot. Among the recent works, hard sample mining-based algorithms have achieved great attention for their promising performance. However, we find that the existing hard sample mining methods have two problems as follows. 1) In the hardness measurement, the important structural information is overlooked for similarity calculation, degrading the representativeness of the selected hard negative samples. 2) Previous works merely focus on the hard negative sample pairs while neglecting the hard positive sample pairs. Nevertheless, samples within the same cluster but with low similarity should also be carefully learned. To solve the problems, we propose a novel contrastive deep graph clustering method dubbed Hard Sample Aware Network (HSAN) by introducing a comprehensive similarity measure criterion and a general dynamic sample weighing strategy. Concretely, in our algorithm, the similarities between samples are calculated by considering both the attribute embeddings and the structure embeddings, better revealing sample relationships and assisting hardness measurement. Moreover, under the guidance of the carefully collected high-confidence clustering information, our proposed weight modulating function will first recognize the positive and negative samples and then dynamically up-weight the hard sample pairs while down-weighting the easy ones. In this way, our method can mine not only the hard negative samples but also the hard positive sample, thus improving the discriminative capability of the samples further. Extensive experiments and analyses demonstrate the superiority and effectiveness of our proposed method.

cs.LG↗

arXiv2023

Meta-Learning PAC-Bayes Priors in Model Averaging

Nowadays model uncertainty has become one of the most important problems in both academia and industry. In this paper, we mainly consider the scenario in which we have a common model set used for model averaging instead of selecting a single final model via a model selection procedure to account for this model's uncertainty to improve the reliability and accuracy of inferences. Here one main challenge is to learn the prior over the model set. To tackle this problem, we propose two data-based algorithms to get proper priors for model averaging. One is for meta-learner, the analysts should use historical similar tasks to extract the information about the prior. The other one is for base-learner, a subsampling method is used to deal with the data step by step. Theoretically, an upper bound of risk for our algorithm is presented to guarantee the performance of the worst situation. In practice, both methods perform well in simulations and real data studies, especially with poor-quality data.

cs.LG↗

arXiv2023

The phonon thermal Hall angle in black phosphorus

The origin of phonon thermal Hall Effect (THE) observed in a variety of insulators is yet to be identified. Here, we report on the observation of a thermal Hall conductivity in a non-magnetic elemental insulator, with an amplitude exceeding what has been previously observed. In black phosphorus (BP), the longitudinal ($κ_{ii}$), and the transverse, $κ_{ij}$, thermal conductivities peak at the same temperature and at this peak temperature, the $κ_{ij}/κ_{jj}/B $ is $\approx 10^{-4}$-$10^{-3}$ T$^{-1}$. Both these features are shared by other insulators displaying THE, despite an absolute amplitude spreading over three orders of magnitude. The absence of correlation between the thermal Hall angle and the phonon mean-free-path imposes a severe constraint for theoretical scenarios of THE. We show that in BP a longitudinal and a transverse acoustic phonon mode anti-cross, facilitating wave-like transport across modes and the anisotropic charge distribution surrounding atomic bonds, paving the way for coupling with magnetic field.

cond-mat.str-el↗

arXiv2022

Classification of radial non-radiative solutions to the 5D nonlinear wave equations

In this work we classify all radial non-radiative solutions to the 5D nonlinear wave equations with a wide range of energy critical nonlinearity. We show that such a solution always comes with two characteristic numbers. These characteristic numbers can be determined by either the radiation profile of the initial data or the asymptotic behaviour of the solution. In addition, two radial weakly non-radiative solutions with the same characteristic numbers must coincide with each other in the overlap part of their exterior regions. Finally we give a few applications of our theory on the global behaviours of solutions to the nonlinear wave equations.

math.AP↗

arXiv2022

BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Images

Accurate localization ability is fundamental in autonomous driving. Traditional visual localization frameworks approach the semantic map-matching problem with geometric models, which rely on complex parameter tuning and thus hinder large-scale deployment. In this paper, we propose BEV-Locator: an end-to-end visual semantic localization neural network using multi-view camera images. Specifically, a visual BEV (Birds-Eye-View) encoder extracts and flattens the multi-view images into BEV space. While the semantic map features are structurally embedded as map queries sequence. Then a cross-model transformer associates the BEV features and semantic map queries. The localization information of ego-car is recursively queried out by cross-attention modules. Finally, the ego pose can be inferred by decoding the transformer outputs. We evaluate the proposed method in large-scale nuScenes and Qcraft datasets. The experimental results show that the BEV-locator is capable to estimate the vehicle poses under versatile scenarios, which effectively associates the cross-model information from multi-view images and global semantic maps. The experiments report satisfactory accuracy with mean absolute errors of 0.052m, 0.135m and 0.251$^\circ$ in lateral, longitudinal translation and heading angle degree.

cs.CV↗