arXiv subjects

Liang Chen

Publications and source records attributed to Liang Chen.

At least 379 records · Page 21Linked to original sources

arXiv2021

Perceiving and Modeling Density is All You Need for Image Dehazing

In the real world, the degradation of images taken under haze can be quite complex, where the spatial distribution of haze is varied from image to image. Recent methods adopt deep neural networks to recover clean scenes from hazy images directly. However, due to the paradox caused by the variation of real captured haze and the fixed degradation parameters of the current networks, the generalization ability of recent dehazing methods on real-world hazy images is not ideal.To address the problem of modeling real-world haze degradation, we propose to solve this problem by perceiving and modeling density for uneven haze distribution. We propose a novel Separable Hybrid Attention (SHA) module to encode haze density by capturing features in the orthogonal directions to achieve this goal. Moreover, a density map is proposed to model the uneven distribution of the haze explicitly. The density map generates positional encoding in a semi-supervised way. Such a haze density perceiving and modeling capture the unevenly distributed degeneration at the feature level effectively. Through a suitable combination of SHA and density map, we design a novel dehazing network architecture, which achieves a good complexity-performance trade-off. The extensive experiments on two large-scale datasets demonstrate that our method surpasses all state-of-the-art approaches by a large margin both quantitatively and qualitatively, boosting the best published PSNR metric from 28.53 dB to 33.49 dB on the Haze4k test dataset and from 37.17 dB to 38.41 dB on the SOTS indoor test dataset.

cs.CV↗

arXiv2021

Peta-electron volt gamma-ray emission from the Crab Nebula

The Crab pulsar and the surrounding nebula powered by the pulsar's rotational energy through the formation and termination of a relativistic electron-positron wind is a bright source of gamma-rays carrying crucial information about this complex conglomerate. We report the detection of $γ$-rays with a spectrum showing gradual steepening over three energy decades, from $5\times 10^{-4}$ to $1.1$ petaelectronvolt (PeV). The ultra-high-energy photons exhibit the presence of a PeV electron accelerator (a pevatron) with an acceleration rate exceeding 15% of the absolute theoretical limit. Assuming that unpulsed $γ$-rays are produced at the termination of the pulsar's wind, we constrain the pevatron's size, between $0.025$ and $0.1$ pc, and the magnetic field $\approx 110 μ$G. The production rate of PeV electrons, $2.5 \times 10^{36}$ erg $\rm s^{-1}$, constitutes 0.5% of the pulsar's spin-down luminosity, although we do not exclude a non-negligible contribution of PeV protons to the production of the highest energy $γ$-rays.

astro-ph.HE↗

arXiv2021

AutoDebias: Learning to Debias for Recommendation

Recommender systems rely on user behavior data like ratings and clicks to build personalization model. However, the collected data is observational rather than experimental, causing various biases in the data which significantly affect the learned model. Most existing work for recommendation debiasing, such as the inverse propensity scoring and imputation approaches, focuses on one or two specific biases, lacking the universal capacity that can account for mixed or even unknown biases in the data. Towards this research gap, we first analyze the origin of biases from the perspective of \textit{risk discrepancy} that represents the difference between the expectation empirical risk and the true risk. Remarkably, we derive a general learning framework that well summarizes most existing debiasing strategies by specifying some parameters of the general framework. This provides a valuable opportunity to develop a universal solution for debiasing, e.g., by learning the debiasing parameters from data. However, the training data lacks important signal of how the data is biased and what the unbiased data looks like. To move this idea forward, we propose \textit{AotoDebias} that leverages another (small) set of uniform data to optimize the debiasing parameters by solving the bi-level optimization problem with meta-learning. Through theoretical analyses, we derive the generalization bound for AutoDebias and prove its ability to acquire the appropriate debiasing strategy. Extensive experiments on two real datasets and a simulated dataset demonstrated effectiveness of AutoDebias. The code is available at \url{https://github.com/DongHande/AutoDebias}.

cs.LG↗

arXiv2021

Physics-Enforced Modeling for Insertion Loss of Transmission Lines by Deep Neural Networks

In this paper, we investigate data-driven parameterized modeling of insertion loss for transmission lines with respect to design parameters. We first show that direct application of neural networks can lead to non-physics models with negative insertion loss. To mitigate this problem, we propose two deep learning solutions. One solution is to add a regulation term, which represents the passive condition, to the final loss function to enforce the negative quantity of insertion loss. In the second method, a third-order polynomial expression is defined first, which ensures positiveness, to approximate the insertion loss, then DeepONet neural network structure, which was proposed recently for function and system modeling, was employed to model the coefficients of polynomials. The resulting neural network is applied to predict the coefficients of the polynomial expression. The experimental results on an open-sourced SI/PI database of a PCB design show that both methods can ensure the positiveness for the insertion loss. Furthermore, both methods can achieve similar prediction results, while the polynomial-based DeepONet method is faster than DeepONet based method in training time.

cs.LG↗

arXiv2021

SDWNet: A Straight Dilated Network with Wavelet Transformation for Image Deblurring

Image deblurring is a classical computer vision problem that aims to recover a sharp image from a blurred image. To solve this problem, existing methods apply the Encode-Decode architecture to design the complex networks to make a good performance. However, most of these methods use repeated up-sampling and down-sampling structures to expand the receptive field, which results in texture information loss during the sampling process and some of them design the multiple stages that lead to difficulties with convergence. Therefore, our model uses dilated convolution to enable the obtainment of the large receptive field with high spatial resolution. Through making full use of the different receptive fields, our method can achieve better performance. On this basis, we reduce the number of up-sampling and down-sampling and design a simple network structure. Besides, we propose a novel module using the wavelet transform, which effectively helps the network to recover clear high-frequency texture details. Qualitative and quantitative evaluations of real and synthetic datasets show that our deblurring method is comparable to existing algorithms in terms of performance with much lower training requirements. The source code and pre-trained models are available at https://github.com/FlyEgle/SDWNet.

eess.IV↗

arXiv2021

Phonon-laser ultrasensitive force sensor

Developing nano-mechanical oscillators for ultrasensitive force detection is of great importance in exploring science. We report our achievement of ultrasensitive detection of the external force regarding the radio-frequency electric field by a nano-sensor made of a single trapped $^{40}$Ca$^{+}$ ion under injection-locking, where squeezing is additionally applied to detection of the smallest force in the ion trap. The employed ion is confined stably in a surface electrode trap and works as a phonon laser that is very sensitive to the external disturbance. The injection-locking drove the ion's oscillation with phase synchronization, yielding the force detection with sensitivity of 347 $\pm$ 50 yN/$\sqrt{Hz}$. Further with 3 dB squeezing applied on the oscillation phase variance, we achieved a successful detection of the smallest force to be 86.5 $\pm$ 70.1 yN.

quant-ph↗

arXiv2021

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

In this paper, we accomplish a unified convergence analysis of a second-order method of multipliers (i.e., a second-order augmented Lagrangian method) for solving the conventional nonlinear conic optimization problems.Specifically, the algorithm that we investigated incorporates a specially designed nonsmooth (generalized) Newton step to furnish a second-order update rule for the multipliers.We first show in a unified fashion that under a few abstract assumptions, the proposed method is locally convergent and possesses a (nonasymptotic) superlinear convergence rate, even though the penalty parameter is fixed and/or the strict complementarity fails.Subsequently, we demonstrate that, for the three typical scenarios, i.e., the classic nonlinear programming, the nonlinear second-order cone programming, and the nonlinear semidefinite programming, these abstract assumptions are nothing but exactly the implications of the iconic sufficient conditions that were assumed for establishing the Q-linear convergence rates of the method of multipliers without assuming the strict complementarity.

math.OC↗

arXiv2021

Neural Architecture Search based on Cartesian Genetic Programming Coding Method

Neural architecture search (NAS) is a hot topic in the field of automated machine learning and outperforms humans in designing neural architectures on quite a few machine learning tasks. Motivated by the natural representation form of neural networks by the Cartesian genetic programming (CGP), we propose an evolutionary approach of NAS based on CGP, called CGPNAS, to solve sentence classification task. To evolve the architectures under the framework of CGP, the operations such as convolution are identified as the types of function nodes of CGP, and the evolutionary operations are designed based on Evolutionary Strategy. The experimental results show that the searched architectures are comparable with the performance of human-designed architectures. We verify the ability of domain transfer of our evolved architectures. The transfer experimental results show that the accuracy deterioration is lower than 2-5%. Finally, the ablation study identifies the Attention function as the single key function node and the linear transformations along could keep the accuracy similar with the full evolved architectures, which is worthy of investigation in the future.

cs.NE↗

arXiv2021

Understanding Structural Vulnerability in Graph Convolutional Networks

Recent studies have shown that Graph Convolutional Networks (GCNs) are vulnerable to adversarial attacks on the graph structure. Although multiple works have been proposed to improve their robustness against such structural adversarial attacks, the reasons for the success of the attacks remain unclear. In this work, we theoretically and empirically demonstrate that structural adversarial examples can be attributed to the non-robust aggregation scheme (i.e., the weighted mean) of GCNs. Specifically, our analysis takes advantage of the breakdown point which can quantitatively measure the robustness of aggregation schemes. The key insight is that weighted mean, as the basic design of GCNs, has a low breakdown point and its output can be dramatically changed by injecting a single edge. We show that adopting the aggregation scheme with a high breakdown point (e.g., median or trimmed mean) could significantly enhance the robustness of GCNs against structural attacks. Extensive experiments on four real-world datasets demonstrate that such a simple but effective method achieves the best robustness performance compared to state-of-the-art models.

cs.LG↗

arXiv2021

Statistical computation methods for microbiome compositional data network inference

Microbes can affect processes from food production to human health. Such microbes are not isolated, but rather interact with each other and establish connections with their living environments. Understanding these interactions is essential to an understanding of the organization and complex interplay of microbial communities, as well as the structure and dynamics of various ecosystems. A common and essential approach toward this objective involves the inference of microbiome interaction networks. Although network inference methods in other fields have been studied before, applying these methods to estimate microbiome associations based on compositional data will not yield valid results. On the one hand, features of microbiome data such as compositionality, sparsity and high-dimensionality challenge the data normalization and the design of computational methods. On the other hand, several issues like microbial community heterogeneity, external environmental interference and biological concerns also make it more difficult to deal with the network inference. In this paper, we provide a comprehensive review of emerging microbiome interaction network inference methods. According to various assumptions and research targets, estimated networks are divided into four main categories: correlation networks, conditional correlation networks, mixture networks and differential networks. Their scope of applications, advantages and limitations are presented in this review. Since real microbial interactions can be complex and dynamic, no unifying method has captured all the aspects of interest to date. In addition, we discuss the challenges now confronting current microbial associations study and future prospects. Finally, we highlight that the research in microbial network inference requires the joint promotion of statistical computation methods and experimental techniques.

stat.AP↗

arXiv2021

Non-sensitive axis feedback control of test mass in full-maglev vertical superconducting gravity instruments

Non-sensitive axis feedback control is crucial for cross-coupling noise suppression in the application of full-maglev vertical superconducting gravity instruments. This paper introduces the non-sensitive axis feedback control of the test mass in a home-made full-maglev vertical superconducting accelerometer. In the feedback system, special superconducting circuits are designed to decouple and detect the multi-degrees-of-freedom motions of the test mass. Then the decoupled motion signals are dealt with by the PID controller and fed back to the side-wall coils to control the test mass. In our test, the test mass is controlled successfully and the displacement is reduced by about one order of magnitude in the laboratory. Accordingly, the noise level of the vertical superconducting accelerometer in the sensitive axis is also reduced.

physics.ins-det↗

arXiv2021

DGCN: Diversified Recommendation with Graph Convolutional Networks

These years much effort has been devoted to improving the accuracy or relevance of the recommendation system. Diversity, a crucial factor which measures the dissimilarity among the recommended items, received rather little scrutiny. Directly related to user satisfaction, diversification is usually taken into consideration after generating the candidate items. However, this decoupled design of diversification and candidate generation makes the whole system suboptimal. In this paper, we aim at pushing the diversification to the upstream candidate generation stage, with the help of Graph Convolutional Networks (GCN). Although GCN based recommendation algorithms have shown great power in modeling complex collaborative filtering effect to improve the accuracy of recommendation, how diversity changes is ignored in those advanced works. We propose to perform rebalanced neighbor discovering, category-boosted negative sampling and adversarial learning on top of GCN. We conduct extensive experiments on real-world datasets. Experimental results verify the effectiveness of our proposed method on diversification. Further ablation studies validate that our proposed method significantly alleviates the accuracy-diversity dilemma.

cs.IR↗

arXiv2021

A possible blazar spectral irregularity case caused by photon--axionlike-particle oscillations

We report detection of a line-like feature in the $γ$-ray spectrum of the blazar B0516$-$621, for which the data obtained with the Large Area Telescope onboard {\it Fermi Gamma-Ray Space Telescope (Fermi)} are analyzed. The feature is at $\sim$7\,GeV and different analyses are conducted to check its real presence. We determine that it has a significance of 2.5--3.0$σ$, and cautiously note the presence of possible systematics in the data which could reduce the significance. This putative feature is too narrow to be explained with radiation processes generally considered for jet emission of blazars. Instead, it could be a signal due to the oscillations between photons and axion-like particles (ALPs) in the source's jet. We investigate this possibility by fitting the spectrum with the photon-ALP oscillation model, and find that the parameter space of ALP mass $m_a\leq 10^{-8}$\,eV and the coupling constant (between photons and ALPs) $g_{aγ}$=1.16--1.48$\times 10^{-10}$\,GeV$^{-1}$ can provide a fit to the line-like feature, while the magnetic field at the emission site of $γ$-rays is fixed at 0.7\,G. The ranges for $m_a$ and $g_{aγ}$ are in tension with those previously obtained from several experiments or methods, but on the other hand in line with some of the others. This spectral-feature case and its possible indication for ALP existence could be checked from similar studies of other blazar systems and also suggest a direction of effort for building future high-energy facilities that would have high sensitivities and spectral resolutions for searching for similar features.

astro-ph.HE↗

arXiv2021

An Open-channel Microfluidic Membrane Device for In situ Hyperspectral mapping of enzymatic cellulose hydrolysis

Synchrotron infrared hyperspectral microscopy is a label-free and non-invasive technique well suited for imaging of chemical events in situ. It can track the spatial and temporal distributions of molecules of interests in a specimen in its native state by the molecule's characteristic vibrational modes. Despite tremendous progress made in recent years, IR hyperspectral imaging of chemical events in biomaterials in liquids remains challenging because of the demanding requirements on environmental control and strong infrared absorption of water. Here we report a multi-phase capillary-driven membrane device for label-free and real-time investigation of enzymatic deconstruction of algal cellulose purified from Cladophora aegagropila.

physics.bio-ph↗

arXiv2021

Planar Integrated Magneto Optical Trap

Abstract The magneto-optical trap (MOT) is an essential tool for collecting and preparing cold atoms with a wide range of applications. We demonstrate a planar-integrated MOT by combining an optical grating chip with a magnetic coil chip. The flat grating chip simplifies the conventional six-beam configuration down to a single laser beam; the flat coil chip replaces the conventional anti-Helmholtz coils of a cylindrical geometry. We trap 10^{4} cold ^{87}\text{Rb} atoms in the planar-integrated MOT, at a point 3-9 mm above the chip surface. This novel configuration effectively reduces the volume, weight, and complexity of the MOT, bringing benefits to applications including gravimeter, clock and quantum memory devices.

physics.atom-ph↗

arXiv2021

Dynamic State Estimation for Integrated Natural Gas and Electric Power Systems

A dynamic state estimation method of integrated natural gas and electric power systems (IGESs) in proposed. Firstly, the coupling model of gas pipeline networks and power systems by gas turbine units (GTUs) is established. Secondly, the Kalman filter based linear DSE model for the IGES is built. The gas density and mass flow rate, as well as the real and imaginary parts of bus voltages are taken as states, which are predicted by the linearized fluid dynamic equations of gases and exponential smoothing techniques. Boundary conditions of pipeline networks are used as supplementary constraints in the system model. At last, the proposed method is applied to an IGES including a 30-node pipeline network and IEEE 39-bus system coupled by two GTUs. Two indexes are used to evaluate the DSE performance under three measurement error conditions, and the results show that the DSE can obtain the accurate dynamic states in different conditions.

eess.SP↗

arXiv2021

Strong constraints on Lorentz violation using new $γ$-ray observations around PeV

The tiny modification of dispersion relation induced by Lorentz violation (LV) is an essential issue in quantum gravity (QG) theories, which can be magnified into significant effects when dealing with astrophysical observations at high energy and long propagation distance. LV would lead to photon decay at high energies, therefore, observations of high-energy photons could constrain LV or even QG theories. The Large High Altitude Air Shower Observatory (LHAASO) is the most sensitive gamma-array instrument currently operating above 100 TeV. Recently, LHAASO reported the detection of 12 sources above 100 TeV with maximum photon energy exceeding 1 PeV. According to these observations, the most stringent restriction is achieved in this paper, i.e., limiting the LV energy scale to $1.7\times10^{33} $ eV, which is over 139,000 times that of the Planck energy and achieve an improvement of about 1.9 orders of magnitude over previous limits.

astro-ph.HE↗

arXiv2021

Self-supervised Graph Learning for Recommendation

Representation learning on user-item graph for recommendation has evolved from using single ID or interaction history to exploiting higher-order neighbors. This leads to the success of graph convolution networks (GCNs) for recommendation such as PinSage and LightGCN. Despite effectiveness, we argue that they suffer from two limitations: (1) high-degree nodes exert larger impact on the representation learning, deteriorating the recommendations of low-degree (long-tail) items; and (2) representations are vulnerable to noisy interactions, as the neighborhood aggregation scheme further enlarges the impact of observed edges. In this work, we explore self-supervised learning on user-item graph, so as to improve the accuracy and robustness of GCNs for recommendation. The idea is to supplement the classical supervised task of recommendation with an auxiliary self-supervised task, which reinforces node representation learning via self-discrimination. Specifically, we generate multiple views of a node, maximizing the agreement between different views of the same node compared to that of other nodes. We devise three operators to generate the views -- node dropout, edge dropout, and random walk -- that change the graph structure in different manners. We term this new learning paradigm as \textit{Self-supervised Graph Learning} (SGL), implementing it on the state-of-the-art model LightGCN. Through theoretical analyses, we find that SGL has the ability of automatically mining hard negatives. Empirical studies on three benchmark datasets demonstrate the effectiveness of SGL, which improves the recommendation accuracy, especially on long-tail items, and the robustness against interaction noises. Our implementations are available at \url{https://github.com/wujcan/SGL}.

cs.IR↗