arXiv subjects

Jun Li

Publications and source records attributed to Jun Li.

At least 577 records · Page 32Linked to original sources

arXiv2022

CompleteDT: Point Cloud Completion with Dense Augment Inference Transformers

Point cloud completion task aims to predict the missing part of incomplete point clouds and generate complete point clouds with details. In this paper, we propose a novel point cloud completion network, namely CompleteDT. Specifically, features are learned from point clouds with different resolutions, which is sampled from the incomplete input, and are converted to a series of \textit{spots} based on the geometrical structure. Then, the Dense Relation Augment Module (DRA) based on the transformer is proposed to learn features within \textit{spots} and consider the correlation among these \textit{spots}. The DRA consists of Point Local-Attention Module (PLA) and Point Dense Multi-Scale Attention Module (PDMA), where the PLA captures the local information within the local \textit{spots} by adaptively measuring weights of neighbors and the PDMA exploits the global relationship between these \textit{spots} in a multi-scale densely connected manner. Lastly, the complete shape is predicted from \textit{spots} by the Multi-resolution Point Fusion Module (MPF), which gradually generates complete point clouds from \textit{spots}, and updates \textit{spots} based on these generated point clouds. Experimental results show that, because the DRA based on the transformer can learn the expressive features from the incomplete input and the MPF can fully explore these feature to predict the complete input, our method largely outperforms the state-of-the-art methods.

cs.CV↗

arXiv2022

A Method for Self-Service Rehabilitation Training of Human Lower Limbs

In recent years, the research of rehabilitation robot technology has become a hotspot in the field of rehabilitation medicine engineering and robotics. To assist active rehabilitation in patients with unilateral lower extremity injury, we propose a new self-service rehabilitation training method to control the injured lower extremity through its contralateral healthy upper limbs. Firstly, the movement data of upper limbs and lower limbs of healthy people in normal walking state are obtained by gait measurement experiment. Secondly, the eigenvectors of upper limb and lower limb movements in a single movement cycle are extracted respectively. Thirdly, the linear mapping relationship between the upper limbs movement and the lower limbs movement is identified using the least squares method. Finally, the simulation experiment of self-service rehabilitation training is implemented on MATLAB/Simulink. The results indicate that the identified linear mapping model can achieve good accuracy and adaptability. The self-service rehabilitation training method is effective for helping patients with unilateral limb injury to make rehabilitation training on themselves.

cs.RO↗

arXiv2022

Accelerating Grasp Learning via Pretraining with Coarse Affordance Maps of Objects

Self-supervised grasp learning, i.e., learning to grasp by trial and error, has made great progress. However, it is still time-consuming to train such a model and also a challenge to apply it in practice. This work presents an accelerating method of robotic grasp learning via pretraining with coarse affordance maps of objects to be grasped based on a quite small dataset. A model generated through pre-training is harnessed as an initialization policy to warmly start grasp learning so as to guide a robot to capture more effective rewards at the beginning of training. An object in its coarse affordance map is annotated with a single key point and thereby, the burden of labeling is greatly alleviated. Extensive experiments in simulation and on a real robot are conducted to evaluate the proposed method. The simulation results show that it can significantly accelerate grasp learning by nearly three times over a vanilla Deep Q-Network -based method. Its test on a real UR3 robot shows that it reaches a grasp success rate of 89.5% via only 500 times of grasp tries within about two hours, which is four times faster than its competitor. In addition, it enjoys an outstanding generalization ability to grasp prior-unseen novel objects. It outperforms some existing methods and has the potential to directly apply to a robot for real-world grasp learning tasks.

cs.RO↗

arXiv2022

A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Model

This paper studies the cooperative learning of two generative flow models, in which the two models are iteratively updated based on the jointly synthesized examples. The first flow model is a normalizing flow that transforms an initial simple density to a target density by applying a sequence of invertible transformations. The second flow model is a Langevin flow that runs finite steps of gradient-based MCMC toward an energy-based model. We start from proposing a generative framework that trains an energy-based model with a normalizing flow as an amortized sampler to initialize the MCMC chains of the energy-based model. In each learning iteration, we generate synthesized examples by using a normalizing flow initialization followed by a short-run Langevin flow revision toward the current energy-based model. Then we treat the synthesized examples as fair samples from the energy-based model and update the model parameters with the maximum likelihood learning gradient, while the normalizing flow directly learns from the synthesized examples by maximizing the tractable likelihood. Under the short-run non-mixing MCMC scenario, the estimation of the energy-based model is shown to follow the perturbation of maximum likelihood, and the short-run Langevin flow and the normalizing flow form a two-flow generator that we call CoopFlow. We provide an understating of the CoopFlow algorithm by information geometry and show that it is a valid generator as it converges to a moment matching estimator. We demonstrate that the trained CoopFlow is capable of synthesizing realistic images, reconstructing images, and interpolating between images.

stat.ML↗

arXiv2022

Squeezed light generated with hyperradiance without nonlinearity

We propose that the squeezed light accompanied by hyperradiance is induced by quantum interference in a linear system consisting of a high quality optical cavity and two coherently driven two-level qubits. When two qubits are placed at the crest and trough of the standing wave in the cavity respectively (i.e., they have the opposite coupling coefficient to the cavity), we show that squeezed light is generated in the hyperradiance regime under the conditions of strong coupling and weak driving. Simultaneously, the Klyshko's criterion alternates up and down at unity when the photon number is even or odd. Moreover, the orthogonal angles of the squeezed light can be controlled by adjusting the frequency detuning pressure between the driving field and the qubits. It can be implemented in a variety of quantum systems, including but not limited to two-level systems such as atoms, quantum dots in single-mode cavities.

quant-ph↗

arXiv2022

CoDo: Contrastive Learning with Downstream Background Invariance for Detection

The prior self-supervised learning researches mainly select image-level instance discrimination as pretext task. It achieves a fantastic classification performance that is comparable to supervised learning methods. However, with degraded transfer performance on downstream tasks such as object detection. To bridge the performance gap, we propose a novel object-level self-supervised learning method, called Contrastive learning with Downstream background invariance (CoDo). The pretext task is converted to focus on instance location modeling for various backgrounds, especially for downstream datasets. The ability of background invariance is considered vital for object detection. Firstly, a data augmentation strategy is proposed to paste the instances onto background images, and then jitter the bounding box to involve background information. Secondly, we implement architecture alignment between our pretraining network and the mainstream detection pipelines. Thirdly, hierarchical and multi views contrastive learning is designed to improve performance of visual representation learning. Experiments on MSCOCO demonstrate that the proposed CoDo with common backbones, ResNet50-FPN, yields strong transfer learning results for object detection.

cs.CV↗

arXiv2022

Towards a Larger Molecular Simulation on the Quantum Computer: Up to 28 Qubits Systems Accelerated by Point Group Symmetry

The exact evaluation of the molecular ground state in quantum chemistry requires an exponentially increasing computational cost. Quantum computation is a promising way to overcome the exponential problem using polynomial-time quantum algorithms. A quantum-classical hybrid optimization scheme known as the variational quantum eigensolver(VQE) is preferred for noisy intermediate-scale quantum devices. However, the circuit depth becomes one of the bottlenecks of its application to large molecules of more than 20 qubits. In this work, we employ the point group symmetry to reduce the number of operators in constructing ansatz so as to achieve a more compact quantum circuit. We illustrate this methodology with a series of molecules ranging from LiH(12 qubits) to C2H4(28 qubits). A significant reduction of up to 82% of the operator numbers is reached on C2H4, which enables the largest molecule ever numerically simulated by VQE-UCC to the best of our knowledge. This also shed light into the further work of this direction to construct even shallower ansatz with enough expressive power and simulate even larger scale system.

quant-ph↗

arXiv2022

Robust quantum control for the manipulation of solid-state spins

Robust and high-fidelity control of electron spins in solids is the cornerstone for facilitating applications of solid-state spins in quantum information processing and quantum sensing. However, precise control of spin systems is always challenging due to the presence of a variety of noises originating from the environment and control fields. Herein, noise-resilient quantum gates, designed with robust optimal control (ROC) algorithms, are demonstrated experimentally with nitrogen-vacancy (NV) centers in diamond to realize tailored robustness against detunings and Rabi errors simultaneously. In the presence of both 10% off-resonant detuning and deviation of a Rabi frequency, we achieve an average single-qubit gate fidelity of up to 99.97%. Our experiments also show that, ROCbased multipulse quantum sensing sequences can suppress spurious responses resulting from finite widths and imperfections of microwave pulses, which provides an efficient strategy for enhancing the performance of existing multipulse quantum sensing sequences.

quant-ph↗

arXiv2022

Quantum Control for Time-dependent Noise by Inverse Geometric Optimization

Quantum systems are exceedingly difficult to engineer because they are sensitive to various types of noises. In particular, time-dependent noises are frequently encountered in experiments but how to overcome them remains a challenging problem. In this work, we extend and apply the recently proposed robust control technique of inverse geometric optimization to time-dependent noises by working it in the filter-function formalism. The basic idea is to parameterize the control filter function geometrically and minimize its overlap with the noise spectral density. This then effectively reduces the noise susceptibility of the controlled system evolution. We show that the proposed method can produce high-quality robust pulses for realizing desired quantum evolutions under realistic noise models, and thus will find practical applications for current physical platforms.

quant-ph↗

arXiv2022

Dynamic Registration: Joint Ego Motion Estimation and 3D Moving Object Detection in Dynamic Environment

Localization in a dynamic environment suffers from moving objects. Removing dynamic object is crucial in this situation but become tricky when ego-motion is coupled. In this paper, instead of proposing a new slam framework, we aim at a more general strategy for a localization scenario. In that case, Dynamic Registration is available for integrating with any lidar slam system. We utilize 3D object detection to obtain potential moving objects and remove them temporarily. Then we proposed Dynamic Registration, to iteratively estimate ego-motion and segment moving objects until no static object generates. Static objects are merged with the environment. Finally, we successfully segment dynamic objects, static environments with static objects, and ego-motion estimation in a dynamic environment. We evaluate the performance of our proposed method on KITTI Tracking datasets. Results show stable and consistent improvements based on other classical registration algorithms.

cs.RO↗

arXiv2022

Faithful coherent states

We propose the notion of faithful coherent states based on the fidelity-based coherence witness. The criterion for detecting faithful coherent states can be restricted to a subclass of fidelity-based criterion under unitary transformations for single and bipartite systems. We can realize these unitary transformations by using quantum gates and circuits, and establish the connection of faithful coherence states and coherence distillation, maximum relative entropy of coherence.

quant-ph↗

arXiv2022

Measuring the primordial gravitational waves from cosmic microwave background and stochastic gravitational wave background observations

We constrain the primordial gravitational waves from cosmic microwave background (CMB) and stochastic gravitational wave background (SGWB) observations. SGWB provides the latest way to explore the early universe and the cosmological evolution which can be reflected by primordial gravitational waves. We not only combine LIGO observations with CMB to measure primordial gravitational waves, but also forecast the potential abilities of the LISA detector and PTA projects. In the $Λ$CDM+$r$+$n_t$ model, the standard six parameters change slightly from SGWB observations. While the constraints on tensor-to-scalar ratio and tensor spectral index are improved obviously from SGWB observations. FAST projects have a significant impact on tensor-to-scalar ratio and tensor spectral index, namely $r<0.028$ and $n_t=-0.41^{+0.64}_{-0.96}$ at $95\%$ confidence level.

astro-ph.CO↗

arXiv2022

Nested Collaborative Learning for Long-Tailed Visual Recognition

The networks trained on the long-tailed dataset vary remarkably, despite the same training settings, which shows the great uncertainty in long-tailed learning. To alleviate the uncertainty, we propose a Nested Collaborative Learning (NCL), which tackles the problem by collaboratively learning multiple experts together. NCL consists of two core components, namely Nested Individual Learning (NIL) and Nested Balanced Online Distillation (NBOD), which focus on the individual supervised learning for each single expert and the knowledge transferring among multiple experts, respectively. To learn representations more thoroughly, both NIL and NBOD are formulated in a nested way, in which the learning is conducted on not just all categories from a full perspective but some hard categories from a partial perspective. Regarding the learning in the partial perspective, we specifically select the negative categories with high predicted scores as the hard categories by using a proposed Hard Category Mining (HCM). In the NCL, the learning from two perspectives is nested, highly related and complementary, and helps the network to capture not only global and robust features but also meticulous distinguishing ability. Moreover, self-supervision is further utilized for feature enhancement. Extensive experiments manifest the superiority of our method with outperforming the state-of-the-art whether by using a single model or an ensemble.

cs.CV↗

arXiv2022

Almost global smooth solutions of the 3D quasilinear Klein-Gordon equations on the product space $\mathbb{R}^{2}\times \mathbb{T}$

In the paper, for the 3D quasilinear Klein-Gordon equation with the small initial data posed on the product space $\mathbb{R}^{2}\times \mathbb{T}$, we focus on the lower bound of the lifespan of the smooth solution. When the size of initial data is bounded by $\varepsilon_0>0$, by the space-time resonance method, it is shown that smooth solution exists up to the time $e^{c_{0}/\varepsilon_{0}^2}$ with $\varepsilon_0$ being sufficiently small and $c_0>0$ being some suitable constant.

math.AP↗

arXiv2022

On the blowup mechanism of smooth solutions to 1D quasilinear strictly hyperbolic systems with large initial data

For the first order 1D $n\times n$ quasilinear strictly hyperbolic system $\partial_tu+F(u)\partial_xu=0$ with $u(x, 0)=\varepsilon u_0(x)$, where $\varepsilon>0$ is small, $u_0(x)\not\equiv 0$ and $u_0(x)\in C_0^2(\mathbb R)$, when at least one eigenvalue of $F(u)$ is genuinely nonlinear, it is well-known that on the finite blowup time $T_{\varepsilon}$, the derivatives $\partial_{t,x}u$ blow up while the solution $u$ keeps to be small. For the 1D scalar equation or $2\times 2$ strictly hyperbolic system (corresponding to $n=1, 2$), if the smooth solution $u$ blows up in finite time, then the blowup mechanism can be well understood (i.e., only the blowup of $\partial_{t,x}u$ happens). In the present paper, for the $n\times n$ ($n\geq 3$) strictly hyperbolic system with a class of large initial data, we are concerned with the blowup mechanism of smooth solution $u$ on the finite blowup time and the detailed singularity behaviours of $\partial_{t,x}u$ near the blowup point. Our results are based on the efficient decomposition of $u$ along the different characteristic directions, the suitable introduction of the modulated coordinates and the global weighted energy estimates.

math.AP↗

arXiv2022

Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives

In recent years, supervised learning has been widely used in various tasks of optical remote sensing image understanding, including remote sensing image classification, pixel-wise segmentation, change detection, and object detection. The methods based on supervised learning need a large amount of high-quality training data and their performance highly depends on the quality of the labels. However, in practical remote sensing applications, it is often expensive and time-consuming to obtain large-scale data sets with high-quality labels, which leads to a lack of sufficient supervised information. In some cases, only coarse-grained labels can be obtained, resulting in the lack of exact supervision. In addition, the supervised information obtained manually may be wrong, resulting in a lack of accurate supervision. Therefore, remote sensing image understanding often faces the problems of incomplete, inexact, and inaccurate supervised information, which will affect the breadth and depth of remote sensing applications. In order to solve the above-mentioned problems, researchers have explored various tasks in remote sensing image understanding under weak supervision. This paper summarizes the research progress of weakly supervised learning in the field of remote sensing, including three typical weakly supervised paradigms: 1) Incomplete supervision, where only a subset of training data is labeled; 2) Inexact supervision, where only coarse-grained labels of training data are given; 3) Inaccurate supervision, where the labels given are not always true on the ground.

cs.CV↗

arXiv2022

Performance Analysis of Wireless Network Aided by Discrete-Phase-Shifter IRS

Discrete phase shifters of intelligent reflecting surface (IRS) generates phase quantization error (QE) and degrades the receive performance at the receiver. To make an analysis of the performance loss caused by IRS with phase QE, based on the law of large numbers, the closed-form expressions of signal-to-noise ratio (SNR) performance loss (PL), achievable rate (AR), and bit error rate (BER) are successively derived under line-of-sight (LoS) channels and Rayleigh channels. Moreover, based on the Taylor series expansion, the approximate simple closed form of PL of IRS with approximate QE is also given. The simulation results show that the performance losses of SNR and AR decrease as the number of quantization bits increase, while they gradually increase with the number of IRS phase shifter elements increase. Regardless of LoS channels or Rayleigh channels, when the number of quantization bits is larger than or equal to 3, the performance losses of SNR and AR are less than 0.23dB and 0.08bits/s/Hz, respectively, and the BER performance degradation is trivial. In particular, the performance loss difference between IRS with QE and IRS with approximate QE is negligible when the number of quantization bits is not less than 2.

cs.IT↗

arXiv2022

Elevation Angle-Dependent 3D Trajectory Design for Aerial RIS-aided Communication

This paper investigates an aerial reconfigurable intelligent surface (RIS)-aided communication system under the probabilistic line-of-sight (LoS) channel, where an unmanned aerial vehicle (UAV) equipped with an RIS is deployed to assist two ground nodes in their information exchange. An optimization problem with the objective of maximizing the minimum average achievable rate is formulated to jointly design the communication scheduling, the RIS's phase shift, and the three-dimensional (3D) UAV trajectory. To solve such a non-convex problem, we propose an efficient iterative algorithm to obtain its suboptimal solution. Simulation results show that our proposed design significantly outperforms the existing schemes and provides new insights into the elevation angle and distance trade-off for the UAV-borne RIS communication system.

eess.SP↗