arXiv subjects

Jun Li

Publications and source records attributed to Jun Li.

At least 595 records · Page 33Linked to original sources

arXiv2022

A3CLNN: Spatial, Spectral and Multiscale Attention ConvLSTM Neural Network for Multisource Remote Sensing Data Classification

The problem of effectively exploiting the information multiple data sources has become a relevant but challenging research topic in remote sensing. In this paper, we propose a new approach to exploit the complementarity of two data sources: hyperspectral images (HSIs) and light detection and ranging (LiDAR) data. Specifically, we develop a new dual-channel spatial, spectral and multiscale attention convolutional long short-term memory neural network (called dual-channel A3CLNN) for feature extraction and classification of multisource remote sensing data. Spatial, spectral and multiscale attention mechanisms are first designed for HSI and LiDAR data in order to learn spectral- and spatial-enhanced feature representations, and to represent multiscale information for different classes. In the designed fusion network, a novel composite attention learning mechanism (combined with a three-level fusion strategy) is used to fully integrate the features in these two data sources. Finally, inspired by the idea of transfer learning, a novel stepwise training strategy is designed to yield a final classification result. Our experimental results, conducted on several multisource remote sensing data sets, demonstrate that the newly proposed dual-channel A3CLNN exhibits better feature representation ability (leading to more competitive classification performance) than other state-of-the-art methods.

cs.CV↗

arXiv2022

MC-UNet Multi-module Concatenation based on U-shape Network for Retinal Blood Vessels Segmentation

Accurate segmentation of the blood vessels of the retina is an important step in clinical diagnosis of ophthalmic diseases. Many deep learning frameworks have come up for retinal blood vessels segmentation tasks. However, the complex vascular structure and uncertain pathological features make the blood vessel segmentation still very challenging. A novel U-shaped network named Multi-module Concatenation which is based on Atrous convolution and multi-kernel pooling is put forward to retinal vessels segmentation in this paper. The proposed network structure retains three layers the essential structure of U-Net, in which the atrous convolution combining the multi-kernel pooling blocks are designed to obtain more contextual information. The spatial attention module is concatenated with dense atrous convolution module and multi-kernel pooling module to form a multi-module concatenation. And different dilation rates are selected by cascading to acquire a larger receptive field in atrous convolution. Adequate comparative experiments are conducted on these public retinal datasets: DRIVE, STARE and CHASE_DB1. The results show that the proposed method is effective, especially for microvessels. The code will be put out at https://github.com/Rebeccala/MC-UNet

eess.IV↗

arXiv2022

Semi-Data-Aided Channel Estimation for MIMO Systems via Reinforcement Learning

Data-aided channel estimation is a promising solution to improve channel estimation accuracy by exploiting data symbols as pilot signals for updating an initial channel estimate. In this paper, we propose a semi-data-aided channel estimator for multiple-input multiple-output communication systems. Our strategy is to leverage reinforcement learning (RL) for selecting reliable detected symbols among the symbols in the first part of transmitted data block. This strategy facilitates an update of the channel estimate before the end of data block transmission and therefore achieves a significant reduction in communication latency compared to conventional data-aided channel estimation approaches. Towards this end, we first define a Markov decision process (MDP) which sequentially decides whether to use each detected symbol as an additional pilot signal. We then develop an RL algorithm to efficiently find the best policy of the MDP based on a Monte Carlo tree search approach. In this algorithm, we exploit the a-posteriori probability for approximating both the optimal future actions and the corresponding state transitions of the MDP and derive a closed-form expression for the best policy. Simulation results demonstrate that the proposed channel estimator effectively mitigates both channel estimation error and detection performance loss caused by insufficient pilot signals.

eess.SP↗

arXiv2022

Energy-Efficient IRS-Aided NOMA Beamforming for 6G Wireless Communications

This manuscript presents an energy-efficient alternating optimization framework based on intelligent reflective surfaces (IRS) aided non-orthogonal multiple access beamforming (NOMA-BF) system for 6G wireless communications. Specifically, this work proposes a centralized IRS-enabled design for the NOMA-BF system to optimize the active beamforming and power allocation coefficient (PAC) of users at the transmitter in the first stage and passive beamforming at IRS in the 2nd stage to maximize the energy efficiency (EE) of the network. However, an increment in the number of supportable users with the NOMA-BF system will lead to NOMA user interference and inter-cluster interference (ICI). To mitigate the effect of ICI, first zero-forcing beamforming along with efficient user clustering algorithm is exploited and then NOMA user interference is tackled efficiently through a proposed iterative algorithm that computes PAC of NOMA user through simplified closed-form expression under the required system constraints. In the 2nd stage, the problem of passive beamforming is solved through a technique based on difference-of-convex (DC) programming and successive convex approximation (SCA). Simulation results demonstrate that the proposed alternating framework for energy-efficient IRS-assisted NOMA-BF system can achieve convergence within a few iterations and provide efficient performance in terms of EE of the system with low complexity.

eess.SP↗

arXiv2022

Beamforming Design for IRS-Aided Decode-and-Forward Relay Wireless Network

As a low-cost and low-power-consumption passive reflector, intelligent reflecting surface (IRS) can make a significant rate improvement by building a programmable wireless environment. To improve the rate performance and coverage range of wireless networks, an IRS-aided decode-and-forward (DF) relay network is proposed with multiple antennas at relay station (RS). To achieve a high rate, an alternately iterative structure (AIS) of maximizing receive power (Max-RP) at RS is proposed to jointly optimize the beamforming vectors at RS and phase shifts at IRS. Considering its high-complexity, two low-complexity Max-RP schemes of null-space projection (NSP) plus maximum ratio combining (MRC) and IRS element selection (IRSES) plus MRC are presented to reduce this complexity, respectively. For the former, NSP is used to separate the reflected signal from IRS and the direct transmitted signal from source and MRC is adopted to combine the two signals at RS. For the latter, the basic concept of IRSES is as follows: IRS is partitioned into M subsets of elements and adjusting the phases of all elements per subset make all reflected signals and the direct signal from source phase alignment (PA) at the corresponding antenna of relay. Simulation results show that the proposed three methods perform much better than the existing network with single-antenna relay in terms of rate performance. In particular, a 85% rate gain over existing scheme is achieved in the high signal-to-noise ratio region. Moreover, it is verified that the positions of RS and IRS have a substantial impact on rate performance, and there exists an optimal positions of RS and IRS.

cs.IT↗

arXiv2022

Collaborative Intelligent Reflecting Surface Networks with Multi-Agent Reinforcement Learning

Intelligent reflecting surface (IRS) is envisioned to be widely applied in future wireless networks. In this paper, we investigate a multi-user communication system assisted by cooperative IRS devices with the capability of energy harvesting. Aiming to maximize the long-term average achievable system rate, an optimization problem is formulated by jointly designing the transmit beamforming at the base station (BS) and discrete phase shift beamforming at the IRSs, with the constraints on transmit power, user data rate requirement and IRS energy buffer size. Considering time-varying channels and stochastic arrivals of energy harvested by the IRSs, we first formulate the problem as a Markov decision process (MDP) and then develop a novel multi-agent Q-mix (MAQ) framework with two layers to decouple the optimization parameters. The higher layer is for optimizing phase shift resolutions, and the lower one is for phase shift beamforming and power allocation. Since the phase shift optimization is an integer programming problem with a large-scale action space, we improve MAQ by incorporating the Wolpertinger method, namely, MAQ-WP algorithm to achieve a sub-optimality with reduced dimensions of action space. In addition, as MAQ-WP is still of high complexity to achieve good performance, we propose a policy gradient-based MAQ algorithm, namely, MAQ-PG, by mapping the discrete phase shift actions into a continuous space at the cost of a slight performance loss. Simulation results demonstrate that the proposed MAQ-WP and MAQ-PG algorithms can converge faster and achieve data rate improvements of 10.7% and 8.8% over the conventional multi-agent DDPG, respectively.

cs.MA↗

arXiv2022

Industrial Style Transfer with Large-scale Geometric Warping and Content Preservation

We propose a novel style transfer method to quickly create a new visual product with a nice appearance for industrial designers' reference. Given a source product, a target product, and an art style image, our method produces a neural warping field that warps the source shape to imitate the geometric style of the target and a neural texture transformation network that transfers the artistic style to the warped source product. Our model, Industrial Style Transfer (InST), consists of large-scale geometric warping (LGW) and interest-consistency texture transfer (ICTT). LGW aims to explore an unsupervised transformation between the shape masks of the source and target products for fitting large-scale shape warping. Furthermore, we introduce a mask smoothness regularization term to prevent the abrupt changes of the details of the source product. ICTT introduces an interest regularization term to maintain important contents of the warped product when it is stylized by using the art style image. Extensive experimental results demonstrate that InST achieves state-of-the-art performance on multiple visual product design tasks, e.g., companies' snail logos and classical bottles (please see Fig. 1). To the best of our knowledge, we are the first to extend the neural style transfer method to create industrial product appearances. Project page: \ulr{https://jcyang98.github.io/InST/home.html}. Code available at: \url{https://github.com/jcyang98/InST}.

cs.CV↗

arXiv2022

Finite Sample t-Tests for High-Dimensional Means

Size distortion can occur if an asymptotic testing procedure requiring diverging sample sizes, is implemented to data with very small sample sizes. In this paper, we consider one-sample and two-sample tests for mean vectors when data are high-dimensional but sample sizes are very small. We establish asymptotic t-distributions of one-sample and two-sample U-statistics, which only require data dimensionality to diverge but sample sizes to be fixed and no less than 3. Simulation studies confirm the theoretical results that the proposed tests maintain accurate empirical sizes for a wide range of sample sizes and data dimensionalities. We apply the proposed tests to an fMRI dataset to demonstrate the practical implementation of the methods.

stat.ME↗

arXiv2022

Universal Segmentation of 33 Anatomies

In the paper, we present an approach for learning a single model that universally segments 33 anatomical structures, including vertebrae, pelvic bones, and abdominal organs. Our model building has to address the following challenges. Firstly, while it is ideal to learn such a model from a large-scale, fully-annotated dataset, it is practically hard to curate such a dataset. Thus, we resort to learn from a union of multiple datasets, with each dataset containing the images that are partially labeled. Secondly, along the line of partial labelling, we contribute an open-source, large-scale vertebra segmentation dataset for the benefit of spine analysis community, CTSpine1K, boasting over 1,000 3D volumes and over 11K annotated vertebrae. Thirdly, in a 3D medical image segmentation task, due to the limitation of GPU memory, we always train a model using cropped patches as inputs instead a whole 3D volume, which limits the amount of contextual information to be learned. To this, we propose a cross-patch transformer module to fuse more information in adjacent patches, which enlarges the aggregated receptive field for improved segmentation performance. This is especially important for segmenting, say, the elongated spine. Based on 7 partially labeled datasets that collectively contain about 2,800 3D volumes, we successfully learn such a universal model. Finally, we evaluate the universal model on multiple open-source datasets, proving that our model has a good generalization performance and can potentially serve as a solid foundation for downstream tasks.

eess.IV↗

arXiv2022

MixCL: Pixel label matters to contrastive learning

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing self-supervised methods applied in natural imaging tasks focus on designing proxy tasks for unlabeled data. For example, contrastive learning is often based on the fact that an image and its transformed version share the same identity. However, pixel annotations contain much valuable information for medical image segmentation, which is largely ignored in contrastive learning. In this work, we propose a novel pre-training framework called Mixed Contrastive Learning (MixCL) that leverages both image identities and pixel labels for better modeling by maintaining identity consistency, label consistency, and reconstruction consistency together. Consequently, thus pre-trained model has more robust representations that characterize medical images. Extensive experiments demonstrate the effectiveness of the proposed method, improving the baseline by 5.28% and 14.12% in Dice coefficient when 5% labeled data of Spleen and 15% of BTVC are used in fine-tuning, respectively.

eess.IV↗

arXiv2022

Measuring Changes in Regional Network Traffic Due to COVID-19 Stay-at-Home Measures

During the 2020 pandemic caused by the COVID-19 virus, many countries implemented stay-at-home measures, which led to many businesses and schools moving from in-person to online mode of operation. We analyze sampled Netflow records at a medium-sized US Regional Optical Network to quantify the changes in the network traffic due to stay-at-home measures in that region. We find that human-driven traffic in the network decreases to around 70%, and mostly shifts to local ISPs, while VPN and online meeting traffic increases up to 5 times. We also find that networks adopt a variety of online meeting solutions and favor one but continue using a few others. We find that educational and government institutions experience large traffic changes, but aim to keep their productivity via increased online meetings. Some scientific traffic also reduces possibly leading to loss of research productivity. Businesses mostly lose their traffic and few show VPN or online meeting activity. Most network prefixes experience large loss of live addresses but a handful increase their liveness. We also find increased incidence of network attacks. Our findings can help plan network provisioning and management to prepare for future possible infection outbreaks and natural disasters.

cs.NI↗

arXiv2022

Generalized Donaldson-Thomas Invariants via Kirwan Blowups

We develop a virtual cycle approach towards generalized Donaldson-Thomas theory of Calabi-Yau threefolds. Let $\mathcal{M}$ be the moduli stack of Gieseker semistable sheaves of fixed topological type on a Calabi-Yau threefold $W$. We construct an associated Deligne-Mumford stack $\widetilde{\mathcal{M}}$ with an induced semi-perfect obstruction theory of virtual dimension zero and define the generalized Donaldson-Thomas invariant of $W$ via Kirwan blowups to be the degree of the virtual cycle $[\widetilde{\mathcal{M}}]^{\mathrm{vir}}$. We show that it is invariant under deformations of the complex structure of $W$.

math.AG↗

arXiv2022

Bulk and edge dynamics of a 2D Affleck-Kennedy-Lieb-Tasaki model

We study the dynamical properties of both bulk and edge spins of a two-dimensional Affleck-Kennedy-Lieb-Tasaki (AKLT) model mainly by using the stochastic series expansion quantum Monte Carlo method with stochastic analytic continuation. In the deep AKLT phase, we obtain a spin spectrum with flat band, which is a strong evidence for a localized state. Through the spectrum analysis, we see a clear continuous phase transition from the AKLT phase to the Néel phase in the model, and the energy gap becomes closed at the corresponding momentum point. In comparison with linear spin-wave theory, the differences show that there are strong interactions among magnons at high energies. With open boundary condition, the gap of edge spins in the AKLT phase closes at both the $Γ$ point and the $π$ point interestingly to emerge into a flat-band-like Luttinger liquid phase, which can be explained by symmetry and perturbation approximation. This paper helps us to better understand the completely different dynamical behaviors of bulk and edge spins in the symmetry protected topological phase.

cond-mat.str-el↗

arXiv2022

A Deep Learning Approach to Predicting Ventilator Parameters for Mechanically Ventilated Septic Patients

We develop a deep learning approach to predicting a set of ventilator parameters for a mechanically ventilated septic patient using a long and short term memory (LSTM) recurrent neural network (RNN) model. We focus on short-term predictions of a set of ventilator parameters for the septic patient in emergency intensive care unit (EICU). The short-term predictability of the model provides attending physicians with early warnings to make timely adjustment to the treatment of the patient in the EICU. The patient specific deep learning model can be trained on any given critically ill patient, making it an intelligent aide for physicians to use in emergent medical situations.

q-bio.QM↗

arXiv2022

RRNet: Relational Reasoning Network with Parallel Multi-scale Attention for Salient Object Detection in Optical Remote Sensing Images

Salient object detection (SOD) for optical remote sensing images (RSIs) aims at locating and extracting visually distinctive objects/regions from the optical RSIs. Despite some saliency models were proposed to solve the intrinsic problem of optical RSIs (such as complex background and scale-variant objects), the accuracy and completeness are still unsatisfactory. To this end, we propose a relational reasoning network with parallel multi-scale attention for SOD in optical RSIs in this paper. The relational reasoning module that integrates the spatial and the channel dimensions is designed to infer the semantic relationship by utilizing high-level encoder features, thereby promoting the generation of more complete detection results. The parallel multi-scale attention module is proposed to effectively restore the detail information and address the scale variation of salient objects by using the low-level features refined by multi-scale attention. Extensive experiments on two datasets demonstrate that our proposed RRNet outperforms the existing state-of-the-art SOD competitors both qualitatively and quantitatively.

cs.CV↗

arXiv2022

Light-induced dimension crossover in 1T-TiSe$_2$ dictated by excitonic correlations

In low-dimensional systems with strong electronic correlations, the application of an ultrashort laser pulse often yields novel phases that are otherwise inaccessible. The central challenge in understanding such phenomena is to determine how dimensionality and many-body correlations together govern the pathway of a non-adiabatic transition. To this end, we examine a layered compound, 1T-TiSe$_2$, whose three-dimensional charge-density-wave (3D CDW) state also features exciton condensation due to strong electron-hole interactions. We find that photoexcitation suppresses the equilibrium 3D CDW while creating a nonequilibrium 2D CDW. Remarkably, the dimension reduction does not occur unless bound electron-hole pairs are broken. This relation suggests that excitonic correlations maintain the out-of-plane CDW coherence, settling a long-standing debate over their role in the CDW transition. Our findings demonstrate how optical manipulation of electronic interaction enables one to control the dimensionality of a broken-symmetry order, paving the way for realizing other emergent states in strongly correlated systems.

cond-mat.str-el↗

arXiv2022

Entanglement-assisted concatenated quantum codes

Entanglement-assisted concatenated quantum codes (EACQCs), constructed by concatenating two quantum codes, are proposed. These EACQCs show several advantages over the standard concatenated quantum codes (CQCs). Several families of EACQCs that, unlike standard CQCs, can beat the nondegenerate Hamming bound for entanglement-assisted quantum error correction codes (EAQECCs) are derived. Further, a number of EACQCs with better parameters than the best known standard quantum error correction codes (QECCs) and EAQECCs are also derived. In particular, several catalytic EACQCs with better parameters than the best known QECCs of the same length and net transmission are constructed. Furthermore, each catalytic EACQC consumes only one or two ebits. It is also shown that EACQCs make entanglement-assisted quantum communication possible even if the ebits are noisy. Finally, it is shown that EACQCs can outperform CQCs in entanglement fidelity over depolarizing channels if the ebits are less noisy than the qubits. Moreover, the threshold error probability of EACQCs is larger than that of CQCs when the error probability of ebits is sufficiently lower than that of qubits. Therefore EACQCs are not only competitive in quantum communication but also applicable in fault-tolerant quantum computation.

quant-ph↗

arXiv2022

Chambers in the symplectic cone and stability of symplectomorphism group for ruled surface

We continue our previous work to prove that for any non-minimal ruled surface $(M,ω)$, the stability under symplectic deformations of $π_0, π_1$ of $Symp(M,ω)$ is guided by embedded $J$-holomorphic curves. Further, we prove that for any fixed sizes blowups, when the area ratio $μ$ between the section and fiber goes to infinity, there is a topological colimit of $Symp(M,ω_μ).$ Moreover, when the blowup sizes are all equal to half the area of the fiber class, we give a topological model of the colimit which induces non-trivial symplectic mapping classes in $Symp(M,ω) \cap \rm Diff_0(M),$ where $\rm Diff_0(M)$ is the identity component of the diffeomorphism group. These mapping classes are not Dehn twists along Lagrangian spheres.

math.SG↗