arXiv subjects

Qian Wang

Publications and source records attributed to Qian Wang.

At least 397 records · Page 22Linked to original sources

arXiv2022

Transformers in Medical Image Analysis: A Review

Transformers have dominated the field of natural language processing, and recently impacted the computer vision area. In the field of medical image analysis, Transformers have also been successfully applied to full-stack clinical applications, including image synthesis/reconstruction, registration, segmentation, detection, and diagnosis. Our paper aims to promote awareness and application of Transformers in the field of medical image analysis. Specifically, we first overview the core concepts of the attention mechanism built into Transformers and other basic components. Second, we review various Transformer architectures tailored for medical image applications and discuss their limitations. Within this review, we investigate key challenges revolving around the use of Transformers in different learning paradigms, improving the model efficiency, and their coupling with other techniques. We hope this review can give a comprehensive picture of Transformers to the readers in the field of medical image analysis.

cs.CV↗

arXiv2022

TBI-GAN: An Adversarial Learning Approach for Data Synthesis on Traumatic Brain Segmentation

Brain network analysis for traumatic brain injury (TBI) patients is critical for its consciousness level assessment and prognosis evaluation, which requires the segmentation of certain consciousness-related brain regions. However, it is difficult to construct a TBI segmentation model as manually annotated MR scans of TBI patients are hard to collect. Data augmentation techniques can be applied to alleviate the issue of data scarcity. However, conventional data augmentation strategies such as spatial and intensity transformation are unable to mimic the deformation and lesions in traumatic brains, which limits the performance of the subsequent segmentation task. To address these issues, we propose a novel medical image inpainting model named TBI-GAN to synthesize TBI MR scans with paired brain label maps. The main strength of our TBI-GAN method is that it can generate TBI images and corresponding label maps simultaneously, which has not been achieved in the previous inpainting methods for medical images. We first generate the inpainted image under the guidance of edge information following a coarse-to-fine manner, and then the synthesized intensity image is used as the prior for label inpainting. Furthermore, we introduce a registration-based template augmentation pipeline to increase the diversity of the synthesized image pairs and enhance the capacity of data augmentation. Experimental results show that the proposed TBI-GAN method can produce sufficient synthesized TBI images with high quality and valid label maps, which can greatly improve the 2D and 3D traumatic brain segmentation performance compared with the alternatives.

eess.IV↗

arXiv2022

Discover the GellMann-Okubo formula with machine learning

Machine learning is a novel and powerful technology and has been widely used in various science topics. We demonstrate a machine-learning based approach built by a set of general metrics and rules inspired by physics. Taking advantages of physical constraints, such as dimension identity, symmetry and generalization, we succeed to rediscover the GellMann Okubo formula using a technique of symbolic regression. This approach can effectively find explicit solutions among user-defined observable, and easily extend to study on exotic hadron spectrum.

hep-ph↗

arXiv2022

Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule Augmentation and Detection

Lung nodule detection in chest X-ray (CXR) images is common to early screening of lung cancers. Deep-learning-based Computer-Assisted Diagnosis (CAD) systems can support radiologists for nodule screening in CXR. However, it requires large-scale and diverse medical data with high-quality annotations to train such robust and accurate CADs. To alleviate the limited availability of such datasets, lung nodule synthesis methods are proposed for the sake of data augmentation. Nevertheless, previous methods lack the ability to generate nodules that are realistic with the size attribute desired by the detector. To address this issue, we introduce a novel lung nodule synthesis framework in this paper, which decomposes nodule attributes into three main aspects including shape, size, and texture, respectively. A GAN-based Shape Generator firstly models nodule shapes by generating diverse shape masks. The following Size Modulation then enables quantitative control on the diameters of the generated nodule shapes in pixel-level granularity. A coarse-to-fine gated convolutional Texture Generator finally synthesizes visually plausible nodule textures conditioned on the modulated shape masks. Moreover, we propose to synthesize nodule CXR images by controlling the disentangled nodule attributes for data augmentation, in order to better compensate for the nodules that are easily missed in the detection task. Our experiments demonstrate the enhanced image quality, diversity, and controllability of the proposed lung nodule synthesis framework. We also validate the effectiveness of our data augmentation on greatly improving nodule detection performance.

eess.IV↗

arXiv2022

On Tree Equilibria in Max-Distance Network Creation Games

We study the Nash equilibrium and the price of anarchy in the max-distance network creation game. Network creation game, first introduced and studied by Fabrikant et al., is a classic model for real-world networks from a game-theoretic point of view. In a network creation game with n selfish vertex agents, each vertex can build undirected edges incident to a subset of the other vertices. The goal of every agent is to minimize its creation cost plus its usage cost, where the creation cost is the unit edge cost $α$ times the number of edges it builds, and the usage cost is the sum of distances to all other agents in the resulting network. The max-distance network creation game, introduced and studied by Demaine et al., is a key variant of the original game, where the usage cost takes into account the maximum distance instead. The main result of this paper shows that for $α> 19$ all equilibrium graphs in the max-distance network creation game must be trees, while the best bound in previous work is $α> 129$. We also improve the constant upper bound on the price of anarchy to 3 for tree equilibria. Our work brings new insights into the structure of Nash equilibria and takes one step forward in settling the so-called tree conjecture in the max-distance network creation game.

cs.GT↗

arXiv2022

DP$^2$-NILM: A Distributed and Privacy-preserving Framework for Non-intrusive Load Monitoring

Non-intrusive load monitoring (NILM), which usually utilizes machine learning methods and is effective in disaggregating smart meter readings from the household-level into appliance-level consumption, can help analyze electricity consumption behaviours of users and enable practical smart energy and smart grid applications. Recent studies have proposed many novel NILM frameworks based on federated deep learning (FL). However, there lacks comprehensive research exploring the utility optimization schemes and the privacy-preserving schemes in different FL-based NILM application scenarios. In this paper, we make the first attempt to conduct FL-based NILM focusing on both the utility optimization and the privacy-preserving by developing a distributed and privacy-preserving NILM (DP2-NILM) framework and carrying out comparative experiments on practical NILM scenarios based on real-world smart meter datasets. Specifically, two alternative federated learning strategies are examined in the utility optimization schemes, i.e., the FedAvg and the FedProx. Moreover, different levels of privacy guarantees, i.e., the local differential privacy federated learning and the global differential privacy federated learning are provided in the DP2-NILM. Extensive comparison experiments are conducted on three real-world datasets to evaluate the proposed framework.

cs.LG↗

arXiv2022

Theoretical study on the contributions of $ω$ meson to the $X(3872) \to J/ψπ^+π^-$ and $J/ψπ^+π^-π^0$ decays

With the newly measurements of $X(3872) \to J/ψπ^+π^-$ from LHCb Collaboration, in addition to the dominant contribution from the $ρ^0$ meson, we perform a theoretical study on the contribution of $ω$ meson in the $X(3872) \to J/ψπ^+π^-$ and $X(3872)\to J/ψπ^+π^-π^0$ processes. It is found that the recent experimental measurements on the $π^+ π^-$ invariant mass distributions can be well reproduced, and the ratio of the couplings between $X(3872) \to J/ψρ^0$ and $X(3872) \to J/ψω$ is also evaluated. Within the parameters extracted from the $π^+ π^-$ invariant mass distributions of the $X(3872) \to J/ψπ^+π^-$ process, the branching fractions of the $X(3872) \to J/ψω$ channel relative to that of the $X(3872) \to J/ψπ^+π^-π^0$ channel and the $π^+ π^- π^0$ invariant mass distributions of the $X(3872) \to J/ψπ^+π^-π^0$ decay are calculated, which gives a hint for the further high-statistic experiment.

hep-ph↗

arXiv2022

Age of Information in Reservation Multi-Access Networks with Stochastic Arrivals

This paper investigates the Age of Information (AoI) performance of Frame Slotted ALOHA with Reservation and Data slots (FSA-RD). We consider a symmetric multi-access network where each user transmits its randomly generated status updates to an access point in a framed manner. Each frame consists of one reservation slot and several data slots. The reservation slot is made up of some mini-slots. In each reservation slot, users, with a status update packet to transmit, randomly send short reservation packets in one of the mini-slots to contend for data slots of the frame. The data slots are assigned to those users that succeed in reservation slot. To provide insights in optimizing the information freshness of FSA-RD, we manage to derive a closed-form expression of the average AoI under FSA-RD by applying a recursive method. Numerical results validate the analytical expression and demonstrate the influence of the frame size and reservation probability on the average AoI. We finally perform a comparison between the AoI performance of FSA-RD with optimized frame size and reservation probability, and that of slotted ALOHA with optimized transmission probability. The comparison results show that FSA-RD can effectively reduce the AoI performance of multi-access networks, especially when the status arrival rate of the network becomes large.

cs.IT↗

arXiv2022

Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning

Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the generalizability and interpretability of the learned representation. The situation becomes even more serious in medical imaging, where the clinical data (e.g., MR images with pathology) are limited and scarce while the reliability, generalizability and transparency of the learned model are highly required. To address this problem, we propose to infuse human experts' intelligence and domain knowledge into the training of deep neural networks. The core idea is that we infuse the visual attention information from expert radiologists to proactively guide the deep model to focus on regions with potential pathology and avoid being trapped in learning harmful shortcuts. To do so, we propose a novel eye-gaze-guided vision transformer (EG-ViT) for diagnosis with limited medical image data. We mask the input image patches that are out of the radiologists' interest and add an additional residual connection in the last encoder layer of EG-ViT to maintain the correlations of all patches. The experiments on two public datasets of INbreast and SIIM-ACR demonstrate our EG-ViT model can effectively learn/transfer experts' domain knowledge and achieve much better performance than baselines. Meanwhile, it successfully rectifies the harmful shortcut learning and significantly improves the EG-ViT model's interpretability. In general, EG-ViT takes the advantages of both human expert's prior knowledge and the power of deep neural networks. This work opens new avenues for advancing current artificial intelligence paradigms by infusing human intelligence.

cs.CV↗

arXiv2022

FairNeuron: Improving Deep Neural Network Fairness with Adversary Games on Selective Neurons

With Deep Neural Network (DNN) being integrated into a growing number of critical systems with far-reaching impacts on society, there are increasing concerns on their ethical performance, such as fairness. Unfortunately, model fairness and accuracy in many cases are contradictory goals to optimize. To solve this issue, there has been a number of work trying to improve model fairness by using an adversarial game in model level. This approach introduces an adversary that evaluates the fairness of a model besides its prediction accuracy on the main task, and performs joint-optimization to achieve a balanced result. In this paper, we noticed that when performing backward propagation based training, such contradictory phenomenon has shown on individual neuron level. Based on this observation, we propose FairNeuron, a DNN model automatic repairing tool, to mitigate fairness concerns and balance the accuracy-fairness trade-off without introducing another model. It works on detecting neurons with contradictory optimization directions from accuracy and fairness training goals, and achieving a trade-off by selective dropout. Comparing with state-of-the-art methods, our approach is lightweight, making it scalable and more efficient. Our evaluation on 3 datasets shows that FairNeuron can effectively improve all models' fairness while maintaining a stable utility.

cs.LG↗

arXiv2022

Investigating the Isospin Property of $T_{cc}^+$ from its Dalitz Plot Distribution

Recently, LHCb observed a double-charmed tetraquark candidate $T_{cc}^+$ and claimed its isospin to be zero due to the absence of $T_{cc}^{++}$. However, the absence of the $T_{cc}^{++}$ in LHCb may be due to their low production in $pp$ collisions, thus the isospin of $T_{cc}^+$ still needs to be clarified. We propose an efficient way to investigate the isospin property of $T_{cc}^+$ from the Dalitz plot distribution of $T_{cc}^+\to D^+D^0π^0$. This method can also be applied to other exotic candidates.

hep-ph↗

arXiv2022

Latency Guarantee for Ubiquitous Intelligence in 6G: A Network Calculus Approach

With the gradual deployment of 5G and the continuous popularization of edge intelligence (EI), the explosive growth of data on the edge of the network has promoted the rapid development of 6G and ubiquitous intelligence (UbiI). This article aims to explore a new method for modeling latency guarantees for UbiI in 6G given 6G's extremely stochastic nature in terahertz (THz) environments, THz channel tail behavior, and delay distribution tail characteristics generated by the UBiI random component, and to find the optimal solution that minimizes the end-to-end (E2E) delay of UbiI. In this article, the arrival curve and service curve of network calculus can well characterize the stochastic nature of wireless channels, the tail behavior of wireless systems and the E2E service curve of network calculus can model the tail characteristic of the delay distribution in UbiI. Specifically, we first propose demands and challenges facing 6G, edge computing (EC), edge deep learning (DL), and UbiI. Then, we propose the hierarchical architecture, the network model, and the service delay model of the UbiI system based on network calculus. In addition, two case studies demonstrate the usefulness and effectiveness of the network calculus approach in analyzing and modeling the latency guarantee for UbiI in 6G. Finally, future open research issues regarding the latency guarantee for UbiI in 6G are outlined.

cs.NI↗

arXiv2022

Deep Generalized Unfolding Networks for Image Restoration

Deep neural networks (DNN) have achieved great success in image restoration. However, most DNN methods are designed as a black box, lacking transparency and interpretability. Although some methods are proposed to combine traditional optimization algorithms with DNN, they usually demand pre-defined degradation processes or handcrafted assumptions, making it difficult to deal with complex and real-world applications. In this paper, we propose a Deep Generalized Unfolding Network (DGUNet) for image restoration. Concretely, without loss of interpretability, we integrate a gradient estimation strategy into the gradient descent step of the Proximal Gradient Descent (PGD) algorithm, driving it to deal with complex and real-world image degradation. In addition, we design inter-stage information pathways across proximal mapping in different PGD iterations to rectify the intrinsic information loss in most deep unfolding networks (DUN) through a multi-scale and spatial-adaptive way. By integrating the flexible gradient descent and informative proximal mapping, we unfold the iterative PGD algorithm into a trainable DNN. Extensive experiments on various image restoration tasks demonstrate the superiority of our method in terms of state-of-the-art performance, interpretability, and generalizability. The source code is available at https://github.com/MC-E/Deep-Generalized-Unfolding-Networks-for-Image-Restoration.

cs.CV↗

arXiv2022

Understanding the onset of surface degradation in LiNiO2 cathodes

Nickel-based layered oxides offer an attractive platform for the development of energy-dense cobalt-free cathodes for lithium-ion batteries but suffer from degradation via oxygen gas release during electrochemical cycling. While such degradation has previously been characterized phenomenologically with experiments, an atomic-scale understanding of the reactions that take place at the cathode surface has been lacking. Here, we develop a first-principles methodology for the prediction of the surface reconstructions of intercalation electrode particles as a function of the temperature and state of charge. We report the surface phase diagrams of the LiNiO2(001) and (104) surfaces and identify surface structures that are likely visited during the first charge and discharge. Our calculations indicate that both surfaces experience oxygen loss during the first charge, resulting in irreversible changes to the surface structures. At the end of charge, the surface Ni atoms migrate into tetrahedral sites, from which they further migrate into Li vacancies during discharge, leading to Li/Ni mixed discharged surface phases. Further, the impact of the temperature and voltage range during cycling on the charge/discharge mechanism is discussed. The present study thus provides insight into the initial stages of cathode surface degradation and lies the foundation for the computational design of cathode materials that are stable against oxygen release.

cond-mat.mtrl-sci↗

arXiv2022

Study of exotic hadrons with machine learning

We analyzed the invariant mass spectrum of near-threshold exotic states for one-channel candidates with a deep neural network. It can extract the scattering length and effective range, which would shed light on the nature of given states, from the experimental mass spectrum. As an application, the mass spectrum of the $X(3872)$ and the $T_{cc}^+$ are studied. The obtained scattering lengths, effective ranges, and most relevant thresholds are consistent with those from fitting to the experimental data. The advantage of the neural network is that it is more stable than the fitting, especially for low-statistic data. The network, which provides another way to analyze the experimental data, can also be applied to other one-channel near-threshold exotic candidates.

hep-ph↗

arXiv2022

NTIRE 2022 Challenge on Super-Resolution and Quality Enhancement of Compressed Video: Dataset, Methods and Results

This paper reviews the NTIRE 2022 Challenge on Super-Resolution and Quality Enhancement of Compressed Video. In this challenge, we proposed the LDV 2.0 dataset, which includes the LDV dataset (240 videos) and 95 additional videos. This challenge includes three tracks. Track 1 aims at enhancing the videos compressed by HEVC at a fixed QP. Track 2 and Track 3 target both the super-resolution and quality enhancement of HEVC compressed video. They require x2 and x4 super-resolution, respectively. The three tracks totally attract more than 600 registrations. In the test phase, 8 teams, 8 teams and 12 teams submitted the final results to Tracks 1, 2 and 3, respectively. The proposed methods and solutions gauge the state-of-the-art of super-resolution and quality enhancement of compressed video. The proposed LDV 2.0 dataset is available at https://github.com/RenYang-home/LDV_dataset. The homepage of this challenge (including open-sourced codes) is at https://github.com/RenYang-home/NTIRE22_VEnh_SR.

cs.CV↗

arXiv2022

Observation of spin splitting torque in a collinear antiferromagnet RuO2

Current-induced spin torques provide efficient data writing approaches for magnetic memories. Recently, the spin splitting torque (SST) was theoretically predicted (R. González-Hernández et al. Phys. Rev. Lett. 126, 127701 (2021)), which combines advantages of conventional spin transfer torque (STT) and spin-orbit torque (SOT) as well as enables controllable spin polarization. Here we provide the experimental evidence of SST in collinear antiferromagnet RuO2 films. The spin current direction is found to be correlated to the crystal orientation of RuO2 and the spin polarization direction is dependent on (parallel to) the Néel vector. These features are quite characteristic for the predicted SST. Our finding not only present a new member for the spin torques besides traditional STT and SOT, but also proposes a promising spin source RuO2 for spintronics.

cond-mat.mtrl-sci↗

arXiv2022

Hadronic molecules

A large number of experimental discoveries especially in the heavy quarkonium sector that did not at all fit to the expectations of the until then very successful quark model led to a renaissance of hadron spectroscopy. Among various explanations of the internal structure of these excitations, hadronic molecules, being analogues of light nuclei, play a unique role since for those predictions can be made with controlled uncertainty. We review experimental evidences of various candidates of hadronic molecules, and methods of identifying such structures. Nonrelativistic effective field theories are the suitable framework for studying hadronic molecules, and are discussed in both the continuum and finite volumes. Also pertinent lattice QCD results are presented. Further, we discuss the production mechanisms and decays of hadronic molecules, and comment on the reliability of certain assertions often made in the literature.

hep-ph↗