arXiv Science⌕ Search

arXiv subjects

Jing Wu

Publications and source records attributed to Jing Wu.

At least 163 records · Page 9Linked to original sources

Active Learning in Brain Tumor Segmentation with Uncertainty Sampling, Annotation Redundancy Restriction, and Data Initialization

Deep learning models have demonstrated great potential in medical 3D imaging, but their development is limited by the expensive, large volume of annotated data required. Active learning (AL) addresses this by training a model on a subset of the most informative data samples without compromising performance. We compared different AL strategies and propose a framework that minimizes the amount of data needed for state-of-the-art performance. 638 multi-institutional brain tumor MRI images were used to train a 3D U-net model and compare AL strategies. We investigated uncertainty sampling, annotation redundancy restriction, and initial dataset selection techniques. Uncertainty estimation techniques including Bayesian estimation with dropout, bootstrapping, and margins sampling were compared to random query. Strategies to avoid annotation redundancy by removing similar images within the to-be-annotated subset were considered as well. We determined the minimum amount of data necessary to achieve similar performance to the model trained on the full dataset (α = 0.1). A variance-based selection strategy using radiomics to identify the initial training dataset is also proposed. Bayesian approximation with dropout at training and testing showed similar results to that of the full data model with less than 20% of the training data (p=0.293) compared to random query achieving similar performance at 56.5% of the training data (p=0.814). Annotation redundancy restriction techniques achieved state-of-the-art performance at approximately 40%-50% of the training data. Radiomics dataset initialization had higher Dice with initial dataset sizes of 20 and 80 images, but improvements were not significant. In conclusion, we investigated various AL strategies with dropout uncertainty estimation achieving state-of-the-art performance with the least annotated data.

cs.CV↗

Orbital hybridization-driven charge density wave transition in CsV3Sb5 kagome superconductor

Owing to its inherent non-trivial geometry, the unique structural motif of the recently discovered Kagome topological superconductor AV3Sb5 is an ideal host of diverse topologically non-trivial phenomena, including giant anomalous Hall conductivity, topological charge order, charge density wave, and unconventional superconductivity. Despite possessing a normal-state CDW order in the form of topological chiral charge order and diverse superconducting gaps structures, it remains unclear how fundamental atomic-level properties and many-body effects including Fermi surface nesting, electron-phonon coupling, and orbital hybridization contribute to these symmetry-breaking phenomena. Here, we report the direct participation of the V3d-Sb5p orbital hybridization in mediating the CDW phase transition in CsV3Sb5. The combination of temperature-dependent X-ray absorption and first principles studies clearly indicate the Inverse Star of David structure as the preferred reconstruction in the low-temperature CDW phase. Our results highlight the critical role that Sb orbitals plays and establish orbital hybridization as the direct mediator of the CDW states and structural transition dynamics in Kagome unconventional superconductors. This is a significant step towards the fundamental understanding and control of the emerging correlated phases from the Kagome lattice through the orbital interactions and provide promising approaches to novel regimes in unconventional orders and topology.

cond-mat.supr-con↗

Two-Dimensional Charge Localization at the Perovskite Oxide Interface

The effects of atomic-scale disorder and charge (de)localization holds significant importance,and they provide essential insights in unravelling the role that strong and weak correlations play in condensed matter systems.For perovskite oxide heterostructures,while disorders introduced via various external stimuli have strong influences on the (de)localization of the interfacial two-dimensional (2D) electrons, these factors alone could not fully account for the system's charge dynamics where interfacial hybridization holds very strong influence.Here, we determine that the displaced 2D free electrons are localized in the specific hybridized states at the LaAlO3/SrTiO3(LAO/STO) interface.This experimental study combines both transport measurements and temperature-dependent X-ray absorption spectroscopy and suggests the localization of 2D electrons can be induced via temperature reduction or ionic liquid gating and it applies to both amorphous and crystalline interfacial systems.Specifically, we demonstrate that interfacial hybridization plays a pivotal role in regulating the 2D electron localization effects.Our study resolves the location where the 2D electrons are localized and highlights the importance of interfacial hybridization and opens further scientific investigation of its influence on 2D charge localization in oxide heterointerfaces.

cond-mat.str-el↗

Quadrupole Topological Insulator in Non-Hermitian Thermal Diffusion

Quantized bulk quadrupole moment has unveiled a nontrivial boundary state, exhibiting lower-dimensional topological edge states and simultaneously hosting the in-gap corner modes of zero dimension. All state-of-the-art strategies for topological thermal metamaterials have so far failed to observe such higher-order hierarchical features, since the absence of quantized bulk quadrupole moments in thermal diffusion fundamentally forbids the possible expansions of band topology, unlike its photonic counterpart. Here, we report a recipe of creating quantized bulk quadrupole moments in diffusion, and observe the quadrupole topological phases in non-Hermitian thermal systems. The experiments demonstrate that both the real- and imaginary-valued bands showcase the hierarchical hallmarks of bulk, gapped edge, and in-gap corner states, in stark contrast to the higher-order states only observed on real-valued bands in classic wave fields. Our findings open up unique possibilities for diffusive manipulations and establish an unexplored playground for multipolar topological physics.

cond-mat.mes-hall↗

Abstract Demonstrations and Adaptive Exploration for Efficient and Stable Multi-step Sparse Reward Reinforcement Learning

Although Deep Reinforcement Learning (DRL) has been popular in many disciplines including robotics, state-of-the-art DRL algorithms still struggle to learn long-horizon, multi-step and sparse reward tasks, such as stacking several blocks given only a task-completion reward signal. To improve learning efficiency for such tasks, this paper proposes a DRL exploration technique, termed A^2, which integrates two components inspired by human experiences: Abstract demonstrations and Adaptive exploration. A^2 starts by decomposing a complex task into subtasks, and then provides the correct orders of subtasks to learn. During training, the agent explores the environment adaptively, acting more deterministically for well-mastered subtasks and more stochastically for ill-learnt subtasks. Ablation and comparative experiments are conducted on several grid-world tasks and three robotic manipulation tasks. We demonstrate that A^2 can aid popular DRL algorithms (DQN, DDPG, and SAC) to learn more efficiently and stably in these environments.

cs.RO↗

Network Hawkes Process Models for Exploring Latent Hierarchy in Social Animal Interactions

Group-based social dominance hierarchies are of essential interest in animal behavior research. Studies often record aggressive interactions observed over time, and models that can capture such dynamic hierarchy are therefore crucial. Traditional ranking methods summarize interactions across time, using only aggregate counts. Instead, we take advantage of the interaction timestamps, proposing a series of network point process models with latent ranks. We carefully design these models to incorporate important characteristics of animal interaction data, including the winner effect, bursting and pair-flip phenomena. Through iteratively constructing and evaluating these models we arrive at the final cohort Markov-Modulated Hawkes process (C-MMHP), which best characterizes all aforementioned patterns observed in interaction data. We compare all models using simulated and real data. Using statistically developed diagnostic perspectives, we demonstrate that the C-MMHP model outperforms other methods, capturing relevant latent ranking structures that lead to meaningful predictions for real data.

stat.AP↗

Entangling remote microwave quantum computers with hybrid entanglement swap and variational distillation

Superconducting microwave circuits with Josephson junctions are a major platform for quantum computing. To unleash their full capabilities, the cooperative operation of multiple microwave superconducting circuits is required. Therefore, designing an efficient protocol to distribute microwave entanglement remotely becomes a crucial open problem. Here, we propose a continuous-variable entanglement-swap approach based on optical-microwave entanglement generation, which can boost the ultimate rate by two orders of magnitude at state-of-the-art parameter region, compared with traditional approaches. We further empower the protocol with a hybrid variational entanglement distillation component to provide huge advantage in the infidelity-versus-success-probability trade-off. Our protocol can be realized with near-term device performance, and is robust against non-perfections such as optical loss and noise. Therefore, our work provides a practical method to realize efficient quantum links for superconducting microwave quantum computers.

quant-ph↗

A Unified Understanding of Deep NLP Models for Text Classification

The rapid development of deep natural language processing (NLP) models for text classification has led to an urgent need for a unified understanding of these models proposed individually. Existing methods cannot meet the need for understanding different models in one framework due to the lack of a unified measure for explaining both low-level (e.g., words) and high-level (e.g., phrases) features. We have developed a visual analysis tool, DeepNLPVis, to enable a unified understanding of NLP models for text classification. The key idea is a mutual information-based measure, which provides quantitative explanations on how each layer of a model maintains the information of input words in a sample. We model the intra- and inter-word information at each layer measuring the importance of a word to the final prediction as well as the relationships between words, such as the formation of phrases. A multi-level visualization, which consists of a corpus-level, a sample-level, and a word-level visualization, supports the analysis from the overall training set to individual samples. Two case studies on classification tasks and comparison between models demonstrate that DeepNLPVis can help users effectively identify potential problems caused by samples and model architectures and then make informed improvements.

cs.CL↗

Exploring and Exploiting Hubness Priors for High-Quality GAN Latent Sampling

Despite the extensive studies on Generative Adversarial Networks (GANs), how to reliably sample high-quality images from their latent spaces remains an under-explored topic. In this paper, we propose a novel GAN latent sampling method by exploring and exploiting the hubness priors of GAN latent distributions. Our key insight is that the high dimensionality of the GAN latent space will inevitably lead to the emergence of hub latents that usually have much larger sampling densities than other latents in the latent space. As a result, these hub latents are better trained and thus contribute more to the synthesis of high-quality images. Unlike the a posterior "cherry-picking", our method is highly efficient as it is an a priori method that identifies high-quality latents before the synthesis of images. Furthermore, we show that the well-known but purely empirical truncation trick is a naive approximation to the central clustering effect of hub latents, which not only uncovers the rationale of the truncation trick, but also indicates the superiority and fundamentality of our method. Extensive experimental results demonstrate the effectiveness of the proposed method.

cs.CV↗

Optimizing Nitrogen Management with Deep Reinforcement Learning and Crop Simulations

Nitrogen (N) management is critical to sustain soil fertility and crop production while minimizing the negative environmental impact, but is challenging to optimize. This paper proposes an intelligent N management system using deep reinforcement learning (RL) and crop simulations with Decision Support System for Agrotechnology Transfer (DSSAT). We first formulate the N management problem as an RL problem. We then train management policies with deep Q-network and soft actor-critic algorithms, and the Gym-DSSAT interface that allows for daily interactions between the simulated crop environment and RL agents. According to the experiments on the maize crop in both Iowa and Florida in the US, our RL-trained policies outperform previous empirical methods by achieving higher or similar yield while using less fertilizers

cs.LG↗

Playing Lottery Tickets in Style Transfer Models

Style transfer has achieved great success and attracted a wide range of attention from both academic and industrial communities due to its flexible application scenarios. However, the dependence on a pretty large VGG-based autoencoder leads to existing style transfer models having high parameter complexities, which limits their applications on resource-constrained devices. Compared with many other tasks, the compression of style transfer models has been less explored. Recently, the lottery ticket hypothesis (LTH) has shown great potential in finding extremely sparse matching subnetworks which can achieve on par or even better performance than the original full networks when trained in isolation. In this work, we for the first time perform an empirical study to verify whether such trainable matching subnetworks also exist in style transfer models. Specifically, we take two most popular style transfer models, i.e., AdaIN and SANet, as the main testbeds, which represent global and local transformation based style transfer methods respectively. We carry out extensive experiments and comprehensive analysis, and draw the following conclusions. (1) Compared with fixing the VGG encoder, style transfer models can benefit more from training the whole network together. (2) Using iterative magnitude pruning, we find the matching subnetworks at 89.2% sparsity in AdaIN and 73.7% sparsity in SANet, which demonstrates that style transfer models can play lottery tickets too. (3) The feature transformation module should also be pruned to obtain a much sparser model without affecting the existence and quality of the matching subnetworks. (4) Besides AdaIN and SANet, other models such as LST, MANet, AdaAttN and MCCNet can also play lottery tickets, which shows that LTH can be generalized to various style transfer models.

cs.CV↗

Accessing negative Poisson`s ratio of graphene by machine learning interatomic potentials

The negative Poisson`s ratio (NPR) is a novel property of materials, which enhances the mechanical feature and creates a wide range of application prospects in lots of fields, such as aerospace, electronics, medicine, etc. Fundamental understanding on the mechanism underlying NPR plays an important role in designing advanced mechanical functional materials. However, with different methods used, the origin of NPR is found different and conflicting with each other, for instance, in the representative graphene. In this study, based on machine learning technique, we constructed a moment tensor potential (MTP) for molecular dynamics (MD) simulations of graphene. By analyzing the evolution of key geometries, the increase of bond angle is found to be responsible for the NPR of graphene instead of bond length. The results on the origin of NPR are well consistent with the start-of-art first-principles, which amend the results from MD simulations using classic empirical potentials. Our study facilitates the understanding on the origin of NPR of graphene and paves the way to improve the accuracy of MD simulations being comparable to first-principle calculations. Our study would also promote the applications of machine learning interatomic potentials in multiscale simulations of functional materials. *Author

physics.comp-ph↗

Electrically driven robust tuning of lattice thermal conductivity

Two-dimensional (2D) materials represented by graphene stand out in future electrical industry and have been widely studied. As a commonly existing factor in electronic devices, the electric field has been extensively utilized to modulate the performance. However, how the electric field regulates thermal transport is rarely studied. Herein, we investigate the modulation of thermal transport properties by applying the external electric field ranging from 0 to 0.4 VA-1, with bilayer graphene, monolayer silicene, and germanene as study cases. The monotonic decreasing trend of thermal conductivity of all the three materials is revealed. The significant effect on the scattering rate is found to be responsible for the decreased thermal conductivity by electric field. Further evidences show that the reconstruction of internal electric field and the generation of induced charges lead to the increased scattering rate from strong phonon anharmonicity. Thus, the ultra-low thermal conductivity emerges with external electric field applied. Applying external electric field to regulate thermal conductivity enlightens the constructive idea for high-efficient thermal management.

physics.comp-ph↗

The stable behavior of low thermal conductivity in 1T-sandwich structure with different components

Designing materials with low thermal conductivity (\k{appa}) is of demand for thermal protection, heat insulation, thermoelectricity, etc. In this paper, based on the start-of-art first-principles calculations, we propose a framework of a 1T-sandwich structure for designing materials with low \k{appa}. The 1T-sandwich structure is the same as the well-known transition metal dichalcogenide (TMD) but with light Carbon atoms in the middle plane. Using different atoms to fill the outer positions, a few novel two-dimensional materials are constructed as study cases, i.e., Mg2C, Janus MgBeC, Be2C, and Mo2C. With a systematic and comparative study, the \k{appa} are calculated to be 3.74, 8.26, 14.80, 5.13 W/mK, respectively. The consistent values indicate the stable behavior of low \k{appa} in the 1T-sandwich structure, being insensitive to the component. Our study would help design advanced functional materials with reliable heat transfer performance for practical applications, which reduces the influence of unavoidable impurities.

cond-mat.mtrl-sci↗

The synergistic modulation of electronic and geometry structures leads to ultra-low thermal conductivity of graphene-like borides (g-B3X5, X=N, P, As)

The design of novel devices with specific technical interests through modulating structural properties and bonding characteristics promotes the vigorous development of materials informatics. Herein, we propose a synergy strategy of component reconstruction by combining geometric configuration and bonding characteristics. With the synergy strategy, we designed a novel two-dimensional (2D) graphene-like borides, e.g. g-B3N5, which possesses counter-intuitive ultra-low thermal conductivity of 21.08 W/mK despite the small atomic mass. The ultra-low thermal conductivity is attributed to the synergy effect of electronics and geometry on thermal transport due to the combining reconstruction of g-BN and nitrogene. With the synergy effect, the dominant acoustic branches are strongly softened, and the scattering absorption and Umklapp process are simultaneously suppressed. Thus, the thermal conductivity is significantly lowered. To verify the component reconstruction strategy, we further constructed g-B3P5 and g-B3As5, and uncovered the ultra-low thermal conductivity of 2.50 and 1.85 W/mK, respectively. The synergy effect and the designed ultra-low thermal conductivity materials with lightweight atomic mass cater to the demand for light development of momentum machinery and heat protection, such as aerospace vehicles, high-speed rail, automobiles.

cond-mat.mtrl-sci↗

A Survey On Universal Adversarial Attack

The intriguing phenomenon of adversarial examples has attracted significant attention in machine learning and what might be more surprising to the community is the existence of universal adversarial perturbations (UAPs), i.e. a single perturbation to fool the target DNN for most images. With the focus on UAP against deep classifiers, this survey summarizes the recent progress on universal adversarial attacks, discussing the challenges from both the attack and defense sides, as well as the reason for the existence of UAP. We aim to extend this work as a dynamic survey that will regularly update its content to follow new works regarding UAP or universal attack in a wide range of domains, such as image, audio, video, text, etc. Relevant updates will be discussed at: https://bit.ly/2SbQlLG. We welcome authors of future works in this field to contact us for including your new finding.

cs.LG↗

MW-GAN: Multi-Warping GAN for Caricature Generation with Multi-Style Geometric Exaggeration

Given an input face photo, the goal of caricature generation is to produce stylized, exaggerated caricatures that share the same identity as the photo. It requires simultaneous style transfer and shape exaggeration with rich diversity, and meanwhile preserving the identity of the input. To address this challenging problem, we propose a novel framework called Multi-Warping GAN (MW-GAN), including a style network and a geometric network that are designed to conduct style transfer and geometric exaggeration respectively. We bridge the gap between the style and landmarks of an image with corresponding latent code spaces by a dual way design, so as to generate caricatures with arbitrary styles and geometric exaggeration, which can be specified either through random sampling of latent code or from a given caricature sample. Besides, we apply identity preserving loss to both image space and landmark space, leading to a great improvement in quality of generated caricatures. Experiments show that caricatures generated by MW-GAN have better quality than existing methods.

cs.CV↗

A Principle Solution for Enroll-Test Mismatch in Speaker Recognition

Mismatch between enrollment and test conditions causes serious performance degradation on speaker recognition systems. This paper presents a statistics decomposition (SD) approach to solve this problem. This approach decomposes the PLDA score into three components that corresponding to enrollment, prediction and normalization respectively. Given that correct statistics are used in each component, the resultant score is theoretically optimal. A comprehensive experimental study was conducted on three datasets with different types of mismatch: (1) physical channel mismatch, (2) speaking behavior mismatch, (3) near-far recording mismatch. The results demonstrated that the proposed SD approach is highly effective, and outperforms the ad-hoc multi-condition training approach that is commonly adopted but not optimal in theory.

cs.SD↗