arXiv Science⌕ Search

arXiv subjects

Le Zhang

Publications and source records attributed to Le Zhang.

At least 181 records · Page 10Linked to original sources
arXiv2023

CorrMatch: Label Propagation via Correlation Matching for Semi-Supervised Semantic Segmentation

This paper presents a simple but performant semi-supervised semantic segmentation approach, called CorrMatch. Previous approaches mostly employ complicated training strategies to leverage unlabeled data but overlook the role of correlation maps in modeling the relationships between pairs of locations. We observe that the correlation maps not only enable clustering pixels of the same category easily but also contain good shape information, which previous works have omitted. Motivated by these, we aim to improve the use efficiency of unlabeled data by designing two novel label propagation strategies. First, we propose to conduct pixel propagation by modeling the pairwise similarities of pixels to spread the high-confidence pixels and dig out more. Then, we perform region propagation to enhance the pseudo labels with accurate class-agnostic masks extracted from the correlation maps. CorrMatch achieves great performance on popular segmentation benchmarks. Taking the DeepLabV3+ with ResNet-101 backbone as our segmentation model, we receive a 76%+ mIoU score on the Pascal VOC 2012 dataset with only 92 annotated images. Code is available at https://github.com/BBBBchan/CorrMatch.

cs.CV↗
arXiv2023

A Novel Deep Clustering Framework for Fine-Scale Parcellation of Amygdala Using dMRI Tractography

The amygdala plays a vital role in emotional processing and exhibits structural diversity that necessitates fine-scale parcellation for a comprehensive understanding of its anatomico-functional correlations. Diffusion MRI tractography is an advanced imaging technique that can estimate the brain's white matter structural connectivity to potentially reveal the topography of the amygdala for studying its subdivisions. In this work, we present a deep clustering pipeline to perform automated, fine-scale parcellation of the amygdala using diffusion MRI tractography. First, we incorporate a newly proposed deep learning approach to enable accurate segmentation of the amygdala directly on the dMRI data. Next, we design a novel streamline clustering-based structural connectivity feature for a robust representation of voxels within the amygdala. Finally, we improve the popular joint dimensionality reduction and k-means clustering approach to enable amygdala parcellation at a finer scale. With the proposed method, we obtain nine unique amygdala parcels. Experiments show that these parcels can be consistently identified across subjects and have good correspondence to the widely used coarse-scale amygdala parcellation.

eess.IV↗
arXiv2023

Fast generation of mock galaxy catalogues with COLA

We investigate the feasibility of using COmoving Lagrangian Acceleration (COLA) technique to efficiently generate galaxy mock catalogues that can accurately reproduce the statistical properties of observed galaxies. Our proposed scheme combines the subhalo abundance matching (SHAM) procedure with COLA simulations, utilizing only three free parameters: the scatter magnitude ($σ_{\rm scat}$) in SHAM, the initial redshift ($z_{\rm init}$) of the COLA simulation, and the time stride ($da$) used by COLA. In this proof-of-concept study, we focus on a subset of BOSS CMASS NGC galaxies within the redshift range $z\in [0.45, 0.55]$. We perform $\mathtt{GADGET}$ simulation and low-resolution COLA simulations with various combinations of $(z_{\rm init}, da)$, each using $1024^{3}$ particles in an $800~h^{-1}{\rm Mpc}$ box. By minimizing the difference between COLA mock and CMASS NGC galaxies for the monopole of the two-point correlation function (2PCF), we obtain the optimal $σ_{\rm scat}$. We have found that by setting $z_{\rm init}=29$ and $da=1/30$, we achieve a good agreement between COLA mock and CMASS NGC galaxies within the range of 4 to $20~h^{-1}{\rm Mpc}$, with a computational cost two orders of magnitude lower than that of the N-body code. Moreover, a detailed verification is performed by comparing various statistical properties, such as anisotropic 2PCF, three-point clustering, and power spectrum multipoles, which shows similar performance between GADGET mock and COLA mock catalogues with the CMASS NGC galaxies. Furthermore, we assess the robustness of the COLA mock catalogues across different cosmological models, demonstrating consistent results in the resulting 2PCFs. Our findings suggest that COLA simulations are a promising tool for efficiently generating mock catalogues for emulators and machine learning analyses in exploring the large-scale structure of the Universe.

astro-ph.CO↗
arXiv2023

String breaking and running coupling of $\rm Q\bar{Q}$ in a rotating media from holography

Through gravity/gauge duality, the string breaking and running coupling constant of heavy quark-antiquark pair are investigated in the rotating background. For the meson decay mode $\rm Q\bar{Q} \rightarrow Q \bar{q}+\bar{Q} q$, we discuss the string breaking and running coupling in the parallel and transverse case. It is found that the parallel case has a more significant on string breaking and running coupling constant than the transverse case in the confined phase. The string-breaking distance and the maximum value of running coupling will decrease with the increase of angular velocity in the parallel case. Besides, we also investigate the running coupling and screening distance at finite angular velocity in the deconfined phase. It is found that the maximum values of the running coupling and screening distance are decreasing functions of angular velocity. The parallel case has a more significant influence on the running coupling and screening distance than the transverse case in the deconfined phase.

hep-ph↗
arXiv2023

MoqaGPT : Zero-Shot Multi-modal Open-domain Question Answering with Large Language Model

Multi-modal open-domain question answering typically requires evidence retrieval from databases across diverse modalities, such as images, tables, passages, etc. Even Large Language Models (LLMs) like GPT-4 fall short in this task. To enable LLMs to tackle the task in a zero-shot manner, we introduce MoqaGPT, a straightforward and flexible framework. Using a divide-and-conquer strategy that bypasses intricate multi-modality ranking, our framework can accommodate new modalities and seamlessly transition to new models for the task. Built upon LLMs, MoqaGPT retrieves and extracts answers from each modality separately, then fuses this multi-modal information using LLMs to produce a final answer. Our methodology boosts performance on the MMCoQA dataset, improving F1 by +37.91 points and EM by +34.07 points over the supervised baseline. On the MultiModalQA dataset, MoqaGPT surpasses the zero-shot baseline, improving F1 by 9.5 points and EM by 10.1 points, and significantly closes the gap with supervised methods. Our codebase is available at https://github.com/lezhang7/MOQAGPT.

cs.CL↗
arXiv2023

Holographic Schwinger Effect in Anisotropic Media

According to gauge/gravity correspondence, we study the holographic Schwinger effect within an anisotropic background. Firstly, the separate length of the particle-antiparticle pairs is computed within the context of an anisotropic background which is parameterized by dynamical exponent $ν$. It is found that the maximum separate length $x$ increases with the increase of dynamical exponent $ν$. By analyzing the potential energy, we find that the potential barrier increases with the dynamical exponent $ν$ at a small separate distance. This observation implies that the Schwinger effect within an anisotropic background is comparatively weaker when contrasted with its manifestation in an isotropic background. Finally, we also find that the Schwinger effect in the transverse direction is weakened, compared to the parallel direction in the anisotropic background, which is consistent with the top-down model.

hep-th↗
arXiv2023

Surface ferromagnetism in rhombohedral heptalayer graphene moire superlattice

The topological electronic structure of crystalline materials often gives rise to intriguing surface states, such as Dirac surface states in topological insulators, Fermi arc surface states in Dirac semimetals, and topological superconductivity in iron-based superconductors. Recently, rhombohedral multilayer graphene has emerged as a promising platform for exploring exotic surface states due to its hosting of topologically protected surface flat bands at low energy, with the layer-dependent energy dispersion. These flat bands can promote electron correlations, leading to a plethora of quantum phenomena, including spontaneous symmetry breaking, superconductivity, ferromagnetism, and topological Chern insulators. Nevertheless, the intricate connection between the surface flat bands in rhombohedral multilayer graphene and the highly dispersive high-energy bands hinders the exploration of correlated surface states. Here, we present a method to isolate the surface flat bands of rhombohedral heptalayer (7L) graphene by introducing moire superlattices. The pronounced screening effects observed in the moire potential-modulated rhombohedral 7L graphene indicate its essential three-dimensional (3D) nature. The isolated surface flat bands favor correlated states on the surface in the regions away from charge-neutrality points. Most notably, we observe tunable surface ferromagnetism, manifested as an anomalous Hall effect with hysteresis loops, which is achieved by polarizing surface states using finite displacement fields. Our work establishes rhombohedral multilayer graphene moire superlattice as a unique 3D system for exploring correlated surface states.

cond-mat.mes-hall↗
arXiv2023

Multi-Task Cooperative Learning via Searching for Flat Minima

Multi-task learning (MTL) has shown great potential in medical image analysis, improving the generalizability of the learned features and the performance in individual tasks. However, most of the work on MTL focuses on either architecture design or gradient manipulation, while in both scenarios, features are learned in a competitive manner. In this work, we propose to formulate MTL as a multi/bi-level optimization problem, and therefore force features to learn from each task in a cooperative approach. Specifically, we update the sub-model for each task alternatively taking advantage of the learned sub-models of the other tasks. To alleviate the negative transfer problem during the optimization, we search for flat minima for the current objective function with regard to features from other tasks. To demonstrate the effectiveness of the proposed approach, we validate our method on three publicly available datasets. The proposed method shows the advantage of cooperative learning, and yields promising results when compared with the state-of-the-art MTL approaches. The code will be available online.

cs.CV↗
arXiv2023

Transport Anisotropy in One-dimensional Graphene Superlattice in the High Kronig-Penney Potential Limit

One-dimensional graphene superlattice subjected to strong Kronig-Penney (KP) potential is promising for achieving electron lensing effect, while previous studies utilizing the modulated dielectric gates can only yield a moderate, spatially dispersed potential profile. Here, we realize high KP potential modulation of graphene via nanoscale ferroelectric domain gating. Graphene transistors are fabricated on PbZr$_{0.2}$Ti$_{0.8}$O$_{3}$ back-gates patterned with periodic, 100-200 nm wide stripe domains. Due to band reconstruction, the h-BN top-gating induces satellite Dirac points in samples with current along the superlattice vector $\hat{s}$, a feature absent in samples with current perpendicular to $\hat{s}$. The satellite Dirac point position scales with the superlattice period ($L$) as $\propto L^β$, with $β= -1.18 \pm 0.06$. These results can be well explained by the high KP potential scenario, with the Fermi velocity perpendicular to $\hat{s}$ quenched to about 1% of that for pristine graphene. Our study presents a promising material platform for realizing electron supercollimation and investigating flat band phenomena.

cond-mat.mes-hall↗
arXiv2023

Evolution of Maximum Bending Strain on Poisson's Ratio Distribution

In recent years, new flexible functional materials have attracted increasing interest, but there is a lack of the designing mechanisms of flexibility design with superstructures. In traditional engineering mechanics, the maximum bending strain (MBS) was considered universal for describing the bendable properties of a given material, leading to the universal designing method of lowering the dimension such as thin membranes designed flexible functional materials.In this work, the MBS was found only applicable for materials with uniformly distributed Poisson's ratio, while the MBS increases with the thickness of the given material in case there is a variation Poisson's ratio in different areas. This means the MBS can be enhanced by certain Poisson's ratio design in the future to achieve better flexibility of thick materials. Here, the inorganic freestanding nanofiber membranes, which have a nonconstant Poisson's ratio response on stress/strain for creating nonuniformly distributed Poisson's ratio were proven applicable for designing larger MBS and lower Young's modulus for thicker samples.

cond-mat.soft↗
arXiv2023

Orbital Fulde-Ferrell-Larkin-Ovchinnikov state in an Ising superconductor

The conventional Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) state relies on the Zeeman effect of an external magnetic field to break time-reversal symmetry, forming a state of finite-momentum Cooper pairing. In superconductors with broken inversion symmetries, the Rashba or Ising-type spin-orbit coupling (SOC) can interact with either the Zeeman or the orbital effect of magnetic fields, extending the range of possible FFLO states, though evidence for these more exotic forms of FFLO pairing has been lacking. Here we report the discovery of an unconventional FFLO state induced by coupling the Ising SOC and the orbital effect in multilayer 2H-NbSe2. Transport measurements show that the translational and rotational symmetries are broken in the orbital FFLO state, providing the hallmark signatures of finite momentum cooper pairings. We establish the entire orbital FFLO phase diagram, consisting of normal metal, uniform Ising superconducting phase, and a six-fold orbital FFLO state. This study highlights an alternative route to finite-momentum superconductivity and provides a universal mechanism to prepare orbital FFLO states in similar materials with broken inversion symmetries.

cond-mat.supr-con↗
arXiv2023

Boosting Salient Object Detection with Transformer-based Asymmetric Bilateral U-Net

Existing salient object detection (SOD) methods mainly rely on U-shaped convolution neural networks (CNNs) with skip connections to combine the global contexts and local spatial details that are crucial for locating salient objects and refining object details, respectively. Despite great successes, the ability of CNNs in learning global contexts is limited. Recently, the vision transformer has achieved revolutionary progress in computer vision owing to its powerful modeling of global dependencies. However, directly applying the transformer to SOD is suboptimal because the transformer lacks the ability to learn local spatial representations. To this end, this paper explores the combination of transformers and CNNs to learn both global and local representations for SOD. We propose a transformer-based Asymmetric Bilateral U-Net (ABiU-Net). The asymmetric bilateral encoder has a transformer path and a lightweight CNN path, where the two paths communicate at each encoder stage to learn complementary global contexts and local spatial details, respectively. The asymmetric bilateral decoder also consists of two paths to process features from the transformer and CNN encoder paths, with communication at each decoder stage for decoding coarse salient object locations and fine-grained object details, respectively. Such communication between the two encoder/decoder paths enables AbiU-Net to learn complementary global and local representations, taking advantage of the natural merits of transformers and CNNs, respectively. Hence, ABiU-Net provides a new perspective for transformer-based SOD. Extensive experiments demonstrate that ABiU-Net performs favorably against previous state-of-the-art SOD methods. The code is available at https://github.com/yuqiuyuqiu/ABiU-Net.

cs.CV↗
arXiv2023

AATCT-IDS: A Benchmark Abdominal Adipose Tissue CT Image Dataset for Image Denoising, Semantic Segmentation, and Radiomics Evaluation

Methods: In this study, a benchmark \emph{Abdominal Adipose Tissue CT Image Dataset} (AATTCT-IDS) containing 300 subjects is prepared and published. AATTCT-IDS publics 13,732 raw CT slices, and the researchers individually annotate the subcutaneous and visceral adipose tissue regions of 3,213 of those slices that have the same slice distance to validate denoising methods, train semantic segmentation models, and study radiomics. For different tasks, this paper compares and analyzes the performance of various methods on AATTCT-IDS by combining the visualization results and evaluation data. Thus, verify the research potential of this data set in the above three types of tasks. Results: In the comparative study of image denoising, algorithms using a smoothing strategy suppress mixed noise at the expense of image details and obtain better evaluation data. Methods such as BM3D preserve the original image structure better, although the evaluation data are slightly lower. The results show significant differences among them. In the comparative study of semantic segmentation of abdominal adipose tissue, the segmentation results of adipose tissue by each model show different structural characteristics. Among them, BiSeNet obtains segmentation results only slightly inferior to U-Net with the shortest training time and effectively separates small and isolated adipose tissue. In addition, the radiomics study based on AATTCT-IDS reveals three adipose distributions in the subject population. Conclusion: AATTCT-IDS contains the ground truth of adipose tissue regions in abdominal CT slices. This open-source dataset can attract researchers to explore the multi-dimensional characteristics of abdominal adipose tissue and thus help physicians and patients in clinical practice. AATCT-IDS is freely published for non-commercial purpose at: \url{https://figshare.com/articles/dataset/AATTCT-IDS/23807256}.

eess.IV↗
arXiv2023

Sudowoodo: a Chinese Lyric Imitation System with Source Lyrics

Lyrics generation is a well-known application in natural language generation research, with several previous studies focusing on generating accurate lyrics using precise control such as keywords, rhymes, etc. However, lyrics imitation, which involves writing new lyrics by imitating the style and content of the source lyrics, remains a challenging task due to the lack of a parallel corpus. In this paper, we introduce \textbf{\textit{Sudowoodo}}, a Chinese lyrics imitation system that can generate new lyrics based on the text of source lyrics. To address the issue of lacking a parallel training corpus for lyrics imitation, we propose a novel framework to construct a parallel corpus based on a keyword-based lyrics model from source lyrics. Then the pairs \textit{(new lyrics, source lyrics)} are used to train the lyrics imitation model. During the inference process, we utilize a post-processing module to filter and rank the generated lyrics, selecting the highest-quality ones. We incorporated audio information and aligned the lyrics with the audio to form the songs as a bonus. The human evaluation results show that our framework can perform better lyric imitation. Meanwhile, the \textit{Sudowoodo} system and demo video of the system is available at \href{https://Sudowoodo.apps-hp.danlu.netease.com/}{Sudowoodo} and \href{https://youtu.be/u5BBT_j1L5M}{https://youtu.be/u5BBT\_j1L5M}.

cs.CL↗
arXiv2023

Precise determination of $^{210}$Pb $β$ Decay Spectrum at 0 keV and its Implication to Theoretical Calculations

The atomic exchange effect will lead to a significant increase in the probability density of $β$ decays below a few keV. This effect is very important for scientific experiments that performed by low-energy electron spectroscopy measurements. However, the atomic exchange effect involves multi-electron interactions, especially for a system with 82 electrons such as lead. Different parameters will lead to different trends in the energy spectrum predicted by the theory, so it is urgent to carry out experimental measurements to provide parameter limits for the theory. The probability increase brought about by the atomic exchange effect is most obvious near 0keV, and the $β$ energy spectrum is accurately measured near this energy point, so as to provide constraints for the physical model of atomic exchange. However, it is extremely difficult to measure the $β$ energy spectrum at 0keV due to the limitations of electronic noise and internal conversion effects. The excited decay path of $^{210}$Pb was taken as the observation object,by measuring the total energy spectrum of $β$ rays and cascaded gamma rays, the precise measurement of the $β$ energy spectrum near 0keV has been completed. The analysis of the $β$ energy spectrum of $^{210}$Pb gives the following conclusions. The experimental results first verified the theory that the exchange effect causes the probability increase at the low energy end near 0keV. At the same time, the experimental results are higher than the existing predictions of the atomic exchange effect. At least for Pb element, all the electron shells have played a role in improving the probability density of the low end of the $β$ energy spectrum. This discovery will promote the theoretical calculation of the $β$ energy spectrum of $^{214}$Pb, at the same time, it also indicates that the reactor neutrinos have a higher probability density at the omnipotent end.

nucl-ex↗
arXiv2023

Map Reconstruction of radio observations with Conditional Invertible Neural Networks

In radio astronomy, the challenge of reconstructing a sky map from time ordered data (TOD) is known as an inverse problem. Standard map-making techniques and gridding algorithms are commonly employed to address this problem, each offering its own benefits such as producing minimum-variance maps. However, these approaches also carry limitations such as computational inefficiency and numerical instability in map-making and the inability to remove beam effects in grid-based methods. To overcome these challenges, this study proposes a novel solution through the use of the conditional invertible neural network (cINN) for efficient sky map reconstruction. With the aid of forward modeling, where the simulated TODs are generated from a given sky model with a specific observation, the trained neural network can produce accurate reconstructed sky maps. Using the five-hundred-meter aperture spherical radio telescope (FAST) as an example, cINN demonstrates remarkable performance in map reconstruction from simulated TODs, achieving a mean squared error of $2.29\pm 2.14 \times 10^{-4}~\rm K^2$, a structural similarity index of $0.968\pm0.002$, and a peak signal-to-noise ratio of $26.13\pm5.22$ at the $1σ$ level. Furthermore, by sampling in the latent space of cINN, the reconstruction errors for each pixel can be accurately quantified.

astro-ph.IM↗
arXiv2023

Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation

The field of protein folding research has been greatly advanced by deep learning methods, with AlphaFold2 (AF2) demonstrating exceptional performance and atomic-level precision. As co-evolution is integral to protein structure prediction, AF2's accuracy is significantly influenced by the depth of multiple sequence alignment (MSA), which requires extensive exploration of a large protein database for similar sequences. However, not all protein sequences possess abundant homologous families, and consequently, AF2's performance can degrade on such queries, at times failing to produce meaningful results. To address this, we introduce a novel generative language model, MSA-Augmenter, which leverages protein-specific attention mechanisms and large-scale MSAs to generate useful, novel protein sequences not currently found in databases. These sequences supplement shallow MSAs, enhancing the accuracy of structural property predictions. Our experiments on CASP14 demonstrate that MSA-Augmenter can generate de novo sequences that retain co-evolutionary information from inferior MSAs, thereby improving protein structure prediction quality on top of strong AF2.

q-bio.QM↗
arXiv2023

AI-assisted reconstruction of cosmic velocity field from redshift-space spatial distribution of halos

The peculiar velocities of dark matter halos are crucial to study many issues in cosmology and galaxy evolution. In this study, by using the state-of-the-art deep learning technique, a UNet-based neural network, we propose to reconstruct the peculiar velocity field from the redshift-space distribution of dark matter halos. Through a point-to-point comparison and examination of various statistical properties, we demonstrate that, the reconstructed velocity field is in good agreement with the ground truth. The power spectra of various velocity field components, including velocity magnitude, divergence and vorticity, can be successfully recovered when $k\lesssim 1.1$ $h/\rm Mpc$ (the Nyquist frequency of the simulations) at about 80% accuracy. This approach is very promising and presents an alternative method to correct the redshift-space distortions using the measured 3D spatial information of halos. Additionally, for the reconstruction of the momentum field of halos, UNet achieves similar good results. Hence the applications in various aspects of cosmology are very broad, such as correcting redshift errors and improving measurements in the structure of the cosmic web, the kinetic Sunyaev-Zel'dovich effect, BAO reconstruction, etc.

astro-ph.CO↗