arXiv subjects

Cheng Li

Publications and source records attributed to Cheng Li.

At least 289 records · Page 16Linked to original sources

arXiv2023

Relating galaxies across different redshift to study galaxy evolution

We propose a general framework leveraging the halo-galaxy connection to link galaxies observed at different redshift in a statistical way, and use the link to infer the redshift evolution of the galaxy population. Our tests based on hydrodynamic simulations show that our method can accurately recover the stellar mass assembly histories up to $z\sim 3$ for present star-forming and quiescent galaxies down to $10^{10}h^{-1}M_{\odot}$. Applying the method to observational data shows that the stellar mass evolution of the main progenitors of galaxies depends strongly on the properties of descendants, such as stellar mass, halo mass, and star formation states. Galaxies hosted by low-mass groups/halos at the present time have since $z\sim 1.8$ grown their stellar mass $\sim 2.5$ times as fast as those hosted by massive clusters. This dependence on host halo mass becomes much weaker for descendant galaxies with similar star formation states. Star-forming galaxies grow about 2-4 times faster than their quiescent counterparts since $z\sim 1.8$. Both TNG and EAGLE simulations over-predict the progenitor stellar mass at $z>1$, particularly for low-mass descendants.

astro-ph.GA↗

arXiv2023

Wave Statistics and Energy Dissipation of Breaking Waves Generated by a Wave Plate

The present study focuses on direct numerical simulations of breaking waves generated by a wave plate at constant water depths. The aim is to quantify the dynamics and kinematics in the breaking process, together with the air entrainment and energy dissipation due to breaking. Good agreement is achieved between numerical and experimental results in terms of free-surface profiles, energy budget, and bubble statistics during wave breaking. A parametric study was conducted to examine the effects of wave properties and initial conditions on breaking features. According to research on the Bond number ($Bo$, the ratio of gravitational to surface tension forces), a larger surface tension produces more significant parasitic capillaries at the forward face of the wave profile and a thicker plunging jet, which causes a delayed breaking time and is tightly correlated with the main cavity size. A close relationship between wave statistics and the initial conditions of the wave plate is discovered, showing that breaker types can be classified according to the ratio of wave height to water depth, $H/d$. Moreover, the energy dissipation rate due to breaking can be related to the initial conditions of the wave plate by applying the conventional dissipation scaling of turbulence theory, and further correlated with the local breaking crest geometry using inertial-scaling arguments. The proposed scaling of the dissipation rate during the active breaking period is found to be in good agreement with our numerical results.

physics.flu-dyn↗

arXiv2023

SuperScaler: Supporting Flexible DNN Parallelization via a Unified Abstraction

With the growing model size, deep neural networks (DNN) are increasingly trained over massive GPU accelerators, which demands a proper parallelization plan that transforms a DNN model into fine-grained tasks and then schedules them to GPUs for execution. Due to the large search space, the contemporary parallelization plan generators often rely on empirical rules that couple transformation and scheduling, and fall short in exploring more flexible schedules that yield better memory usage and compute efficiency. This tension can be exacerbated by the emerging models with increasing complexity in their structure and model size. SuperScaler is a system that facilitates the design and generation of highly flexible parallelization plans. It formulates the plan design and generation into three sequential phases explicitly: model transformation, space-time scheduling, and data dependency preserving. Such a principled approach decouples multiple seemingly intertwined factors and enables the composition of highly flexible parallelization plans. As a result, SuperScaler can not only generate empirical parallelization plans, but also construct new plans that achieve up to 3.5X speedup compared to state-of-the-art solutions like DeepSpeed, Megatron and Alpa, for emerging DNN models like Swin-Transformer and AlphaFold2, as well as well-optimized models like GPT-3.

cs.DC↗

arXiv2023

Dark Matter Phenomenology in 2HDMS

The constituents of dark matter are still an unresolved puzzle. Several Beyond Standard Model (BSM) Physics offer suitable candidates. In this study here we consider the Two Higgs Doublet model augmented with a complex scalar singlet (2HDMS) and focus on the dark matter phenomenology of 2HDMS with the complex scalar singlet as the dark matter candidate. The parameter space allowed from existing experimental constraints from dark matter, flavour physics and collider searches has been studied. The discovery potential for such a 2HDMS at HL-LHC and at future $e^+e^-$ colliders has been worked out.

hep-ph↗

arXiv2023

Collective excitations of the Chern-insulator states in commensurate double moiré superlattices of twisted bilayer graphene on hexagonal boron nitride

We study the collective excitation modes of the Chern insulator states in magic-angle twisted bilayer graphene aligned with hexagonal boron nitride (TBG/BN) at odd integer fillings ($ν$) of the flat bands. For the $1 \times 1$ commensurate double moiré superlattices in TBG/BN at three twist angles ($θ'$) between BN and graphene, self-consistent Hartree-Fock calculations show that the electron-electron interaction and the broken $C_{2z}$ symmetry lead to the Chern-insulator ground states with valley-spin flavor polarized HF bands at odd $ν$. In the active-band approximation, the HF bands in the same flavor of TBG/BN are much more separated than those of the pristine TBG with TBG/BN having a larger intra-flavor band gap so that the energies of the lowest intra-flavor exciton modes of TBG/BN computed within the time-dependent HF method are much higher than those of TBG and reach about 20 meV, and the exciton wavefunctions of TBG/BN become less localized than those of TBG. The inter-flavor valley-wave modes in TBG/BN have excitation energies higher than 2.5 meV which is also much larger than that of TBG, while the spin-wave modes all have zero excitation gap. In contrast to TBG with particle-hole symmetric excitation modes for positive and negative $ν$, the excitation spectrums and gaps of TBG/BN at positive $ν$ are rather different from those at negative $ν$. The quantitative behavior of the excitation spectrum of TBG/BN also varies with $θ'$. Full HF calculations demonstrate that more HF bands besides the two central bands can have rather large contributions from the single-particle flat-band states, then the lowest exciton modes that determine the optical properties of the Chern insulator states in TBG/BN are generally the ones between the remote and flat-like bands, while the valley-wave modes have similar energies as those in the active-band approximation.

cond-mat.mes-hall↗

arXiv2022

Galaxy populations in groups and clusters: evidence for a characteristic stellar mass scale at $M_\ast\sim 10^{9.5}M_\odot$

We use the most recent data release (DR9) of the DESI legacy imaging survey and SDSS galaxy groups to measure the conditional luminosity function (CLF) for groups with halo mass $M_{\rm h}\ge 10^{12}M_{\odot}$ and redshift $0.01\le z\le 0.08$, down to a limiting $r$-band magnitude of $M_{\rm r}=-10\sim-12$. For a given halo mass we measure the CLF for the total satellite population, as well as separately for the red and blue populations classified using the $(g-z)$ color. We find a clear faint-end upturn in the CLF of red satellites, with a slope $α\approx-1.8$ which is almost independent of halo mass. This faint-end upturn is not seen for blue satellites and for the total population. Our stellar population synthesis modeling shows that the $(g-z)$ color provides a clean red/blue division, and that group galaxies in the red population defined by $(g-z)$ are all dominated by old stellar populations. The fraction of old galaxies as a function of galaxy luminosity shows a minimum at a luminosity $M_{\rm r}\sim-18$, corresponding to a stellar mass $M_\ast\sim10^{9.5}M_\odot$. This mass scale is independent of halo mass and is comparable to the characteristic luminosity at which galaxies show a dichotomy in surface brightness and size, suggesting that the dichotomy in the old fraction and in galaxy structure may have a common origin. The rising of the old fraction at the faint end for Milky Way (MW)-sized halos found here is in good agreement with the quenched fraction measured both for the MW/M31 system and from the ELVES survey. We discuss the implications of our results for the formation and evolution of low-mass galaxies, and for the stellar mass functions of low-mass galaxies to be observed at high redshift.

astro-ph.GA↗

arXiv2022

Conditional HI mass functions and the HI-to-halo mass relation in the local Universe

We present a new HI mass estimator which relates the HI-to-stellar mass ratio to four galaxy properties: stellar surface mass density, color index $u-r$, stellar mass and concentration index, with the scatter of individual galaxies around the mean HI mass modeled with a Gaussian distribution. We calibrate the estimator using the xGASS sample, including both HI detection and non-detection, and constrain the model parameters through Bayesian inferences. Tests with mock catalogs demonstrate that our estimator provides unbiased HI masses for optical samples like the SDSS, thus suitable for statistical studies of HI gas contents in galaxies and dark matter halos. We apply our estimator to the SDSS spectroscopic sample to estimate the local HI mass function (HIMF), the conditional HI mass function (CHIMF) in galaxy groups and the HI-halo mass (HIHM) relation. Our HIMF agrees with the ALFALFA measurements at $M_{HI}\gtrsim 5\times 10^9M_{\odot}$, but with higher amplitude and a steeper slope at lower masses. We show that this discrepancy is caused primarily by the cosmic variance which is corrected for the SDSS sample but not for the ALFALFA. The CHIMFs for all halo masses can be described by a single Schechter function, and this is true for red, blue and satellite galaxies. For central galaxies the CHIMFs show a double-Gaussian profile, with the two components contributed by the red and blue galaxies, respectively. The total HI mass in a group increases monotonically with halo mass. The HI mass of central galaxies in galaxy groups increases rapidly with halo mass only at $M_h\lesssim10^{12}M_{\odot}$, while the mass dependence becomes much weaker at higher halo masses. The observed HI-halo mass relation is not reproduced by current hydrodynamic simulations and semi-analytic models of galaxy formation.

astro-ph.GA↗

arXiv2022

Energy transfer and third-order law in forced anisotropic MHD turbulence with hyperviscosity

The Kolmogorov-Yaglom (third-order) law, links energy transfer rates in the inertial range of magneto-hydrodynamic (MHD) turbulence with third-order structure functions. Anisotropy, a typical property in the solar wind, largely challenges the applicability of the third-order law with isotropic assumption. To shed light on the energy transfer process in the presence of anisotropy, the present study conducted direct numerical simulations (DNSs) on forced MHD turbulence with normal and hyper-viscosity under various strengths of the external magnetic field ($B_0$), and calculated three forms of third-order structure function with or without averaging azimuthal or polar angles to $B_0$ direction. Correspondingly, three forms of estimated energy transfer rates were studied systematically with various $B_0$. The result shows that the peak of the estimated longitudinal transfer rate occurs at larger scales as closer to the $B_0$ direction, and its maximum shifts away from the $B_0$ direction at larger $B_0$. Compared with normal viscous cases, hyper-viscous cases can attain better separation of the inertial range from the dissipation range, thus facilitating the analyses of the inertial range properties and the estimation of the energy cascade rates. The direction-averaged third-order structure function over a spherical surface proposed in literature predicts the energy transfer rates and inertial range accurately, even at very high $B_0$. With limited statistics, the calculation of the third-order structure function shows a stronger dependence on averaging of azimuthal angles than the time, especially at high $B_0$ cases. These findings provide insights into the anisotropic effect on the estimation of energy transfer rates.

physics.flu-dyn↗

arXiv2022

Flux Variations of Cosmic Ray Air Showers Detected by LHAASO-KM2A During a Thunderstorm on 10 June 2021

The Large High Altitude Air Shower Observatory (LHAASO) has three sub-arrays, KM2A, WCDA and WFCTA. The flux variations of cosmic ray air showers were studied by analyzing the KM2A data during the thunderstorm on 10 June 2021. The number of shower events that meet the trigger conditions increases significantly in atmospheric electric fields, with maximum fractional increase of 20%. The variations of trigger rates (increases or decreases) are found to be strongly dependent on the primary zenith angle. The flux of secondary particles increases significantly, following a similar trend with that of the shower events. To better understand the observed behavior, Monte Carlo simulations are performed with CORSIKA and G4KM2A (a code based on GEANT4). We find that the experimental data (in saturated negative fields) are in good agreement with simulations, assuming the presence of a uniform upward electric field of 700 V/cm with a thickness of 1500 m in the atmosphere above the observation level. Due to the acceleration/deceleration and deflection by the atmospheric electric field, the number of secondary particles with energy above the detector threshold is modified, resulting in the changes in shower detection rate.

astro-ph.HE↗

arXiv2022

Iterative Data Refinement for Self-Supervised MR Image Reconstruction

Magnetic Resonance Imaging (MRI) has become an important technique in the clinic for the visualization, detection, and diagnosis of various diseases. However, one bottleneck limitation of MRI is the relatively slow data acquisition process. Fast MRI based on k-space undersampling and high-quality image reconstruction has been widely utilized, and many deep learning-based methods have been developed in recent years. Although promising results have been achieved, most existing methods require fully-sampled reference data for training the deep learning models. Unfortunately, fully-sampled MRI data are difficult if not impossible to obtain in real-world applications. To address this issue, we propose a data refinement framework for self-supervised MR image reconstruction. Specifically, we first analyze the reason of the performance gap between self-supervised and supervised methods and identify that the bias in the training datasets between the two is one major factor. Then, we design an effective self-supervised training data refinement method to reduce this data bias. With the data refinement, an enhanced self-supervised MR image reconstruction framework is developed to prompt accurate MR imaging. We evaluate our method on an in-vivo MRI dataset. Experimental results show that without utilizing any fully sampled MRI data, our self-supervised framework possesses strong capabilities in capturing image details and structures at high acceleration factors.

eess.IV↗

arXiv2022

Convergence Analysis of Stochastic Kriging-Assisted Simulation with Random Covariates

We consider performing simulation experiments in the presence of covariates. Here, covariates refer to some input information other than system designs to the simulation model that can also affect the system performance. To make decisions, decision makers need to know the covariate values of the problem. Traditionally in simulation-based decision making, simulation samples are collected after the covariate values are known; in contrast, as a new framework, simulation with covariates starts the simulation before the covariate values are revealed, and collects samples on covariate values that might appear later. Then, when the covariate values are revealed, the collected simulation samples are directly used to predict the desired results. This framework significantly reduces the decision time compared to the traditional way of simulation. In this paper, we follow this framework and suppose there are a finite number of system designs. We adopt the metamodel of stochastic kriging (SK) and use it to predict the system performance of each design and the best design. The goal is to study how fast the prediction errors diminish with the number of covariate points sampled. This is a fundamental problem in simulation with covariates and helps quantify the relationship between the offline simulation efforts and the online prediction accuracy. Particularly, we adopt measures of the maximal integrated mean squared error (IMSE) and integrated probability of false selection (IPFS) for assessing errors of the system performance and the best design predictions. Then, we establish convergence rates for the two measures under mild conditions. Last, these convergence behaviors are illustrated numerically using test examples.

stat.ME↗

arXiv2022

A Statistical Approach to Estimating Adsorption-Isotherm Parameters in Gradient-Elution Preparative Liquid Chromatography

Determining the adsorption isotherms is an issue of significant importance in preparative chromatography. A modern technique for estimating adsorption isotherms is to solve an inverse problem so that the simulated batch separation coincides with actual experimental results. However, due to the ill-posedness, the high non-linearity, and the uncertainty quantification of the corresponding physical model, the existing deterministic inversion methods are usually inefficient in real-world applications. To overcome these difficulties and study the uncertainties of the adsorption-isotherm parameters, in this work, based on the Bayesian sampling framework, we propose a statistical approach for estimating the adsorption isotherms in various chromatography systems. Two modified Markov chain Monte Carlo algorithms are developed for a numerical realization of our statistical approach. Numerical experiments with both synthetic and real data are conducted and described to show the efficiency of the proposed new method.

stat.AP↗

arXiv2022

Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers

Large-scale transformer models have become the de-facto architectures for various machine learning applications, e.g., CV and NLP. However, those large models also introduce prohibitive training costs. To mitigate this issue, we propose a novel random and layerwise token dropping method (random-LTD), which skips the computation of a subset of the input tokens at all middle layers. Particularly, random-LTD achieves considerable speedups and comparable accuracy as the standard training baseline. Compared to other token dropping methods, random-LTD does not require (1) any importance score-based metrics, (2) any special token treatment (e.g., [CLS]), and (3) many layers in full sequence length training except the first and the last layers. Besides, a new LayerToken learning rate schedule is proposed for pretraining problems that resolve the heavy tuning requirement for our proposed training mechanism. Finally, we demonstrate that random-LTD can be applied to broader applications, including GPT and BERT pretraining as well as ViT and GPT finetuning tasks. Our results show that random-LTD can save about 33.3% theoretical compute cost and 25.6% wall-clock training time while achieving similar zero-shot evaluations on GPT-31.3B as compared to baseline.

cs.CL↗

arXiv2022

Uncertainty-Aware Multi-Parametric Magnetic Resonance Image Information Fusion for 3D Object Segmentation

Multi-parametric magnetic resonance (MR) imaging is an indispensable tool in the clinic. Consequently, automatic volume-of-interest segmentation based on multi-parametric MR imaging is crucial for computer-aided disease diagnosis, treatment planning, and prognosis monitoring. Despite the extensive studies conducted in deep learning-based medical image analysis, further investigations are still required to effectively exploit the information provided by different imaging parameters. How to fuse the information is a key question in this field. Here, we propose an uncertainty-aware multi-parametric MR image feature fusion method to fully exploit the information for enhanced 3D image segmentation. Uncertainties in the independent predictions of individual modalities are utilized to guide the fusion of multi-modal image features. Extensive experiments on two datasets, one for brain tissue segmentation and the other for abdominal multi-organ segmentation, have been conducted, and our proposed method achieves better segmentation performance when compared to existing models.

eess.IV↗

arXiv2022

Semi-Supervised and Self-Supervised Collaborative Learning for Prostate 3D MR Image Segmentation

Volumetric magnetic resonance (MR) image segmentation plays an important role in many clinical applications. Deep learning (DL) has recently achieved state-of-the-art or even human-level performance on various image segmentation tasks. Nevertheless, manually annotating volumetric MR images for DL model training is labor-exhaustive and time-consuming. In this work, we aim to train a semi-supervised and self-supervised collaborative learning framework for prostate 3D MR image segmentation while using extremely sparse annotations, for which the ground truth annotations are provided for just the central slice of each volumetric MR image. Specifically, semi-supervised learning and self-supervised learning methods are used to generate two independent sets of pseudo labels. These pseudo labels are then fused by Boolean operation to extract a more confident pseudo label set. The images with either manual or network self-generated labels are then employed to train a segmentation model for target volume extraction. Experimental results on a publicly available prostate MR image dataset demonstrate that, while requiring significantly less annotation effort, our framework generates very encouraging segmentation results. The proposed framework is very useful in clinical applications when training data with dense annotations are difficult to obtain.

cs.CV↗

arXiv2022

Adaptive PromptNet For Auxiliary Glioma Diagnosis without Contrast-Enhanced MRI

Multi-contrast magnetic resonance imaging (MRI)-based automatic auxiliary glioma diagnosis plays an important role in the clinic. Contrast-enhanced MRI sequences (e.g., contrast-enhanced T1-weighted imaging) were utilized in most of the existing relevant studies, in which remarkable diagnosis results have been reported. Nevertheless, acquiring contrast-enhanced MRI data is sometimes not feasible due to the patients physiological limitations. Furthermore, it is more time-consuming and costly to collect contrast-enhanced MRI data in the clinic. In this paper, we propose an adaptive PromptNet to address these issues. Specifically, a PromptNet for glioma grading utilizing only non-enhanced MRI data has been constructed. PromptNet receives constraints from features of contrast-enhanced MR data during training through a designed prompt loss. To further boost the performance, an adaptive strategy is designed to dynamically weight the prompt loss in a sample-based manner. As a result, PromptNet is capable of dealing with more difficult samples. The effectiveness of our method is evaluated on a widely-used BraTS2020 dataset, and competitive glioma grading performance on NE-MRI data is achieved.

eess.IV↗

arXiv2022

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing automatic segmentation methods, multi-modal MRI data are still unavailable in real-world clinical applications due to quite a few uncontrollable factors (e.g. different imaging protocols, data corruption, and patient condition limitations), which lead to a large performance drop during practical applications. In this work, we propose a Deeply supervIsed knowledGE tranSfer neTwork (DIGEST), which achieves accurate brain tumor segmentation under different modality-missing scenarios. Specifically, a knowledge transfer learning frame is constructed, enabling a student model to learn modality-shared semantic information from a teacher model pretrained with the complete multi-modal MRI data. To simulate all the possible modality-missing conditions under the given multi-modal data, we generate incomplete multi-modal MRI samples based on Bernoulli sampling. Finally, a deeply supervised knowledge transfer loss is designed to ensure the consistency of the teacher-student structure at different decoding stages, which helps the extraction of inherent and effective modality representations. Experiments on the BraTS 2020 dataset demonstrate that our method achieves promising results for the incomplete multi-modal MR image segmentation task.

eess.IV↗

arXiv2022

PARCEL: Physics-based Unsupervised Contrastive Representation Learning for Multi-coil MR Imaging

With the successful application of deep learning to magnetic resonance (MR) imaging, parallel imaging techniques based on neural networks have attracted wide attention. However, in the absence of high-quality, fully sampled datasets for training, the performance of these methods is limited. And the interpretability of models is not strong enough. To tackle this issue, this paper proposes a Physics-bAsed unsupeRvised Contrastive rEpresentation Learning (PARCEL) method to speed up parallel MR imaging. Specifically, PARCEL has a parallel framework to contrastively learn two branches of model-based unrolling networks from augmented undersampled multi-coil k-space data. A sophisticated co-training loss with three essential components has been designed to guide the two networks in capturing the inherent features and representations for MR images. And the final MR image is reconstructed with the trained contrastive networks. PARCEL was evaluated on two vivo datasets and compared to five state-of-the-art methods. The results show that PARCEL is able to learn essential representations for accurate MR reconstruction without relying on fully sampled datasets.

eess.IV↗