arXiv Science⌕ Search

arXiv subjects

Zhiyuan Li

Publications and source records attributed to Zhiyuan Li.

At least 235 records · Page 13Linked to original sources
arXiv2024

Traditional Transformation Theory Guided Model for Learned Image Compression

Recently, many deep image compression methods have been proposed and achieved remarkable performance. However, these methods are dedicated to optimizing the compression performance and speed at medium and high bitrates, while research on ultra low bitrates is limited. In this work, we propose a ultra low bitrates enhanced invertible encoding network guided by traditional transformation theory, experiments show that our codec outperforms existing methods in both compression and reconstruction performance. Specifically, we introduce the Block Discrete Cosine Transformation to model the sparsity of features and employ traditional Haar transformation to improve the reconstruction performance of the model without increasing the bitstream cost.

eess.IV↗
arXiv2024

A Fermi-LAT Study of Globular Cluster Dynamical Evolution in the Milky Way: Millisecond Pulsars as the Probe

Using archival {\it Fermi}-LAT data with a time span of $\sim12$ years, we study the population of Millisecond Pulsars (MSPs) in Globular Clusters (GlCs) and investigate their dependence on cluster dynamical evolution in the Milky Way Galaxy. We show that the $γ$-ray luminosity ($L_γ$) and emissivity ($ε_γ=L_γ/M$) are good indicators of the population and abundance of MSPs in GlCs, and they are highly dependent on the dynamical evolution history of the host clusters. Specifically speaking, the dynamically older GlCs with more compact structures are more likely to have larger $L_γ$ and $ε_γ$, and these trends can be summarized as strong correlations with cluster stellar encounter rate $Γ$ and the specific encounter rate ($Λ=Γ/M$), with $L_γ\propto Γ^{0.70\pm0.11}$ and $ε_γ\propto Λ^{0.73\pm0.13}$ for dynamically normal GlCs. However, as GlCs evolve into deep core collapse, these trends are found to be reversed, implying that strong encounters may have lead to the ejection of MSPs from core-collapsed Systems. Besides, the GlCs are found to exhibit larger $ε_γ$ with increasing stellar mass function slope, decreasing tidal radius and distances from the Galactic Center (GC). These correlations indicate that, as GlCs losing kinetic energy and spiral in towards GC, tidal stripping and mass segregation have a preference in leading to the loss of normal stars from GlCs, while MSPs are more likely to concentrate to cluster center and be deposited into the GC. Moreover, we gauge $ε_γ$ of GlCs is $\sim10-1000$ times larger than the Galactic bulge, the latter is thought to reside thousands of unresolved MSPs and may responsible for the GC $γ$-ray excess, which support that GlCs are generous contributors to the population of MSPs in the GC.

astro-ph.GA↗
arXiv2024

Backpropagation Through Agents

A fundamental challenge in multi-agent reinforcement learning (MARL) is to learn the joint policy in an extremely large search space, which grows exponentially with the number of agents. Moreover, fully decentralized policy factorization significantly restricts the search space, which may lead to sub-optimal policies. In contrast, the auto-regressive joint policy can represent a much richer class of joint policies by factorizing the joint policy into the product of a series of conditional individual policies. While such factorization introduces the action dependency among agents explicitly in sequential execution, it does not take full advantage of the dependency during learning. In particular, the subsequent agents do not give the preceding agents feedback about their decisions. In this paper, we propose a new framework Back-Propagation Through Agents (BPTA) that directly accounts for both agents' own policy updates and the learning of their dependent counterparts. This is achieved by propagating the feedback through action chains. With the proposed framework, our Bidirectional Proximal Policy Optimisation (BPPO) outperforms the state-of-the-art methods. Extensive experiments on matrix games, StarCraftII v2, Multi-agent MuJoCo, and Google Research Football demonstrate the effectiveness of the proposed method.

cs.MA↗
arXiv2023

Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopment

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and enhancing disease diagnosis. The development of such a technique hinges on the efficient fusion of heterogeneous multimodal features, which initially reside within distinct representation spaces. Naively fusing the multimodal features does not adequately capture the complementary information and could even produce redundancy. In this work, we present a novel joint self-supervised and supervised contrastive learning method to learn the robust latent feature representation from multimodal MRI data, allowing the projection of heterogeneous features into a shared common space, and thereby amalgamating both complementary and analogous information across various modalities and among similar subjects. We performed a comparative analysis between our proposed method and alternative deep multimodal learning approaches. Through extensive experiments on two independent datasets, the results demonstrated that our method is significantly superior to several other deep multimodal learning methods in predicting abnormal neurodevelopment. Our method has the capability to facilitate computer-aided diagnosis within clinical practice, harnessing the power of multimodal data.

eess.IV↗
arXiv2023

X-Ray Constraints on the Hot Gaseous Corona of Edge-on Late-type Galaxies in Virgo

We present a systematic study of the putative hot gas corona around late-type galaxies (LTGs) residing in the Virgo cluster, based on archival Chandra observations. Our sample consists of 21 nearly edge-on galaxies representing a star formation rate (SFR) range of ($0.2-3\rm~M_\odot~yr^{-1}$) a stellar mass ($M_*$) range of $(0.2-10) \times 10^{10}\rm~M_{\odot}$, the majority of which have not been explored with high-sensitivity X-ray observations so far. Significant extraplanar diffuse X-ray (0.5-2 keV) emission is detected in only three LTGs, which are also the three galaxies with the highest SFR. A stacking analysis is performed for the remaining galaxies without individual detection, dividing the whole sample into two subsets based on SFR, stellar mass, or specific SFR. Only the high-SFR bin yields a significant detection, which has a value of $L\rm_X \sim3\times10^{38}\rm~erg~s^{-1}$ per galaxy. The stacked extraplanar X-ray signals of the Virgo LTGs are consistent with the empirical $L\rm_X - SFR$ and $L\rm_X - M_*$ relations found among highly inclined disk galaxies in the field, but appear to be systematically lower than that of a comparison sample of simulated cluster star-formation galaxies identified from the Illustris-TNG100 simulation. The apparent paucity of hot gas coronae in the sampled Virgo LTGs might be understood as the net outcome of the long-lasting effect of ram pressure stripping exerted by the hot intra-cluster medium and in-disk star-forming activity acting on shorter timescales. A better understanding of the roles of environmental effects in regulating the hot gas content of cluster galaxies invites sensitive X-ray observations for a large galaxy sample.

astro-ph.GA↗
arXiv2023

A Statistical Study of Soft X-ray Flares on Solar-type Stars

The statistical characteristic of stellar flares at optical bands has received an extensive study, but it remains to be studied at soft X-ray bands, in particular for solar-type stars. Here, we present a statistical study of soft X-ray flares on solar-type stars, which can help understand multi-wavelength behaviors of stellar flares. We mainly use Chandra Source Catalog Release 2.0, which includes a number of flaring stars with denoted variability, and Gaia Data Release 3, which includes necessary information for classifying stars. We also develop a set of methods for identifying and classifying stellar soft X-ray flares and estimating their properties. A detailed statistical investigation for 129 flare samples on 103 nearby solar-type stars as selected yields the following main results. (1) The flare energy emitted at the soft X-ray band in our sample ranges from $\sim 10^{33}$ to $\sim 10^{37} \ \mathrm{erg}$, and the majority of them are superflares with the most energetic one having energy of $6.0_{-4.7}^{+3.2} \times 10^{37} \ \mathrm{erg}$. (2) The flare duration is related to its energy as formulated by $T_\mathrm{duration,SXR} \propto E_\mathrm{flare,SXR}^{\ 0.201 \pm 0.024}$, which is different from those derived at optical and NIR bands, indicating distinct radiation mechanisms at different bands. (3) The frequency distribution of stellar flares as a function of energy is formulated as $\mathrm{d} N_\mathrm{flare} / \mathrm{d} E_\mathrm{flare,SXR} \propto E_\mathrm{flare,SXR}^{\ -1.77}$, which is similar to the results found at other bands and on other types of stars, indicating that the energy emitted at the soft X-ray band could be a constant fraction of the full-band bolometric energy.

astro-ph.SR↗
arXiv2023

A Chandra Survey of Milky Way Globular Clusters -- IV. Periodic X-ray sources

We present a systematic search for periodic X-ray sources in 10 Galactic globular clusters (GCs) utilizing deep archival Chandra observations. By applying the Gregory-Loredo algorithm, we detect 28 periodic signals among 27 independent X-ray sources in 6 GCs, which include 21 newly discovered ones in the X-ray band. The remaining 4 GCs exhibit no periodic X-ray sources, mainly due to a relatively lower sensitivity of the data. Through analysis of their X-ray timing and spectral properties, complemented with available optical and ultraviolet information, we identify 21 of these periodic sources as cataclysmic variables (CVs). Combining with 11 periodic CVs in 47 Tuc similarly identified in the X-ray band, we compile the most comprehensive sample to date of GC CVs with a probable orbital period. The scarcity of old, short-period CVs in GCs compared to the Galactic inner bulge and solar neighborhood, can be attributed to both a selection effect favouring younger, dynamically-formed systems and the hindrance of CV formation through primordial binary evolution by stellar dynamical interactions common to the GC environment. Additionally, we identify a significant fraction of the GC CVs, most with an orbital period below or within the CV period gap, as probable magnetic CVs, but in the meantime there is a deficiency of luminous intermediate polars in the GC sample compared to the solar neighborhood.

astro-ph.HE↗
arXiv2023

Simultaneous uniqueness and numerical inversion for an inverse problem in the time-domain diffuse optical tomography with fluorescence

In this work, an inverse problem on the determination of multiple coefficients arising from the time-domain diffuse optical tomography with fluorescence (DOT-FDOT) is investigated. We simultaneously recover the distribution of background absorption coefficient, photon diffusion coefficient as well as the fluorescence absorption in biological tissue by the time-dependent boundary measurements. We build the uniqueness theorem of this multiple coefficients simultaneous inverse problem. After that, the numerical inversions are considered. We introduce an accelerated Landweber iterative algorithm and give several numerical examples illustrating the performance of the proposed inversion schemes.

math.NA↗
arXiv2023

Complex Organ Mask Guided Radiology Report Generation

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario, radiologists frequently face the challenge of producing extensive reports derived from numerous medical images, thereby medical report generation from multi-image perspective is needed. In this paper, we propose the Complex Organ Mask Guided (termed as COMG) report generation model, which incorporates masks from multiple organs (e.g., bones, lungs, heart, and mediastinum), to provide more detailed information and guide the model's attention to these crucial body regions. Specifically, we leverage prior knowledge of the disease corresponding to each organ in the fusion process to enhance the disease identification phase during the report generation process. Additionally, cosine similarity loss is introduced as target function to ensure the convergence of cross-modal consistency and facilitate model optimization.Experimental results on two public datasets show that COMG achieves a 11.4% and 9.7% improvement in terms of BLEU@4 scores over the SOTA model KiUT on IU-Xray and MIMIC, respectively. The code is publicly available at https://github.com/GaryGuTC/COMG_model.

cs.CV↗
arXiv2023

CAHA/PPAK Integral-field Spectroscopic Observations of M81. II. Testing Photoionization Models in A Spatially-resolved LINER

The origin of the low-ionization nuclear emission-line region (LINER) prevalent in local galaxies and its relationship with supermassive black holes are debated for decades. We preform a comprehensive evaluation of traditional photoionization models against the circumnuclear ionized gas in M81, for which recent CAHA/PPAK integral-field spectroscopic observations reveal a LINER characteristic out to a galactocentric radius of ~1 kpc. Constructed with the photoionization code cloudy, the models have the novel aspect of their primary parameters being well constrained by extensive observations of a prototypical low-luminosity active galactic nucleus (LLAGN) and an old stellar bulge in M81. Additionally, these models incorporate a reasonably broad range of uncertain nebular properties. It is found that the integrated photoionization by the LLAGN and hot, low-mass stars distributed in the bulge can roughly reproduce the observed radial intensity distributions of the Halpha, Hbeta and [N ii] lines, with the bulge stars dominating the ionizing flux at radii >~200 pc. However, the models generally fail to reproduce a similarly declining profile of the [Oiii] line or an accordingly flat profile of the [O iii]/Hbeta ratio. This clearly points to a deficiency of ionizing photons in the outer regions despite an extended photoionization source. The discrepancy might be alleviated if much of the observed [O iii] line arose from a bulge-filling, low-density gas surrounding a denser, Halpha-emitting disk, or by a higher AGN luminosity in the recent past. The case of M81 has important implications for the ionization mechanism of LINERs and low-ionization emission-line regions in general.

astro-ph.GA↗
arXiv2023

Bayesian optimization with active learning of Ta-Nb-Hf-Zr-Ti system for spin transport properties

Designing materials with enhanced spin charge conversion, i.e., with high spin Hall conductivity (SHC) and low longitudinal electric conductivity (hence large spin Hall angle (SHA)), is a challenging task, especially in the presence of a vast chemical space for compositionally complex alloys (CCAs). In this work, focusing on the Ta-Nb-Hf-Zr-Ti system, we confirm that CCAs exhibit significant spin Hall conductivities and propose a multi-objective Bayesian optimization approach (MOBO) incorporated with active learning (AL) in order to screen for the optimal compositions with significant SHC and SHA. As a result, within less than 5 iterations we are able to target the TaZr-dominated systems displaying both high magnitudes of SHC (~-2.0 (10$^{-3}$ $Ω$ cm)$^{-1}$) and SHA (~0.03). The SHC is mainly ascribed to the extrinsic skew scattering mechanism. Our work provides an efficient route for identifying new materials with significant SHE, which can be straightforwardly generalized to optimize other properties in a vast chemical space.

cond-mat.mtrl-sci↗
arXiv2023

AMUSE-antlia I: Nuclear X-ray properties of early-type galaxies in a dynamically young galaxy cluster

To understand the formation and growth of supermassive black holes (SMBHs) and their co-evolution with host galaxies, it is essential to know the impact of environment on the activity of active galactic nuclei (AGN). We present new Chandra X-ray observations of nuclear emission from member galaxies in the Antlia cluster, the nearest non-cool core and the nearest merging galaxy cluster, residing at D = 35.2 Mpc. Its inner region, centered on two dominant galaxies NGC 3268 and NGC 3258, has been mapped with three deep Chandra ACIS-I pointings. Nuclear X-ray sources are detected in 7/84 (8.3%) early-type galaxies (ETG) and 2/8 (25%) late-type galaxies with a median detection limit of 8x10^38 erg/s. All nuclear X-ray sources but one have a corresponding radio continuum source detected by MeerKAT at the L-band. Nuclear X-ray sources detected in early-type galaxies are considered as the genuine X-ray counterpart of low-luminosity AGN. When restricted to a detection limit of logLx(erg/s) > 38.9 and a stellar mass of 10 < log Ms(Msun) <11.6, 6/11 (54.5%) ETG are found to contain an X-ray AGN in Antlia, exceeding the AGN occupation fraction of 7/39 (18.0%) and 2/12 (16.7%) in the more relaxed, cool core clusters, Virgo and Fornax, respectively, and rivaling that of the AMUSE-Field ETG of 27/49 (55.1%). Furthermore, more than half of the X-ray AGN in Antlia are hosted by its younger subcluster, centered on NGC 3258. We believe that this is because SMBH activity is enhanced in a dynamically young cluster compared to relatively relaxed clusters.

astro-ph.GA↗
arXiv2023

Algebraic reverse Khovanskii--Teissier inequality via Okounkov bodies

Let $X$ be a projective variety of dimension $n$ over an algebraically closed field of arbitrary characteristic and let $A, B, C$ be nef divisors on $X$. We show that for any integer $1\leq k\leq n-1$, $$ (B^k\cdot A^{n-k})\cdot (A^k\cdot C^{n-k})\geq \frac{k!(n-k)!}{n!}(A^n)\cdot (B^k\cdot C^{n-k}). $$ The same inequality in the analytic setting was obtained by Lehmann and Xiao for compact Kähler manifolds using the Calabi--Yau theorem, while our approach is purely algebraic using (multipoint) Okounkov bodies. We also discuss applications of this inequality to Bézout-type inequalities and inequalities on degrees of dominant rational self-maps.

math.AG↗
arXiv2023

Distributionally Robust Optimization and Invariant Representation Learning for Addressing Subgroup Underrepresentation: Mechanisms and Limitations

Spurious correlation caused by subgroup underrepresentation has received increasing attention as a source of bias that can be perpetuated by deep neural networks (DNNs). Distributionally robust optimization has shown success in addressing this bias, although the underlying working mechanism mostly relies on upweighting under-performing samples as surrogates for those underrepresented in data. At the same time, while invariant representation learning has been a powerful choice for removing nuisance-sensitive features, it has been little considered in settings where spurious correlations are caused by significant underrepresentation of subgroups. In this paper, we take the first step to better understand and improve the mechanisms for debiasing spurious correlation due to subgroup underrepresentation in medical image classification. Through a comprehensive evaluation study, we first show that 1) generalized reweighting of under-performing samples can be problematic when bias is not the only cause for poor performance, while 2) naive invariant representation learning suffers from spurious correlations itself. We then present a novel approach that leverages robust optimization to facilitate the learning of invariant representations at the presence of spurious correlations. Finetuned classifiers utilizing such representation demonstrated improved abilities to reduce subgroup performance disparity, while maintaining high average and worst-group performance.

cs.CV↗
arXiv2023

Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization

Despite extensive studies, the underlying reason as to why overparameterized neural networks can generalize remains elusive. Existing theory shows that common stochastic optimizers prefer flatter minimizers of the training loss, and thus a natural potential explanation is that flatness implies generalization. This work critically examines this explanation. Through theoretical and empirical investigation, we identify the following three scenarios for two-layer ReLU networks: (1) flatness provably implies generalization; (2) there exist non-generalizing flattest models and sharpness minimization algorithms fail to generalize, and (3) perhaps most surprisingly, there exist non-generalizing flattest models, but sharpness minimization algorithms still generalize. Our results suggest that the relationship between sharpness and generalization subtly depends on the data distributions and the model architectures and sharpness minimization algorithms do not only minimize sharpness to achieve better generalization. This calls for the search for other explanations for the generalization of over-parameterized neural networks.

cs.LG↗
arXiv2023

Prototype-Driven and Multi-Expert Integrated Multi-Modal MR Brain Tumor Image Segmentation

For multi-modal magnetic resonance (MR) brain tumor image segmentation, current methods usually directly extract the discriminative features from input images for tumor sub-region category determination and localization. However, the impact of information aliasing caused by the mutual inclusion of tumor sub-regions is often ignored. Moreover, existing methods usually do not take tailored efforts to highlight the single tumor sub-region features. To this end, a multi-modal MR brain tumor segmentation method with tumor prototype-driven and multi-expert integration is proposed. It could highlight the features of each tumor sub-region under the guidance of tumor prototypes. Specifically, to obtain the prototypes with complete information, we propose a mutual transmission mechanism to transfer different modal features to each other to address the issues raised by insufficient information on single-modal features. Furthermore, we devise a prototype-driven feature representation and fusion method with the learned prototypes, which implants the prototypes into tumor features and generates corresponding activation maps. With the activation maps, the sub-region features consistent with the prototype category can be highlighted. A key information enhancement and fusion strategy with multi-expert integration is designed to further improve the segmentation performance. The strategy can integrate the features from different layers of the extra feature extraction network and the features highlighted by the prototypes. Experimental results on three competition brain tumor segmentation datasets prove the superiority of the proposed method.

eess.IV↗
arXiv2023

Bond-based nonlocal models by nonlocal operator method in symmetric support domain

This paper is concerned with the energy decomposition of various nonlocal models, including elasticity, thin plates, and gradient elasticity, to arrive at bond-based nonlocal models in which the bond force depends only on the deformation of a single bond. By assuming an appropriate form of bond force and using energy equivalence between local and nonlocal models, several very concise bond-based models are derived. We also revisit the nonlocal operator methods and study the simplified form of second-order NOM in the symmetric support domain. A bent-bond consisting of three points is proposed to describe the curvature and moment. To model the damage, a rule based on Griffith theory for the critical normal strain of the bond is proposed in analogy to the phase field model, which can be applied individually to each bond and provides strain localization. With this rule, the crack direction can be automatically predicted by simply cutting the bond, giving comparable results to the phase field method. At the same time, a damage rule for critical shear strains in shear fractures is proposed. Furthermore, an incremental form of the plasticity model for bond reaction force is derived. Several numerical examples are presented to further validate the nonlocal bond-based models.

physics.class-ph↗
arXiv2023

The Inductive Bias of Flatness Regularization for Deep Matrix Factorization

Recent works on over-parameterized neural networks have shown that the stochasticity in optimizers has the implicit regularization effect of minimizing the sharpness of the loss function (in particular, the trace of its Hessian) over the family zero-loss solutions. More explicit forms of flatness regularization also empirically improve the generalization performance. However, it remains unclear why and when flatness regularization leads to better generalization. This work takes the first step toward understanding the inductive bias of the minimum trace of the Hessian solutions in an important setting: learning deep linear networks from linear measurements, also known as \emph{deep matrix factorization}. We show that for all depth greater than one, with the standard Restricted Isometry Property (RIP) on the measurements, minimizing the trace of Hessian is approximately equivalent to minimizing the Schatten 1-norm of the corresponding end-to-end matrix parameters (i.e., the product of all layer matrices), which in turn leads to better generalization. We empirically verify our theoretical findings on synthetic datasets.

cs.LG↗