arXiv subjects

Zhiyuan Li

Publications and source records attributed to Zhiyuan Li.

At least 163 records · Page 9Linked to original sources

arXiv2025

Robust Containerization of the High Angular Resolution Functional Imaging (HARFI) Pipeline

Historically, functional magnetic resonance imaging (fMRI) of the brain has focused primarily on gray matter, particularly the cortical gray matter and associated nuclei. However, recent work has demonstrated that functional activity in white matter also plays a meaningful role in both cognition and learning. In previous work, we introduced the High Angular Resolution Functional Imaging (HARFI) pipeline, which demonstrated both local and global patterns of functional correlation in white matter. Notably, HARFI enabled exploration of asymmetric voxel-wise correlation using odd-order spherical harmonics. Although the original implementation of HARFI was released via GitHub, adoption was limited due to the technical complexity of running the source code. In this work, we present a robust and efficient containerized version of the HARFI pipeline, enabling seamless execution across multiple public datasets. Our goal is to facilitate broader and deeper exploration of functional white matter architecture, especially through the lens of high angular resolution functional correlations. The key innovation of this work is the containerized implementation, which we have made available under a permissive open-source license to support reproducible and accessible research practices.

physics.med-ph↗

arXiv2025

N-body simulations of galaxy bars generated by satellite collisions: effects of the impact geometry

Bars, a common and important structure in disk galaxies, can be induced by galaxy interactions. Although there have been some studies on bar formation in flybys or collisions, the vast parameter space still leaves many scenarios that require further investigation. Here, we focus on the role of collisions caused by small galaxies (denoted as intruders), referred to as satellite collisions, in bar formation for MW/M31-like galaxies (denoted as target galaxies). Multiple sets of simulations with varying intruder initial velocities, inclination angles, collision positions, and intruder masses were run to study the dependence of this mechanism on these parameters. Our simulations show that bar formation favors moderate collision velocity, large inclination angle, off-center collision position, and large intruder mass. However, the bar's pattern speed and length are insensitive to these parameters, as the intruder's mass is relatively small compared to that of the target galaxy itself. Moreover, based on our tests, the intruder mass should be more than $\sim 3\times10^{9}$ ${\rm M}_{\odot}$ in order for this bar formation mechanism to operate effectively in MW/M31-like galaxies. Our work suggests the possibility that satellite collisions may have contributed, to some extent, to the bar formation in the Milky Way or M31.

astro-ph.GA↗

arXiv2025

PENCIL: Long Thoughts with Short Memory

While state-of-the-art LLMs have demonstrated great promise of using long Chains-of-Thought (CoT) to boost reasoning, scaling it up to more challenging problems at test-time is fundamentally limited by suboptimal memory usage -- intermediate computations accumulate indefinitely in context even when no longer needed for future thoughts. We introduce PENCIL, which incorporates a novel reduction mechanism into the autoregressive generation process that recursively cleans up intermediate thoughts based on patterns learned from training. By iteratively generating and erasing thoughts, PENCIL can think deeper to solve harder problems using shorter context and less compute. Empirically, we observe PENCIL is significantly more effective and efficient than CoT. For example, we demonstrate PENCIL with a small 25M-parameter transformer and 2048 context length solves Einstein's puzzle -- a task that challenges much larger models like GPT-4. Theoretically, we prove PENCIL can perform universal efficient computation by simulating any Turing machines with optimal time and space complexity, and thus can solve arbitrary computable tasks that are otherwise intractable for vanilla CoT.

cs.LG↗

arXiv2025

Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning

Federated learning (FL) allows multiple clients to collaboratively train a global machine learning model with coordination from a central server, without needing to share their raw data. This approach is particularly appealing in the era of privacy regulations like the GDPR, leading many prominent companies to adopt it. However, FL's distributed nature makes it susceptible to poisoning attacks, where malicious clients, controlled by an attacker, send harmful data to compromise the model. Most existing poisoning attacks in FL aim to degrade the model's integrity, such as reducing its accuracy, with limited attention to privacy concerns from these attacks. In this study, we introduce FedPoisonMIA, a novel poisoning membership inference attack targeting FL. FedPoisonMIA involves malicious clients crafting local model updates to infer membership information. Additionally, we propose a robust defense mechanism to mitigate the impact of FedPoisonMIA attacks. Extensive experiments across various datasets demonstrate the attack's effectiveness, while our defense approach reduces its impact to a degree.

cs.CR↗

arXiv2025

Derived isogenies and isogenies for abelian surfaces

In this paper, we study the twisted Fourier-Mukai partners of abelian surfaces. Following the work of Huybrechts [doi:10.4171/CMH/465], we introduce the twisted derived equivalence between abelian surfaces. We show that there is a twisted derived Torelli theorem for abelian surfaces over algebraically closed fields with characteristic $\neq 2,3$. Over complex numbers, the derived isogenies correspond to rational Hodge isometries between the second cohomology groups, which is in analogy to the work of Huybrechts and Fu-Vial on K3 surfaces. Their proof relies on the global Torelli theorem over $\mathbb{C}$, which is missing in positive characteristics. To overcome this issue, we firstly extend a trick given by Shioda on integral Hodge structures, to rational Hodge structures, $\ell$-adic Tate modules and $F$-crystals. Then we make use of Tate's isogeny theorem to give a characterization of the twisted derived equivalences between abelian surfaces via isogenies. As a consequence, we show the two abelian surfaces are principally isogenous if and only if they are derived isogenous.

math.AG↗

arXiv2025

Numerical analysis of scattered point measurement-based regularization for backward problems for fractional wave equations

In this work, our aim is to reconstruct the unknown initial value from terminal data. We develop a numerical framework on nonuniform time grids for fractional wave equations under the lower regularity assumptions. Then, we introduce a regularization method that effectively handles scattered point measurements contaminated with stochastic noise. The optimal error estimates of stochastic convergence not only balance discretization errors, the noise, and the number of observation points, but also propose an a priori choice of regularization parameters. Finally, several numerical experiments are presented to demonstrate the efficiency and accuracy of the algorithm.

math.NA↗

arXiv2025

Scattered point measurement-based regularization for backward problems for fractional wave equations

In this work, we are devoted to the reconstruction of an unknown initial value from the terminal data. The asymptotic and root-distribution properties of Mittag-Leffler functions are used to establish stability of the backward problem. Furthermore, we introduce a regularization method that effectively handles scattered point measurements contaminated with stochastic noise. Furthermore, we prove the stochastic convergence of our proposed regularization and provide an iterative algorithm to find the optimal regularization parameter. Finally, several numerical experiments are presented to demonstrate the efficiency and accuracy of the algorithm.

math.NA↗

arXiv2025

Filtrations on the derived category of twisted K3 surfaces

We introduce and study the Shen-Yin-Zhao filtration on derived categories of twisted K3 surfaces. A main contribution is the construction of a twisted Beauville-Voisin class $\mathfrak{o}_{\mathscr{X}} \in \operatorname{CH}_0(X)$ that extends fundamental results of O'Grady and Shen-Yin-Zhao \cite{OG13, SYZ20} to twisted settings. This class enables: 1. A derived equivalence-invariant filtration $\mathbf{S}_\bullet(\mathrm{D}^{(1)}(\mathscr{X}))$ preserved under Fourier-Mukai transforms, 2. A birational invariant filtration $\mathbf{S}^{\mathrm{SYZ}}_\bullet \operatorname{CH}_0$ on Bridgeland moduli spaces. We prove $\mathbf{S}^{\mathrm{SYZ}}_\bullet \operatorname{CH}_0$ coincides with Voisin's filtration $\mathbf{S}^{\mathrm{BV}}_\bullet\operatorname{CH}_0$ (Theorem 1.4), providing a canonical candidate for the conjectural Beauville-Voisin filtration. Applications include Bloch's conjecture for (anti)-symplectic automorphisms and existence of algebraically coisotropic subvarieties.

math.AG↗

arXiv2025

The Picard group of the Baily--Borel compactification of the moduli space of quasi-polarized K3 surfaces and generalizations

In this paper, we investigate the Picard group of the Baily--Borel compactification of orthogonal Shimura varieties. As a key result, we determine the Picard group of the Baily--Borel compactification of the moduli space of quasi-polarized K3 surfaces, proving that it is isomorphic to $\mathbb{Z}$. Notably, this contrasts with the moduli space of smooth curves, where the Picard group exhibits a more complex structure after natural compactification. Our result follows from a general theorem for orthogonal Shimura varieties: for even lattices $M$ of signature $(2,n)$ with $n > 8$ satisfying specific arithmetic conditions (e.g. K3 type or $p$-elementary), the rational Picard group of $\overline{\operatorname{Sh}}_Γ(M)$ with $Γ$ containing the stable orthogonal group is $1$-dimensional. The core of our proof lies in constructing an arithmetic obstruction space that governs the extension of Heegner divisors to the generic points of the boundary in orthogonal Shimura varieties. We further establish a connection between this obstruction space and the space of theta series, demonstrating that the obstruction space is maximal under our conditions.

math.AG↗

arXiv2025

Adam Exploits $\ell_\infty$-geometry of Loss Landscape via Coordinate-wise Adaptivity

Adam outperforms SGD when training language models. Yet this advantage is not well-understood theoretically -- previous convergence analysis for Adam and SGD mainly focuses on the number of steps $T$ and is already minimax-optimal in non-convex cases, which are both $\widetilde{O}(T^{-1/4})$. In this work, we argue that the exploitation of nice $\ell_\infty$-geometry is the key advantage of Adam over SGD. More specifically, we give a new convergence analysis for Adam under novel assumptions that loss is smooth under $\ell_\infty$-geometry rather than the more common $\ell_2$-geometry, which yields a much better empirical smoothness constant for GPT-2 and ResNet models. Our experiments confirm that Adam performs much worse when the favorable $\ell_\infty$-geometry is changed while SGD provably remains unaffected. We also extend the convergence analysis to blockwise Adam under novel blockwise smoothness assumptions.

cs.LG↗

arXiv2025

AMUSE-Antlia. II. Intracluster X-ray Population in the Antlia Cluster

We conduct a systematic survey of X-ray sources in the inner ($r\sim200$ kpc) region of the Antlia cluster based on \Chandra observations, down to a source detection limit of $ L(0.5\text{--}8\ \mathrm{keV})\sim4.2\times10^{-7}\ \mathrm{ph\ cm^{-2}\ s^{-1}}$ ($2\times10^{38}\ \mathrm{erg\ s^{-1}}$). We present an X-ray source catalog with 202 sources and provide their coordinates, multi-band flux information and hardness ratios. We find a statistically significant excess at a significance level of $4.2σ$ with 37.6 excess sources beyond three times the mean effective radius of the two BCGs. This implies that these excess sources could be a genuine intracluster X-ray population that is not associated with the bulk stellar component. Also, the increased number of excess sources in the fields containing a BCG implies a potential connection between the excess sources and BCGs. The discovery of these sources in the Antlia cluster, together with previous research of similar findings in other two nearby clusters, Virgo and Fornax, indicates that the intracluster X-ray population could be universal in nearby galaxy clusters. Furthermore, we discuss the candidate origins of the excess sources, including low-mass X-ray binaries (LMXBs) associated with intracluster light (ICL-LMXBs), LMXBs in globular clusters (GC-LMXBs) and supernova-kicked LMXBs (SN-kicked LMXBs). We estimate the contribution of ICL-LMXBs, which should include the LMXBs relating with the stellar halo surrounding BCGs, are unlikely to dominate the intracluster X-ray population in Antlia. Meanwhile, GC-LMXBs and SN-kicked LMXBs, each component could contribute $\sim30\%$ to the total excess sources.

astro-ph.HE↗

arXiv2025

Chandra X-ray Measurement of Heavy Element Abundances of Wolf-Rayet Stars in the Galactic Center

Elemental abundances hold important information about the star formation history in the Galactic Center. The thermal X-ray spectra of certain stars can provide a robust probe of elemental abundances, mainly through the presence of K-shell emission lines. In this work, based on deep archival {\it Chandra} observations, we obtain X-ray measurements of five heavy elements (Si, S, Ar, Ca and Fe) for three sources in the Arches cluster, one source in the Quintuplet cluster, as well as a field source known as Edd 1, which are all probable WR stars exhibiting a high quality X-ray spectrum. A two-temperature, non-equilibrium ionization plasma model is employed for the spectral fit, taking into account light element compositions characteristic of WR star winds, which is substantially depleted in hydrogen but enriched in nitrogen and/or carbon. It is found that the Arches and Quintuplet WR stars share similar abundances of Si, S, and Ar, while exhibiting distinct Ca and Fe abundances, which may be understood as due to dust depletion of the latter two elements in Quintuplet. The observed near-solar or sub-solar metallicity of the WR star winds can be naturally understood as the result of nucleosynthesis and internal mixing of the parent star, which have a supersolar initial metallicity as expected for the Galactic center in general. Implications of our findings on the origin of the young star clusters and isolated massive stars in the Galactic center, as well as the elemental composition of the accretion flow onto Sgr A*, are addressed.

astro-ph.GA↗

arXiv2025

A Survey of Retentive Network

Retentive Network (RetNet) represents a significant advancement in neural network architecture, offering an efficient alternative to the Transformer. While Transformers rely on self-attention to model dependencies, they suffer from high memory costs and limited scalability when handling long sequences due to their quadratic complexity. To mitigate these limitations, RetNet introduces a retention mechanism that unifies the inductive bias of recurrence with the global dependency modeling of attention. This mechanism enables linear-time inference, facilitates efficient modeling of extended contexts, and remains compatible with fully parallelizable training pipelines. RetNet has garnered significant research interest due to its consistently demonstrated cross-domain effectiveness, achieving robust performance across machine learning paradigms including natural language processing, speech recognition, and time-series analysis. However, a comprehensive review of RetNet is still missing from the current literature. This paper aims to fill that gap by offering the first detailed survey of the RetNet architecture, its key innovations, and its diverse applications. We also explore the main challenges associated with RetNet and propose future research directions to support its continued advancement in both academic research and practical deployment.

cs.CL↗

arXiv2025

Non-Asymptotic Length Generalization

Length generalization is the ability of a learning algorithm to learn a hypothesis which generalizes to longer inputs than the inputs in the training set. In this paper, we provide provable guarantees of length generalization for various classes of functions in an idealized setting. First, we formalize the framework of non-asymptotic length generalization, which requires a computable upper bound for the minimum input length that guarantees length generalization, as a function of the complexity of ground-truth function under some given complexity measure. We refer to this minimum input length to length generalize as length complexity. We show the Minimum-Complexity Interpolator learning algorithm achieves optimal length complexity. We further show that whether a function class admits non-asymptotic length generalization is equivalent to the decidability of its language equivalence problem, which implies that there is no computable upper bound for the length complexity of Context-Free Grammars. On the positive side, we show that the length complexity of Deterministic Finite Automata is $2n - 2$ where $n$ is the number of states of the ground-truth automaton. Our main results are upper bounds of length complexity for a subset of a transformer-related function class called C-RASP (Yang & Chiang, 2024). We show that the length complexity of 1-layer C-RASP functions is $O(T^2)$ when the ground-truth function has precision $T$, and that the length complexity of 2-layer C-RASP functions is $O(T^{O(K)})$ when the ground-truth function has precision $T$ and $K$ heads.

cs.LG↗

arXiv2025

SegRet: An Efficient Design for Semantic Segmentation with Retentive Network

With the rapid evolution of autonomous driving technology and intelligent transportation systems, semantic segmentation has become increasingly critical. Precise interpretation and analysis of real-world environments are indispensable for these advanced applications. However, traditional semantic segmentation approaches frequently face challenges in balancing model performance with computational efficiency, especially regarding the volume of model parameters. To address these constraints, we propose SegRet, a novel model employing the Retentive Network (RetNet) architecture coupled with a lightweight residual decoder that integrates zero-initialization. SegRet offers three distinctive advantages: (1) Lightweight Residual Decoder: by embedding a zero-initialization layer within the residual network structure, the decoder remains computationally streamlined without sacrificing essential information propagation; (2) Robust Feature Extraction: adopting RetNet as its backbone enables SegRet to effectively capture hierarchical image features, thereby enriching the representation quality of extracted features; (3) Parameter Efficiency: SegRet attains state-of-the-art (SOTA) segmentation performance while markedly decreasing the number of parameters, ensuring high accuracy without imposing additional computational burdens. Comprehensive empirical evaluations on prominent benchmarks, such as ADE20K, Citycapes, and COCO-Stuff, highlight the effectiveness and superiority of our method.

eess.IV↗

arXiv2025

THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models

Large reasoning models (LRMs) have achieved impressive performance in complex tasks, often outperforming conventional large language models (LLMs). However, the prevalent issue of overthinking severely limits their computational efficiency. Overthinking occurs when models generate excessive and redundant tokens that contribute little to accurate outcomes, especially in simple tasks, resulting in a significant waste of computational resources. To systematically investigate this issue, we introduce Think-Bench, a benchmark designed to evaluate the reasoning efficiency of LRMs. We also propose novel efficiency metrics and conduct a comprehensive evaluation of various LRMs across multiple dimensions, including the reasoning process, outcome quality, and chain-of-thought (CoT) characteristics. Our analysis reveals that most LRMs exhibit overthinking in handling easy questions, generating unnecessarily lengthy reasoning chains. While many LRMs demonstrate high CoT quality, several suffer from low efficiency. We hope that Think-Bench can serve as a robust foundation for advancing research into LRMs.

cs.CL↗

arXiv2025

Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Discern Causal Links Across Modalities

Multimodal Large Language Models (MLLMs) have showcased exceptional Chain-of-Thought (CoT) reasoning ability in complex textual inference tasks including causal reasoning. However, will these causalities remain straightforward when crucial hints hide in visual details? If not, what factors might influence cross-modal generalization? Whether we can effectively enhance their capacity for robust causal inference across both text and vision? Motivated by these, we introduce MuCR - a novel Multimodal Causal Reasoning benchmark that leverages synthetic siamese images and text pairs to challenge MLLMs. Additionally, we develop tailored metrics from multiple perspectives, including image-level match, phrase-level understanding, and sentence-level explanation, to comprehensively assess MLLMs' comprehension abilities. Our experiments reveal that current MLLMs fall short in multimodal causal reasoning compared to their performance in purely textual settings. Additionally, we find that identifying visual cues across images is key to effective cross-modal generalization. Finally, we propose a VcCoT strategy that better highlights visual cues, and our results confirm its efficacy in enhancing multimodal causal reasoning. The project is available at: https://github.com/Zhiyuan-Li-John/MuCR

cs.CV↗

arXiv2025

RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusion

Diffusion-based extreme image compression methods have achieved impressive performance at extremely low bitrates. However, constrained by the iterative denoising process that starts from pure noise, these methods are limited in both fidelity and efficiency. To address these two issues, we present Relay Residual Diffusion Extreme Image Compression (RDEIC), which leverages compressed feature initialization and residual diffusion. Specifically, we first use the compressed latent features of the image with added noise, instead of pure noise, as the starting point to eliminate the unnecessary initial stages of the denoising process. Second, we directly derive a novel residual diffusion equation from Stable Diffusion's original diffusion equation that reconstructs the raw image by iteratively removing the added noise and the residual between the compressed and target latent features. In this way, we effectively combine the efficiency of residual diffusion with the powerful generative capability of Stable Diffusion. Third, we propose a fixed-step fine-tuning strategy to eliminate the discrepancy between the training and inference phases, thereby further improving the reconstruction quality. Extensive experiments demonstrate that the proposed RDEIC achieves state-of-the-art visual quality and outperforms existing diffusion-based extreme image compression methods in both fidelity and efficiency. The source code and pre-trained models are available at https://github.com/huai-chang/RDEIC.

eess.IV↗