arXiv subjects

Zhiyuan Li

Publications and source records attributed to Zhiyuan Li.

At least 145 records · Page 8Linked to original sources

arXiv2025

Advancing Marine Research: UWSAM Framework and UIIS10K Dataset for Precise Underwater Instance Segmentation

With recent breakthroughs in large-scale modeling, the Segment Anything Model (SAM) has demonstrated significant potential in a variety of visual applications. However, due to the lack of underwater domain expertise, SAM and its variants face performance limitations in end-to-end underwater instance segmentation tasks, while their higher computational requirements further hinder their application in underwater scenarios. To address this challenge, we propose a large-scale underwater instance segmentation dataset, UIIS10K, which includes 10,048 images with pixel-level annotations for 10 categories. Then, we introduce UWSAM, an efficient model designed for automatic and accurate segmentation of underwater instances. UWSAM efficiently distills knowledge from the SAM ViT-Huge image encoder into the smaller ViT-Small image encoder via the Mask GAT-based Underwater Knowledge Distillation (MG-UKD) method for effective visual representation learning. Furthermore, we design an End-to-end Underwater Prompt Generator (EUPG) for UWSAM, which automatically generates underwater prompts instead of explicitly providing foreground points or boxes as prompts, thus enabling the network to locate underwater instances accurately for efficient segmentation. Comprehensive experimental results show that our model is effective, achieving significant performance improvements over state-of-the-art methods on multiple underwater instance datasets. Datasets and codes are available at https://github.com/LiamLian0727/UIIS10K.

cs.CV↗

arXiv2025

Episodic Feedback in Triple AGN Candidate SDSS J0849+1114 Revealed by Extended ionized gas

Galaxy mergers funnel gas toward the nuclei, igniting starbursts and active galactic nuclei (AGNs). The AGN feedback can reshape the host galaxy and regulate both star formation and super-massive black-hole (SMBH) accretion. Using VLT/MUSE integral-field spectroscopy, we conduct a spatially resolved study of the triple-AGN candidate SDSS J0849+1114. Extended ionized gas structures ($>10$ kpc from nucleus A) primarily associated with tidal tails are detected. Meanwhile, two distinct ionized gas outflows are revealed. One extends over $>5$ kpc around nuclei A with a kinetic power of $\dot{E}_{\rm out,A} = 3.0\times10^{42}\rm\, erg\, s^{-1}$, which might be driven by the radio jet. The other outflow extends $\sim 5.9$ kpc around nucleus C, with a kinetic power of $\dot{E}_{\rm out,C} = 2.0\times10^{40}\rm\, erg\, s^{-1}$. High [O III]/H$α$ and [N II]/H$α$ ratios in the tidal gas require that nucleus A radiated at a high accretion rate with $L_{\rm A,bol} \sim 0.1$--$0.5\,L_{\rm Edd,A}$ at least $\sim3$--$\times10^{4}\rm\,yr$ ago, $20$--$100$ times brighter than today. Combined with multi-wavelength constraints, we find evidence for episodic AGN feedback that expelled circumnuclear gas and rapidly quenched accretion. This triple AGN candidate demonstrates how AGN feedback can self-regulate black hole growth and impact hosts during mergers.

astro-ph.GA↗

arXiv2025

Pitfalls of defacing whole-head MRI: re-identification risk with diffusion models and compromised research potential

Defacing is often applied to head magnetic resonance image (MRI) datasets prior to public release to address privacy concerns. The alteration of facial and nearby voxels has provoked discussions about the true capability of these techniques to ensure privacy as well as their impact on downstream tasks. With advancements in deep generative models, the extent to which defacing can protect privacy is uncertain. Additionally, while the altered voxels are known to contain valuable anatomical information, their potential to support research beyond the anatomical regions directly affected by defacing remains uncertain. To evaluate these considerations, we develop a refacing pipeline that recovers faces in defaced head MRIs using cascaded diffusion probabilistic models (DPMs). The DPMs are trained on images from 180 subjects and tested on images from 484 unseen subjects, 469 of whom are from a different dataset. To assess whether the altered voxels in defacing contain universally useful information, we also predict computed tomography (CT)-derived skeletal muscle radiodensity from facial voxels in both defaced and original MRIs. The results show that DPMs can generate high-fidelity faces that resemble the original faces from defaced images, with surface distances to the original faces significantly smaller than those of a population average face (p < 0.05). This performance also generalizes well to previously unseen datasets. For skeletal muscle radiodensity predictions, using defaced images results in significantly weaker Spearman's rank correlation coefficients compared to using original images (p < 10-4). For shin muscle, the correlation is statistically significant (p < 0.05) when using original images but not statistically significant (p > 0.05) when any defacing method is applied, suggesting that defacing might not only fail to protect privacy but also eliminate valuable information.

eess.IV↗

arXiv2025

Brain age identification from diffusion MRI synergistically predicts neurodegenerative disease

Estimated brain age from magnetic resonance image (MRI) and its deviation from chronological age can provide early insights into potential neurodegenerative diseases, supporting early detection and implementation of prevention strategies. Diffusion MRI (dMRI) presents an opportunity to build an earlier biomarker for neurodegenerative disease prediction because it captures subtle microstructural changes that precede more perceptible macrostructural changes. However, the coexistence of macro- and micro-structural information in dMRI raises the question of whether current dMRI-based brain age estimation models are leveraging the intended microstructural information or if they inadvertently rely on the macrostructural information. To develop a microstructure-specific brain age, we propose a method for brain age identification from dMRI that mitigates the model's use of macrostructural information by non-rigidly registering all images to a standard template. Imaging data from 13,398 participants across 12 datasets were used for the training and evaluation. We compare our brain age models, trained with and without macrostructural information mitigated, with an architecturally similar T1-weighted (T1w) MRI-based brain age model and two recent, popular, openly available T1w MRI-based brain age models that primarily use macrostructural information. We observe difference between our dMRI-based brain age and T1w MRI-based brain age across stages of neurodegeneration, with dMRI-based brain age being older than T1w MRI-based brain age in participants transitioning from cognitively normal (CN) to mild cognitive impairment (MCI), but younger in participants already diagnosed with Alzheimer's disease (AD). Furthermore, dMRI-based brain age may offer advantages over T1w MRI-based brain age in predicting the transition from CN to MCI up to five years before diagnosis.

cs.CV↗

arXiv2025

DP-FedLoRA: Privacy-Enhanced Federated Fine-Tuning for On-Device Large Language Models

As on-device large language model (LLM) systems become increasingly prevalent, federated fine-tuning enables advanced language understanding and generation directly on edge devices; however, it also involves processing sensitive, user-specific data, raising significant privacy concerns within the federated learning framework. To address these challenges, we propose DP-FedLoRA, a privacy-enhanced federated fine-tuning framework that integrates LoRA-based adaptation with differential privacy in a communication-efficient setting. Each client locally clips and perturbs its LoRA matrices using Gaussian noise to satisfy ($ε$, $δ$)-differential privacy. We further provide a theoretical analysis demonstrating the unbiased nature of the updates and deriving bounds on the variance introduced by noise, offering practical guidance for privacy-budget calibration. Experimental results across mainstream benchmarks show that DP-FedLoRA delivers competitive performance while offering strong privacy guarantees, paving the way for scalable and privacy-preserving LLM deployment in on-device environments.

cs.CR↗

arXiv2025

Discovery of giant bubbles in the hot gaseous halo of the massive disk galaxy NGC 6286

Based on archival Chandra X-ray observation, optical integral-field spectroscopic data and radio interferometric data, we report the discovery of a pair of giant bubbles (with a projected radius ~ 5 kpc) of ionized gas emerging from a highly inclined starburst galaxy NGC 6286, which is undergoing strong tidal interactions with its close neighbor NGC 6285. The bubbles are manifested by extraplanar soft X-ray emission with an X-shaped morphology, which is tightly co-spatial with $\rm Hα$ line emission and partially coincident with radio continuum. Low surface brightness diffuse X-ray emission can be traced out to ~ 90 kpc from the galactic center, revealing the presence of an extended hot gaseous halo. X-ray spectral analysis of the bubbles yields a gas temperature of $0.70^{+0.16}_{-0.18}$ keV, a relatively high value among known galactic-scale bubbles in the local universe. An average energy injection rate of ~ $10^{43}$ erg $\rm s^{-1}$ is required to inflate the bubbles within an estimated dynamical age of ~ 6.4 Myr. The multi-wavelength properties of the bubbles can be understood with the conventional superwind scenario, in which disk/halo gas is swept up into an expanding, cooling shell by a hot tenuous wind. The current starburst in NGC 6286 is energetically sufficient to launch the superwind, although we cannot rule out the possibility of a more violent AGN in the recent past as the driving source. Future high-resolution spectroscopic observations will help to shed light on the origin of the superwind and its role as an important galactic feedback process.

astro-ph.GA↗

arXiv2025

Hölder Stable Recovery of the Source in Space-Time Fractional Wave Equations

We study the recovery of a spatially dependent source in a one-dimensional space-time fractional wave equation using boundary measurement data collected at a single endpoint. The main challenge arises from the fact that the eigenfunctions of the Dirichlet eigenvalue problem do not form an orthogonal system, due to the presence of a fractional derivative in space. To address this difficulty, we introduce a bi-orthogonal basis for the Mittag-Leffler functions and use it to establish uniqueness and Hölder-type stability results, provided the measurement time is sufficiently large. A Tikhonov regularization method is then employed to numerically solve the inverse source problem. Several numerical examples are presented to demonstrate the accuracy and efficiency of the proposed method and to validate our theoretical findings.

math.AP↗

arXiv2025

A Survey: Towards Privacy and Security in Mobile Large Language Models

Mobile Large Language Models (LLMs) are revolutionizing diverse fields such as healthcare, finance, and education with their ability to perform advanced natural language processing tasks on-the-go. However, the deployment of these models in mobile and edge environments introduces significant challenges related to privacy and security due to their resource-intensive nature and the sensitivity of the data they process. This survey provides a comprehensive overview of privacy and security issues associated with mobile LLMs, systematically categorizing existing solutions such as differential privacy, federated learning, and prompt encryption. Furthermore, we analyze vulnerabilities unique to mobile LLMs, including adversarial attacks, membership inference, and side-channel attacks, offering an in-depth comparison of their effectiveness and limitations. Despite recent advancements, mobile LLMs face unique hurdles in achieving robust security while maintaining efficiency in resource-constrained environments. To bridge this gap, we propose potential applications, discuss open challenges, and suggest future research directions, paving the way for the development of trustworthy, privacy-compliant, and scalable mobile LLM systems.

cs.CR↗

arXiv2025

A Theory of Learning with Autoregressive Chain of Thought

For a given base class of sequence-to-next-token generators, we consider learning prompt-to-answer mappings obtained by iterating a fixed, time-invariant generator for multiple steps, thus generating a chain-of-thought, and then taking the final token as the answer. We formalize the learning problems both when the chain-of-thought is observed and when training only on prompt-answer pairs, with the chain-of-thought latent. We analyze the sample and computational complexity both in terms of general properties of the base class (e.g. its VC dimension) and for specific base classes such as linear thresholds. We present a simple base class that allows for universal representability and computationally tractable chain-of-thought learning. Central to our development is that time invariance allows for sample complexity that is independent of the length of the chain-of-thought. Attention arises naturally in our construction.

stat.ML↗

arXiv2025

Characterizing Visual Intents for People with Low Vision through Eye Tracking

Accessing visual information is crucial yet challenging for people with low vision due to visual conditions like low visual acuity and limited visual fields. However, unlike blind people, low vision people have and prefer using their functional vision in daily tasks. Gaze patterns thus become an important indicator to uncover their visual challenges and intents, inspiring more adaptive visual support. We seek to deeply understand low vision users' gaze behaviors in different image-viewing tasks, characterizing typical visual intents and the unique gaze patterns exhibited by people with different low vision conditions. We conducted a retrospective think-aloud study using eye tracking with 20 low vision participants and 20 sighted controls. Participants completed various image-viewing tasks and watched the playback of their gaze trajectories to reflect on their visual experiences. Based on the study, we derived a visual intent taxonomy with five visual intents characterized by participants' gaze behaviors. We demonstrated the difference between low vision and sighted participants' gaze behaviors and how visual ability affected low vision participants' gaze patterns across visual intents. Our findings underscore the importance of combining visual ability information, visual context, and eye tracking data in visual intent recognition, setting up a foundation for intent-aware assistive technologies for low vision people.

cs.HC↗

arXiv2025

Exploiting Local Observations for Robust Robot Learning

While many robotic tasks can be addressed using either centralized single-agent control with full state observation or decentralized multi-agent control, clear criteria for choosing between these approaches remain underexplored. This paper systematically investigates how multi-agent reinforcement learning (MARL) with local observations can improve robustness in complex robotic systems compared to traditional centralized control. Through theoretical analysis and empirical validation, we show that in certain tasks, decentralized MARL can achieve performance comparable to centralized methods while exhibiting greater resilience to perturbations and agent failures. By analytically demonstrating the equivalence of single-agent reinforcement learning (SARL) and MARL under full observability, we identify observability as the critical factor distinguishing the two paradigms. We further derive bounds quantifying performance degradation under external perturbations for locally observable policies. Empirical results on standard MARL benchmarks confirm that MARL with limited observations can maintain competitive performance. Finally, real-world experiments with a mobile manipulator demonstrate that decentralized MARL controllers achieve markedly improved robustness to agent malfunctions and environmental disturbances relative to centralized baselines. Together, these findings highlight MARL with local observations as a robust and practical alternative to conventional centralized control in complex robotic systems.

cs.RO↗

arXiv2025

On the convergence of PINNs for inverse source problem in the complex Ginzburg-Landau equation

This paper addresses the problem of recovering the spatial profile of the source in the complex Ginzburg-Landau equation from regional observation data at fixed times. We establish two types of sufficient measurements for the unique solvability of the inverse problem. The first is to determine the source term by using whole data at one fixed instant. Conditional stability is established by using the eigenfunction expansion argument. Next, using the analytic continuation method, both uniqueness and a stability estimate for recovering the unknown source can be established from local data at two instants. Finally, algorithms based on the physics-informed neural networks (PINNs) are proposed, and several numerical experiments are presented to show the accuracy and efficiency of the algorithm.

math.AP↗

arXiv2025

Megrez2 Technical Report

We present Megrez2, a novel lightweight and high-performance language model architecture optimized for device native deployment. Megrez2 introduces a novel cross-layer expert sharing mechanism, which significantly reduces total parameter count by reusing expert modules across adjacent transformer layers while maintaining most of the model's capacity. It also incorporates pre-gated routing, enabling memory-efficient expert loading and faster inference. As the first instantiation of the Megrez2 architecture, we introduce the Megrez2-Preview model, which is pre-trained on a 5-trillion-token corpus and further enhanced through supervised fine-tuning and reinforcement learning with verifiable rewards. With only 3B activated and 7.5B stored parameters, Megrez2-Preview demonstrates competitive or superior performance compared to larger models on a wide range of tasks, including language understanding, instruction following, mathematical reasoning, and code generation. These results highlight the effectiveness of the Megrez2 architecture to achieve a balance between accuracy, efficiency, and deployability, making it a strong candidate for real-world, resource-constrained applications.

cs.CL↗

arXiv2025

Precise Measurement of $^{216}$Po Half-life with Exact Parent-daughter Pairing in PandaX-4T

We report a precise measurement of $^{216}\rm Po$ half-life using the PandaX-4T liquid xenon time projection chamber (TPC). $^{220}\rm Rn $, emanating from a $^{228}\rm Th $ calibration source, is injected to the detector and undergoes successive $α$ decays, first to $^{216}\rm Po$ and then to $^{212}\rm Pb$. PandaX-4T detector measures the 5-dimensional (5D) information of each decay, including time, energy, and 3-dimensional positions. Therefore, we can identify the $^{220}\rm Rn $ and $^{216}\rm Po$ decay events and pair them exactly to extract the lifetime of each $^{216}\rm Po$. With a large data set and high-precision $^{220}\rm $Rn-$^{216}\rm $Po pairing technique, we measure the $^{216}\rm Po$ half-life to be $143.7\pm0.5$ ms, which is the most precise result to date and agrees with previously published values. The leading precision of this measurement demonstrates the power of 5D calorimeter and the potential of exact parent-daughter pairing in the xenon TPC.

nucl-ex↗

arXiv2025

Structured Preconditioners in Adaptive Optimization: A Unified Analysis

We present a novel unified analysis for a broad class of adaptive optimization algorithms with structured (e.g., layerwise, diagonal, and kronecker-factored) preconditioners for both online regret minimization and offline convex optimization. Our analysis not only provides matching rate to several important structured preconditioned algorithms including diagonal AdaGrad, full-matrix AdaGrad, and AdaGrad-Norm, but also gives an improved convergence rate for a one-sided variant of Shampoo over that of original Shampoo. Interestingly, more structured preconditioners (e.g., diagonal Adagrad, AdaGrad-Norm which use less space and compute) are often presented as computationally efficient approximations to full-matrix Adagrad, aiming for improved optimization performance through better approximations. Our unified analysis challenges this prevailing view and reveals, perhaps surprisingly, that more structured preconditioners, despite using less space and computation per step, can outperform their less structured counterparts. To demonstrate this, we show that one-sided Shampoo, which is relatively much cheaper than full-matrix AdaGrad could outperform it both theoretically and experimentally.

cs.LG↗

arXiv2025

Wind-fed Supermassive Black Hole Accretion by the Nuclear Star Cluster: the Case of M31*

The central supermassive black hole (SMBH) of the Andromeda galaxy, known as M31*, exhibits dim electromagnetic emission and is inferred to have an extremely low accretion rate for its remarkable mass ($\sim10^8~\rm~M_\odot$). In this work, we use three-dimensional hydrodynamical simulations to explore a previously untested scenario, in which M31* is fed by the collective stellar mass-loss from its surrounding nuclear star cluster, manifested as a famous eccentric disk of predominantly old stellar populations. The stellar mass-loss is assumed to be dominated by the slow and cold winds from 100 asymptotic giant-branch stars, which follow well-constrained Keplerian orbits around M31* and together provide a mass injection rate of $\sim4\times10^{-5}\rm~M_\odot~yr^{-1}$. The simulations achieve a quasi-steady state on a Myr timescale, at which point a quasi-Keplerian, cool ($T\sim10^3-10^4~\rm K$) gas disk extending several parsecs is established. This disk is continuously supplied by the stellar winds and itself feeds the central SMBH. At the end of the simulations at 2 Myr, an accretion rate of $\sim2\times10^{-5}\rm~M_\odot~yr^{-1}$ is found but could vary by a factor of few depending on whether the subdominant gravity of the NSC or a moderate global inflow is included. The predicted X-ray luminosity of $\sim10^{36}~\rm erg~s^{-1}$, dominated by the hot ($T\sim10^7-10^8~\rm K$) plasma within 0.2 parsec of the SMBH, is well consistent with Chandra observations. We conclude that the feeding mechanism of M31* is successfully identified, which has important implications for the working of dormant SMBHs prevalent in the local universe.

astro-ph.GA↗

arXiv2025

External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendation

Ads recommendation is a prominent service of online advertising systems and has been actively studied. Recent studies indicate that scaling-up and advanced design of the recommendation model can bring significant performance improvement. However, with a larger model scale, such prior studies have a significantly increasing gap from industry as they often neglect two fundamental challenges in industrial-scale applications. First, training and inference budgets are restricted for the model to be served, exceeding which may incur latency and impair user experience. Second, large-volume data arrive in a streaming mode with data distributions dynamically shifting, as new users/ads join and existing users/ads leave the system. We propose the External Large Foundation Model (ExFM) framework to address the overlooked challenges. Specifically, we develop external distillation and a data augmentation system (DAS) to control the computational cost of training/inference while maintaining high performance. We design the teacher in a way like a foundation model (FM) that can serve multiple students as vertical models (VMs) to amortize its building cost. We propose Auxiliary Head and Student Adapter to mitigate the data distribution gap between FM and VMs caused by the streaming data issue. Comprehensive experiments on internal industrial-scale applications and public datasets demonstrate significant performance gain by ExFM.

cs.IR↗

arXiv2025

Multi-Modality Conditioned Variational U-Net for Field-of-View Extension in Brain Diffusion MRI

An incomplete field-of-view (FOV) in diffusion magnetic resonance imaging (dMRI) can severely hinder the volumetric and bundle analyses of whole-brain white matter connectivity. Although existing works have investigated imputing the missing regions using deep generative models, it remains unclear how to specifically utilize additional information from paired multi-modality data and whether this can enhance the imputation quality and be useful for downstream tractography. To fill this gap, we propose a novel framework for imputing dMRI scans in the incomplete part of the FOV by integrating the learned diffusion features in the acquired part of the FOV to the complete brain anatomical structure. We hypothesize that by this design the proposed framework can enhance the imputation performance of the dMRI scans and therefore be useful for repairing whole-brain tractography in corrupted dMRI scans with incomplete FOV. We tested our framework on two cohorts from different sites with a total of 96 subjects and compared it with a baseline imputation method that treats the information from T1w and dMRI scans equally. The proposed framework achieved significant improvements in imputation performance, as demonstrated by angular correlation coefficient (p < 1E-5), and in downstream tractography accuracy, as demonstrated by Dice score (p < 0.01). Results suggest that the proposed framework improved imputation performance in dMRI scans by specifically utilizing additional information from paired multi-modality data, compared with the baseline method. The imputation achieved by the proposed framework enhances whole brain tractography, and therefore reduces the uncertainty when analyzing bundles associated with neurodegenerative.

cs.CV↗