arXiv subjects

Zhuo Li

Publications and source records attributed to Zhuo Li.

At least 91 records · Page 5Linked to original sources

arXiv2025

UltraDfeGAN: Detail-Enhancing Generative Adversarial Networks for High-Fidelity Functional Ultrasound Synthesis

Functional ultrasound (fUS) is a neuroimaging technique known for its high spatiotemporal resolution, enabling non-invasive observation of brain activity through neurovascular coupling. Despite its potential in clinical applications such as neonatal monitoring and intraoperative guidance, the development of fUS faces challenges related to data scarcity and limitations in generating realistic fUS images. This paper explores the use of a generative adversarial network (GAN) framework tailored for fUS image synthesis. The proposed method incorporates architectural enhancements, including feature enhancement modules and normalization techniques, aiming to improve the fidelity and physiological plausibility of generated images. The study evaluates the performance of the framework against existing generative models, demonstrating its capability to produce high-quality fUS images under various experimental conditions. Additionally, the synthesized images are assessed for their utility in downstream tasks, showing improvements in classification accuracy when used for data augmentation. Experimental results are based on publicly available fUS datasets, highlighting the framework's effectiveness in addressing data limitations.

eess.IV↗

arXiv2025

AgentMental: An Interactive Multi-Agent Framework for Explainable and Adaptive Mental Health Assessment

Mental health assessment is crucial for early intervention and effective treatment, yet traditional clinician-based approaches are limited by the shortage of qualified professionals. Recent advances in artificial intelligence have sparked growing interest in automated psychological assessment, yet most existing approaches are constrained by their reliance on static text analysis, limiting their ability to capture deeper and more informative insights that emerge through dynamic interaction and iterative questioning. Therefore, in this paper, we propose a multi-agent framework for mental health evaluation that simulates clinical doctor-patient dialogues, with specialized agents assigned to questioning, adequacy evaluation, scoring, and updating. We introduce an adaptive questioning mechanism in which an evaluation agent assesses the adequacy of user responses to determine the necessity of generating targeted follow-up queries to address ambiguity and missing information. Additionally, we employ a tree-structured memory in which the root node encodes the user's basic information, while child nodes (e.g., topic and statement) organize key information according to distinct symptom categories and interaction turns. This memory is dynamically updated throughout the interaction to reduce redundant questioning and further enhance the information extraction and contextual tracking capabilities. Experimental results on the DAIC-WOZ dataset illustrate the effectiveness of our proposed method, which achieves better performance than existing approaches.

cs.CL↗

arXiv2025

Layer-Wise Perturbations via Sparse Autoencoders for Adversarial Text Generation

With the rapid proliferation of Natural Language Processing (NLP), especially Large Language Models (LLMs), generating adversarial examples to jailbreak LLMs remains a key challenge for understanding model vulnerabilities and improving robustness. In this context, we propose a new black-box attack method that leverages the interpretability of large models. We introduce the Sparse Feature Perturbation Framework (SFPF), a novel approach for adversarial text generation that utilizes sparse autoencoders to identify and manipulate critical features in text. After using the SAE model to reconstruct hidden layer representations, we perform feature clustering on the successfully attacked texts to identify features with higher activations. These highly activated features are then perturbed to generate new adversarial texts. This selective perturbation preserves the malicious intent while amplifying safety signals, thereby increasing their potential to evade existing defenses. Our method enables a new red-teaming strategy that balances adversarial effectiveness with safety alignment. Experimental results demonstrate that adversarial texts generated by SFPF can bypass state-of-the-art defense mechanisms, revealing persistent vulnerabilities in current NLP systems.However, the method's effectiveness varies across prompts and layers, and its generalizability to other architectures and larger models remains to be validated.

cs.CL↗

arXiv2025

LLM4Rail: An LLM-Augmented Railway Service Consulting Platform

Large language models (LLMs) have significantly reshaped different walks of business. To meet the increasing demands for individualized railway service, we develop LLM4Rail - a novel LLM-augmented railway service consulting platform. Empowered by LLM, LLM4Rail can provide custom modules for ticketing, railway food & drink recommendations, weather information, and chitchat. In LLM4Rail, we propose the iterative "Question-Thought-Action-Observation (QTAO)" prompting framework. It meticulously integrates verbal reasoning with task-oriented actions, that is, reasoning to guide action selection, to effectively retrieve external observations relevant to railway operation and service to generate accurate responses. To provide personalized onboard dining services, we first construct the Chinese Railway Food and Drink (CRFD-25) - a publicly accessible takeout dataset tailored for railway services. CRFD-25 covers a wide range of signature dishes categorized by cities, cuisines, age groups, and spiciness levels. We further introduce an LLM-based zero-shot conversational recommender for railway catering. To address the unconstrained nature of open recommendations, the feature similarity-based post-processing step is introduced to ensure all the recommended items are aligned with CRFD-25 dataset.

cs.AI↗

arXiv2025

Cosmogenic Neutrino Point Source and KM3-230213A

Cosmogenic neutrinos (CNs) are produced by ultra-high energy cosmic rays (UHECRs) interacting with cosmic background radiation. We investigated the properties of CN point/extended sources, i.e, the neutrino spectrum, and angular profile as functions of time, by assuming that UHECR sources are transient events, such as gamma-ray bursts. The properties depend much on the intergalactic magnetic field (IGMF), but the angular extent is in general sub-degree, within which the CN flux can overshoot the diffuse CN flux in early time. The nearby CN point sources could be detected for the low IGMF case by future neutrino telescopes. The recent KM3-230213A event is possible to account for by a nearby transient CN source, rather than diffuse CN emission. Observations of CN point sources will provide a chance to search for UHECR sources.

astro-ph.HE↗

arXiv2025

The Power of Architecture: Deep Dive into Transformer Architectures for Long-Term Time Series Forecasting

Transformer-based models have recently become dominant in Long-term Time Series Forecasting (LTSF), yet the variations in their architecture, such as encoder-only, encoder-decoder, and decoder-only designs, raise a crucial question: What Transformer architecture works best for LTSF tasks? However, existing models are often tightly coupled with various time-series-specific designs, making it difficult to isolate the impact of the architecture itself. To address this, we propose a novel taxonomy that disentangles these designs, enabling clearer and more unified comparisons of Transformer architectures. Our taxonomy considers key aspects such as attention mechanisms, forecasting aggregations, forecasting paradigms, and normalization layers. Through extensive experiments, we uncover several key insights: bi-directional attention with joint-attention is most effective; more complete forecasting aggregation improves performance; and the direct-mapping paradigm outperforms autoregressive approaches. Furthermore, our combined model, utilizing optimal architectural choices, consistently outperforms several existing models, reinforcing the validity of our conclusions. We hope these findings offer valuable guidance for future research on Transformer architectural designs in LTSF. Our code is available at https://github.com/HALF111/TSF_architecture.

cs.LG↗

arXiv2025

VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasters

Foundation models have emerged as a promising approach in time series forecasting (TSF). Existing approaches either repurpose large language models (LLMs) or build large-scale time series datasets to develop TSF foundation models for universal forecasting. However, these methods face challenges due to the severe cross-domain gap or in-domain heterogeneity. This paper explores a new road to building a TSF foundation model from rich, high-quality natural images. Our key insight is that a visual masked autoencoder, pre-trained on the ImageNet dataset, can naturally be a numeric series forecaster. By reformulating TSF as an image reconstruction task, we bridge the gap between image pre-training and TSF downstream tasks. Surprisingly, without further adaptation in the time series domain, the proposed VisionTS could achieve better zero-shot forecast performance than existing TSF foundation models. With fine-tuning for one epoch, VisionTS could further improve the forecasting and achieve state-of-the-art performance in most cases. Extensive experiments reveal intrinsic similarities between images and real-world time series, suggesting that visual models may offer a "free lunch" for TSF and highlight the potential for future cross-modality research. Our code is publicly available at https://github.com/Keytoyze/VisionTS.

cs.CV↗

arXiv2025

Reconfigurable Ultrafast Thermal Metamaterial Pixel Arrays by Dual-Gate Graphene Transistors

Thermal signatures represent ubiquitous infrared appearances of objects, carrying their unique spectral fingerprints. Despite extensive efforts to decipher and manipulate thermal-infrared signals, the ability to fully control them across spatial, temporal and spectral domains remains a significant challenge due to the slow speed, diffuse and broadband emitting nature of thermal emission in most materials. Here, we demonstrate a reconfigurable ultrafast thermal metamaterial pixel array that integrates active metasurfaces with dual-gate graphene transistors (Gr-FETs). The Gr-FETs with dual-gate control in each pixel achieve the heater-switch dual functionalities. As broadband transparent microheaters, Gr-FETs support the arbitrary design of integrated metasurfaces to achieve multi-color, narrowband infrared emission and operate at ultrafast modulation speeds. Concurrently as electrical switches, they enable a unified control scheme for pixel arrays of various sizes over large areas without compromising emission intensity. By decoupling the thermal generation and emission design processes, our approach provides an unprecedented degree of flexibility in programming thermal output across space, time, and wavelength. Our fabricated thermal pixel array experimentally demonstrated 26 alphabetical letters by applying progressive scanning, thus paving the way for practical realization of universal thermal signature controls for advanced thermal-infrared applications.

physics.optics↗

arXiv2025

Jailbreak-R1: Exploring the Jailbreak Capabilities of LLMs via Reinforcement Learning

As large language models (LLMs) grow in power and influence, ensuring their safety and preventing harmful output becomes critical. Automated red teaming serves as a tool to detect security vulnerabilities in LLMs without manual labor. However, most existing methods struggle to balance the effectiveness and diversity of red-team generated attack prompts. To address this challenge, we propose \ourapproach, a novel automated red teaming training framework that utilizes reinforcement learning to explore and generate more effective attack prompts while balancing their diversity. Specifically, it consists of three training stages: (1) Cold Start: The red team model is supervised and fine-tuned on a jailbreak dataset obtained through imitation learning. (2) Warm-up Exploration: The model is trained in jailbreak instruction following and exploration, using diversity and consistency as reward signals. (3) Enhanced Jailbreak: Progressive jailbreak rewards are introduced to gradually enhance the jailbreak performance of the red-team model. Extensive experiments on a variety of LLMs show that \ourapproach effectively balances the diversity and effectiveness of jailbreak prompts compared to existing methods. Our work significantly improves the efficiency of red team exploration and provides a new perspective on automated red teaming.

cs.AI↗

arXiv2025

Multi-objective Large Language Model Alignment with Hierarchical Experts

Aligning large language models (LLMs) to simultaneously satisfy multiple objectives remains a significant challenge, especially given the diverse and often conflicting nature of human preferences. Existing alignment methods struggle to balance trade-offs effectively, often requiring costly retraining or yielding suboptimal results across the Pareto frontier of preferences. In this paper, we introduce \textit{HoE}(Hierarchical Mixture-of-Experts), a \textit{lightweight}, \textit{parameter-efficient}, and \textit{plug-and-play} approach that eliminates the need for model training, while enabling LLMs to adapt across the entire Pareto frontier and accommodate diverse user preferences. In particular, \textit{HoE} consists of three hierarchical components: LoRA Experts, Router Experts and Preference Routing, reaching optimal Pareto frontiers and achieving a trade-off between parameter size, training cost, and performance. We evaluate \textit{HoE} across various tasks on 14 objectives and 200 different preferences among 6 benchmarks, demonstrating superior performance over 15 recent baselines. Code is available in the supplementary materials.

cs.CL↗

arXiv2025

High-Fidelity Functional Ultrasound Reconstruction via A Visual Auto-Regressive Framework

Functional ultrasound (fUS) imaging provides exceptional spatiotemporal resolution for neurovascular mapping, yet its practical application is significantly hampered by critical challenges. Foremost among these are data scarcity, arising from ethical considerations and signal degradation through the cranium, which collectively limit dataset diversity and compromise the fairness of downstream machine learning models.

eess.IV↗

arXiv2025

Unidirectional zero-index and omnidirectional hybrid hydrodynamic cloaks constructed from isotropic media with anisotropic geometry

Hydrodynamic cloaking offers a promising approach for manipulating viscous flows by redirecting fluid around an obstacle without inducing external disturbances. By extending pseudo-conformal mappings into potential flow models, we introduce a new isobaric boundary condition that enables the construction of zero-index cloaks using isotropic and homogeneous media shaped into anisotropic geometries, such as elliptical shells. Compared to conventional cloaks, which suffer performance degradation under realistic viscous conditions, the zero-index design significantly reduces such losses by suppressing flow disturbances at the inner boundary. To overcome practical limitations in realizing ideal isobaric conditions, we further propose a hybrid cloak that integrates a raised fluid domain with an auxiliary flow channel above the obstacle. This architecture removes the need for viscosity tuning and, under anisotropic geometries, surpasses both conventional and zero-index cloaks in omnidirectional performance. The design is validated through simulations and experiments. Our findings offer a generalizable strategy for controlling viscous flows and open new directions for microfluidic applications including drug delivery, particle steering, and cell sorting.

physics.flu-dyn↗

arXiv2025

Shared Properties of Merger-driven Long-duration Gamma-Ray Bursts

The recent detections of bright optical/infrared kilonova signals following two long-duration gamma-ray bursts (LGRBs), GRB 211211A and GRB 230307A, have significantly challenged the traditional classification of GRBs. These merger-driven LGRBs may represent a distinct GRB population. Since traditional GRB classification methods often struggle to distinguish merger-driven LGRBs from traditional merger-driven short-duration GRBs resulting from compact object mergers and collapse-driven LGRBs produced by massive stars, this work aims to explore the shared properties in terms of hardness, energy, and duration among currently observed merger-driven LGRB events, thereby identifying their observed differences from the traditional GRB population. We collect a sample of merger-driven LGRBs with known redshifts, including observed information on their main emission (ME) and whole emission (WE) phases. Treating ME and WE properties as two independent sets of information, we apply several GRB classification methodologies to explore their potential shared properties. Using the phenomenologically defined Energy-Hardness (EH) parameter, we identify a probable universal linear correlation across merger-driven LGRBs, regardless of whether their ME or WE phases are considered. We propose that such shared properties of merger-driven LGRBs are unlikely to arise from the low-redshift selection effect and they become particularly intriguing when compared with the relatively weak correlations or lack of correlation observed in traditional merger-driven short-duration GRBs (with or without extended emissions) and collapse-driven LGRBs. Our newly proposed correlation highlights the necessity for further investigation into the observations of merger-driven LGRBs and the physical mechanisms underlying the empirical correlation.

astro-ph.HE↗

arXiv2025

CMD: Constraining Multimodal Distribution for Domain Adaptation in Stereo Matching

Recently, learning-based stereo matching methods have achieved great improvement in public benchmarks, where soft argmin and smooth L1 loss play a core contribution to their success. However, in unsupervised domain adaptation scenarios, we observe that these two operations often yield multimodal disparity probability distributions in target domains, resulting in degraded generalization. In this paper, we propose a novel approach, Constrain Multi-modal Distribution (CMD), to address this issue. Specifically, we introduce \textit{uncertainty-regularized minimization} and \textit{anisotropic soft argmin} to encourage the network to produce predominantly unimodal disparity distributions in the target domain, thereby improving prediction accuracy. Experimentally, we apply the proposed method to multiple representative stereo-matching networks and conduct domain adaptation from synthetic data to unlabeled real-world scenes. Results consistently demonstrate improved generalization in both top-performing and domain-adaptable stereo-matching models. The code for CMD will be available at: \href{https://github.com/gallenszl/CMD}{https://github.com/gallenszl/CMD}.

cs.CV↗

arXiv2025

Optimizing Safe and Aligned Language Generation: A Multi-Objective GRPO Approach

Aligning large language models (LLMs) with human values and safety constraints is challenging, especially when objectives like helpfulness, truthfulness, and avoidance of harm conflict. Reinforcement Learning from Human Feedback (RLHF) has achieved notable success in steering models, but is complex and can be unstable. Recent approaches such as Direct Preference Optimization (DPO) simplify preference-based fine-tuning but may introduce bias or trade-off certain objectives~\cite{dpo}. In this work, we propose a Group Relative Policy Optimization (GRPO) framework with a multi-label reward regression model to achieve safe and aligned language generation. The GRPO algorithm optimizes a policy by comparing groups of sampled responses, eliminating the need for a separate value critic and improving training efficiency~\cite{grpo}. We train a reward model to predict multiple alignment scores (e.g., safety, helpfulness, etc.), which are combined into a single reward signal. We provide a theoretical derivation for using this learned multi-aspect reward within GRPO and discuss its advantages and limitations. Empirically, our approach improves all the safety and quality metrics evaluated in language generation tasks on model scales (0.5B, 7B, and 14B parameters), demonstrating a robust balance of objectives. We compare GRPO to PPO-based RLHF and DPO, highlighting that GRPO achieves alignment with significantly lower computational cost and explicit multi-objective handling. \textbf{We will open-source all trained models at https://huggingface.co/hydroxai.

cs.CL↗

arXiv2025

Output Length Effect on DeepSeek-R1's Safety in Forced Thinking

Large Language Models (LLMs) have demonstrated strong reasoning capabilities, but their safety under adversarial conditions remains a challenge. This study examines the impact of output length on the robustness of DeepSeek-R1, particularly in Forced Thinking scenarios. We analyze responses across various adversarial prompts and find that while longer outputs can improve safety through self-correction, certain attack types exploit extended generations. Our findings suggest that output length should be dynamically controlled to balance reasoning effectiveness and security. We propose reinforcement learning-based policy adjustments and adaptive token length regulation to enhance LLM safety.

cs.CL↗

arXiv2025

Observe Gamma-Rays and Neutrinos Associated with Ultra-High Energy Cosmic Rays

IceCube measures a diffuse neutrino flux comparable to the Waxman-Bahcall bound, which suggests the possibility that the ultra-high energy cosmic rays (UHECRs) have a common origin with diffuse high energy neutrinos. We propose high energy gamma-ray and/or neutrino observations toward the arrival directions of UHECRs to search for the sources and test this possibility. We calculate the detection probability of gamma-ray/neutrino sources, and find that the average probability per UHECR of >10 EeV is $\sim$10% if the sensitivity of the gamma-ray or neutrino telescope is $\sim$10$^{-12}$ erg cm$^{-2}$s$^{-1}$ and the source number density is $\sim$10$^{-5}$ Mpc$^{-3}$. Future gamma-ray and neutrino observations toward UHECRs, e.g., by LHAASO-WCDA, CTA, IceCube/Gen2, are encouraged to constrain the density of UHECR sources or even identify the sources of UHECRs.

astro-ph.HE↗

arXiv2025

Overall Ultra-high Energy Neutrino Emission from GRBs during Jet Expansion

The ultra-relativistic jet released in gamma-ray bursts (GRBs) is expected to produce ultra-high-energy cosmic rays (UHECRs), prompt gamma-ray emission and hence prompt high-energy neutrinos by photopion interactions. In this work, we calculate the time-integrated neutrino spectrum during the expansion of jets by taking into account the time evolution of cosmic ray and secondary spectra and neutrino production. We numerically solve the continuity equations for nucleons, pions, and muons for their spectral evolution. Since pion and muon damping weakens as the jet expands, the neutrino production at large radii at high energies may dominate that around the jet energy dissipation radius. Compared with the usually adopted approaches that only consider neutrino production around the energy dissipation radius, the overall UHE neutrino fluence integrated over time can be significantly larger, and the flavor fraction of electron neutrinos as function of neutrino energy is different at UHE, due to neutrino production at radii much larger than the energy dissipation radius. The faster magnetic field decay leads to larger UHE neutrino fluence, and the UHE neutrino spectra is weakly dependent on the energy dissipation radius and the jet Lorentz factor. Observations of prompt EeV neutrinos from GRBs by the next-generation neutrino telescopes, e.g., GRAND and IceCube-Gen2, will test the hypothesis of GRBs as UHECR sources and probe the physics of GRB jets.

astro-ph.HE↗