arXiv subjects

Xiaotian Zhang

Publications and source records attributed to Xiaotian Zhang.

At least 37 records · Page 2Linked to original sources

arXiv2026

UniVBench: Towards Unified Evaluation for Video Foundation Models

Video foundation models aim to integrate video understanding, generation, editing, and instruction following within a single framework, making them a central direction for next-generation multimodal systems. However, existing evaluation benchmarks remain fragmented and limited in scope, as they each target a single task, rely on task-specific metrics, and typically use short or simple video clips. As a result, they do not capture the unified capabilities that these models are designed to deliver. To address this gap, we introduce UniVBench, a benchmark purpose-built for evaluating video foundation models across four core abilities: video understanding, video generation, video editing, and a newly proposed task, video reconstruction, which assesses how faithfully a model can reproduce video content it has encountered. Our benchmark substantially expands the complexity of evaluation by incorporating 200 high-quality, diverse and multi-shot videos, each paired with detailed captions, multi-format editing instructions, and reference images. All videos are human-created and carefully validated, offering richer cinematic information than prior benchmarks. In addition, we develop a unified agentic evaluation system (UniV-Eval) that standardizes prompting, instruction parsing, and scoring across all tasks, enabling fair, scalable, and reproducible comparisons of unified video models. By grounding evaluation in instruction-based multi-shot video tasks, UniVBench provides the first framework for measuring the integrated capabilities that video foundation models aim to achieve. Extensive human annotations ensure our evaluation aligns with human judgment, enabling rigorous assessment and accelerating progress toward robust video intelligence.

cs.CV↗

arXiv2026

Emergent Polar Metal Phase in a Van der Waals Mott Magnet

We report the emergence of a two-dimensional (2D) polar metal phase in van der Waals compound FePSe$_3$ under moderate pressures. This layered material is a Mott insulator with antiferromagnetic order under ambient conditions. We show that FePSe$_3$ uniquely allows tuning a 2D correlated insulator into an exotic metal state where a loss of inversion symmetry leads to periodic polar displacements of ions, within a conducting phase - a polar metal. Our combined synchrotron and neutron diffraction data allow us to present a long-sought, unambiguous high-pressure structural model and show the polar displacements of this new phase. We also observe the suppression of magnetic ordering at the insulator-to-metal transition correspondent with this structural change. Our work outlines a comprehensive temperature-pressure phase diagram of FePSe$_3$, combining detailed structural, magnetic and transport data. The high-pressure phase exhibits activated semiconductor behavior at high temperatures, a $T^2$-dependence in its resistivity at lower temperatures - despite the conditions required for a `good metal' Fermi-Liquid description not being met in this case - and a low-temperature resistivity upturn which is suppressed as the system is tuned away from the concomitant transitions. The realisation of a tunable 2D polar metal state in FePSe$_3$ due to the loss of its inversion symmetry combined with pressure-induced metallicity offers a promising new platform to investigate this exotic phase at accessible pressures.

cond-mat.str-el↗

arXiv2026

Human-in-the-Loop Interactive Report Generation for Chronic Disease Adherence

Chronic disease management requires regular adherence feedback to prevent avoidable hospitalizations, yet clinicians lack time to produce personalized patient communications. Manual authoring preserves clinical accuracy but does not scale; AI generation scales but can undermine trust in patient-facing contexts. We present a clinician-in-the-loop interface that constrains AI to data organization and preserves physician oversight through recognition-based review. A single-page editor pairs AI-generated section drafts with time-aligned visualizations, enabling inline editing with visual evidence for each claim. This division of labor (AI organizes, clinician decides) targets both efficiency and accountability. In a pilot with three physicians reviewing 24 cases, AI successfully generated clinically personalized drafts matching physicians' manual authoring practice (overall mean 4.86/10 vs. 5.0/10 baseline), requiring minimal physician editing (mean 8.3\% content modification) with zero safety-critical issues, demonstrating effective automation of content generation. However, review time remained comparable to manual practice, revealing an accountability paradox: in high-stakes clinical contexts, professional responsibility requires complete verification regardless of AI accuracy. We contribute three interaction patterns for clinical AI collaboration: bounded generation with recognition-based review via chart-text pairing, automated urgency flagging that analyzes vital trends and adherence patterns with fail-safe escalation for missed critical monitoring tasks, and progressive disclosure controls that reduce cognitive load while maintaining oversight. These patterns indicate that clinical AI efficiency requires not only accurate models, but also mechanisms for selective verification that preserve accountability.

cs.HC↗

arXiv2026

Is Grokking a Computational Glass Relaxation?

Understanding neural network's (NN) generalizability remains a central question in deep learning research. The special phenomenon of grokking, where NNs abruptly generalize long after the training performance reaches a near-perfect level, offers a unique window to investigate the underlying mechanisms of NNs' generalizability. Here we propose an interpretation for grokking by framing it as a computational glass relaxation: viewing NNs as a physical system where parameters are the degrees of freedom and train loss is the system energy, we find memorization process resembles a rapid cooling of liquid into non-equilibrium glassy state at low temperature and the later generalization is like a slow relaxation towards a more stable configuration. This mapping enables us to sample NNs' Boltzmann entropy (states of density) landscape as a function of training loss and test accuracy. Our experiments in transformers on arithmetic tasks suggests that there is NO entropy barrier in the memorization-to-generalization transition of grokking, challenging previous theory that defines grokking as a first-order phase transition. We identify a high-entropy advantage under grokking, an extension of prior work linking entropy to generalizability but much more significant. Inspired by grokking's far-from-equilibrium nature, we develop a toy optimizer WanD based on Wang-landau molecular dynamics, which can eliminate grokking without any constraints and find high-norm generalizing solutions. This provides strictly-defined counterexamples to theory attributing grokking solely to weight norm evolution towards the Goldilocks zone and also suggests new potential ways for optimizer design.

cs.LG↗

arXiv2025

Towards Proactive Personalization through Profile Customization for Individual Users in Dialogues

The deployment of Large Language Models (LLMs) in interactive systems necessitates a deep alignment with the nuanced and dynamic preferences of individual users. Current alignment techniques predominantly address universal human values or static, single-turn preferences, thereby failing to address the critical needs of long-term personalization and the initial user cold-start problem. To bridge this gap, we propose PersonalAgent, a novel user-centric lifelong agent designed to continuously infer and adapt to user preferences. PersonalAgent constructs and dynamically refines a unified user profile by decomposing dialogues into single-turn interactions, framing preference inference as a sequential decision-making task. Experiments show that PersonalAgent achieves superior performance over strong prompt-based and policy optimization baselines, not only in idealized but also in noisy conversational contexts, while preserving cross-session preference consistency. Furthermore, human evaluation confirms that PersonalAgent excels at capturing user preferences naturally and coherently. Our findings underscore the importance of lifelong personalization for developing more inclusive and adaptive conversational agents. Our code is available here.

cs.CL↗

arXiv2025

Beyond N-grams: A Hierarchical Reward Learning Framework for Clinically-Aware Medical Report Generation

Automatic medical report generation can greatly reduce the workload of doctors, but it is often unreliable for real-world deployment. Current methods can write formally fluent sentences but may be factually flawed, introducing serious medical errors known as clinical hallucinations, which make them untrustworthy for diagnosis. To bridge this gap, we introduce HiMed-RL, a Hierarchical Medical Reward Learning Framework designed to explicitly prioritize clinical quality. HiMed-RL moves beyond simple text matching by deconstructing reward learning into three synergistic levels: it first ensures linguistic fluency at the token-level, then enforces factual grounding at the concept-level by aligning key medical terms with expert knowledge, and finally assesses high-level diagnostic consistency at the semantic-level using a specialized LLM verifier. This hierarchical reward is implemented via a Human-inspired Dynamic Reward Adjustment, a strategy which first teaches the model to learn basic facts before progressing to more complex diagnostic reasoning. Experimentally, HiMed-3B achieves state-of-the-art performance on both in-domain and out-of-domain benchmarks, particularly on the latter, with an improvement of 12.1% over the second-best baseline. Our work provides a robust paradigm for generating reports that not only improve fluency but clinical fine-grained quality.

cs.CE↗

arXiv2025

Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detection

Anomaly detection (AD) is essential for industrial inspection, yet existing methods typically rely on ``comparing'' test images to normal references from a training set. However, variations in appearance and positioning often complicate the alignment of these references with the test image, limiting detection accuracy. We observe that most anomalies manifest as local variations, meaning that even within anomalous images, valuable normal information remains. We argue that this information is useful and may be more aligned with the anomalies since both the anomalies and the normal information originate from the same image. Therefore, rather than relying on external normality from the training set, we propose INP-Former, a novel method that extracts Intrinsic Normal Prototypes (INPs) directly from the test image. Specifically, we introduce the INP Extractor, which linearly combines normal tokens to represent INPs. We further propose an INP Coherence Loss to ensure INPs can faithfully represent normality for the testing image. These INPs then guide the INP-Guided Decoder to reconstruct only normal tokens, with reconstruction errors serving as anomaly scores. Additionally, we propose a Soft Mining Loss to prioritize hard-to-optimize samples during training. INP-Former achieves state-of-the-art performance in single-class, multi-class, and few-shot AD tasks across MVTec-AD, VisA, and Real-IAD, positioning it as a versatile and universal solution for AD. Remarkably, INP-Former also demonstrates some zero-shot AD capability. Code is available at:https://github.com/luow23/INP-Former.

cs.CV↗

arXiv2025

Med-U1: Incentivizing Unified Medical Reasoning in LLMs via Large-scale Reinforcement Learning

Medical Question-Answering (QA) encompasses a broad spectrum of tasks, including multiple choice questions (MCQ), open-ended text generation, and complex computational reasoning. Despite this variety, a unified framework for delivering high-quality medical QA has yet to emerge. Although recent progress in reasoning-augmented large language models (LLMs) has shown promise, their ability to achieve comprehensive medical understanding is still largely unexplored. In this paper, we present Med-U1, a unified framework for robust reasoning across medical QA tasks with diverse output formats, ranging from MCQs to complex generation and computation tasks. Med-U1 employs pure large-scale reinforcement learning with mixed rule-based binary reward functions, incorporating a length penalty to manage output verbosity. With multi-objective reward optimization, Med-U1 directs LLMs to produce concise and verifiable reasoning chains. Empirical results reveal that Med-U1 significantly improves performance across multiple challenging Med-QA benchmarks, surpassing even larger specialized and proprietary models. Furthermore, Med-U1 demonstrates robust generalization to out-of-distribution (OOD) tasks. Extensive analysis presents insights into training strategies, reasoning chain length control, and reward design for medical LLMs. Our code is available here.

cs.CL↗

arXiv2025

Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgment

Aligning language models with human preferences presents significant challenges, particularly in achieving personalization without incurring excessive computational costs. Existing methods rely on reward signals and additional annotated data, limiting their scalability and adaptability to diverse human values. To address these challenges, we introduce Persona-judge, a novel discriminative paradigm that enables training-free personalized alignment with unseen preferences. Instead of optimizing policy parameters through external reward feedback, Persona-judge leverages the intrinsic preference judgment capabilities of the model. Specifically, a draft model generates candidate tokens conditioned on a given preference, while a judge model, embodying another preference, cross-validates the predicted tokens whether to be accepted. Experimental results demonstrate that Persona-judge, using the inherent preference evaluation mechanisms of the model, offers a scalable and computationally efficient solution to personalized alignment, paving the way for more adaptive customized alignment. Our code is available here.

cs.CL↗

arXiv2025

DiffPO: Diffusion-styled Preference Optimization for Efficient Inference-Time Alignment of Large Language Models

Inference-time alignment provides an efficient alternative for aligning LLMs with humans. However, these approaches still face challenges, such as limited scalability due to policy-specific value functions and latency during the inference phase. In this paper, we propose a novel approach, Diffusion-styled Preference Optimization (\model), which provides an efficient and policy-agnostic solution for aligning LLMs with humans. By directly performing alignment at sentence level, \model~avoids the time latency associated with token-level generation. Designed as a plug-and-play module, \model~can be seamlessly integrated with various base models to enhance their alignment. Extensive experiments on AlpacaEval 2, MT-bench, and HH-RLHF demonstrate that \model~achieves superior alignment performance across various settings, achieving a favorable trade-off between alignment quality and inference-time latency. Furthermore, \model~demonstrates model-agnostic scalability, significantly improving the performance of large models such as Llama-3-70B.

cs.CL↗

arXiv2025

From Matter Density to Deflection Angle and Gravitational Lensing Using a Perturbative Method

In this work, we develop a perturbative method to compute the deflection angle of null or timelike signals in spacetimes filled with a static and spherically symmetric (SSS) perfect fluid with fairly arbitrary density distributions. After solving the Tolman-Oppenheimer-Volkoff equations, the metric functions of the spacetime are obtained either as asymptotic series or as expansions around a finite boundary. The deflection angles of null or timelike signals in the weak-field limit in such spacetimes can then be expressed as series expansions in terms of the impact parameter, with coefficients determined by the metric expansions and, in turn, the density distribution function. Gravitational lensing equations are also solved perturbatively to derive the apparent angles of the lensed images. Comparing our analytical formulas with numerical results demonstrates the validity and efficiency of our method and results. This procedure establishes a direct connection between the mass density, the deflection angle, and the apparent angles of gravitationally lensed images. We apply these methods and results to the generalized Navarro-Frenk-White model and some other density profiles to analyze the influence of the density parameters.

gr-qc↗

arXiv2025

High-entropy Advantage in Neural Networks' Generalizability

One of the central challenges in modern machine learning is understanding how neural networks generalize knowledge learned from training data to unseen test data. While numerous empirical techniques have been proposed to improve generalization, a theoretical understanding of the mechanism of generalization remains elusive. Here we introduce the concept of Boltzmann entropy into neural networks by re-conceptualizing such networks as hypothetical molecular systems where weights and biases are atomic coordinates, and the loss function is the potential energy. By employing molecular simulation algorithms, we compute entropy landscapes as functions of both training loss and test accuracy (or test loss), on networks with up to 1 million parameters, across four distinct machine learning tasks: arithmetic question, real-world tabular data, image recognition, and language modeling. Our results reveal the existence of high-entropy advantage, wherein high-entropy network states generally outperform those reached via conventional training techniques like stochastic gradient descent. This entropy advantage provides a thermodynamic explanation for neural network generalizability: the generalizable states occupy a larger part of the parameter space than its non-generalizable analog at low train loss. Furthermore, we find this advantage more pronounced in narrower neural networks, indicating a need for different training optimizers tailored to different sizes of networks.

cs.LG↗

arXiv2025

Dome-like pressure-temperature phase diagram of the cooperative Jahn--Teller distortion in NaNiO$_2$

NaNiO$_2$ is a Ni$^{3+}$-containing layered material consisting of alternating triangular networks of Ni and Na cations, separated by octahedrally-coordinated O anions. At ambient pressure, it features a collinear Jahn--Teller distortion below $T^\mathrm{JT}_\mathrm{onset}\approx480$ K, which disappears in a first-order transition on heating to $T^\mathrm{JT}_\mathrm{end}\approx500$ K, corresponding to the increase in symmetry from monoclinic to rhombohedral. It was previously studied by variable-pressure neutron diffraction [ACS Inorganic Chemistry 61.10 (2022): 4312-4321] and found to exhibit an increasing $T^\mathrm{JT}_\mathrm{onset}$ with pressure up to ~5 GPa. In this work, powdered NaNiO$_2$ was studied via variable-pressure synchrotron x-ray diffraction up to pressures of ~67 GPa at 294 K and 403 K. Suppression of the collinear Jahn--Teller ordering is observed via the emergence of a high-symmetry rhombohedral phase, with the onset pressure occurring at ~18 GPa at both studied temperatures. Further, a discontinuous decrease in unit cell volume is observed on transitioning from the monoclinic to the rhombohedral phase. These results taken together suggest that in the vicinity of the transition, application of pressure causes the Jahn--Teller transition temperature, $T^\mathrm{JT}_\mathrm{onset}$, to decrease rapidly. We conclude that the pressure-temperature phase diagram of the cooperative Jahn--Teller distortion in NaNiO$_2$ is dome-like.

cond-mat.mtrl-sci↗

arXiv2025

PAD: Personalized Alignment of LLMs at Decoding-Time

Aligning with personalized preferences, which vary significantly across cultural, educational, and political differences, poses a significant challenge due to the computational costs and data demands of traditional alignment methods. In response, this paper presents Personalized Alignment at Decoding-time (PAD), a novel framework designed to align LLM outputs with diverse personalized preferences during the inference phase, eliminating the need for additional training. By introducing a unique personalized reward modeling strategy, this framework decouples the text generation process from personalized preferences, facilitating the generation of generalizable token-level personalized rewards. The PAD algorithm leverages these rewards to guide the decoding process, dynamically tailoring the base model's predictions to personalized preferences. Extensive experimental results demonstrate that PAD not only outperforms existing training-based alignment methods in terms of aligning with diverse preferences but also shows significant generalizability to preferences unseen during training and scalability across different base models. This work advances the capability of LLMs to meet user needs in real-time applications, presenting a substantial step forward in personalized LLM alignment.

cs.CL↗

arXiv2025

Magnetoelastic coupling in the stretched diamond lattice of TbTaO$_4$

The magnetic structure of diamond-like lattice has been studied extensively in terms of the magnetic frustration. Here we report the distortion of stretched diamond lattice of Tb$^{3+}$ (4$f^8$) in M-TbTaO$_4$ on application of a magnetic field. We have investigated the structural and magnetic properties of M phase terbium tantalate M-TbTaO$_4$ as a function of temperature and magnetic field using magnetometry and powder neutron diffraction. Sharp $λ$-shape transitions in $d(χT)/dT$, $dM/dH$ and specific heat data confirm the previously reported three-dimensional (3D) antiferromagnetic ordering at $T_N \approx 2.25$ K. On application of a magnetic field the Néel temperature is found to decrease and variable field neutron diffraction experiments below $T_N$ at 1.6 K show an increase in both the bond and angle distortion of the stretched diamond lattice with magnetic field, indicating a potential magneto-elastic coupling effect. By combining our magnetometry, heat capacity and neutron diffraction results we generate a magnetic phase diagram for M-TbTaO$_4$ as a function of temperature and field.

cond-mat.str-el↗

arXiv2024

Cavity dark mode mediated by atom array without atomic scattering loss

We realize a ring cavity strongly interacting with an atom array with configurable spatial structures. By preparing the atom array with a maximized structure factor, we observe the emergence of a cavity dark mode, where the standing-wave nodes are dynamically locked to the positions of the atoms. The dark mode is decoupled from the atoms, protecting the system from dissipation through atomic scattering, but still mediates strong coupling and enables efficient conversion between two optical modes. Moreover, we impart an arbitrary large phase shift on the converted optical fields by translating the atom array. This strongly interacting ring cavity system with single-atom addressability opens ways to quantum optical engineering and the generation of photonic quantum states based on the geometrical structure of atom arrays.

quant-ph↗

arXiv2023

Does Correction Remain A Problem For Large Language Models?

As large language models, such as GPT, continue to advance the capabilities of natural language processing (NLP), the question arises: does the problem of correction still persist? This paper investigates the role of correction in the context of large language models by conducting two experiments. The first experiment focuses on correction as a standalone task, employing few-shot learning techniques with GPT-like models for error correction. The second experiment explores the notion of correction as a preparatory task for other NLP tasks, examining whether large language models can tolerate and perform adequately on texts containing certain levels of noise or errors. By addressing these experiments, we aim to shed light on the significance of correction in the era of large language models and its implications for various NLP applications.

cs.CL↗

arXiv2023

Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System

Dialogue data in real scenarios tend to be sparsely available, rendering data-starved end-to-end dialogue systems trained inadequately. We discover that data utilization efficiency in low-resource scenarios can be enhanced by mining alignment information uncertain utterance and deterministic dialogue state. Therefore, we innovatively implement dual learning in task-oriented dialogues to exploit the correlation of heterogeneous data. In addition, the one-to-one duality is converted into a multijugate duality to reduce the influence of spurious correlations in dual training for generalization. Without introducing additional parameters, our method could be implemented in arbitrary networks. Extensive empirical analyses demonstrate that our proposed method improves the effectiveness of end-to-end task-oriented dialogue systems under multiple benchmarks and obtains state-of-the-art results in low-resource scenarios.

cs.CL↗