arXiv subjects

Jian Zhang

Publications and source records attributed to Jian Zhang.

At least 199 records · Page 11Linked to original sources

arXiv2025

AutoG: Towards automatic graph construction from tabular data

Recent years have witnessed significant advancements in graph machine learning (GML), with its applications spanning numerous domains. However, the focus of GML has predominantly been on developing powerful models, often overlooking a crucial initial step: constructing suitable graphs from common data formats, such as tabular data. This construction process is fundamental to applying graph-based models, yet it remains largely understudied and lacks formalization. Our research aims to address this gap by formalizing the graph construction problem and proposing an effective solution. We identify two critical challenges to achieve this goal: 1. The absence of dedicated datasets to formalize and evaluate the effectiveness of graph construction methods, and 2. Existing automatic construction methods can only be applied to some specific cases, while tedious human engineering is required to generate high-quality graphs. To tackle these challenges, we present a two-fold contribution. First, we introduce a set of datasets to formalize and evaluate graph construction methods. Second, we propose an LLM-based solution, AutoG, automatically generating high-quality graph schemas without human intervention. The experimental results demonstrate that the quality of constructed graphs is critical to downstream task performance, and AutoG can generate high-quality graphs that rival those produced by human experts. Our code can be accessible from https://github.com/amazon-science/Automatic-Table-to-Graph-Generation.

cs.LG↗

arXiv2025

LLM-Driven Completeness and Consistency Evaluation for Cultural Heritage Data Augmentation in Cross-Modal Retrieval

Cross-modal retrieval is essential for interpreting cultural heritage data, but its effectiveness is often limited by incomplete or inconsistent textual descriptions, caused by historical data loss and the high cost of expert annotation. While large language models (LLMs) offer a promising solution by enriching textual descriptions, their outputs frequently suffer from hallucinations or miss visually grounded details. To address these challenges, we propose $C^3$, a data augmentation framework that enhances cross-modal retrieval performance by improving the completeness and consistency of LLM-generated descriptions. $C^3$ introduces a completeness evaluation module to assess semantic coverage using both visual cues and language-model outputs. Furthermore, to mitigate factual inconsistencies, we formulate a Markov Decision Process to supervise Chain-of-Thought reasoning, guiding consistency evaluation through adaptive query control. Experiments on the cultural heritage datasets CulTi and TimeTravel, as well as on general benchmarks MSCOCO and Flickr30K, demonstrate that $C^3$ achieves state-of-the-art performance in both fine-tuned and zero-shot settings.

cs.CV↗

arXiv2025

ReNiL: Event-Driven Pedestrian Bayesian Localization Using IMU for Real-World Applications

Pedestrian inertial localization is key for mobile and IoT services because it provides infrastructure-free positioning. Yet most learning-based methods depend on fixed sliding-window integration, struggle to adapt to diverse motion scales and cadences, and yield inconsistent uncertainty, limiting real-world use. We present ReNiL, a Bayesian deep-learning framework for accurate, efficient, and uncertainty-aware pedestrian localization. ReNiL introduces Inertial Positioning Demand Points (IPDPs) to estimate motion at contextually meaningful waypoints instead of dense tracking, and supports inference on IMU sequences at any scale so cadence can match application needs. It couples a motion-aware orientation filter with an Any-Scale Laplace Estimator (ASLE), a dual-task network that blends patch-based self-supervision with Bayesian regression. By modeling displacements with a Laplace distribution, ReNiL provides homogeneous Euclidean uncertainty that integrates cleanly with other sensors. A Bayesian inference chain links successive IPDPs into consistent trajectories. On RoNIN-ds and a new WUDataset covering indoor and outdoor motion from 28 participants, ReNiL achieves state-of-the-art displacement accuracy and uncertainty consistency, outperforming TLIO, CTIN, iMoT, and RoNIN variants while reducing computation. Application studies further show robustness and practicality for mobile and IoT localization, making ReNiL a scalable, uncertainty-aware foundation for next-generation positioning.

cs.RO↗

arXiv2025

NVIDIA Nemotron Nano V2 VL

We introduce Nemotron Nano V2 VL, the latest model of the Nemotron vision-language series designed for strong real-world document understanding, long video comprehension, and reasoning tasks. Nemotron Nano V2 VL delivers significant improvements over our previous model, Llama-3.1-Nemotron-Nano-VL-8B, across all vision and text domains through major enhancements in model architecture, datasets, and training recipes. Nemotron Nano V2 VL builds on Nemotron Nano V2, a hybrid Mamba-Transformer LLM, and innovative token reduction techniques to achieve higher inference throughput in long document and video scenarios. We are releasing model checkpoints in BF16, FP8, and FP4 formats and sharing large parts of our datasets, recipes and training code.

cs.LG↗

arXiv2025

Monotonicity Conjectures and Sharp Stability for Solitons of the Cubic-Quintic NLS on R^3

This paper deals with the cubic-quintic nonlinear Schrödinger equation on R^3. Two monotonicity conjectures for solitons posed by Killip, Oh, Pocovnicu and Visan are completely resolved: one concerning frequency monotonicity, and the other concerning mass monotonicity. Uniqueness of the energy minimizer is proved. Then sharp stability of the solitons is established. And classification of normalized solutions is first presented.

math.AP↗

arXiv2025

Sharp Stability of Solitons for the Cubic-Quintic NLS on R^2

This paper concerns with the cubic-quintic nonlinear Schrödinger equation on R^2. A family of new variational problems related to the solitons are introduced and solved. Some key monotonicity and uniqueness results are obtained. Then the orbital stability of solitons at every frequency are proved in terms of the Cazenave and Lions' argument. And classification of normalized ground states is first presented. Our results settle the questions raised by Lewin and Rota Nodari as well as Carles and Sparber.

math.AP↗

arXiv2025

Uniqueness and stability of normalized ground states for Hartree equation with a harmonic potential

The dynamic properties of normalized ground states for the Hartree equation with a harmonic potential are addressed. The existence of normalized ground state for any prescribed mass is confirmed according to mass-energy constrained variational approach. The uniqueness is shown by the strictly convex properties of the energy functional. Moreover, the orbital stability of every normalized ground state is proven in terms of the Cazenave and Lions' argument.

math.AP↗

arXiv2025

ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenes

Online free-viewpoint video (FVV) reconstruction is challenged by slow per-frame optimization, inconsistent motion estimation, and unsustainable storage demands. To address these challenges, we propose the Reconfigurable Continuum Gaussian Stream, dubbed ReCon-GS, a novel storage-aware framework that enables high fidelity online dynamic scene reconstruction and real-time rendering. Specifically, we dynamically allocate multi-level Anchor Gaussians in a density-adaptive fashion to capture inter-frame geometric deformations, thereby decomposing scene motion into compact coarse-to-fine representations. Then, we design a dynamic hierarchy reconfiguration strategy that preserves localized motion expressiveness through on-demand anchor re-hierarchization, while ensuring temporal consistency through intra-hierarchical deformation inheritance that confines transformation priors to their respective hierarchy levels. Furthermore, we introduce a storage-aware optimization mechanism that flexibly adjusts the density of Anchor Gaussians at different hierarchy levels, enabling a controllable trade-off between reconstruction fidelity and memory usage. Extensive experiments on three widely used datasets demonstrate that, compared to state-of-the-art methods, ReCon-GS improves training efficiency by approximately 15% and achieves superior FVV synthesis quality with enhanced robustness and stability. Moreover, at equivalent rendering quality, ReCon-GS slashes memory requirements by over 50% compared to leading state-of-the-art methods.

eess.IV↗

arXiv2025

ODesign: A World Model for Biomolecular Interaction Design

Biomolecular interactions underpin almost all biological processes, and their rational design is central to programming new biological functions. Generative AI models have emerged as powerful tools for molecular design, yet most remain specialized for individual molecular types and lack fine-grained control over interaction details. Here we present ODesign, an all-atom generative world model for all-to-all biomolecular interaction design. ODesign allows scientists to specify epitopes on arbitrary targets and generate diverse classes of binding partners with fine-grained control. Across entity-, token-, and atom-level benchmarks in the protein modality, ODesign demonstrates superior controllability and performance to modality-specific baselines. Extending beyond proteins, it generalizes to nucleic acid and small-molecule design, enabling interaction types such as protein-binding RNA/DNA and RNA/DNA-binding ligands that were previously inaccessible. By unifying multimodal biomolecular interactions within a single generative framework, ODesign moves toward a general-purpose molecular world model capable of programmable design. ODesign is available at https://odesign.lglab.ac.cn ,

q-bio.BM↗

arXiv2025

Kinematic, Elemental and Structural Dependences on Metallicity in the Galactic Bulge

We selected Bulge stars from APOGEE DR17 cross-matched with astrometric data from \textit{Gaia} DR3. Bulge stars were divided into sub-samples with line-of-sight velocity dispersion analyzed and the peaks of MDF were detected by both Gaussian Mixture Models (GMM) and \texttt{scipy.signal.find\_peaks}. GMM is also conducted to kinematically distinguish the metal-poor and metal-rich populations. Analyses were put on the Bulge stars (including retrograde stars), their elemental abundances, and the [Mg/Mn]-[Al/Fe] plane to investigate potential accreted components. Finally, the shapes (X-shaped/boxy) of Bulge stars with different metallicities were analyzed through least-squares fitting based on the analytical Bulge models. By studying the kinematic, elemental and structural dependences on metallicity for Bulge stars, our findings are concluded as follows: 1. Six peaks are detected in the Bulge MDF, encompassing values reported in previous studies, suggesting a complex composition of Bulge populations. 2. An inversion relationship is well-observed in metal-rich sub-samples, while absent in metal-poor sub-samples. 3. Metal-poor populations exhibit larger dispersions than metal-rich stars (which is also revealed by GMM decomposition), suggesting that metal-rich stars are kinematically coherent. 4. Retrograde stars are confined to $\sim1$ kpc of the Galactic center, with their relative fraction decreasing at higher [Fe/H] -- a trend potentially linked to the ``spin-up'' process of Galactic disks. 5. Metal-rich Bulge stars with [Al/Fe] $<-0.15$ are likely associated with from disk accreted substructure, while all elemental planes exhibit bimodality but Na abundances rise monotonically with metallicity. 6. In general, stars with all metallicities support a boxy profile.

astro-ph.GA↗

arXiv2025

FlashMP: Fast Discrete Transform-Based Solver for Preconditioning Maxwell's Equations on GPUs

Efficiently solving large-scale linear systems is a critical challenge in electromagnetic simulations, particularly when using the Crank-Nicolson Finite-Difference Time-Domain (CN-FDTD) method. Existing iterative solvers are commonly employed to handle the resulting sparse systems but suffer from slow convergence due to the ill-conditioned nature of the double-curl operator. Approximate preconditioners, like Successive Over-Relaxation (SOR) and Incomplete LU decomposition (ILU), provide insufficient convergence, while direct solvers are impractical due to excessive memory requirements. To address this, we propose FlashMP, a novel preconditioning system that designs a subdomain exact solver based on discrete transforms. FlashMP provides an efficient GPU implementation that achieves multi-GPU scalability through domain decomposition. Evaluations on AMD MI60 GPU clusters (up to 1000 GPUs) show that FlashMP reduces iteration counts by up to 16x and achieves speedups of 2.5x to 4.9x compared to baseline implementations in state-of-the-art libraries such as Hypre. Weak scalability tests show parallel efficiencies up to 84.1%.

cs.DC↗

arXiv2025

Frame-Difference Guided Dynamic Region Perception for CLIP Adaptation in Text-Video Retrieval

With the rapid growth of video data, text-video retrieval technology has become increasingly important in numerous application scenarios such as recommendation and search. Early text-video retrieval methods suffer from two critical drawbacks: first, they heavily rely on large-scale annotated video-text pairs, leading to high data acquisition costs; second, there is a significant modal gap between video and text features, which limits cross-modal alignment accuracy. With the development of vision-language model, adapting CLIP to video tasks has attracted great attention. However, existing adaptation methods generally lack enhancement for dynamic video features and fail to effectively suppress static redundant features. To address this issue, this paper proposes FDA-CLIP (Frame Difference Alpha-CLIP), which is a concise CLIP-based training framework for text-video alignment. Specifically, the method uses frame differences to generate dynamic region masks, which are input into Alpha-CLIP as an additional Alpha channel. This proactively guides the model to focus on semantically critical dynamic regions while suppressing static background redundancy. Experiments demonstrate that frame difference-guided video semantic encoding can effectively balance retrieval efficiency and accuracy.

cs.CV↗

arXiv2025

Learned Cost Model for Placement on Reconfigurable Dataflow Hardware

Mapping a dataflow-graph of an ML model onto a reconfigurable system is difficult, as different mappings have different throughputs and consume resource constraints differently. To solve this, a model to evaluate the throughput of mappings is necessary as measuring throughput completely is expensive. Many use a hand-designed analytical model, relying on proxy features or intuition, introducing error. We provide a Learned Approach that predicts throughput 31%-52% more accurately over a variety of graphs. In addition, our approach shows no accuracy degradation after removing performance annotations. We show that using this approach results in 5.6% faster compiled graphs.

cs.DC↗

arXiv2025

Humanoid-inspired Causal Representation Learning for Domain Generalization

This paper proposes the Humanoid-inspired Structural Causal Model (HSCM), a novel causal framework inspired by human intelligence, designed to overcome the limitations of conventional domain generalization models. Unlike approaches that rely on statistics to capture data-label dependencies and learn distortion-invariant representations, HSCM replicates the hierarchical processing and multi-level learning of human vision systems, focusing on modeling fine-grained causal mechanisms. By disentangling and reweighting key image attributes such as color, texture, and shape, HSCM enhances generalization across diverse domains, ensuring robust performance and interpretability. Leveraging the flexibility and adaptability of human intelligence, our approach enables more effective transfer and learning in dynamic, complex environments. Through both theoretical and empirical evaluations, we demonstrate that HSCM outperforms existing domain generalization models, providing a more principled method for capturing causal relationships and improving model robustness. The code is available at https://github.com/lambett/HSCM.

cs.AI↗

arXiv2025

Small Language Models Offer Significant Potential for Science Community

Recent advancements in natural language processing, particularly with large language models (LLMs), are transforming how scientists engage with the literature. While the adoption of LLMs is increasing, concerns remain regarding potential information biases and computational costs. Rather than LLMs, I developed a framework to evaluate the feasibility of precise, rapid, and cost-effective information retrieval from extensive geoscience literature using freely available small language models (MiniLMs). A curated corpus of approximately 77 million high-quality sentences, extracted from 95 leading peer-reviewed geoscience journals such as Geophysical Research Letters and Earth and Planetary Science Letters published during years 2000 to 2024, was constructed. MiniLMs enable a computationally efficient approach for extracting relevant domain-specific information from these corpora through semantic search techniques and sentence-level indexing. This approach, unlike LLMs such as ChatGPT-4 that often produces generalized responses, excels at identifying substantial amounts of expert-verified information with established, multi-disciplinary sources, especially for information with quantitative findings. Furthermore, by analyzing emotional tone via sentiment analysis and topical clusters through unsupervised clustering within sentences, MiniLM provides a powerful tool for tracking the evolution of conclusions, research priorities, advancements, and emerging questions within geoscience communities. Overall, MiniLM holds significant potential within the geoscience community for applications such as fact and image retrievals, trend analyses, contradiction analyses, and educational purposes.

cs.CL↗

arXiv2025

Synergistic modulation of band structure and phonon transport for higher thermoelectric performance of WSe2

Tungsten diselenide (WSe2) emerges as a promising thermoelectric (TE) candidate due to its high thermopower (S), cost-effectiveness, and environmentally friendly characteristics. However, pristine WSe2 exhibits limited electrical conductivity (sigma), a low power factor (PF), and high lattice thermal conductivity (k_L), which restrict its overall TE performance. Here, we show that through co-doping of Nb for W and Te for Se in WSe2, its power factor increases 17-fold, reaching 8.91 microW cm^-1 K^-2 at 850 K. Simultaneously, its lattice thermal conductivity (k_L) decreases from 1.70 W m^-1 K^-1 to 0.48 W m^-1 K^-1. Experiments and density functional theory (DFT) analysis demonstrate that the enhancement of PF is linked to an increased density of states, higher effective mass (md*), improved mobility (mu), and elevated electrical conductivity (sigma) owing to the replacement of Se2- with Te2-; while the observed 72% reduction in k_L results primarily from phonon scattering at Te-Se and Nb-W defects. As a result, a remarkable ZT_max ~ 1 is obtained at 850 K for the sample W0.95Nb0.05Se2-yTey with y = 0.3, which is about a 30-fold increase compared to WSe2, proving that Nb and Te co-doping in WSe2 can significantly boost its TE performance.

cond-mat.mtrl-sci↗

arXiv2025

FedL2T: Personalized Federated Learning with Two-Teacher Distillation for Seizure Prediction

The training of deep learning models in seizure prediction requires large amounts of Electroencephalogram (EEG) data. However, acquiring sufficient labeled EEG data is difficult due to annotation costs and privacy constraints. Federated Learning (FL) enables privacy-preserving collaborative training by sharing model updates instead of raw data. However, due to the inherent inter-patient variability in real-world scenarios, existing FL-based seizure prediction methods struggle to achieve robust performance under heterogeneous client settings. To address this challenge, we propose FedL2T, a personalized federated learning framework that leverages a novel two-teacher knowledge distillation strategy to generate superior personalized models for each client. Specifically, each client simultaneously learns from a globally aggregated model and a dynamically assigned peer model, promoting more direct and enriched knowledge exchange. To ensure reliable knowledge transfer, FedL2T employs an adaptive multi-level distillation strategy that aligns both prediction outputs and intermediate feature representations based on task confidence. In addition, a proximal regularization term is introduced to constrain personalized model updates, thereby enhancing training stability. Extensive experiments on two EEG datasets demonstrate that FedL2T consistently outperforms state-of-the-art FL methods, particularly under low-label conditions. Moreover, FedL2T exhibits rapid and stable convergence toward optimal performance, thereby reducing the number of communication rounds and associated overhead. These results underscore the potential of FedL2T as a reliable and personalized solution for seizure prediction in privacy-sensitive healthcare scenarios.

cs.LG↗

arXiv2025

On the Implicit Adversariality of Catastrophic Forgetting in Deep Continual Learning

Continual learning seeks the human-like ability to accumulate new skills in machine intelligence. Its central challenge is catastrophic forgetting, whose underlying cause has not been fully understood for deep networks. In this paper, we demystify catastrophic forgetting by revealing that the new-task training is implicitly an adversarial attack against the old-task knowledge. Specifically, the new-task gradients automatically and accurately align with the sharp directions of the old-task loss landscape, rapidly increasing the old-task loss. This adversarial alignment is intriguingly counter-intuitive because the sharp directions are too sparsely distributed to align with by chance. To understand it, we theoretically show that it arises from training's low-rank bias, which, through forward and backward propagation, confines the two directions into the same low-dimensional subspace, facilitating alignment. Gradient projection (GP) methods, a representative family of forgetting-mitigating methods, reduce adversarial alignment caused by forward propagation, but cannot address the alignment due to backward propagation. We propose backGP to address it, which reduces forgetting by 10.8% and improves accuracy by 12.7% on average over GP methods.

cs.LG↗