arXiv Science⌕ Search

arXiv subjects

Jian Zhang

Publications and source records attributed to Jian Zhang.

At least 109 records · Page 6Linked to original sources

Video Generation with Predictive Latents

Video Variational Autoencoder (VAE) enables latent video generative modeling by mapping the visual world into compact spatiotemporal latent spaces, improving training efficiency and stability. While existing video VAEs achieve commendable reconstruction quality, continued optimization of reconstruction does not necessarily translate into improved generative performance. How to enhance the diffusability of video latents remains a critical and unresolved challenge. In this work, inspired by principles of predictive world modeling, we investigate the potential of predictive learning to improve the video generative modeling. To this end, we introduce a simple and effective predictive reconstruction objective that unifies predictive learning with video reconstruction. Specifically, we randomly discard future frames and encode only partial past observations, while training the decoder to reconstruct the observed frames and predict future ones simultaneously. This design encourages the latent space to encode temporally predictive structures and build a more coherent understanding of video dynamics, thereby improving generation quality. Our model, termed Predictive Video VAE (PV-VAE), achieves superior performance on video generation, with 52% faster convergence and a 34.42 FVD improvement over the Wan2.2 VAE on UCF101. Furthermore, comprehensive analyses demonstrate that PV-VAE not only exhibits favorable scalability, with generative performance improving alongside VAE training, but also yields consistent gains in downstream video understanding, underscoring a latent space that effectively captures temporal coherence and motion priors.

cs.CV↗

StableMind: Source-Free Cross-Subject fMRI Decoding with Regularized Adaptation

Existing cross-subject fMRI decoding methods typically train a model on multiple scanned subjects and then adapt it to a new subject using substantial paired fMRI-image data. However, in realistic scenarios, new-subject fMRI data are often limited due to costly data acquisition, and raw data from previous subjects may be inaccessible, leading existing methods to suffer performance degradation during new-subject adaptation. In this paper, we identify that this degradation stems from two key issues: brain-side instability caused by large subject differences in fMRI responses, and image-side supervision unreliability caused by fine-grained visual details that are not reliably supported by limited fMRI signals. To address these challenges, we propose StableMind, a regularized adaptation framework designed to improve brain-side representation stability and image-side supervision reliability. (1) To stabilize brain representations, StableMind reuses ridge projections from the pretrained model as adaptation priors to constrain limited-data new-subject adaptation, and applies Fourier-based feature-level brain augmentation to improve robustness to individual variability. (2) To improve image supervision reliability, StableMind introduces difficulty-aware image blur for brain-image alignment, reducing the influence of fine-grained visual details that are weakly supported by limited fMRI signals while preserving stable visual structure. Experiments on the Natural Scenes Dataset under a unified 1-hour adaptation protocol demonstrate that StableMind achieves 84.02% image retrieval accuracy and 81.66% brain retrieval accuracy averaged over four subjects, surpassing the state-of-the-art method by 5.71% brain retrieval accuracy with fewer trainable adaptation parameters. Our code is available at https://github.com/lingeringlight/StableMind.

cs.CV↗

Sapphire Photonic Crystal Fiber Sensor

Sapphire optical fiber shows great promise for remote sensing in extreme environments approaching 2000 degC, by using laser-processing to form a single-mode waveguide within it. However, for practical application, longer devices with high manufacturability and reliability are required. We report the design, modeling, fabrication, and optimization of an index-guiding sapphire photonic crystal fiber Bragg grating temperature sensor. The device is fabricated using femtosecond laser direct writing to inscribe both the photonic crystal waveguide and the Bragg grating. A spatial light modulator was used to compensate for the mismatch between the immersion objective and the high-index oil used. This improved the aspect ratio and suppressed cracking during fabrication, for higher reliability. The design results in a 6-fold reduction in fabrication time over an equivalent depressed cladding waveguide, significantly reducing the cost of manufacture. Devices up to 7 cm long were fabricated and spliced to standard single-mode fiber. The propagation loss was estimated to be 0.7 dB/cm and the Bragg gratings had a bandwidth of approximately 0.12 nm. Devices were tested in a furnace showing a temperature sensitivity of between 19.0-32.3 pm/degC over a range 25-1200 degC. These longer devices have the potential to enable practical high precision extreme temperature monitoring in many applications, with lower manufacturing cost and higher reliability.

physics.optics↗

SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning

Large vision-language models (VLMs) still struggle with reliable 3D spatial reasoning, a core capability for embodied and physical AI systems. This limitation arises from their inability to capture fine-grained 3D geometry and spatial relationships. While recent efforts have introduced multi-view geometry transformers into VLMs, they typically fuse only the deep-layer features from vision and geometry encoders, discarding rich hierarchical signals and creating a fundamental bottleneck for spatial understanding. To overcome this, we propose SpatialStack, a general hierarchical fusion framework that progressively aligns vision, geometry, and language representations across the model hierarchy. Moving beyond conventional late-stage vision-geometry fusion, SpatialStack stacks and synchronizes multi-level geometric features with the language backbone, enabling the model to capture both local geometric precision and global contextual semantics. Building upon this framework, we develop VLM-SpatialStack, a model that achieves state-of-the-art performance on multiple 3D spatial reasoning benchmarks. Extensive experiments and ablations demonstrate that our multi-level fusion strategy consistently enhances 3D understanding and generalizes robustly across diverse spatial reasoning tasks, establishing SpatialStack as an effective and extensible design paradigm for vision-language-geometry integration in next-generation multimodal physical AI systems.

cs.CV↗

A Survey on GNN-based Link Prediction: Techniques, Applications, and Challenges

Graph Neural Networks (GNNs) have emerged as the leading paradigm for link prediction, enabling the inference of missing connections and the anticipation of potential future links. However, existing reviews lack systematic exploration specifically targeting underlying GNN architectures and diverse graph structures. To address this critical gap, this paper provides a comprehensive review of GNN-based link prediction from a novel and dedicated GNN perspective. We propose an innovative taxonomy that categorizes recent advancements based on techniques and applications. From a technique perspective, we focus on key GNN encoder architectures, including GCN-based, GAE-based, GAT-based, and GFormer-based methods, discussing their strengths and limitations. From an application perspective, we highlight prominent use cases of link prediction in knowledge graphs and recommendation systems, demonstrating their real-world impact. In addition, we examine the current challenges and discuss promising future directions.

cs.AI↗

SVOM/VT: Instrument Overview, Science Objectives, and First-Year Performance

The 44-cm Visible Telescope (VT) aboard the Space-based Variable Objects Monitor (SVOM) is a dual-band (400-650 nm and 650-1000 nm) instrument designed to detect and characterize the optical counterparts of gamma-ray bursts (GRBs) and other high-energy transients. This paper presents the VT's design, scientific objectives, observing strategies, and both space- and ground-based data processing pipelines, along with its first-year in-orbit performance. In-orbit commissioning tests confirm a sensitivity of 22.5 AB mag (300 s exposure), extendable to $\sim\!24$ AB mag through stacking. This performance enables the VT to monitor over 100 GRBs in its first year with an exceptional $\sim\!80\%$ detection rate for \textit{SVOM}/ECLAIRS-triggered bursts and ToO-observed bursts from other missions (e.g., \textit{Swift, Fermi, Einstein Probe (EP)}), outperforming \textit{Swift}/UVOT's $\sim\!40\%$ detection rate. Beyond its exceptional detection efficiency, the VT played a key role in identifying high-redshift GRBs-most notably GRB 250314A (z = 7.3). Its deep upper limits at long wavelengths (up to 1 $μ$m) were pivotal in guiding follow-up observations with large ground-based telescopes, enabling crucial near-infrared (NIR) detections. With its rapid response, deep sensitivity, and real-time processing capabilities, the VT is a key instrument for GRB research in \textit{SVOM}-era, enabling critical studies of GRB optical afterglows, circumburst environments, relativistic jet dynamics, and the origins of optically dark bursts.

astro-ph.HE↗

SVOM/VT: Flight Model Verification and Pre-launch Testing

This paper presents pre-launch testing and calibration results for the SVOM/VT (Space-based Variable Objects Monitor, Visible Telescope) Flight Model (FM), validating its performance under simulated space conditions through thermal vacuum cycling, energy concentration analysis, stray light suppression, and CCD/electronics calibrations (gain, noise, quantum efficiency). The results confirm full compliance with design requirements: stray light suppression achieves point-source transmittance $<10^{-7}$ at $30^\circ$ off-axis, thermal control maintains stable CCD temperatures ($-75^\circ$C for the red channel, $-65^\circ$C for the blue channel), and detection sensitivity meets the limiting magnitude of 22.50 (SNR $>$ 3 with 300 seconds exposure). Early in-orbit tests further validate performance, yielding limiting magnitudes of 22.70 (V-band, red) and 22.78 (blue), consistent with pre-launch specifications.

astro-ph.IM↗

SVOM/VT: Real-Time Onboard Data Processing

The SVOM Visible Telescope (VT) is critical for the rapid identification of gamma-ray burst (GRB) optical counterparts, particularly for high-redshift candidates that require immediate infrared spectroscopic follow-up. To address the stringent bandwidth constraints of the VHF downlink while ensuring real-time data availability, we developed the VT Onboard Data Processing Pipeline (VOPP).This paper details the software architecture, algorithms, and hardware implementation of VOPP using an FPGA and a CPU. The pipeline performs essential real-time tasks, including image quality assessment, dark and flat-field correction, and optimized image stacking to mitigate cosmic ray contamination and variable background noise. Furthermore, it generates compact source catalogs and highly compressed 1-bit images to facilitate rapid downlink.In-flight performance analysis confirms the pipeline's robustness, demonstrating the availability of VT VHF data for 78 percent of promptly slewed SVOM GRBs, with 56 percent leading to the identification of optical counterparts, typically within 18 minutes post-trigger.

astro-ph.IM↗

Quantum Super Littlewood Correspondences

In this paper, we study the Littlewood theory associated with the quantum super immanants and supersymmetric polynomials, including both the super case and the quantum generalization. In the setting of quantum super Schur-Weyl duality between the quantum superalgebra $U_q(\mathfrak{gl}_{m|n})$ and the Iwahori-Hecke algebra $\mathcal{H}_r$ of type A, we explicitly construct basis vectors of the $(U_q(\mathfrak{gl}_{m|n}), \mathcal{H}_r)$-bimodule on the tensor product space $(\mathbb{C}^{m|n})^{\otimes r}$. Using this construction, we interpret the quantum super immanants via weight spaces of covariant tensor representations of $U_q(\mathfrak{gl}_{m|n})$.

math.QA↗

Making TransactionIsolation Checking Practical

Checking whether database transactions adhere to isolation levels is a crucial yet challenging problem. We present Boomslang, the first general-purpose checking framework capable of verifying configurations that were previously uncheckable. Boomslang advances beyond prior work in three key aspects: (1) it supports arbitrary operation types provided by modern transactional key-value stores, (2) it requires no knowledge of database internals, and (3) it offers a modular, extensible pipeline amenable to customization and optimizations. Boomslang adopts a front-/back-end separation. As the front-end, it parses a database trace into an Abstract Semantic Graph, which is then lowered -- via semantic analysis -- into a low-level intermediate representation (IR). The back-end converts this IR to a set of constraints for SMT solving. This design is enabled by a key abstraction in the IR, called superpositions, which capture the uncertainty and complexity caused by arbitrary operations and missing information. Our experiments show that with just 271--386 lines of code, the core logic of three prior checkers can be reimplemented as Boomslang modules, achieving comparable or superior performance. Using Boomslang, we also identify a new bug in TiDB, audit the metadata layer of the JuiceFS file system, check vendor-specific behavior in MariaDB, support five previously unchecked isolation levels, and confirm a theoretical result on the correctness of strict serializability.

cs.DB↗

VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction

The rapid advancement of Large Multimodal Models (LMMs) for 2D images and videos has motivated extending these models to understand 3D scenes, aiming for human-like visual-spatial intelligence. Nevertheless, achieving deep spatial understanding comparable to human capabilities poses significant challenges in model encoding and data acquisition. Existing methods frequently depend on external depth sensors for geometry capture or utilize off-the-shelf algorithms for pre-constructing 3D maps, thereby limiting their scalability, especially with prevalent monocular video inputs and for time-sensitive applications. In this work, we introduce VLM-3R, a unified framework for Vision-Language Models (VLMs) that incorporates 3D Reconstructive instruction tuning. VLM-3R processes monocular video frames by employing a geometry encoder to derive implicit 3D tokens that represent spatial understanding. Leveraging our Spatial-Visual-View Fusion and over 200K curated 3D reconstructive instruction tuning question-answer (QA) pairs, VLM-3R effectively aligns real-world spatial context with language instructions. This enables monocular 3D spatial assistance and embodied reasoning. To facilitate the evaluation of temporal reasoning, we introduce the Vision-Spatial-Temporal Intelligence benchmark, featuring over 138.6K QA pairs across five distinct tasks focused on evolving spatial relationships. Extensive experiments demonstrate that our model, VLM-3R, not only facilitates robust visual-spatial reasoning but also enables the understanding of temporal 3D context changes, excelling in both accuracy and scalability.

cs.CV↗

SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing

Traditional photographic image editing typically requires users to possess sufficient aesthetic understanding to provide appropriate instructions for adjusting image quality and camera parameters. However, this paradigm relies on explicit human instruction of aesthetic intent, which is often ambiguous, incomplete, or inaccessible to non-expert users. In this work, we propose SmartPhotoCrafter, an automatic photographic image editing method which formulates image editing as a tightly coupled reasoning-to-generation process. The proposed model first performs image quality comprehension and identifies deficiencies by the Image Critic module, and then the Photographic Artist module realizes targeted edits to enhance image appeal, eliminating the need for explicit human instructions. A multi-stage training pipeline is adopted: (i) Foundation pretraining to establish basic aesthetic understanding and editing capabilities, (ii) Adaptation with reasoning-guided multi-edit supervision to incorporate rich semantic guidance, and (iii) Coordinated reasoning-to generation reinforcement learning to jointly optimize reasoning and generation. During training, SmartPhotoCrafter emphasizes photo-realistic image generation, while supporting both image restoration and retouching tasks with consistent adherence to color- and tone-related semantics. We also construct a stage-specific dataset, which progressively builds reasoning and controllable generation, effective cross-module collaboration, and ultimately high-quality photographic enhancement. Experiments demonstrate that SmartPhotoCrafter outperforms existing generative models on the task of automatic photographic enhancement, achieving photo-realistic results while exhibiting higher tonal sensitivity to retouching instructions. Project page: https://github.com/vivoCameraResearch/SmartPhotoCrafter.

cs.CV↗

Bulk superconductivity up to 96 K in pressurized nickelate single crystals

Recently, the Ruddlesden-Popper bilayer nickelate $La_3Ni_2O_7$ has emerged as a superconductor with a transition temperature ($T_c$) of approximately 80 K above 14 GPa (Refs. 1-3). Achieving higher $T_c$ in nickelate superconductors, along with the synthesis of reproducible high-quality single crystals without relying on high-oxygen-pressure growth conditions, remains a significant challenge$^{[4-7]}$. Here we report superconductivity up to 96 K under high pressure in bilayer nickelate single crystals synthesized at ambient pressure. Energy-dispersive spectroscopy, single-crystal X-ray diffraction, nuclear quadrupole resonance and scanning transmission electron microscopy evidenced high crystal quality of the flux-grown $La_2SmNi_2O_{7-δ}$ single crystals. $La_2SmNi_2O_7$ exhibits clear bulk superconductivity, including zero resistivity ($T_{c,max}^{onset}$ = 92 K and $T_{c,max}^{zero}$ = 73 K at 21.6 GPa) and the Meissner effect ($T_c$= 60 K at 20.6 GPa). A low-temperature high-pressure structural study indicates that both monoclinic and tetragonal structures can support superconductivity in this bilayer nickelate. Furthermore, we established a correlation between higher $T_c$ under high pressures and larger in-plane lattice distortion under ambient conditions, corroborated by observing even higher $T_c^{onset}$ of 96 K in $La_{1.57}Sm_{1.43}Ni_2O_{7-δ}$. This study overcomes key limitations in growing nickelate superconductor crystals, resolves the crystal structure in the superconducting state and demonstrates an effective pathway towards achieving higher $T_c$.

cond-mat.supr-con↗

DeepFWI: Identifying Bug-Sensitive Warnings with Multi-Modal Code-Warning Semantics

Static analysis tools have evolved over time to assist in detecting bugs. However, the excessive false warnings can impede developers' productivity and confidence in the tools. Previous research efforts have explored learning-based approaches to identify bug warnings. Nevertheless, their coarse granularity, focusing on either long-term warnings or function-level alerts, is insensitive to individual bugs. Also, they rely on manually crafted features or solely on source code semantics, which is inadequate for effective learning. In this paper, we propose DeepFWI, a learning-based approach that identifies bug-sensitive warnings at a fine-grained granularity. Specifically, we design a novel LSTM-based model that captures multi-modal semantics of source code and warnings from automated static analysis tools (ASATs) and highlights their correlations with cross-attention. To tackle the data scarcity of training and evaluation, we collected a large-scale dataset of 280,273 warnings. We conducted extensive experiments on the dataset to evaluate DeepFWI. The experimental results demonstrate the effectiveness of our approach, with an F1-score 67.06% for confirming true warnings in a finer-grained manner, significantly outperforming all baselines. Additionally, to validate the practicality of DeepFWI from the perspective of developers, we applied DeepFWI to four popular open-source projects. Our approach filtered out the vast majority of warnings, while still successfully surfacing 25 true bug-related warnings that were confirmed through manual analysis.

cs.SE↗

Dissecting Failure Dynamics in Large Language Model Reasoning

Large Language Models (LLMs) achieve strong performance through extended inference-time deliberation, yet how their reasoning failures arise remains poorly understood. By analyzing model-generated reasoning trajectories, we find that errors are not uniformly distributed but often originate from a small number of early transition points, after which reasoning remains locally coherent but globally incorrect. These transitions coincide with localized spikes in token-level entropy, and alternative continuations from the same intermediate state can still lead to correct solutions. Based on these observations, we introduce GUARD, a targeted inference-time framework that probes and redirects critical transitions using uncertainty signals. Empirical evaluations across multiple benchmarks confirm that interventions guided by these failure dynamics lead to more reliable reasoning outcomes. Our findings highlight the importance of understanding when and how reasoning first deviates, complementing existing approaches that focus on scaling inference-time computation.

cs.AI↗

A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for open-world robot manipulation, but their practical deployment is often constrained by cost: billion-scale VLM backbones and iterative diffusion/flow-based action heads incur high latency and compute, making real-time control expensive on commodity hardware. We present A1, a fully open-source and transparent VLA framework designed for low-cost, high-throughput inference without sacrificing manipulation success; Our approach leverages pretrained VLMs that provide implicit affordance priors for action generation. We release the full training stack (training code, data/data-processing pipeline, intermediate checkpoints, and evaluation scripts) to enable end-to-end reproducibility. Beyond optimizing the VLM alone, A1 targets the full inference pipeline by introducing a budget-aware adaptive inference scheme that jointly accelerates the backbone and the action head. Specifically, we monitor action consistency across intermediate VLM layers to trigger early termination, and propose Inter-Layer Truncated Flow Matching that warm-starts denoising across layers, enabling accurate actions with substantially fewer effective denoising iterations. Across simulation benchmarks (LIBERO, VLABench) and real robots (Franka, AgiBot), A1 achieves state-of-the-art success rates while significantly reducing inference cost (e.g., up to 72% lower per-episode latency for flow-matching inference and up to 76.6% backbone computation reduction with minor performance degradation). On RoboChallenge, A1 achieves an average success rate of 29.00%, outperforming baselines including pi0(28.33%), X-VLA (21.33%), and RDT-1B (15.00%).

cs.RO↗

Sharp Exponent of Stable Standing Waves for the Perturbated Hartree Equation

This paper is concerned with the stability of standing waves for the mass-critical Hartree equation with a focusing perturbation by the variational method. The profile decomposition theory is employed to prove the attainability of the cross constrained variational problem, and then the comparison of two cross constrained variational problems is derived. The sharp criteria of blowup, the orbital stability, and strong instability of standing waves without any frequency constraint are obtained. This improves the cross constrained variational argument proposed by Zhang (2005).

math.AP↗

Interpretable Zero-shot Referring Expression Comprehension with Query-driven Scene Graphs

Zero-shot referring expression comprehension (REC) aims to locate target objects in images given natural language queries without relying on task-specific training data, demanding strong visual understanding capabilities. Existing Vision-Language Models~(VLMs), such as CLIP, commonly address zero-shot REC by directly measuring feature similarities between textual queries and image regions. However, these methods struggle to capture fine-grained visual details and understand complex object relationships. Meanwhile, Large Language Models~(LLMs) excel at high-level semantic reasoning, their inability to directly abstract visual features into textual semantics limits their application in REC tasks. To overcome these limitations, we propose \textbf{SGREC}, an interpretable zero-shot REC method leveraging query-driven scene graphs as structured intermediaries. Specifically, we first employ a VLM to construct a query-driven scene graph that explicitly encodes spatial relationships, descriptive captions, and object interactions relevant to the given query. By leveraging this scene graph, we bridge the gap between low-level image regions and higher-level semantic understanding required by LLMs. Finally, an LLM infers the target object from the structured textual representation provided by the scene graph, responding with detailed explanations for its decisions that ensure interpretability in the inference process. Extensive experiments show that SGREC achieves top-1 accuracy on most zero-shot REC benchmarks, including RefCOCO val (66.78\%), RefCOCO+ testB (53.43\%), and RefCOCOg val (73.28\%), highlighting its strong visual scene understanding.

cs.CV↗