arXiv Science⌕ Search

arXiv subjects

Tianqi Zhang

Publications and source records attributed to Tianqi Zhang.

At least 19 recordsLinked to original sources
arXiv2026

Rosemary: Efficient and Adaptable In-Storage Acceleration for Fully Homomorphic Encryption

Fully Homomorphic Encryption (FHE) enables computation on encrypted data and is promising for privacy-preserving computing. However, FHE deployment remains constrained due to massive computational, memory, and data-movement overheads. Existing acceleration strategies often overlook the storage I/O bottleneck caused by the enormous size of FHE data in large-scale applications, as most prior works focus on small benchmarks that fit in main memory. Our studies show that state-of-the-art FHE systems spend 71\% to 85\% of their execution time moving data between storage and compute units rather than performing useful computation. To address the I/O bottleneck, we present Rosemary, a heterogeneous FHE acceleration system that incorporates a novel in-storage processing (ISP) architecture with compiler-level and algorithmic optimizations. Our key innovations include 1) an adaptable hardware-aware FHE engine inside a NAND flash-based solid-state drive (SSD) for efficient and cost-effective in-storage FHE processing, 2) a Throughput-Data-Aware Program Allocator (TDAP) that partitions FHE workloads into heterogeneous programs, and 3) a Compiler-Level Ciphertext-Aware Optimizer (CLCAO) that exploits ISP-friendly FHE kernels for low-cost ISP execution. Across a diverse set of FHE workloads, including encrypted deep learning inference and cloud database queries, Rosemary achieves geometric-mean speedups of $185.7\times$ over state-of-the-art CPU/GPU implementations and $3.7\times$ over prior FHE accelerators, while improving energy efficiency by up to $3.9\times$ and Energy-Delay-Area-Product (EDAP) by up to $16.5\times$.

cs.CR↗
arXiv2026

ACSAN: All-Convolutional Self-Attention Network Integrating Convolutional Operations with Vision Transformer

In the past few years, Vision Transformer (ViT) has achieved excellent performance in the field of computer vision. However, there still some problems remain. For instance, ViTs heavily rely on large-scale training data since they simply contain a large number of trainable parameters, which slows down their learning efficiency and limits their applicability in resource-constrained scenarios. In this paper, we propose a novel deep learning model, namely All-Convolutional Self-Attention Network (ACSAN), which applies convolution operations to replace fully-connected matrices multiplications in the ViT framework. To implement ACSAN, we firstly design Dynamic Convolutional Self-Attention (DCSA) as the basic module, which employs multi-scale dilated convolutions to generate Query, Key, and Value. We defined spatial self-attention and channel self-attention to generate attention features respectively. The two attention features are finally merged as the output of the DCSA module. Based on DCSA, we then construct the basic ACSAN block. Comparing with ViT, we use DCSA to replace the regular self-attention operations, and use convolution layers to replace MLPs. To evaluate the performance of the proposed method, we train ACSAN on three widely-used image classification databases, i.e. CIFAR-10, CIFAR-100 and ImageNet-1k, from scratch. Experimental results show that ACSAN achieves excellent classification accuracy comparing with standard ViT with comparable or fewer parameters, as well as other state-of-the-art methods. Ablation studies verify that each component contributes positively to the final performance.

cs.CV↗
arXiv2026

Electric Edelstein Effect in Two Dimensions

We propose the electric Edelstein effect (EEE) in two-dimensional (2D) systems, where crossed out-of-plane and in-plane electric fields generate a spin polarization. The gate field converts the Edelstein response from a material-fixed spin polarization into a gate-tunable one. A symmetry analysis over all magnetic layer point groups shows that the EEE is allowed in a wide range of magnetic and nonmagnetic systems, including ferromagnets, antiferromagnets, and altermagnets. The EEE plays two distinct roles: it generates spin polarization where the linear Edelstein effect (EE) is symmetry-forbidden, as in centrosymmetric materials; and it adds a new gate-tunable component, generally non-collinear with the conventional one, where the EE is already present. The two fields then act as independent knobs and raise the control dimension of the spin polarization from one to two. Our microscopic theory traces the EEE to band-geometric quantities, which are strongly enhanced near small band gaps. First-principles calculations predict pronounced effects in the centrosymmetric ferromagnet MnSe2, where the linear EE is symmetry-forbidden. In the nonmagnet SnSe where the EE and EEE coexist, the two knobs cover an extended region of the spin sphere. Our findings establish the EEE as a symmetry-guided, gate-tunable route to electrical spin manipulation and open avenues for multistate spintronics in 2D quantum materials.

cond-mat.mtrl-sci↗
arXiv2026

Convergence of repeated-pole rational approximation of the exponential on infinite sectors

For $h>0$, degree $m\ge0$, $0\leβ<π$, and $q>0$, let $Σ_β=\{re^{iθ}:r\ge0,\ |θ|\leβ/2\}$ and let $E_{m,β}(q)$ denote the best uniform error for approximating $e^{-hz}$ on $Σ_β$ by rational functions whose only possible finite pole is $s=-q/h$, with multiplicity at most $m$. For the linear scaling $q=αm$ with a fixed $α>0$, a Möbius map reduces the problem to polynomial approximation on a compact lens. Write $γ_β=2-β/π$ and let $α_c(γ_β)$ denote the saddle-coalescence threshold. For $0<α<α_c(γ_β)$, let $H_β(α)\in(0,1)$ be the exponential of the real saddle action. An exact boundary Faber integral, a global fractional-power contour deformation, and a two-saddle expansion yield the sharp two-sided order $E_{m,β}(αm)\asymp m^{-1/2}H_β(α)^m$, uniformly on compact subsets of $0<α<α_c(γ_β)$. On this noncoalescing interval, the exponential factor $H_β(α)$ has the unique minimizer $α_β^*=1/[γ_β\sin(π/(2γ_β))]$ and minimum $\tan(π/(4γ_β))$, recovering the classical half-line factor $\tan(π/8)=\sqrt{2}-1$ at $β=0$. Numerical-range estimates give matrix dimension-independent upper bounds for projected shift-and-invert Arnoldi, while finite-degree pole searches and nonnormal experiments illustrate the distinction between the sector-uniform law and individual matrix computations.

math.NA↗
arXiv2026

Shifted tapered-pole approximation on finite sectors: an exact asymptotic and dimension control

We study explicit lightning-plus-polynomial (LP) approximation of $g(z)z^α(\log z)^m$ on a closed unit-radius sector, where $0<α<1$, $m$ is fixed, and $g$ is analytic nearby. Since the basic sector root-exponential rate is already known, we address three finer questions. First, a one-sided Abel--Poisson formula and a pole-free notched contour give a branchwise error bound that is uniform for grid shifts in compact subsets of $(0,1)$ and valid for every fixed logarithmic power. Second, for $z^α$ in the dense and balanced regimes, an exact vertex-scale rescaling identifies a positive finite leading constant for a specified shifted sequence. Third, a rate-matched band of additional representation poles followed by polynomial compression gives the explicit representation dimension $N+2\sqrt{2αλ_σN}+O(1)$ while leaving the first $N$ tapered poles unchanged. A slightly overresolved hybrid sequence also preserves the exact leading constant. Matched-dimension experiments, including reentrant sectors, illustrate the allocation. These exact-asymptotic and dimension statements concern the stated constructions, not sector minimax approximation or total computational complexity.

math.NA↗
arXiv2026

Fixed-Grid Reversibility of High-Order Splittings for Nonlinear Schrödinger Equations with Arbitrary-Axis 3D Rotation

High-order splittings for rotational nonlinear Schrödinger equations may use an exact continuous factorization of the Laplace--rotation flow, but its fixed-grid Fourier realization need not retain the symmetry required by standard symmetric compositions. For the specified realization of the 3D arbitrary-axis explicit exact integrator (EEI), we prove that the complete map has a nonzero quadratic coefficient in its local matrix logarithm for every nonzero rotation on centered even grids. The defect persists under every real consistent composition of the same unrepaired nonlinear sandwich through a positive sum-of-squares factor. We construct two self-adjoint remedies: an adjoint-symmetrized EEI and a palindromic shear alternative. Fourier-tail estimates illustrate the representation mechanism, while complete-map diagnostics and a three-dimensional dipolar benchmark are consistent with the predicted order behavior. An implementation audit separates floating-point coefficient cancellation from the exact-arithmetic symmetry defect.

math.NA↗
arXiv2026

FedUHD: Unsupervised Federated Learning using In-Memory Hyperdimensional Computing

Unsupervised federated learning (UFL) enables privacy-preserving distributed training without data labeling, yet practical deployment remains challenging due to non-IID data, high computational and communication costs at edge devices, and sensitivity to communication noise. We propose FedUHD, the first UFL framework based on Hyperdimensional Computing (HDC). On the client side, FedUHD employs kNN-based cluster hypervector removal to mitigate non-IID effects by filtering detrimental local outliers. On the server side, cluster-aware HDC aggregation leverages cluster-level statistics to stabilize learning across heterogeneous clients. To further improve efficiency, we design a compute-in-memory (CIM) accelerator based on a novel phase-change memory (PCM) device, integrated with lightweight ASIC digital modules to execute the client-side HDC pipeline within the accelerator. The intrinsic robustness of HDC to low precision and device variations enables efficient mapping onto analog PCM crossbars, exploiting massive parallelism while minimizing data movement. Experimental results show that FedUHD achieves comparable accuracy to state-of-the-art neural network-based UFL methods across all datasets. On HAR and CIFAR10/100, FedUHD delivers an average 2,239x speedup and 1,542x higher energy efficiency on GPU. In addition, FedUHD reduces communication cost by up to 176x on HAR and CIFAR10/100 and demonstrates greater robustness than Orchestra under communication noise. Compared to GPU implementation of FedUHD, the proposed PCM-based accelerator provides an additional 4.07x speedup and three orders of magnitude higher energy efficiency on average. Furthermore, the results demonstrate the benefit of PCM over RRAM as a CIM substrate.

cs.LG↗
arXiv2026

Second-order Real Nodal Lines in Nodal Surface Semimetals

Real nodal lines (RNLs) featuring real Chern numbers and second-order boundary modes have attracted widespread attention. In all previously reported realizations, an RNL is linked by another nodal line, and whether an RNL can be linked by other types of band degeneracies has remained open. Here, we propose a second-order real nodal-line semimetal in which a pair of RNLs is linked by a nodal surface. We show that this state can be realized in spinless systems with both $PT$ and nonsymmorphic $S_{2z}T$ symmetries, where the $S_{2z}T$-enforced nodal surface prevents the pair of RNLs from annihilation. Each nodal line carries a nontrivial real Chern number $ν_R=1$, giving rise to topological hinge Fermi arcs located at a pair of $PT$-related hinges. Guided by this construction, we identify the interpenetrated graphene network (IGN) as a promising material realization. First-principles calculations confirm that a pair of nodal lines traversing the Brillouin zone are linked by a nodal surface and each nodal line carries double nontrivial $Z_2$ charges. The bulk-boundary correspondence of IGN manifests as a pair of hinge Fermi arcs together with drumhead surface states. Our work establishes nodal surfaces as a new linking partner for real nodal lines and provides a roadmap for exploring higher-order real topology in carbon-based and other light-element systems.

cond-mat.mtrl-sci↗
arXiv2026

Uniform Chebyshev asymptotics for repeated-pole rational approximation of the exponential

We study uniform approximation of $\exp(tz)$, $t>0$, on $(-\infty,0]$ by rational functions $P_m(z)/(q_m-z)^m$ with a prescribed repeated pole $q_m>0$. A Möbius transformation reduces the problem to polynomial approximation of $F_λ(x)=\exp\!\left(-λ\frac{1-x}{1+x}\right)$ on $[-1,1]$, where $λ=tq_m$. We derive a uniform two-saddle asymptotic formula for the Chebyshev coefficients, including explicit amplitude and phase and a relative remainder for each localized complex saddle contribution, covering fixed, sublinear, and linear pole scalings away from saddle coalescence. Because the two saddle contributions can cancel in a single coefficient, we pass to a growing block of neighboring coefficients and prove that the whole block cannot cancel. This transfers the coefficient asymptotics to approximation errors. For $q_m=(α/t)m$, $0<α<3\sqrt3/2$, the best uniform error has two-sided order $m^{-1/2}H_e(α)^m$; at the optimal ratio $α=1/\sqrt2$ this becomes $m^{-1/2}(\sqrt2-1)^m$. The normalized Chebyshev-weighted $L^2$ projection error has an explicit bounded oscillatory profile. These prefactor-resolved estimates yield a two-term precision-to-work law and quantify mismatch between pole-design and stopping degrees. Finally, the scalar error gives an exact worst-case matrix-action benchmark for self-adjoint negative semidefinite matrices and dimension-independent shift-and-invert Krylov bounds.

math.NA↗
arXiv2026

Rethinking Gradient Modulation in Multimodal Regression

Even balanced multimodal learning methods do not consistently translate additional modalities into better regression performance. To understand this limitation, we revisit the optimization mechanism of balanced multimodal learning, using MMPareto as a representative case. We reveal a previously overlooked issue: MMPareto uses a fixed gradient modulation strength throughout training, while different training stages favor different strengths; an inappropriate modulation strength can instead hinder subsequent optimization. To address this issue, we propose SGM, which adapts the modulation strength according to the current training behavior. We provide theoretical and empirical analyses to characterize and validate the modulation decisions made by SGM. We further build a two-stage multimodal regression framework that integrates AM for unimodal regression representation learning and SGM for adaptive multimodal optimization. Extensive experiments under the same total training budget demonstrate consistent improvements over strong unimodal and multimodal baselines. Our code is provided in the supplementary material.

cs.CV↗
arXiv2026

HarnessEval-W: Agentifying the Evaluation of Visual Worlds

A benchmark should deliver more than a scalar score: what makes an evaluation trustworthy is the reasoning that justifies the score. This is especially critical for world models, where judging a rollout requires understanding whether physics, causality, and world state evolve correctly. Humans spot such violations naturally, yet no existing benchmark automates this capability: metrics are computed brute-force, leaving no reasoning chain that can be examined or verified. We introduce HarnessEval-W, an agentified evaluation pipeline that brings the harness paradigm from the LLM ecosystem to world model benchmarking. Rather than applying a fixed rubric, HarnessEval-W interprets the context of each evaluation case, decomposes the evaluation question into measurable subproblems, and spawns specialized sub-agents, each equipped with tailored context and diagnostic tools to reason over its own subproblem. The parent agent then validates the gathered evidence and summarizes it into the final verdict. This hierarchical workflow turns every evaluation into a transparent evidence tree whose complete reasoning chain justifies the result. We apply HarnessEval-W to 18 representative world models over 330 evaluation cases. Its judgments closely align with human preferences while providing verifiable, fine-grained diagnoses of every generated rollout. We open-source the full pipeline as a live benchmark and invite the broad community to contribute to grow new skills and evaluation cases as world models evolve.

cs.CV↗
arXiv2026

Superposed Latent Autoencoder

Autoencoders typically meet tight latent-memory budgets by making each latent representation smaller, sacrificing representational capacity. We ask a different question: can multiple wider latents be stored together instead? We introduce the Superposed Latent Autoencoder (SLAE), which preserves high-capacity latent representations while sharing storage through learned superposition. SLAE transforms latents into storage-friendly codes, binds them with randomized keys, superposes multiple codes into a single memory tensor, and learns to recover each latent before decoding. Under the same storage budget, SLAE replaces irreversible dimensional bottlenecks with structured interference that can be suppressed. Across CIFAR-10/100, SVHN, STL-10, Tiny ImageNet, and a wide range of memory budgets, SLAE substantially improves the reconstruction--memory tradeoff, reducing reconstruction error by up to 56% over conventional autoencoders at matched storage. Further analysis shows that SLAE's advantage comes from making wider representations usable under the same storage budget. These gains also extend beyond reconstruction: the information preserved by SLAE improves downstream classification by up to 16.79 percentage points under the same memory budget. Our results suggest a new principle for representation compression: instead of making every latent smaller, keep representations wide and let them share memory.

cs.LG↗
arXiv2026

D-NOVA: In-Storage Retrieval Accelerator via Dual-Bound 3D NAND-Optimized Similarity Search with Vector Adaptation

Retrieval-Augmented Generation (RAG) enhances the factual grounding of large language model (LLM) inference by retrieving relevant information from external knowledge bases. However, its dense vector retrieval introduces significant latency and energy overhead, becoming the primary performance bottleneck. Although recent in-storage accelerators aim to reduce data movement, they still rely on host or embedded processors outside the memory, where nearly 70% of the total retrieval time is spent. As a result, they cannot fully overcome the bandwidth limitations, leading to yet another memory bottleneck. To tackle these limitations, we present D-NOVA, a hardware-software co-designed in-storage retrieval accelerator. D-NOVA executes an inverted file (IVF)-based hierarchical retrieval pipeline by deeply embedding the search functionality directly into the NAND memory array. This is achieved by incorporating a new distance metric, Dual-Bound Tight Similarity Sensing (DTS), which is specifically tailored for searching within the NAND string. In addition, we introduce a lightweight contrastive adapter that maps embedding vectors into a DTS-friendly domain, recovering near-software recall while improving performance and energy efficiency. D-NOVA is up to 41.7x faster and 71x more energy-efficient than a CPU baseline, and achieves 12.13x higher throughput while being up to 1.26x more energy-efficient than state-of-the-art in-storage RAG accelerators, demonstrating the potential of fully in-storage vector search for scalable RAG acceleration.

cs.AR↗
arXiv2026

TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies

Robot manipulation alternates between low-risk transit phases that call for fast execution and high-risk contact stages that demand slow, precise motion. Yet existing Vision-Language-Action models (VLAs) only inherit a single fixed speed from training demonstrations. Prior efforts to accelerate VLAs through model compression, KV-cache reuse, or reinforcement learning only shift the policy from one fixed speed to another, and leave deceleration almost unexplored. We observe that the magnitude of each predicted action already governs how fast the robot moves, opening a direct route to controllable execution speed. We turn this observation into TempoVLA, a single VLA whose execution speed is controlled by an explicit condition. TempoVLA combines two coupled components. (1) A data-side Variable-Speed Trajectory Augmentation (VSTA) that re-times demonstration to any target speed by merging or splitting actions while preserving its motion semantics. (2) A model-side conditioning mechanism that feeds the speed to the policy. Statistics show that VSTA reaches the requested speed with negligible motion error. Experiments in simulation and on real-world tasks demonstrate that TempoVLA achieves flexible speed control in both directions, while VSTA additionally boosts the default $1\times$ performance via better data utilization. Furthermore, by cooperating with a large multimodal model, TempoVLA realizes dynamic speed control, accelerating through low-risk phases and decelerating for high-risk ones.

cs.RO↗
arXiv2026

DexVerse: A Modular Benchmark for Multi-Task, Multi-Embodiment Dexterous Manipulation

Building general-purpose dexterous manipulation policies requires benchmarks that go beyond isolated tasks to systematically evaluate policies across diverse interaction modes, sensory conditions, and robot embodiments. However, existing benchmarks remain limited in task and data diversity, embodiment coverage, or controllable visual variation, hindering studies of cross-task and cross-embodiment generalization. We present DexVerse, a large-scale and modular benchmark for dexterous manipulation. DexVerse includes 100 tasks spanning a broad range of manipulation skills, including object grasping and relocation, articulated-object interaction, functional tool use, bimanual coordination, non-prehensile control, contact-rich behaviors, multi-goal execution, and long-horizon multi-stage task completion. It supports 3 robot arms and 6 dexterous hands, and is extensible to new tasks, assets, and embodiments. To evaluate visuomotor generalization, DexVerse provides configurable visual variations in textures, background, lighting, and camera viewpoints. We further provide a VR-based teleoperation interface and 3,180 demonstrations with synchronized proprioceptive, RGB, depth, point-cloud, and state observations. We benchmark representative methods, including Diffusion Policy, DP3, OpenVLA, and $π_{0.5}$, across 19 tasks. Results reveal substantial challenges in task generalization and visuomotor robustness, establishing DexVerse as a promising testbed for general-purpose dexterous manipulation. Project page: https://ycyao216.github.io/DexVerse.site

cs.RO↗
arXiv2026

Learning Action Priors for Cross-embodiment Robot Manipulation

Most Vision-Language-Action (VLA) models build on a Vision-Language Model (VLM) backbone by attaching an action module and optimizing the full policy jointly. This design inherits strong visual and linguistic priors from the VLM, but leaves the action module to learn physical motion almost from scratch. As a result, the policy lacks an explicit motion prior, forcing early optimization to simultaneously discover temporal action dynamics and cross-modal alignment, a challenge further amplified in cross-embodiment settings. In this work, we propose to pretrain the action module with motion priors before cross-modal VLA alignment. Specifically, we introduce a two-stage training framework that equips the action module with cross-embodiment temporal motion structure before VLA training begins. In Stage~1, a lightweight flow-matching-based encoder-decoder action module efficiently learns temporal motion structure solely from unconditioned action trajectories, without processing visual or language tokens. In Stage~2, this learned prior is transferred to VLA training through decoder reuse and early-stage latent distillation, aligning visual-language features with the action embedding space while still allowing end-to-end policy refinement. In addition, the trained encoder serves as a compact history compressor, summarizing state-action histories into a single temporal context token for history-aware modeling at negligible cost. Extensive experiments across 13 diverse cross-embodiment tasks on both simulated and real-world platforms validate the effectiveness of our approach. Compared with VLA training without action priors, our model achieves faster convergence, higher success rates, and substantially stronger performance on data-scarce real-world tasks. Moreover, scaling up the action data in Stage~1 yields a more generalizable action prior that directly improves downstream VLA performance.

cs.RO↗
arXiv2026

ACRONYM: Accelerated Approximate Nearest Neighbor Search in Memory for Dynamic Vector Databases

Vector database search with frequent updates is increasingly critical in applications such as retrieval augmented generation, recommendation systems, and large-scale embedding retrieval. Existing solutions, such as graph-based and partition-based approximate nearest neighbor search (ANNS), suffer from frequent index rebuilding due to data distribution-dependent indexing that impacts continuous deployment and causes long rebuilding latency. This paper proposes an algorithm-hardware co-designed platform, ACRONYM, that addresses key problems with state of the art database search. Algorithmically, it leverages efficient encoding independent of data distribution and Hamming-distance based search for efficient hardware acceleration. Architecturally, we propose CAM-based in-memory parallel distance computation followed by time multiplexed approximated top-k selection to enable the exhaustive search. We propose two-stage search that includes coarse search followed by binary refinement to achieve high recall in CAM based search which is heavily limited to small vector dimension due to capacity and wordline parasitic. ACRONYM supports continuous update without stalling and integrates novel XOR-and-Accumulate (XAC) based systolic-array encoder for efficient on chip encoding during search. Across million-scale datasets, while serving dynamic database ACRONYM achieves >90% recall at a throughput of 8e6 queries per second, with a memory footprint of only 32MB and an average energy consumption of 2.56uJ per query, speedup over HNSW (CPU) of about 400x and FAISS-IVF (GPU) of about 80x.

cs.AR↗
arXiv2026

Qwen-Image-2.0 Technical Report

We present Qwen-Image-2.0, an omni-capable image generation foundation model that unifies high-fidelity generation and precise image editing within a single framework. Despite recent progress, existing models still struggle with ultra-long text rendering, multilingual typography, high-resolution photorealism, robust instruction following, and efficient deployment, especially in text-rich and compositionally complex scenarios. Qwen-Image-2.0 addresses these challenges by coupling Qwen3-VL as the condition encoder with a Multimodal Diffusion Transformer for joint condition-target modeling, supported by large-scale data curation and a customized multi-stage training pipeline. This enables strong multimodal understanding while preserving flexible generation and editing capabilities. The model supports instructions of up to 1K tokens for generating text-rich content such as slides, posters, infographics, and comics, while significantly improving multilingual text fidelity and typography. It also enhances photorealistic generation with richer details, more realistic textures, and coherent lighting, and follows complex prompts more reliably across diverse styles. Extensive human evaluations show that Qwen-Image-2.0 substantially outperforms previous Qwen-Image models in both generation and editing, marking a step toward more general, reliable, and practical image generation foundation models.

cs.CV↗