arXiv subjects

Ke Zhu

Publications and source records attributed to Ke Zhu.

At least 19 recordsLinked to original sources

arXiv2026

FlashOffloading: Low-Latency KV Cache Offloading for Long-Context LLM Serving

In large language model (LLM) serving systems, the key-value (KV) cache grows linearly with sequence length and concurrency, so long-context inference easily hits the high-bandwidth memory (HBM) capacity wall and results in low concurrency. Offloading the KV cache to host dynamic random-access memory (DRAM) frees HBM space and raises concurrency, but the additional cache management and host-to-device (H2D) load overhead inflates inference latency, higher concurrency fails to translate into effective throughput. We present FlashOffloading, a host-DRAM-centric inference architecture that fully offloads the KV cache in both the prefill and decode phases. FlashOffloading builds rolling HBM cache for prefill, a hot cache for decode, a reverse sparse index with zero extra miss-lookup overhead, and a compute--load overlapped kernel, optimizing KV offloading latency across the entire pipeline and delivering throughput gains under a time-per-output-token (TPOT) service-level objective (SLO). In experiments deploying GLM-5.2 with multi-token prediction (MTP3) speculative decoding on an Ascend910C prefill--decode (PD)-disaggregated platform, FlashOffloading improves prefill throughput by up to 1.38$\times$ and decode throughput by up to 1.91$\times$ under a 30 ms TPOT constraint. FlashOffloading is integrated into an open-source serving framework: https://github.com/vllm-project/vllm-ascend/tree/releases/v0.30.0.

cs.AI↗

arXiv2026

HiMark: Hierarchical and Controllable Multi-bit Watermarking for Large Language Models

With the rapid adoption of large language models (LLMs) in text generation applications, it has become increasingly difficult to trace generated content and assign responsibility for its use, raising concerns about provenance, copyright protection, and accountability. Multi-bit watermarking addresses these issues by embedding multi-bit provenance information into generated text, but reliable extraction remains difficult due to sparse per-bit evidence and the trade-off between watermark-extraction accuracy and text quality. To deal with these challenges, we propose HiMark, a hierarchical and controllable multi-bit watermarking framework for LLM-generated text. During watermark embedding, HiMark uses a hierarchical candidate-control mechanism, including initial candidate sampling, layer-wise tournament elimination, support-based refinement, and support-threshold filtering. During watermark detection, a model-agnostic evidence aggregation mechanism computes multi-layer support evidence for each observed token, and then accumulates these token-level votes into the corresponding information for robust watermark extraction. Experiments show that HiMark improves watermark extraction accuracy while maintaining text quality, e.g., the watermark extraction accuracy is 90.01% under the paraphrasing attack when 32 bits were embedded within a text containing 300 tokens, demonstrating its effectiveness for provenance tracking.

cs.CR↗

arXiv2026

Targeted Data Fusion for Region-Specific Survival Effects in the AMP HIV Prevention Trials

The Antibody Mediated Prevention (AMP) trials opened a new scientific frontier by showing that passively administered monoclonal broadly neutralizing antibodies (bnAbs) could prevent HIV-1 acquisition. The trials enrolled 4,611 participants across four epidemiologically distinct regions, with 174 HIV-1 diagnoses observed during follow-up. Regional heterogeneity in treatment efficacy, together with privacy and regulatory limits on central data pooling, calls for methods that borrow strength across regions without sharing individual-level data. To estimate region- and treatment-specific survival curves under distributional heterogeneity, we develop a federated learning approach that combines site-specific estimators via an L1-regularized criterion that downweights data sources not aligned with the target. We further extend the framework to a general class of causal contrasts, including the survival difference, survival ratio, and restricted mean survival time difference. In the AMP analysis, for example, the standard error of the day-148 survival difference decreased from 0.007 using the target-only estimator to 0.004 using the federated estimator. For women in South Africa, the region-specific analyses provided no strong evidence of an overall VRC01 benefit, consistent with the primary AMP findings. Overall, the proposed approach provides region-adaptive inference with improved precision without sharing individual-level data, while preserving estimation of region-specific treatment effects under cross-region heterogeneity.

stat.ME↗

arXiv2026

Robust Estimation and Inference in Hybrid Controlled Trials for Binary Outcomes: A Case Study on Non-Small Cell Lung Cancer

Hybrid controlled trials (HCTs), which augment randomized controlled trials (RCTs) with external controls (ECs), are increasingly receiving attention as a way to address limited power, slow accrual, and ethical concerns in clinical research. However, borrowing from ECs raises critical statistical challenges in estimation and inference, especially for binary outcomes where hidden bias is harder to detect and estimands such as risk difference, risk ratio, and odds ratio are of primary interest. We propose a novel framework that combines doubly robust estimators for various estimands under covariate shift of ECs with conformal selective borrowing (CSB) to address outcome incomparability. CSB uses conformal inference with nearest-neighbor-based conformal scores and their label-conditional extensions to perform finite-sample exact individual-level EC selection, addressing the limited information in binary outcomes. To ensure strict type I error rate control for testing treatment effects while gaining power, we use a Fisher randomization test with the CSB estimator as the test statistic. Extensive simulations demonstrate the robust performance of our methods. We apply our method to data from CALGB 9633 and the National Cancer Database to evaluate chemotherapy effects in Stage IB non-small-cell lung cancer patients and show that the proposed method effectively mitigates hidden bias introduced by full-borrowing approaches, strictly controls the type I error rate, and improves the power over RCT-only analysis.

stat.ME↗

arXiv2026

PACE: Progressive Angular-to-Norm Contrastive Embedding

Multimodal embedding models encode heterogeneous inputs into a shared embedding space, enabling efficient similarity computation across modalities and tasks. Most existing methods optimize cosine-based contrastive objectives, which promote stable training but restrict semantic compatibility to angular geometry, precluding embedding norms from serving as an additional semantic signal. However, directly optimizing the more expressive dot-product similarity, which leverages both angular and norm information, underperforms cosine-based training and exhibits unstable training dynamics. We attribute this discrepancy to premature optimization-space expansion, manifested as angular--norm entanglement and directional anisotropy in the representation space and further compounded by full-parameter fine-tuning. In this paper, we propose PACE, a two-stage framework that progressively expands both the representation and trainable parameter spaces. Stage I combines cosine-based objective with low-rank adaptation to establish a reliable angular geometry within constrained optimization spaces. Stage II switches to dot-product similarity and full-parameter fine-tuning, enabling embedding directions and norms to jointly encode semantic information. We further introduce Focal Embedding Loss, a confidence-adaptive objective that downweights queries with high positive retrieval confidence while emphasizing ambiguous queries with competitive negatives. Experiments across multiple backbone scales and diverse multimodal embedding tasks consistently validate the effectiveness of PACE.

cs.CV↗

arXiv2026

Power and Sample Size Calculations for Hybrid Controlled Trials

Hybrid controlled trials (HCTs) augment randomized controls with external controls (ECs) to address practical challenges in randomized controlled trials (RCTs) and improve statistical power in settings such as rare diseases, oncology, and pediatrics. However, prospective sample-size determination is challenging because the required RCT sample size depends on the comparability of ECs with RCT controls, which are unavailable at the planning stage. We propose a 5+3 design for HCT sample-size determination based on an inverse probability weighting estimator of the average treatment effect. The framework uses five conventional RCT design parameters and three additional scalar parameters characterizing EC comparability: the number of outcome-drift-free ECs, an overlap coefficient for the covariate distributions of the RCT and ECs, and a correlation coefficient linking the sampling mechanism to the control potential outcome. We establish the asymptotic distribution of the estimator and prove that its variance is determined by these design parameters under the proposed working models, yielding sample-size calculations for both continuous and binary outcomes. Simulation studies evaluate finite-sample performance, and a real clinical application illustrates its practical use. The method is implemented in the hctdesign R package.

stat.ME↗

arXiv2026

Robust Estimation and Inference with Selective Borrowing in Hybrid Controlled Trials: A Tutorial with SelectiveIntegrative and intFRT

Hybrid controlled trials (HCTs) augment randomized controlled trials (RCTs) with external controls (ECs) to improve statistical efficiency when RCTs face limited sample sizes, slow accrual, or ethical constraints. However, valid use of ECs requires careful adjustment for covariate shift and outcome drift, as inappropriate borrowing may introduce bias and compromise inference. This tutorial provides a practical workflow for estimation and inference in HCTs. We first present a statistical analysis roadmap covering estimands, identification assumptions, eligibility alignment, matching, full and selective borrowing strategies, and both asymptotic inference and randomization tests. We then demonstrate step-by-step implementation using the SelectiveIntegrative and intFRT packages. The workflow is illustrated using a synthetic lung cancer dataset included in the intFRT package that mimics the CALGB 9633 trial and ECs from the National Cancer Database. The tutorial aims to help applied statisticians conduct transparent, interpretable, and reproducible HCT analyses that improve efficiency while maintaining valid inference.

stat.ME↗

arXiv2026

A Conformal Selection Framework for Individual Treatment Beneficiaries with Auxiliary External Data

Identifying patients who are likely to benefit from a treatment is central to precision medicine and can guide follow-up trials, enrichment designs, and individualized decisions. Although randomized controlled trials (RCTs) provide evidence on efficacy, they are usually powered to estimate average treatment effects rather than patient-level benefit. Meanwhile, artificial intelligence and machine learning methods offer flexible tools for estimating heterogeneous treatment effects, especially when augmented by real-world data (RWD). However, in practice, these estimated effects are often translated into decisions through simple ranking or thresholding rules, which can ignore uncertainty and multiplicity when many patients are evaluated simultaneously. Motivated by this, we propose a model-agnostic conformal inference framework for uncertainty-aware beneficiary selection. The framework reformulates CATE-based treatment-benefit selection as a multiple-testing problem. For each candidate, we test whether the conditional treatment benefit exceeds a clinically meaningful threshold and construct a conformal p-value using RCT-based calibration. These p-values are then adjusted by the Benjamini-Hochberg procedure to control the false discovery rate (FDR) among selected beneficiaries. To improve efficiency when RCT sample sizes are limited, external data, such as RWD, can be used to train flexible treatment effect models, while conformal calibration remains anchored in the RCT data. It can be paired with conventional machine learning algorithms and emerging tabular foundation models. Simulations show that the framework maintains FDR control, with power depending on the base learner and external-data comparability. A case study in early-stage non-small-cell lung cancer illustrates how the method identifies candidate profiles with evidence of benefit from limited resection to reduce overtreatment.

stat.ME↗

arXiv2026

From Morse Trees to $J$-Holomorphic Discs -- Rigid Y-Graphs

The correspondence between Morse flow trees and $J$-holomorphic discs was established by Fukaya--Oh and Ekholm. We revisit this correspondence and present an alternative approach, designed to generalize naturally to the equivariant setting and to certain Morse graph configurations. The central ingredient is a gluing construction that produces $J$-holomorphic discs from Morse flow trees. A well-known difficulty is that this gluing is of Morse--Bott type, equivalently, in an appropriate Fredholm framework, pieces to be glued together are obstructed. We resolve this via the obstruction bundle gluing technique of Hutchings--Taubes. Given a rigid, transversely cut-out Y-shaped Morse flow tree, we show that for every sufficiently small $ε> 0$ there exists at least one corresponding $J$-holomorphic discs in the cotangent bundle, with boundaries inside corresponding Lagrangian submanifolds of height $ε$. This is the first paper in a series; subsequent work will extend the result to all ribbon trees and to moduli spaces of all dimensions and establish the injectivity and surjectivity of the correspondence.

math.SG↗

arXiv2026

ReSGA: A Large Tail Risk Model for Learning Value-at-Risk and Expected Shortfall

Learning Value-at-Risk (VaR) and Expected Shortfall (ES) is important for managing financial risks effectively. Existing approaches with limited parameters are vulnerable to model misspecification in the era of big data. To address this limitation, we propose a large tail risk model, the retrieval-enhanced self-grouping autoencoder (ReSGA), which is designed with millions of parameters to exploit the rich cross-sectional dependence and long-term temporal dynamics of assets using their characteristics. Applied to monthly US equity returns from 1926 to 2023 with 153 firm characteristics, ReSGA outperforms twelve econometric and machine learning competitors in terms of out-of-sample loss and statistical backtesting. In addition, its forecast advantages can translate into significant economic gains from long-short decile portfolios that are constructed by a new size-enhanced left-side momentum strategy. To clarify the role of complexity, we further conduct a systematic scaling analysis and demonstrate that improvements in joint VaR-ES forecasting are primarily driven by data complexity rather than model complexity. Finally, our analyses of group-importance and transfer-learning exhibit the interpretability and cross-market generalizability of ReSGA.

stat.ML↗

arXiv2026

Discovery of a nonsymmorphic superconductor with spontaneous rotational symmetry breaking and nontrivial zero modes

Topological superconductivity has attracted great interest due to its fundamental significance for realizing Majorana quasiparticles and fault-tolerant quantum computation. Nonsymmorphic superconductors, with symmetry-protected nontrivial electronic structures, offer a promising route to exotic topological superconducting states, yet experimental realizations remain scarce. Here we identify nonsymmorphic compound PtPb4 as a robust platform hosting superconductivity with spontaneous rotational symmetry breaking and nontrivial zero-energy modes. PtPb4 crystallizes in a frustrated Shastry-Sutherland lattice and exhibits nontrivial band topology. By combining in-plane and out-of-plane resistivity measurements, pronounced twofold anisotropy is observed in both the superconducting state and the upper critical field, evidencing spontaneous rotational symmetry breaking. Scanning tunneling microscopy/spectroscopy further reveal twofold-symmetric magnetic vortices, providing direct real-space evidence for the symmetry-broken superconducting state. Notably, a robust zero-energy vortex bound state emerges and persists without spatial splitting over extended distances, consistent with the characteristics expected for Majorana bound state. These findings uncover an exotic superconducting state in PtPb4 and establish a promising platform for exploring topological superconductivity and superconducting quantum devices.

cond-mat.supr-con↗

arXiv2026

Externally Controlled Trials: A Review of Design and Borrowing Through a Causal Lens

Externally controlled trials (ECTs) are increasingly used when randomized controls are infeasible, unethical, or insufficient, including applications in rare diseases, oncology, pediatrics, and post-approval effectiveness research. Although methodological work has expanded rapidly across causal inference, Bayesian dynamic borrowing, and hybrid trial designs, the literature remains fragmented. We adopt a six-step scientific roadmap to organize modern ECT methodology in two primary settings: (i) single-arm trials that evaluate efficacy through comparison with external controls, and (ii) hybrid controlled trials that augment the internal control arm with external controls drawn from real-world data or historical studies. The roadmap clarifies causal estimands, identifiability assumptions, and how statistical parameters arise from identification, and shows how modeling and borrowing strategies trade off efficiency and robustness, especially under covariate shift and outcome drift. Within this framework, we synthesize and evaluate recent Bayesian and frequentist developments, compare their strengths, limitations, operating characteristics, and available software, and emphasize the role of sensitivity analysis. By re-framing ECT methodology through a causal lens, this work establishes a coherent foundation for integrating external data into regulatory and clinical decision-making and highlights core challenges and opportunities for future research.

stat.ME↗

arXiv2026

Discovery of parity-violating chiral polar-nematic charge density wave and superconductivity in kagome metals

Nonmagnetic kagome metals and superconductors AV3Sb5 (A = K, Rb, Cs) host unconventional charge density wave (CDW) and superconducting (SC) phases accompanied by multiple electronic symmetry breaking. Due to the centrosymmetric crystal structure, inversion symmetry has generally been assumed to hold. Here, using scanning tunneling microscopy complemented by atomic force microscopy and optical second-harmonic generation, we directly reveal that inversion symmetry in the kagome plane is spontaneously broken in the CDW state. The mixed-parity CDW state exhibits ferroelectric dipolar and nematic quadrupolar ordered moments. The coexistence and coupling between the dipole and quadrupole favor noncollinear ferro-polar and nematic alignment that breaks all mirror symmetries and gives rise to robust electronic chirality in the 3Q CDW. The multipolar coupling to in-plane electric field enables electric field control and manipulation of the chiral polar-nematic CDW state, including its chirality. Below the SC transition, we observe parity-violating pair density modulations at both the original and the CDW lattice wavevectors. Our findings of parity-violating electronic chiral multipolar order provide microscopic insights into the magnetoelectric and nonreciprocal transport, loop current order, pairing density waves, and unconventional superconductivity in kagome metals and related quantum materials.

cond-mat.supr-con↗

arXiv2026

Cs$_4$Cr$_7$Te$_{10}$: Interwoven Reconstructed Archimedean and Kagome Lattices with a Possible Phase Transition near 130 K

Chromium-based materials with complex lattice geometries provide an important platform for investigating correlated electronic and magnetic states. However, Cr-based compounds with unusual crystal geometries are still rarely reported. Here, we report a new Cr-based compound, Cs$_4$Cr$_7$Te$_{10}$, featuring interwoven Cr and Te sublattices that can be viewed as reconstructed networks derived from Archimedean (3.4.6.4) tiling and the kagome lattice, respectively. Transport measurements reveal the semiconducting nature in Cs$_4$Cr$_7$Te$_{10}$. Magnetization measurements show a weak anisotropy between H//b and H//ac planes, and uncover an anomaly near 130 K that is insensitive to the applied magnetic fields. Specific-heat measurements further confirm this transition, indicating its bulk thermodynamic nature. The associated entropy change is as small as 0.41 J mol^-1 K^-1, ruling out a structural phase transition and pointing to a possible electronic and/or magnetic phase transition. These results provide a new route for designing complex crystal geometries and exploring their associated emergent phenomena.

cond-mat.mtrl-sci↗

arXiv2026

Fast Rerandomization for Balancing Covariates in Randomized Experiments: A Metropolis-Hastings Framework

Balancing covariates is critical for credible and efficient randomized experiments. Rerandomization addresses this by repeatedly generating treatment assignments until covariate balance meets a prespecified threshold. By shrinking this threshold, it can achieve arbitrarily strong balance, with established results guaranteeing optimal estimation and valid inference in both finite-sample and asymptotic settings across diverse complex experimental settings. Despite its rigorous theoretical foundations, practical use is limited by the extreme inefficiency of rejection sampling, which becomes prohibitively slow under small thresholds and often forces practitioners to adopt suboptimal settings, leading to degraded performance. Existing work focusing on acceleration typically fail to maintain the uniformity over the acceptable assignment space, thus losing the theoretical grounds of classical rerandomization. Building upon a Metropolis-Hastings framework, we address this challenge by introducing an additional sampling-importance resampling step, which restores uniformity and preserves statistical guarantees. Our proposed algorithm, PSRSRR, achieves speedups ranging from 10 to 10,000 times while maintaining exact and asymptotic validity, as demonstrated by simulations and two real-data applications.

stat.ME↗

arXiv2026

Realization of a Wigner-Mott insulator in 6R-TaS$_2$ superconductor

Wigner-Mott insulating states represent a paradigmatic manifestation of strong electronic correlations, in which long-range Coulomb interactions drive spontaneous charge ordering and enable Mott localization at fractional electronic fillings. Such states have been theoretically proposed to arise from the cooperative interplay between onsite and inter-site Coulomb interactions. However, experimental realizations of the simultaneous microscopic observation of interaction-driven charge order and genuine Mott localization, which are the defining hallmarks of a Wigner-Mott insulator, have remained elusive. Here we report the observation of a Wigner-Mott insulating state in 6R-TaS$_2$ using scanning tunneling microscopy. By locally injecting electrons into the depleted 1T layer, we induce distinct Star-of-David charge-ordered superstructures and realize a cascade of insulating phases. In particular, a $\sqrt{3}\times \sqrt{3}$ charge-ordered superstructure at one-third filling hosts a robust Mott gap despite fractional filling. The spontaneous relaxation from excited states back to the ground state demonstrates that this Wigner-Mott phase is stabilized by the cooperative effects of onsite and inter-site Coulomb interactions. Our results provide direct microscopic evidence for a Wigner-Mott mechanism and establish 6R-TaS$_2$ as a platform for the controlled realization and investigation of Wigner-Mott insulating states.

cond-mat.str-el↗

arXiv2026

Selective Information Borrowing for Region-Specific Treatment Effect Inference under Covariate Mismatch in Multi-Regional Clinical Trials

Multi-regional clinical trials (MRCTs) are central to global drug development, enabling evaluation of treatment effects across diverse populations. A key challenge is valid and efficient inference for a region-specific estimand when the target region is small and differs from auxiliary regions in baseline covariates or unmeasured factors. We adopt an estimand-based framework and focus on the region-specific average treatment effect (RSATE) in a prespecified target region, which is directly relevant to local regulatory decision-making. Cross-region differences can induce covariate shift, covariate mismatch, and outcome drift, potentially biasing information borrowing and invalidating RSATE inference. To address these issues, we develop a unified causal inference framework with selective information borrowing. First, we introduce an inverse-variance weighting estimator that combines a "small-sample, rich-covariate" target-only estimator with a "large-sample, limited-covariate" full-borrowing doubly robust estimator, maximizing efficiency under no outcome drift. Second, to accommodate outcome drift, we apply conformal prediction to assess patient-level comparability and adaptively select auxiliary-region patients for borrowing. Third, to ensure rigorous finite-sample inference, we employ a conditional randomization test with exact, model-free, selection-aware type I error control. Simulation studies show the proposed estimator improves efficiency, yielding 10-50% reductions in mean squared error and higher power relative to no-borrowing and full-borrowing approaches, while maintaining valid inference across diverse scenarios. An application to the POWER trial further demonstrates improved precision for RSATE estimation.

stat.ME↗

arXiv2026

Enhancing Descriptive Captions with Visual Attributes for Multimodal Perception

Training Large Multimodality Models (LMMs) relies on descriptive image caption that connects image and language. Existing methods for generating such captions often rely on distilling the captions from pretrained LMMs, constructing them from publicly available internet images, or even generating them through human annotation. However, these strategies can fall short in terms of precision and granularity, particularly when dealing with complex visual reasoning tasks. In this paper, we propose to leverage off-the-shelf visual specialists, which were trained from annotated images initially not for image captioning, for enhancing the image caption. Our approach, named EDC, explores object low-level and fine-grained attributes (e.g., depth, emotion and fine-grained categories) and object relations (e.g., relative location and human-object-interaction (HOI)), and combine the attributes into the descriptive caption. By systematically integrating these rich attributes into the generated captions, EDC significantly improves the descriptive quality of the captions, providing a deeper and more nuanced understanding of the visual content. Experiments demonstrate that such visual specialists are able to improve the performance for visual understanding tasks as well as reasoning that benefits from more accurate visual understanding. The complete source code of EDC pipeline and datasets will be available at https://github.com/syp2ysy/DCE.

cs.CV↗