arXiv Science⌕ Search

arXiv subjects

Xiaodong Li

Publications and source records attributed to Xiaodong Li.

At least 19 recordsLinked to original sources
arXiv2026

Inference for Directions in Canonical Correlation Analysis with Partially Paired Data

Canonical correlation analysis (CCA) is a classical tool for learning linear associations between two data views, and inference on canonical directions is the key for interpreting their coefficients and detecting interesting relationships. We study the problem of hypothesis testing for canonical directions when paired observations are supplemented by unpaired observations of either view. The key challenge is to incorporate the additional marginal information while accounting for its dependence on the paired sample used to estimate the canonical directions. To address this issue, we propose coupled augmentation functions that jointly use the marginal information from both views and construct a one-step estimator based on the resulting corrections. Theoretically, we show that under the null, the proposed estimator is consistent and asymptotically normal even when dimension grows at the rate $d = o(n)$. This result provides a sign-invariant Wald test statistic for detecting important variables in canonical directions. Through numerical studies, we show that the proposed test statistic with semi-paired data improves upon inference using paired data.

stat.ME↗
arXiv2026

LingLanMedBench: A Unified Benchmark for Evaluating Large Language Models in Traditional Chinese Medicine

Reliable evaluation of large language models in traditional Chinese medicine remains limited because existing benchmarks mainly focus on examination-style question answering or isolated generative tasks. We developed LingLanMedBench, a unified benchmark comprising 25,620 expert-verified items across 13 subtasks and five domains, covering knowledge, language understanding, information extraction, and diagnostic-therapeutic decision-making. LingLanMedBench standardizes task formats and evaluation metrics and further incorporates synonym-tolerant clinical-label matching, empirically derived hard subsets, and decision-recognition reformulations of open-ended clinical tasks. Fourteen open-source and proprietary models were evaluated under a standardized zero-shot protocol. Performance varied substantially across domains, model families, task formulations, and difficulty levels. The leading overall score decreased from 51.1 on the full benchmark to 31.9 on the hard subsets. Prescription performance also differed markedly between open-ended generation, with F1 scores of 32.7 and 20.3, and decision recognition, with accuracies of 90.6 and 56.8 on the full and hard subsets, respectively. These findings reveal a substantial gap between knowledge-oriented performance and clinically faithful reasoning. LingLanMedBench provides a standardized and reproducible framework for characterizing current capabilities, identifying systematic limitations, and tracking meaningful progress in large language models for traditional Chinese medicine.

cs.AI↗
arXiv2026

Lingdan-V2: Large language models for clinically grounded reasoning in traditional Chinese medicine

Large language models have advanced medical reasoning, but clinically grounded reasoning in traditional Chinese medicine (TCM) remains challenging because prescription decisions require integrating domain knowledge, syndrome differentiation, treatment principles, herbal prescription composition, and dosage determination. We develop a TCM language model family comprising models with 4 billion, 8 billion, and 14 billion parameters. The artificial intelligence contribution is a staged clinical alignment framework integrating large scale continued pretraining on TCM and clinical records, complementary reasoning supervision, and prescription-centered reinforcement learning (RL). We further formulate herbal prescription generation as a structured RL problem with prescription-level feedback, enabling direct optimization of clinical decision outputs beyond knowledge reproduction and generic instruction following. The engineering application is TCM clinical decision support, particularly herbal prescription recommendation. We evaluate the models on a public benchmark containing 25,620 expert-verified items across 13 TCM knowledge and clinical reasoning tasks and on a private retrospective dataset of 4,348 spleen and stomach disease prescription cases. The 14 billion parameter reinforcement aligned model achieves a prescription generation F1 of 37.0 on the public benchmark, compared with 32.3 for DeepSeek-R1 with 671 billion total parameters, and a herb-level F1 of 52.8 on the clinical dataset with improved dosage agreement. Reinforcement post-training consistently improves prescription recommendation across all scales, while physician-source analysis shows that expert heterogeneity affects reward stability. These findings demonstrate a scalable pathway from domain grounding and reasoning supervision to clinically oriented prescription decision support.

cs.CL↗
arXiv2026

Multitask Regression with Pairwise Fusion

We study multitask regression when coefficient sharing can differ by predictor. For a given predictor, many tasks may have the same coefficient while a few differ, and the exceptional tasks need not be the same for another predictor. We describe this structure by two quantities: the number of active predictors and the total number of task coefficients that differ from the most common value for their predictor. We estimate the coefficient matrix by penalizing all pairwise coefficient differences across tasks, with an additional group penalty when predictor selection is needed. The resulting upper and lower bounds have the same dependence on these two quantities. We also consider the stronger setting in which a large set of tasks shares one entire coefficient vector. Under explicit sample-size conditions, the same pairwise estimator pools those tasks exactly, while allowing the remaining tasks to differ. Simulations and household energy data illustrate the transition between broad sharing and task-specific coefficients.

stat.ML↗
arXiv2026

Signal-to-Noise Ratio Inference for Multivariate High-Dimensional Linear Models

We study inference for the fraction of total response variation explained by multivariate high-dimensional linear models. Two moment equations yield explicit estimates without fitting the regression coefficients. We establish asymptotically valid confidence intervals for fixed- and random-effects models, allowing the response dimension to grow with the sample size. The theory describes how response dependence affects precision and provides a correction for unequal noise levels in the random-design setting. Simulations assess finite-sample performance, and an analysis of yeast growth across environments illustrates joint inference for additive marker-based signal.

math.ST↗
arXiv2026

Cascade: Hierarchical Recoverability Control for Large Language Model Unlearning

Large Language Model (LLM) unlearning is essential for removing sensitive or copyrighted knowledge while preserving general utility. Existing methods often leave residual knowledge in intermediate representations, which can still be recovered. To address this, we propose Cascade, a hierarchical recoverability control framework that minimizes the internal identifiability of target knowledge. Cascade combines three complementary controls: path-level routing to suppress privacy-associated activation routes, representation-level compression to reduce geometric separability, and decoding-level intervention to limit residual recovery. Experiments on TOFU, MUSE-News, and WMDP, including robustness tests with query reformulation and extraction-style prompts, show that Cascade effectively reduces recoverability while maintaining stable model utility.

cs.CL↗
arXiv2026

LazFormer: Scaling Transformers for Industrial Recommendation via Transferable Generative Pre-training

Transformers have shown promising performance in LLMs due to their outstanding scalability, several studies have investigated the scalability of Transformers for industrial recommendation. They typically rely on a single ranking model to optimize both sparse and dense parameters from scratch, resulting in substantial computational resource consumption and slow convergence. Fortunately, the pre-training models offer an effective solution to the above issues by providing favorable initialization of both sparse and dense parameters for the subsequent ranking. However, they still face two major limitations: (1) Since the input features used in pre-training and ranking are usually inconsistent, directly transferring dense parameters from pre-training to ranking may lead to negative transfer. (2) Multi-epoch training during the ranking process may result in the overfitting of sparse parameters, while freezing the sparse parameters limits their adaptability to the ranking objectives. To this end, we propose a Scaling Transformer for Industrial Recommendation via Transferable Generative Pre-training, termed LazFormer. Specifically, we first present a generative pre-training module to autoregressively generate sequential features, providing favorable initialization of both sparse and dense parameters for the subsequent ranking. To solve the negative transfer of dense parameters, we propose a transferable residual adapter that injects additional ranking-specific features into ranking in a residual manner. Moreover, a request-aware ranking module integrates long-sequence compression, hybrid sparse attention, and a request-aware paradigm to efficiently model users' long sequences. Besides, we further propose an asymmetric multi-epoch training strategy that resets sparse parameters while continuously accumulating dense parameters across epochs, alleviating the overfitting of sparse parameters.

cs.IR↗
arXiv2026

Gaussian-trigonometric functional link artificial neural network: design and analysis

This paper proposes a Gaussian function-based trigonometric functional link artificial neural network (GTFLN) filter for linear-in-the-parameters nonlinear filtering. Compared with the adaptive exponential TFLN (AETFLN) filter, the GTFLN filter provides smooth and localized basis functions with reduced computational complexity, where modeling advantages are theoretically established through the smoothness, reproducing kernel Hilbert space, approximation error, and operator theory properties. To maximize the modeling performance, an optimized scaling parameter for the GTFLN filter is derived, yielding the optimized GTFLN (OGTFLN) filter. Least mean square (LMS) adaptation is applied to the GTFLN and OGTFLN filters for nonlinear system identification, resulting in the GTFLMS and OGTFLMS algorithms, respectively. Moreover, the theoretical steady-state excess mean-square error of the GTFLN filter is analyzed. Simulations validate the effectiveness of the theoretical analysis and demonstrate the improved performance of the GTFLN and OGTFLN filters over the linear-in-the-parameters benchmarks in nonlinear system identification and nonlinear acoustic echo cancellation. Based on the GTFLN filter, the filtered-g LMS (FgLMS) algorithm is proposed for nonlinear active noise control. Simulations demonstrate improved stability and noise reduction performance compared to the benchmarks.

eess.SP↗
arXiv2026

When Financial Fine-tuning Fails: A Three-Level Detectability Analysis of Numerical Hallucination in Domain-Adapted Language Models

Financial large language models are increasingly deployed for summarization of reports and disclosures, where numerical hallucination poses significant practical risks. While prior work often attributes such hallucination to insufficient numerical reasoning, this assumption has not been systematically tested under controlled fine-tuning settings. In this paper, we conduct a cost-effective, controlled study of numerical hallucination in financial summarization across three model variants: a base instruction-tuned model, a domain language-adapted model (FT-A), and a numeracy-enhanced domain model (FT-A+B+C). We introduce a three-level detectability taxonomy distinguishing between overt hallucination (currency-denominated fabrication), covert-explicit hallucination (professional-convention numbers), and covert-implicit hallucination (ungrounded quantitative claims). Our results reveal that domain fine-tuning substantially degrades numerical restraint at all detectability levels. While the Base model maintains near-zero hallucination rates (5.4\%), FT-A exhibits 82.5\% overt hallucination and FT-A+B+C reaches 98\%. Contrary to intuition, numeracy supervision amplifies rather than mitigates hallucination across all levels. We identify template injection---the insertion of memorized canonical values regardless of input content---as a primary hallucination mechanism in fine-tuned models. These findings demonstrate that numerical hallucination in financial summarization is driven by the degradation of numerical restraint through domain adaptation, not by insufficient numerical reasoning. We recommend that evaluation protocols assess hallucination across all detectability levels and that deployment practices include explicit mechanisms for grounding-aware generation or abstention.

cs.AI↗
arXiv2026

An Ultrathin Laterally Conductive Mesh Interphase Enables Spatially Extended Zinc Deposition for Aqueous Zinc Batteries

Zn metal anodes often suffer from nonuniform interfacial reactions during cycling, resulting in uneven deposition and dendrite growth. Existing artificial interphases can mitigate side reactions or regulate nucleation, but rarely achieve regulation of the interfacial electron/field distribution to sustain uniform deposition at the evolving Zn/electrolyte interface. Here, we develop an Au mesh interphase (AuMI), an ultrathin two-dimensional Au aerogel network that couples lateral electron redistribution with open pathways for ions. During Zn plating/stripping, the conductive AuMI distributes electron transport across the Zn surface, while its porous mesh preserves Zn$^{2+}$ access, enabling more uniform interfacial reactions. Experiments and simulations show that AuMI homogenizes the interfacial electric field and current distribution, promotes more uniform Zn plating/stripping, and limits dendrite growth. As a result, this regulated interfacial reaction mode enables AuMI Zn symmetric cells to operate stably for 3000 h at 1 mA cm$^{-2}$/1 mAh cm$^{-2}$ and for 1100 h at 10 mA cm$^{-2}$/10 mAh cm$^{-2}$, while AuMI Zn||NVO (NaV$_3$O$_8$\cdot$1.5H$_2$O) full cells retain 80.8 % capacity after over 5000 cycles at 1 A g$^{-1}$. These findings highlight the importance of combining ultrathin architecture, lateral electron transport, and open Zn2+ access in artificial interphases for stable aqueous Zn metal anodes.

cond-mat.mtrl-sci↗
arXiv2026

Imaging cellular-level brain microstructure with diffusion MRI

Noninvasive live-cell imaging in deep human tissues is crucial for exploring the cellular biological and pathogenic processes, but remains a significant unmet challenge. Diffusion magnetic resonance imaging (dMRI) promises to narrow this gap by noninvasively providing cellular-level microstructural information. Within a single crowded voxel containing millions of living cells, the intricate cellular-level microstructures create numerous microcompartments, each characterized by a specific diffusivity. However, conventional dMRI methods relying on voxel-averaged macroscopic parameters, merely reflect aggregate microstructural properties and fail to quantify this distribution of microcompartment-specific diffusivity within a voxel, thereby obscuring microstructural details. Here, we propose an intravoxel diffusivity probability distribution (IDPD) model to resolve a wealth of essential microstructural information via quantifying microcompartment-specific diffusivity distribution, thereby enabling direct cellular-level characterization. This exceptional capability is realized through a multi-tiered analytical workflow spanning targeted single-voxel or region of interest (ROI) analysis to global visualization using dynamic videos and statistic parametric maps. Ultimately, the IDPD model enables noninvasive cellular-level microstructure imaging, offering a promising avenue to evaluate living cell functions in vivo.

physics.med-ph↗
arXiv2026

CodeHID: Learning an Addressable Hierarchical Code Index for Generative Code Retrieval

Code retrieval models have predominantly relied on a flat matching paradigm that treats code snippets as independent candidates, making them less capable of distinguishing similar code candidates. Generative retrieval offers a solution by constructing a learnable index over the code corpus, guiding the retriever to better understand how code candidates are semantically organized and addressed. However, naively applying generative retrieval in the code retrieval task may result in operating over an identifier space whose prefixes do not correspond to meaningful code-semantic regions. In this paper, we propose CodeHID, a generative code retrieval framework that reformulates the code retrieval task from flat candidate matching to coarse-to-fine semantic address generation. CodeHID relies on two core components. First, Pseudo-Neighbor Guided DocID Learning constructs a globally static hierarchical index by applying multi-level residual quantization and $k$-nearest-neighbor pseudo-supervision, ensuring that semantically related code snippets share prefixes while preserving target-level separability. Second, Dual-Phase DocID Generation Guidance reliably navigates this fixed index by combining training-side ranking enhancements, using hard negatives and rank distillation, with inference-side candidate constraints and prefix-aware decoding. Extensive experiments on CoSQA and ProCQA benchmarks demonstrate that CodeHID outperforms existing sparse retrieval, pre-trained code models, dense code retrieval, and generative retrieval baselines by a large margin in most cases, achieving particularly strong improvements in rank-one retrieval metrics.

cs.IR↗
arXiv2026

Mask-Free Privacy Extraction and Rewriting: A Domain-Aware Approach via Prototype Learning

Client-side privacy rewriting is crucial for deploying LLMs in privacy-sensitive domains. However, existing approaches struggle to balance privacy and utility. Full-text methods often distort context, while span-level approaches rely on impractical manual masks or brittle static dictionaries. Attempts to automate localization via prompt-based LLMs prove unreliable, as they suffer from unstable instruction following that leads to privacy leakage and excessive context scrubbing. To address these limitations, we propose DAMPER (Domain-Aware Mask-free Privacy Extraction and Rewriting). DAMPER operationalizes latent privacy semantics into compact Domain Privacy Prototypes via contrastive learning, enabling precise, autonomous span localization. Furthermore, we introduce a Prototype-Guided Preference Alignment, which leverages learned prototypes as semantic anchors to construct preference pairs, optimizing a domain-compliant rewriting policy without human annotations. At inference time, DAMPER integrates a sampling-based Exponential Mechanism to provide rigorous span-level Differential Privacy (DP) guarantees. Extensive experiments demonstrate that DAMPER significantly outperforms existing baselines, achieving a superior privacy-utility trade-off.

cs.CR↗
arXiv2026

ATLAS: Scaffold-Free Algorithm Synthesis by LLMs via Embedding-Guided Quality-Diversity Search

Most LLM-based automated algorithm design methods optimize a designated component within a human-specified scaffold, fixing overall organization and component interactions. We present ATLAS, an embedding-guided quality-diversity framework for scaffold-free full-algorithm synthesis in combinatorial optimization. The problem specification supplies objectives and constraints; a minimal I/O interface fixes only instance and solution formats; the LLM chooses and restructures components, interactions, and control flow. This freedom enlarges the search space, risking invalid candidates and premature convergence to one design region. ATLAS independently detects execution, interface, and feasibility failures, recomputes objectives, and applies error-conditioned repair; similarity-based archive management preserves algorithms across embedding-space regions to counter premature convergence. Its three-layer search refines the best design, gives other regions dedicated refinement opportunities, and performs cross-region synthesis to recombine components and their interactions. Across four NP-hard problems, ATLAS outperforms several state-of-the-art component-synthesis methods and a matched full-synthesis baseline while remaining competitive with strong human-designed algorithms. One ATLAS run retains several algorithms with comparable performance from distinct embedding-space regions rather than a single design. Code inspection finds that these multi-component designs differ in their primary construction or global-search backbone. Our results suggest that embedding-guided quality-diversity search can make the enlarged full-algorithm design space practically searchable. Source code and exact executable prompts are available at https://github.com/Danial-Yazdani/ATLAS .

cs.AI↗
arXiv2026

LingShu: A Large-Scale Symptom-Centric Contextualized Knowledge Graph Bridging Traditional Chinese Medicine and Modern Biomedicine

Biomedical knowledge graphs (KGs) are pivotal for knowledge organization, yet traditional binary relations often struggle to represent the conditional nature of biomedical knowledge. Symptoms provide a shared phenotypic layer for linking Traditional Chinese Medicine (TCM), which relies on symptom patterns for syndrome differentiation and treatment selection, with modern biomedicine, which connects clinical manifestations to diseases and molecular mechanisms. We present LingShu, a large-scale symptom-centric contextualized knowledge graph designed to bridge TCM and modern biomedicine. The exported version of LingShu analyzed in this study comprises 17.33 million atom-level entity records and 39.47 million relation records, including 17.19 million semantic triples and 22.29 million contextualized quadruples. LingShu integrates multi-source data, including clinical electronic medical records, authoritative TCM texts, biomedical ontologies, and curated knowledge bases, through a pipeline combining natural language processing, terminology normalization, and human-in-the-loop verification. A key innovation of LingShu is its hybrid data model: it maintains 64 typed triple relation patterns to ensure broad connectivity, while incorporating 35 contextual quadruple relation patterns to capture conditional medical associations. This dual-structure approach explicitly encodes conditional knowledge, providing a granular representation of the contexts associated with medical relations. These contextualized relations cover syndrome-dependent herb efficacy, disease-contextualized drug effects, population-specific clinical associations, and mechanism-related therapeutic responses. Furthermore, we developed a web platform (http://www.tcmkg.com/) that integrates graph visualization, graph-based reasoning, and an evidence-grounded knowledge question-answering agent.

cs.CL↗
arXiv2026

Towards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach

Federated prompt tuning (FPT) enables collaborative adaptation of vision--language models (VLMs) using lightweight prompts. Existing methods often address heterogeneity and privacy through a split-prompt design under local differential privacy (DP), combining a shared prompt for global transfer with private prompts for local adaptation. However, a single shared prompt may over-smooth diverse transferable knowledge, weakening the balance between personalization and generalization. Multi-expert prompts (MEPs) can better capture this diversity, but enlarge the communicated space, increasing DP noise and communication cost while making robust expert composition more difficult. We propose FedSEPT, a privacy-preserving Fed}erated Subspace-decomposed Expert Prompt Tuning. Specifically, we employ Subspace-decomposed Expert Modeling (SEM) to parameterize multiple prompt experts with shared low-rank factors, a fixed public basis, and private residuals, thereby confining communication and DP perturbation to a compact factor space while enabling direct server aggregation in a common coordinate system. We further design Instance-aware Expert Fusion (IEF), which adaptively combines semantically complementary experts via on-device routing and performs efficient logit-level fusion using cached expert-specific text features. Extensive experiments on 11 heterogeneous benchmarks show that, under the same privacy constraints, FedSEPT achieves a better trade-off between local adaptation and global generalization than strong baselines.

cs.CV↗
arXiv2026

Misspecification Analysis of High-Dimensional Random Effects Models for Estimation of Signal-to-Noise Ratios

Estimation of signal-to-noise ratios and residual variances in high-dimensional linear models has various important applications, including heritability estimation in bioinformatics. One widely used estimator is the Gaussian random-effects maximum likelihood estimator (MLE), based on the likelihood of the homogeneous Gaussian random-effects model in which both the regression coefficients and the noise variables are assumed to be i.i.d. Gaussian. This paper studies the behavior of this likelihood estimator under model misspecification. For isotropic random designs with independent, symmetric, sub-Gaussian entries, we establish consistency and asymptotic normality of the SNR MLE for fixed dense coefficient vectors and independent, centered, heteroscedastic finite-moment noise, allowing moderately heavy-tailed errors. We also give parallel consistency and central limit results for correlated Gaussian noise as a benchmark. The asymptotic variance depends on the limiting aspect ratio, the true SNR, and a scalar noise-square fluctuation parameter. This explicit form yields feasible plug-in confidence intervals under independent noise in two cases where the fluctuation parameter can be estimated from response fourth moments: heterogeneous Gaussian noise and homogeneous non-Gaussian noise. Numerical simulations compare likelihood-based and method-of-moments confidence intervals under heterogeneous and non-Gaussian noise, and a real-data illustration demonstrates the resulting calibrations on high-dimensional text features.

math.ST↗
arXiv2026

Conditional Diffusion Guided Knowledge Transfer for Multi-Domain Knowledge Graph Completion

Multi-domain knowledge graph completion (MKGC) aims to improve missing triple prediction in a target KG by transferring knowledge from other support KGs. Existing methods typically enforce consistency constraints on equivalent entities across KGs to transfer knowledge, which risks suppressing domain-specific contextual information of entities. This design can also compromise entity representation information from all KG domains, impeding performance improvements, especially in low-resource data scenarios. To address this, we pioneer a generation-based paradigm for MKGC and propose DMKGC, a conditional diffusion-guided knowledge transfer framework. Our key insight is to treat each KG as a partial view of the entity entire information, and generate informative domain-general entity embeddings through diffusion models conditioned on support KGs. Particularly, we first initialize domain-agnostic entity embeddings as prior entity embeddings, and then encode them within individual KGs. Afterward, we fuse equivalent entities from support KGs as the conditional diffusion generation guidance. We leverage the prior entity embeddings as the proxy generation objective, which ensures this conditional generation to be unbiased towards any conditioned KGs. Simultaneously, we also train the generated embeddings to be predictive across KGs, thus preserving domain-specific information. Extensive experiments on 14 KGs in 3 benchmarks demonstrate a 4.3\% average MRR improvement in tail entity prediction over state-of-the-art methods, with sustained gains in low-resource data settings.

cs.CL↗