arXiv Science⌕ Search

arXiv subjects

Chen Lin

Publications and source records attributed to Chen Lin.

At least 19 recordsLinked to original sources
arXiv2026

MemT-1.0: Towards Memory-Native Evolution

Memory-native evolution requires making memory an intrinsic capability of foundation models, enabling them to continuously accumulate and utilize information. To this end, we introduce MemT-1.0, a new architecture of memory foundation models that internalize memory as part of model computation. Building on Metis, MemT-1.0 employs Gated DeltaNet-2 with a stable token-level memory update mechanism within each turn. We further introduce Mixture-of-Storage to scale native memory capacity. Following a deliberate backbone preparation, we develop a two-stage training pipeline consisting of continued pre-training and post-training, supported by 34B tokens of training data and efficient training and inference infrastructure. We release a model family comprising MemT-1.0-Nano and MemT-1.0-Flash, and conduct a comprehensive evaluation of memory and general capabilities. The results show that they outperform the parametric memory baselines on average and remain competitive with retrieval-augmented methods, while largely preserving general capabilities. At a history length of 128K tokens, MemT-1.0-Nano achieves approximately $1.86\times$ end-to-end inference speedup and a $66\times$ reduction in persistent storage relative to full context KV cache. By internalizing retrieved procedural experience, MemT-1.0 improves task success on agentic tasks, providing a practical step toward memory-native evolution.

cs.CL↗
arXiv2026

Many Steps into One: Reasoning Contraction and the Limits of Safe Memory Reuse for LLM Agents

Thought templates, skill libraries, agent memories and caches turn many reasoning steps into one. We call this reasoning contraction. A contracted memory saves reasoning steps and errors until its facts change, then quietly answers wrong. Most systems trust memories by counting successes and failures. We prove that such counters are badly tuned change detectors: a symmetric counter notices a partial change only after a power of its false-alarm horizon, and an unclipped one may never notice it. On five LLMs answering multi-hop questions over edited facts, ExpeL- and ACE-style counters serve 7.0-13.5x more stale answers than certified memories given the same information, and on code tasks with an exact verifier 35-73x more. Safety also has a price. When facts change and each memory is judged only by its own verified outcomes, one number, the certification load, sets how much reasoning any safe memory can skip, and under Zipf demand it yields a scaling law. Our recipe weighs each memory's failures by its own likelihood ratio, certifies its utility against live reasoning, and restarts the certificate when facts change, with the likelihood-ratio detector as the safety net for unannounced changes; for large edits it also invalidates the memory.

cs.CL↗
arXiv2026

Panoramic modelling of single-cell transcriptomes at scale with CellNet

Comprehensively characterizing cellular diversity is critical for understanding tissue development, identifying disease-associated populations and investigating gene programmes linked to specialized functions. Advances in single-cell profiling reveal additional cell-specific transcripts and molecular associations, yet many foundation models represent only a restricted portion of this increasingly rich molecular information. Here we present CellNet, which enables panoramic modelling of single-cell transcriptomes by integrating DNA-derived gene identities and measured RNA expression in a shared image representation. Pretrained on 231 million cell profiles spanning 40 species, CellNet improves rare-population and condition-associated state recognition in evaluated cohorts while retaining competitive general cell representations. It predicts withheld coding-gene expression and selected non-coding targets in total-RNA data, and recovers lineage-specific expression patterns in spatial measurements. Prediction also extends across species, including to targets without expression-pretraining exposure. Its gene representations retrieve known non-coding modules and developmental or neural programmes, including from sparsely detected RNA queries. Together, these results establish CellNet as a scalable framework for interpreting cellular diversity through increasingly comprehensive transcriptomic measurements.

q-bio.GN↗
arXiv2026

RoLaQ: Joint Rotation and Range Calibration for 2-Bit KV Caches in Multi-Head Latent Attention

Multi-head latent attention (MLA) compresses the content of a key-value cache into a shared latent per token, making low-bit storage attractive for long-context inference. At two bits, errors in this representation perturb both attention matching and value readout, with effects that depend on error direction and reconstruction scale. We introduce RoLaQ (Rotation-calibrated Latent Quantization), an offline method for joint rotation and range calibration. RoLaQ refines a shared rotation within subspaces defined by the frozen key and value projections, and jointly learns quantization ranges whose thresholds and reconstruction gains are coupled to control the shared signal's response. Prediction matching and attention-output supervision guide calibration with model weights frozen. Across three MLA models and six benchmarks, RoLaQ achieves the highest average accuracy among the compared 2-bit methods both without and with token protection. On DeepSeek-V2-Lite, an SGLang implementation provides 3.96 times the BF16 KV capacity under the same memory budget and 2.51 times its decode throughput with 256K input tokens.

cs.LG↗
arXiv2026

Understanding Gene Expression-to-Image Learning: Spatial Structure and Information Fidelity

Single-cell RNA sequencing (scRNA-seq) enables cell-level analysis of biological heterogeneity, but learning effective representations from high-dimensional, unordered gene expression profiles remains challenging. Gene Expression-to-Image (GE2I) offers an effective learning strategy by arranging gene values on pixel grids for convolutional neural networks, but its underlying mechanisms remain unclear. We study GE2I on full-transcriptome data while keeping the network and training procedure fixed. Our results reveal a trade-off between spatial smoothness and gene-level fidelity. Structured mappings produce smooth, low-frequency patterns that support faster early optimization, whereas assigning multiple genes to the same pixel obscures expression differences and can reduce predictive performance. This trade-off explains why random mappings can compete with structured layouts when many genes are represented. One-to-one gene-to-pixel assignment improves prediction across the tested visual backbones even when image smoothness decreases. We further find that the benefits of pretraining and augmentation depend on the backbone and mapping. These findings provide practical guidance for pixel allocation and the transfer of vision priors to gene expression data.

cs.AI↗
arXiv2026

Matrix Kloosterman sums and product-trace estimates for semisimple algebras

Let $k=\mathbb{F}_q$, $E=\mathbb{F}_{q^n}$ and $\mathrm{Tr}=\mathrm{Tr}_{E/k}$. For $r\ge 2$, $a\in k^{\times}$ and $x\in E^{\times}$, let $\mathrm{N}(E,r,x,a)$ be the number of $r$-tuples $(x_1,\cdots,x_r)$ in $(E^{\times})^r$ satisfying $x_1\cdots x_r=x$ and $\mathrm{Tr}(x_1+\cdots+x_r)=a$. We prove $\left|\mathrm{N}(E,r,x,a)-\left((q^n-1)^{r-1}+(-1)^r\right)/q\right|\le (r^n-1) q^{\frac{(r-1)n-1}{2}}$. This proves the square-root estimate predicted in Wan's conjecture and generalizes a previous result of Moisio and Wan. For a finite semisimple algebra $B=\prod\limits_{i=1}^s M_{d_i}(\mathbb{F}_{q^{n_i}})$ over $k$ and a regular element $x\in B^{\times}$, the same method combined with Zelingher's formula leads to analogous square-root estimates.

math.NT↗
arXiv2026

Revisiting the Broken Symmetry Phase of Solid Hydrogen: A Neural Network Variational Monte Carlo Study

The crystal structure of high-pressure solid hydrogen remains a fundamental open problem. Although the research frontier has mostly shifted toward ultra-high pressure phases above 400 GPa, we show that even the broken symmetry phase observed around 130~GPa requires revisiting due to its intricate coupling of electronic and nuclear degrees of freedom. Here, we develop a first principle quantum Monte Carlo framework based on a deep neural network wave function that treats both electrons and nuclei quantum mechanically within the constant pressure ensemble. Our calculations reveal an unreported ground-state structure candidate for the broken symmetry phase with $Cmcm$ space group symmetry, and we test its stability up to 96 atoms. The predicted structure quantitatively matches the experimental equation of state and gives the closest x-ray diffraction peak-position match among the tested candidates. Furthermore, our group-theoretical analysis provides a symmetry-counting compatibility check between the $Cmcm$ structure and existing Raman and infrared spectroscopic data. Crucially, static density functional theory calculation reveals the $Cmcm$ structure as a dynamically unstable saddle point on the Born-Oppenheimer potential energy surface, demonstrating that a full quantum many-body treatment of the problem is necessary. These results shed new light on the phase diagram of high-pressure hydrogen and call for further experimental verifications.

cond-mat.str-el↗
arXiv2026

An adaptive $L_2$-type test for high-dimensional white noise

We propose a new $L_2$-type test for white noise which allows the dimension $p$ of the time series to either (i) be a fixed constant, or (ii) diverge with the sample size $n$. The proposed test statistic exhibits an interesting phase transition, following two different regimes of behavior: $p$ is fixed, and $p\rightarrow\infty$. Because identification of the operable regime is difficult, if not impossible in practice, we devise a novel adaptive bootstrap method to construct unified testing procedure across different phases. Numerical experiments confirm the good finite sample performance of the proposed adaptive $L_2$-type test in comparison to the existing methods in the literature. The proposed testing procedure has been implemented in R package HDTSA.

math.ST↗
arXiv2026

Dual-Vocabulary Language Model for Cross-Tokenizer Distillation

On-policy distillation (OPD) bridges teacher supervision and student behavior, but different teacher-student tokenizers introduce misalignment in both input tokenization (#1) and output logits (#2). Existing approaches address the former by matching same-text spans or converting tokens to bytes, often losing fine-grained token information or disrupting the native-token paradigm, while for the latter, strategies such as ranking, padding, or key-token selection retain only shared logit dimensions, resulting in much distribution loss. In this paper, we propose Dual-Vocabulary Language Model (DVLM), which replaces the teacher's LM head with a new student-vocabulary projection head and obtains full-dimensional student logits (for #2). To support student tokens (for #1), it takes a Parallel-Tokenized Sequence (PTS) as input, which concatenates the original teacher-tokenized sequence and a re-tokenized sequence formed by independently converting each student token into a teacher-token group. To avoid inference inconsistency with the original teacher tokens, the Hybrid-Prefix Attention (HPA) further restricts re-tokenized groups to their corresponding teacher prefix and uses its last state as the aggregation of the original student-token representation for projection into the student vocabulary space. Similarly, via the combined use of PTS and HPA, the DVLM teacher can provide distribution-aligned supervision with the student's input-tokenization and output-logit during OPD. Experimental results demonstrate that our DVLM teacher has a similar converged loss as the original teacher model and enables student models to improve performance across six reasoning tasks.

cs.AI↗
arXiv2026

Enhancing Healthcare Search Intent Recognition with Query Representation Learning and Session Context

Classifying the intent behind healthcare search queries is crucial for improving the delivery of online healthcare information. The intricate nature of medical search queries, coupled with the limited availability of high-quality labeled data, presents substantial challenges for developing efficient classification models. Previous studies have exploited user interaction data, such as user clicks from search logs and employed pairwise loss functions to model co-click behavior for query representation learning. However, many health queries could have multiple intents, resulting in ambiguous or divergent click behavior. Furthermore, learning the single most popular intent of queries as inferred from global statistics based on the aggregate behavior of different users could potentially lead to disparity and performance drop when classifying the query intent within specific search sessions. To address these limitations, our work improves the query representation learning by aggregating similar queries via clustering, and introducing a novel loss function designed to capture the multifaceted nature of health search queries, resulting in a more scalable and accurate learning procedure. Furthermore, we quantify the ambiguity of health queries and the misalignment between global search intents and those discerned from individual sessions, by introducing the concordance rate (CR) score, and demonstrate a simple and effective method for incorporating our learned query representation into contextual, session-based search intent classification. Our extensive experimental results and analysis on two real-world search log datasets, i.e., a Health Search (HS) dataset and the publicly available TripClick dataset, demonstrate that our approach not only improves the intrinsic clustering metrics for query representation learning but also enhances accuracy for subsequent search intent classification tasks.

cs.IR↗
arXiv2026

Generic Nullity of Generalized Commutators

We study the generic nullity of generalized commutator operators \[L_{\mathbf{A}}(X)=s_{k+1}(A_1,\cdots,A_k,X)\] on matrix algebras, where $s_{k+1}$ denotes the standard polynomial. Dixon and Pressman conjectured an explicit formula for the generic nullity of $L_{\mathbf{A}}$, and Brassil and Reichstein proved the conjecture when $k$ is even. In this paper, we settle the remaining case where $k$ is odd. Our proof first treats the boundary cases $k=2n-3$ in dimensions $n$ and $n+1$ using degree decompositions and graph-theoretic interpretations of alternating trace forms, and then establishes a dimension-extension argument from $n$ to $n+2$. Consequently, together with the result of Brassil and Reichstein, we obtain a complete proof of the Dixon-Pressman generic nullity conjecture over any field of characteristic zero.

math.RA↗
arXiv2026

The $p$-rationality of $\mathbb{Q}\left(\sqrt{-(kp+m)}\right)$ and $\mathbb{Q}\left(\sqrt{p(p+1)}\right)$

In this paper, we construct new families of imaginary and real quadratic fields that are $p$-rational. In the imaginary case, we prove that for any positive integer $k$ and any integer $m$, the imaginary quadratic field $\mathbb{Q}\left(\sqrt{-(kp+m)}\right)$ is $p$-rational for sufficiently large primes $p$. The proof relies on Louboutin's bound on the class numbers of imaginary quadratic fields. As a corollary, we recover the $p$-rationality of consecutive quadratic fields, a result due to Chattopadhyay, Laxmi and Saikia \cite{CLS}. In the real case, we give an explicit proof of the $p$-rationality of the real quadratic field $\mathbb{Q}\left(\sqrt{p(p+1)}\right)$ for any odd prime $p$, and obtain new pairs of real quadratic fields $\left(\mathbb{Q}\left(\sqrt{p(p-2)}\right),\mathbb{Q}\left(\sqrt{p(p-1)}\right)\right)$ and $\left(\mathbb{Q}\left(\sqrt{p(p+1)}\right),\mathbb{Q}\left(\sqrt{p(p+2)}\right)\right)$ for any prime $p>3$. We also construct new examples of $p$-rational triquadratic fields.

math.NT↗
arXiv2026

On the Fractional Parts of Polynomials Modulo $p$

We study a half-interval distribution problem for polynomial residues modulo an odd prime $p$: how often the fractional part of $φ(x)/p$ lies in the upper half of the unit interval as $x$ ranges over $1\leq x< p/2$. Using finite Fourier expansions together with the Weil bound, we prove an asymptotic formula $\#\left\{1\leq x< p/2:\left\{{φ(x)}/{p}\right\}>\frac12\right\} =\frac{p}{4}+O_φ(\sqrt p\log^2 p). $ We then show that the error term can be improved to $O_φ(\sqrt p\log p)$ for arbitrary quadratic polynomials and for polynomials satisfying suitable reflection symmetries. For even monomials $φ(x)=x^m$, we further obtain the bound $O_m(\sqrt p\log\log p)$ under the Generalized Riemann Hypothesis. Finally, in the case $m=2$, we prove an unconditional matching lower bound, showing that the factor $\log\log p$ is best possible in this setting.

math.NT↗
arXiv2026

Impact of Residual Angular Chirp in a Petawatt-class Laser System on Laser-driven Proton Acceleration

Laser-driven proton acceleration has attracted considerable interest owing to its appealing potential in versatile applications including cancer therapy. Proton energies depend critically on the on-target intensities, yet the detrimental impact of focal spot degradation induced by spatiotemporal couplings on the acceleration remains insufficiently elucidated. In this study, we demonstrate that residual angular chirp (AC), stemming from minor misalignments of the grating compressor in a Petawatt-class laser system, acts as a critical bottleneck for proton acceleration. Experimental results reveal that even around 100 microradians of grating misalignment induces substantial focal-spot elongation and a pronounced reduction in peak intensity. By implementing an in situ spectral-blocking diagnostic, we effectively eliminated the residual AC and restored a near-diffraction-limited focus. This optimization led to a significant recovery of the on-target intensity, resulting in a twofold increase in the proton cutoff energy. Our work presents a successful demonstration of diagnosing and eliminating residual AC. This provides a practical reference for generating high-energy proton beams and supporting their diverse applications in a PW-class laser.

physics.plasm-ph↗
arXiv2026

ReNIO: Reweighting Negative Trajectory Importance for LLM On-Policy Distillation

On-policy distillation (OPD) improves LLM reasoning by training a student model on its own generated outputs, but standard OPD treats all student-generated outputs (SGOs) equally regardless of their informativeness. We observe a consistent asymmetry in controlled filtering experiments: in both OPD and on-policy self distillation (OPSD), training only on incorrect SGOs outperforms training only on correct ones. Our further analysis suggests that models trained on correct-only SGOs tend to generate shorter reasoning traces and show weaker reflection behavior, while incorrect SGOs better preserve exploratory reasoning near the model's capability boundary. To exploit this signal without requiring full answer-containing rollouts, we introduce ReNIO, which Reweights Negative trajectory Importance for LLM On-policy distillation. By using the student-to-teacher probability ratio, ReNIO identifies pivotal tokens leading to wrong reasoning traces and aggregates their information into a normalized sample weight, inherently assigning larger weights to likely negative trajectories without observing the correctness of final-answer. Since Re-NIO only uses prefix-conditioned token probabilities, it preserves OPD's prefix training advantage over full-rollout reinforcement learning. Across both mathematical reasoning and code generation tasks, ReNIO improves both OPD and OPSD, with representative relative gains of up to 8.90% for Qwen3-1.7B and 10.00% for R1-Distill-Qwen-7B on mathematical reasoning benchmarks. Code repo: https://github.com/BDML-lab/ReNIO.

cs.LG↗
arXiv2026

Impact of noise on nonlinear-exceptional-point-based sensors

Nonlinear exceptional points (NEPs), a new type of spectral singularity in nonlinear non-Hermitian systems, are expected to address the noise divergence issue encountered at linear exceptional points and are therefore under the scrutiny of theoretical and experimental investigations. However, concerns have been raised that NEPs may hinder improvements in the signal-to-noise ratio (SNR) of sensors, and there is currently no rigorous theoretical framework to characterize noise effects in NEPs, particularly when accounting for the inherent nonlinear feedback. Here, we develop a new theoretical framework to address the impact of noise on NEP-based sensors, effectively resolving these concerns. The interplay between noise and nonlinearity keeps the average frequency virtually unchanged. In addition, a hidden feedback mechanism limits the increase in detectable uncertainty, together enabling a substantial SNR enhancement at NEPs. Our results resolve the ongoing debate over the SNR of NEPs and lay the groundwork for NEP-based sensor technologies.

physics.optics↗
arXiv2026

DFT Accuracy on Crystal Structure Prediction with Machine Learning Interatomic Potentials

We present an evaluation of CSP-MACE-Å, a machine learning interatomic potential intended to replace DFT in crystal structure prediction (CSP). We decompose the total energy into separate intramolecular and intermolecular components. For the intramolecular component, we adopt the MACE-POLAR architecture and train it on the OMol25 dataset. The intermolecular component combines three terms: an intermolecular contribution from the MACE-POLAR model, a long-range dispersion term with the functional form of the XDM correction, and a learned delta model trained to reproduce B86bPBE-XDM intermolecular energies. The learned delta model is trained on residual intermolecular targets derived from 50,000 B86bPBE-XDM calculations on molecular crystal structures. On an evaluation set composed of 19 compounds, including a salt, selected from AstraZeneca's previous CSP publications, CSP-MACE-Å achieves performance comparable to PBE DFT with the Neumann-Perrin dispersion correction. On a second evaluation set composed of 28 compounds, including cocrystals and salts, collated from the seven CSP blind tests, CSP-MACE-Å achieves performance close to B86bPBE-XDM DFT. In both evaluation sets, reranking with harmonic free energies substantially improves performance relative to ranking by energy alone. Across our evaluation suite, CSP-MACE-Å is shown to outperform the MACE-POLAR-1 and UMA-OMC foundation models. Lastly, on a set of five compounds, CSP-MACE-Å is shown to capture temperature-dependent trends in the relative stability of polymorphs through estimation of the free energy under the harmonic approximation. By running multiple orders of magnitude faster than DFT, CSP-MACE-Å enables energy and free energy evaluation of far more candidate structures, providing greater confidence when derisking solid forms.

physics.chem-ph↗