arXiv Science⌕ Search

arXiv subjects

Zehao Lin

Publications and source records attributed to Zehao Lin.

At least 19 recordsLinked to original sources

MemT-1.0: Towards Memory-Native Evolution

Memory-native evolution requires making memory an intrinsic capability of foundation models, enabling them to continuously accumulate and utilize information. To this end, we introduce MemT-1.0, a new architecture of memory foundation models that internalize memory as part of model computation. Building on Metis, MemT-1.0 employs Gated DeltaNet-2 with a stable token-level memory update mechanism within each turn. We further introduce Mixture-of-Storage to scale native memory capacity. Following a deliberate backbone preparation, we develop a two-stage training pipeline consisting of continued pre-training and post-training, supported by 34B tokens of training data and efficient training and inference infrastructure. We release a model family comprising MemT-1.0-Nano, MemT-1.0-Flash, and MemT-1.0-Pro, and conduct a comprehensive evaluation of memory and general capabilities. The results show that they outperform the parametric memory baselines on average and remain competitive with retrieval-augmented methods, while largely preserving general capabilities. At a history length of 128K tokens, MemT-1.0-Nano achieves approximately $1.86\times$ end-to-end inference speedup and a $66\times$ reduction in persistent storage relative to full context KV cache. By internalizing retrieved procedural experience, MemT-1.0 improves task success on agentic tasks, providing a practical step toward memory-native evolution.

cs.CL↗

The Value of Memory in Language Agents

Language agents carry information from past experience into future tasks whose demands may be unknown or change over time. We develop a decision-theoretic account of the capability available in history, retained in storage and realized through use, together with the costs of recovery and revision. Drawing on comparison of statistical experiments, information acquisition and the value of computation, we express these values in units of avoided task loss. Recovery and revision define attainable risk-cost profiles and preservation across uses. A cost-aware simulation condition and five minimal counterexamples establish how information timing, access, computation, feedback and demand shape these comparisons; a pointer with zero answer mutual information can reduce the cost of exact recovery. Allocation and recovery criteria identify when gains pay for estimation, selection and evidence access. Complete-split studies on LoCoMo, LongMemEval-S and PersonaMem cover 3,075 questions and two readers. They show complementary value from saved state and recovered evidence, task-dependent performance orderings, and the role of reuse in amortizing construction costs. Multi-project workflows connect correction to preservation and validation costs. Together, the theory and studies support decisions about what to retain, which recovery options to preserve, and how to adapt memory as evidence and objectives evolve.

cs.AI↗

When Does Better Confidence Improve a Knowledge-Graph Audit?

Confidence estimates guide human review in LLM-built knowledge graphs, but an erroneous shared entity need not be the only reason an incident fact is wrong. We study how this distinction affects budgeted audits, alongside selection headroom and label validity. Modelling non-adaptive auditing as budgeted covering, we characterise the minimal decision-relevant error statistics and bound the regret of scalar-preserving first-order planning by a structural mass $Δ^{\mathrm{cl}}$. We simulate ideal repair against benchmark-aligned labels for five extraction configurations and two cross-document graphs on Re-DocRED, followed by frozen confirmation on test and replication on 500 hash-selected training documents. An error-rate $\times$ fan-out baseline leaves 3.98-4.74 percentage points more errors than joint planning with the same actions. Independent-block planning also avoids this disadvantage: its held-out point estimates improve on a fact-only scalar baseline by 1.22-1.79 points and are slightly better than the joint model, although the frozen equivalence criterion remains inconclusive. On 300 DWIE training documents, independent and joint plans also outperform fan-out in point estimates, with extractor-dependent gains over fact-only review. For verification, a generic support check improves three of four model-budget configurations on each held-out set. These comparisons motivate evaluating complete-repair probabilities and retaining both fact-only and factorised baselines when choosing an audit model.

cs.CL↗

A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecycle

The emergence of writable, cross-session persistent memory in LLM agents introduces a qualitatively different threat landscape from conventional input-centric security concerns, characterized by three properties: persistence, statefulness, and propagation. To systematically characterize this landscape, we propose a Memory Lifecycle Framework that organizes attacks, defenses, and their cross-phase dependencies along two axes: six lifecycle phases (Write, Store, Retrieve, Execute, Share & Propagate, Forget & Rollback) and four security objectives (Integrity, Confidentiality, Availability, Governance). This analysis in turn exposes the need for explicit security requirements at the system level, motivating Verifiable Memory Governance (VMG), a framework of five architectural primitives for specifying and evaluating auditable, recoverable control over memory state within declared system and threat-model boundaries. Our analysis motivates integrating provenance, versioning, and policy-aware retention with retrieval and execution defenses to support auditable prevention, containment, and recovery across the lifecycle.

cs.CR↗

Gaia DR3 Compact Binary Candidates Constrained by Radial Velocity Measurements

Astrometry enables the most direct determination of the orbital elements and component masses of compact binaries. The potential of the current Gaia data for this purpose has not yet been fully explored. In this work, we combine Gaia astrometric and radial velocity (RV) measurements to perform joint orbital fitting for 1,835 Gaia astrometric binaries with available RV data. Among the 518 systems with at least three effective RV epochs, we identify 171 compact binary candidates, including four with inferred dark companion masses exceeding 2.1 $M_{\odot}$ and 22 between 1.4 and 2.1 $M_{\odot}$. These candidates provide valuable targets for future follow-up observations and Gaia DR4 analyses. We also flag 1,317 additional potential compact binary candidates with effective RV epochs less than three, including 84 with inferred companion masses above 2.1 $M_{\odot}$ and 173 between 1.4 and 2.1 $M_{\odot}$. More importantly, our results point to a large, currently hidden population of black hole and neutron star binaries that can be further explored with the forthcoming Gaia DR4 data and complementary follow-up observations.

astro-ph.SR↗

Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG

Large language models increasingly act as controllers in structured decision pipelines, yet their decisions are still executed by autoregressive text decoding. Hierarchical RAG is one such setting: at each frontier of a document tree, an LLM commits to $b$ of $k$ sections under an input-dependent action grammar, executed as either failure-prone free-form JSON or reliable but strictly serial grammar-constrained generation. We show that this serialization is unnecessary for bounded-horizon control: the reachable future forms a shallow action-prefix tree, which we compile --- one root prefill plus one tree-causal probe evaluate every prefix-conditioned action distribution with serial decoding's tokens, positions, and causal ancestry. A prefix-state lemma makes compiled control policy-exact in exact arithmetic: the same policy with a two-forward critical path and zero output tokens. One further probe pass certifies the exact order-marginalized MAP set. Across four document-disjoint splits and two scales on the primary MetaX device, compiled control matches the serial policy on $84$--$89\%$ of questions --- every instrumented divergence a floating-point near-tie --- and cuts control latency by $35$--$47\%$ versus token-wise serial decoding and $6$--$7\%$ versus an idealized chunked engine; an H800 repetition preserves the ordering.

cs.CL↗

High-Priority Compact-Object Candidates in Young Clusters from the \textit{Gaia} DR3 Non-Single-Star Catalog

The search for massive compact objects such as black holes (BHs) or neutron stars (NSs) in star clusters is longstanding challenge in astrophysics, yet no definitive identification of such compact objects in young clusters has been reported. In this Letter, we construct a sample of high-priority candidates for follow-up investigation. By cross-matching the cluster catalog with the Gaia Non-Single-Star database and estimating companion masses, we identify 13 systems with companion masses exceeding 1.4~$M_{\odot}$, three of which have masses above 2.1~$M_{\odot}$. Applying our newly developed Astrometric Mass-Ratio Function (AMRF) classification based on cluster-specific isochrones, we identify three systems whose companions cannot readily be explained by a single main-sequence star or an unresolved close binary. These systems have inferred companion masses exceeding 2.1~$M_{\odot}$, suggesting that they may be high-mass compact-object candidates. Joint Gaia and radial velocity orbit fitting for a comparison subset yields companion masses broadly consistent with the astrometric estimates, supporting the use of our framework for target prioritization. These unconfirmed systems are valuable targets for multi-epoch spectroscopy, high-resolution imaging, and future Gaia epoch astrometry.

astro-ph.GA↗

Morphological Statistic of Milky Way-like Galaxies

We analyze the spiral morphology of 1,738 nearby galaxies with similar Hubble type of the Milky Way ($i<60^\circ$, $z<0.048$) using multi-band optical images from the Sloan Digital Sky Survey and Digitized Sky Survey. Multiple-arm systems dominate, comprising $\sim$50-60% of the sample and $\sim$75% of large galaxies ($d_{\rm max} \geqslant 18~\mathrm{kpc}$). In $90\pm3$% of multiple-arm galaxies, two inner arms extend into multiple outer arms; three-arm inner structures occur in $9\pm2$%, and four or more are rare ($<1$%). Morphology and inner-arm counts are consistent across bands at $\sim$80%. Bifurcation points, marking the transition from two inner arms to multiple outer arms, occur in up to $\sim$40% of galaxies, are more prominent in bluer bands tracing younger stellar populations, and cluster within 4-7~kpc of galaxy centers. These statistics suggest that the Milky Way's inner two-arm and outer multiple-arm morphology, including bifurcations at similar radii, is broadly consistent with that of a typical multiple-arm spiral galaxy.

astro-ph.GA↗

First Trigonometric Parallax Measurements with the KVN and VERA Array (KaVA)

To demonstrate the astrometric capability of the combined Korean VLBI (Very Long Baseline Interferometry) Network (KVN) and VLBI Exploration of Radio Astrometry (VERA) Array (KaVA), we conducted six-epoch VLBI observations of 22-GHz H$_{2}$O masers associated with the star-forming region W3(OH). Two atmospheric calibration methods, (1) GPS and (2) JMA (Japan Meteorological Agency) mesoscale analysis data, and two phase-reference sources were independently applied to the astrometric analysis. Trigonometric parallaxes of W3(OH) were successfully measured with all calibration strategies, including the first successful parallax measurement using JMA calibration. The combined-fit parallax is 0.497$\pm$0.024 mas, corresponding to a distance of 2.01$^{+0.10}_{-0.09}$ kpc. This value is consistent with the previous Very Long Baseline Array (VLBA) result of 0.489$\pm$0.017 mas. KaVA achieved a 55$\%$ higher signal-to-noise ratio in phase-referenced maps than VERA, in good agreement with theoretical expectations. These results suggest that KaVA will enable trigonometric parallax measurements of 22-GHz H$_2$O masers that are difficult to observe with VERA alone because of low flux densities and/or limited $uv$ coverage. A flux variation from 510\,$\pm$\,50 to 3900\,$\pm$\,400 Jy was detected in W3(OH) over a one-year observing campaign and is attributed to two nearby maser features separated by only $\sim$64 AU at 2.01 kpc. The brightest feature showed a decrease in linewidth with increasing peak flux density, consistent with unsaturated maser amplification, whereas no similar trend was found for the other feature, suggesting different responses to the same amplification conditions, possibly owing to differences in saturation state and internal velocity structure.

astro-ph.GA↗

Star Formation in the H II Region Sh 2-205: 3D Morphology and Kinematics from Young Stars and Molecular Gas

Using Gaia astrometry of young stars combined with CO observations, we present the first systematic three-dimensional (3D) analysis of the structure, kinematics, and evolutionary history of the star-forming regions in the environs of the H II region Sh 2-205 (S205). S205 exhibits a complex morphology and coherent expansion on both global and subregional scales. We identify several O9-B1 stars and a 0.56 Myr old pulsar that are likely associated with the region. A momentum estimate suggests that feedback from these objects may account for the observed overall expansion. Trace-back analysis of the expansion, combined with color-magnitude diagram fitting for young star clusters, indicates at least two episodes of star formation. These results reveal a complex star-formation history of S205 and provide new insights into its 3D evolution.

astro-ph.GA↗

200 mm Wafer-Scale Monolithic 3D Integration of Atomic Layer-Deposited Oxide Semiconductors

Monolithic 3D (M3D) integration offers a pathway to overcome the scaling limits of conventional silicon complementary metal-oxide-semiconductor (CMOS) technology by extending dense vertical stacking of multifunctional logic and memory devices. Here, we demonstrate wafer-scale M3D integration of three tiers of atomic-layer-deposited (ALD) indium oxide (InOx)-based devices (>100,000 fabricated), including ferroelectric, enhancement-mode, and depletion-mode field-effect transistors, on 200 mm silicon wafers. We achieve threshold voltage standard deviation as low as 0.04 V, average electron mobility up to 91.6 cm2V-1s-1, and fully functional cross-tier circuits. A four-tier 3D computing-in-memory (CIM) accelerator targeting large language model workloads is developed using a custom InOx process design kit, delivering 1.4x to 2.9x speedup and comparable energy-delay product improvements over 2D baselines. These results establish ALD InOx M3D integration as a scalable and CMOS-compatible platform for next-generation artificial intelligence hardware and advanced electronics.

physics.app-ph↗

Metis: Memory Foundation Model

Recent advances in AI agents have increasingly internalized native capabilities into their underlying foundation models, giving rise to multimodal foundation models and large reasoning models. However, agent memory is still primarily implemented through external modules, leaving the native memory capability largely unexplored. In this paper, we take a first step toward this direction by introducing memory foundation models, which empower foundation models with native memory capabilities. We formalize native memory from two perspectives: a persistent and dynamically evolving memory state within the backbone, and native memory procedures that autonomously store and utilize information through model computation. We show that native memory offers advantages in architecture, end-to-end optimization, and efficiency. Based on this formulation, we propose Metis, the first prototype of memory foundation models. Metis introduces a new architecture that equips a foundation model with a native memory state, allowing historical information to be compressed into the model and accessed through memory attention. We construct large-scale memory-specific training data and introduce multiple optimization objectives to acquire these native memory procedures through mid-training. The online memory maintenance of Metis is gradient-free, and the memory update requires only a forward pass. At inference time, all learned model weights remain frozen, while the native memory states are autonomously transformed through standard forward computation. Through extensive experiments, we show that Metis exhibits native memory capabilities and further provide a detailed analysis of its strengths, limitations, and behaviors. To facilitate future research on memory foundation models, we release our project and model checkpoints.

cs.CL↗

MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations

Long-term memory has become a foundational capability for LLM-based agents that accompany users across extended, multi-session interactions. Existing benchmarks, however, evaluate such memory almost exclusively through downstream question answering, scoring only the correctness of a final answer. This black-box formulation conflates the heterogeneous causes of memory failure, such as missing the introduction of a relevant fact, binding an operation to the wrong target, or relying on stale values after a correction. As a result, it can credit correct answers despite their reliance on inconsistent or unsafe memory states. In this paper, we argue that, in dynamic long-horizon interactions, memory is not a static collection of facts but a lifecycle of explicit operations, including remembering, forgetting, updating, reflecting, and their compositions. We introduce MemOps, a benchmark that reformulates conversational memory as a sequence of lifecycle operations and represents each memory event with a structured trace specifying its trigger, target, scope, state transition, and supporting evidence. A controllable generation pipeline embeds these operations into long, task-oriented conversations and produces gold operation traces together with six categories of operation-level probes, evaluated under both adjacent-evidence and long-context settings. Across long-context, retrieval-based, parametric and managed-memory systems, MemOps disentangles failure modes that final-answer accuracy alone conceals, revealing that current systems remain far from uniformly reliable. For instance, session-level retrieval outperforms turn-level retrieval, and long-context models remain notably weak at reconstructing ordered memory-state trajectories. These results move long-term memory evaluation from final-answer scoring toward interpretable, operation-level diagnosis.

cs.AI↗

Mapping the Milky Way with Masers

SKA-VLBI is poised to revolutionize our understanding of the Galactic structure through its unprecedented astrometric precision and sensitivity. As a next-generation facility, it will answer long-standing questions about the Galactic structure by mapping its entire spiral structure in detail, spanning from the solar neighborhood, through the Galactic Center, to the far side of the Milky Way. Its access to the Southern sky will allow us to obtain more precise 3D parameters of the Galactic bar, reveal the nature of the 3-kpc Arm, and clarify the dynamical coupling between the bar and the spiral arms. By leveraging high-precision astrometry of numerous celestial objects with SKA-VLBI, the Galactic fundamental parameters such as the Solar motion and the Galactic rotation curve can be constrained more precisely. These advancements will not only elucidate the structure of our Milky Way, but also provide benchmarks for understanding barred spiral galaxies in general. Furthermore, they are important for advancing our knowledge of cosmological structure formation. The capabilities of SKA-VLBI will open a new era of high precision Galactic astrometry.

astro-ph.GA↗

SparseX: Efficient Segment-Level KV Cache Sharing for Interleaved LLM Serving

In long-context LLM serving, the prefill stage often dominates time-to-first-token and computational cost. Although Prefix Cache in vLLM/PagedAttention has been widely used to reuse identical prompt prefixes, repeated content in practical applications frequently appears as non-prefix, cross-request, cross-turn, and cross-agent segments, which makes conventional cache mechanisms insufficient. This paper presents SparseX, a segment-level KV Cache sharing method for common serving scenarios. SparseX uses contiguous token segments as reuse units and exploits Sparse-Q indices that naturally arise in KV Cache reuse workloads to estimate the key tokens that require correction. Based on this estimate, SparseX performs Sparse-KV Recomputation within a single forward pass, thereby restoring cross-segment contextual interactions under complex interleaved reuse patterns while avoiding additional models or separate preprocessing stages for token selection. SparseX further implements a full+sparse hybrid attention mode based on a layer-specific threshold: early layers retain full attention to obtain a more stable token-importance signal, and later layers switch to sparse recomputation to improve reuse quality on complex long-context tasks. We implement SparseX-vLLM on top of vLLM, integrating segment-level cache lookup, PagedAttention management, RoPE alignment, Sparse-Q token selection, and FlashAttention backends into a unified execution path. SparseX is model-agnostic, training-free, and compatible with Prefix Cache, and it provides unified support for common online serving scenarios including multi-round chat, retrieval-augmented generation (RAG), and agent workflows.

cs.PF↗

East Asian VLBI Network astrometry toward the star-forming region G040.96+02.48 in the Extreme Outer Galaxy

Accurate astrometric measurements for star-forming regions located on the far side of the Milky Way remain scarce. In this work, we present the astrometric results for a 22\,GHz water maser associated with star-forming region G040.96+02.48 located on the far side of the Milky Way, using the East Asian VLBI Network. The target water maser's proper motion was determined to be ($μ_α\cosδ, μ_δ$) = ($-2.06_{-0.51}^{+0.53}$, $-2.95_{-0.44}^{+0.45}$)~mas~yr$^{-1}$. The derived three-dimensional kinematic distance to the star-forming region is 20.2$\pm$3.2\,kpc, placing it slightly outside the Outer Scutum$-$Centaurus Arm. The corresponding vertical height of 872$\pm$139\,pc indicates a significant warp of the outer Galactic disk, which is in good agreement with the latest precessing warp model. Moreover, the resulting peculiar motions reveal a complex kinematic pattern, characterized by a large outward radial velocity of $-32\pm$18\,km~s$^{-1}$. Our observations substantially expand the valuable sample of star-forming regions with accurate astrometric measurements in the Extreme Outer Galaxy.

astro-ph.GA↗

Breakdown of Ohm's Law by Disorders in Low-Dimensional Transistors

Ohm's law provides a fundamental framework for understanding charge transport in conductors and underpins the concept of electrical scaling that has enabled the continuous advancement of modern CMOS technologies. As transistors are scaled to even smaller dimensions, device channels inevitably enter low-dimensional regimes to achieve higher performance. Low-dimensional materials such as atomically thin oxide semiconductors, 2D van der Waals semiconductors, and 1D carbon nanotubes, have thus emerged as key candidates for extending Moore's law. Here, we reveal the fundamental distinction between three-dimensional and low-dimensional conductors arising from disorder-induced electron localization, which leads to the breakdown of Ohm's law and lateral linear scaling. We develop a quantitative model that captures the role of the disordered region, a unique characteristic intrinsically to low-dimensional transistors. Furthermore, the disorder-induced localization framework consistently explains experimental observations in atomically thin In2O3 field-effect transistors across variations in channel length, temperature, thickness, and post-annealing conditions. This work establishes a unified physical picture for understanding and optimizing disorder-driven electronic transport in low-dimensional transistors.

cond-mat.mes-hall↗

MemOS: A Memory OS for AI System

Large Language Models (LLMs) have become an essential infrastructure for Artificial General Intelligence (AGI), yet their lack of well-defined memory management systems hinders the development of long-context reasoning, continual personalization, and knowledge consistency.Existing models mainly rely on static parameters and short-lived contextual states, limiting their ability to track user preferences or update knowledge over extended periods.While Retrieval-Augmented Generation (RAG) introduces external knowledge in plain text, it remains a stateless workaround without lifecycle control or integration with persistent representations.Recent work has modeled the training and inference cost of LLMs from a memory hierarchy perspective, showing that introducing an explicit memory layer between parameter memory and external retrieval can substantially reduce these costs by externalizing specific knowledge. Beyond computational efficiency, LLMs face broader challenges arising from how information is distributed over time and context, requiring systems capable of managing heterogeneous knowledge spanning different temporal scales and sources. To address this challenge, we propose MemOS, a memory operating system that treats memory as a manageable system resource. It unifies the representation, scheduling, and evolution of plaintext, activation-based, and parameter-level memories, enabling cost-efficient storage and retrieval. As the basic unit, a MemCube encapsulates both memory content and metadata such as provenance and versioning. MemCubes can be composed, migrated, and fused over time, enabling flexible transitions between memory types and bridging retrieval with parameter-based learning. MemOS establishes a memory-centric system framework that brings controllability, plasticity, and evolvability to LLMs, laying the foundation for continual learning and personalized modeling.

cs.CL↗