arXiv Science⌕ Search

arXiv subjects

Boyu Zhang

Publications and source records attributed to Boyu Zhang.

At least 19 recordsLinked to original sources

WeightLoop: Weight-Space Programming with Experimental Feedback

Weight-space programming (WSP) shows that language models can reason about and rewrite neural network weights; recursive self-improvement (RSI) motivates feedback-driven improvement. Models guiding experiments receive concrete feedback: completed assays reveal prediction errors and inform what to test next. We introduce WeightLoop, a framework that turns experimental feedback into persistent updates to deployed predictors. GPT-6 Astra inspects a task specification and the model implementation, then writes a bounded, reusable parameter-editing program. As new measurements arrive, the program identifies prediction discrepancies, validates candidate edits using observed outcomes, and writes the selected changes back to the original model. The editor remains fixed while the predictor evolves, enabling repeated updates without further LLM calls or gradient retraining while preserving the original inference interface. In offline replay, targeted edits improve mean ranking utility in seven of eight endpoint-budget settings (all eight versus random edits) and mean final discovery across three sequential tasks. WeightLoop connects WSP with an RSI-inspired improvement loop, making experimental evidence a direct driver of model change and subsequent decisions.

cs.LG↗

Spin and scalar curvature on punctured four manifolds

We show that a closed spin four-manifold with nonzero signature, even after being punctured along a finite graph, does not admit a complete metric with uniformly positive scalar curvature. We also show that this implies Schoen's conjecture on $L^{\infty}$-metrics with non-negative scalar curvature for these manifolds. This is in contrast to higher dimensions. A key new observation, which could be of independent interest, is that Gromov's $μ$-bubbles are a convenient class of boundaries for the APS boundary value problem for the Dirac operator.

math.DG↗

KiT: A Foundation Model for Financial Time-Series Forecasting using DiffusionTransformers

Financial candlestick forecasting is fundamental to quantitative investment, yet it remains exceptionally challenging due to extremely low signal-to-noise ratios and vast heterogeneity across markets and instruments. Existing approaches have largely attempted to introduce deep learning to capture hidden temporal features, but most adopt an auto-regressive formulation, which leads to error accumulation during inference. Meanwhile, general-purpose time-series foundation models are not tailored to the unique structure of k-line data and yield unsatisfactory performance on downstream candlestick forecasting tasks. To tackle these problems, we introduce KiT, a K-line Diffusion Transformer foundation model, and reformulate future prediction as conditional path generation via flow matching: given a historical context window, the model generates an ensemble of plausible future OHLCV trajectories. We pre-train KiT at multiple parameter scales on billions of candlestick bars spanning multiple markets and timescales. Across three markets and seven resolutions, KiT attains a mean return RankIC of 0.057 and a mean volatility RankIC of 0.66, leading at every timescale and outperforming both task-specific financial forecasters and general time-series foundation models. Code will be available at: https://github.com/Luciferbobo/KiT.

cs.LG↗

SAGE: Subspace Alignment for Classifier-Free Guidance in Mixture-of-Experts Diffusion Models

Diffusion Transformers with Mixture-of-Experts (MoE) routing are a leading recipe for scaling generative models. Classifier-Free Guidance (CFG) is essential for generation quality, yet excessively high guidance scales trigger collapse. We identify a previously unreported failure mode in their combination: the two CFG branches route independently, so their realized activations occupy different subspaces. The unconditional write then leaves the conditional subspace, and CFG amplifies that residual linearly in the guidance scale. We propose SAGE, a training-time regularizer that aligns unconditional MoE activations to the conditional subspace without restricting routing diversity, at zero inference cost. Toy experiments show that SAGE dramatically suppresses extreme drift by 9.2x. When scaled to a 1B-parameter text-to-image model, SAGE significantly improves generation quality, delivering a 9.3% boost in peak DPG-Bench performance. Extensive experiments demonstrate that SAGE consistently outperforms the baseline.

cs.CV↗

TSGate: Timestep-Aware Gated Attention for Diffusion Transformers

Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-fidelity image and video generation. Recent DiT systems increasingly use structured prompts for training, improving caption quality and prompt adherence. However, their generation quality can degrade severely under out-of-domain (OOD) prompts, including the free-form descriptions supplied by users at inference time. Although LLM-based rewriting can convert these prompts into structured formats, it does not guarantee that the rewritten prompts align with the training distribution. Our analysis links this degradation to attention sinks and reduced early-step image-to-text attention and shows that sink suppression alone is insufficient to restore generation quality. Despite effective sink suppression, models trained with standard gated attention exhibit reduced early-step image-to-text attention and suboptimal generation quality. Based on these insights, we propose Timestep-Aware Gated Attention (TSGate), which injects a timestep-conditioned bias into the gate signal so that gating behavior adapts across denoising steps. Extensive experiments show that TSGate consistently outperforms both the baseline and standard gated attention across multiple benchmarks, improving the raw-prompt DPG score by 9.5% over the baseline.

cs.CV↗

Equilibria in heterogeneous multi-strategy network games

In this paper, we analyze a multi-strategy network game with three types of players, conformists, rebels, and stubborn agents. Conformists adopt the strategy that is most common among their neighbors, rebels adopt the least common, and stubborn agents adhere to a fixed strategy. We study the existence and structure of pure strategy Nash equilibrium (PNE). On arbitrary networks, we establish sufficient conditions for PNE existence, and prove that in a broad class of large random networks the probability of PNE existence tends to zero as the network size grows. For several specific network architectures, such as complete network, lines, rings, trees, and stars, we derive necessary and sufficient conditions or develop an algorithm for determining PNE existence and characterize the equilibrium strategy frequencies. Collectively, these results offer a unified perspective that PNE is likely to exist when every conformist has more conformist and stubborn neighbors, and fails when the network game has numerous conformist-rebel edges.

econ.TH↗

The Dax isomorphism for topological $4$-manifolds

Let $X$ be an oriented topological $4$-manifold with boundary. We establish a Dax isomorphism for the fundamental group of the space of embedded arcs in $X$. Here, the embedding space can be either the simplicial set of locally flat embeddings or the space of topological embeddings endowed with the compact-open topology. When $X$ is smooth, we show that the space of smooth arcs and topological arcs have canonically isomorphic fundamental groups, and the topological Dax isomorphism agrees with the smooth Dax isomorphism. As a consequence, the homomorphisms that arise in the smooth Dax isomorphism do not depend on the smooth structure.

math.GT↗

Splitting spheres for $S^2$-links in $S^4$

We prove that every smooth two-component split sphere link $L\sqcup R\subset S^4$ admits infinitely many smooth splitting $3$-spheres that are topologically non-isotopic. This generalizes a theorem of Tatsuoka from the two-component sphere unlink to split links with arbitrarily knotted sphere components. In the course of the proof, we establish a general sufficient condition under which a connected sum of smooth $4$-manifolds admits infinitely many topologically non-isotopic splitting $3$-spheres. This criterion may be of independent interest; in particular, it applies to all previously known examples of nonuniqueness for splitting $3$-spheres of positive-genus surface links.

math.GT↗

InteractBench: Benchmarking LLMs on Competitive Programming under Unrevealed Information

Competitive programming is increasingly being used to evaluate the algorithmic reasoning capabilities of large language models (LLMs). However, existing benchmarks primarily focus on full-information tasks where all problem inputs are provided upfront. This overlooks a critical dimension of algorithmic reasoning: the ability of generated programs to operate when key information is not revealed upfront. Interactive problems, a distinctive component of competitive programming, embody this challenge. These problems require programs to engage in multi-round interaction with an interactor (a judge program) under strict protocol constraints and limited query budgets, with new information revealed only in response to queries. To address this gap, we introduce InteractBench, a benchmark comprising 322 high-quality interactive problems curated from Codeforces, AtCoder, IOI, and ICPC. Each problem is packaged with executable local interactors, enabling fully offline evaluation. Unlike existing benchmarks, InteractBench assesses whether model-generated code can acquire information and track state dynamically. Our evaluation reveals a significant interaction gap: even the most advanced reasoning models achieve limited success on interactive problems. Beyond success rates, we propose a fine-grained failure taxonomy to diagnose the root causes of these deficiencies. Although algorithmic logic errors remain dominant, protocol violations and query-budget overruns are frequent. Code is available at https://github.com/kmsgk0/InteractBench.

cs.SE↗

Network games with heterogeneous players

Real social and economic networks involve individuals with diverse incentives, yet most studies of network games assume homogeneous preferences or few player types. We introduce a general framework for binary choice network games with fully heterogeneous payoff structures. We first show that any such game can be transformed into an equivalent one with conformist, rebel, and stubborn archetypes, preserving equilibria and best response trajectories. We then establish sufficient conditions for pure strategy Nash equilibrium existence and convergence of best response dynamics on arbitrary networks, while proving that equilibria almost surely vanish in large sparse random networks. We further develop a deterministic approximation approach that predicts evolutionary trends and equilibrium strategy frequencies from network homophily and heterophily patterns, without computing equilibria explicitly. Extending the framework to limited information, we prove that dynamics converge either to a unique limited information equilibrium or to a unique stationary distribution, and we derive necessary and sufficient conditions for the existence of the limited information equilibrium. We validate our predictions using Prisoner's Dilemma games on real social networks that incorporate heterogeneous altruism and peer influence. These findings together provide a unified framework for equilibrium existence, evolutionary dynamics, and equilibrium outcome prediction in heterogeneous network games.

econ.TH↗

Candidate overtone shear horizontal SAW resonators in thin-film lithium niobate for intermodal acousto-optic modulation

The merits of thin-film surface acoustic wave (SAW) devices are pivotal to develop the high-performance intermodal acousto-optic modulators. In this work, we have proposed shear-horizontal (SH) SAW resonators for anticipated intermodal acousto-optic modulation on the thin-film lithium niobate platform. Through optimization of the cut angle of LN films, the SAW wavelength, and the thickness of interdigital transducer (IDT) electrodes, the calculated acousto-optic overlap factors utilizing SH0 modes are improved by more than an order of magnitude compared with those of Rayleigh modes. Furthermore, we have fabricated and characterized three kinds of proof-of-principle SH0 mode devices without/with grating reflectors. The electromechanical coupling coefficients (keff^2) and quality factors (Q) in the overtone resonators with grating reflectors are systematically evaluated, featuring the highest Q of 843 with the compromised keff^2 of 0.96%-4.72%. The results reveal that the temperature coefficients of frequency (TCF) of Rayleigh modes vary across various overtones, whereas the SH0 modes exhibit TCFs in the range of 32.3-68.9 ppm/C. Our fabricated SH0-mode overtone resonators demonstrate the capability of operating at power levels up to 29 dBm without electrode damage, offering a promising paradigm for robust and high-efficiency intermodal acousto-optic modulators with potential applications in integrated optical signal processing, microwave photonics,and quantum information technologies.

physics.optics↗

Interpretable Graph Kolmogorov-Arnold Networks for Multi-Cancer Classification and Biomarker Identification using Multi-Omics Data

The integration of heterogeneous multi-omics datasets at a systems level remains a central challenge for developing analytical and computational models in precision cancer diagnostics. This paper introduces Multi-Omics Graph Kolmogorov-Arnold Network (MOGKAN), a deep learning framework that utilizes messenger-RNA, micro-RNA sequences, and DNA methylation samples together with Protein-Protein Interaction (PPI) networks for cancer classification across 31 different cancer types. The proposed approach combines differential gene expression with DESeq2, Linear Models for Microarray (LIMMA), and Least Absolute Shrinkage and Selection Operator (LASSO) regression to reduce multi-omics data dimensionality while preserving relevant biological features. The model architecture is based on the Kolmogorov-Arnold theorem principle and uses trainable univariate functions to enhance interpretability and feature analysis. MOGKAN achieves classification accuracy of 96.28 percent and exhibits low experimental variability in comparison to related deep learning-based models. The biomarkers identified by MOGKAN were validated as cancer-related markers through Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) enrichment analysis. By integrating multi-omics data with graph-based deep learning, our proposed approach demonstrates robust predictive performance and interpretability with potential to enhance the translation of complex multi-omics data into clinically actionable cancer diagnostics.

cs.LG↗

Post-Hoc Understanding of Metaphor Processing in Decoder-Only Language Models via Conditional Scale Entropy

Metaphor requires a language model to resolve a token whose contextual meaning diverges from its basic literal sense. Understanding how transformer models organize this reinterpretation across depth remains an open problem in mechanistic interpretability. We introduce conditional scale entropy (CSE), a wavelet-derived measure of how broadly transformer computation engages across frequency scales at each layer position. Two theorems establish that CSE is invariant to update magnitude, isolating the structural pattern of updates from their intensity. Using CSE, we find that metaphorical tokens produce significantly higher spectral breadth than literal tokens at contiguous layer positions on every decoder-only architecture tested, from 124M to 20B parameters (GPT-2 family, LLaMA-2 7B, GPT-oss 20B). The effect survives cluster-based permutation correction, recurs in the early-to-mid relative depth range across models, and converges with an independent analysis of 200 naturalistic VUA pairs. Specificity controls further show that the effect is not explained by semantic complexity or by matched propositional content. These results identify multi-scale coordination as a consistent signature of metaphorical language processing in the decoder-only architectures examined, and establish CSE as a principled tool for characterizing cross-depth structure in transformers.

cs.CL↗

Recasting AI Data Centers as Engines for Carbon Removal

AI data centers (AIDCs) are rapidly increasing electricity demand and associated CO2 emissions, yet they also generate continuous low-grade waste heat. Here, we assess whether this heat can be upgraded by heat pumps to drive direct air capture (DAC) and reduce the climate impact of AI infrastructure. We develop a thermodynamically integrated DAC-AIDC system and conduct a region-resolved assessment across the United States, accounting for AIDC capacity, server composition, local climate, electricity prices, and grid carbon intensity. We find that AIDC waste heat can substantially improve net CO2 removal and lower the levelized cost of capture. In carbon-intensive regions, integration can flip DAC from net-positive to net-negative. Under a 2030 scenario with more GPU-intensive AIDCs and cleaner grids, several states achieve removal ratios above 1, indicating that integrated systems can offset their own operational emissions and deliver additional carbon removal.

math.OC↗

FinRL-X: An AI-Native Modular Infrastructure for Quantitative Trading

We present FinRL-X, a modular and deployment-consistent trading architecture that unifies data processing, strategy construction, backtesting, and broker execution under a weight-centric interface. While existing open-source platforms are often backtesting- or model-centric, they rarely provide system-level consistency between research evaluation and live deployment. FinRL-X addresses this gap through a composable strategy pipeline that integrates stock selection, portfolio allocation, timing, and portfolio-level risk overlays within a unified protocol. The framework supports both rule-based and AI-driven components, including reinforcement learning allocators and LLM-based sentiment signals, without altering downstream execution semantics. FinRL-X provides an extensible foundation for reproducible, end-to-end quantitative trading research and deployment. The official FinRL-X implementation is available at https://github.com/AI4Finance-Foundation/FinRL-Trading.

q-fin.TR↗

The Role of Defect Geometry in Localized Emission from Monolayer Tungsten Dichalcogenides

Understanding the mechanism of single photon emission (SPE) in two-dimensional (2D) material is an unsolved problem important for quantum optical materials and the development of quantum information applications. In 2D transition metal dichalcogenides (TMDs) such as tungsten diselenide (WSe2), quantum emission has been broadly attributed to exciton localization from atomic point defects, yet the precise microscopic origins are not fully understood. This work introduces an empirically grounded computational framework that explains both the origins of facile SPE in WSe2 and its relative scarcity in related TMD, tungsten disulfide. High resolution microscopy identifies native defect geometries existing in monolayer WSe2 lattices providing the ingredients necessary to build a realistic model. The qualitative effects of chalcogen type, defect geometry, and mechanical strain on the electronic structure are then individually assessed using density functional theory, from which a specific divacancy configuration emerges as the candidate for localized single-electron transitions that match observed spectral energies. Spectroscopy and photon correlation measurements further validate this model, establishing a self-consistent link between defect geometry, electronic structure, and quantum emission. By isolating the distinct roles of chalcogen type, defect configuration, and mechanical strain, this work provides a thorough investigation of exciton localization and optical behavior, contributing to a clearer picture of the physical drivers of single photon emission in tungsten-based TMDs.

cond-mat.mtrl-sci↗

Topological symplectic manifolds and bi-Lipschitz structures

We show that a topological symplectic manifold has a canonically associated bi-Lipschitz structure. As a corollary, we obtain the first examples of non-existence and non-uniqueness for topological symplectic structures. Our arguments hold for any topological manifold admitting an atlas with transition maps that are $C^0$--limits of bi-Lipschitz homeomorphisms.

math.SG↗

Pseudo-isotopies of 3-manifolds with infinite fundamental groups

Suppose $Y$ is a compact, connected, oriented 3-manifold possibly with boundary, such that $π_1(Y)$ is infinite. Let $\operatorname{Diff}_\partial(I\times Y)$ denote the group of self-diffeomorphisms of $I\times Y$ that are equal to the identity near the boundary. Let $\operatorname{Diff}_{PI}(I\times Y)$ denote the subgroup of $\operatorname{Diff}_\partial(I\times Y)$ consisting of elements pseudo-isotopic to the identity. Define $\operatorname{Homeo}_\partial(I\times Y)$, $\operatorname{Homeo}_{PI}(I\times Y)$ similarly for homeomorphisms. We show that the canonical map $π_0\operatorname{Diff}_{PI}(I\times Y) \to π_0\operatorname{Homeo}_{PI}(I\times Y)$ is of infinite rank. As a consequence, $π_0\operatorname{Diff}_{PI}(I\times Y)$, $π_0\operatorname{Diff}_{\partial}(I\times Y)$, $π_0\operatorname{Homeo}_{PI}(I\times Y)$, $π_0\operatorname{Homeo}_{\partial}(I\times Y)$ are all abelian groups of infinite rank. We also prove that $π_0\,C(Y)$ contains an abelian subgroup of infinite rank, and $π_0\,C(I\times Y)$ admits a surjection to an abelian group of infinite rank, where $C(X)$ denotes the concordance automorphism group $\operatorname{Diff}(I\times X, \{0\}\times X\cup I\times \partial X)$ or $\operatorname{Homeo}(I\times X, \{0\}\times X\cup I\times \partial X)$. These results are proved by studying the actions of barbell diffeomorphisms on the spaces of embedded arcs and configuration spaces.

math.GT↗