arXiv ScienceSearch

arXiv subjects

Dong Zhang

Publications and source records attributed to Dong Zhang.

At least 19 recordsLinked to original sources

Nonlinear spectral graph theory

Nonlinear spectral graph theory is an extension of the traditional (linear) spectral graph theory and studies relationships between spectral properties of nonlinear operators defined on a graph and topological properties of the graph itself. Many of these relationships get tighter when going from the linear to the nonlinear case. In this manuscript, we discuss the spectral theory of the graph $p$-Laplacian operator. In particular we report links between the $p$-Laplacian spectrum and higher-order Cheeger (or isoperimetric) constants, sphere packing constants, independence and matching numbers of the graph. The main aim of this paper is to present a complete and self-contained introduction to the problem accompanied by a discussion of the main results and the proof of new results that fill some gaps in the theory. The majority of the new results are devoted to the study of the graph infinity Laplacian spectrum and the information that it yields about the packing radii, the independence numbers and the matching number of the graph. This is accompanied by a novel discussion about the nodal domains induced by the infinity eigenfunctions. There are also new results about the variational spectrum of the $p$-Laplacian, the regularity of the $p$-Laplacian spectrum varying $p$, and the relations between the $1$-Laplacian spectrum and new Cheeger constants.

math.SP

Large-Scale Pretraining for Improving Deep Learning-Based Geometric Distortion Correction of Diffusion-Weighted Imaging

Diffusion-weighted imaging (DWI) is widely used in clinical settings but remains vulnerable to geometric distortion. Conventional correction methods often require additional acquisitions or vendor-specific solutions, limiting their feasibility in high-throughput, resource-constrained settings. This study investigates whether large-scale pretraining strategies can improve deep learning-based distortion correction for single-phase-encoding DWI. We formulate the task as image reconstruction, and compare a non-pretrained baseline against a self-supervised and a generative pretrained model, evaluated using both quantitative image-similarity metrics and qualitative expert assessment. The best-performing model was further tested for transferability on data collected in an LMIC setting with acquisition shift. Pretrained models outperformed the non-pretrained baseline, with cWDM achieving the strongest results across both quantitative and qualitative evaluation. However, application to LMIC data revealed transferability challenges, including contrast alteration and over-reliance on T1-weighted anatomical structure. Registering images to a common standard space improved predictions, suggesting that harmonized preprocessing may enhance cross-domain deployment.

cs.CV

Graphon as a Bridge between Graphs and Manifolds

We show that there exist graphons that interpolate between Riemannian manifolds and weighted geometric graphs. Specifically, the graph-to-manifold approximation used in manifold learning can be regarded as the composition of a graph-to-graphon convergence and a graphon-to-manifold convergence in a certain sense. Furthermore, we establish a monotonicity inequality which reveals an implicit relationship between numerous combinatorial parameters and geometric quantities on graphons. Using this inequality, we find relations among conductance, maxcut problem, capacity, and packing radius, as well as their limiting behaviors under graph-to-graphon and graphon-to-manifold convergences; some of these relations are novel even for simple graphs and closed manifolds.

math.CO

Relative Time Intervals Representation for Word-level Timestamping with Masked Training

Although Speech Large Language Models (SpeechLLMs) excel at speech understanding and generation, their capacity for fine-grained, temporally aligned outputs remains underexplored. Our work addresses this gap by enabling SpeechLLMs to jointly model speech content and temporal structure, effectively transforming them from ``content understanding machines" into ``temporal-aware content understanding machines". Specifically, we replace traditional absolute timestamps with relative timestamps, achieving a more compact vocabulary and stronger generalization capabilities. To efficiently infuse timestamp prediction ability into pre-trained large language models, we introduce a hybrid fine-tuning strategy: full-parameter fine-tuning of the timestamp-augmented embedding layer and language model head, combined with LoRA fine-tuning of the decoder layers. Moreover, we design a masked timestamp training objective, preventing the model from over-relying on ground-truth timestamps, and thereby enhancing robustness against noisy real-world annotations. Extensive experiments demonstrate that our approach achieves significant improvements in timestamp prediction accuracy while maintaining strong speech transcription performance.

cs.AI

Don't Just Listen, Try Planning: Graph-based Retrieval-Generation Agent for Long-form Audio Meeting Understanding

While long-form audio meeting understanding (LAMU) is garnering growing attention, task-specific question answering (QA) datasets remain scarce. Existing speech QA paradigms and state-of-the-art Speech LLMs suffer from acoustic information loss and poor long-term context memory. To address these issues, we construct the LongAudioQA dataset and propose the GRGA model, which models heterogeneous audio features into a multi-dimensional graph and leverages agent planning for retrieval and answer generation.

cs.SD

Congruence Decomposition with Neural Block Solvers for Large-Scale PCI Assignment

Physical Cell Identity (PCI) assignment is essential for interference management in dense 5G networks. As cellular networks scale, PCI reuse becomes unavoidable, which may cause collisions, confusions, and multiple forms of modular interference. Jointly mitigating these effects gives rise to a large-scale, multi-objective combinatorial optimization problem that is difficult to solve efficiently at practical network scales. In this work, we propose a congruence decomposition framework with neural block solvers for large-scale PCI assignment. The proposed decomposition exploits the arithmetic structure of PCI values to decouple multiple modular interference objectives into a collection of blockwise Min-$k$-Partition subproblems, followed by a graph coloring procedure to resolve PCI conflicts. For the resulting NP-hard Min-$k$-Partition subproblems, we develop neural block solvers by parameterizing their relaxed quadratic formulations with graph neural networks, enabling efficient optimization at large scales. Discrete assignments are recovered through conditional expectation rounding with theoretical guarantees. Experiments on synthetic cellular graphs and real-world 5G networks show that the proposed method consistently outperforms existing modular-interference-aware baselines in modular interference reduction, conflict elimination, and computational efficiency.

cs.LG

SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPOD

Full-parameter post-training of trillion-parameter-scale MoE models introduces substantial system-level challenges for large-scale distributed training, including severe memory pressure, non-overlapped communication overhead, and inefficient kernel execution. While most large-scale LLM training systems are built around GPU-based clusters, this report presents an end-to-end optimization practice on the Ascend NPU SuperPOD. Using the DeepSeek-V4 model family as the target workload, we develop a hierarchical optimization framework spanning model-level parallelism, computation-communication orchestration, and low-level kernel execution. The resulting system achieves 34.22% Model FLOPs Utilization (MFU) with a 2.93x improvement over the open-source baseline recipe while maintaining training stability. Building on this optimized infrastructure, we further establish a CPT and SFT workflow for complex Operations Research (OR) tasks. We refer to the integrated framework as SLAI T-Rex. Using DeepSeek-V4-Flash, we develop OR-oriented CPT and SFT data pipelines that combine collected domain resources with solver-verified synthetic optimization documents. The resulting dataset contains 10K high-quality SFT samples spanning four task categories and three problem representations. The specialized model achieves the highest average zero-shot Pass@1 score among the evaluated models, reaching 71.81% and outperforming GPT-5.4-Mini and the base DeepSeek-V4-Flash model by 3.98 and 11.27 percentage points, respectively. Overall, this work demonstrates a full-stack pathway from efficient trillion-parameter model post-training on Ascend infra to domain-specialized Flash models for solver-grounded mathematical modeling, advancing frontier-model systems for complex reasoning.

cs.CL

Choquet-type extension theory of set-pair functions, and applications to graph limits, hypergraphs, Riemannian manifolds and metric measure spaces

We propose Choquet extension for set-pair functions, $L^p$ integration of Choquet extensions, and global extension constants, and apply these to investigate optimization problems and bound many combinatorial and geometric quantities. Our research line is also applicable to the study of original Choquet extension; within this framework, parallel results for the original version are obtained. Specifically, we use Choquet-type extensions to build an equivalent functional representation of set-based fractional optimization, which finds applications in various settings, such as maxcut, bipartiteness ratio, and conductance on graph limits or Riemannian manifolds. We further establish the $L^p$ integration of a family of Choquet extensions, and apply it to derive spectral bounds for conductance and other combinatorial quantities on measure spaces. A monotonicity inequality on global extension constants is proposed, which unifies classical estimates and uncovers new bounds for a lot of geometric and combinatorial quantities, such as torsional rigidity, Cheeger constants, Dirichlet $p$-isoperimetric constant, and $p$-Laplacian eigenvalues, in totally distinct underlying structures----including hypergraphs, graph limits, Riemannian manifolds and metric measure spaces.

math.CO

PDD-RRG: Posterior Diagnostic Decision for Study-level Radiology Report Generation

Automatic radiology report generation (RRG) aims to simulate the workflow of radiologists, assisting them in clinical diagnosis. However, existing methods often fall short in utilizing all information relevant to the examination, as is typically done in clinical practice. Although some works attempt to incorporate multi-view images and historical data, these additional inputs may sometimes lead to avoidable diagnostic errors on the contrary. To address these challenges, we introduce a decision-making stage after report generation for the first time and propose a Posterior Diagnostic Decision framework (PDD-RRG) to integrate potentially conflicting diagnoses. Specifically, we create various subsets of input data and utilize an existing RRG model to generate reports from different perspectives. Then the Bayesian posterior probability and the learned thresholds for each clinical observation are calculated to obtain an aggregated diagnostic conclusion, which is subsequently used to refine the generated report. Experiments on MIMIC-CXR demonstrate that our proposed PDD-RRG can effectively enhance the clinical efficacy of existing RRG models without any retraining.

cs.CV

Deep learning accelerated solutions of incompressible Navier-Stokes equations on non-uniform Cartesian grids

In incompressible flow simulations, non-uniform grids efficiently capture localized flow features; however, their spatially varying resolutions severely exacerbate computational complexity. The pressure Poisson equation (PPE) formulated on these grids yields highly complex linear systems, forming the primary computational bottleneck in fractional step method. To address this, we develop an extended hybrid framework tailored for non-uniform Cartesian grids, integrating deep learning with classical iterative solvers to accelerate PPE solutions. Specifically, the framework employs a deep operator network with a U-Net-based branch network. To effectively capture spatially varying resolutions, we propose a multi-level distance vector map construction strategy that computes discrete grid-spacing information corresponding to each hierarchical level of the U-Net. This grid-spacing information is explicitly fused into feature maps prior to convolution operations. Empowered by this grid-spacing-aware architecture, the framework seamlessly extends to simulate flows interacting with solid structures using a decoupled immersed boundary projection method. By training exclusively on fabricated linear systems rather than conventional flow-dependent datasets, the model generalizes effortlessly across diverse immersed obstacle geometries with fixed network weights. Benchmark results demonstrate that the framework significantly outperforms standalone preconditioned conjugate gradient methods and its standard convolution counterpart, underscoring its exceptional potential for real-world computational fluid dynamics applications.

physics.flu-dyn

Baryonic mass budgets in the central regions of the Bullet Cluster and their consistency with strong lensing in MOND

Strong lensing observations of the Bullet Cluster have traditionally been regarded as strong evidence for dark matter and a major challenge to Milgromian dynamics (MOND). The offset between the lensing mass and the X-ray gas centroids implies a substantial amount of unseen mass near the brightest cluster galaxies (BCGs). However, the high metallicities observed in both the intracluster gas and the massive early-type member galaxies suggest a past stellar population dominated by massive stars, whose evolved remnants contribute additional baryonic mass. This effect is naturally incorporated in the integrated galaxy-wide initial mass function (IGIMF) theory, which predicts substantially larger baryonic masses than a canonical IMF. In this work, we re-estimate the baryonic masses of the three BCG-centred core regions of the Bullet Cluster using recent JWST photometry and compare them with MOND strong-lensing masses. We derive IGIMF masses using stellar population synthesis models with constant and (self-) enriched metallicities, representing lower and upper mass limits, respectively. We find that the MOND strong-lensing masses of all three cores lie within the range predicted by the IGIMF models. These results suggest that the baryonic mass budget is consistent with MOND requirements from strong-lensing observations in the core regions of the Bullet Cluster. However, the physical viability of this scenario also depends on the spatial distribution and dynamical behavior of the remnant population, which remain to be established. More generally, regardless of the validity of MOND, the results imply that less dark matter may be required than previously inferred.

astro-ph.GA

Web-CogReasoner: Towards Multimodal Knowledge-Induced Cognitive Reasoning for Web Agents

Multimodal large-scale models have significantly advanced the development of web agents, enabling perception and interaction with digital environments akin to human cognition. In this paper, we argue that web agents must first acquire sufficient knowledge to effectively engage in cognitive reasoning. Therefore, we decompose a web agent's capabilities into two essential stages: knowledge content learning and cognitive processes. To formalize this, we propose Web-CogKnowledge Framework, categorizing knowledge as Factual, Conceptual, and Procedural. In this framework, knowledge content learning corresponds to the agent's processes of Memorizing and Understanding, which rely on the first two knowledge types, representing the "what" of learning. Conversely, cognitive processes correspond to Exploring, grounded in Procedural knowledge, defining the "how" of reasoning and action. To facilitate knowledge acquisition, we construct the Web-CogDataset, a structured resource curated from 14 real-world websites, designed to systematically instill core knowledge necessary for web agent. This dataset serves as the agent's conceptual grounding-the "nouns" upon which comprehension is built-as well as the basis for learning how to reason and act. Building on this foundation, we operationalize these processes through a novel knowledge-driven Chain-of-Thought (CoT) reasoning framework, developing and training our proposed agent, the Web-CogReasoner. Extensive experimentation reveals its significant superiority over existing models, especially in generalizing to unseen tasks where structured knowledge is decisive. To enable rigorous evaluation, we introduce the Web-CogBench, a comprehensive evaluation suite designed to assess and compare agent performance across the delineated knowledge domains and cognitive capabilities. Our code and data is open sourced at https://github.com/Gnonymous/Web-CogReasoner

cs.CL

Testing Frontier Large Language Models' Physics Literacy in Parallel Physical Worlds

Current large-language-model (LLM) physics benchmarks are usually scored by answer accuracy, which cannot distinguish genuine reasoning from recall of familiar problem patterns and reveals little about where a model's reasoning breaks down. We introduce an auditable four-stage diagnostic that evaluates whether an LLM can reason inside an unfamiliar physics framework through induction, formulation, prediction, and review. The diagnostic combines locked pre-registrations, fresh sessions between stages, dual-LLM judging, and a human-audit pathway, and we apply it to three parallel physics worlds: a single-equation counterfactual world ($F=mv$), a historical framework (Aristotelian mechanics), and a four-domain counterfactual world (Decay World). Across Claude Opus 4.7, GPT-5.5, and Gemini 3.1 Pro, the three worlds yield composite PASS rates are 6/15, 6/15, and 0/15 respectively (content $\land$ structural for $F=mv$ and Aristotelian, content axis only for Decay World where the structural axis is out of scope). The most pointed empirical pattern is a qualitative-versus-quantitative asymmetry: in Decay World, models almost never predict the wrong direction of change, but frequently compute the wrong ratio by slipping back to standard-physics relations. The protocol also surfaces two methodology findings: LLM-judge reliability does not transfer across frameworks, and Stage 4 self-review is weak in every framework, with the model's own review wrongly reporting no earlier error in at least two-thirds of the trials that actually contained one. We release the full prompts, responses, verdicts, and audit records.

cs.LG

Hidden critical and Morse equivalence behind duality: Theory and Applications

The aim of this paper is to establish critical duality theory for ratios of nonnegative homogeneous convex functions (shorten for RC functions) and differences of convex functions (abbreviated as DC functions) on Banach spaces. Specifically, we establish a series of duality results on critical point theory and Morse theory for RC functions, including the homotopy type of sublevel sets, the Morse critical points and their Rothe critical groups, Lagrange critical points and their multiplicities, Lusternik-Schnirelman min-max critical values, Poincare polynomials, as well as the structure of handlebody decompositions, all of which are proved to be preserved under polarity dual. Moreover, we obtain the first critical duality theory of DC functions which does not depend on the DC decomposition. This answers a question left open from the work of Toland on DC functions and the work of Le-Pham on DC programming. We apply these results to provide a reformulation of the graph Cheeger constant using zonotopes; we introduce the contact data which serves as a geometric characterization of Lagrange criticality; and we show that the eigenproblems for 1-Laplacian and $\infty$-Laplacian on hypergraphs are equivalent to the contact problems of zonotopes, which indeed establishes a new characterization of zonotopes. We also prove a duality equivalence for certain nonlinear eigenvalue problems and bifurcation problems. Our study here reveals an intricate interaction of critical point theory with other fields such as convex analysis, combinatorial geometry, and nonlinear eigenproblems on graphs.

math.FA

From the discrete to the continuous, from simplicial complexes to Riemannian manifolds. Approximating flows and cuts on manifolds by discrete versions

Many fundamental structures of Riemannian geometry have found discrete counterparts for graphs or combinatorial ones for simplicial complexes. These include those discussed in this survey, Hodge theory, Morse theory, the spectral theory of Laplace type operators and Cheeger inequalities, and their interconnections. This raises the question of the relation between them, abstractly as structural analogies and concretely what happens when a graph constructed from random sampling of a Riemannian manifold or a simplicial complex triangulating such a manifold converge to that manifold. We survey the current state of research, highlighting some recent developments like Cheeger type inequalities for the higher dimensional geometry of simplicial complexes, Floer type constructions in the presence of periodic or homoclinic orbits of dynamical systems or the disorientability of simplicial complexes.

math.DG

OmniPlan: An Adaptive Framework for Timely and Near-Optimal Network Planning Optimization

Network planning optimization is a fundamental problem across diverse domains, including transportation systems, communication networks, and power grids. It requires simultaneous optimization of multiple competing objectives under complex constraints. Existing network planning optimization frameworks rely on mixed integer programming (MIP) solvers, heuristics, and deep reinforcement learning (DRL) models to compute planning decisions. However, they lack effective adaptability to diverse and dynamic user intents, thus leading to the trade-off between execution time and optimality. In this paper, we propose OmniPlan, an adaptive framework that achieves both timeliness and near-optimality in network planning optimization. To achieve the adaptability lacking in existing solutions, OmniPlan employs a large language model (LLM)-based interpreter to convert heterogeneous natural-language intents into a unified and quantifiable user-preference vector. Then it employs a mixture-of-experts architecture that integrates MIP solvers, heuristics, and DRL models as specialized experts, where OmniPlan adapts to diverse intents by dynamically selecting timely and near-optimal experts. Finally, it incorporates a DRL-based expert configuration module that fine-tunes optimization objective weights to align planning decisions with user-specific preferences. We evaluate OmniPlan with a representative real-world workload, i.e., distributed machine learning (ML), where we leverage OmniPlan to offload a wide spectrum of ML inference tasks, e.g., decision trees, SVM, naive Bayes, XGBoost, and random forests, onto a network of hardware devices. Our experiments on a real-world testbed indicate that OmniPlan achieves near-optimal and low-execution-time offloading for real-world ML inference tasks, reducing latency by up to 97.8\% and network device resource consumption by up to 11.5\%.

cs.NI

SetupX: Can LLM Agents Learn from Past Failures in Functionality-Correct Code Repository Setup?

Functionality-correct repository setup aims to configure execution environments (e.g., dependencies, build scripts) to successfully execute a repository's documented features. It presents significant challenges due to diverse, repository-specific failures, including dependency incompatibilities, missing toolchains, incomplete installations, and verification-strategy mismatches. Existing LLM agents struggle to robustly resolve these issues, specifically failing to support (1) cross-repository experience transfer, (2) multi-step trial-and-repair under non-invertible state changes, and (3) robust verification of setup outcomes to distinguish setup-induced failures from repository bugs. To address this, we introduce SetupX, an experiential learning-based setup framework. First, we construct a Self-Evolving Experience Representation (XPU), a dual-modality knowledge unit encoding setup signals, textual guidance, executable actions to dynamically transfer verified environment fixes to unseen repositories. Second, we employ Experience-Augmented Speculative Execution backed by a LIFO Docker snapshot stack, enabling the agent to proactively trial fixes and safely roll back to known-good states. Third, we introduce a Prosecutor-Judge Verification Protocol that separates evidence collection from final judgment, enabling more reliable setup verification beyond superficial build-time metrics. Evaluation results on carefully-crafted benchmarks show SetupX achieves highest performance (e.g., 92% pass rate) and outperforms the strongest baseline by over 19%. Crucially, SetupX excels in complex multi-repository setup requiring coordinating multiple interconnected services across different containers. The code repository is available at https://github.com/OpenDataBox/SetupX.

cs.SE

Sparser Block-Sparse Attention via Token Permutation

Scaling the context length of large language models (LLMs) offers significant benefits but is computationally expensive. This expense stems primarily from the self-attention mechanism, whose $O(N^2)$ complexity with respect to sequence length presents a major bottleneck for both memory and latency. Fortunately, the attention matrix is often sparse, particularly for long sequences, suggesting an opportunity for optimization. Block-sparse attention has emerged as a promising solution that partitions sequences into blocks and skips computation for a subset of these blocks. However, the effectiveness of this method is highly dependent on the underlying attention patterns, which can lead to sub-optimal block-level sparsity. For instance, important key tokens for queries within a single block may be scattered across numerous other blocks, leading to computational redundancy. In this work, we propose Permuted Block-Sparse Attention (\textbf{PBS-Attn}), a plug-and-play method that leverages the permutation properties of attention to increase block-level sparsity and enhance the computational efficiency of LLM prefilling. We conduct comprehensive experiments on challenging real-world long-context datasets, demonstrating that PBS-Attn consistently outperforms existing block-sparse attention methods in model accuracy and closely matches the full attention baseline. Powered by our custom permuted-FlashAttention kernels, PBS-Attn achieves an end-to-end speedup of up to $2.75\times$ in long-context prefilling, confirming its practical viability. Code available at https://github.com/xinghaow99/pbs-attn

cs.CL