arXiv subjects

Ke Zhang

Publications and source records attributed to Ke Zhang.

At least 109 records · Page 6Linked to original sources

arXiv2025

Multi-Component Open/Relative/Local Correspondence

For a toric Calabi-Yau 3-orbifold relative to s Aganagic-Vafa outer branes, we prove a correspondence among the genus-zero open Gromov-Witten invariants with maximal winding at each brane and: (i) closed invariants of a toric Calabi-Yau (3+s)-orbifold; (ii) formal relative invariants of a formal toric Calabi-Yau (FTCY) 3-orbifold with maximal tangency to s divisors; (iii) formal relative invariants of a sequence of FTCY intermediate geometries interpolating dimensions 3 and 3+s. The correspondence provides examples of the log/local principle of van Garrel-Graber-Ruddat in the multi-component setting and the refined conjecture of Brini-Bousseau-van Garrel via intermediate geometries. It also establishes the multi-component case of the open/closed correspondence proposed by Lerche-Mayr and studied by Liu-Yu. As an application, we obtain examples of the conjecture of Klemm-Pandharipande on the integrality of BPS invariants of higher-dimensional toric Calabi-Yau manifolds. Along the way, we set the basic stages of the relative Gromov-Witten theory of higher-dimensional FTCY orbifolds, generalizing the case of smooth 3-folds by Li-Liu-Liu-Zhou.

math.AG↗

arXiv2025

Endless World: Real-Time 3D-Aware Long Video Generation

Producing long, coherent video sequences with stable 3D structure remains a major challenge, particularly in streaming scenarios. Motivated by this, we introduce Endless World, a real-time framework for infinite, 3D-consistent video generation.To support infinite video generation, we introduce a conditional autoregressive training strategy that aligns newly generated content with existing video frames. This design preserves long-range dependencies while remaining computationally efficient, enabling real-time inference on a single GPU without additional training overhead.Moreover, our Endless World integrates global 3D-aware attention to provide continuous geometric guidance across time. Our 3D injection mechanism enforces physical plausibility and geometric consistency throughout extended sequences, addressing key challenges in long-horizon and dynamic scene synthesis.Extensive experiments demonstrate that Endless World produces long, stable, and visually coherent videos, achieving competitive or superior performance to existing methods in both visual fidelity and spatial consistency. Our project has been available on https://bwgzk-keke.github.io/EndlessWorld/.

cs.CV↗

arXiv2025

CDKFormer: Contextual Deviation Knowledge-Based Transformer for Long-Tail Trajectory Prediction

Predicting the future movements of surrounding vehicles is essential for ensuring the safe operation and efficient navigation of autonomous vehicles (AVs) in urban traffic environments. Existing vehicle trajectory prediction methods primarily focus on improving overall performance, yet they struggle to address long-tail scenarios effectively. This limitation often leads to poor predictions in rare cases, significantly increasing the risk of safety incidents. Taking Argoverse 2 motion forecasting dataset as an example, we first investigate the long-tail characteristics in trajectory samples from two perspectives, individual motion and group interaction, and deriving deviation features to distinguish abnormal from regular scenarios. On this basis, we propose CDKFormer, a Contextual Deviation Knowledge-based Transformer model for long-tail trajectory prediction. CDKFormer integrates an attention-based scene context fusion module to encode spatiotemporal interaction and road topology. An additional deviation feature fusion module is proposed to capture the dynamic deviations in the target vehicle status. We further introduce a dual query-based decoder, supported by a multi-stream decoder block, to sequentially decode heterogeneous scene deviation features and generate multimodal trajectory predictions. Extensive experiments demonstrate that CDKFormer achieves state-of-the-art performance, significantly enhancing prediction accuracy and robustness for long-tailed trajectories compared to existing methods, thus advancing the reliability of AVs in complex real-world environments.

cs.RO↗

arXiv2025

Tool-RoCo: An Agent-as-Tool Self-organization Large Language Model Benchmark in Multi-robot Cooperation

This study proposes Tool-RoCo, a novel benchmark for evaluating large language models (LLMs) in long-term multi-agent cooperation based on RoCo, a multi-robot cooperative benchmark. Recent research on LLM-based multi-agent systems has relied on predefined orchestration, while ignoring agent autonomy. Tool-RoCo treats other agents as tools and introduces cooperative tools, leveraging tool usage to evaluate multi-agent cooperation and self-organization. Tool usage means that each agent (LLM) selects a tool from a candidate set based on the current state, receives feedback, and adjusts its selection in subsequent rounds. To evaluate different autonomy levels, we propose four LLM paradigms: (1) centralized cooperation, where a single LLM allocates tools to all agents; (2) centralized self-organization, where a central LLM autonomously activates agents while keeping others inactive; (3) decentralized cooperation, where each agent has its own LLM and calls tools based on local information; and (4) self-organization, where a randomly chosen initial agent can request collaboration, activating additional agents via tool calls. Tool-RoCo includes three multi-robot tasks, SORT, PACK, and CABINET, to measure format and parameter accuracy and agent coordination through tool usage. The results using several LLMs showed that cooperative tools accounted for only 7.09% of all tools, indicating that LLM-based agents rarely invoked others as assistants. Moreover, activation tools accounted for 96.42%, suggesting that current LLMs tend to maintain active agents while seldom deactivating them for adaptive coordination. Tool-RoCo provides a systematic benchmark to evaluate LLM autonomy and cooperation in multi-agent tasks. Code and Demo: https://github.com/ColaZhang22/Tool-Roco

cs.MA↗

arXiv2025

OOCO: Latency-disaggregated Architecture for Online-Offline Co-locate LLM Serving

Large Language Models (LLMs) are increasingly deployed in both latency-sensitive online services and cost-sensitive offline workloads. Co-locating these workloads on shared serving instances can improve resource utilization, but directly applying this approach to Prefill/Decode (P/D) disaggregated systems introduces severe load imbalance, as fluctuating request mixes alter the intrinsic P/D ratio. Existing dynamic adjustment techniques cannot keep up with the bursty traffic patterns of online services. We propose a latency-constraint disaggregated architecture, which separates cluster resources into latency-strict and latency-relaxed pools based on task latency requirements. This design enables flexible placement of offline decode tasks, mitigating P/D imbalance while preserving online performance. To fully exploit this flexibility, we propose (1) a bottleneck-based scheduler guided by a Roofline-based performance model for performance bottleneck based scheduling, and (2) a fast preemption mechanism that strictly enforces Service Level Objectives (SLOs) for online requests. Experiments on real-world traces show that compared to existing offline system approaches, our method improves offline throughput by up to 3x, while maintaining online request SLOs.

cs.DC↗

arXiv2025

A Survey on Speech Large Language Models for Understanding

Speech understanding is essential for interpreting the diverse forms of information embedded in spoken language, including linguistic, paralinguistic, and non-linguistic cues that are vital for effective human-computer interaction. The rapid advancement of large language models (LLMs) has catalyzed the emergence of Speech Large Language Models (Speech LLMs), which marks a transformative shift toward general-purpose speech understanding systems. To further clarify and systematically delineate task objectives, in this paper, we formally define the concept of speech understanding and introduce a structured taxonomy encompassing its informational, functional, and format dimensions. Within this scope of definition, we present a comprehensive review of current Speech LLMs, analyzing their architectures through a three-stage abstraction: Modality Feature Extraction, Modality Information Fusion, and LLM Inference. In addition, we examine training strategies, discuss representative datasets, and review evaluation methodologies adopted in the field. Based on empirical analyses and experimental evidence, we identify two key challenges currently facing Speech LLMs: instruction sensitivity and degradation in semantic reasoning and propose concrete directions for addressing these issues. Through this systematic and detailed survey, we aim to offer a foundational reference for researchers and practitioners working toward more robust, generalizable, and human-aligned Speech LLMs.

eess.AS↗

arXiv2025

A Submillimeter Survey of CS Excitation in Protoplanetary Disks: Evidence of X-ray-Driven Sulfur Chemistry

The sulfur chemistry in protoplanetary disks influences the properties of nascent planets, including potential habitability. Although the inventory of sulfur molecules in disks has gradually increased over the last decade, CS is still the most commonly-observed sulfur-bearing species and it is expected to be the dominant gas-phase sulfur carrier beyond the water snowline. Despite this, few dedicated multi-line observations exist, and thus the typical disk CS chemistry is not well constrained. Moreover, it is unclear how that chemistry - and in turn, the bulk volatile sulfur reservoir - varies with stellar and disk properties. Here, we present the largest survey of CS to date, combining both new and archival observations from ALMA, SMA, and NOEMA of 12 planet-forming disks, covering a range of stellar spectral types and dust morphologies. Using these data, we derived disk-integrated CS gas excitation conditions in each source. Overall, CS chemistry appears similar across our sample with rotational temperatures of ${\approx}$10-40 K and column densities between 10$^{12}$-10$^{13}$ cm$^{-2}$. CS column densities do not show strong trends with most source properties, which broadly suggests that CS chemistry is not highly sensitive to disk structure or stellar characteristics. We do, however, identify a positive correlation between stellar X-ray luminosity and CS column density, which indicates that the dominant CS formation pathway is likely via ion-neutral reactions in the upper disk layers, where X-ray-enhanced S$^+$ and C$^+$ drive abundant CS production. Thus, using CS as a tracer of gas-phase sulfur abundance requires a nuanced approach that accounts for its emitting region and dependence on X-ray luminosity.

astro-ph.EP↗

arXiv2025

HydraInfer: Hybrid Disaggregated Scheduling for Multimodal Large Language Model Serving

Multimodal Large Language Models (MLLMs) have been rapidly advancing, enabling cross-modal understanding and generation, and propelling artificial intelligence towards artificial general intelligence. However, existing MLLM inference systems are typically designed based on the architecture of language models, integrating image processing and language processing as a single scheduling unit. This design struggles to accommodate the heterogeneous demands of different stages in terms of computational resources, memory access patterns, and service-level objectives (SLOs), leading to low resource utilization and high request latency, ultimately failing to meet the service requirements of diverse inference scenarios. To address these challenges, we propose HydraInfer, an efficient MLLM inference system that adopts a Hybrid Encode-Prefill-Decode (EPD) Disaggregation architecture. By scheduling the three stages - encode, prefill, and decode - onto separate heterogeneous inference instances, the system flexibly reallocates resources across stages, significantly reducing idle computation, alleviating resource bottlenecks, and improving overall system throughput and scalability. In addition, HydraInfer supports a stage-level batching strategy that enhances load balancing, enables parallel execution of visual and language models, and further optimizes inference performance. Experiments under real multimodal inference workloads demonstrate that HydraInfer can achieve up to 4x higher inference throughput compared to state-of-the-art systems (e.g., vLLM) on a single-node 8xH800 GPU cluster, while meeting the 90th percentile request SLO.

cs.DC↗

arXiv2025

Searching for Exoplanets Born Outside the Milky Way: VOYAGERS Survey Design

Observations over the past few decades have found that planets are common around nearby stars in our Galaxy, but little is known about planets that formed outside the Milky Way. We describe the design and early implementation of a survey to test whether planets also exist orbiting the remnant stars of ancient dwarf galaxies that merged with the Milky Way, and if so, how they differ from their Milky Way counterparts. VOYAGERS (Views Of Yore - Ancient Gaia-enceladus Exoplanet Revealing Survey) is a radial velocity (RV) search using precision spectrographs to discover exoplanets orbiting very low metallicity ($-2.8 < [\mathrm{Fe/H}] \leq -0.8$) stars born in the dwarf galaxy Enceladus, which merged with the Milky Way galaxy about 10 Gyr ago. A sample of 22 candidates have been screened from a catalog of Gaia-Enceladus-Sausage (GES) members using a combination of stellar properties and reconnaissance observations from the TRES spectrograph. Precision RV measurements have been initiated using the NEID, HARPS-N, and CARMENES spectrographs. We plan to focus most upcoming observations on 10 main sequence targets. Data collection is well underway, with 778 observations on 22 candidates (385 of which are 10 focus targets), but far from complete. This survey is designed to be sensitive to sub-Neptune mass planets with periods up to hundreds of days. We note that the RV analysis gives mass multiplied by $\sin (inclination)$ or the minimum mass for exoplanets. The expected survey yield is three planets, assuming that occurrence rates are similar to those in the Milky Way and taking into account the degeneracy with inclination in our yield models. Our survey is designed to detect at least one exoplanet if occurrence rates are similar to known Milky Way exoplanets or, if no exoplanets are discovered, to rule out a Milky Way-like planet population in GES with 95% confidence level.

astro-ph.EP↗

arXiv2025

Arrow: Adaptive Scheduling Mechanisms for Disaggregated LLM Inference Architecture

Existing large language model (LLM) serving systems typically employ Prefill-Decode disaggregated architecture to prevent computational interference between the prefill and decode phases. However, in real-world LLM serving scenarios, significant fluctuations in request input/output lengths lead to imbalanced computational loads between prefill and decode nodes under traditional static node allocation strategies, consequently preventing efficient utilization of computing resources to improve the system's goodput. To address this challenge, we design and implement Arrow, an adaptive scheduler that leverages stateless instances and latency characteristics of prefill and decode tasks to achieve efficient adaptive request and instance scheduling. Arrow dynamically adjusts the number of instances handling prefill and decode tasks based on real-time cluster performance metrics, substantially enhancing the system's capability to handle traffic spikes and load variations. Our evaluation under diverse real-world workloads shows that Arrow achieves up to $2.55 \times$ higher request serving rates compared to state-of-the-art Prefill-Decode disaggregated serving systems.

cs.DC↗

arXiv2025

LIFT: Interpretable truck driving risk prediction with literature-informed fine-tuned LLMs

This study proposes an interpretable prediction framework with literature-informed fine-tuned (LIFT) LLMs for truck driving risk prediction. The framework integrates an LLM-driven Inference Core that predicts and explains truck driving risk, a Literature Processing Pipeline that filters and summarizes domain-specific literature into a literature knowledge base, and a Result Evaluator that evaluates the prediction performance as well as the interpretability of the LIFT LLM. After fine-tuning on a real-world truck driving risk dataset, the LIFT LLM achieved accurate risk prediction, outperforming benchmark models by 26.7% in recall and 10.1% in F1-score. Furthermore, guided by the literature knowledge base automatically constructed from 299 domain papers, the LIFT LLM produced variable importance ranking consistent with that derived from the benchmark model, while demonstrating robustness in interpretation results to various data sampling conditions. The LIFT LLM also identified potential risky scenarios by detecting key combination of variables in truck driving risk, which were verified by PERMANOVA tests. Finally, we demonstrated the contribution of the literature knowledge base and the fine-tuning process in the interpretability of the LIFT LLM, and discussed the potential of the LIFT LLM in data-driven knowledge discovery.

cs.AI↗

arXiv2025

Quantification of Electrolyte Degradation in Lithium-ion Batteries with Neutron Imaging Techniques

Non-destructive characterization of lithium-ion batteries provides critical insights for optimizing performance and lifespan while preserving structural integrity. Optimizing electrolyte design in commercial LIBs requires consideration of composition, electrolyte-to-capacity ratio, spatial distribution, and associated degradation pathways. However, existing non-destructive methods for studying electrolyte infiltration, distribution, and degradation in LIBs lack the spatiotemporal resolution required for precise observation and quantification of the electrolyte. In this study, we employ neutron imaging with sufficient spatial resolution ~150 um and large field of view 20x20 cm2 to quantitatively resolve the electrolyte inventory and distribution within LiFePO4/graphite pouch cells under high-temperature accelerated aging. Quantitative standard curves based on neutron transmission attenuation reveal a clear electrolyte dry-out threshold at 3.18 g Ah-1 and the two stages evolutions of EI during cell aging were quantified. By integrating non-destructive electrochemical diagnostics, accelerated graphite material loss and liquid phase Li+ diffusion degradation is observed during pore-drying. Further analysis, including operando cyclic aging, reveals that the neutron transmission below the saturation reference is due to the enrichment of hydrogen nuclei within the solid-electrolyte interphase. Assumed pore-drying does not occur, the SEI signal of the electrodes can be quantitatively decoupled during ageing. Combined analyses with NI, TOF-SIMS, and SEM reveal that high EI cells exhibit uniform SEI growth and reduced degradation, while low EI cells show uneven SEI formation, accelerating capacity loss. This study unveils a dynamic electrolyte infiltration-consumption-dry-out process in LIBs, offering non-destructive and quantitative insights to guide sustainable and durable battery development.

physics.app-ph↗

arXiv2025

Think Before You Diffuse: Infusing Physical Rules into Video Diffusion

Recent video diffusion models have demonstrated their great capability in generating visually-pleasing results, while synthesizing the correct physical effects in generated videos remains challenging. The complexity of real-world motions, interactions, and dynamics introduce great difficulties when learning physics from data. In this work, we propose DiffPhy, a generic framework that enables physically-correct and photo-realistic video generation by fine-tuning a pre-trained video diffusion model. Our method leverages large language models (LLMs) to infer rich physical context from the text prompt. To incorporate this context into the video diffusion model, we use a multimodal large language model (MLLM) to verify intermediate latent variables against the inferred physical rules, guiding the gradient updates of model accordingly. Textual output of LLM is transformed into continuous signals. We then formulate a set of training objectives that jointly ensure physical accuracy and semantic alignment with the input text. Additionally, failure facts of physical phenomena are corrected via attention injection. We also establish a high-quality physical video dataset containing diverse phyiscal actions and events to facilitate effective finetuning. Extensive experiments on public benchmarks demonstrate that DiffPhy is able to produce state-of-the-art results across diverse physics-related scenarios. Our project page is available at https://bwgzk-keke.github.io/DiffPhy/.

cs.CV↗

arXiv2025

FreeViS: Training-free Video Stylization with Inconsistent References

Video stylization plays a key role in content creation, but it remains a challenging problem. Naïvely applying image stylization frame-by-frame hurts temporal consistency and reduces style richness. Alternatively, training a dedicated video stylization model typically requires paired video data and is computationally expensive. In this paper, we propose FreeViS, a training-free video stylization framework that generates stylized videos with rich style details and strong temporal coherence. Our method integrates multiple stylized references to a pretrained image-to-video (I2V) model, effectively mitigating the propagation errors observed in prior works, without introducing flickers and stutters. In addition, it leverages high-frequency compensation to constrain the content layout and motion, together with flow-based motion cues to preserve style textures in low-saliency regions. Through extensive evaluations, FreeViS delivers higher stylization fidelity and superior temporal consistency, outperforming recent baselines and achieving strong human preference. Our training-free pipeline offers a practical and economic solution for high-quality, temporally coherent video stylization. The code and videos can be accessed via https://xujiacong.github.io/FreeViS/

cs.CV↗

arXiv2025

Observational Constraints on Evolution of Dust Disc Properties in Upper Scorpius

Protoplanetary discs in the Upper Scorpius star-forming region are excellent laboratories to investigate late stages of planet formation. In this work, we analyse the morphology of the dust continuum emission of 121 discs from an ALMA Band 7 survey of the Upper Scorpius region. This analysis is done in the visibility plane, to measure the flux, geometry and characterise potential structures. We compare the results with state-of-the art gas and dust evolution models that include external photoevaporation, with mild values of the $F_{\rm{UV}}$ of 1-40$G_0$. From the visibility analysis, 52 of the 121 discs are resolved (43%). From the resolved discs, 24 discs have structures and 28 remain as smooth discs at the mean resolution scale of $\sim$0.1$^{\prime \prime}$ (~14au). Our results show no significant dust disc size evolution of the surviving discs in UpperSco when compared to discs in younger star-forming regions, such as Lupus. We find a strong, steeper-than-previously-reported correlation between dust disc size and disc millimeter continuum luminosity, in agreement with drift-dominated dust evolution models. We also find positive correlations between the dust disc mass vs. stellar mass and dust disc size vs. stellar mass. The slope of the dust disc size vs. stellar mass relationship is steeper compared to younger star forming regions. Additionally, we observe no significant correlation between dust disc properties and the environmental $F_{\rm{UV}}$, consistent with models predicting that dust disc properties are primarily shaped by drift and dust traps. Our models predict that gas disc masses and sizes should be highly affected by the moderate $F_{\rm{UV}}$ values that Upper Scorpius discs experience in contrast to the dust, highlighting the need for deeper and higher-resolution gas observations of these discs exposed to mild external photoevaporation.

astro-ph.EP↗

arXiv2025

Symphony: A Decentralized Multi-Agent Framework for Scalable Collective Intelligence

Most existing Large Language Model (LLM)-based agent frameworks rely on centralized orchestration, incurring high deployment costs, rigid communication topologies, and limited adaptability. To address these challenges, we introduce Symphony, a decentralized multi-agent system which enables lightweight LLMs on consumer-grade GPUs to coordinate. Symphony introduces three key mechanisms: (1) a decentralized ledger that records capabilities, (2) a Beacon-selection protocol for dynamic task allocation, and (3) weighted result voting based on CoTs. This design forms a privacy-saving, scalable, and fault-tolerant orchestration with low overhead. Empirically, Symphony outperforms existing baselines on reasoning benchmarks, achieving substantial accuracy gains and demonstrating robustness across models of varying capacities.

cs.LG↗

arXiv2025

OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations

Open-vocabulary (OV) 3D object detection is an emerging field, yet its exploration through image-based methods remains limited compared to 3D point cloud-based methods. We introduce OpenM3D, a novel open-vocabulary multi-view indoor 3D object detector trained without human annotations. In particular, OpenM3D is a single-stage detector adapting the 2D-induced voxel features from the ImGeoNet model. To support OV, it is jointly trained with a class-agnostic 3D localization loss requiring high-quality 3D pseudo boxes and a voxel-semantic alignment loss requiring diverse pre-trained CLIP features. We follow the training setting of OV-3DET where posed RGB-D images are given but no human annotations of 3D boxes or classes are available. We propose a 3D Pseudo Box Generation method using a graph embedding technique that combines 2D segments into coherent 3D structures. Our pseudo-boxes achieve higher precision and recall than other methods, including the method proposed in OV-3DET. We further sample diverse CLIP features from 2D segments associated with each coherent 3D structure to align with the corresponding voxel feature. The key to training a highly accurate single-stage detector requires both losses to be learned toward high-quality targets. At inference, OpenM3D, a highly efficient detector, requires only multi-view images for input and demonstrates superior accuracy and speed (0.3 sec. per scene) on ScanNet200 and ARKitScenes indoor benchmarks compared to existing methods. We outperform a strong two-stage method that leverages our class-agnostic detector with a ViT CLIP-based OV classifier and a baseline incorporating multi-view depth estimator on both accuracy and speed.

cs.CV↗

arXiv2025

Interpolating Speaker Identities in Embedding Space for Data Expansion

The success of deep learning-based speaker verification systems is largely attributed to access to large-scale and diverse speaker identity data. However, collecting data from more identities is expensive, challenging, and often limited by privacy concerns. To address this limitation, we propose INSIDE (Interpolating Speaker Identities in Embedding Space), a novel data expansion method that synthesizes new speaker identities by interpolating between existing speaker embeddings. Specifically, we select pairs of nearby speaker embeddings from a pretrained speaker embedding space and compute intermediate embeddings using spherical linear interpolation. These interpolated embeddings are then fed to a text-to-speech system to generate corresponding speech waveforms. The resulting data is combined with the original dataset to train downstream models. Experiments show that models trained with INSIDE-expanded data outperform those trained only on real data, achieving 3.06\% to 5.24\% relative improvements. While INSIDE is primarily designed for speaker verification, we also validate its effectiveness on gender classification, where it yields a 13.44\% relative improvement. Moreover, INSIDE is compatible with other augmentation techniques and can serve as a flexible, scalable addition to existing training pipelines.

eess.AS↗