arXiv Science⌕ Search

arXiv subjects

Zhiwei Fan

Publications and source records attributed to Zhiwei Fan.

At least 19 recordsLinked to original sources

Data-driven reconstruction of band dispersion and quantum geometry via Koopman dynamic mode decomposition

We present a data-driven framework for reconstructing band structures using Koopman operator analysis and dynamic mode decomposition (Koopman-DMD). Instead of deriving spectra from an explicit Hamiltonian, the approach reconstructs band dispersion and modal dynamics directly from spatiotemporal data, including wavefunctions and observables. This framework establishes a correspondence between Hamiltonian Floquet-Bloch decomposition and Koopman-DMD, whereby the extracted DMD modes encode frequencies, decay or growth rates, spatial profiles and projection weights. These quantities allow the reconstruction of spectral functions, local density of states, and delocalized-to-localized measures such as the inverse participation ratio. Also, these extended DMD modes enable inference of quantum-geometric and topological properties, including the quantum metric, Berry curvature and geometric phases. Applications to prototypical one- and two-dimensional tight-binding models, including disordered Su-Schrieffer-Heeger model and its Floquet and non-Hermitian variants, graphene and Haldane models, demonstrate that Koopman-DMD provides a unified route for the data-driven analysis of wave propagation, localization, and topological phases in condensed matter, photonics, and related fields.

physics.comp-ph↗

Vortex solitons in spin-orbit-coupled atomic-molecular condensates

In our previous study of a three-dimensional (3D) atomic-molecular Bose-Einstein condensate (BEC) with quadratic nonlinearity and spin-orbit coupling (SOC), stable solitons are realized as semi-vortex (SV) or mixed-mode (MM) states, with SOC applied solely to the atomic component. In the SV state, the molecular part forms a pure vortex, while the atomic part remains a hybrid of fundamental and vortex modes. This prevents the overall self-bound state from achieving a fully pure vortex configuration, with the total vortex component always less than $100\%$. Here, we extend the study to two dimensions (2D) and uncover a qualitatively different behavior: purely quadratic 2D systems support not only ground-state (GS) SV solitons, but also higher-order excited-state (ES) solitons that are genuine full vortices (a feature absent in the 3D counterpart). For both GS and ES solitons, stable vortex states exist only when the SOC strength $λ$ exceeds a minimum threshold $λ_{\min}$, which increases monotonically with $S_1$. Conversely, the critical detuning $α_c$ decreases monotonically with $S_1$, indicating that higher-order vortices are more susceptible to destabilization. For $λ< λ_{\min}$, the system forms MM states instead of vortex solitons. Our results demonstrate that dimensional reduction to 2D enables the emergence of pure-vortex excited states, establishing a new pathway for stabilizing high-charge topological excitations in ultracold molecular gases.

cond-mat.quant-gas↗

Fine-Grained Anomaly Perception in Wild UGC-Enhanced Images: A Comprehensive Dataset and Difference-Fusion Framework

Image enhancement and restoration have become standard back-end operations on short-video and social media platforms to boost UGC visual experience. Yet these processes inevitably introduce visual anomalies--especially in faces, texts, and textures--that directly undermine perceptual fidelity and viewer trust. While existing IQA methods perform well on classic distortions, they target holistic quality assessment and fail to capture the specific, localized anomalies caused by enhancement algorithms in real-world UGC. To bridge this gap, we formally define a new task-quality Anomaly Perception for UGC image Enhancement (UEAP), and contribute the first UEAP benchmark dataset, named UEAP-4k, curated from the real business scenarios. It provides fine-grained annotations for anomaly categories, localization and severity levels. Furthermore, we propose a Difference-Fusion Anomaly Perception Method (DFAP-UGC) for wild UGC-enhanced images, which leverages explicit problem-reference difference fusion with dense spatial querying, regional verification, and quality-aware ranking, enabling robust anomaly identification in challenging scenarios. To handle the inherent coupling of subtasks in this new task, we propose a Locality-Aware Dynamic Task Prioritization (LADTP) training strategy that enables effective end-to-end learning and eliminates multi-stage overhead. Extensive experiments show that our method outperforms baselines adapted from classical approaches for this task, validating the value of this dataset and the superior of DFAP-UGC for robust UGC-enhanced image anomaly perception. Code and data will be public.

cs.CV↗

Multi-Head Residual-Gated DeepONet for Coherent Nonlinear Wave Dynamics

Coherent nonlinear wave dynamics are often strongly shaped by a compact set of physically meaningful descriptors of the initial state. Traditional neural operators typically treat the input-output mapping as a largely black-box high-dimensional regression problem, without explicitly exploiting this structured physical context. Common feature-integration strategies usually rely on direct concatenation or FiLM-style affine modulation in hidden latent spaces. Here we introduce a different paradigm, loosely inspired by the complementary roles of state evolution and physically meaningful observables in quantum mechanics: the wave field is learned through a standard DeepONet state pathway, while compact physical descriptors follow a parallel conditioning pathway and act as residual modulation factors on the state prediction. Based on this idea, we develop a Multi-Head Residual-Gated DeepONet (MH-RG), which combines a pre-branch residual modulator, a branch residual gate, and a trunk residual gate with a low-rank multi-head mechanism to capture multiple complementary conditioned response patterns without prohibitive parameter growth. We evaluate the framework on representative benchmarks including highly nonlinear conservative wave dynamics and dissipative trapped dynamics and further perform detailed mechanistic analyses of the learned multi-head gating behavior. Compared with feature-augmented baselines, MH-RG DeepONet achieves consistently lower error while better preserving phase coherence and the fidelity of physically relevant dynamical quantities.

cs.LG↗

CACTUSDB: Unlock Co-Optimization Opportunities for SQL and AI/ML Inferences

There is a growing demand for supporting inference queries that combine Structured Query Language (SQL) and Artificial Intelligence / Machine Learning (AI/ML) model inferences in database systems, to avoid data denormalization and transfer, facilitate management, and alleviate privacy concerns. Co-optimization techniques for executing inference queries in database systems without accuracy loss fall into four categories: (O1) Relational algebra optimization treating AI/ML models as black-box user-defined functions (UDFs); (O2) Factorized AI/ML inferences; (O3) Tensor-relational transformation; and (O4) General cross-optimization techniques. However, we found none of the existing database systems support all these techniques simultaneously, resulting in suboptimal performance. In this work, we identify two key challenges to address the above problem: (1) the difficulty of unifying all co-optimization techniques that involve disparate data and computation abstractions in one system; and (2) the lack of an optimizer that can effectively explore the exponential search space. To address these challenges, we present CactusDB, a novel system built atop Velox - a high-performance, UDF-centric database engine, open-sourced by Meta. CactusDB features a three-level Intermediate Representations (IR) that supports relational operators, expression operators, and ML functions to enable flexible optimization of arbitrary sub-computations. Additionally, we propose a novel Monte-Carlo Tree Search (MCTS)-based optimizer with query embedding, co-designed with our unique three-level IR, enabling shared and reusable optimization knowledge across different queries. Evaluation of 12 representative inference workloads and 2,000 randomly generated inference queries on well-known datasets, such as MovieLens and TPCx-AI, shows that CactusDB achieves up to 441 times speedup compared to alternative systems.

cs.DB↗

FlowLog: Efficient and Extensible Datalog via Incrementality

Datalog-based languages are regaining popularity as a powerful abstraction for expressing recursive computations in domains such as program analysis and graph processing. However, existing systems often face a trade-off between efficiency and extensibility. Engines like Souffle achieve high efficiency through domain-specific designs, but lack general-purpose flexibility. Others, like RecStep, offer modularity by layering Datalog on traditional databases, but struggle to integrate Datalog-specific optimizations. This paper bridges this gap by presenting FlowLog, a new Datalog engine that uses an explicit relational IR per-rule to cleanly separate recursive control (e.g., semi-naive execution) from each rule's logical plan. This boundary lets us retain fine-grained, Datalog-aware optimizations at the logical layer, but also reuse off-the-shelf database primitives at execution. At the logical level (i.e. IR), we apply proven SQL optimizations, such as logic fusion and subplan reuse. To address high volatility in recursive workloads, we adopt a robustness-first approach that pairs a structural optimizer (avoiding worst-case joins) with sideways information passing (early filtering). Built atop Differential Dataflow--a mature framework for streaming analytics--FlowLog supports both batch and incremental Datalog and adds novel recursion-aware optimizations called Boolean (or algebraic) specialization. Our evaluation shows that FlowLog outperforms state-of-the-art Datalog engines and modern databases across a broad range of recursive workloads, achieving superior scalability while preserving a simple and extensible architecture.

cs.DB↗

DeLoad: Demand-Driven Short-Video Preloading with Scalable Watch-Time Estimation

Short video streaming has become a dominant paradigm in digital media, characterized by rapid swiping interactions and diverse media content. A key technical challenge is designing an effective preloading strategy that dynamically selects and prioritizes download tasks from an evolving playlist, balancing Quality of Experience (QoE) and bandwidth efficiency under practical commercial constraints. However, real world analysis reveals critical limitations of existing approaches: (1) insufficient adaptation of download task sizes to dynamic conditions, and (2) watch time prediction models that are difficult to deploy reliably at scale. In this paper, we propose DeLoad, a novel preloading framework that addresses these issues by introducing dynamic task sizing and a practical, multi dimensional watch time estimation method. Additionally, a Deep Reinforcement Learning (DRL) enhanced agent is trained to optimize the download range decisions adaptively. Extensive evaluations conducted on an offline testing platform, leveraging massive real world network data, demonstrate that DeLoad achieves significant improvements in QoE metrics (34.4% to 87.4% gain). Furthermore, after deployment on a large scale commercial short video platform, DeLoad has increased overall user watch time by 0.09% while simultaneously reducing rebuffering events and 3.76% bandwidth consumption.

cs.MM↗

PIRA: Pan-CDN Intra-video Resource Adaptation for Short Video Streaming

In large scale short video platforms, CDN resource selection plays a critical role in maintaining Quality of Experience (QoE) while controlling escalating traffic costs. To better understand this phenomenon, we conduct in the wild network measurements during video playback in a production short video system. The results reveal that CDNs delivering higher average QoE often come at greater financial cost, yet their connection quality fluctuates even within a single video underscoring a fundamental and dynamic trade off between QoE and cost. However, the problem of sustaining high QoE under cost constraints remains insufficiently investigated in the context of CDN selection for short video streaming. To address this, we propose PIRA, a dynamic resource selection algorithm that optimizes QoE and cost in real time during video playback. PIRA formally integrating QoE and cost by a mathematical model, and introduce a intra video control theoretic CDN resource selection approach which can balance QoE and cost under network dynamics. To reduce the computation overheads, PIRA employs state space pruning and adaptive parameter adjustment to efficiently solve the high dimensional optimization problem. In large scale production experiments involving 450,000 users over two weeks, PIRA outperforms the production baseline, achieving a 2.1% reduction in start up delay, 15.2% shorter rebuffering time, and 10% lower average unit traffic cost, demonstrating its effectiveness in balancing user experience and financial cost at scale.

cs.MM↗

Unleashing the power of computational insights in revealing the complexity of biological systems in the new era of spatial multi-omics

Recent advances in spatial omics technologies have revolutionized our ability to study biological systems with unprecedented resolution. By preserving the spatial context of molecular measurements, these methods enable comprehensive mapping of cellular heterogeneity, tissue architecture, and dynamic biological processes in developmental biology, neuroscience, oncology, and evolutionary studies. This review highlights a systematic overview of the continuous advancements in both technology and computational algorithms that are paving the way for a deeper, more systematic comprehension of the structure and mechanisms of mammalian tissues and organs by using spatial multi-omics. Our viewpoint demonstrates how advanced machine learning algorithms and multi-omics integrative modeling can decode complex biological processes, including the spatial organization and topological relationships of cells during organ development, as well as key molecular signatures and regulatory networks underlying tumorigenesis and metastasis. Finally, we outline future directions for technological innovation and modeling insights of spatial omics in precision medicine.

q-bio.QM↗

A Multi-Layered Framework for Modeling Human Biology: From Basic AI Agents to a Full-Body AI Agent

We envision the Full-Body AI Agent as a comprehensive AI system designed to simulate, analyze, and optimize the dynamic processes of the human body across multiple biological levels. By integrating computational models, machine learning tools, and experimental platforms, this system aims to replicate and predict both physiological and pathological processes, ranging from molecules and cells to tissues, organs, and entire body systems. Central to the Full-Body AI Agent is its emphasis on integration and coordination across these biological levels, enabling analysis of how molecular changes influence cellular behaviors, tissue responses, organ function, and systemic outcomes. With a focus on biological functionality, the system is designed to advance the understanding of disease mechanisms, support the development of therapeutic interventions, and enhance personalized medicine. We propose two specialized implementations to demonstrate the utility of this framework: (1) the metastasis AI Agent, a multi-scale metastasis scoring system that characterizes tumor progression across the initiation, dissemination, and colonization phases by integrating molecular, cellular, and systemic signals; and (2) the drug AI Agent, a system-level drug development paradigm in which a drug AI-Agent dynamically guides preclinical evaluations, including organoids and chip-based models, by providing full-body physiological constraints. This approach enables the predictive modeling of long-term efficacy and toxicity beyond what localized models alone can achieve. These two agents illustrate the potential of Full-Body AI Agent to address complex biomedical challenges through multi-level integration and cross-scale reasoning.

q-bio.TO↗

Chiral solitons in quadratic quasi-phase-matched photonic crystals

We introduce a quasi-phase-matched technique in quadratic nonlinear crystals, constructing an artificial gauge field by changing the inclination angle of stripes, which is realized by the positive and negative polarization directions of nonlinear susceptibility along the crystal. Unlike the artificial gauge field constructed through linear coupling in other settings, the gauge field in this system is realized by nonlinear coupling. We demonstrate that this gauge field can generate stable chiral solitons with chiral energy flow rotating around the solitons. In contrast to conventional chiral currents generated with the same specie or frequency, the chiral currents in the present system are formed by mutual coupling between fundamental frequency and second harmonic components. We derive the semi-analytical solution for the chiral energy flow in this system. It is found that there exists an optimal inclination angle that can maximize the chiral energy flow under different parameters, and this optimal inclination shows a positive correlation with the power and detuning. The mobility and collisions of the chiral solitons are also discussed. The results show that chiral solitons move in response to kicking and undergo fully elastic collisions with each other. In addition, the possibility of experimentally generating chiral solitons and chiral currents is outlined.

physics.optics↗

Event Soliton Formation in Mixed Energy-Momentum Gaps of Nonlinear Spacetime Crystals

We report the formation of a novel soliton, termed event soliton, in nonlinear photonic spacetime crystals (STCs). In these media, simultaneous spatiotemporal periodic modulation of the dielectric constant generates mixed frequency ($ω$) and wavevector (k) gaps. Under Kerr nonlinearity, the event solitons emerge as fully localized entities in both spacetime and energy-momentum domains, providing a tangible demonstration of the concept of event in relativity. The $ω$k-gap mixture arises from the coexistence and competition between time reflected and Bragg reflected waves due to the spatiotemporal modulation. We propose a new partial differential equation to capture various spatiotemporal patterns and present numerical simulations to validate our theoretical predictions, reflecting a three-way balance among k-gap opening, $ω$-gap opening, and nonlinearity. Our work opens avenues for fundamental studies and fosters experimental prospects for implementing spacetime crystals in both time-varying photonics and periodically driven condensed matter systems.

physics.optics↗

Personalized Playback Technology: How Short Video Services Create Excellent User Experience

Short-form video content has become increasingly popular and influential in recent years. Its concise yet engaging format aligns well with todays' fast-paced and on-the-go lifestyles, making it a dominating trend in the digital world. As one of the front runners in the short video platform space, ByteDance has been highly successful in delivering a one-of-a-kind short video experience and attracting billions of users worldwide. One key contributing factor is its advanced end-to-end personalized short video playback technology, where we pioneered and developed the new technical field over the past five years to optimize user experience. This paper introduces the major concepts and methodologies of this personalized video playback technology that distinguish it from traditional multimedia technologies. More details, including goal setting, iterative process, modeling, experimental methods and required supporting systems, are also provided to encourage deeper research in this area.

cs.MM↗

Naive Bayes Classifiers over Missing Data: Decision and Poisoning

We study the certifiable robustness of ML classifiers on dirty datasets that could contain missing values. A test point is certifiably robust for an ML classifier if the classifier returns the same prediction for that test point, regardless of which cleaned version (among exponentially many) of the dirty dataset the classifier is trained on. In this paper, we show theoretically that for Naive Bayes Classifiers (NBC) over dirty datasets with missing values: (i) there exists an efficient polynomial time algorithm to decide whether multiple input test points are all certifiably robust over a dirty dataset; and (ii) the data poisoning attack, which aims to make all input test points certifiably non-robust by inserting missing cells to the clean dataset, is in polynomial time for single test points but NP-complete for multiple test points. Extensive experiments demonstrate that our algorithms are efficient and outperform existing baselines.

cs.LG↗

LinCQA: Faster Consistent Query Answering with Linear Time Guarantees

Most data analytical pipelines often encounter the problem of querying inconsistent data that violate pre-determined integrity constraints. Data cleaning is an extensively studied paradigm that singles out a consistent repair of the inconsistent data. Consistent query answering (CQA) is an alternative approach to data cleaning that asks for all tuples guaranteed to be returned by a given query on all (in most cases, exponentially many) repairs of the inconsistent data. This paper identifies a class of acyclic select-project-join (SPJ) queries for which CQA can be solved via SQL rewriting with a linear time guarantee. Our rewriting method can be viewed as a generalization of Yannakakis's algorithm for acyclic joins to the inconsistent setting. We present LinCQA, a system that can output rewritings in both SQL and non-recursive Datalog rules for every query in this class. We show that LinCQA often outperforms the existing CQA systems on both synthetic and real-world workloads, and in some cases, by orders of magnitude.

cs.DB↗

Mid-infrared frequency combs and staggered spectral patterns in $χ^{(2)}$ microresonators

The potential of frequency comb spectroscopy has aroused great interest in generating mid-infrared frequency combs in the integrated photonic setting. However, despite remarkable progress in microresonators and quantum cascade lasers, the availability of suitable mid-IR comb sources remains scarce. Here, we present a new approach for the generation of mid-IR microcombs through cascaded three-wave-mixing. By pumping a CdSiP$_2$ microresonator at 1.55 $μ$m wavelength with a low power continuous wave laser, we generate $χ^{(2)}$ frequency combs at 3.1 $μ$m wavelength, with a span of about 30 nm. We observe ordinary combs states with a line spacing of the free spectral range of the resonator, and combs where the sideband numbers around the pump and half-harmonic alternate, forming staggered patterns of spectral lines. Our scheme for mid-IR microcomb generation is compatible with integrated telecom lasers. Therefore, it has the potential to be used as a simple and fully integrated mid-IR comb source, relying on only one single material.

physics.optics↗

Controlling microresonator solitons with the counter-propagating pump

Considering a bidirectionally pumped ring microresonator, we provide a concise derivation of the model equations allowing us to eliminate the repetition rate terms and reduce the nonlinear interaction between the counter-propagating waves to the power-dependent shifts of the resonance frequencies. We present the simulation results of the soliton control by swiping the frequency of the counter-propagating wave in the forward and backward directions and with the soliton-blockade effect either present or not. We highlight the non-reciprocity of the forward and backward scans. Furthermore, we report the soliton crystals and breathers existing in the vicinity of the blockade interval.

physics.optics↗

Soliton blockade in bidirectional microresonators

We report a method to control - disrupt and restore, a regime of the unidirectional soliton generation in a bidirectionally pumped ring microresonator. This control, i.e., the soliton blockade, is achieved by tuning pump frequency of the counterrotating field. The blockade effect is correlated with the emergence of a dark-bright nonlinear resonance of the cw-states.

physics.optics↗