arXiv subjects

Yuntian Chen

Publications and source records attributed to Yuntian Chen.

At least 55 records · Page 3Linked to original sources

arXiv2025

Generative Discovery of Partial Differential Equations by Learning from Math Handbooks

Data driven discovery of partial differential equations (PDEs) is a promising approach for uncovering the underlying laws governing complex systems. However, purely data driven techniques face the dilemma of balancing search space with optimization efficiency. This study introduces a knowledge guided approach that incorporates existing PDEs documented in a mathematical handbook to facilitate the discovery process. These PDEs are encoded as sentence like structures composed of operators and basic terms, and used to train a generative model, called EqGPT, which enables the generation of free form PDEs. A loop of generation evaluation optimization is constructed to autonomously identify the most suitable PDE. Experimental results demonstrate that this framework can recover a variety of PDE forms with high accuracy and computational efficiency, particularly in cases involving complex temporal derivatives or intricate spatial terms, which are often beyond the reach of conventional methods. The approach also exhibits generalizability to irregular spatial domains and higher dimensional settings. Notably, it succeeds in discovering a previously unreported PDE governing strongly nonlinear surface gravity waves propagating toward breaking, based on real world experimental data, highlighting its applicability to practical scenarios and its potential to support scientific discovery.

cs.LG↗

arXiv2025

Categorize coalescing quasi-normal modes through far-field scattering patterns

Resonances in the form of quasi-normal modes (QNMs) for open scattering systems can be generally identified in the far field through peaks of scattering spectra (\textit{e.g.} cross sections of scattering, extinction and absorption). Nevertheless, when the resonant frequencies of different QNMs are spectrally overlapped or sufficiently close, the scattering peaks merge and it then becomes extremely challenging to reveal the mode constituents underlying the scattering spectra solely in the far field. Here in this work, we study open systems scattering electromagnetic plane waves, and reveal that spectrally close or even overlapped QNMs can be selectively excited through tuning incident directions and polarizations. Such a far-field technique can be further applied to categorize the nature of degenerate QNMs sharing identical complex eigenfrequencies (coalescent eigenvalues): at effectively Hermitian degeneracies (conical or Dirac points), the eigenvectors are not coalescent and thus the QNMs can still be selectively excited, producing distinct scattering patterns; while for non-Hermitian degeneracies (exceptional points), eigenvectors also coalesce and thus selective QNM excitation does not exist, leading to invariant scattering patterns. Our technique sheds new light on the borderlands of Mie theory, QNMs, non-Hermitian photonics and singular optics, which can empower new explorations and applications and cross-fertilize all those disciplines.

physics.optics↗

arXiv2025

Quasi-normal modes empowered coherent control of electromagnetic interactions

Quasi-normal modes (QNMs) and coherent control of light-matter interactions (through synchronized multiple coherent incident waves) are profound and pervasive concepts in and beyond photonics, making accessible photonic manipulations with extreme precision and efficiency. Though each has been playing essential roles in its own, these two sweeping concepts remain largely segregated with little interactions, blocking vast opportunities of cross-fertilization to explore. Here we unify both concepts into a novel framework of coherent control for light interacting with open photonic systems. From the QNM perspective, scattered waves are superimposed radiations from all QNMs excited, and thus coherent controls can be mapped into another problem of QNM excitation manipulations. Within our framework, all incident properties (amplitudes, phases and polarizations) of waves from different directions can be exploited simultaneously in a synchronous manner, facilitating independent manipulations of each QNM and thus unlocking enormous flexibilities for coherent controls of both scattering intensity and polarization: (i) A visible structure under a single incident wave can be made invisible through shining extra waves; (ii) Along a direction where QNMs' radiation polarizations are identical, scattering along this direction can be fully eliminated, thus generalizing Kerker effects from a distinct QNM perspective; (iii) Along a direction of distinct QNM radiation polarizations, arbitrary scattering polarizations can be obtained. Given the ubiquity and profundity of QNMs and coherent control in almost all branches of wave physics, our framework and its underlying principles will inspire further fundamental explorations and practical applications beyond photonics, opening new opportunities for various forms of wave-matter interactions.

physics.optics↗

arXiv2025

Accelerating Private Large Transformers Inference through Fine-grained Collaborative Computation

Homomorphic encryption (HE) and secret sharing (SS) enable computations on encrypted data, providing significant privacy benefits for large transformer-based models (TBM) in sensitive sectors like medicine and finance. However, private TBM inference incurs significant costs due to the coarse-grained application of HE and SS. We present FASTLMPI, a new approach to accelerate private TBM inference through fine-grained computation optimization. Specifically, through the fine-grained co-design of homomorphic encryption and secret sharing, FASTLMPI achieves efficient protocols for matrix multiplication, SoftMax, LayerNorm, and GeLU. In addition, FASTLMPI introduces a precise segmented approximation technique for differentiable non-linear, improving its fitting accuracy while maintaining a low polynomial degree. Compared to solution BOLT (S&P'24), FASTLMPI shows a remarkable 54% to 64% decrease in runtime and an impressive 72.2% reduction in communication costs.

cs.CR↗

arXiv2024

Revisiting PCA for time series reduction in temporal dimension

Revisiting PCA for Time Series Reduction in Temporal Dimension; Jiaxin Gao, Wenbo Hu, Yuntian Chen; Deep learning has significantly advanced time series analysis (TSA), enabling the extraction of complex patterns for tasks like classification, forecasting, and regression. Although dimensionality reduction has traditionally focused on the variable space-achieving notable success in minimizing data redundancy and computational complexity-less attention has been paid to reducing the temporal dimension. In this study, we revisit Principal Component Analysis (PCA), a classical dimensionality reduction technique, to explore its utility in temporal dimension reduction for time series data. It is generally thought that applying PCA to the temporal dimension would disrupt temporal dependencies, leading to limited exploration in this area. However, our theoretical analysis and extensive experiments demonstrate that applying PCA to sliding series windows not only maintains model performance, but also enhances computational efficiency. In auto-regressive forecasting, the temporal structure is partially preserved through windowing, and PCA is applied within these windows to denoise the time series while retaining their statistical information. By preprocessing time-series data with PCA, we reduce the temporal dimensionality before feeding it into TSA models such as Linear, Transformer, CNN, and RNN architectures. This approach accelerates training and inference and reduces resource consumption. Notably, PCA improves Informer training and inference speed by up to 40% and decreases GPU memory usage of TimesNet by 30%, without sacrificing model accuracy. Comparative analysis against other reduction methods further highlights the effectiveness of PCA in improving the efficiency of TSA models.

cs.LG↗

arXiv2024

Discovering Boundary Equations for Wave Breaking using Machine Learning

Many supervised machine learning methods have revolutionised the empirical modelling of complex systems. These empirical models, however, are usually "black boxes" and provide only limited physical explanations about the underlying systems. Instead, so-called "knowledge discovery" methods can be used to explore the governing equations that describe observed phenomena. This paper focuses on how we can use such methods to explore underlying physics and also model a commonly observed yet not fully understood phenomenon - the breaking of ocean waves. In our work, we use symbolic regression to explore the equation that describes wave-breaking evolution from a dataset of in silico waves generated using expensive numerical methods. Our work discovers a new boundary equation that provides a reduced-order description of how the surface elevation (i.e., the water-air interface) evolves forward in time, including the instances when the wave breaks - a problem that has defied traditional approaches. Compared to the existing empirical models, the unique equation-based nature of our model allows further mathematical interpretation, which provides an opportunity to explore the fundamentals of breaking waves. Further expert-AI collaborative research reveals the physical meaning of each term of the discovered equation, which suggests a new characteristic of breaking waves in deep water - a decoupling between the water-air interface and the fluid velocities. This novel reduced-order model also hints at computationally efficient ways to simulate breaking waves for engineering applications.

physics.flu-dyn↗

arXiv2024

Auto-Regressive Moving Diffusion Models for Time Series Forecasting

Time series forecasting (TSF) is essential in various domains, and recent advancements in diffusion-based TSF models have shown considerable promise. However, these models typically adopt traditional diffusion patterns, treating TSF as a noise-based conditional generation task. This approach neglects the inherent continuous sequential nature of time series, leading to a fundamental misalignment between diffusion mechanisms and the TSF objective, thereby severely impairing performance. To bridge this misalignment, and inspired by the classic Auto-Regressive Moving Average (ARMA) theory, which views time series as continuous sequential progressions evolving from previous data points, we propose a novel Auto-Regressive Moving Diffusion (ARMD) model to first achieve the continuous sequential diffusion-based TSF. Unlike previous methods that start from white Gaussian noise, our model employs chain-based diffusion with priors, accurately modeling the evolution of time series and leveraging intermediate state information to improve forecasting accuracy and stability. Specifically, our approach reinterprets the diffusion process by considering future series as the initial state and historical series as the final state, with intermediate series generated using a sliding-based technique during the forward process. This design aligns the diffusion model's sampling procedure with the forecasting objective, resulting in an unconditional, continuous sequential diffusion TSF model. Extensive experiments conducted on seven widely used datasets demonstrate that our model achieves state-of-the-art performance, significantly outperforming existing diffusion-based TSF models. Our code is available on GitHub: https://github.com/daxin007/ARMD.

cs.LG↗

arXiv2024

Numerical approximation of slowlingly varying envelope in finite element electromagnetism: a ray-wave method of modeling multi-scale devices

In this work we propose an efficient and accurate multi-scale optical simulation algorithm by applying a numerical version of slowly varying envelope approximation in FEM. Specifically, we employ the fast iterative method to quickly compute the phase distribution of the electric field within the computational domain and construct a novel multi-scale basis function that combines the conventional polynomial basis function together with numerically resolved phase information of optical waves. Utilizing this multi-scale basis function, the finite element method can significantly reduce the degrees of freedom required for the solution while maintaining computational accuracy, thereby improving computational efficiency. Without loss of generality, we illustrate our approach via simulating the examples of lens groups and gradient-index lenses, accompanied with performance benchmark against the standard finite element method. The results demonstrate that the proposed method achieves consistent results with the standard finite element method but with a computational speed improved by an order of magnitude.

physics.optics↗

arXiv2024

Open-Vocabulary Remote Sensing Image Semantic Segmentation

Open-vocabulary image semantic segmentation (OVS) seeks to segment images into semantic regions across an open set of categories. Existing OVS methods commonly depend on foundational vision-language models and utilize similarity computation to tackle OVS tasks. However, these approaches are predominantly tailored to natural images and struggle with the unique characteristics of remote sensing images, such as rapidly changing orientations and significant scale variations. These challenges complicate OVS tasks in earth vision, requiring specialized approaches. To tackle this dilemma, we propose the first OVS framework specifically designed for remote sensing imagery, drawing inspiration from the distinct remote sensing traits. Particularly, to address the varying orientations, we introduce a rotation-aggregative similarity computation module that generates orientation-adaptive similarity maps as initial semantic maps. These maps are subsequently refined at both spatial and categorical levels to produce more accurate semantic maps. Additionally, to manage significant scale changes, we integrate multi-scale image features into the upsampling process, resulting in the final scale-aware semantic masks. To advance OVS in earth vision and encourage reproducible research, we establish the first open-sourced OVS benchmark for remote sensing imagery, including four public remote sensing datasets. Extensive experiments on this benchmark demonstrate our proposed method achieves state-of-the-art performance. All codes and datasets are available at https://github.com/caoql98/OVRS.

cs.CV↗

arXiv2024

Efficient finite element modeling of photonic modal analysis augmented by combined symmetry

In this work, we present an efficient numerical implementation of the finite element method for modal analysis that leverages various symmetry operations, including spatial symmetry in point groups and space-time symmetry in pseudo-Hermiticity systems. We provide a formal and rigorous treatment, specifically deriving the boundary constraint conditions corresponding to symmetry constraints. Without loss of generality, we illustrate our approach via computing the modes of optical waveguides with complex cross-sections, accompanied with performance benchmark against the standard finite element method. The obtained results demonstrate excellent agreement between our method and standard FEM with significantly improved computational efficiency. Specifically, the calculation speed increased by a factor of $23$ in the hollow-core fiber. Furthermore, our method directly classifies and computes the modes based on symmetry, facilitating the modal analysis of complex waveguides.

physics.optics↗

arXiv2024

Amplified Light Beam Cooling via Emergent Onsager's Irreversible Thermodynamics

High-brightness coherent light source is at the heart of optical technology and yet challenging to achieve. Here, we propose an unconventional approach that utilizes the "forbidden chemical" in optical thermodynamics to convert any incoming light beam into a high-brightness, high-spatial-coherence light beam in multimode nonlinear optical waveguide systems, in contrast to evaporative cooling in cold atoms where the brightness is instead reduced. This approach is powered by the fact that light in nonlinear multimode structures undergoes an irreversible thermalization process triggered by its own photon-photon interactions. Moreover, the key characteristics in statistical mechanics, the optical temperature and chemical potential can be widely tuned in photonic systems. As such, when the chemical potential of an optical reservoir is designed to locate at the forbidden band of the probe bosonic system, it can never reach thermal equilibrium with the probe hence endlessly pumping the probe system towards an enhanced brightness and spatial coherence. This amplified cooling of light beam is revealed via both Onsager's irreversible thermodynamics theory and numerical simulations. Akin to this effect, the inverse photonic transport currents emerge due to the negative off-diagonal Onsager coefficients. We demonstrate the feasibility of the amplified beam cooling using a coupled multimode optical waveguide system and show that after 800 rounds of amplified cooling, the optical power of an incoming beam is enhanced by 16 times, meanwhile the fundamental mode occupancy is increased to 90%. These findings unveil an anomalous optical phenomenon and a new route toward high-quality light sources.

physics.optics↗

arXiv2024

Discovery of Green's function based on symbolic regression with physical hard constraints

The Green's function, serving as a kernel function that delineates the interaction relationships of physical quantities within a field, holds significant research implications across various disciplines. It forms the foundational basis for the renowned Biot-Savart formula in fluid dynamics, the theoretical solution of the pressure Poisson equation, and et al. Despite their importance, the theoretical derivation of the Green's function is both time-consuming and labor-intensive. In this study, we employed DISCOVER, an advanced symbolic regression method leveraging symbolic binary trees and reinforcement learning, to identify unknown Green's functions for several elementary partial differential operators, including Laplace operators, Helmholtz operators, and second-order differential operators with jump conditions. The Laplace and Helmholtz operators are particularly vital for resolving the pressure Poisson equation, while second-order differential operators with jump conditions are essential for analyzing multiphase flows and shock waves. By incorporating physical hard constraints, specifically symmetry properties inherent to these self-adjoint operators, we significantly enhanced the performance of the DISCOVER framework, potentially doubling its efficacy. Notably, the Green's functions discovered for the Laplace and Helmholtz operators precisely matched the true Green's functions. Furthermore, for operators without known exact Green's functions, such as the periodic Helmholtz operator and second-order differential operators with jump conditions, we identified potential Green's functions with solution error on the order of 10^(-10). This application of symbolic regression to the discovery of Green's functions represents a pivotal advancement in leveraging artificial intelligence to accelerate scientific discoveries, particularly in fluid dynamics and related fields.

physics.comp-ph↗

arXiv2024

AutoPV: Automatically Design Your Photovoltaic Power Forecasting Model

Photovoltaic power forecasting (PVPF) is a critical area in time series forecasting (TSF), enabling the efficient utilization of solar energy. With advancements in machine learning and deep learning, various models have been applied to PVPF tasks. However, constructing an optimal predictive architecture for specific PVPF tasks remains challenging, as it requires cross-domain knowledge and significant labor costs. To address this challenge, we introduce AutoPV, a novel framework for the automated search and construction of PVPF models based on neural architecture search (NAS) technology. We develop a brand new NAS search space that incorporates various data processing techniques from state-of-the-art (SOTA) TSF models and typical PVPF deep learning models. The effectiveness of AutoPV is evaluated on diverse PVPF tasks using a dataset from the Daqing Photovoltaic Station in China. Experimental results demonstrate that AutoPV can complete the predictive architecture construction process in a relatively short time, and the newly constructed architecture is superior to SOTA predefined models. This work bridges the gap in applying NAS to TSF problems, assisting non-experts and industries in automatically designing effective PVPF models.

cs.LG↗

arXiv2024

LLM4ED: Large Language Models for Automatic Equation Discovery

Equation discovery is aimed at directly extracting physical laws from data and has emerged as a pivotal research domain. Previous methods based on symbolic mathematics have achieved substantial advancements, but often require the design of implementation of complex algorithms. In this paper, we introduce a new framework that utilizes natural language-based prompts to guide large language models (LLMs) in automatically mining governing equations from data. Specifically, we first utilize the generation capability of LLMs to generate diverse equations in string form, and then evaluate the generated equations based on observations. In the optimization phase, we propose two alternately iterated strategies to optimize generated equations collaboratively. The first strategy is to take LLMs as a black-box optimizer and achieve equation self-improvement based on historical samples and their performance. The second strategy is to instruct LLMs to perform evolutionary operators for global search. Experiments are extensively conducted on both partial differential equations and ordinary differential equations. Results demonstrate that our framework can discover effective equations to reveal the underlying physical laws under various nonlinear dynamic systems. Further comparisons are made with state-of-the-art models, demonstrating good stability and usability. Our framework substantially lowers the barriers to learning and applying equation discovery techniques, demonstrating the application potential of LLMs in the field of knowledge discovery.

cs.LG↗

arXiv2024

Optimization of geological carbon storage operations with multimodal latent dynamic model and deep reinforcement learning

Maximizing storage performance in geological carbon storage (GCS) is crucial for commercial deployment, but traditional optimization demands resource-intensive simulations, posing computational challenges. This study introduces the multimodal latent dynamic (MLD) model, a deep learning framework for fast flow prediction and well control optimization in GCS. The MLD model includes a representation module for compressed latent representations, a transition module for system state evolution, and a prediction module for flow responses. A novel training strategy combining regression loss and joint-embedding consistency loss enhances temporal consistency and multi-step prediction accuracy. Unlike existing models, the MLD supports diverse input modalities, allowing comprehensive data interactions. The MLD model, resembling a Markov decision process (MDP), can train deep reinforcement learning agents, specifically using the soft actor-critic (SAC) algorithm, to maximize net present value (NPV) through continuous interactions. The approach outperforms traditional methods, achieving the highest NPV while reducing computational resources by over 60%. It also demonstrates strong generalization performance, providing improved decisions for new scenarios based on knowledge from previous ones.

cs.LG↗

arXiv2024

When Swarm Learning meets energy series data: A decentralized collaborative learning design based on blockchain

Machine learning models offer the capability to forecast future energy production or consumption and infer essential unknown variables from existing data. However, legal and policy constraints within specific energy sectors render the data sensitive, presenting technical hurdles in utilizing data from diverse sources. Therefore, we propose adopting a Swarm Learning (SL) scheme, which replaces the centralized server with a blockchain-based distributed network to address the security and privacy issues inherent in Federated Learning (FL)'s centralized architecture. Within this distributed Collaborative Learning framework, each participating organization governs nodes for inter-organizational communication. Devices from various organizations utilize smart contracts for parameter uploading and retrieval. Consensus mechanism ensures distributed consistency throughout the learning process, guarantees the transparent trustworthiness and immutability of parameters on-chain. The efficacy of the proposed framework is substantiated across three real-world energy series modeling scenarios with superior performance compared to Local Learning approaches, simultaneously emphasizing enhanced data security and privacy over Centralized Learning and FL method. Notably, as the number of data volume and the count of local epochs increases within a threshold, there is an improvement in model performance accompanied by a reduction in the variance of performance errors. Consequently, this leads to an increased stability and reliability in the outcomes produced by the model.

cs.LG↗

arXiv2024

Cross-variable Linear Integrated ENhanced Transformer for Photovoltaic power forecasting

Photovoltaic (PV) power forecasting plays a crucial role in optimizing the operation and planning of PV systems, thereby enabling efficient energy management and grid integration. However, un certainties caused by fluctuating weather conditions and complex interactions between different variables pose significant challenges to accurate PV power forecasting. In this study, we propose PV-Client (Cross-variable Linear Integrated ENhanced Transformer for Photovoltaic power forecasting) to address these challenges and enhance PV power forecasting accuracy. PV-Client employs an ENhanced Transformer module to capture complex interactions of various features in PV systems, and utilizes a linear module to learn trend information in PV power. Diverging from conventional time series-based Transformer models that use cross-time Attention to learn dependencies between different time steps, the Enhanced Transformer module integrates cross-variable Attention to capture dependencies between PV power and weather factors. Furthermore, PV-Client streamlines the embedding and position encoding layers by replacing the Decoder module with a projection layer. Experimental results on three real-world PV power datasets affirm PV-Client's state-of-the-art (SOTA) performance in PV power forecasting. Specifically, PV-Client surpasses the second-best model GRU by 5.3% in MSE metrics and 0.9% in accuracy metrics at the Jingang Station. Similarly, PV-Client outperforms the second-best model SVR by 10.1% in MSE metrics and 0.2% in accuracy metrics at the Xinqingnian Station, and PV-Client exhibits superior performance compared to the second-best model SVR with enhancements of 3.4% in MSE metrics and 0.9% in accuracy metrics at the Hongxing Station.

cs.LG↗

arXiv2024

A Noise-robust Multi-head Attention Mechanism for Formation Resistivity Prediction: Frequency Aware LSTM

The prediction of formation resistivity plays a crucial role in the evaluation of oil and gas reservoirs, identification and assessment of geothermal energy resources, groundwater detection and monitoring, and carbon capture and storage. However, traditional well logging techniques fail to measure accurate resistivity in cased boreholes, and the transient electromagnetic method for cased borehole resistivity logging encounters challenges of high-frequency disaster (the problem of inadequate learning by neural networks in high-frequency features) and noise interference, badly affecting accuracy. To address these challenges, frequency-aware framework and temporal anti-noise block are proposed to build frequency aware LSTM (FAL). The frequency-aware framework implements a dual-stream structure through wavelet transformation, allowing the neural network to simultaneously handle high-frequency and low-frequency flows of time-series data, thus avoiding high-frequency disaster. The temporal anti-noise block integrates multiple attention mechanisms and soft-threshold attention mechanisms, enabling the model to better distinguish noise from redundant features. Ablation experiments demonstrate that the frequency-aware framework and temporal anti-noise block contribute significantly to performance improvement. FAL achieves a 24.3% improvement in R2 over LSTM, reaching the highest value of 0.91 among all models. In robustness experiments, the impact of noise on FAL is approximately 1/8 of the baseline, confirming the noise resistance of FAL. The proposed FAL effectively reduces noise interference in predicting formation resistivity from cased transient electromagnetic well logging curves, better learns high-frequency features, and thereby enhances the prediction accuracy and noise resistance of the neural network model.

cs.LG↗