arXiv subjects

Benjamin Schäfer

Publications and source records attributed to Benjamin Schäfer.

At least 37 records · Page 2Linked to original sources

arXiv2025

Real-E: A Foundation Benchmark for Advancing Robust and Generalizable Electricity Forecasting

Energy forecasting is vital for grid reliability and operational efficiency. Although recent advances in time series forecasting have led to progress, existing benchmarks remain limited in spatial and temporal scope and lack multi-energy features. This raises concerns about their reliability and applicability in real-world deployment. To address this, we present the Real-E dataset, covering over 74 power stations across 30+ European countries over a 10-year span with rich metadata. Using Real- E, we conduct an extensive data analysis and benchmark over 20 baselines across various model types. We introduce a new metric to quantify shifts in correlation structures and show that existing methods struggle on our dataset, which exhibits more complex and non-stationary correlation dynamics. Our findings highlight key limitations of current methods and offer a strong empirical basis for building more robust forecasting models

cs.LG↗

arXiv2025

BUILDA: A Thermal Building Data Generation Framework for Transfer Learning

Transfer learning (TL) can improve data-driven modeling of building thermal dynamics. Therefore, many new TL research areas emerge in the field, such as selecting the right source model for TL. However, these research directions require massive amounts of thermal building data which is lacking presently. Neither public datasets nor existing data generators meet the needs of TL research in terms of data quality and quantity. Moreover, existing data generation approaches typically require expert knowledge in building simulation. We present BuilDa, a thermal building data generation framework for producing synthetic data of adequate quality and quantity for TL research. The framework does not require profound building simulation knowledge to generate large volumes of data. BuilDa uses a single-zone Modelica model that is exported as a Functional Mock-up Unit (FMU) and simulated in Python. We demonstrate BuilDa by generating data and utilizing it for pretraining and fine-tuning TL models.

cs.LG↗

arXiv2025

Learning the Frequency Dynamics of the Power System Using Higher-order Dynamic Mode Decomposition

The increasing penetration of renewable energy sources, characterised by low inertia and intermittent disturbances, presents substantial challenges to power system stability. As critical indicators of system stability, frequency dynamics and associated oscillatory phenomena have attracted significant research attention. While existing studies predominantly employ linearized models, our findings demonstrate that linear approximations exhibit considerable errors when predicting frequency oscillation dynamics across multiple time scales, thus necessitating the incorporation of nonlinear characteristics. This paper proposes a data-driven approach based on higher-order dynamical mode decomposition (HODMD) for learning frequency dynamics. The proposed method offers distinct advantages over alternative nonlinear methods, including no prior knowledge required, adaptability to high-dimensional systems, and robust performance. Furthermore, HODMD demonstrates superior capability in capturing system-wide spatio-temporal modes, successfully identifying modal behaviour that remains undetectable through standard Dynamic Mode Decomposition techniques. The efficacy of the proposed methodology is validated through comprehensive case studies on both IEEE 14-bus and WECC systems.

eess.SY↗

arXiv2025

Analyzing Spatio-Temporal Dynamics of Dissolved Oxygen for the River Thames using Superstatistical Methods and Machine Learning

By employing superstatistical methods and machine learning, we analyze time series data of water quality indicators for the River Thames, with a specific focus on the dynamics of dissolved oxygen. After detrending, the probability density functions of dissolved oxygen fluctuations exhibit heavy tails that are effectively modeled using $q$-Gaussian distributions. Our findings indicate that the multiplicative Empirical Mode Decomposition method stands out as the most effective detrending technique, yielding the highest log-likelihood in nearly all fittings. We also observe that the optimally fitted width parameter of the $q$-Gaussian shows a negative correlation with the distance to the sea, highlighting the influence of geographical factors on water quality dynamics. In the context of same-time prediction of dissolved oxygen, regression analysis incorporating various water quality indicators and temporal features identify the Light Gradient Boosting Machine as the best model. SHapley Additive exPlanations reveal that temperature, pH, and time of year play crucial roles in the predictions. Furthermore, we use the Transformer to forecast dissolved oxygen concentrations. For long-term forecasting, the Informer model consistently delivers superior performance, achieving the lowest MAE and SMAPE with the 192 historical time steps that we used. This performance is attributed to the Informer's ProbSparse self-attention mechanism, which allows it to capture long-range dependencies in time-series data more effectively than other machine learning models. It effectively recognizes the half-life cycle of dissolved oxygen, with particular attention to key intervals. Our findings provide valuable insights for policymakers involved in ecological health assessments, aiding in accurate predictions of river water quality and the maintenance of healthy aquatic ecosystems.

cs.LG↗

arXiv2024

Spatial analysis of tails of air pollution PDFs in Europe

Outdoor air pollution is estimated to cause a huge number of premature deaths worldwide, it catalyses many diseases on a variety of time scales, and it has a detrimental effect on the environment. In light of these impacts it is necessary to obtain a better understanding of the dynamics and statistics of measured air pollution concentrations, including temporal fluctuations of observed concentrations and spatial heterogeneities. Here we present an extensive analysis for measured data from Europe. The observed probability density functions (PDFs) of air pollution concentrations depend very much on the spatial location and on the pollutant substance. We analyse a large number of time series data from 3544 different European monitoring sites and show that the PDFs of nitric oxide ($NO$), nitrogen dioxide ($NO_{2}$) and particulate matter ($PM_{10}$ and $PM_{2.5}$) concentrations generically exhibit heavy tails. These are asymptotically well approximated by $q$-exponential distributions with a given entropic index $q$ and width parameter $λ$. We observe that the power-law parameter $q$ and the width parameter $λ$ vary widely for the different spatial locations. We present the results of our data analysis in the form of a map that shows which parameters $q$ and $λ$ are most relevant in a given region. A variety of interesting spatial patterns is observed that correlate to properties of the geographical region. We also present results on typical time scales associated with the dynamical behaviour.

physics.ao-ph↗

arXiv2024

Why Reinforcement Learning in Energy Systems Needs Explanations

With economic development, the complexity of infrastructure has increased drastically. Similarly, with the shift from fossil fuels to renewable sources of energy, there is a dire need for such systems that not only predict and forecast with accuracy but also help in understanding the process of predictions. Artificial intelligence and machine learning techniques have helped in finding out wellperforming solutions to different problems in the energy sector. However, the usage of state-of-the-art techniques like reinforcement learning is not surprisingly convincing. This paper discusses the application of reinforcement techniques in energy systems and how explanations of these models can be helpful

cs.AI↗

arXiv2023

An Explainable Framework for Machine learning-Based Reactive Power Optimization of Distribution Network

To reduce the heavy computational burden of reactive power optimization of distribution networks, machine learning models are receiving increasing attention. However, most machine learning models (e.g., neural networks) are usually considered as black boxes, making it challenging for power system operators to identify and comprehend potential biases or errors in the decision-making process of machine learning models. To address this issue, an explainable machine-learning framework is proposed to optimize the reactive power in distribution networks. Firstly, a Shapley additive explanation framework is presented to measure the contribution of each input feature to the solution of reactive power optimizations generated from machine learning models. Secondly, a model-agnostic approximation method is developed to estimate Shapley values, so as to avoid the heavy computational burden associated with direct calculations of Shapley values. The simulation results show that the proposed explainable framework can accurately explain the solution of the machine learning model-based reactive power optimization by using visual analytics, from both global and instance perspectives. Moreover, the proposed explainable framework is model-agnostic, and thus applicable to various models (e.g., neural networks).

eess.SY↗

arXiv2023

Probabilistic Forecasting of Day-Ahead Electricity Prices and their Volatility with LSTMs

Accurate forecasts of electricity prices are crucial for the management of electric power systems and the development of smart applications. European electricity prices have risen substantially and became highly volatile after the Russian invasion of Ukraine, challenging established forecasting methods. Here, we present a Long Short-Term Memory (LSTM) model for the German-Luxembourg day-ahead electricity prices addressing these challenges. The recurrent structure of the LSTM allows the model to adapt to trends, while the joint prediction of both mean and standard deviation enables a probabilistic prediction. Using a physics-inspired approach - superstatistics - to derive an explanation for the statistics of prices, we show that the LSTM model faithfully reproduces both prices and their volatility.

cs.LG↗

arXiv2023

Non-linear, bivariate stochastic modelling of power-grid frequency applied to islands

Mitigating climate change requires a transition away from fossil fuels towards renewable energy. As a result, power generation becomes more volatile and options for microgrids and islanded power-grid operation are being broadly discussed. Therefore, studying the power grids of physical islands, as a model for islanded microgrids, is of particular interest when it comes to enhancing our understanding of power-grid stability. In the present paper, we investigate the statistical properties of the power-grid frequency of three island systems: Iceland, Ireland, and the Balearic Islands. We utilise a Fokker-Planck approach to construct stochastic differential equations that describe market activities, control, and noise acting on power-grid dynamics. Using the obtained parameters we create synthetic time series of the frequency dynamics. Our main contribution is to propose two extensions of stochastic power-grid frequency models and showcase the applicability of these new models to non-Gaussian statistics, as encountered in islands.

physics.data-an↗

arXiv2023

Transformer Training Strategies for Forecasting Multiple Load Time Series

In the smart grid of the future, accurate load forecasts on the level of individual clients can help to balance supply and demand locally and to prevent grid outages. While the number of monitored clients will increase with the ongoing smart meter rollout, the amount of data per client will always be limited. We evaluate whether a Transformer load forecasting model benefits from a transfer learning strategy, where a global univariate model is trained on the load time series from multiple clients. In experiments with two datasets containing load time series from several hundred clients, we find that the global training strategy is superior to the multivariate and local training strategies used in related work. On average, the global training strategy results in 21.8% and 12.8% lower forecasting errors than the two other strategies, measured across forecasting horizons from one day to one month into the future. A comparison to linear models, multi-layer perceptrons and LSTMs shows that Transformers are effective for load forecasting when they are trained with the global training strategy.

cs.LG↗

arXiv2023

Regulatory Changes in Power Systems Explored with Explainable Artificial Intelligence

A stable supply of electrical energy is essential for the functioning of our society. Therefore, the electrical power grid's operation and energy and balancing markets are subject to strict regulations. As the external technical, economic, or social influences on the power grid change, these regulations must also be constantly adapted. However, whether these regulatory changes lead to the intended results is not easy to assess. Could eXplainable Artificial Intelligence (XAI) models distinguish regulatory settings and support the understanding of the effects of these changes? In this article, we explore two examples of regulatory changes in the German energy markets for bulk electricity and for reserve power. We explore the splitting of the German-Austrian bidding zone and changes in the pricing schemes of the German balancing energy market. We find that boosted tree models and feedforward neural networks before and after a regulatory change differ in their respective parametrizations. Using Shapley additive explanations, we reveal model differences, e.g. in terms of feature importances, and identify key features of these distinct models. With this study, we demonstrate how XAI can be applied to investigate system changes in power systems.

eess.SY↗

arXiv2023

Local versus global stability in dynamical systems with consecutive Hopf-Bifurcations

Quantifying the stability of an equilibrium is central in the theory of dynamical systems as well as in engineering and control. A comprehensive picture must include the response to both small and large perturbations, leading to the concepts of local (linear) and global stability. Here, we show how systems displaying Hopf bifurcations show contrarian results on these two aspects of stability: Global stability is large close to the point where the system loses its local stability altogether. We demonstrate this effect for an elementary model system, an anharmonic oscillator and a realistic model of power system dynamics with delayed control. Detailed investigations of the bifurcation explain the seeming paradox in terms of the location of the attractors relative to the equilibrium.

nlin.AO↗

arXiv2023

Predicting the power grid frequency of European islands

Modelling, forecasting and overall understanding of the dynamics of the power grid and its frequency are essential for the safe operation of existing and future power grids. Much previous research was focused on large continental areas, while small systems, such as islands are less well-studied. These natural island systems are ideal testing environments for microgrid proposals and artificially islanded grid operation. In the present paper, we utilize measurements of the power grid frequency obtained in European islands: the Faroe Islands, Ireland, the Balearic Islands and Iceland and investigate how their frequency can be predicted, compared to the Nordic power system, acting as a reference. The Balearic islands are found to be particularly deterministic and easy to predict in contrast to hard-to-predict Iceland. Furthermore, we show that typically 2-4 weeks of data are needed to improve prediction performance beyond simple benchmarks.

stat.AP↗

arXiv2022

Initial analysis of the impact of the Ukrainian power grid synchronization with Continental Europe

When Russia invaded Ukraine on the 24\textsuperscript{th} of February 2022, this led to many acts of solidarity with Ukraine, including support for its electricity system. Just 20 days after the invasion started, the Ukrainian and Moldovan power grids were synchronized to the Continental European power grid to provide stability to these grids. Here, we present an initial analysis of how this synchronization affected the statistics of the power grid frequency and cross-border flows of electric power within Continental Europe. We observe faster inter-area oscillations, an increase in fluctuations and changes in the cross-border flows in and out of Ukraine and surrounding countries as an effect of the synchronization with Continental Europe. Overall these changes are small such that the now connected system can be considered as stable as before the synchronization.

physics.soc-ph↗

arXiv2022

Understanding electricity prices beyond the merit order principle using explainable AI

Electricity prices in liberalized markets are determined by the supply and demand for electric power, which are in turn driven by various external influences that vary strongly in time. In perfect competition, the merit order principle describes that dispatchable power plants enter the market in the order of their marginal costs to meet the residual load, i.e. the difference of load and renewable generation. Many market models implement this principle to predict electricity prices but typically require certain assumptions and simplifications. In this article, we present an explainable machine learning model for the prices on the German day-ahead market, which substantially outperforms a benchmark model based on the merit order principle. Our model is designed for the ex-post analysis of prices and thus builds on various external features. Using Shapley Additive exPlanation (SHAP) values, we can disentangle the role of the different features and quantify their importance from empiric data. Load, wind and solar generation are most important, as expected, but wind power appears to affect prices stronger than solar power does. Fuel prices also rank highly and show nontrivial dependencies, including strong interactions with other features revealed by a SHAP interaction analysis. Large generation ramps are correlated with high prices, again with strong feature interactions, due to the limited flexibility of nuclear and lignite plants. Our results further contribute to model development by providing quantitative insights directly from data.

cs.LG↗

arXiv2022

Physics-inspired machine learning for power grid frequency modelling

The operation of power systems is affected by diverse technical, economic and social factors. Social behaviour determines load patterns, electricity markets regulate the generation and weather-dependent renewables introduce power fluctuations. Thus, power system dynamics must be regarded as a non-autonomous system whose parameters vary strongly with time. However, the external driving factors are usually only available on coarse scales and the actual dependencies of the dynamic system parameters are generally unknown. Here, we propose a physics-inspired machine learning model that bridges the gap between large-scale drivers and short-term dynamics of the power system. Integrating stochastic differential equations and artificial neural networks, we construct a probabilistic model of the power grid frequency dynamics in Continental Europe. Its probabilistic prediction outperforms the daily average profile, which is an important benchmark. Using the integrated model, we identify and explain the parameters of the dynamical system from the data, which reveals their strong time-dependence and their relation to external drivers such as wind power feed-in and fast generation ramps. Finally, we generate synthetic time series from the model, which successfully reproduce central characteristics of the grid frequency such as their heavy-tailed distribution. All in all, our work emphasises the importance of modelling power system dynamics as a stochastic non-autonomous system with both intrinsic dynamics and external drivers.

eess.SY↗

arXiv2022

Understanding Braess' Paradox in power grids

The ongoing energy transition requires power grid extensions to connect renewable generators to consumers and to transfer power among distant areas. The process of grid extension requires a large investment of resources and is supposed to make grid operation more robust. Yet, counter-intuitively, increasing the capacity of existing lines or adding new lines may also reduce the overall system performance and even promote blackouts due to Braess' paradox. Braess' paradox was theoretically modeled but not yet proven in realistically scaled power grids. Here, we present an experimental setup demonstrating Braess' paradox in an AC power grid and show how it constrains ongoing large-scale grid extension projects. We present a topological theory that reveals the key mechanism and predicts Braessian grid extensions from the network structure. These results offer a theoretical method to understand and practical guidelines in support of preventing unsuitable infrastructures and the systemic planning of grid extensions.

eess.SY↗

arXiv2022

Lockdown effects on air quality in megacities during the first and second waves of COVID-19 pandemic

Air pollution is among the highest contributors to mortality worldwide, especially in urban areas. During spring 2020, many countries enacted social distancing measures in order to slow down the ongoing COVID-19 pandemic. A particularly drastic measure, the 'lockdown', urged people to stay at home and thereby prevent new COVID-19 infections during the first (2020) and second wave (2021) of the pandemic. In turn, it also reduced traffic and industrial activities. But how much did these lockdown measures improve air quality in large cities, and are there differences in how air quality was affected? Here, we analyse data from two megacities: London as an example for Europe and Delhi as an example for Asia. We consider data during first and second wave lockdowns and compare them to 2019 values. Overall, we find a reduction in almost all air pollutants with intriguing differences between the two cities except Delhi in 2021. In London, despite smaller average concentrations, we still observe high-pollutant states and an increased tendency towards extreme events (a higher kurtosis of the probability density during lockdown) during 2020 and low pollution levels during 2021. For Delhi, we observe a much stronger decrease of pollution concentrations, including high pollution states during 2020 and higher pollution levels in 2021. These results could help to design policies to improve long-term air quality in megacities.

physics.soc-ph↗