arXiv Science⌕ Search

arXiv subjects

Andrei Ermakov

Publications and source records attributed to Andrei Ermakov.

7 recordsLinked to original sources

Pattern-Based Matrix Analysis Under Permutations

Low-rank approximation captures one important notion of matrix simplicity: a matrix is simple if it is well described by a low-dimensional linear model. This paper studies a complementary notion. We consider matrices that become structurally simple only after permuting rows and columns, so that their mass concentrates in a prescribed geometric pattern such as a band, block-diagonal, arrowhead, or related form. We introduce a pattern distance that measures how close a matrix is to a given pattern after optimal reordering, giving a common framework for structural problems such as latent ordering, community detection, and bandwidth minimization. The problem is NP-hard in general; we derive an alternating algorithm based on Linear Assignment subproblems. We further introduce a pattern-plus-low-rank decomposition that combines permutation-structured fitting with a low-rank residual, whose permutation step is pattern fitting on the residual; its gains across pattern families persist at a matched parameter budget and are substantially reduced under a density-matched random-mask control. We evaluate the framework on synthetic recovery tasks, real correlation and graph adjacency matrices, and transformer attention heads, showing that a single universal algorithm recovers qualitatively different forms of matrix structure.

cs.LG↗

Turning TS2Vec into a Foundation Model for Time Series Classification

TS2Vec is one of the strongest self-supervised methods for time series classification, introduced in 2022. It is designed to be trained anew on every dataset: self-supervised pre-training followed by linear probing. Since then, the field has shifted towards foundation models that reuse one encoder across datasets. Yet TS2Vec offers a compact convolutional architecture that operates directly on temporal samples and accepts variable-length inputs without resampling. We ask whether these properties can be retained when the encoder is pre-trained only once, and show that they can: TS2Vec can essentially be turned into a foundation model. Three changes suffice: pre-train on a synthetic corpus, feed the encoder a raw amplitude view and an instance-normalized shape view of the input through two small stems, and distill one specialist encoder per view into a single encoder. The result, TS2Vec-FM, is a 1.6M-parameter dilated convolutional network that, kept frozen, reaches 83.3% on UCR-128 and 75.3% on UEA-27 under linear probing, within 0.3 pp of MantisV2, the current state of the art, and above TS2Vec trained separately on each target dataset. What we find most interesting is how different TS2Vec-FM is from other foundation models in design: near-parity is reached without attention, without a patch tokenizer, and without intermediate-layer extraction, using an "old-school" convolutional encoder and a two-layer MLP stem.

cs.LG↗

Evolutionary Two-Stage Hyperparameter Optimization Strategies for Physics-Informed Neural Networks

Physics-Informed Neural Networks (PINNs) solve Partial Differential Equations (PDEs) by embedding physical laws into neural network training. However, their performance suffers from unstable convergence, training plateaus, and strong sensitivity to architectural and optimization hyperparameters due to the highly non-convex and multi-term structure of the physics-informed loss. In this setting, the outer-loop hyperparameter search is a noisy and black-box optimization problem over heterogeneous parameters, where classical local or gradient-based strategies are easily trapped in suboptimal regions. Evolutionary algorithms, with their population-based exploration and ability to handle mixed, non-differentiable search spaces, provide a more robust mechanism for discovering promising configurations. We propose and investigate a two-stage approach based on evolutionary algorithms that combines exploration and exploitation parts of PINNs training to improve solution accuracy and robustness under fixed computational budgets. In the first stage, we perform low-fidelity training runs with truncated epochs to rapidly screen candidate configurations, treating hyperparameter selection as a black-box outer-loop problem. In the second stage, only the most promising candidates are fully trained with standard gradient-based optimizers to refine the solution. Evaluated on three popular problems, namely Advection, Klein-Gordon and Helmholtz equations, our method consistently outperforms standard training and achieves significantly lower mean error within constrained computational resources.

cs.LG↗

Enhancing GNNs Performance on Combinatorial Optimization by Recurrent Feature Update

Combinatorial optimization (CO) problems are crucial in various scientific and industrial applications. Recently, researchers have proposed using unsupervised Graph Neural Networks (GNNs) to address NP-hard combinatorial optimization problems, which can be reformulated as Quadratic Unconstrained Binary Optimization (QUBO) problems. GNNs have demonstrated high performance with nearly linear scalability and significantly outperformed classic heuristic-based algorithms in terms of computational efficiency on large-scale problems. However, when utilizing standard node features, GNNs tend to get trapped to suboptimal local minima of the energy landscape, resulting in low quality solutions. We introduce a novel algorithm, denoted hereafter as QRF-GNN, leveraging the power of GNNs to efficiently solve CO problems with QUBO formulation. It relies on unsupervised learning by minimizing the loss function derived from QUBO relaxation. The proposed key components of the architecture include the recurrent use of intermediate GNN predictions, parallel convolutional layers and combination of static node features as input. Altogether, it helps to adapt the intermediate solution candidate to minimize QUBO-based loss function, taking into account not only static graph features, but also intermediate predictions treated as dynamic, i.e. iteratively changing recurrent features. The performance of the proposed algorithm has been evaluated on the canonical benchmark datasets for maximum cut, graph coloring and maximum independent set problems. Results of experiments show that QRF-GNN drastically surpasses existing learning-based approaches and is comparable to the state-of-the-art conventional heuristics, improving their scalability on large instances.

cs.LG↗

Soliton Interaction with External Forcing within the Korteweg-de Vries Equation

We revise the solutions of the forced Korteweg-de Vries equation describing a resonant interaction of a solitary wave with external pulse-type perturbations. In contrast to previous works where only the limiting cases of a very narrow forcing in comparison with the initial soliton or a very narrow soliton in comparison with the width of external perturbation were studied, we consider here an arbitrary relationship between the widths of soliton and external perturbation of a relatively small amplitude. In many particular cases, exact solutions of the forced Korteweg-de Vries equation can be obtained for the specific forcings of arbitrary amplitude. We use the earlier developed asymptotic method to derive an approximate set of equations up to the second-order on a small parameter characterising the amplitude of external force. The analysis of exact solutions of the derived equations is presented and illustrated graphically. It is shown that the theoretical outcomes obtained by asymptotic method are in a good agreement with the results of direct numerical modelling within the framework of forced Korteweg-de Vries equation.

nlin.PS↗

Scattering of long water waves in a canal with rapidly varying cross-section in the presence of a current

The analytical study of long wave scattering in a canal with a rapidly varying cross-section is presented. It is assumed that waves propagate on a stationary current with a given flow rate. Due to the fixed flow rate, the current speed is different in the different sections of the canal, upstream and downstream. The scattering coefficients (the transmission and reflection coefficients) are calculated for all possible orientations of incident wave with respect to the background current (downstream and upstream propagation) and for all possible regimes of current (subcritical, transcritical, and supercritical). It is shown that in some cases negative energy waves can appear in the process of waves scattering. The conditions are found when the overreflection and over-transmission phenomena occur. In particular, it is shown that a spontaneous wave generation can arise in a trans-critical accelerating flow, when the background current enhances due to the canal narrowing. This resembles a spontaneous wave generation on the horizon of an evaporating black hole due to the Hawking effect.

physics.flu-dyn↗

Wave Scattering in Spatially Inhomogeneous Currents

We analytically study a scattering of long linear surface waves on stationary currents in a duct (canal) of constant depth and variable width. It is assumed that the background velocity linearly increases or decreases with the longitudinal coordinate due to the gradual variation of duct width. Such a model admits analytical solution of the problem in hand, and we calculate the scattering coefficients as functions of incident wave frequency for all possible cases of sub-, super-, and trans-critical currents. For completeness we study both co-current and counter-current wave propagation in accelerating and decelerating currents. The results obtained are analysed in application to recent analog gravity experiments and shed light on the problem of hydrodynamic modelling of Hawking radiation.

physics.flu-dyn↗