arXiv Science⌕ Search

arXiv subjects

Krzysztof Podgórski

Publications and source records attributed to Krzysztof Podgórski.

7 recordsLinked to original sources

Structural Packing and Dyadic Factorization of Sparse Positive Definite Matrices

Efficient inversion of large sparse positive definite matrices requires exploiting sparsity patterns beyond those captured by conventional bandwidth reduction. In this work, we recast nested dissection, a prominent alternative, as a two-stage framework. The matrix was first packed into block-tridiagonal or dyadic form, followed by sparse Gram-Schmidt orthogonalization. This decomposition provided a unified perspective on sparse matrix factorization and inversion and identified dyadic structure as a fundamental component of sparse Cholesky factorization. For the first stage, we introduced a packing algorithm that recovered block-tridiagonal and dyadic patterns using a novel $\ell_1$ criterion. Using approximate distances obtained through classical multidimensional scaling, the method was effective when the target structure was sufficiently represented among the nonzero entries. Iterative application could also remove structural noise and reveal hidden dyadic organization, corresponding to separator identification in nested dissection. For the second stage, we developed the theory of dyadically structured matrices. We derived sparse factorization and inversion procedures, analyzed their computational complexity, and obtained an efficient inversion algorithm. A modified version reduced the cost of inverting block-tridiagonal matrices, demonstrating the benefit of exploiting their structure directly rather than treating them as generic band matrices.

math.NA↗

Splinets -- splines through the Taylor expansion, their support sets and orthogonal bases

A new representation of splines that targets efficiency in the analysis of functional data is implemented. The efficiency is achieved through two novel features: using the recently introduced orthonormal spline bases, the so-called {\it splinets} and accounting for the spline support sets in the proposed spline object representation. The recently-introduced orthogonal splinets are evaluated by {\it dyadic orthogonalization} of the $B$-splines. The package is built around the {\it Splinets}-object that represents a collection of splines. It treats splines as mathematical functions and contains information about the support sets and the values of the derivatives at the knots that uniquely define these functions. Algebra and calculus of splines utilize the Taylor expansions at the knots within the support sets. Several orthonormalization procedures of the $B$-splines are implemented including the recommended dyadic method leading to the splinets. The method bases on a dyadic algorithm that can be also viewed as the efficient method of diagonalizing a band matrix. The locality of the $B$-splines in terms of the support sets is, to a great extend, preserved in the corresponding splinet. This together with implemented algorithms utilizing locality of the supports provides a valuable computational tool for functional data analysis. The benefits are particularly evident when the sparsity in the data plays an important role. Various diagnostic tools are provided allowing to maintain the stability of the computations. Finally, the projection operation to the space of splines is implemented that facilitates functional data analysis. An example of a simple functional analysis of the data using the tools in the package is presented. The functionality of the package extends beyond the splines to piecewise polynomial functions, although the splines are its focus.

stat.CO↗

Spline Based Methods for Functional Data on Multivariate Domains

Functional data analysis is typically performed in two steps: first, functionally representing discrete observations, and then applying functional methods to the so-represented data. The initial choice of a functional representation may have a significant impact on the second phase of the analysis, as shown in recent research, where data-driven spline bases outperformed the predefined rigid choice of functional representation. The method chooses an initial functional basis by an efficient placement of the knots using a simple machine-learning algorithm. The approach does not apply directly when the data are defined on domains of a higher dimension than one such as, for example, images. The reason is that in higher dimensions the convenient and numerically efficient spline bases are obtained as tensor bases from 1D spline bases that require knots that are located on a lattice. This does not allow for a flexible knot placement that was fundamental for the 1D approach. The goal of this research is to propose two modified approaches that circumvent the problem by coding the irregular knot selection into their densities and utilizing these densities through the topology of the spaces of splines. This allows for regular grids for the knots and thus facilitates using the spline tensor bases. It is tested on 1D data showing that its performance is comparable to or better than the previous methods.

stat.AP↗

Splinets -- Orthogonal Splines and FDA for the Classification Problem

This study introduces an efficient workflow for functional data analysis in classification problems, utilizing advanced orthogonal spline bases. The methodology is based on the flexible Splinets package, featuring a novel spline representation designed for enhanced data efficiency. Several innovative features contribute to this efficiency: 1)Utilization of Orthonormal Spline Bases 2)Consideration of Spline Support Sets 3)Data-Driven Knot Selection. Illustrating this approach, we applied the workflow to the Fashion MINST dataset. We demonstrate the classification process and highlight significant efficiency gains. Particularly noteworthy are the improvements that can be achieved through the 2D generalization of our methodology, especially in scenarios where data sparsity and dimension reduction are critical factors. A key advantage of our workflow is the projection operation into the space of splines with arbitrarily chosen knots, allowing for versatile functional data analysis associated with classification problems. Moreover, the study explores Splinets package features suited for functional data analysis. The algebra and calculus of splines use Taylor expansions at the knots within the support sets. Various orthonormalization techniques for B-splines are implemented, including the highly recommended dyadic method, which leads to the creation of splinets. Importantly, the locality of B-splines concerning support sets is preserved in the corresponding splinet. Using this locality, along with implemented algorithms, provides a powerful computational tool for functional data analysis.

stat.ME↗

Splinets 1.5.0 -- Periodic Splinets

Periodic splines are a special kind of splines that are defined over a set of knots over a circle and are adequate for solving interpolation problems related to closed curves. This paper presents a method of implementing the objects representing such splines and describes how an efficient orthogonal basis can be obtained. The proposed orthonormalized basis is called a periodic splinet in the reference to earlier work where analogous concepts and tools have been introduced for splines on an interval. Based on this methodology, the periodic splines and splinets are added to the earlier version of the R package "Splinets". Moreover, the developed computational tools have been applied to functionally analyze a standard example of functional circular data of wind directions and speeds.

math.NA↗

Machine Learning Assisted Orthonormal Basis Selection for Functional Data Analysis

In implementations of the functional data methods, the effect of the initial choice of an orthonormal basis has not gained much attention in the past. Typically, several standard bases such as Fourier, wavelets, splines, etc. are considered to transform observed functional data and a choice is made without any formal criteria indicating which of the bases is preferable for the initial transformation of the data into functions. In an attempt to address this issue, we propose a strictly data-driven method of orthogonal basis selection. The method uses recently introduced orthogonal spline bases called the splinets obtained by efficient orthogonalization of the B-splines. The algorithm learns from the data in the machine learning style to efficiently place knots. The optimality criterion is based on the average (per functional data point) mean square error and is utilized both in the learning algorithms and in comparison studies. The latter indicates efficiency that is particularly evident for the sparse functional data and to a lesser degree in analyses of responses to complex physical systems.

stat.ML↗

Signals Featuring Harmonics with Random Frequencies -- Spectral, Distributional and Ergodic Properties

It has been observed that an interesting class of non-Gaussian stationary processes is obtained when in the harmonics of a signal with random amplitudes and phases, frequencies can also vary randomly. In the resulting models, the statistical distribution of frequencies determines the process spectrum while the distribution of amplitudes governs the process distributional properties. Since decoupling the distributional and spectral properties can be advantageous in applications, we thoroughly investigate a variety of properties exhibited by these models. We extend previous work that represented processes as finite sum of harmonics, by conveniently embedding them into the class of harmonizable processes. Harmonics are integrated with respect to independently scattered second order non-Gaussian random measures. The proposed approach provides with a proper mathematical framework that allows to study spectral, distributional, and ergodic properties. The mathematical elegance of these representations avoids serious conceptual and technical difficulties with limiting behavior of the models while at the same time facilitates derivation of their fundamental properties. In particular, the multivariate distributions are obtained and the asymptotic behavior of time averages is formally derived through the strong ergodic theorem. Several deficiencies following from the previous approaches are resolved and some of the results appearing in the literature are corrected and extended. It is shown that due to the lack of ergodicity processes exhibit an interesting property of non-trivial randomness remaining in the limit of time averages. This feature maybe utilized to modelling signals observed in the presence of influential and variable random factors.

math.PR↗