arXiv ScienceSearch

arXiv subjects

Deepanjhan Das

Publications and source records attributed to Deepanjhan Das.

5 recordsLinked to original sources

Multivariate linear regression without prior assumptions

Recovering the linear relationships that govern a system from noisy measurements is a basic task across the physical and engineering sciences. Because every measured variable may carry an unknown amount of noise, classical regression must commit in advance to a set of structural assumptions: ordinary least squares requires a declared input-output partition with input variables being noise-free, total least squares assumes equal noise variance across all variables, and generalized total least squares additionally requires the noisy-variable partition and variances to be known beforehand. Kalman~\cite{Kalman:1982} showed that any procedure returning a unique linear model from inexact data must rest on such unverifiable a priori assumptions -- ``prejudices'' -- that cannot be checked against the data itself, and that removing them leaves the identification problem fundamentally indeterminate. Whether these prejudices can instead be resolved directly from the data has remain unresolved. Here we show that an iterative generalized-eigenvalue algorithm, QZ-IPCA, recovers the noisy-variable partition, noise variances, number of linear relations, and regression coefficients of a multivariate linear system simultaneously, using only the raw data. Across all possible exhaustive noise configurations of a five-variable benchmark network, QZ-IPCA correctly identifies model structure and recovers coefficients with error below 6.4\%. It outperforms ordinary least squares even when given the best partition, and succeeds in rank identification precisely where standard total least squares falls once noise variances differ across variables. These results show that the assumptions conventionally required for multivariate regression are not necessary, recasting model identification as a problem solvable from data geometry alone.

eess.SY

Subspace Based Identification of Errors-in-Variables Linear Descriptor Systems

The identification of linear descriptor systems (DAEs) from noise-corrupted data makes two critical assumptions: requirement of an \textit{a priori} classification of variables into inputs and outputs, and a pre-specified structural assumption with respect to the index of the system. This paper proposes a data-driven methodology for identifying index-0 and index-1 DAEs within an errors-in-variables framework. We extend a subspace-based iterative PCA (SMI-IPCA) approach to the behavioral setting, treating all measured variables as a unified augmented vector to avoid classification bias. This method enables systematic estimation of the noise variances, the number of algebraic and differential output variables, while simultaneously identifying the algebraic constraints and kernel representation of the dynamic system corresponding to its minimal realization order without prior structural knowledge. Simulation studies on index-0 and index-1 systems demonstrate the effectiveness of the proposed approach and its practical applicability.

eess.SY

A recursive subspace based method for errors-in-variables model identification of time-varying systems

The Subspace-based Model Identification algorithm using a modified Iterative Principal Component Analysis (SMI-IPCA) is a theoretically rigorous method for identifying a linear state-space model of a multi-input multi-output (MIMO) process, in an errors-in-variables (EIV) setting. The method can simultaneously estimate unknown heteroskedastic noise variances corrupting the input and output measurements, along with the state space model. This work proposes a recursive formulation of SMI-IPCA (RSMI-IPCA) enabling online identification and adaptive model updates as and when new data arrive. By maintaining a fixed length lag window rather than storing the complete historical data, RSMI-IPCA estimates measurement noise variances, process order, while simultaneously identifying the state-space matrices, making it suitable to monitor time-varying systems, whether the induced changes are slow or abrupt. The algorithm gradually adapts to slow sensor degradation (time-varying noise variances), changes in process operating conditions (time-varying model parameters), and structural modifications (varying model order). Simulation studies are presented to demonstrate the efficacy and practical applicability of the proposed algorithm.

eess.SY

DISPCA : A hybrid iterative-sequential approach for the identification of errors-in-variables model of linear DAE systems

The dynamic behavior of numerous engineering processes is effectively characterized through differential-algebraic equations (DAEs), commonly referred to as descriptor systems. While substantial progress has been achieved in identifying dynamic models governed by ordinary differential equations (ODEs), limited research has addressed the identification of descriptor systems from measured data. This work presents a systematic methodology for identifying the DAE model of a linear descriptor system in discrete difference equation form under errors-in-variables (EIV) setting, where both input and output measurements are corrupted by random noise. The proposed methodology generalizes the identification framework to handle scenarios where the system contains multiple algebraic and different ordered differential relations. The key innovation involves a partial stacking procedure of lagged data matrix with a sequentially increasing lag window that identifies all the differential relations individually. This is preceded by an iterative estimation of the measurement error covariance matrix that is diagonal and heteroskedastic, under large sample conditions. The algorithm simultaneously estimates the number of differential and algebraic relations, observability indices and delay parameters of the differential equations, and all the model coefficients directly from measured data without requiring prior specification from the user. The framework addresses the increased complexity arising from multiple dynamic coupled interactions while maintaining computational tractability through systematic decomposition of the identification problem. Effectiveness of the proposed methodology is demonstrated through several simulation studies.

eess.SY

Recursive Identification of EIV-ARX Models for Time Varying SISO Processes

This paper proposes a recursive algorithm, rARX-DIPCA, for identifying errors-in-variables autoregressive models with exogenous input (EIV-ARX), for tracking time-varying SISO processes. Building on a recently developed recursive iterative PCA method, the proposed algorithm recursively updates model parameters and noise variances as new measurements arrive, without storing historical data beyond a specified lag window. The method enables real-time adaptation to sensor degradation, and changes in model coefficients. The algorithm simultaneously identifies process order, time delay, and noise variances while maintaining computational efficiency through online covariance updates. Simulation studies on benchmark systems demonstrate effective tracking performance and practical applicability.

eess.SY