arXiv ScienceSearch

arXiv subjects

Javier Lopatin

Publications and source records attributed to Javier Lopatin.

3 recordsLinked to original sources

Earth and space observations meet complex algebras: from complex to octonions for multivariate autoregressive time series analysis

Many datasets arise as multivariate time series observed at irregular time intervals, particularly in Earth observation and astronomical measurements. Classical time-series models assume that time is discrete and observations occur at equally spaced intervals, limiting their ability to capture dynamics when observation gaps vary. Existing approaches to irregular sampling rely on continuous-time formulations, which assume that observation intervals are sufficiently small. We address this limitation by introducing a discrete-time framework that accommodates irregular observation gaps while preserving multivariate dependence structures. We introduce a framework for the analysis of irregularly observed multivariate time series based on hypercomplex autoregressive processes. The framework embeds multivariate observations into a hypercomplex algebraic structure, allowing multiple variables and their interactions to be represented within a single mathematical entity while incorporating irregular observation gaps. The resulting process admits a structured matrix representation, which enables the model to be expressed as a state-space system. This formulation provides an estimation methodology in which model parameters can be inferred using Kalman filtering techniques. The state-space representation allows recursive estimation and prediction in the presence of irregular sampling intervals. The performance of the methodology is illustrated through data and applications to remote sensing and astronomical datasets, where observations occur at nonuniform time intervals. The results demonstrate that the approach captures dynamics and cross-variable interactions difficult to model using traditional time-series techniques. The proposed framework provides a methodology for analyzing irregularly sampled multivariate time series and opens possibilities for modeling observational data across disciplines.

stat.ME

Turning spectra into images improves plant trait retrieval with 2D-CNNs

Hyperspectral reflectance spectroscopy enables non-destructive estimation of plant functional traits, yet current deep learning approaches process spectra as one-dimensional sequences, which limits how they capture long-range inter-band dependencies. We asked whether transforming 1D spectra into 2D image representations improves multi-trait prediction with convolutional neural networks (CNN). We compared nine transformations using EfficientNet-B0 on the GreenHyperSpectra dataset (7,897 labeled spectra, eight traits, 400-2450 nm), benchmarked against published 1D CNN results on the same split. Trained from scratch, the simplest transformation, a direct Reshape of the spectrum into a 2D grid, performed best ($R^2 = 0.684 \pm 0.001$) and improved on the state-of-the-art 1D baseline ($R^2 = 0.587$, $+0.097$). We then pretrained a 2D masked autoencoder (MAE-2D) on 139,000 unlabeled spectral images. Linear probing, which freezes the encoder and trains only a multilayer perceptron head, reached $R^2 = 0.646$ and exceeded every 1D self-supervised counterpart, including the fine-tuned MAE-1D ($R^2 = 0.641$). Under cross-dataset evaluation all models lost most of their accuracy and none beat the 1D baseline significantly. To identify which wavelengths drive each prediction, we applied Integrated Gradients and Grad-CAM and unfolded band importance back to the spectral axis. Protein ($r = 0.45$) and leaf water ($r = 0.33$) agreed with sensitivities simulated by the PROSAIL radiative-transfer model, while carotenoids ($r = 0.06$) and leaf area index ($r = -0.11$) did not, showing that the model reads established leaf chemistry for traits with sharp absorption features. The representational advantage of 2D spectral images, rather than architectural complexity or ImageNet pretraining, drives the gain over 1D approaches.

cs.CV

PlantTraitNet: An Uncertainty-Aware Multimodal Framework for Global-Scale Plant Trait Inference from Citizen Science Data

Global plant maps of plant traits, such as leaf nitrogen or plant height, are essential for understanding ecosystem processes, including the carbon and energy cycles of the Earth system. However, existing trait maps remain limited by the high cost and sparse geographic coverage of field-based measurements. Citizen science initiatives offer a largely untapped resource to overcome these limitations, with over 50 million geotagged plant photographs worldwide capturing valuable visual information on plant morphology and physiology. In this study, we introduce PlantTraitNet, a multi-modal, multi-task uncertainty-aware deep learning framework that predictsfour key plant traits (plant height, leaf area, specific leaf area, and nitrogen content) from citizen science photos using weak supervision. By aggregating individual trait predictions across space, we generate global maps of trait distributions. We validate these maps against independent vegetation survey data (sPlotOpen) and benchmark them against leading global trait products. Our results show that PlantTraitNet consistently outperforms existing trait maps across all evaluated traits, demonstrating that citizen science imagery, when integrated with computer vision and geospatial AI, enables not only scalable but also more accurate global trait mapping. This approach offers a powerful new pathway for ecological research and Earth system modeling.

cs.CV