arXiv Science⌕ Search

arXiv · 2610.36159

MtReNIRS: A Self-Supervised Foundation Model for Transferable Neurovascular Representations

Abstract

Functional near-infrared spectroscopy (fNIRS) offers a promising approach for monitoring the hemodynamic correlates of neural activity in naturalistic settings. However, existing modeling methods for fNIRS are largely confined to small-scale, single-session data with low sampling rates, driven by high heterogeneity in acquisition devices and optode montages. In addition, the complex spatiotemporal structure of fNIRS signals further restricts model scalability and transferability across settings. As a result, it remains unclear whether a single fNIRS encoder can learn representations that are usable across subjects, tasks, devices, and montages. Here, we show that a montage-aware masked autoencoder, pretrained on 12 public fNIRS datasets spanning 268 subjects and 567 recording hours, learns generalizable neurovascular representations that transfer across three external datasets. Our fNIRS foundation model, MtReNIRS, jointly encodes the slow hemodynamic nature of fNIRS, chromophore identity and cortical location by mapping heterogeneous montages onto a shared anatomical reference. MtReNIRS achieves cross-subject performance on par or better than fully supervised baselines and excels in few-shot within-subject calibration, where it outperforms prior state-of-the-art fNIRS models, while remaining robust to sparse montages. Our results indicate that montage-aware self-supervision yields physiologically grounded, transferable fNIRS representations, providing a scalable foundation for label-efficient brain-computer interfaces.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tony Chae, Kleanthis Avramidis, Dimitra Emmanouilidou, Ivan J. Tashev. 2026-10-26. MtReNIRS: A Self-Supervised Foundation Model for Transferable Neurovascular Representations. https://arxiv.org/abs/2610.36159

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Bodyseismography (BSG): Theoretical Foundation and Numerical Modeling

Bodyseismography (BSG) records cardiovascular vibrations transmitted through the body and a supporting bed, enabling contactless assessment of cardiac mechanics. Relating these vibrations to hemodynamic features requires separating cardiac excitation from the effects of body and bed transmission. We develop a source-transmission-measurement framework that couples myocardial contraction and vascular recoil to directional BSG observations. The theory connects stroke volume, cardiac output, and blood pressure to observation and target Jacobians, establishes a local first-order target-observability criterion, and characterizes how additional sensing axes reduce ambiguities under specified source and transmission uncertainties. Numerical modeling combines four-chamber cardiac mechanics, cardiac-to-body excitation, and calibrated body-bed operators. Across 27 participants, a multilayer finite-element model with calibrated frequency correction achieves median Pearson correlation coefficients of 0.865 for the vertical channel and 0.682 for the planar-sum channel in matched-window waveform reconstruction. Controlled stroke-volume perturbations show that transmission reshapes feature sensitivity, including a reversal of the vertical feature association in 8 of 27 participant-specific transfer models. These analytical and numerical studies explain how cardiovascular sources and mechanical propagation jointly shape triaxial BSG and provide a physical basis for relating directional vibration features to hemodynamic changes.

eess.SP↗

Structured Wavenumber-Domain Channel Estimation for LoS XL-MIMO

Near-field line-of-sight (LoS) channels in extremely large-scale multiple-input multiple-output (XL-MIMO) systems exhibit distinctive structural properties in the wavenumber domain. In this paper, we develop a structured wavenumber-domain channel estimation framework that first obtains an initial channel estimate using classical estimators and then refines it through a windowing-based refinement step that suppresses out-of-band noise by exploiting the localized spatial-frequency power distribution. The resulting estimate is subsequently enhanced through a convex constrained formulation that exploits the sparsity and low-rank structure of the wavenumber-domain channel. The corresponding sparsity and rank constraint bounds are selected using a conservative worst-case characterization over the relative position of the transmitter and receiver. Numerical results show that the proposed framework improves estimation accuracy, particularly at low signal-to-noise ratio, by effectively leveraging the structural properties of the wavenumber-domain channel.

eess.SP↗

Soft Temporal Alignment Distillation for Camera-to-mmWave Radar Human Activity Recognition

Millimeter-wave (mmWave) radar provides privacy?preserving human activity recognition (HAR), but sparse point clouds limit its representation of body structure and motion. We propose a cross-modal knowledge distillation framework in which a teacher trained on camera-derived two-dimensional (2D) human keypoints supervises a radar-only student. The stu?dent combines PointNet-based point-set encoding, bidirectional temporal modeling, segment-level aggregation, and lightweight shared latent-channel scaling. The teacher retains contextualized states at every time step, whereas the student summarizes the radar sequence into a small number of segments, making fixed timestamp correspondence unsuitable for feature transfer. Soft Temporal Alignment Distillation lets each student segment adaptively retrieve and aggregate teacher temporal evidence into its distillation target. Alignment denotes student-conditioned representation-space matching rather than chronological or monotonic registration. On the Multi-Modal Non-Intrusive 4D Human Dataset (MM-Fi), the method improves radar-only ac?curacy from 87.04% to 89.17%, achieving the highest mean accuracy among the evaluated established and recent distillation baselines. It also obtains higher mean accuracy and macro?averaged F1 score (macro-F1) than the radar student under most evaluated point- and frame-dropout settings. Adaptation to our independently collected millimeter-wave Office Human Ac?tivity Recognition Dataset (mmO-HAR) improves accuracy from 80.33% to 87.75%, supporting the transferability of the distilled radar representation. The teacher and alignment branch are removed after training, enabling privacy-preserving radar-only inference without additional sensing or computational branches.

eess.SP↗