arXiv subjects

Stepan Botman

Publications and source records attributed to Stepan Botman.

5 recordsLinked to original sources

arXiv2026

MeFEm: Medical Face Embedding model

We present MeFEm, a vision model based on a modified Joint Embedding Predictive Architecture (JEPA) for biometric and medical analysis from facial images. Key modifications include an axial stripe masking strategy to focus learning on semantically relevant regions, a circular loss weighting scheme, and the probabilistic reassignment of the CLS token for high quality linear probing. Trained on a consolidated dataset of curated images, MeFEm outperforms strong baselines like FaRL and Franca on core anthropometric tasks despite using significantly less data. It also shows promising results on Body Mass Index (BMI) estimation, evaluated on a novel, consolidated closed-source dataset that addresses the domain bias prevalent in existing data. Model weights are available at https://huggingface.co/boretsyury/MeFEm , offering a strong baseline for future work in this domain.

cs.CV↗

arXiv2025

Gaze into the Heart: A Multi-View Video Dataset for rPPG and Health Biomarkers Estimation

Progress in remote PhotoPlethysmoGraphy (rPPG) is limited by the critical issues of existing publicly available datasets: small size, privacy concerns with facial videos, and lack of diversity in conditions. The paper introduces a novel comprehensive large-scale multi-view video dataset for rPPG and health biomarkers estimation. Our dataset comprises 3600 synchronized video recordings from 600 subjects, captured under varied conditions (resting and post-exercise) using multiple consumer-grade cameras at different angles. To enable multimodal analysis of physiological states, each recording is paired with a 100 Hz PPG signal and extended health metrics, such as electrocardiogram, arterial blood pressure, biomarkers, temperature, oxygen saturation, respiratory rate, and stress level. Using this data, we train an efficient rPPG model and compare its quality with existing approaches in cross-dataset scenarios. The public release of our dataset and model should significantly speed up the progress in the development of AI medical assistants.

cs.CV↗

arXiv2024

GigaPevt: Multimodal Medical Assistant

Building an intelligent and efficient medical assistant is still a challenging AI problem. The major limitation comes from the data modality scarceness, which reduces comprehensive patient perception. This demo paper presents the GigaPevt, the first multimodal medical assistant that combines the dialog capabilities of large language models with specialized medical models. Such an approach shows immediate advantages in dialog quality and metric performance, with a 1.18% accuracy improvement in the question-answering task.

cs.AI↗

arXiv2016

Electrical Resistivity Model for Quasi-one-dimensional structures

In this paper electron-impurity scattering coefficient of Bloch waves for one dimensional Dirac comb potential is used for calculation of temperature dependence of resistivity within kinetic theory. We restrict ourselves by scattering on impurities that is also modeled by zero-range potential. The standard averaging is expressed by integral that is evaluated within advanced numerical procedure. The plots on base of the calculations results demonstrate strong variability as function of temperature and impurity strength.

cond-mat.mes-hall↗

arXiv2015

Bloch wave scattering on pseudopotential impurity in 1D Dirac comb model

This paper presents calculation of electron-impurity scattering coefficient of Bloch waves for one dimensional Dirac comb potential. The impurity is also modeled as delta function pseudopotential that allows explicit solution of Schr\"odinger equation and scattering problem for Bloch waves.

cond-mat.mes-hall↗