WiFi based Multi user Activity Recognition via User Conditioned Spatial Attention

Abstract

WiFi-based human activity recognition has achieved high accuracy under the single-user scene. Recognizing activities performed by multiple concurrent users remains challenging, because their body-reflected propagation paths superimpose in the channel state information (CSI) measurement. Existing multi-user methods either decompose the signal before classification, suffering from error propagation, or predict activities jointly without reliably associating each prediction with the correct user. Moreover, attention mechanisms that have proven effective for single-user sensing compute a single user-agnostic attention map, blending patterns from different users and providing no mechanism to associate features with specific user slots. This paper proposes a user-conditioned spatial attention (UCSA) module that generates per-user spatial attention maps by conditioning multi-scale spatial attention on learnable user-ID embeddings via feature-wise linear modulation (FiLM). UCSA creates a deep coupling between spatial feature enhancement and user differentiation: the attention module itself becomes user-aware, producing distinct attention maps for each user slot rather than relying on a late-fusion embedding addition. Combined with a shareable multi-semantic spatial attention (SMSA) module for multi-scale spatial enhancement, the proposed framework addresses both feature quality and user differentiation in a unified architecture. Experiments on the WiMANS benchmark across three indoor environments and up to five concurrent users show that the proposed method outperforms nine baselines in all settings, achieving an average accuracy of over 93\% across three environments even with five users. Ablation studies confirm that both SMSA and UCSA contribute substantially to recognition accuracy, with UCSA providing the critical link between shared features and per-user predictions.