arXiv Science⌕ Search

arXiv subjects

Linlu Gao

Publications and source records attributed to Linlu Gao.

2 recordsLinked to original sources

Smart Glasses for Ubiquitous Computing: A Layered Survey and the Road Ahead

We conduct a systematic survey of smart-glasses research for ubiquitous computing. Our search covers work published from 2020 to October 2026, with selected earlier work included for historical context. After screening and title-level deduplication, we identify 163 smart-glasses papers and separately compile related resources, including 14 representative hardware platforms, their associated software tools and pretrained models, and 10 datasets. We organize this literature through four complementary layers. Research Resources covers hardware platforms, software tools and models, and datasets that support development and evaluation. Sensing & Perception examines how glasses measure and interpret information about users and their surroundings. Interaction & Assistance addresses how users express intentions and receive feedback and assistance. Applications situates these contributions in tasks and use contexts. Energy, latency, wearability, reliability, privacy, security, and social acceptability are treated as deployment constraints across all four layers. This framework provides a unified view of current research and a vision for how advances across the four layers could come together to support smart glasses as a ubiquitous computing platform. Building on this synthesis, we outline research directions for extending capabilities across tasks and over time, supporting assistance under human control, and achieving reliable, efficient, and sustained everyday use.

cs.HC↗

RF-HOI: Recognize Human-Object Interaction with Radio Frequency Signals

Recognizing Human-Object Interactions (HOI) is essential for intelligent systems, underpinning applications in virtual and augmented reality, embodied AI, and assistive robotics. However, vision-based HOI methods face challenges in privacy concerns and poor light conditions. In this work, we introduce RF-HOI, the first framework that only uses radio frequency (RF) signals for HOI recognition. A key challenge of RF-HOI is that single-modality RF sensing is insufficient to recognize both actions and the objects being interacted with. RF-HOI addresses this through a novel modality fusion that combines mmWave radar and RFID, enabling simultaneous action recognition and target identification. Another challenge is limited training data across diverse setups, which impairs the generalizability of the recognition model. To overcome this, we develop a simulator that synthesizes multimodal RF data for diverse HOIs at scale, allowing us to fine-tune with only a small amount of real-world data. Experiment results show that RF-HOI outperforms all baselines, approaching vision model performance, and that our diverse synthetic training data can significantly boost our system's performance on real-world scenarios. These results highlight the potential of multimodal RF sensing for robust and privacy-preserving HOI recognition as well as the effectiveness of our RF data synthesis.

cs.AI↗