arXiv ScienceSearch

arXiv subjects

Yong Wang

Publications and source records attributed to Yong Wang.

2 recordsLinked to original sources

Learning Human Health and Diseases from 24-hour Wrist Movement

Much of human health and function unfolds beyond the clinic, through the movements of everyday life. Wrist-worn accelerometers capture these movements continuously, yet their rich signals are often reduced to a small set of predefined behavioural summary measures. Here, we present Sensori, a self-supervised foundation model that learns general-purpose health representations directly from 24 hours of raw tri-axial wrist movement. We developed and evaluated the model across four population-based cohorts from the United Kingdom, China and the United States, comprising 122,640 participants contributing 683,617 person-days of free-living recordings. Sensori condensed each day of movement into a representation that captured diverse movement behaviours, demographic characteristics, health axes and physical function. Evaluation in independent cohorts showed that these representations generalised across populations and measurement settings without retraining. When added to common clinical covariates, Sensori significantly improved prevalent disease classification for 52 of 102 eligible conditions (median delta AUROC, 0.060; range, 0.012-0.242) and incident disease risk prediction for 26 of 87 eligible conditions (median delta Uno's C-index, 0.064; range, 0.025-0.172), with the largest gains for neurological and psychiatric disorders. These findings establish 24-hour wrist movement as a rich and scalable source of health information, with the potential to support passive health monitoring and disease prediction at population scale.

cs.LG

AniMaster: From Story Texts to Animated Videos via Cinematic Script Generation and Interactive Authoring

Recent advances in Video Generation Models (VGMs) have demonstrated strong capabilities in producing short video clips. However, it is still challenging for everyday creators to leverage these models to produce polished long-form animated videos from brief story texts. Informed by a formative study with both novice creators and film experts, we identify two major challenges of interactive video authoring: (1) the lack of expertise in translating free-form story texts to professional cinematic scripts and finally high-quality animated videos, and (2) the absence of effective ways to convey video design intents to key variables of visual storytelling, such as shot composition, camera controls and shot sequencing. Drawing on narratology and film studies, we propose a three-layer design framework that defines the key design dimensions across three layers (i.e., story texts, cinematic scripts, and animated videos) as well as the translation between them. Built on this framework, we present AniMaster, a VGM-powered authoring tool to enable everyday creators to easily produce smooth animated videos from free-form story texts. AniMaster automatically expands brief story texts to detailed cinematic scripts, and further translates cinematic scripts into polished videos by following professional visual storytelling principles. It also allows users to interactively edit the scripts and refine the generated videos via text instructions and intuitive interactions. We extensively evaluated AniMaster through an in-depth user study with 16 participants, two case studies, and expert interviews with 2 film professionals. The results demonstrate the effectiveness and usability of AniMaster in helping everyday creators create polished animated videos from free-form story texts.

cs.HC