arXiv ScienceSearch

arXiv subjects

Yaluo Wang

Publications and source records attributed to Yaluo Wang.

3 recordsLinked to original sources

PaintCopilot: Modeling Painting as Autonomous Artistic Continuation

Existing neural painting methods are target-driven: given a reference image, strokes are optimized to reconstruct it, fixing the outcome before painting begins. We instead ask whether a model can predict plausible painting actions when the final image is unknown, a problem we call autonomous artistic continuation. PaintCopilot realizes this through three lightweight, task-specific models: a Target Predictor that infers a provisional visual target directly from the evolving canvas, a Stroke Predictor that formulates brushstroke generation as flow matching to capture multiple plausible continuations, and a Region Sampler that generates stroke sequences within artist-specified regions via a conditional VAE, trained on a constructed dataset of 3000 portraits with stroke-level supervision. This lets AI autonomously act on an artwork whose direction is still open, through interruptible, revisable delegation mechanisms spanning individual strokes, extended sequences, bounded regions, and prior stroke history. A two-week deployment with ten artists suggests that creative agency was shaped not simply by how much work artists delegated, but by their ability to continually negotiate the direction, scope, and persistence of AI participation.

cs.CV

Smell with Genji: Rediscovering Human Perception through an Olfactory Game with AI

Olfaction plays an important role in human perception, yet its subjective and ephemeral nature makes it difficult to articulate, compare, and share across individuals. Traditional practices like the Japanese incense game Genji-ko offer one way to structure olfactory experience through shared interpretation. In this work, we present Smell with Genji, an AI-mediated olfactory interaction system that reinterprets Genji-ko as a collaborative human-AI sensory experience. By integrating a game setup, a mobile application, and an LLM-powered co-smelling partner equipped with olfactory sensing and LLM-based conversation, the system invites participants to compare scents and construct Genji-mon patterns, fostering reflection through a dialogue that highlights the alignment and discrepancies between human and machine perception. This work illustrates how sensing-enabled AI can participate in olfactory experience alongside users, pointing toward new possibilities for AI-supported sensory interaction and reflection in HCI.

cs.HC

ArchSeek: Retrieving Architectural Case Studies Using Vision-Language Models

Efficiently searching for relevant case studies is critical in architectural design, as designers rely on precedent examples to guide or inspire their ongoing projects. However, traditional text-based search tools struggle to capture the inherently visual and complex nature of architectural knowledge, often leading to time-consuming and imprecise exploration. This paper introduces ArchSeek, an innovative case study search system with recommendation capability, tailored for architecture design professionals. Powered by the visual understanding capabilities from vision-language models and cross-modal embeddings, it enables text and image queries with fine-grained control, and interaction-based design case recommendations. It offers architects a more efficient, personalized way to discover design inspirations, with potential applications across other visually driven design fields. The source code is available at https://github.com/danruili/ArchSeek.

cs.IR