arXiv ScienceSearch

arXiv subjects

Kapil Garg

Publications and source records attributed to Kapil Garg.

2 recordsLinked to original sources

Situated Practice Systems: A Computational System for Supporting the Coaching and Practice of Regulation Skills for Innovation Work

Students are increasingly expected to prepare for open-ended innovation work, which requires well-developed cognitive, metacognitive, and emotional regulation skills. College learning environments offer opportunities to work on real-world problems--such as in design and engineering--but students often remain unaware of their ineffective work practices and recurring regulation challenges, and may struggle to improve. Coaching from experts can help, but students' practices and regulation behaviors are largely invisible from work artifacts alone and are difficult to diagnose and track without computational support. We introduce Situated Practice Systems (SPS), which provide: (1) an Interactive Context-Assessment-Plan (CAP) Notes tool to support coaches' understanding and modeling students' regulation-informed practices, and (2) Practice Agents that help students develop more effective practices. SPS uses Practice Objects to represent practices and regulation behaviors computationally, and Practice Scripts to automatically present suggested practices to students in relevant situations. In a formative 3-week field study, SPS helped coaches identify recurring regulation gaps and provide tailored practices. SPS also guided students in adopting more effective ways of working on their own and with others. We demonstrate how CSCW systems and learning environments can be designed to support the development of students' work practices and regulation skills, enabling them to lead innovation work.

cs.HC

"It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models

Vision-Language Models (VLMs) are increasingly used by blind and low-vision (BLV) people to identify and understand products in their everyday lives, such as food, personal care items, and household goods. Despite their prevalence, we lack an empirical understanding of how common image quality issues--such as blur, misframing, and rotation--affect the accuracy of VLM-generated captions and whether the resulting captions meet BLV people's information needs. Based on a survey of 86 BLV participants, we develop an annotated dataset of 1,859 product images from BLV people to systematically evaluate how image quality issues affect VLM-generated captions. While the best VLM achieves 98% accuracy on images with no quality issues, accuracy drops to 75% overall when quality issues are present, worsening considerably as issues compound. We discuss the need for model evaluations that center on disabled people's experiences throughout the process and offer concrete recommendations for HCI and ML researchers to make VLMs more reliable for BLV people.

cs.HC