Talk details
Title: Visual Intelligence from Human Learning
Speaker: Ranjay Krishna, Assistant Professor, Paul G. Allen School of Computer Science & Engineering, University of Washington, PhD & MS (Stanford University), BS (Cornell University)
Date: 19 February 2023
Time: 10 AM (IST)
Abstract:
At the core of human development is the ability to adapt to new, previously unseen stimuli. We ask one another for clarification when we encounter new concepts. Yet, this ability to go beyond the confounds of their training data remains an open challenge for artificial intelligence agents. My research designs visual intelligence to acquire new concepts by interacting with people. I will introduce a framework for socially situated learning. This framework pushes agents beyond traditional computer vision training paradigms and enables learning from human interactions in online social environments. I will showcase a real-world deployment of our agent, which learned to acquire new visual concepts by asking people targeted questions on social media. By interacting with over 230K people over 8 months, our agent learned to recognize hundreds of new concepts. This work demonstrates the possibility for agents to adapt and self-improve in real-world social environments.
Speaker’s bio
Ranjay Krishna is an Assistant Professor at the Paul G. Allen School of Computer Science & Engineering. His research lies at the intersection of computer vision and human-computer interaction. This research has received best paper, outstanding paper, and orals at CVPR, ACL, CSCW, NeurIPS, UIST, and ECCV, and has been reported by Science, Forbes, the Wall Street Journal, and PBS NOVA. He holds a bachelor’s degree in Electrical & Computer Engineering and in Computer Science from Cornell University, a master’s degree in Computer Science from Stanford University, and a Ph.D. in Computer Science from Stanford University.