Goggles, wearable cameras are poised to enter our social spaces in a big way. In this talk, I will investigate what wearable cameras can tell us both about the person wearing the cameras and the people they interact with. In the first part, I will present a method to reconstruct the motion of a person from cameras mounted on different limbs of the person, with the goal of taking motion capture out of the lab or studio. In the second part, I will present a method that measure areas of social saliency from head-mounted cameras on different members of a social scene, with the goal of building robots that are truly collaborative partners rather than passive tools.
Joint work with Hyun Soo Park, Eakta Jain, Takaaki Shiratori, Leonid Sigal, and Jessica Hodgins. Research supported by NSF, Intel Research, Disney Research, and DARPA.