Social interactions play an important role in our daily lives: people organize themselves in groups to share views, opinions, as well as thoughts. In many settings, observing these interactions offer deep insights into on-going events and situations. Manual analysis of such interactions is accurate but is tedious. Recent developments in sensors and processing enable the possibility for automated analysis of social interactions.
This talk focuses on the analysis of social interactions from the social signal perspective in a multi-sensor setting. The talk starts with our work on extended F-formation system for robust interaction and interactant detection in an ambient sensor environment. Building upon this work, we study the spatial structure of social interactions in a multiple wearable sensor environment. We use a search-based method to reconstruct the social interaction structure given multiple first-person views, where each view contributes to the multi-faceted understanding of the social interaction.
The talk ends with our work on "presentation analytics" which is a very important sub-class of social interactions. A new multi-sensor analytics framework is proposed using ambient and wearable sensors for a substantially improved sensing which allows for presentation self-quantification. We have used some deep learning techniques for the analysis. Feedback from presenters shows a lot of potential for the use of such analytics.
Mohan Kankanhalli is Provost's Chair Professor of Computer Science at the National University of Singapore (NUS). He is also the Dean of NUS School of Computing. Before becoming the Dean in July 2016, he was the NUS Vice Provost (Graduate Education) during 2014-2016 and Associate Provost during 2011-2013. Mohan obtained his BTech from IIT Kharagpur and MS & PhD from the Rensselaer Polytechnic Institute.
His current research interests are in Multimedia Computing, Information Security & Privacy, Image/Video Processing and Social Media Analysis. He directs the SeSaMe (Sensor-enhanced Social Media) Centre which does fundamental exploration of social cyber-physical systems which has applications in social sensing, sensor analytics and smart systems. He is on the editorial boards of several journals including the ACM Transactions on Multimedia, Springer Multimedia Systems Journal, IEEE Multimedia, Pattern Recognition Journal and Springer Multimedia Tools & Applications Journal. He is a Fellow of IEEE.