SALSA: A Multimodal Dataset for the Automated Analysis of Free-Standing Social Interactions

The automated study of free interactions in unstructured social gatherings (e.g., cocktail party) has attracted much attention from the computer science community, and is also of critical importance to other fields such as psychology and sociology. In this context, the study of free-standing conversational groups (FCGs) has recently become one of the flagship tasks, and many associated research questions remain unanswered at this time. Despite the wealth of information available at the group (social networks) and individual (native behavior and personality traits) levels, the difficulty in examining cues such as target locations, their speaking activity, and head/body pose has hampered research in this respect. In a bid to address the above shortcomings, we propose SALSA, a dataset facilitating multimodal and Synergetic sociAL Scene Analysis, and make two main contributions: (1) SALSA records social interactions among 18 participants in a natural, indoor environment for over 60 min, un...