Jointly estimating interactions and head, body pose of interactors from distant social scenes

We present joint estimation of F-formations and head, body pose of interactors in a social scene captured by surveillance cameras. Unlike prior works that have focused on (a) discov-ering F-formations based on head pose and position cues, or (b) jointly learned head and body pose of individuals based on anatomic constraints, we exploit positional and pose cues characterizing interactors and interactions to jointly infer both (a) and (b). We show how the joint inference frame-work benefits both F-formation and head, body pose esti-mation accuracy via experiments on two social datasets.