We present a novel Bipartite Graph Reasoning GAN (BiGraphGAN) for the challenging person image generation task. The proposed graph generator mainly consists of two novel blocks that aim to model the pose-to-pose and pose-to-image relations, respectively. Specifically, the proposed Bipartite Graph Reasoning (BGR) block aims to reason the crossing long-range relations between the source pose and the target pose in a bipartite graph, which mitigates some challenges caused by pose deformation. Moreover, we propose a new Interaction-and-Aggregation (IA) block to effectively update and enhance the feature representation capability of both person's shape and appearance in an interactive way. Experiments on two challenging and public datasets,~emph{i.e.},~Market-1501 and DeepFashion, show the effectiveness of the proposed BiGraphGAN in terms of objective quantitative scores and subjective visual realness. The source code and trained models are available at https://github.com/Ha0Tang/BiGraphGAN.

Bipartite Graph Reasoning GANs for Person Image Generation / Tang, Hao; Song, Bai; Torr, Philipp H. S.; Sebe, Nicu. - (2020). (Intervento presentato al convegno BMVC’20 tenutosi a online nel 7th-10th September 2020).

Bipartite Graph Reasoning GANs for Person Image Generation

Tang, Hao;Sebe, Nicu
2020-01-01

Abstract

We present a novel Bipartite Graph Reasoning GAN (BiGraphGAN) for the challenging person image generation task. The proposed graph generator mainly consists of two novel blocks that aim to model the pose-to-pose and pose-to-image relations, respectively. Specifically, the proposed Bipartite Graph Reasoning (BGR) block aims to reason the crossing long-range relations between the source pose and the target pose in a bipartite graph, which mitigates some challenges caused by pose deformation. Moreover, we propose a new Interaction-and-Aggregation (IA) block to effectively update and enhance the feature representation capability of both person's shape and appearance in an interactive way. Experiments on two challenging and public datasets,~emph{i.e.},~Market-1501 and DeepFashion, show the effectiveness of the proposed BiGraphGAN in terms of objective quantitative scores and subjective visual realness. The source code and trained models are available at https://github.com/Ha0Tang/BiGraphGAN.
2020
British Machine Vision Conference (BMVC’20)
Oxford
British Machine Vision Association
Tang, Hao; Song, Bai; Torr, Philipp H. S.; Sebe, Nicu
Bipartite Graph Reasoning GANs for Person Image Generation / Tang, Hao; Song, Bai; Torr, Philipp H. S.; Sebe, Nicu. - (2020). (Intervento presentato al convegno BMVC’20 tenutosi a online nel 7th-10th September 2020).
File in questo prodotto:
File Dimensione Formato  
2008.04381.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 4.56 MB
Formato Adobe PDF
4.56 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/286977
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 26
  • ???jsp.display-item.citation.isi??? ND
social impact