Given the success of deep generative models in many creative tasks, it is natural to ask how to best leverage them to support human designers. We study this problem in the context of mixed-initiative design of platformer levels, a paradigmatic co-creative task. This setting is especially challenging, because – like all functional content – platformer levels must satisfy complex validity constraints, like coherency and playability. We explore mixed-initiative interaction with constrained adversarial networks (CANs), a class of deep generative models that synthesize structures satisfying one or more validity constraints. As such, CANs can be used to complete user-supplied partial levels while retaining full control of the constraints to be applied. We go one step beyond, and consider the issue of customizing a pre-trained CAN to some target design task or to the designer’s preferences. We discuss how to achieve this by combining CANs with coactive learning, a very natural mixed-initiate interaction protocol that acquires the necessary supervision from the designer in a transparent manner. Finally, we illustrate how to extend coactive learning to acquire informative supervision in the form of interpretable constraints.

Co-creating Platformer Levels with Constrained Adversarial Networks / Morettin, Paolo; Passerini, Andrea; Teso, Stefano. - 2903:(2021). (Intervento presentato al convegno 2nd Workshop on Human-AI Co-Creation with Generative Models tenutosi a virtual nel 13-17, April 2021).

Co-creating Platformer Levels with Constrained Adversarial Networks

Morettin, Paolo;Passerini, Andrea;Teso, Stefano
2021-01-01

Abstract

Given the success of deep generative models in many creative tasks, it is natural to ask how to best leverage them to support human designers. We study this problem in the context of mixed-initiative design of platformer levels, a paradigmatic co-creative task. This setting is especially challenging, because – like all functional content – platformer levels must satisfy complex validity constraints, like coherency and playability. We explore mixed-initiative interaction with constrained adversarial networks (CANs), a class of deep generative models that synthesize structures satisfying one or more validity constraints. As such, CANs can be used to complete user-supplied partial levels while retaining full control of the constraints to be applied. We go one step beyond, and consider the issue of customizing a pre-trained CAN to some target design task or to the designer’s preferences. We discuss how to achieve this by combining CANs with coactive learning, a very natural mixed-initiate interaction protocol that acquires the necessary supervision from the designer in a transparent manner. Finally, we illustrate how to extend coactive learning to acquire informative supervision in the form of interpretable constraints.
2021
Joint Proceedings of the ACM IUI 2021 Workshops
online
CEUR Workshop Proceedings
Morettin, Paolo; Passerini, Andrea; Teso, Stefano
Co-creating Platformer Levels with Constrained Adversarial Networks / Morettin, Paolo; Passerini, Andrea; Teso, Stefano. - 2903:(2021). (Intervento presentato al convegno 2nd Workshop on Human-AI Co-Creation with Generative Models tenutosi a virtual nel 13-17, April 2021).
File in questo prodotto:
File Dimensione Formato  
cocan___hai_gen_21.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 611.72 kB
Formato Adobe PDF
611.72 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/364928
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact