Automatically constructing a complete documentary or educational film from scattered pieces of images and knowledge is a significant challenge. Even when this information is provided in an annotated format, the problems of ordering, structuring and animating sequences of images, and producing natural language descriptions that correspond to those images within multiple constraints, are each individually difficult tasks. This paper describes an approach for tackling these problems through a combination of rhetorical structures with narrative and film theory to produce movie-like visual animations from still images along with natural language generation techniques needed to produce text descriptions of what is being seen in the animations. The use of rhetorical structures from NLG is used to integrate separate components for video creation and script generation. We further describe an implementation, named Glamour, that produces actual, short video documentaries, focusing on a cultural heritage domain, and that have been evaluated by professional filmmakers. © 2005 Elsevier B.V. All rights reserved.

Automatic cinematography and multilingual NLG for generating video documentaries / Callaway, C.; Not, E.; Novello, A.; Rocchi, C.; Stock, O.; Zancanaro, M.. - In: ARTIFICIAL INTELLIGENCE. - ISSN 0004-3702. - 165:1(2005), pp. 57-89. [10.1016/j.artint.2005.02.001]

Automatic cinematography and multilingual NLG for generating video documentaries

Callaway C.;Rocchi C.;Stock O.;Zancanaro M.
2005

Abstract

Automatically constructing a complete documentary or educational film from scattered pieces of images and knowledge is a significant challenge. Even when this information is provided in an annotated format, the problems of ordering, structuring and animating sequences of images, and producing natural language descriptions that correspond to those images within multiple constraints, are each individually difficult tasks. This paper describes an approach for tackling these problems through a combination of rhetorical structures with narrative and film theory to produce movie-like visual animations from still images along with natural language generation techniques needed to produce text descriptions of what is being seen in the animations. The use of rhetorical structures from NLG is used to integrate separate components for video creation and script generation. We further describe an implementation, named Glamour, that produces actual, short video documentaries, focusing on a cultural heritage domain, and that have been evaluated by professional filmmakers. © 2005 Elsevier B.V. All rights reserved.
1
Callaway, C.; Not, E.; Novello, A.; Rocchi, C.; Stock, O.; Zancanaro, M.
Automatic cinematography and multilingual NLG for generating video documentaries / Callaway, C.; Not, E.; Novello, A.; Rocchi, C.; Stock, O.; Zancanaro, M.. - In: ARTIFICIAL INTELLIGENCE. - ISSN 0004-3702. - 165:1(2005), pp. 57-89. [10.1016/j.artint.2005.02.001]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11572/272707
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 29
  • ???jsp.display-item.citation.isi??? 14
social impact