This paper presents a novel approach to learning predictive motor control via “mental simulations”. The method, inspired by learning via mental imagery in natural Cognition, develops in two phases: first, the learning of predictive models based on data recorded in the interaction with the environment; then, at a deferred time, the synthesis of inverse models via offline episodic simulations. Parallelism with human-engineered control-theoretic workflow (mathematical modeling the direct dynamics followed by optimal control inversion) is established. Compared to the latter human-directed synthesis, the mental simulation approach increases autonomy: a robotic agent can learn predictive models and synthesize inverse ones with a large degree of independence. Human modeling is still needed but limited to providing efficient templates for the forward and inverse neural networks and a few other directives. One could consider these templates as the efficient brain network typologies that evolution produced to permit live beings quickly and efficiently learning. The structure of the neural networks —both forward and inverse ones— is made of interpretable “local models”, which follows the cerebellar organization (and are also similar to local model approaches known in the literature). We demonstrate the learning of a first-round model (contrasted to Model Predictive Control) for lateral vehicle dynamics. Then, we demonstrate a second learning iteration, where the forward/inverse neural models are significantly improved.

A Mental Simulation Approach for Learning Neural-Network Predictive Control (in Self-Driving Cars) / Da Lio, Mauro; Donà, Riccardo; Rosati Papini, Gastone Pietro; Biral, Francesco; Svensson, Henrik. - In: IEEE ACCESS. - ISSN 2169-3536. - 2020:8(2020), pp. 192041-192064. [10.1109/ACCESS.2020.3032780]

A Mental Simulation Approach for Learning Neural-Network Predictive Control (in Self-Driving Cars)

MAURO DA LIO;RICCARDO DONÀ;GASTONE PIETRO ROSATI PAPINI;FRANCESCO BIRAL;
2020-01-01

Abstract

This paper presents a novel approach to learning predictive motor control via “mental simulations”. The method, inspired by learning via mental imagery in natural Cognition, develops in two phases: first, the learning of predictive models based on data recorded in the interaction with the environment; then, at a deferred time, the synthesis of inverse models via offline episodic simulations. Parallelism with human-engineered control-theoretic workflow (mathematical modeling the direct dynamics followed by optimal control inversion) is established. Compared to the latter human-directed synthesis, the mental simulation approach increases autonomy: a robotic agent can learn predictive models and synthesize inverse ones with a large degree of independence. Human modeling is still needed but limited to providing efficient templates for the forward and inverse neural networks and a few other directives. One could consider these templates as the efficient brain network typologies that evolution produced to permit live beings quickly and efficiently learning. The structure of the neural networks —both forward and inverse ones— is made of interpretable “local models”, which follows the cerebellar organization (and are also similar to local model approaches known in the literature). We demonstrate the learning of a first-round model (contrasted to Model Predictive Control) for lateral vehicle dynamics. Then, we demonstrate a second learning iteration, where the forward/inverse neural models are significantly improved.
8
Da Lio, Mauro; Donà, Riccardo; Rosati Papini, Gastone Pietro; Biral, Francesco; Svensson, Henrik
A Mental Simulation Approach for Learning Neural-Network Predictive Control (in Self-Driving Cars) / Da Lio, Mauro; Donà, Riccardo; Rosati Papini, Gastone Pietro; Biral, Francesco; Svensson, Henrik. - In: IEEE ACCESS. - ISSN 2169-3536. - 2020:8(2020), pp. 192041-192064. [10.1109/ACCESS.2020.3032780]
File in questo prodotto:
File Dimensione Formato  
09234399.pdf

accesso aperto

Descrizione: versione editoriale dell'articolo
Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 3.48 MB
Formato Adobe PDF
3.48 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/278575
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 10
  • ???jsp.display-item.citation.isi??? 4
social impact