We formulate a control problem for positive compartmental systems formed by nodes (buffers) and arcs (flows). Our main result is that, on a finite horizon, we can solve the Pontryagin equations in one shot without resorting to trial and error via shooting. As expected, the solution is bang–bang and the switching times can be easily determined. We are also able to find a cost-to-go-function, in an analytic form, by solving a simple nonlinear differential equation. On an infinite horizon, we consider the Hamilton–Jacobi–Bellman theory and we show that the HJB equation can be solved exactly. Moreover, we show that the optimal solution is constant and the cost-to-go function is linear and copositive. This function is the solution of a nonlinear equation. We propose an iterative scheme for solving this equation, which converges in finite time. We also show that an exact solution can be found if there is a positive external disturbance affecting the process and the problem is formulated in a min sup framework. We finally provide illustrative examples related to flood control and epidemiology. © 2022 Elsevier Ltd. All rights reserved

Optimal control of compartmental models: The exact solution / Blanchini, Franco; Bolzern, Paolo; Colaneri, Patrizio; De Nicolao, Giuseppe; Giordano, Giulia. - In: AUTOMATICA. - ISSN 0005-1098. - 147:(2023), p. 110680. [10.1016/j.automatica.2022.110680]

Optimal control of compartmental models: The exact solution

Giordano, Giulia
Ultimo
2023-01-01

Abstract

We formulate a control problem for positive compartmental systems formed by nodes (buffers) and arcs (flows). Our main result is that, on a finite horizon, we can solve the Pontryagin equations in one shot without resorting to trial and error via shooting. As expected, the solution is bang–bang and the switching times can be easily determined. We are also able to find a cost-to-go-function, in an analytic form, by solving a simple nonlinear differential equation. On an infinite horizon, we consider the Hamilton–Jacobi–Bellman theory and we show that the HJB equation can be solved exactly. Moreover, we show that the optimal solution is constant and the cost-to-go function is linear and copositive. This function is the solution of a nonlinear equation. We propose an iterative scheme for solving this equation, which converges in finite time. We also show that an exact solution can be found if there is a positive external disturbance affecting the process and the problem is formulated in a min sup framework. We finally provide illustrative examples related to flood control and epidemiology. © 2022 Elsevier Ltd. All rights reserved
2023
Blanchini, Franco; Bolzern, Paolo; Colaneri, Patrizio; De Nicolao, Giuseppe; Giordano, Giulia
Optimal control of compartmental models: The exact solution / Blanchini, Franco; Bolzern, Paolo; Colaneri, Patrizio; De Nicolao, Giuseppe; Giordano, Giulia. - In: AUTOMATICA. - ISSN 0005-1098. - 147:(2023), p. 110680. [10.1016/j.automatica.2022.110680]
File in questo prodotto:
File Dimensione Formato  
J061_2023_Automatica.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.28 MB
Formato Adobe PDF
2.28 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/364266
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 0
social impact