Optimal feedback control of dynamical systems via value-function approximation
A self-learning approach for optimal feedback gains for finite-horizon nonlinear continuous time control systems is proposed and analysed. It relies on parameter dependent approximations to the optimal value function obtained from a family of universal approximators. The cost functional for the trai...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Académie des sciences
2023-07-01
|
| Series: | Comptes Rendus. Mécanique |
| Subjects: | |
| Online Access: | https://comptes-rendus.academie-sciences.fr/mecanique/articles/10.5802/crmeca.199/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | A self-learning approach for optimal feedback gains for finite-horizon nonlinear continuous time control systems is proposed and analysed. It relies on parameter dependent approximations to the optimal value function obtained from a family of universal approximators. The cost functional for the training of an approximate optimal feedback law incorporates two main features. First, it contains the average over the objective functional values of the parametrized feedback control for an ensemble of initial values. Second, it is adapted to exploit the relationship between the maximum principle and dynamic programming. Based on universal approximation properties, existence, convergence and first order optimality conditions for optimal neural network feedback controllers are proved. |
|---|---|
| ISSN: | 1873-7234 |