Optimal Greedy Control in Reinforcement Learning

Sensors (Basel). 2022 Nov 18;22(22):8920. doi: 10.3390/s22228920.


We consider the problem of dimensionality reduction of state space in the variational approach to the optimal control problem, in particular, in the reinforcement learning method. The control problem is described by differential algebraic equations consisting of nonlinear differential equations and algebraic constraint equations interconnected with Lagrange multipliers. The proposed method is based on changing the Lagrange multipliers of one subset based on the Lagrange multipliers of another subset. We present examples of the application of the proposed method in robotics and vibration isolation in transport vehicles. The method is implemented in FRUND-a multibody system dynamics software package.

Keywords: machine learning; optimal control; reinforcement learning; robotics; variational methods.

Grant support

This research received no external funding.