TY - GEN
T1 - Optimal Control and Reinforcement Learning for Robot
T2 - 17th EAI International Conference on Collaborative Computing: Networking, Applications, and Worksharing, CollaborateCom 2021
AU - Feng, Haodong
AU - Yu, Lei
AU - Chen, Yuqing
N1 - Funding Information:
This work was supported by the Research Development Fund RDF-20-01-08 provided by Xi’an Jiaotong-Liverpool University.
Publisher Copyright:
© 2021, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
PY - 2021
Y1 - 2021
N2 - Along with the development of systems and their applications, conventional control approaches are limited by system complexity and functions. The development of reinforcement learning and optimal control has become an impetus of engineering, which has show large potentials on automation. Currently, the optimization applications on robot are facing challenges caused by model bias, high dimensional systems, and computational complexity. To solve these issues, several researches proposed available data-driven optimization approaches. This survey aims to review the achievements on optimal control and reinforcement learning approaches for robots. This is not a complete and exhaustive survey, but provides some latest and remarkable achievements for optimal control of robots. It introduces the background and facing problem statement at the beginning. The developments of the solutions to existed issues for robot control and some notable control methods in these areas are reviewed briefly. In addition, the survey discusses the future development prospects from four aspects as research directions to achieve improving the efficiency of control, the artificial assistant learning, the applications in extreme environment and related subjects. The interdisciplinary researches are essential for engineering fields based on optimal control methods according to the perspective; which would not only promote engineering equipment to be more intelligent, but extend applications of optimal control approaches.
AB - Along with the development of systems and their applications, conventional control approaches are limited by system complexity and functions. The development of reinforcement learning and optimal control has become an impetus of engineering, which has show large potentials on automation. Currently, the optimization applications on robot are facing challenges caused by model bias, high dimensional systems, and computational complexity. To solve these issues, several researches proposed available data-driven optimization approaches. This survey aims to review the achievements on optimal control and reinforcement learning approaches for robots. This is not a complete and exhaustive survey, but provides some latest and remarkable achievements for optimal control of robots. It introduces the background and facing problem statement at the beginning. The developments of the solutions to existed issues for robot control and some notable control methods in these areas are reviewed briefly. In addition, the survey discusses the future development prospects from four aspects as research directions to achieve improving the efficiency of control, the artificial assistant learning, the applications in extreme environment and related subjects. The interdisciplinary researches are essential for engineering fields based on optimal control methods according to the perspective; which would not only promote engineering equipment to be more intelligent, but extend applications of optimal control approaches.
KW - Data-driven optimization
KW - Model bias
KW - Optimal control
KW - Reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=85122580270&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-92635-9_4
DO - 10.1007/978-3-030-92635-9_4
M3 - Conference Proceeding
AN - SCOPUS:85122580270
SN - 9783030926342
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 54
EP - 66
BT - Collaborative Computing
A2 - Gao, Honghao
A2 - Wang, Xinheng
PB - Springer Science and Business Media Deutschland GmbH
Y2 - 16 October 2021 through 18 October 2021
ER -