Safe, Efficient, and Comfortable Velocity Control based on Reinforcement Learning for Autonomous Driving
By Meixin Zhu, Yinhai Wang, Jingyun Hu, X. Wang, Ruimin Ke. Transportation Research Part C: Emerging Technologies, 2019
419 citations recorded by the source corpus.
Abstract A model used for velocity control during car following is proposed based on reinforcement learning (RL). To optimize driving performance, a reward function is developed by referencing human driving data and combining driving features related to safety, efficiency, and comfort. With the developed reward function, the RL agent learns to control vehicle speed in a fashion that maximizes cumulative rewards, through trials and errors in the simulation environment. To avoid potential unsafe actions, the proposed RL model is incorporated with a collision avoidance strategy for safety checks. The safety check strategy is used during both model training and testing phases, which results in faster convergence and zero collisions. A total of 1,341 car-following events extracted from the Next Generation Simulation (NGSIM) dataset are used to train and test the proposed model. The performance of the proposed model is evaluated by the comparison with empirical NGSIM data and with adaptive cruise control (ACC) algorithm implemented through model predictive control (MPC). The experimental results show that the proposed model demonstrates the capability of safe, efficient, and comfortable velocity control and outperforms human drivers in that it 1) has larger TTC values than those of human drivers, 2) can maintain efficient and safe headways around 1.2s, and 3) can follow the lead vehicle comfortably with smooth acceleration (jerk value is only a third of that of human drivers). Compared with the MPC-based ACC algorithm, the proposed model has better performance in terms of safety, comfort, and especially running speed during testing (more than 200 times faster). The results indicate that the proposed approach could contribute to the development of better autonomous driving systems. Source code of this paper can be found at https://github.com/MeixinZhu/Velocity_control .
Subfields: Automotive Engineering, Control and Systems Engineering, Safety, Risk, Reliability and Quality
View Paper: https://www.semanticscholar.org/paper/fb1c46d24fadc748020b8d70a52a13e968c1a8d7
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Automotive Engineering
In Control and Systems Engineering
In Safety, Risk, Reliability and Quality
Citations in the corpus
- Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles (2020, background): “Reward systems use the collision of the two vehicles as a failure naturally, while the performance of the agent is based on the jerk, TTC (time to collision) [50], or passenger comfort [77].”