Talk · International Conference on Electronics, Computer and Computation · November 1, 2018

Reinforcement Learning Intersection Controller

Gulnur Tolebi, N. S. Dairbekov, Daniyar Kurmankhojayev, Ravil Mussabayev

Abstract

This paper presents an online model-free adaptive traffic signal controller for an isolated intersection using a Reinforcement Learning (RL) approach. We base our solution on the Q-learning algorithm with action-value approximation. In contrast with other studies in the field, we use the queue length in adddition to the average delay as a measure of performance. Also, the number of queuing vehicles and the green phase duration in four directions are aggregated to represent a state. The duration of phases is a precise value for the nonconflicting directions. Therefore, cycle length is non-fixed. Finally, we analyze and update the equilibrium and queue reduction terms in our previous equation of an immediate reward. Also, the delay based reward is tested in the given control system. The performance of the proposed method is compared with an optimal symmetric fixed signal plan.

Traffic control and managementTraffic Prediction and Management TechniquesReinforcement Learning in Roboticstraffic signal controlreinforcement learningQ-learning

Reinforcement Learning Intersection Controller

Abstract

More by Nurlan Dairbekov