Real-Time Optimization of Urban Rail Transit Train Scheduling via Advantage Actor–Critic Deep Reinforcement Learning

Abstract

Under the condition of urban rail transit uncertainty of passenger demand and the high frequency of departure intervals, this study presents an innovative real-time urban rail transit (URT) train service scheduling control framework. In the context of a bidirectional urban rail transit line, a high-fidelity urban rail transit simulation environment was constructed. Within this environment, an advantage actor–critic (A2C) reinforcement learning approach was utilized to train a suitable strategy aimed at minimizing both passenger waiting costs and transit authority operational expenses. Subject to specific constraints, the strategy is designed to generate real-time train schedule based on the representation of traffic state using station congestion levels and train positions. Experimental results on Lines 3 and S7 of Nanjing Metro demonstrated the agent’s effectiveness in achieving high-performance schedules across various scenarios. This research integrates deep reinforcement learning into the optimization of dynamic traffic systems, showing great potential for enhancing the efficiency and resilience of urban transport systems.