Real-Time Scheduling for Electric Vehicles Charging/Discharging Using Reinforcement Learning
Abstract
With the increase in Electric Vehicles (EVs) penetration, their charging needs form an additional burden on the grid. Thus, charging coordination is necessary for safe and efficient EV use. The scheduling of EVs is especially essential in Vehicle-to-Grid schemes, where EVs energy cost can be reduced by intelligently managing the charging and discharging according to real-time prices and owners' needs. Further, utilities can perform load shifting by price-based demand-response programs. However, the scheduling problem is challenging in the presence of multiple unknown variables, such as real-time prices, commuting behavior, and energy needs. Most of the scheduling techniques attempt to model the system uncertainties (e.g., forecast prices) and plan accordingly. In this paper, we propose the use of a model-free Reinforcement Learning (RL) technique that can deduce a charging/discharging strategy without requiring any model of the system. We evaluate the performance of the proposed system with real-world data and investigate the learned charging/discharging pattern to show the effectiveness of the proposed method.
Collections
- Electrical Engineering [2811 items ]
- Information Intelligence [93 items ]
Related items
Showing items related by title, author, creator and subject.
-
On the effect of proportional fairness in energy transfer for wireless powered communication networks
Butt M.M.; Mohamed A.; Guizani M. ( Institute of Electrical and Electronics Engineers Inc. , 2015 , Conference)Wireless powered communication network (WPCN) is an emerging area of research where energy is transferred from the access point to the mobile terminals in the downlink and information is transferred in the uplink. In the ... -
Exploring blind online scheduling for mobile cloud multimedia services
Zhou, Liang; Yang, Zhen; Rodrigues, Joel J.P.C.; Guizani, Mohsen (2013 , Article)Mobile cloud is a new emerging technology which can be used to enable users to enjoy abundant multimedia applications in a pervasive computing environment. Therefore, the scheduling of massive multimedia flows with ... -
A support vector machine-based method for LPV-ARX identification with noisy scheduling parameters
Abbasi, F.; Mohammadpour, J.; Toth, R.; Meskin, Nader ( Institute of Electrical and Electronics Engineers Inc. , 2014 , Conference)In this paper, we present a method that utilizes support vector machines (SVM) to identify linear parameter-varying (LPV) auto-regressive exogenous input (ARX) models corrupted by not only noise, but also uncertainties in ...