Campus Units

Electrical and Computer Engineering

Document Type

Conference Proceeding


2018 IEEE International Conference on Communications (ICC)

Publication Version

Accepted Manuscript

Link to Published Version

Publication Date


Journal or Book Title

2018 IEEE International Conference on Communications (ICC)



Conference Title

2018 IEEE International Conference on Communications (ICC)

Conference Date

May 20-24, 2018


Kansas City, MO


Prolonging the lifetime, and maximizing the throughput are important factors in designing an efficient communications system, especially for energy harvesting-based systems. In this work, the problem of maximizing the throughput of point-to-point energy harvesting communications system, while prolonging its lifetime is investigated. This work considers more real communications system, where this system does not have a priori knowledge about the environment. This system consists of a transmitter and receiver. The transmitter is equipped with an infinite buffer to store data, and energy harvesting capability to harvest renewable energy and store it in a finite battery. The problem of finding an efficient power allocation policy is formulated as a reinforcement learning problem. Two different exploration algorithms are used, which are the convergence-based and the epsilon-greedy algorithms. The first algorithm uses the action-value function convergence error and the exploration time threshold to balance between exploration and exploitation. On the other hand, the second algorithm tries to achieve balancing through the exploration probability (i.e. epsilon). Simulation results show that the convergence-based algorithm outperforms the epsilon-greedy algorithm. Then, the effects of the parameters of each algorithm are investigated.


This is a manuscript of a proceeding published as Masadeh, Alaeddin, Zhengdao Wang, and Ahmed E. Kamal. "Reinforcement Learning Exploration Algorithms for Energy Harvesting Communications Systems." In 2018 IEEE International Conference on Communications (ICC). 2018. DOI: 10.1109/ICC.2018.8422710. Posted with permission.


© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Copyright Owner




File Format


Published Version


Article Location