As the number of IoT devices increases, power management of the cluster head, which acts as a gateway between the cluster and sink nodes in the IoT network, becomes crucial. Particularly when the cluster head is a mobile wireless terminal, the power consumption of the IoT network must be minimized over its lifetime. In addition, the delay of information transmission in the IoT network is one of the primary metrics for rapid information collecting in the IoT network. In this paper, we propose a low-power buffer management algorithm that takes into account the information transmission delay in an IoT network. By forwarding or skipping received packets utilizing deep Q learning employed in deep reinforcement learning methods, the suggested method is able to reduce power consumption while decreasing transmission delay level. The proposed approach is demonstrated to reduce power consumption and to improve delay relative to the existing buffer management technique used as a comparison in slotted ALOHA protocol.
M. T. Lazarescu, “Design of a wsn platform for long-term environmental monitoring for iot applications,” IEEE Journal on emerging and selected topics in circuits and systems, Vol.3, No.1, pp.45-54, 2013.
W. R. Heinzelman, A. Chandrakasan, and H. Balakrishnan, “Energy-efficient communication protocol for wireless microsensor networks.” IEEE Proceedings of the 33rd annual Hawaii international conference on system sciences, p.223, 2000.
I. Gupta, D. Riordan, and S. Sampalli, “Cluster-head election using fuzzy logic for wireless sensor networks,” IEEE 3rd Annual Communication Networks and Services Research Conference (CNSR'05), 2005.
A. K. Dwivedi and A. K. Sharma, “EE-LEACH: energy enhancement in LEACH using fuzzy logic for homogeneous WSN,” Wireless Personal Communications, Vol.120, pp.3035-3055, 2021.
B. Manzoor, N. Javaid, O. Rehman, M. Akbar, Q. Nadeem, A. Iqbal, and M. Ishfaq, “Q-LEACH: A new routing protocol for WSNs,” Vol.19. pp.926-931, 2013.
M. E. Haque, T. Hossain, M. R. Sarker, M. Paul, M. S. Hoque, S. Uddin, A. A. Suman, M. H. M. Saad, and T. U. Huque, “A hybrid approach to enhance the lifespan of wsns in nuclear power plant monitoring system,” Scientific Reports, Vol.12(1), pp.1-14, 2022.
G. A. Senthil, A. Raaza, and N. Kumar, “Internet of things energy efficient cluster-based routing using hybrid particle swarm optimization for wireless sensor network,” Wireless Personal Communications, Vol.122, pp.2603–2619, 2022.
R. Maheswar, P. Jayarajan, S. Vimalraj, G. Sivagnanam, V. Sivasankaran, and I. S. Amiri, “Energy efficient real time environmental monitoring system using buffer management protocol; energy efficient real time environmental monitoring system using buffer management protocol,” IEEE 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 2018.
D. Hosahalli and K. G. Srinivas, “Enhanced reinforcement learning assisted dynamic power management model for internet-of-things centric wireless sensor network,” IET Communications, Vol.14, pp.3748–3760, 2020.
H. A. Alwasef, “An energy-efficient buffer management scheme based on data integrity and multivariate data reduction for wireless sensor networks,” Journal of Control Engineering and Applied Informatics, Vol.23, No.3, pp.53–61, 2021.
S. Merlin, G. Barriac, H. Sampath, L. Cariou, T. Derham, J.-P. L. Rouzic, R. Stacey, M. Park, C. Ghosh, R. Porat, N. Jindal, Y. Inoue, Y. Asai, Y. Takatori, A. Kishida, A. Yamada, R. Hedayat, S. Choudhury, K. Doppler, J. Kneckt, E.-H. Rantala, D. X. Yang, Y. (Ross), Z. Lan, J. Zhang, Y. Li, Y. Li, J. Pang, H. Su, Y. Lin, W. Lee, H. Cho, S. Kim, H. Choi, J. Levy, F. L. Sita, J. Jiang, L. Chu, Y. Sun, F. Mestanov, G. Li, S. Marin, E. Sakai, W. Carney, B. Sun, K. Lv, Y. Ke, H. Zhiqiang, C.-C. Wang, R. Huang, C. Yu, J. Yee, E. Wong, J. Kim, and X. Wang, “TGax Simulation Scenarios.” [Online]. Available:https://mentor.ieee.org/802.11/dcn/14/11-14-0980-16-00ax-simulation-scenarios.docx
“Gym Documentation.” [Online]. Available:https://www.gymlibrary.ml
“NumPy.” [Online]. Available: https://numpy.org
“PyTorch.” [Online]. Available: https://pytorch.org
T. J. Ott, T. V. Lakshman, and L. H. Wong, “Sred:Stabilized red,” IEEE INFOCOM'99, Vol.3, pp.1346–1355, 1999.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” 2014. [Online]. Available:https://arxiv.org/abs/1412.6980