Journal of Machine and Computing


Highway Self-Attention Dilated Casual Convolutional Neural Network Based Short Term Load Forecasting in Micro Grid



Journal of Machine and Computing

Received On : 04 February 2023

Revised On : 20 May 2023

Accepted On : 20 June 2023

Published On : 05 October 2023

Volume 03, Issue 04

Pages : 394-407


Abstract


Forecasting the electricity load is crucial for power system planning and energy management. Since the season of the year, weather, weekdays, and holidays are the key aspects that have an effect on the load consumption, it is difficult to anticipate the future demands. Therefore, we proposed a weather-based short-term load forecasting framework in this paper. First, the missing data is filled, and data normalisation is performed in the pre-processing step. Normalization accelerates convergence and improves network training efficiency by preventing gradient explosion during the training phase. Then the weather, PV, and load features are extracted and fed into the proposed Highway Self-Attention Dilated Casual Convolutional Neural Network (HSAD-CNN) forecasting model. The dilated casual convolutions increase the receptive field without significantly raising computing costs. The multi-head self-attention mechanism (MHSA) gives importance to the most significant time steps for a more accurate forecast. The highway skip network (HS-Net) uses shortcut paths and skip connections to improve the information flow. This speed up the network convergence and prevents feature reuse, vanishing gradients, and negative learning problems. The performance of the HSAD-CNN forecasting technique is evaluated and compared to existing techniques under different day types and seasonal changes. The outcomes indicate that the HSAD-CNN forecasting model has low Mean Absolute Error (MAE), Mean Squared Error (MSE), Mean Absolute Percentage Error (MAPE), and a high R2.


Keywords


Load Forecasting, Micro Grid, Neural Network, Attention, Energy Management.


  1. J. Cronin, G. Anandarajah, and O. Dessens, “Climate change impacts on the energy system: a review of trends and gaps,” Climat ic Change, vol. 151, no. 2, pp. 79–93, Aug. 2018, doi: 10.1007/s10584-018-2265-4.
  2. H. C. Bloomfield et al., “Quantifying the sensitivity of european power systems to energy scenarios and climate change projections,” Renewable Energy, vol. 164, pp. 1062–1075, Feb. 2021, doi: 10.1016/j.renene.2020.09.125.
  3. A. Q. Al-Shetwi, M. A. Hannan, K. P. Jern, M. Mansur, and T. M. I. Mahlia, “Grid-connected renewable energy sources: Review of the recent integration requirements and control methods,” Journal of Cleaner Production, vol. 253, p. 119831, Apr. 2020, doi: 10.1016/j.jclepro.2019.119831.
  4. X. Liang and C. Andalib -Bin- Karim, “Harmonics and Mitigation Techniques Through Advanced Control in Grid-Connected Renewable Energy Sources: A Review,” IEEE Transactions on Industry Applications, vol. 54, no. 4, pp. 3100–3111, Jul. 2018, doi: 10.1109/tia.2018.2823680.
  5. B. Marinescu, O. Gomis-Bellmunt, F. Dorfler, H. Schulte, and L. Sigrist, “Dynamic Virtual Power Plant: A New Concept for Grid Integration of Renewable Energy Sources,” IEEE Access, vol. 10, pp. 104980–104995, 2022, doi: 10.1109/access.2022.3205731.
  6. M. F. Roslan, M. A. Hannan, P. J. Ker, and M. N. Uddin, “Microgrid control methods toward achieving sustainable energy management,” Applied Energy, vol. 240, pp. 583–607, Apr. 2019, doi: 10.1016/j.apenergy.2019.02.070.
  7. N. Nasser and M. Fazeli, “Buffered-Microgrid Structure for Future Power Networks; a Seamless Microgrid Control,” IEEE Transactions on Smart Grid, vol. 12, no. 1, pp. 131–140, Jan. 2021, doi: 10.1109/tsg.2020.3015573.
  8. F. Rodríguez, A. M. Florez-Tapia, L. Fontán, and A. Galarza, “Very short-term wind power density forecasting through artificial neural networks for microgrid control,” Renewable Energy, vol. 145, pp. 1517–1527, Jan. 2020, doi: 10.1016/j.renene.2019.07.067.
  9. F. Zheng, X. Lin, Y. Lin, Y. Zhang, and Y. Zhang, “Design of a Novel Hybrid Control Strategy for ES Grid-Connected Inverter for Smooth Microgrid Transition Operation,” IEEE Access, vol. 7, pp. 171950–171965, 2019, doi: 10.1109/access.2019.2955713.
  10. G. Wang, X. Wang, and X. Gao, “Improved Seamless Switching Control Strategy for AC/DC Hybrid Microgrid,” IEEE Access, vol. 9, pp. 55790–55801, 2021, doi: 10.1109/access.2021.3071821.
  11. E. Samadi, A. Badri, and R. Ebrahimpour, “Decentralized multi-agent based energy management of microgrid using reinforcement learning,” International Journal of Electrical Power & Energy Systems, vol. 122, p. 106211, Nov. 2020, doi: 10.1016/j.ijepes.2020.10 6211.
  12. F. S. Al-Ismail, “DC Microgrid Planning, Operation, and Control: A Comprehensive Review,” IEEE Access, vol. 9, pp. 36154–36172, 2021, doi: 10.1109/access.2021.3062840.
  13. D. A. Gadanayak, “Protection algorithms of microgrids with inverter interfaced distributed generation units—A review,” Electric Power Systems Research, vol. 192, p. 106986, Mar. 2021, doi: 10.1016/j.epsr.2020.106986.
  14. W. Violante, C. A. Canizares, M. A. Trovato, and G. Forte, “An Energy Management System for Isolated Microgrids With Thermal Energy Resources,” IEEE Transactions on Smart Grid, vol. 11, no. 4, pp. 2880–2891, Jul. 2020, doi: 10.1109/tsg.2020.2973321.
  15. S. Aslam, H. Herodotou, S. M. Mohsin, N. Javaid, N. Ashraf, and S. Aslam, “A survey on deep learning methods for power load a nd renewable energy forecasting in smart microgrids,” Renewable and Sustainable Energy Reviews, vol. 144, p. 110992, Jul. 2021, doi: 10.1016/j.rser.2021.110992.
  16. S. H. Rafi, Nahid-Al-Masood, S. R. Deeba, and E. Hossain, “A Short-Term Load Forecasting Method Using Integrated CNN and LSTM Network,” IEEE Access, vol. 9, pp. 32436–32448, 2021, doi: 10.1109/access.2021.3060654.
  17. H. J. Sadaei, P. C. de Lima e Silva, F. G. Guimarães, and M. H. Lee, “Short-term load forecasting by using a combined method of convolutional neural networks and fuzzy time series,” Energy, vol. 175, pp. 365–377, May 2019, doi: 10.1016/j.energy.2019.03.081.
  18. A. Yang, W. Li, and X. Yang, “Short-term electricity load forecasting based on feature selection and Least Squares Support Vector Machines,” Knowledge-Based Systems, vol. 163, pp. 159–173, Jan. 2019, doi: 10.1016/j.knosys.2018.08.027.
  19. H. H. H. Aly, “A proposed intelligent short-term load forecasting hybrid models of ANN, WNN and KF based on clustering techniques for smart grid,” Electric Power Systems Research, vol. 182, p. 106191, May 2020, doi: 10.1016/j.epsr.2019.106191.
  20. D. Arcos-Aviles et al., “An Energy Management System Design Using Fuzzy Logic Control: Smoothing the Grid Power Profile of a Residential Electro-Thermal Microgrid,” IEEE Access, vol. 9, pp. 25172–25188, 2021, doi: 10.1109/access.2021.3056454.
  21. D. Klutz, “Neurofeedback for Cognitive Enhancement, Intervention and Brain Plasticity,” Journal of Biomedical and Sustainable Healthcare Applications, pp. 45–55, Jan. 2023, doi: 10.53759/0088/jbsha202303005.
  22. W. Dong, Q. Yang, X. Fang, and W. Ruan, “Adaptive optimal fuzzy logic-based energy management in multi-energy microgrid considering operational uncertainties,” Applied Soft Computing, vol. 98, p. 106882, Jan. 2021, doi: 10.1016/j.asoc.2020.106882.
  23. A. A. Muzumdar, C. N. Modi, M. G. M, and C. Vyjayanthi, “Designing a Robust and Accurate Model for Consumer-Centric Short-Term Load Forecasting in Microgrid Environment,” IEEE Systems Journal, vol. 16, no. 2, pp. 2448–2459, Jun. 2022, doi: 10.1109/jsyst.2021.3073493.
  24. Y. Li, R. Wang, and Z. Yang, “Optimal Scheduling of Isolated Microgrids Using Automated Reinforcement Learning-Based Multi-Period Forecasting,” IEEE Transactions on Sustainable Energy, vol. 13, no. 1, pp. 159–169, Jan. 2022, doi: 10.1109/tste.2021.3105529.
  25. H. Zang et al., “Residential load forecasting based on LSTM fusing self-attention mechanism with pooling,” Energy, vol. 229, p. 120682, Aug. 2021, doi: 10.1016/j.energy.2021.120682.
  26. M. Massaoudi, S. S. Refaat, I. Chihi, M. Trabelsi, F. S. Oueslati, and H. Abu-Rub, “A novel stacked generalization ensemble-based hybrid LGBM-XGB-MLP model for Short-Term Load Forecasting,” Energy, vol. 214, p. 118874, Jan. 2021, doi: 10.1016/j.energy.2020.118874.
  27. H. Shi, L. Wang, R. Scherer, M. Wozniak, P. Zhang, and W. Wei, “Short-Term Load Forecasting Based on Adabelief Optimized Temporal Convolutional Network and Gated Recurrent Unit Hybrid Neural Network,” IEEE Access, vol. 9, pp. 66965–66981, 2021, doi: 10.1109/access.2021.3076313.
  28. S. H. Rafi, Nahid-Al-Masood, S. R. Deeba, and E. Hossain, “A Short-Term Load Forecasting Method Using Integrated CNN and LSTM Network,” IEEE Access, vol. 9, pp. 32436–32448, 2021, doi: 10.1109/access.2021.3060654.
  29. Y. Hong, Y. Chan, Y. Cheng, Y. Lee, J. Jiang, and S. Wang, “Week‐ahead daily peak load forecasting using genetic algorithm‐based hybrid convolutional neural network,” IET Generation, Transmission & Distribution, vol. 16, no. 12, pp. 2416–2424, Mar. 2022, doi: 10.1049/gtd2.12460.
  30. Y. Yang, Z. Wang, Y. Gao, J. Wu, S. Zhao, and Z. Ding, “An effective dimensionality reduction approach for short-term load forecasting,” Electric Power Systems Research, vol. 210, p. 108150, Sep. 2022, doi: 10.1016/j.epsr.2022.108150.
  31. R. Gao, L. Du, P. N. Suganthan, Q. Zhou, and K. F. Yuen, “Random vector functional link neural network based ensemble deep learning for short-term load forecasting,” Expert Systems with Applications, vol. 206, p. 117784, Nov. 2022, doi: 10.1016/j.eswa.2022.117784.
  32. S. Surana, K. Pathak, M. Gagnani, V. Shrivastava, M. T. R, and S. Madhuri G, “Text Extraction and Detection from Images using Machine Learning Techniques: A Research Review,” 2022 International Conference on Electronics and Renewable Systems (ICEARS), Mar. 20 22, doi: 10.1109/icears53579.2022.9752274.
  33. M. T R, “An Efficient Ensemble Method Using K-Fold Cross Validation for the Early Detection of Benign and Malignant Breast Cancer,” International Journal of Integrated Engineering, vol. 14, no. 7, Dec. 2022, doi: 10.30880/ijie.2022.14.07.015.
  34. B. N. . V. S., A. . Kumar Bhagat, C. . C., B. . Sulaiman Alfurhood, A. . Pratap Singh, and M. . T. R., “Blockchain Based De-Duplication Analysis of Cloud Data with Data Integrity using Policy Based Encryption Technique in Cloud Storage”, Int J Intell Syst Appl Eng, vol. 11, no. 3s, pp. 161–164, Feb. 2023.

Acknowledgements


Author(s) thanks to Dr.Narayana Swamy Ramaiah for this research completion and support.


Funding


No funding was received to assist with the preparation of this manuscript.


Ethics declarations


Conflict of interest

The authors have no conflicts of interest to declare that are relevant to the content of this article.


Availability of data and materials


No data available for above study.


Author information


Contributions

All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.


Corresponding author


Rights and permissions


Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/


Cite this article


Shreenidhi H S and Narayana Swamy Ramaiah, “Highway Self-Attention Dilated Casual Convolutional Neural Network Based Short Term Load Forecasting in Micro Grid”, Journal of Machine and Computing, vol.3, no.4, pp. 394-407, October 2023. doi: 10.53759/7669/jmc202303033.


Copyright


© 2023 Shreenidhi H S and Narayana Swamy Ramaiah. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.