Journal of Machine and Computing


Enhancing Small Target Detection in Aerial Imagery with Bi-PAN-FPN and EDMOA-Optimized YOLOv8-s



Journal of Machine and Computing

Received On : 12 March 2024

Revised On : 22 April 2024

Accepted On : 18 July 2024

Published On : 05 October 2024

Volume 04, Issue 04

Pages : 908-917


Abstract


Across the globe, people are working to build "smart cities" that will employ technology to make people's lives better and safer. Installing cameras at strategic spots across the city to monitor public spaces besides provide real-time footage to law enforcement besides other local authorities is a crucial part of smart city infrastructure, which includes video surveillance. A more effective answer is provided by deep learning algorithms, however research in this area still faces significant problems from changes in target size, form change, occlusion, and illumination circumstances as seen from the drone's perspective. In light of the aforementioned issues, this study presents a highly effective and resilient approach for aerial picture identification. To begin, the concept of Bi-PAN-FPN is presented to enhance the neck component of YOLOv8-s, taking into consideration the prevalent issue of small targets being easily misdetected or ignored in aerial photos. We achieve a more advanced and thorough feature fusion procedure much as feasible by completely considering and reusing multiscale features. To further reduce the amount of parameters in the model and prevent info loss during long-distance feature transfer, the benchmark model's backbone incorporates the GhostblockV2 structure in lieu of a portion of the C2f module. With the help of the Enhanced Dwarf Mongoose Optimization Algorithm (EDMOA), the suggested model's hyper-parameters are optimised. Lastly, a dynamic nonmonotonic focusing mechanism is employed in conjunction with WiseIoU loss as bounding box regression loss. The detector accounts for varying anchor box quality by utilizing "outlier" evaluations, thus improving the complete presentation of the detection task.


Keywords


Video Surveillance, Enhanced Dwarf Mongoose Optimization Algorithm, GhostblockV2, Smart Cities, YOLOv8.


  1. A. A. Adegun, S. Viriri, and J.-R. Tapamo, “Review of deep learning methods for remote sensing satellite images classification: experimental survey and comparative analysis,” Journal of Big Data, vol. 10, no. 1, Jun. 2023, doi: 10.1186/s40537-023-00772-x.
  2. X. Liu, K. H. Ghazali, F. Han, and I. I. Mohamed, “Review of CNN in aerial image processing,” The Imaging Science Journal, vol. 71, no. 1, pp. 1–13, Jan. 2023, doi: 10.1080/13682199.2023.2174651.
  3. A. Thirumalraj, V. Asha, and B. P. Kavin, “An Improved Hunter-Prey Optimizer-Based DenseNet Model for Classification of Hyper-Spectral Images,” AI and IoT-Based Technologies for Precision Medicine, pp. 76–96, Oct. 2023, doi: 10.4018/979-8-3693-0876-9.ch005.
  4. H. Ouchra, A. Belangour, and A. Erraissi, “Machine Learning Algorithms for Satellite Image Classification Using Google Earth Engine and Landsat Satellite Data: Morocco Case Study,” IEEE Access, vol. 11, pp. 71127–71142, 2023, doi: 10.1109/access.2023.3293828.
  5. Ö. İNİK, “Havasal Görüntülerdeki Sahnelerin Derin Öğrenme Modelleri ile Sınıflandırılması,” Türk Doğa ve Fen Dergisi, vol. 12, no. 1, pp. 37–43, Mar. 2023, doi: 10.46810/tdfd.1225756.
  6. I. Papoutsis, N. I. Bountos, A. Zavras, D. Michail, and C. Tryfonopoulos, “Benchmarking and scaling of deep learning models for land cover image classification,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 195, pp. 250–268, Jan. 2023, doi: 10.1016/j.isprsjprs.2022.11.012.
  7. V. Revathi, B. P. Kavin, A. Thirumalraj, E. Gangadevi, B. Balusamy, and S. Gite, “Image Based Feature Separation Using RBM Tech with ADBN Tech for Accurate Fruit Classification,” 2024 IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT), Feb. 2024, doi: 10.1109/ic2pct60090.2024.10486564.
  8. P. Gadhave, P. Chaturvedi, S. Bera, A. Singh, and R. Joseph, “Post-Disaster Aerial Image Analysis Using Deep Learning and Image Processing,” Soft Computing for Security Applications, pp. 345–362, 2023, doi: 10.1007/978-981-99-3608-3_24.
  9. A. Bouguettaya, H. Zarzour, A. Kechida, and A. M. Taberkit, “A survey on deep learning-based identification of plant and crop diseases from UAV-based aerial images,” Cluster Computing, vol. 26, no. 2, pp. 1297–1317, Aug. 2022, doi: 10.1007/s10586-022-03627-x.
  10. F. Kateb and M. Ragab, “Archimedes Optimization with Deep Learning Based Aerial Image Classification for Cybersecurity Enabled UAV Networks,” Computer Systems Science and Engineering, vol. 47, no. 2, pp. 2171–2185, 2023, doi: 10.32604/csse.2023.039931.
  11. A. Clark, S. Phinn, and P. Scarth, “Optimised U-Net for Land Use–Land Cover Classification Using Aerial Photography,” PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science, vol. 91, no. 2, pp. 125–147, Feb. 2023, doi: 10.1007/s41064-023-00233-3.
  12. R. F. Mansour and E. Alabdulkreem, “Disaster Monitoring of Satellite Image Processing Using Progressive Image Classification,” Computer Systems Science and Engineering, vol. 44, no. 2, pp. 1161–1169, 2023, doi: 10.32604/csse.2023.023307.
  13. R. Jain et al., “Internet of Things-based smart vehicles design of bio-inspired algorithms using artificial intelligence charging system,” Nonlinear Engineering, vol. 11, no. 1, pp. 582–589, Jan. 2022, doi: 10.1515/nleng-2022-0242.
  14. Y. Li, Q. Fan, H. Huang, Z. Han, and Q. Gu, “A Modified YOLOv8 Detection Network for UAV Aerial Image Recognition,” Drones, vol. 7, no. 5, p. 304, May 2023, doi: 10.3390/drones7050304.
  15. T. Mollick, M. G. Azam, and S. Karim, “Geospatial-based machine learning techniques for land use and land cover mapping using a high-resolution unmanned aerial vehicle image,” Remote Sensing Applications: Society and Environment, vol. 29, p. 100859, Jan. 2023, doi: 10.1016/j.rsase.2022.100859.
  16. Mahaveerakannan R, C. Anitha, Aby K Thomas, S. Rajan, T. Muthukumar, and G. Govinda Rajulu, “An IoT based forest fire detection system using integration of cat swarm with LSTM model,” Computer Communications, vol. 211, pp. 37–45, Nov. 2023, doi: 10.1016/j.comcom.2023.08.020.
  17. N. Jahan, T. B. M. Niloy, J. F. Silvi, M. Hasan, I. J. Nashia, and R. Khan, “Development of an IoT-based firefighting drone for enhanced safety and efficiency in fire suppression,” Measurement and Control, Apr. 2024, doi: 10.1177/00202940241238674.
  18. B. Kovács, F. Vörös, T. Vas, K. Károly, M. Gajdos, and Z. Varga, “Safety and Security-Specific Application of Multiple Drone Sensors at Movement Areas of an Aerodrome,” Drones, vol. 8, no. 6, p. 231, May 2024, doi: 10.3390/drones8060231.
  19. A. Alsawy, D. Moss, A. Hicks, and S. McKeever, “An Image Processing Approach for Real-Time Safety Assessment of Autonomous Drone Delivery,” Drones, vol. 8, no. 1, p. 21, Jan. 2024, doi: 10.3390/drones8010021.
  20. A. ABDELHAK, D. Moss, A. Hicks, and S. mckeever, “An Image Processing Approach for Real-Time Safety Assessment of Autonomous Drone Delivery,” SSRN Electronic Journal, 2022, doi: 10.2139/ssrn.4192669.
  21. G. Chen, W. Du, T. Xu, S. Wang, X. Qi, and Y. Wang, “Investigating Enhanced YOLOv8 Model Applications for Large-Scale Security Risk Management and Drone-Based Low-Altitude Law Enforcement,” Highlights in Science, Engineering and Technology, vol. 98, pp. 390–396, May 2024, doi: 10.54097/fbxtqk26.
  22. R. H. Jacobsen et al., “Design of an Autonomous Cooperative Drone Swarm for Inspections of Safety Critical Infrastructure,” Applied Sciences, vol. 13, no. 3, p. 1256, Jan. 2023, doi: 10.3390/app13031256.
  23. C. Kyrkou and T. Theocharides, “EmergencyNet: Efficient Aerial Image Classification for Drone-Based Emergency Monitoring Using Atrous Convolutional Feature Fusion,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 13, pp. 1687–1699, 2020, doi: 10.1109/jstars.2020.2969809.
  24. K. Kamaraj, B. Lanitha, S. Karthic, P. N. Senthil Prakash, and R. Mahaveerakannan, “A Hybridized Artificial Neural Network for Automated Software Test Oracle,” Computer Systems Science and Engineering, vol. 45, no. 2, pp. 1837–1850, 2023, doi: 10.32604/csse.2023.029703.
  25. M. Tan, R. Pang, and Q. V. Le, “EfficientDet: Scalable and Efficient Object Detection,” 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2020, doi: 10.1109/cvpr42600.2020.01079.
  26. K. Han, Y. Wang, Q. Tian, J. Guo, C. Xu, and C. Xu, “GhostNet: More Features From Cheap Operations,” 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2020, doi: 10.1109/cvpr42600.2020.00165.
  27. J. O. Agushaka, A. E. Ezugwu, and L. Abualigah, “Dwarf Mongoose Optimization Algorithm,” Computer Methods in Applied Mechanics and Engineering, vol. 391, p. 114570, Mar. 2022, doi: 10.1016/j.cma.2022.114570.

Acknowledgements


Authors thank Reviewers for taking the time and effort necessary to review the manuscript.


Funding


No funding was received to assist with the preparation of this manuscript.


Ethics declarations


Conflict of interest

The authors have no conflicts of interest to declare that are relevant to the content of this article.


Availability of data and materials


Data sharing is not applicable to this article as no new data were created or analysed in this study.


Author information


Contributions

All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.


Corresponding author


Rights and permissions


Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/


Cite this article


Sarojini Yarramsetti, Rasi D, Srikanth Mylapalli P, Pushpa S, Gopala Krishna P and Gowri G, “Enhancing Small Target Detection in Aerial Imagery with Bi-PAN-FPN and EDMOA-Optimized YOLOv8-s”, Journal of Machine and Computing, pp. 908-917, October 2024. doi:10.53759/7669/jmc202404084.


Copyright


© 2024 Sarojini Yarramsetti, Rasi D, Srikanth Mylapalli P, Pushpa S, Gopala Krishna P and Gowri G. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.