Detecting foreground objects in video is crucial in various machine vision applications and computerized video surveillance technologies. Object tracking and detection are essential in object identification, surveillance, and navigation approaches. Object detection is the technique of differentiating between background and foreground features in a photograph. Recent improvements in vision systems, including distributed smart cameras, have inspired researchers to develop enhanced machine vision applications for embedded systems. The efficiency of featured object detection algorithms declines as dynamic video data increases as contrasted to conventional object detection methods. Moving subjects that are blurred, fast-moving objects, backdrop occlusion, or dynamic background shifts within the foreground area of a video frame can all cause problems. These challenges result in insufficient prominence detection. This work develops a deep-learning model to overcome this issue. For object detection, a novel method utilizing YOLOv3 and MobileNet was built. First, rather than picking predefined feature maps in the conventional YOLOv3 architecture, the technique for determining feature maps in the MobileNet is optimized based on examining the receptive fields. This work focuses on three primary processes: object detection, recognition, and classification, to classify moving objects before shared features. Compared to existing algorithms, experimental findings on public datasets and our dataset reveal that the suggested approach achieves 99% correct classification accuracy for urban settings with moving objects. Experiments reveal that the suggested model beats existing cutting-edge models by speed and computation.
Keywords
Object Detection, Classification, Deep Learning, Image Classification.
L. Jiao et al., “A Survey of Deep Learning-Based Object Detection,” IEEE Access, vol. 7, pp. 128837–128868, 2019, doi: 10.1109/access.2019.2939201.
R. Dixit and H. Singh, “Comparison of Detection and Classification Algorithms Using Boolean and Fuzzy Techniques,” Advances in Fuzzy Systems, vol. 2012, pp. 1–10, 2012, doi: 10.1155/2012/406204.
M. N. Khan, M. Al Hasan, and S. Anwar, “Improving the Robustness of Object Detection Through a Multi-Camera–Based Fusion Algorithm Using Fuzzy Logic,” Frontiers in Artificial Intelligence, vol. 4, May 2021, doi: 10.3389/frai.2021.638951.
S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137–1149, Jun. 2017, doi: 10.1109/tpami.2016.2577031.
M. A. Rashidan, Y. M. Mustafah, A. A. Shafie, N. A. Zainuddin, N. N. A. Aziz, and A. W. Azman, “Moving Object Detection and Classification Using Neuro-Fuzzy Approach,” International Journal of Multimedia and Ubiquitous Engineering, vol. 11, no. 4, pp. 253–266, Apr. 2016, doi: 10.14257/ijmue.2016.11.4.26.
S. Et. al., “Detection of Moving Vehicles on Highway using Fuzzy Logic for Smart Surveillance System,” Turkish Journal of Computer and Mathematics Education (TURCOMAT), vol. 12, no. 1S, pp. 419–431, Apr. 2021, doi: 10.17762/turcomat.v12i1s.1888.
M. Jiang, C. Deng, Z. Pan, L. Wang, and X. Sun, “Multiobject Tracking in Videos Based on LSTM and Deep Reinforcement Learning,” Complexity, vol. 2018, pp. 1–12, Nov. 2018, doi: 10.1155/2018/4695890.
L. Shi, Y. Wan, X. Gao, and M. Wang, “Feature Selection for Object-Based Classification of High-Resolution Remote Sensing Images Based on the Combination of a Genetic Algorithm and Tabu Search,” Computational Intelligence and Neuroscience, vol. 2018, pp. 1–13, 2018, doi: 10.1155/2018/6595792.
G. Lee, R. Mallipeddi, G.-J. Jang, and M. Lee, “A Genetic Algorithm-Based Moving Object Detection for Real-time Traffic Surveillance,” IEEE Signal Processing Letters, vol. 22, no. 10, pp. 1619–1622, Oct. 2015, doi: 10.1109/lsp.2015.2417592.
N. H. Reyes and E. P. Dadios, “Dynamic Color Object Recognition Using Fuzzy Logic,” Journal of Advanced Computational Intelligence and Intelligent Informatics, vol. 8, no. 1, pp. 29–38, Jan. 2004, doi: 10.20965/jaciii.2004.p0029.
Z. Guo, M. Zhang, and D.-J. Lee, “Efficient Evolutionary Learning Algorithm for Real-Time Embedded Vision Applications,” Electronics, vol. 8, no. 11, p. 1367, Nov. 2019, doi: 10.3390/electronics8111367.
J. H. Lee, T. Delbruck, and M. Pfeiffer, “Training Deep Spiking Neural Networks Using Backpropagation,” Frontiers in Neuroscience, vol. 10, Nov. 2016, doi: 10.3389/fnins.2016.00508.
Kugele, T. Pfeil, M. Pfeiffer, and E. Chicca, “Hybrid SNN-ANN: Energy-Efficient Classification and Object Detection for Event-Based Vision,” Pattern Recognition, pp. 297–312, 2021, doi: 10.1007/978-3-030-92659-5_19.
Perot, Etienne & Tournemire, Pierre & Nitti, Davide & Masci, Jonathan & Sironi, Amos. (2020). Learning to Detect Objects with a 1 Megapixel Event Camera.
B. Ramesh, A. Ussa, L. Della Vedova, H. Yang, and G. Orchard, “Low-Power Dynamic Object Detection and Classification With Freely Moving Event Cameras,” Frontiers in Neuroscience, vol. 14, Feb. 2020, doi: 10.3389/fnins.2020.00135.
S. Zhang, W. Wang, H. Li, and S. Zhang, “EVtracker: An Event-Driven Spatiotemporal Method for Dynamic Object Tracking,” Sensors, vol. 22, no. 16, p. 6090, Aug. 2022, doi: 10.3390/s22166090.
M. A. Perez-Cutino, A. G. Eguiluz, J. R. M. Dios, and A. Ollero, “Event-based human intrusion detection in UAS using Deep Learning,” 2021 International Conference on Unmanned Aircraft Systems (ICUAS), Jun. 2021, doi: 10.1109/icuas51884.2021.9476677.
K. Srinivas, L. Singh, S. R. Chavva, B. Dappuri, S. Chandrasekaran, and S. Qamar, “Multi-modal cyber security based object detection by classification using deep learning and background suppression techniques,” Computers and Electrical Engineering, vol. 103, p. 108333, Oct. 2022, doi: 10.1016/j.compeleceng.2022.108333.
S. Al-Otaibi, V. Cherappa, T. Thangarajan, R. Shanmugam, P. Ananth, and S. Arulswamy, “Hybrid K-Medoids with Energy-Efficient Sunflower Optimization Algorithm for Wireless Sensor Networks,” Sustainability, vol. 15, no. 7, p. 5759, Mar. 2023, doi: 10.3390/su15075759.
B. Gökçe and G. Sonugür, “Recognition of dynamic objects from UGVs using Interconnected Neural network-based Computer Vision system,” Automatika, vol. 63, no. 2, pp. 244–258, Jan. 2022, doi: 10.1080/00051144.2022.2031539.
O. A. Pakhomova and O. J. Kravets, “Efficiency analysis of dynamic object detection in computer vision system,” Journal of Physics: Conference Series, vol. 1203, p. 012048, Apr. 2019, doi: 10.1088/1742-6596/1203/1/012048.
J. Duo and L. Zhao, “An Asynchronous Real-Time Corner Extraction and Tracking Algorithm for Event Camera,” Sensors, vol. 21, no. 4, p. 1475, Feb. 2021, doi: 10.3390/s21041475.
J. Furmonas, J. Liobe, and V. Barzdenas, “Analytical Review of Event-Based Camera Depth Estimation Methods and Systems,” Sensors, vol. 22, no. 3, p. 1201, Feb. 2022, doi: 10.3390/s22031201.
T. Ozawa, Y. Sekikawa, and H. Saito, “Accuracy and Speed Improvement of Event Camera Motion Estimation Using a Bird’s-Eye View Transformation,” Sensors, vol. 22, no. 3, p. 773, Jan. 2022, doi: 10.3390/s22030773.
Mohana and H. V. Ravish Aradhya, “Simulation of Object Detection Algorithms for Video Survillance Applications,” 2018 2nd International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC)I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), 2018 2nd International Conference on, Aug. 2018, doi: 10.1109/i-smac.2018.8653665.
Raghunandan, Mohana, P. Raghav, and H. V. R. Aradhya, “Object Detection Algorithms for Video Surveillance Applications,” 2018 International Conference on Communication and Signal Processing (ICCSP), Apr. 2018, doi: 10.1109/iccsp.2018.8524461.
K. Cai, X. Miao, W. Wang, H. Pang, Y. Liu, and J. Song, “A modified YOLOv3 model for fish detection based on MobileNetv1 as backbone,” Aquacultural Engineering, vol. 91, p. 102117, Nov. 2020, doi: 10.1016/j.aquaeng.2020.102117.
Howard, Andrew & Zhu, Menglong & Chen, Bo & Kalenichenko, Dmitry & Wang, Weijun & Weyand, Tobias & Andreetto, Marco & Adam, Hartwig. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications.
X. Li, M. Tian, S. Kong, L. Wu, and J. Yu, “A modified YOLOv3 detection method for vision-based water surface garbage capture robot,” International Journal of Advanced Robotic Systems, vol. 17, no. 3, p. 172988142093271, May 2020, doi: 10.1177/1729881420932715.
D. Cao, Z. Chen, and L. Gao, “An improved object detection algorithm based on multi-scaled and deformable convolutional neural networks,” Human-centric Computing and Information Sciences, vol. 10, no. 1, Apr. 2020, doi: 10.1186/s13673-020-00219-9.
P. Dendorfer et al., “MOTChallenge: A Benchmark for Single-Camera Multiple Target Tracking,” International Journal of Computer Vision, vol. 129, no. 4, pp. 845–881, Dec. 2020, doi: 10.1007/s11263-020-01393-0.
Acknowledgements
Author(s) thanks to Dr.J.Rangaraj for this research completion and support.
Funding
No funding was received to assist with the preparation of this manuscript.
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Availability of data and materials
No data available for above study.
Author information
Contributions
All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.
Corresponding author
T. Mohandoss
T. Mohandoss
Department of ECE, Annamalai University, Chidambaram, Tamil Nadu, India.
Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
Cite this article
T. Mohandoss and J.Rangaraj, “Machine Learning Based Performance Analysis of Video Object Detection and Classification Using Modified Yolov3 and Mobilenet Algorithm, Journal of Machine and Computing, vol.3, no.3, pp. 282-296, July 2023. doi: 10.53759/7669/jmc202303025.
