With real-world applications in robotic vision, scene analysis, surveillance, image compression, medical imaging, and augmented reality, real-time Human Tracking Systems (HTSs) have emerged as a significant area of study in computer vision and image processing. To lessen the computational load and increase the accuracy of HTS, we present in this study a Faster Region-based Convolutional Neural Network coupled with Crow Search Optimization (FR-CNN-CSO). Additionally, to further enhance performance, an optimization strategy was combined to improve trajectory assessment, reduce individuality switches, and update functions according to environmental conditions. Moreover, the hybridized framework has provided an effective solution for improving tracking accuracy and compactional efficiency compared to conventional models. The suggested system is created using video input in a Python environment. Redundant data is eliminated from the gathered datasets during preprocessing. Histograms of Oriented Gradients (HOG) are then used for feature extraction. The extracted features are then fed into the FR-CNN model, which uses crow search optimization to effectively identify and track individuals. This strategy aims to reduce execution time and computational complexity while achieving excellent forecast accuracy. According to experimental data, the suggested approach performs better than traditional methods in terms of execution time, accuracy, precision, recall, and F-measure. The proposed FR-CNN-CSO algorithm illustrates a possible application in autonomous systems, smart surveillance systems, and provides a balance between adaptability and robustness.
M. S. Rohei, E. Salwana, N. B. A. K. Shah, and A. S. Kakar, “Design and Testing of an Epidermal RFID Mechanism in a Smart Indoor Human Tracking System,” IEEE Sensors Journal, vol. 21, no. 4, pp. 5476–5486, Feb. 2021, doi: 10.1109/jsen.2020.3036233.
V.-T. Nguyen, A.-T. Nguyen, V.-T. Nguyen, and H.-A. Bui, “A Real-Time Human Tracking System Using Convolutional Neural Network and Particle Filter,” Intelligent Systems and Networks, pp. 411–417, 2021, doi: 10.1007/978-981-16-2094-2_50.
K. Xue et al., “Robotic seam tracking system based on vision sensing and human-machine interaction for multi-pass MAG welding,” Journal of Manufacturing Processes, vol. 63, pp. 48–59, Mar. 2021, doi: 10.1016/j.jmapro.2020.02.026.
A. Motroni et al., “An RFID Tracking System for Agricultural Safety,” 2021 IEEE International Conference on RFID Technology and Applications (RFID-TA), pp. 28–31, Oct. 2021, doi: 10.1109/rfid-ta53372.2021.9617356.
O. T. Cetinkaya, S. Sandal, E. Bostanci, M. S. Guzel, M. Osmanoglu, and N. Kanwal, “A Fuzzy Rule Based Visual Human Tracking System for Drones,” 2019 4th International Conference on Computer Science and Engineering (UBMK), pp. 1–6, Sep. 2019, doi: 10.1109/ubmk.2019.8907104.
J. Xu et al., “Vitality‐Enhanced Dual‐Modal Tracking System Reveals the Dynamic Fate of Mesenchymal Stem Cells for Stroke Therapy (Small 47/2022),” Small, vol. 18, no. 47, Nov. 2022, doi: 10.1002/smll.202270256.
M. Revilla-León, J. M. Zeitler, and J. C. Kois, “Digital maxillomandibular relationship and mandibular motion recording by using an optical jaw tracking system to acquire a dynamic virtual patient,” The Journal of Prosthetic Dentistry, vol. 132, no. 1, pp. 14–19, Jul. 2024, doi: 10.1016/j.prosdent.2022.05.012.
L.-P. Tian, L.-Q. Chen, Z.-M. Xu, and Z. (David) Chen, “Wits: An Efficient Wi-Fi Based Indoor Positioning and Tracking System,” Remote Sensing, vol. 14, no. 1, p. 19, Dec. 2021, doi: 10.3390/rs14010019.
J. Azimjonov and A. Özmen, “A real-time vehicle detection and a novel vehicle tracking systems for estimating and monitoring traffic flow on highways,” Advanced Engineering Informatics, vol. 50, p. 101393, Oct. 2021, doi: 10.1016/j.aei.2021.101393.
J. Antonanzas, M. Arbeloa-Ibero, and J. C. Quinn, “Comparative life cycle assessment of fixed and single axis tracking systems for photovoltaics,” Journal of Cleaner Production, vol. 240, p. 118016, Dec. 2019, doi: 10.1016/j.jclepro.2019.118016.
T. Hempel and A. Al-Hamadi, “SLAM-Based Multistate Tracking System for Mobile Human-Robot Interaction,” Image Analysis and Recognition, pp. 368–376, 2020, doi: 10.1007/978-3-030-50347-5_32.
Y. Zou, T. Chen, X. Chen, and J. Li, “Robotic seam tracking system combining convolution filter and deep reinforcement learning,” Mechanical Systems and Signal Processing, vol. 165, p. 108372, Feb. 2022, doi: 10.1016/j.ymssp.2021.108372.
M. Liu, Y. Li, and H. Liu, “3D Gaze Estimation for Head-Mounted Eye Tracking System With Auto-Calibration Method,” IEEE Access, vol. 8, pp. 104207–104215, 2020, doi: 10.1109/access.2020.2999633.
O. Younis, W. Al-Nuaimy, M. H., and F. Rowe, “A Hazard Detection and Tracking System for People with Peripheral Vision Loss using Smart Glasses and Augmented Reality,” International Journal of Advanced Computer Science and Applications, vol. 10, no. 2, 2019, doi: 10.14569/ijacsa.2019.0100201.
F. Yang, R. Zhang, and Y. Zhao, “Research on a Visual Sensing and Tracking System for Distance Education,” International Journal of Emerging Technologies in Learning (iJET), vol. 14, no. 08, p. 181, Apr. 2019, doi: 10.3991/ijet.v14i08.9827.
J. Xie, E. Stensrud, and T. Skramstad, “Detection-Based Object Tracking Applied to Remote Ship Inspection,” Sensors, vol. 21, no. 3, p. 761, Jan. 2021, doi: 10.3390/s21030761.
S. K. Teoh, V. V. Yap, C. S. Soh, and P. Sebastian, “Implementation and optimization of human tracking system using ARM embedded platform,” 2012 4th International Conference on Intelligent and Advanced Systems (ICIAS2012), pp. 353–356, Jun. 2012, doi: 10.1109/icias.2012.6306217.
Y. Liu, Y. Li, Z. Zhuang, and T. Song, “Improvement of Robot Accuracy with an Optical Tracking System,” Sensors, vol. 20, no. 21, p. 6341, Nov. 2020, doi: 10.3390/s20216341.
P. Zhao et al., “Human tracking and identification through a millimeter wave radar,” Ad Hoc Networks, vol. 116, p. 102475, May 2021, doi: 10.1016/j.adhoc.2021.102475.
A. Larumbe-Bergera, G. Garde, S. Porta, R. Cabeza, and A. Villanueva, “Accurate Pupil Center Detection in Off-the-Shelf Eye Tracking Systems Using Convolutional Neural Networks,” Sensors, vol. 21, no. 20, p. 6847, Oct. 2021, doi: 10.3390/s21206847.
P. Pandiyan, R. Thangaraj, M. Subramanian, R. Rahul, M. Nishanth, and I. Palanisamy, “Real-time monitoring of social distancing with person marking and tracking system using YOLO V3 model,” International Journal of Sensor Networks, vol. 38, no. 3, p. 154, 2022, doi: 10.1504/ijsnet.2022.121700.
Q. Hao, Z. Wang, and L. Qin, “Design of Beidou Satellite System in Ocean Logistics Real-Time Tracking System,” Journal of Coastal Research, vol. 94, no. sp1, p. 204, Sep. 2019, doi: 10.2112/si94-043.1.
C. Liu and T. Szirányi, “Real-Time Human Detection and Gesture Recognition for On-Board UAV Rescue,” Sensors, vol. 21, no. 6, p. 2180, Mar. 2021, doi: 10.3390/s21062180.
F. Shu and J. Shu, “An eight-camera fall detection system using human fall pattern recognition via machine learning by a low-cost android box,” Scientific Reports, vol. 11, no. 1, Jan. 2021, doi: 10.1038/s41598-021-81115-9.
Zhang, Kevin, et al. "Double anchor R-CNN for human detection in a crowd." arXiv preprint arXiv:1909.09998 (2019).
M.-C. Chiu, H.-Y. Tsai, and J.-E. Chiu, “A novel directional object detection method for piled objects using a hybrid region-based convolutional neural network,” Advanced Engineering Informatics, vol. 51, p. 101448, Jan. 2022, doi: 10.1016/j.aei.2021.101448.
I. Ahmed, M. Anisetti, and G. Jeon, “An IoT‐based human detection system for complex industrial environment with deep learning architectures and transfer learning,” International Journal of Intelligent Systems, vol. 37, no. 12, pp. 10249–10267, May 2021, doi: 10.1002/int.22472.
K. Boudjit and N. Ramzan, “Human detection based on deep learning YOLO-v2 for real-time UAV applications,” Journal of Experimental & Theoretical Artificial Intelligence, vol. 34, no. 3, pp. 527–544, Apr. 2021, doi: 10.1080/0952813x.2021.1907793.
H. Goyal, K. Sidana, C. Singh, A. Jain, and S. Jindal, “A real time face mask detection system using convolutional neural network,” Multimedia Tools and Applications, vol. 81, no. 11, pp. 14999–15015, Feb. 2022, doi: 10.1007/s11042-022-12166-x.
A. A.N. and S. A.P., “Lightweight and computationally faster Hypermetropic Convolutional Neural Network for small size object detection,” Image and Vision Computing, vol. 119, p. 104396, Mar. 2022, doi: 10.1016/j.imavis.2022.104396.
Y. Yamazaki, M. Tamaki, C. Premachandra, C. J. Perera, S. Sumathipala, and B. H. Sudantha, “Victim Detection Using UAV with On-board Voice Recognition System,” 2019 Third IEEE International Conference on Robotic Computing (IRC), pp. 555–559, Feb. 2019, doi: 10.1109/irc.2019.00114.
H. Chander et al., “Wearable Stretch Sensors for Human Movement Monitoring and Fall Detection in Ergonomics,” International Journal of Environmental Research and Public Health, vol. 17, no. 10, p. 3554, May 2020, doi: 10.3390/ijerph17103554.
A. G. Hussien et al., “Crow Search Algorithm: Theory, Recent Advances, and Applications,” IEEE Access, vol. 8, pp. 173548–173565, 2020, doi: 10.1109/access.2020.3024108.
Matsumura, Ryo, and Akitoshi Hanazawa. "Human detection using color contrast-based histograms of oriented gradients." International Journal of Innovative Computing, Information and Control 15.4, 2019.
S. Singh, U. Ahuja, M. Kumar, K. Kumar, and M. Sachdeva, “Face mask detection using YOLOv3 and faster R-CNN models: COVID-19 environment,” Multimedia Tools and Applications, vol. 80, no. 13, pp. 19753–19768, Mar. 2021, doi: 10.1007/s11042-021-10711-8.
CRediT Author Statement
The author reviewed the results and approved the final version of the manuscript.
Conceptualization: Srilatha M and Srinivasu N;
Methodology: Srinivasu N;
Writing- Original Draft Preparation: Srilatha M and Srinivasu N;
Supervision: Srinivasu N;
Validation: Srilatha M;
Writing- Reviewing and Editing: Srilatha M and Srinivasu N;
All authors reviewed the results and approved the final version of the manuscript.
Acknowledgements
Author(s) thanks to Dr. Srinivasu N for this research completion and support.
Funding
No funding was received to assist with the preparation of this manuscript.
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Availability of data and materials
Data sharing is not applicable to this article as no new data were created or analysed in this study.
Author information
Contributions
All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.
Corresponding author
Srilatha M
Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Guntur, Vaddeswaram, Andhra Pradesh, India.
Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
Cite this article
Srilatha M and Srinivasu N, “Human Tracking System Using Optimization with Convolution Networks”, Journal of Machine and Computing, vol.5, no.4, pp. 2719-2733, October 2025, doi: 10.53759/7669/jmc202505208.
