1st International Conference on Emerging Trends in Mechanical Sciences for Sustainable Technologies
A Machine Learning Approach for Design and Control of Automated Guided Vehicle System - A Critical Review
Gokul S, Ganeshkumar S, Ashwathi Krishna R, Kabilan K and Vigneshvar S A, Department of Mechanical Engineering, Sri Eshwar College of Engineering, Coimbatore, Tamil Nadu, India.
This paper presents a critical review of the machine learning approach for the design and control of automated guided vehicle (AGV) systems. The paper discusses the current state of the art in terms of machine learning approaches for the design and control of AGV systems. It also provides a comparison between traditional control approaches and machine learning approaches for AGV system design and control. The paper further explores the potential of machine learning algorithms and their application in the design and control of AGV systems. The paper reviews the various machine learning algorithms such as artificial neural networks (ANNs), support vector machines (SVMs), deep learning, gaussian process regression (GPR), and reinforcement learning (RL) that are used for the design and control of AGV systems. It also discusses the advantages and disadvantages of using each of these algorithms for AGV system design and control. The paper further presents a case study of an AGV system that is designed and controlled using a machine learning approach. This case study provides a detailed analysis of the system architecture and the performance of the system. The results from the case study demonstrate the potential of using machine learning algorithms for the design and control of AGV systems. The paper concludes by providing an overview of the current state of the art in terms of machine learning approaches for AGV system design and control. The paper also provides future research directions and recommendations for the further improvement of the design and control of AGV systems using machine learning algorithms.
Keywords
Automated Guided Vehicle (AGV) System, Machine Learning, Artificial Neural Networks (ANNs), Support Vector Machines (SVMs), Deep Learning, Gaussian Process Regression (GPR), Reinforcement Learning (RL), Design and Control, System Architecture, Performance Analysis.
T. Le-Anh and M. B. M. De Koster, “A review of design and control of automated guided vehicle systems,” European Journal of Operational Research, vol. 171, no. 1, pp. 1–23, May 2006, doi: 10.1016/j.ejor.2005.01.036.
I. F. A. Vis, “Survey of research in the design and control of automated guided vehicle systems,” European Journal of Operational Research, vol. 170, no. 3, pp. 677–709, May 2006, doi: 10.1016/j.ejor.2004.09.020.
R. Kamoshida and Y. Kazama, “Acquisition of Automated Guided Vehicle Route Planning Policy Using Deep Reinforcement Learning,” 2017 6th IEEE International Conference on Advanced Logistics and Transport (ICALT), Jul. 2017, doi: 10.1109/icadlt.2017.8547000.
M. Elsisi and M.-Q. Tran, “Development of an IoT Architecture Based on a Deep Neural Network against Cyber Attacks for Automated Guided Vehicles,” Sensors, vol. 21, no. 24, p. 8467, Dec. 2021, doi: 10.3390/s21248467.
M. Rhazzaf and T. Masrour, “Deep Learning Approach for Automated Guided Vehicle System,” Artificial Intelligence and Industrial Applications, pp. 227–237, Sep. 2020, doi: 10.1007/978-3-030-51186-9_16.
I. Um, H. Cheon, and H. Lee, “The simulation design and analysis of a Flexible Manufacturing System with Automated Guided Vehicle System,” Journal of Manufacturing Systems, vol. 28, no. 4, pp. 115–122, Dec. 2009, doi: 10.1016/j.jmsy.2010.06.001.
S. M. Jeon, K. H. Kim, and H. Kopfer, “Routing automated guided vehicles in container terminals through the Q-learning technique,” Logistics Research, vol. 3, no. 1, pp. 19–27, Dec. 2010, doi: 10.1007/s12159-010-0042-5.
C.-C. Lin, K.-Y. Chen, and L.-T. Hsieh, “Real-Time Charging Scheduling of Automated Guided Vehicles in Cyber-Physical Smart Factories Using Feature-Based Reinforcement Learning,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 4, pp. 4016–4026, Apr. 2023, doi: 10.1109/tits.2023.3234010.
M. Ohzeki, A. Miki, M. J. Miyama, and M. Terabe, “Control of Automated Guided Vehicles Without Collision by Quantum Annealer and Digital Devices,” Frontiers in Computer Science, vol. 1, Nov. 2019, doi: 10.3389/fcomp.2019.00009.
R. Stetter, “Algorithms and Methods for the Fault-Tolerant Design of an Automated Guided Vehicle,” Sensors, vol. 22, no. 12, p. 4648, Jun. 2022, doi: 10.3390/s22124648.
J. E. Sierra Garcia and M. Santos, “Combining reinforcement learning and conventional control to improve automatic guided vehicles tracking of complex trajectories,” Expert Systems, vol. 41, no. 2, Jun. 2022, doi: 10.1111/exsy.13076.
K. V Sagar and J. Jerald, “Real-time Automated Guided vehicles scheduling with Markov Decision Process and Double Q-Learning algorithm,” Materials Today: Proceedings, vol. 64, pp. 279–284, 2022, doi: 10.1016/j.matpr.2022.04.522.
H. Martínez-Barberá and D. Herrero-Pérez, “Autonomous navigation of an automated guided vehicle in industrial environments,” Robotics and Computer-Integrated Manufacturing, vol. 26, no. 4, pp. 296–311, Aug. 2010, doi: 10.1016/j.rcim.2009.10.003.
J. K. Lim, J. M. Lim, K. Yoshimoto, K. H. Kim, and T. Takahashi, “Designing guide-path networks for automated guided vehicle system by using the Q-learning technique,” Computers & Industrial Engineering, vol. 44, no. 1, pp. 1–17, Jan. 2003, doi: 10.1016/s0360-8352(02)00128-6.
R. Yan, S. J. Dunnett, and L. M. Jackson, “Model-Based Research for Aiding Decision-Making During the Design and Operation of Multi-Load Automated Guided Vehicle Systems,” Reliability Engineering & System Safety, vol. 219, p. 108264, Mar. 2022, doi: 10.1016/j.ress.2021.108264.
T. Steclik, R. Cupek, and M. Drewniak, “Automatic grouping of production data in Industry 4.0: The use case of internal logistics systems based on Automated Guided Vehicles,” Journal of Computational Science, vol. 62, p. 101693, Jul. 2022, doi: 10.1016/j.jocs.2022.101693.
D. Bechtsis, N. Tsolakis, D. Vlachos, and E. Iakovou, “Sustainable supply chain management in the digitalisation era: The impact of Automated Guided Vehicles,” Journal of Cleaner Production, vol. 142, pp. 3970–3984, Jan. 2017, doi: 10.1016/j.jclepro.2016.10.057.
M. Gregor, R. Hodoň, P. Grznár, and Š. Mozol, “Design of a System for Verification of Automatic Guided Vehicle Routes Using Computer Emulation,” Applied Sciences, vol. 12, no. 7, p. 3397, Mar. 2022, doi: 10.3390/app12073397.
B. Farooq, J. Bao, H. Raza, Y. Sun, and Q. Ma, “Flow-shop path planning for multi-automated guided vehicles in intelligent textile spinning cyber-physical production systems dynamic environment,” Journal of Manufacturing Systems, vol. 59, pp. 98–116, Apr. 2021, doi: 10.1016/j.jmsy.2021.01.009.
P. Zhou, L. Lin, and K. H. Kim, “Anisotropic Q-learning and waiting estimation based real-time routing for automated guided vehicles at container terminals,” Journal of Heuristics, vol. 29, no. 2–3, pp. 207–228, Jan. 2021, doi: 10.1007/s10732-020-09463-9.
H. Zhang, J. Luo, X. Lin, K. Tan, and C. Pan, “Dispatching and Path Planning of Automated Guided Vehicles based on Petri Nets and Deep Reinforcement Learning,” 2021 IEEE International Conference on Networking, Sensing and Control (ICNSC), Dec. 2021, doi: 10.1109/icnsc52481.2021.9702196.
J. Menyhart and R. Szabolcsi, “Artificial Intelligence Applied for Technical Status Diagnostics of the Batteries of Automated Guided Vehicles,” 2019 International Conference on Military Technologies (ICMT), May 2019, doi: 10.1109/miltechs.2019.8870056.
Z. Miljković, N. Vuković, M. Mitić, and B. Babić, “New hybrid vision-based control approach for automated guided vehicles,” The International Journal of Advanced Manufacturing Technology, vol. 66, no. 1–4, pp. 231–249, Jul. 2012, doi: 10.1007/s00170-012-4321-y.
H. Yoshitake, R. Kamoshida, and Y. Nagashima, “New Automated Guided Vehicle System Using Real-Time Holonic Scheduling for Warehouse Picking,” IEEE Robotics and Automation Letters, vol. 4, no. 2, pp. 1045–1052, Apr. 2019, doi: 10.1109/lra.2019.2894001.
J. Zhang, X. Yang, W. Wang, J. Guan, L. Ding, and V. C. S. Lee, “Automated guided vehicles and autonomous mobile robots for recognition and tracking in civil engineering,” Automation in Construction, vol. 146, p. 104699, Feb. 2023, doi: 10.1016/j.autcon.2022.104699.
Jun Jiao et al., “Intelligent variable structure control for Automated Guided Vehicle,” 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence), Jun. 2008, doi: 10.1109/cec.2008.4631337.
J. M. Lucas, H. Martinez, and F. Jimenez, “Fuzzy Tuning for the Docking Maneuver Controller of an Automated Guided Vehicle,” Studies in Computational Intelligence, pp. 585–600, doi: 10.1007/11399346_25.
S. Lu, C. Xu, R. Y. Zhong, and L. Wang, “A passive RFID tag-based locating and navigating approach for automated guided vehicle,” Computers & Industrial Engineering, vol. 125, pp. 628–636, Nov. 2018, doi: 10.1016/j.cie.2017.12.026.
Z. Zhang, L. Wu, W. Zhang, T. Peng, and J. Zheng, “Energy-efficient path planning for a single-load automated guided vehicle in a manufacturing workshop,” Computers & Industrial Engineering, vol. 158, p. 107397, Aug. 2021, doi: 10.1016/j.cie.2021.107397.
J. C. Chen, T.-L. Chen, and Y.-C. Teng, “Meta-model based simulation optimization for automated guided vehicle system under different charging mechanisms,” Simulation Modelling Practice and Theory, vol. 106, p. 102208, Jan. 2021, doi: 10.1016/j.simpat.2020.102208.
S. Holly et al., “Flexibility management and provision of balancing services with battery-electric automated guided vehicles in the Hamburg container terminal Altenwerder,” Energy Informatics, vol. 3, no. S1, Oct. 2020, doi: 10.1186/s42162-020-00129-1.
U. A. Umar, M. K. A. Ariffin, N. Ismail, and S. H. Tang, “Hybrid multiobjective genetic algorithms for integrated dynamic scheduling and routing of jobs and automated-guided vehicle (AGV) in flexible manufacturing systems (FMS) environment,” The International Journal of Advanced Manufacturing Technology, vol. 81, no. 9–12, pp. 2123–2141, Jun. 2015, doi: 10.1007/s00170-015-7329-2.
R. A. Søraa and M. E. Fostervold, “Social domestication of service robots: The secret lives of Automated Guided Vehicles (AGVs) at a Norwegian hospital,” International Journal of Human-Computer Studies, vol. 152, p. 102627, Aug. 2021, doi: 10.1016/j.ijhcs.2021.102627.
S. Butdee, A. Suebsomran, F. Vignat and P. Yarlagadda, “Control and path prediction of an Automate Guided Vehicle,”Journal of Achievements in Materials and Manufacturing Engineering, Vol.31, no.2, 2008.
J. Mehami, M. Nawi, and R. Y. Zhong, “Smart automated guided vehicles for manufacturing in the context of Industry 4.0,” Procedia Manufacturing, vol. 26, pp. 1077–1086, 2018, doi: 10.1016/j.promfg.2018.07.144.
J. Liu, Z. Liu, H. Zhang, H. Yuan, K. B. Manokaran, and M. Maheshwari, “Multi-sensor information fusion for IoT in automated guided vehicle in smart city,” Soft Computing, vol. 25, no. 18, pp. 12017–12029, Mar. 2021, doi: 10.1007/s00500-021-05696-3.
G. S, D. T, and A. Haldorai, “A Supervised Machine Learning Model for Tool Condition Monitoring in Smart Manufacturing,” Defence Science Journal, vol. 72, no. 5, pp. 712–720, Nov. 2022, doi: 10.14429/dsj.72.17533.
A. Irshayyid and J. Chen, “Comparative Study of Cooperative Platoon Merging Control Based on Reinforcement Learning,” Sensors, vol. 23, no. 2, p. 990, Jan. 2023, doi: 10.3390/s23020990.
L.-H. Kong, W. He, W.-S. Chen, H. Zhang, and Y.-N. Wang, “Dynamic Movement Primitives Based Robot Skills Learning,” Machine Intelligence Research, vol. 20, no. 3, pp. 396–407, Jan. 2023, doi: 10.1007/s11633-022-1346-z.
T. Raoofi and M. Yildiz, “Comprehensive review of battery state estimation strategies using machine learning for battery Management Systems of Aircraft Propulsion Batteries,” Journal of Energy Storage, vol. 59, p. 106486, Mar. 2023, doi: 10.1016/j.est.2022.106486.
Y. Shao, R. K. Agarwal, X. Wang, and B. Jin, “Study of Flow Patterns in a Moving Bed Reactor for Chemical Looping Combustion Based on Machine Learning Methods,” Journal of Energy Resources Technology, vol. 145, no. 6, Jan. 2023, doi: 10.1115/1.4056562.
S. Balaji et al., “Comparative analysis of experimental and numerical investigation on multiple projectile impact of AA5083 friction stir welded targets,” PLOS ONE, vol. 18, no. 7, p. e0285254, Jul. 2023, doi: 10.1371/journal.pone.0285254.
G. S, “Digital Twin Technology for Tool Condition Monitoring: A Review of Recent Research”, JAMS, vol. 2, no. 2, pp. 41–51, May 2023.
Cite this article
Gokul S, Ganeshkumar S, Ashwathi Krishna R, Kabilan K and Vigneshvar S A, “A Machine Learning Approach for Design and Control of Automated Guided Vehicle System - A Critical Review”, Advances in Intelligent Systems and Technologies, pp. 001-009, August. 2023. doi:10.53759/aist/978-9914-9946-4-3_1
