An adaptive game design includes human emotions as a key factor for selecting the next level of harness in the game design. In most of the situation, face expression could not identified exactly and this may leads to an uncertainty for selecting a next level in the game flow. An efficient game design requires an efficient behaviour tree construction model based on the emotions of a player. This paper presented an artificial intelligent based game design using behaviour tree model by including an efficient emotion detection or classification system using a deep learning model ResNet 50. The proposed technique classifies the emotion of a player based five different category and the player current state of mind will be calculated based on this emotion score. The Behavior tree has been constructed from the foundation based on the hardness value calculated for each sub-BT. The performance evaluation for the emotion classification archives close to 92% and this accuracy will lead to construct an efficient BT for any game. We have evaluated the emotion detection system with other related Deep learning models.
Keywords
Behavior Tree, Game Engine, BT Editor, ResNet 50, AI Emotion Detection.
K. Chen, X. Yang, C. Fan, W. Zhang, and Y. Ding, “Semantic-Rich Facial Emotional Expression Recognition,” IEEE Transactions on Affective Computing, vol. 13, no. 4, pp. 1906–1916, Oct. 2022, doi: 10.1109/taffc.2022.3201290.
B. Iske and U. Ruckert, “A methodology for behaviour design of autonomous systems,” Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180), vol. 1, pp. 539–544, doi: 10.1109/iros.2001.973412.
P. Ekman, and W. V. Friesen, “Facial Action Coding System,” Consulting Psychologists Press, Palo Alto, CA 1978.
N. Llopis, “Game architecture. In S. Rabin (Ed.),” Introduction to Game Development Boston: Charles River Media, pp. 235-270, 2010.
Weiss, M. A. Data structures and algorithm analysis in C?? (4th ed.), 2013. Upper Saddle River: Pearson.
Bungie Studios, Halo 2, video game, Xbox, Microsoft, 2004.
D. Isla, “Handling complexity in the Halo 2 AI, 2005. Retrieved January 15, 2014, from http://www. gamasutra.com/view/feature/130663/ gdc_2005_proceeding_ handling_.php.
D. Isla, “Building a better battle: The Halo 3 AI objectives system,” 2008. Retrieved February 8, 2017, from https://web.cs.wpi.edu/*rich/courses/imgd4000-d09/lectures/halo3.pdf.
A. Khoo, An Introduction to behaviour-based systems for games. In S. Rabin (Ed.), 2006. AI Game programming wisdom Vol. 3, pp. 351-364. Boston: Charles River Media.
E. Babaei, N. Srivastava, J. Newn, Q. Zhou, T. Dingler, and E. Velloso, “Faces of Focus: A Study on the Facial Cues of Attentional States,” Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13, Apr. 2020, doi: 10.1145/3313831.3376566.
Sasanko Sekhar Gantayat and Swathi Lenka, “Study of Algorithms and Methods on Emotion Detection from Facial Expressions: A Review from Past Research,” In Communication Software and Networks, Suresh Chandra Satapathy, Vikrant Bhateja, M. Ramakrishna Murty, Nguyen Gia Nhu, and Jayasri Kotti (Eds.). Springer Singapore, Singapore, 231–244, 2021.
Z. Sarsenbayeva et al., “Does Smartphone Use Drive our Emotions or vice versa? A Causal Analysis,” Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–15, Apr. 2020, doi: 10.1145/3313831.3376163.
K. Yang et al., “Benchmarking commercial emotion detection systems using realistic distortions of facial image datasets,” The Visual Computer, vol. 37, no. 6, pp. 1447–1466, Jun. 2020, doi: 10.1007/s00371-020-01881-x.
M. Ashwin Shenoy and N. Thillaiarasu, “Enhancing temple surveillance through human activity recognition: A novel dataset and YOLOv4-ConvLSTM approach,” Journal of Intelligent & Fuzzy Systems, vol. 45, no. 6, pp. 11217–11232, Dec. 2023, doi: 10.3233/jifs-233919.
E. G. Krumhuber, D. Küster, S. Namba, and L. Skora, “Human and machine validation of 14 databases of dynamic facial expressions,” Behavior Research Methods, vol. 53, no. 2, pp. 686–701, Aug. 2020, doi: 10.3758/s13428-020-01443-y.
J. Mosiman, & S.Watson, 2014, February 10. Behavior Designer—behavior trees for everyone | Unity Community. Retrieved June 17, 2016, from Unity3D Forums: http://forum.unity3d.com/threads/behavior-designer-behavior-trees-for-everyone.227497/.
E. Johansen, (2016). The Behave project. Retrieved June 15, 2016, from AngryAnt: http://angryant.com/ behave/.
R. Pereira, (2015, June 24). GitHub—behavior3/behavior3editor. Retrieved June 14, 2016, from GitHub https://github.com/ behavior3/ behavior3editor.
Brainiac Designer. (2009, November 23). Retrieved June 11, 2016, from CodePlex: https://brainiac. codeplex.com/.
CRediT Author Statement
The authors confirm contribution to the paper as follows:
Conceptualization: Sreenarayanan N M and Partheeban N;
Methodology: Sreenarayanan N M;
Data Curation: Partheeban N;
Writing- Original Draft Preparation: Sreenarayanan N M and Partheeban N;
Visualization: Sreenarayanan N M and Partheeban N;
Investigation: Partheeban N;
Supervision: Sreenarayanan N M;
Validation: Sreenarayanan N M;
Writing- Reviewing and Editing: Sreenarayanan N M and Partheeban N;
All authors reviewed the results and approved the final version of the manuscript.
Acknowledgements
Author(s) thanks to Dr. Partheeban N for this research completion and support.
Funding
No funding was received to assist with the preparation of this manuscript.
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Availability of data and materials
Data sharing is not applicable to this article as no new data were created or analysed in this study.
Author information
Contributions
All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.
Corresponding author
Sreenarayanan N M
School of Computing Science and Engineering, Galgotias University, Greater Noida, Uttar Pradesh, India.
Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
Cite this article
Sreenarayanan N M and Partheeban N, “A Framework for Designing Behaviour Tree Artificial Intelligent Game Based on Dynamic Human Emotions”, Journal of Machine and Computing, pp. 743-752, April 2025, doi: 10.53759/7669/jmc202505059.
