Journal of Robotics Spectrum


Mental State Adaptive Interfaces as a Remedy to the Issue of Long-term, Continuous Human Machine Interaction



Journal of Robotics Spectrum

Received On : 25 January 2023

Revised On : 28 February 2023

Accepted On : 05 March 2023

Published On : 16 March 2023

Volume 01, 2023

Pages : 078-089


Abstract


In order to promote safer and more efficient human-machine interaction, this article advocates for the employment of adaptive systems that account for the user's mental state throughout the duration of lengthy, continuous usage. Perhaps what is needed are adaptive systems that can adjust to the user's mood. The operator's state of mind may be inferred using a combination of operator-independent metrics (for instance, time of day and weather) and behavior (for instance, lane deviation and response time) and physiological (for instance, heart activity and electroencephalography) indicators. Several changes may be made to the dynamic between the operator and the system to mitigate the impacts of the operator's diminished cognitive capacity and preserve the reliability and efficacy of operations. Depending on the specifics of the job at hand and the difficulties that must be overcome, adjustments may be made to factors such as the type of the information presented, the structure of the presentation, the prominence of the stimuli, and the order in which the tasks are performed, frequently using the predictions produced by machine learning.


Keywords


Human-Machine Interaction, Mental State Adaptive Interfaces, Mental Fatigue, Cognitive Flexibility, Brain-Computer Interfaces, Situational Awareness.


  1. Á. Csathó, D. van der Linden, I. Hernádi, P. Buzás, and G. Kalmár, “Effects of mental fatigue on the capacity limits of visual attention,” J. Cogn. Psychol. (Hove), vol. 24, no. 5, pp. 511–524, 2012.
  2. R. Govaerts et al., “Work performance in industry: The impact of mental fatigue and a passive back exoskeleton on work efficiency,” Appl. Ergon., vol. 110, p. 104026, 2023.
  3. S. Russell, S. L. Halson, D. G. Jenkins, S. B. Rynne, B. Roelands, and V. G. Kelly, “Thinking about elite performance: The experience and impact of mental fatigue in elite sport coaching,” Int. J. Sports Physiol. Perform., pp. 1–7, 2023.
  4. J. Steele, M. Pinto, K. K. Nosaka, and J. Nuzzo, “Perceptions of capacity, fatigue, and their psychophysics: Examining construct equivalence and the relationship between actual capacity and perception of capacity during resisted elbow flexion tasks,” PsyArXiv, 2022.
  5. K. Sakai, “Task set and prefrontal cortex,” Annu. Rev. Neurosci., vol. 31, no. 1, pp. 219–245, 2008.
  6. A. M. Hund, R. M. Bove, and N. Van Beuning, “Cognitive flexibility explains unique variance in reading comprehension for elementary students,” Cogn. Dev., vol. 67, no. 101358, p. 101358, 2023.
  7. L. N. Nijhof, S. L. Nijhof, E. M. van de Putte, J. Houtveen, J. M. van Montfrans, and H. Knoop, “Internet-delivered cognitive behavioural therapy for chronic fatigue among adolescents with a chronic medical condition: a single case study,” Behav. Cogn. Psychother., vol. 51, no. 3, pp. 259–264, 2023.
  8. J. Sherbino and G. Norman, “Task switching, multitasking, and errors: A psychologic perspective on the impact of interruptions,” Ann. Emerg. Med., vol. 78, no. 3, pp. 425–428, 2021.
  9. H. M. Abd-Elfattah, F. H. Abdelazeim, and S. Elshennawy, “Physical and cognitive consequences of fatigue: A review,” J. Adv. Res., vol. 6, no. 3, pp. 351–358, 2015.
  10. J. Dorrian, J. Chapman, L. Bowditch, N. Balfe, and A. Naweed, “A survey of train driver schedules, sleep, wellbeing, and driving performance in Australia and New Zealand,” Sci. Rep., vol. 12, no. 1, p. 3956, 2022.
  11. W. Staiano, L. R. S. Bonet, M. Romagnoli, and C. Ring, “Mental fatigue: The cost of cognitive loading on weight lifting, resistance training, and cycling performance,” Int. J. Sports Physiol. Perform., vol. 18, no. 5, pp. 465–473, 2023.
  12. V. Marasco, W. Boner, B. Heidinger, K. Griffiths, and P. Monaghan, “Repeated exposure to stressful conditions can have beneficial effects on survival,” Exp. Gerontol., vol. 69, pp. 170–175, 2015.
  13. K. Tam and K. D. Jones, “Situational awareness: Examining factors that affect cyber-risks in the maritime sector,” Int. J. Cyber Situational Aware., vol. 4, no. 1, pp. 40–68, 2019.
  14. J. O’Brien and R. A. Bull Schaefer, “Deadly distraction – Eastern Air 401: the accident that changed aviation forever,” Case J., vol. 16, no. 3, pp. 345–368, 2020.
  15. M. Wischnewski and N. Krämer, “Measuring and understanding trust calibrations for automated systems: A survey of the state-of-the-art and future directions,” PsyArXiv, 2023.
  16. H. Azevedo-Sa, X. J. Yang, L. P. Robert, and D. M. Tilbury, “A unified bi-directional model for natural and artificial trust in human–robot collaboration,” IEEE Robot. Autom. Lett., vol. 6, no. 3, pp. 5913–5920, 2021.
  17. P. Arcaini, E. Riccobene, and P. Scandurra, “Formal design and verification of self-adaptive systems with decentralized control,” ACM Trans. Auton. Adapt. Syst., vol. 11, no. 4, pp. 1–35, 2017.
  18. F. P. Morgeson, M. H. Reider, and M. A. Campion, “Selecting individuals in team settings: The importance of social skills, personality characteristics, and teamwork knowledge,” Pers. Psychol., vol. 58, no. 3, pp. 583–611, 2005.
  19. S. Agrawal and S. Peeta, “Corrigendum to ‘Evaluating the impacts of situational awareness and mental stress on takeover performance under conditional automation’ [Transp. Res. Part F: Traffic Psychol. Behav. 83 (2021) 210–225],” Transp. Res. Part F Traffic Psychol. Behav., vol. 93, p. 172, 2023.
  20. N. Balachandran, “A proposed taxonomy of human evolved psychological adaptations,” J. Soc. Evol. Cult. Psychol., vol. 5, no. 3, pp. 194–207, 2011.
  21. S. Piechowski et al., “Visual attention relates to operator performance in spacecraft docking training,” Aerosp. Med. Hum. Perform., vol. 93, no. 6, pp. 480–486, 2022.
  22. Y. Zak, Y. Parmet, and T. Oron-Gilad, “Facilitating the work of Unmanned Aerial Vehicle operators using artificial intelligence: An intelligent filter for command-and-control maps to reduce cognitive workload,” Hum. Factors, p. 187208221081968, 2022.
  23. H. J. Wee, S. W. Lye, and J.-P. Pinheiro, “Monitoring performance measures for radar air traffic controllers using eye tracking techniques,” in Advances in Human Factors of Transportation, Cham: Springer International Publishing, 2020, pp. 727–738.
  24. T. Coll-Martín, H. Carretero-Dios, and J. Lupiáñez, “Attentional networks, vigilance, and distraction as a function of attention‐deficit/hyperactivity disorder symptoms in an adult community sample,” Br. J. Psychol., vol. 112, no. 4, pp. 1053–1079, 2021.
  25. V. Mittelstädt, J. Miller, and A. Kiesel, “Trading off switch costs and stimulus availability benefits: An investigation of voluntary task-switching behavior in a predictable dynamic multitasking environment,” Mem. Cognit., vol. 46, no. 5, pp. 699–715, 2018.
  26. W. E. Soares 3rd, L. L. Price, B. Prast, E. Tarbox, T. J. Mader, and R. Blanchard, “Accuracy screening for ST elevation myocardial infarction in a task-switching simulation,” West. J. Emerg. Med., vol. 20, no. 1, pp. 177–184, 2019.
  27. D. M. Brenner et al., “Linaclotide reduced response time for irritable bowel syndrome with constipation symptoms: Analysis of 4 randomized controlled trials,” Am. J. Gastroenterol., vol. 118, no. 5, pp. 872–879, 2023.
  28. A. Umemoto and C. B. Holroyd, “Task-specific effects of reward on task switching,” Psychol. Res., vol. 79, no. 4, pp. 698–707, 2015.
  29. 铭铭, “The effect of social networking site usage on the cognitive flexibility ability of university students,” Adv. Psychol., vol. 12, no. 11, pp. 3874–3881, 2022.
  30. E. Cayeux, J. Macpherson, M. Laing, D. Pirovolou, and F. Florence, “Drilling systems automation: Fault Detection, isolation and Recovery functions for situational awareness,” in Day 1 Tue, March 07, 2023, 2023.
  31. Å. Fasth, J. Stahre, and K. Dencker, “Measuring and analysing Levels of Automation in an assembly system,” in Manufacturing Systems and Technologies for the New Frontier, London: Springer London, 2008, pp. 169–172.
  32. W. Junaid, “Evaluating the effectiveness of problem frames for contextual modeling of cyber-physical systems: A tool suite with adaptive user interfaces,” in Evaluation and Assessment in Software Engineering, 2021.
  33. S. M. Herrington, M. J. H. Zahed, and T. D. Fields, “Handling qualities assessment and performance evaluation for unmanned aerial systems and pilots,” Unmanned Syst., 2022.
  34. H. M. Gavelin, A. S. Neely, T. Dunås, T. Eskilsson, L. S. Järvholm, and C.-J. Boraxbekk, “Mental fatigue in stress-related exhaustion disorder: Structural brain correlates, clinical characteristics and relations with cognitive functioning,” NeuroImage Clin., vol. 27, no. 102337, p. 102337, 2020.
  35. K. Sandberg, B. M. Bibby, B. Timmermans, A. Cleeremans, and M. Overgaard, “Measuring consciousness: Task accuracy and awareness as sigmoid functions of stimulus duration,” Conscious. Cogn., vol. 20, no. 4, pp. 1659–1675, 2011.
  36. L. Angrisani et al., “Passive and active brain-computer interfaces for rehabilitation in health 4.0,” Measur. Sens., vol. 18, no. 100246, p. 100246, 2021.
  37. M. Gupta and H. C. Kaplan, “Measurement for quality improvement: using data to drive change,” J. Perinatol., vol. 40, no. 6, pp. 962–971, 2020.
  38. W. Stuerzlinger, O. Chapuis, D. Phillips, and N. Roussel, “User interface façades: Towards fully adaptable user interfaces,” in Proceedings of the 19th annual ACM symposium on User interface software and technology, 2006.
  39. E. Plebankiewicz, M. Juszczyk, and J. Malara, “Estimation of task completion times with the use of the PERT method on the example of A real construction project,” Arch. Civ. Eng., vol. 61, no. 3, pp. 51–62, 2015.
  40. G. Singh, C. P. C. Chanel, and R. N. Roy, “Mental workload estimation based on physiological features for pilot-UAV teaming applications,” Front. Hum. Neurosci., vol. 15, p. 692878, 2021.
  41. S. Alhomdy, F. Thabit, F. H. Abdulrazzak, A. Haldorai, and S. Jagtap, “The role of cloud computing technology: A savior to fight the lockdown in COVID 19 crisis, the benefits, characteristics and applications,” International Journal of Intelligent Networks, vol. 2, pp. 166–174, 2021, doi: 10.1016/j.ijin.2021.08.001.
  42. A. Roshini, V. D. V. sai, S. D. Chowdary, M. Kommineni, and H. Anandakumar, “An Efficient SecureU Application to Detect Malicious Applications in Social Media Networks,” 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Mar. 2020, doi: 10.1109/icaccs48705.2020.9074169.
  43. M. S. Mrutyunjaya, R. Arulmurugan, and H. Anandakumar, “A Study on Varıous Bıo-Inspıred Algorıthms for Intellıgent Computatıonal System,” New Trends in Computational Vision and Bio-inspired Computing, pp. 1533–1540, 2020, doi: 10.1007/978-3-030-41862-5_157.
  44. H. Anandakumar and K. Umamaheswari, “A bio-inspired swarm intelligence technique for social aware cognitive radio handovers,” Computers Electrical Engineering, vol. 71, pp. 925–937, Oct. 2018, doi: 10.1016/j.compeleceng.2017.09.016.

Acknowledgements


Author(s) thanks to University of Nairobi for research lab and equipment support.


Funding


No funding was received to assist with the preparation of this manuscript.


Ethics declarations


Conflict of interest

The authors have no conflicts of interest to declare that are relevant to the content of this article.


Availability of data and materials


No data available for above study.


Author information


Contributions

All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.


Corresponding author


Rights and permissions


Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/


Cite this article


John Huria Nderitu, “AMental State Adaptive Interfaces as a Remedy to the Issue of Long-term, Continuous Human Machine Interaction”, Journal of Robotics Spectrum, vol.1, pp. 078-089, 2023. doi: 10.53759/9852/JRS202301008.


Copyright


© 2023 John Huria Nderitu. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.