In the domain of proactive healthcare management, the imperative for remote health monitoring has escalated, the remote health care in this scenario specially means, the patient is seating at the remote location that is not in the hospital setting, and doctor or healthcare worker is monitoring the health parameters gathered using biomedical sensors and passed through the network. Conventional methodologies, while partially effective, encounter challenges in predictive precision, responsiveness to evolving health dynamics, and managing the vast array of patient data. These limitations underscore the demand for a sophisticated, holistic solution catering to diverse use cases. This work introduces a pioneering framework amalgamating traditional machine learning (ML) models with the advanced capabilities of Deep Dyna Q Learning process to overcome existing constraints. This framework strategically utilizes ensemble of traditional algorithms which amalgamates the strengths of these diverse models. Central to this model is the integration of Deep Dyna Q Learning, empowering the system with real-time adaptability and dynamic decision-making process through reinforcement learning principles, thereby deriving insights from historical and simulated datasets to foster more nuanced, patient-centric decisions. The impact of this comprehensive approach is profound, evidenced by preliminary results showcasing significant enhancements in the efficiency of remote health monitoring systems. Notably, the model achieves increase in precision, accuracy and recall for disease prediction. These improvements signify a paradigm shift towards proactive and efficient healthcare interventions, especially in remote settings. The fusion of traditional ML techniques with Deep Dyna Q Learning emerges as a potent solution, heralding a revolution in remote health monitoring and establishing a new benchmark for proactive healthcare delivery scenarios.
Keywords
Remote Health Monitoring, Machine Learning, Deep Dyna Q Learning, Proactive Healthcare, Data Pattern Analysis
J. Edward, M. M. Rosli and A. Seman, "A New Multi-Class Rebalancing Framework for Imbalance Medical Data," in IEEE Access, vol. 11, pp. 92857-92874, 2023, doi: 10.1109/ACCESS.2023.3309732.
L. A. Alharbi, "Artificial Rabbits Optimizer With Machine Learning Based Emergency Department Monitoring and Medical Data Classification at KSA Hospitals," in IEEE Access, vol. 11, pp. 59133-59141, 2023, doi: 10.1109/ACCESS.2023.3284390.
S. Choi, H. -C. Seo, M. S. Cho, S. Joo and G. -B. Nam, "Performance Improvement of Deep Learning Based Multi-Class ECG Classification Model Using Limited Medical Dataset," in IEEE Access, vol. 11, pp. 53185-53194, 2023, doi: 10.1109/ACCESS.2023.3280565.
Y. Li, J. Yang, Z. Zhang, J. Wen and P. Kumar, "Healthcare Data Quality Assessment for Cybersecurity Intelligence," in IEEE Transactions on Industrial Informatics, vol. 19, no. 1, pp. 841-848, Jan. 2023, doi: 10.1109/TII.2022.3190405.
G. Bo, W. Shanshan, Z. Qing, P. Bo and Z. Yan, "Empowering Medical Data Analysis: An Advanced Deep Fusion Model for Sorting Medicine Document," in IEEE Access, vol. 12, pp. 1650-1659, 2024, doi: 10.1109/ACCESS.2023.3347029.
M. Owais, S. W. Cho and K. R. Park, "Volumetric Model Genesis in Medical Domain for the Analysis of Multimodality 2-D/3-D Data Based on the Aggregation of Multilevel Features," in IEEE Transactions on Industrial Informatics, vol. 19, no. 12, pp. 11809-11822, Dec. 2023, doi: 10.1109/TII.2023.3252541.
J. Rodriguez-Almeida et al., "Synthetic Patient Data Generation and Evaluation in Disease Prediction Using Small and Imbalanced Datasets," in IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 6, pp. 2670-2680, June 2023, doi: 10.1109/JBHI.2022.3196697.
X. Xu, H. Xu, L. Wang, Y. Zhang and F. Xaio, "Hygeia: A Multilabel Deep Learning-Based Classification Method for Imbalanced Electrocardiogram Data," in IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 20, no. 4, pp. 2480-2493, 1 July-Aug. 2023, doi: 10.1109/TCBB.2022.3176905.
Asiri et al., "Enhancing Brain Tumor Diagnosis: Transitioning From Convolutional Neural Network to Involutional Neural Network," in IEEE Access, vol. 11, pp. 123080-123095, 2023, doi: 10.1109/ACCESS.2023.3326421.
M. W. Condry and X. I. Quan, "Remote Patient Monitoring Technologies and Markets," in IEEE Engineering Management Review, vol. 51, no. 3, pp. 59-64, 1 thirdquarter,Sept. 2023, doi: 10.1109/EMR.2023.3285688.
Segun and A. Telukdarie, "Revolutionizing Healthcare Delivery Through Wireless Wearable Antenna Frameworks: Current Trends and Future Prospects," in IEEE Access, vol. 11, pp. 80327-80347, 2023, doi: 10.1109/ACCESS.2023.3298951.
L. Abirami and J. Karthikeyan, "Digital Twin-Based Healthcare System (DTHS) for Earlier Parkinson Disease Identification and Diagnosis Using Optimized Fuzzy Based k-Nearest Neighbor Classifier Model," in IEEE Access, vol. 11, pp. 96661-96672, 2023, doi: 10.1109/ACCESS.2023.3312278.
N. Bao et al., "Wi-Breath: A WiFi-Based Contactless and Real-Time Respiration Monitoring Scheme for Remote Healthcare," in IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 5, pp. 2276-2285, May 2023, doi: 10.1109/JBHI.2022.3186152.
T. C. Kwong, Y. S. Choy and S. W. Y. Mung, "Remote-Control Sound Pattern Recognition for Auditory Assessment and Therapy in Smart Healthcare," in IEEE Access, vol. 11, pp. 41167-41174, 2023, doi: 10.1109/ACCESS.2023.3269067.
Y. Li, M. Wang, K. Hwang, Z. Li and T. Ji, "LEO Satellite Constellation for Global-Scale Remote Sensing With On-Orbit Cloud AI Computing," in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 16, pp. 9369-9381, 2023, doi: 10.1109/JSTARS.2023.3316298.
F. Zeshan, A. Ahmad, M. I. Babar, M. Hamid, F. Hajjej and M. Ashraf, "An IoT-Enabled Ontology-Based Intelligent Healthcare Framework for Remote Patient Monitoring," in IEEE Access, vol. 11, pp. 133947-133966, 2023, doi: 10.1109/ACCESS.2023.3332708.
M. B. Singh, N. Taunk, N. K. Mall and A. Pratap, "Criticality and Utility-Aware Fog Computing System for Remote Health Monitoring," in IEEE Transactions on Services Computing, vol. 16, no. 3, pp. 1738-1749, 1 May-June 2023, doi: 10.1109/TSC.2022.3206770.
P. Kar, K. Chen and J. Shi, "DMACN: A Dynamic Multi-Attribute Caching Mechanism for NDN-Based Remote Health Monitoring System," in IEEE Transactions on Computers, vol. 72, no. 5, pp. 1301-1313, 1 May 2023, doi: 10.1109/TC.2022.3197955.
M. A. d. Santos, J. Herbert, I. Cinelli, J. A. L. Burmann, V. V. Soares and T. Russomano, "Development of a Digital Platform: A Perspective to Advance Space Telepharmacy," in IEEE Open Journal of Engineering in Medicine and Biology, vol. 4, pp. 168-172, 2023, doi: 10.1109/OJEMB.2023.3237988.
X. Wang and Y. Wu, "Fog-Assisted Internet of Medical Things for Smart Healthcare," in IEEE Transactions on Consumer Electronics, vol. 69, no. 3, pp. 391-399, Aug. 2023, doi: 10.1109/TCE.2023.3253896.
Singh, K. Chatterjee, A. K. Singh and N. Kumar, "Secure Smart Healthcare Framework Using Lightweight DNA Sequence and Chaos for Mobile-Edge Computing," in IEEE Internet of Things Journal, vol. 10, no. 6, pp. 4883-4890, 15 March15, 2023, doi: 10.1109/JIOT.2022.3219113.
Lakhan et al., "Federated-Learning Based Privacy Preservation and Fraud-Enabled Blockchain IoMT System for Healthcare," in IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 2, pp. 664-672, Feb. 2023, doi: 10.1109/JBHI.2022.3165945.
S. Misra, S. Pal, N. Ahmed and A. Mukherjee, "SDN-Controlled Resource-Tailored Analytics for Healthcare IoT System," in IEEE Systems Journal, vol. 17, no. 2, pp. 1777-1784, June 2023, doi: 10.1109/JSYST.2023.3245816.
J. Liu et al., "Conditional Anonymous Remote Healthcare Data Sharing Over Blockchain," in IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 5, pp. 2231-2242, May 2023, doi: 10.1109/JBHI.2022.3183397.
P. Soni, J. Pradhan, A. K. Pal and S. H. Islam, "Cybersecurity Attack-Resilience Authentication Mechanism for Intelligent Healthcare System," in IEEE Transactions on Industrial Informatics, vol. 19, no. 1, pp. 830-840, Jan. 2023, doi: 10.1109/TII.2022.3179429.
Abdullah Alqahtani, Shtwai Alsubai, Mohemmed Sha, Lucia Vilcekova, Talha Javed, "Cardiovascular Disease Detection using Ensemble Learning", Computational Intelligence and Neuroscience, vol. 2022, Article ID 5267498, 9 pages, 2022. https://doi.org/10.1155/2022/5267498.
Alanazi R. “Identification and Prediction of Chronic Diseases using Machine Learning Approach”. J Healthcare Eng. 2022 Feb 25;2022:2826127. doi: 10.1155/2022/2826127. PMID: 35251563; PMCID: PMC8896926.
H. A, B. L. R, S. Murugan, and M. Balakrishnan, “Deep Learning for Mental Health Disorder Via Social Network Analysis,” EAI/Springer Innovations in Communication and Computing, pp. 153–173, 2024, doi: 10.1007/978-3-031-53972-5_8.
Acknowledgements
Author(s) thanks to School of Computer Science and Engineering, Vellore Institute of Technology for research lab and equipment support.
Funding
No funding was received to assist with the preparation of this manuscript.
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Availability of data and materials
Data sharing is not applicable to this article as no new data were created or analysed in this study.
Author information
Contributions
All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.
Corresponding author
Ramanathan Lakshmanan
Ramanathan Lakshmanan
School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India.
Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
Cite this article
Gaikwad Rama Bhagwatrao and Ramanathan Lakshmanan, “Design of a Model Using Machine Learning and Deep Dyna Q Learning Integration for Improved Disease Prediction in Remote Healthcare”, Journal of Machine and Computing, pp. 531-540, July 2024. doi: 10.53759/7669/jmc202404051.
