The majority of cloud service providers (CSPs) store and remove customer data according to certain principles. The majority of them have designed their cloud platform to have very high levels of consistency, speed, availability, and durability. Their systems are built with these performance characteristics in mind, and the requirement to ensure precise and rapid data deletion must be carefully balanced. In the public blockchain, this paper suggests employing the rapid content-defined Chunking algorithm for data duplication. Acute data is frequently outsourced by individuals and organizations to distant cloud servers since doing so greatly reduces the headache of maintaining infrastructure and software. However, because user data is transmitted to cloud storage providers and stored on a remote cloud, ownership and control rights are nonetheless separated. Users thus have significant challenges when attempting to confirm the integrity of private information. According to the experiment results, the suggested dynamic chunking has a fast processing time that is on par with fixed-length chunking and significantly improves deduplication processing capability.
Keywords
cloud service providers (CSPs); chunking algorithm; data duplication; blockchain;
Guo, S., Mao, X., Sun, M., & Wang, S. (2023). Double sliding window chunking algorithm for data deduplication in ocean observation. IEEE Access.
El Ghazouani, M., Latifa, E. R., & El Khanboubi, Y. (2020). Efficient method based on blockchain ensuring data integrity auditing with deduplication in cloud.
Sumathi, M. (2021). Secure blockchain based data storage and integrity auditing in cloud. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(9), 159-165.
Yuan, H., Chen, X., Wang, J., Yuan, J., Yan, H., & Susilo, W. (2020). Blockchain-based public auditing and secure deduplication with fair arbitration. Information Sciences, 541, 409-425.
Liu, L., Liu, X., & Wan, J. (2022). Design of Updating Encryption Algorithm for Privacy Big Data Based on Consortium Blockchain Technology. Journal of Mathematics, 2022.
Gnana Jeslin, J., & Mohan Kumar, P. (2022). Decentralized and privacy sensitive data de-duplication framework for convenient big data management in cloud backup systems. Symmetry, 14(7), 1392.
Zhou, B., Zhang, S., Zhang, Y., & Tan, J. (2015). A bit string content aware chunking strategy for reduced CPU energy on cloud storage. Journal of Electrical and Computer Engineering, 2015, 43-43.
Zhang, C., Qi, D., Li, W., & Guo, J. (2020). Function of content defined chunking algorithms in incremental synchronization. IEEE Access, 8, 5316-5330.
Prajapati, P., & Shah, P. (2022). A review on secure data deduplication: Cloud storage security issue. Journal of King Saud University-Computer and Information Sciences, 34(7), 3996-4007.
Ko, Y. W., Jung, H. M., Lee, W. Y., Kim, M. J., & Yoo, C. (2013). Stride static chunking algorithm for deduplication system. IEICE transactions on information and systems, 96(7), 1544-1547.
Rao, K. P. (2021). Efficient and Reliable Secure Cloud Storage Schema of Block chain for Data De-duplication in Cloud. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(9), 1547-1556.
Nisha, T. R., Abirami, S., & Manohar, E. (2016). Experimental study on chunking algorithms of data deduplication system on large scale data. In Proceedings of the International Conference on Soft Computing Systems: ICSCS 2015, Volume 2 (pp. 91-98). Springer India.
Bo, C., Li, Z. F., & Can, W. (2013). Research on chunking algorithms of data de-duplication. In Proceedings of the 2012 International Conference on Communication, Electronics and Automation Engineering (pp. 1019-1025). Springer Berlin Heidelberg.
El Khanboubi, Y., Hanoune, M., & El Ghazouani, M. (2021). A new data deletion scheme for a blockchain-based de-duplication system in the cloud. Int. J. Commun. Netw. Inf. Secur, 13, 331-339.
Rao, K. P. (2021). Efficient and Reliable Secure Cloud Storage Schema of Block chain for Data De-duplication in Cloud. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(9), 1547-1556.
Paul, S. P., & Vetrithangam, D. (2023, March). A Scientometric Study of Research Development on Cloud Computing-Based Data Management Technique. In Doctoral Symposium on Computational Intelligence (pp. 617-625). Singapore: Springer Nature Singapore.
Acknowledgements
We would like to thank Reviewers for taking the time and effort necessary to review the manuscript. We sincerely appreciate all valuable comments and suggestions, which helped us to improve the quality of the manuscript.
Funding
No funding was received to assist with the preparation of this manuscript.
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Availability of data and materials
Data sharing is not applicable to this article as no new data were created or analysed in this study.
Author information
Contributions
All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.
Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
Cite this article
Richa Arora and Vetrithangam D, “Enhancing Cloud Data Deduplication with Dynamic Chunking and Public Blockchain”, Journal of Machine and Computing, doi: 10.53759/7669/jmc202404050.
