2nd International Conference on Materials Science and Sustainable Manufacturing Technology
Data Integration and Modelling using Talend
Avanthika S, Aniruthram K P, Anubama G, Sreemathy J, Department of Computer Science and Engineering, Sri Eshwar College of Engineering, Coimbatore, India.
The world revolves entirely around data. We are unable to find even the most fundamental facts without data.
Data will grow as enterprises do. You can learn a lot of things with these data. Data integration must be considered in
order to access this information. Data integration has a wide range of applications and is used to combine multiple
heterogeneous data sets into homogenous data. Analysis, extraction, transformation, and loading are all components of
integration. ETL is a key component of data integration and takes up the majority of the work. The concept of
warehousing is crucial because it describes how data that has undergone the ETL step will be loaded and used for various
purposes.
Keywords
Data Integration, Information, ETL, Heterogenous Data, Homogenous Data.
H. M. Gihan Chanuka Karunarathne, H. M. N. Dilum Bandara, and S. Herath, “WDIAS: A Microservices-Based Weather Data Integration and Assimilation System,” 2020 Moratuwa Engineering Research Conference (MERCon), Jul. 2020, doi:10.1109/mercon50084.2020.9185270.
M.-E. Vidal, S. Jozashoori, and A. Sakor, “Semantic Data Integration Techniques for Transforming Big Biomedical Data into Actionable Knowledge,” 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), Jun. 2019, doi:10.1109/cbms.2019.00116.
M. Matyoqubov, A. Saidov, O. Kazakov, and O. Rustamova, “Enterprise Systems Data Integration,” 2020 International Conference on Information Science and Communications Technologies (ICISCT), Nov. 2020, doi: 10.1109/icisct50599.2020.9351423.
Fivien Nur Savitri and H. Laksmiwati, “Study of localized data cleansing process for ETL performance improvement in independent datamart,” Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, Jul. 2011, doi:10.1109/iceei.2011.6021806.
P. S. Diouf, A. Boly, and S. Ndiaye, “Variety of data in the ETL processes in the cloud: State of the art,” 2018 IEEE International Conference on Innovative Research and Development (ICIRD), May 2018, doi: 10.1109/icird.2018.8376308.
D. Alvarez-Coello and J. M. Gomez, “Ontology-Based Integration of Vehicle-Related Data,” 2021 IEEE 15th International Conference on Semantic Computing (ICSC), Jan. 2021, doi: 10.1109/icsc50631.2021.00078.
S. Oni, K. Pansare, S. S. Arneja, Z. Chen, A. Crainiceanu, and D. Needham, “RDFINT: A Benchmark for Comparing Data Warehouse with Virtual Integration Approaches for Integration of RDF Data,” 2020 IEEE International Conference on Big Data (Big Data), Dec. 2020, doi:10.1109/bigdata50022.2020.9378131.
M. HAJJI, M. Qbadou, and K. Mansouri, “Towards the Development of Talend Open Studio Components for the Support of Semantic Sources,” 2019 1st International Conference on Smart Systems and Data Science (ICSSD), Oct. 2019, doi:10.1109/icssd47982.2019.9002820.
Md. Badiuzzaman Biplob, G. A. Sheraji, and S. I. Khan, “Comparison of Different Extraction Transformation and Loading Tools for Data Warehousing,” 2018 International Conference on Innovations in Science, Engineering and Technology (ICISET), Oct. 2018, doi:10.1109/iciset.2018.8745574.
B. Pan, G. Zhang, and X. Qin, “Design and realization of an ETL method in business intelligence project,” 2018 IEEE 3rd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), Apr. 2018, doi: 10.1109/icccbda.2018.8386526.
P. S. Diouf, A. Boly, and S. Ndiaye, “Variety of data in the ETL processes in the cloud: State of the art,” 2018 IEEE International Conference on Innovative Research and Development (ICIRD), May 2018, doi: 10.1109/icird.2018.8376308.
H. Dhayne, R. Haque, R. Kilany, and Y. Taher, “In Search of Big Medical Data Integration Solutions - A Comprehensive Survey,” IEEE Access, vol. 7, pp. 91265–91290, 2019, doi: 10.1109/access.2019.2927491.
Munawar, “Extract Transform Loading (ETL) Based Data Quality for Data Warehouse Development,” 2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI), Oct. 2021, doi: 10.1109/iccsai53272.2021.9609770.
A. Ta’a, N. Ishak, E. M. Elias, and N. Mahidin, “An Impact Analysis Of Extract Transform Load Process For Maintaining The System Of Data Warehouse,” Journal of Information System and Technology Management, vol. 7, no. 27, pp. 168–186, Sep. 2022, doi:10.35631/jistm.727014.
J. Sreemathy, I. Joseph V., S. Nisha, C. Prabha I., and G. Priya R.M., “Data Integration in ETL Using TALEND,” 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Mar. 2020, doi: 10.1109/icaccs48705.2020.9074186.
Cite this article
Avanthika S, Aniruthram K P, Anubama G, Sreemathy J, “Data Integration and Modelling using Talend”, Advances in Computational Intelligence in Materials Science, pp. 001-006, May. 2023. doi:10.53759/acims/978-9914-9946-9-8_1
