International Journal on Science and Technology

E-ISSN: 2229-7677     Impact Factor: 9.88

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 16 Issue 2 April-June 2025 Submit your research before last 3 days of June to publish your research paper in the issue of April-June.

The Impact of Generative AI on Data Engineering: A Technical Perspective

Author(s) Raghavendra Kurva
Country United States
Abstract The integration of generative AI is fundamentally transforming the landscape of data engineering, revolutionizing how organizations approach pipeline development, maintenance, and optimization. This transformation spans across various sectors, from automotive to insurance, introducing sophisticated
approaches to data processing and management. The article explores how AI-driven solutions are enhancing pipeline efficiency, automating routine tasks, and enabling more sophisticated approaches to data quality management and monitoring. Through case studies in automotive and insurance sectors, the
research demonstrates the practical implementation of AI-powered systems in real-world scenarios, highlighting advancements in areas such as real-time data processing, automated schema translation, and intelligent metadata management. The article also examines technical implementation considerations, emphasizing the importance of robust frameworks for AI integration and performance monitoring.
Keywords Generative AI, Data Pipeline Optimization, Automated Data Engineering, AI-Driven Development, Metadata Management
Field Computer
Published In Volume 16, Issue 1, January-March 2025
Published On 2025-03-21
Cite This The Impact of Generative AI on Data Engineering: A Technical Perspective - Raghavendra Kurva - IJSAT Volume 16, Issue 1, January-March 2025. DOI 10.71097/IJSAT.v16.i1.2497
DOI https://doi.org/10.71097/IJSAT.v16.i1.2497
Short DOI https://doi.org/g892hb

Share this