Aaditya Sharma

Background

About Aaditya Sharma

Data Engineer with extensive experience in creating robust and dynamic data pipelines, specializing in Azure Data Factory (ADF), Databricks, Pyspark and SQL. I have a strong history of improving ETL processes and updating old systems to newer platforms. Key Highlights- Pipeline Development: Expert in designing and implementing complex and dynamic pipelines, ensuring seamless data flow and processing- ETL Migration: Successfully migrated legacy ETL tasks from Abinitio to Azure Data Factory (ADF), improving performance and scalability- Data Transformation: Skilled in using Databricks PySpark Notebooks and ADF dataflows to transform and enrich data, providing actionable insights- Data Processing: Developed highly efficient workflows for data extraction, transformation, and loading (ETL), enhancing overall data management- Data Integration: Managed diverse transportation data from multiple sources including MySQL, Teradata, SFTP, Oracle, and on-premise systems, handling both transactional and non-transactional databases- Automation and Orchestration: Utilized ADF and Azure Databricks to automate data pipelines, reducing manual efforts and minimizing errors. Passionate about leveraging cutting-edge technologies to solve complex data challenges and drive business value.