Deepak Dhotre

Background

About Deepak Dhotre

As a Senior Data Engineer with five years of experience, I specialize in designing, building, and maintaining data infrastructure and systems for large-scale data processing, storage, and analysis, specifically within the Azure and Hadoop ecosystems. I collaborate with business analysts, data scientists, and IT teams to translate their requirements into robust technical solutions, utilizing Azure services such as Azure Data Factory, ADLS Gen2, Azure Databricks, Azure Synapse Analytics, and HDInsight. I also work extensively with Hadoop, Sqoop, Hive, HBase, and Spark, with a deep understanding of PySpark, Scala, SQL, and Java for big data processing. I have successfully delivered projects in domains such as banking, media, and content analytics, with a strong focus on card transactions, credit history, fraud detection, customer segmentation, and rewards activity. My expertise in cloud technologies has allowed me to implement end-to-end ETL pipelines, optimize data processing workflows, and ensure data quality. Additionally, I possess solid knowledge of schema design, dimensional data modeling, and data quality monitoring within an Agile methodology framework. With a Post Graduate Diploma in Advanced Computing from CDAC and multiple certifications, including Azure Data Engineering (DP-203) and AWS Data Analytics Specialty, I bring a strong technical background and a continuous learning mindset to every project.