Dharmesh Gupta

Background

About Dharmesh Gupta

I am a Data Engineer with over 9+ years of experience in designing, developing, and optimizing data solutions across on-premises and cloud platforms. My background combines 5 years as a PL/SQL Developer and 4 years as an Azure Data Engineer, giving me strong expertise in both traditional database systems and modern data engineering practices. My core skills include Azure Data Factory (ADF), Azure Databricks, PySpark, SQL, and Python, where I focus on building scalable, automated ETL/ELT pipelines and delivering high-performance data processing solutions. Key achievements include:* Leading data migration projects from Oracle to Azure SQL.* Implementing complex data transformations using Databricks and PySpark to replace stored procedures.* Optimizing Spark performance with partitioning, caching, and tuning techniques.* Designing robust data workflows aligned with Agile and CI/CD best practices. I have extensive experience in the Merchant Acquiring and Transaction settlements in Banking, Property and Casualty Insurance, Life Sciences domain, delivering validated and audit-ready data solutions for compliance, reporting, and analytics. My goal is to create future-proof, reusable data frameworks that improve data quality, reduce manual effort, and enable faster, data-driven decision-making. Azure Data Engineer | Azure Data Factory | Azure Databricks | PySpark | SQL | Python | ETL Pipelines | Cloud Data Migration | Big Data | Performance Tuning | Life Sciences | Merchant Acquiring | P&C Insurance