Suraj Pathak

Background

About Suraj Pathak

I am a results-oriented Data Engineering & Analytics Consultant with over 13 years of proven expertise in delivering scalable, secure, and cloud-native data solutions across healthcare and insurance domains. My core strengths lie in Azure (ADF, Databricks, ADLS Gen2), Python/PySpark, and driving enterprise data migrations from on-premise to modern cloud platforms. I specialize in designing ETL frameworks, building modular PySpark pipelines, and orchestrating end-to-end project delivery using Agile methodologies. I’ve led SAS-to-Azure cloud migrations, optimized complex data workflows, and implemented data governance protocols (PIPEDA/HIPAA) that ensure regulatory compliance and operational efficiency. From writing optimized SQL queries and building metadata lineage to coordinating test cycles using Azure DevOps and driving Agile ceremonies, I bring both technical depth and delivery discipline. My ability to translate business challenges into technical solutions has consistently added value across large-scale, cross-functional initiatives. Key Highlights • Architected reusable ADF + PySpark pipelines processing 30M+ records • Automated data validation using SQL, Python & Azure Test Plans • Integrated GenAI chatbot with Azure backend for internal productivity boost • Successfully led migration of legacy SAS workloads to Databricks & Synapse • Certified in Microsoft Fabric (DP600), ScrumMaster®, and Cognitive AI PM Currently, I am focused on AI-integrated data solutions, cloud optimization, and contributing to high-impact projects that bridge business goals with intelligent data platforms. Let’s connect if you’re looking for someone who can blend data engineering leadership, AI-driven automation, and enterprise-grade project governance with a passion for continuous learning and delivery excellence.