Dheeraj Pant

Background

About Dheeraj Pant

I am an accomplished Lead Data Engineer with extensive experience in retail data management, campaign analytics, and My expertise includes orchestrating end-to-end data pipelines using Apache NiFi, PySpark, and Python to process retail campaign data into Azure Data Lake Storage (ADLS). I am proficient in Azure Data Factory (ADF), Databricks, and Delta Lake for advanced data analytics, including AROAS and IROAS calculations. With a solid foundation in SQL, I leverage Azure DevOps for version control and collaboration- Data Pipeline Management: Orchestrated data workflows using Apache NiFi for seamless ingestion and transformation of retail campaign data into ADLS, ensuring data integrity and reliability- Analytics with PySpark and Python: Conducted in-depth analysis of retail campaign performance metrics using PySpark and Python, providing actionable insights with statistical models and machine learning techniques in Databricks- Azure Data Factory (ADF): Designed and implemented ADF pipelines for automated data processing, optimizing efficiency and reliability of data operations- 🧠 Databricks Analytics: Leveraged Databricks notebooks for data analysis, feature engineering, and model training, enhancing decision-making and strategic planning for marketing campaigns- Delta Lake Management: Implemented Delta Lake architecture to ensure ACID transactions and schema enforcement, maintaining data consistency and reliability- SQL for Data Transformation: Utilized SQL for complex data querying, transformation, and aggregation, enabling efficient data processing across multiple sources- Azure DevOps: Managed data engineering projects in Azure DevOps, implementing CI/CD pipelines for version control, automated testing, and deployment, ensuring scalability and maintainability- Data Governance and Compliance: Established data governance frameworks to uphold data quality standards, security protocols, and regulatory compliance, safeguarding sensitive retail campaign data- 🤝 Cross-Functional Collaboration: Fostered collaborative relationships with Consumer Packaged Goods (CPG) partners and internal teams and third parties, ensuring alignment on data-driven initiatives and strategic goals- Team Leadership: Led and mentored cross-functional teams in agile environments, promoting a culture of innovation and continuous learning to deliver high-quality data insights and solutions. I thrive in dynamic environments where collaboration, innovation, and continuous learning are key to achieving impactful results.