Sambit Mohapatra

Background

About Sambit Mohapatra

I’m Sambit, having 9.5 years of experience, including 2.5 years in designing and implementing scalable data solutions using Azure services. 7 years in ETL testing, data warehousing (DWH) testing & Azure cloud testing. Proven leadership in managing teams of 4, with a good track record of delivering efficient, cloud-based solutions. Skilled in u Azure technologies to optimize data processes and achieve impactful business results.I specialize in designing, developing, and implementing scalable and efficient data solutions leveraging Azure services. My expertise encompasses a comprehensive range of skills that allow me to effectively support both batch and real-time data integration. I excel in designing and implementing solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Databricks, ensuring optimal performance and cost-efficiency.I have successfully implemented data integration solutions for batch and real-time data workflows, utilizing Azure Data Factory and Stream Analytics to facilitate seamless data flow and processing. Proficient in creating and scheduling Data Pipeline jobs and triggers in ADF, I ensure that data ingestion is timely and reliable, meeting the needs of various stakeholders. I possess a solid understanding of ADF components, including Pipelines, Activities, Dataflows, Linked Services, and Integration Runtime, enabling me to build robust data workflows tailored to business requirements.In Azure Databricks, I develop Spark applications using PySpark and Spark SQL for data extraction, transformation, and aggregation, driving insights from diverse data sources. My experience includes optimizing Spark code through various techniques such as Caching and Persistence, Broadcasting, Adaptive Query Execution (AQE), Skew Optimization, Repartitioning, Coalescing, and optimizing join operations to enhance performance.My knowledge spans various phases of the project lifecycle, including design, analysis, implementation, and testing, ensuring a thorough approach to delivering high-quality data solutions. I am committed to staying at the forefront of technological advancements and continuously strive to expand my skills in data engineering and integration. I am eager to connect with professionals and organizations that share my passion for leveraging technology to drive innovation and achieve impactful business results. Let’s collaborate to enhance the quality and reliability of data solutions together!