Sai Dixit

Background

About Sai Dixit

Welcome to my LinkedIn profile! I am a dedicated Data Engineer with expertise in designing and developing high-performance data pipelines for real-time processing using Hadoop, Spark, Python, Scala, and DevOps tools within an AWS environment. My work focuses on maximizing data processing efficiency, leveraging Apache Spark Streaming for real-time insights, and setting up robust monitoring systems with AWS CloudWatch. I also create insightful dashboards using Power BI and AWS Quick Sight. My technical capabilities include SQL scripting, ETL pipeline implementation in Databricks, and optimizing workflows with Snowflake Data Integration tools. In previous roles as an ETL Developer, I gained valuable experience with Azure Data Factory, performed complex Spark transformations in Databricks, and led data pipeline projects leveraging AWS services. Additionally, I have a background in Linux automation, API development using Flask, and providing Tableau production support. I bring a results-driven approach to data engineering with a versatile skill set that includes Python, Java, SQL Server, Redshift, Airflow, Pandas, Tableau, Spark, Hadoop, Hive, Azure, and AWS. Known for delivering innovative, scalable solutions, I thrive in fast-paced environments and continuously adapt to evolving technologies. The Work I Love: Turning business challenges into scalable, reliable data solutions that make a real impact Using big data technologies to design, build, and optimize automated, end-to-end data pipelines Creating batch and real-time data processes for efficient data handling Implementing CI/CD for faster, automated deployments to save time and reduce human error