Rohit Vatsa

Background

About Rohit Vatsa

I’m a Data Engineer with 3.8 years of experience building and optimizing large-scale data pipelines across Azure and GCP. My journey has been all about solving tough data problems—whether it’s reducing runtime, cutting costs, or making data available faster for decision-making. At Tech Mahindra, I designed and deployed data pipelines on Azure Data Factory, Databricks, and ADLS, processing 2+ TB of data daily with 99.9% SLA compliance. By optimizing PySpark jobs with advanced partitioning and caching, I reduced runtimes by 45% and lowered compute costs by 20%. I also implemented a Delta Lakehouse architecture with schema evolution and automated data quality checks, cutting production issues by half. Before that, at TCS, I engineered pipelines on GCP (Dataproc, BigQuery) and the Hadoop ecosystem, reducing ETL processing time by 30% and query execution by 40%. I gained hands-on experience migrating legacy pipelines to modern cloud-native solutions while ensuring scalability and reliability. What drives me is turning messy, complex data into reliable, actionable insights. I enjoy bridging business needs with technical solutions, whether that means designing Lakehouse architectures, building streaming pipelines for real-time analytics, or fine-tuning SQL queries to squeeze out extra performance. I hold certifications in Azure Fundamentals (AZ-900), Google Associate Cloud Engineer, and Databricks Lakehouse Fundamentals, strengthening my ability to deliver value across multi-cloud environments. If you’re looking for someone who can optimize pipelines, enable modern data platforms, and deliver measurable impact, let’s connect.