Swaraj Chaudhari

Background

About Swaraj Chaudhari

Data Engineering Analyst | Azure, Databricks & PySpark Specialist | Building Scalable Medallion Architectures.In the modern data landscape, the difference between a "data-rich" organization and a "data-driven" one lies in the integrity and speed of its pipelines. As a Data Engineering Analyst at Accenture, I specialize in bridging that gap—designing, building, and optimizing the robust architectures that turn raw, chaotic data into a strategic asset.Since graduating with a B.E. in Computer Science in 2022, I have focused on mastering the Azure Data Stack. My work is centered on creating high-performance environments where data is not just stored, but intelligently orchestrated. Core Technical Competencies & Specializations• Modern Data Lakehouse Architecture: I implement Medallion Architecture (Bronze, Silver, and Gold layers) to ensure data quality and organizational clarity. By utilizing Delta Lake, I provide ACID transactions and scalable metadata handling. I've good understanding of data serialization formats like JSON, Parquet, or CSV.• Efficient Data Ingestion: I leverage Databricks Autoloader for incremental data ingestion, ensuring that pipelines are resilient, cost-effective, and capable of handling schema evolution automatically.• Real-Time & Batch Processing: My expertise spans both batch ETL and Spark Streaming, allowing for the delivery of low-latency insights that empower real-time decision-making.• Performance Optimization: I don't just build pipelines; I refine them. From Fact and dimension tables, Normalisation, optimizing Spark shuffles and partitioning strategies to fine-tuning SQL queries, I focus on reducing compute costs and increasing throughput.• Data Governance & Security: I prioritize the "trust" factor in data. By implementing strict data governance protocols, I ensure that data remains secure, compliant, and accessible to the right stakeholders, uses unity catalog. Technical Toolkit Data Engineering: Azure Data Factory, Azure Databricks. Cloud & Storage: Azure Data Lake, Azure Blob Storage, Delta Lake. Languages: Python, SQL, PySpark. Methodologies: ETL/ELT, CI/CD in Data, Data Modeling, Medallion Architecture, Performance Tuning & Optimization. Soft Skills Analytical problem-solver with a data-driven mindset Strong communicator skilled in stakeholder collaboration Team-oriented contributor focused on process and quality improvements Adaptable professional with a passion for continuous learning