Amit Mall

Background

About Amit Mall

Experience in data engineering, specializing in Hadoop, Spark, and SQL, to efficiently process and analyze large-scale datasets for actionable insights. • Designing and building end-to-end data pipelines, optimizing data extraction, transformation, and loading (ETL) processes, resulting in improved data quality and accessibility. • Skilled in orchestrating complex data workflows using Apache Airflow and Argo, streamlining data processing, transformation, and pipeline execution for enhanced efficiency. • Proficient in utilizing Git for effective code versioning and collaborating with cross-functional teams, ensuring seamless integration of code changes. • Collaborate effectively with data scientists, analysts, and stakeholders to understand data requirements, provide data support, and deliver actionable insights that drive informed decision-making. • Currently leveraging AWS EMR and S3 cloud buckets to design, develop, and implement scalable and cost-effective data solutions that meet business needs.