Milan Kumar Shingala

Background

About Milan Kumar Shingala

Passionate Data Engineer with 3+ years of hands-on experience in designing and implementing robust data solutions. Proficient in leveraging cutting-edge technologies to drive insights and streamline processes.**Experience Highlights:**- Led end-to-end data engineering projects, from architecture design to implementation, optimizing data pipelines for scalability and performance- Extensive proficiency in PySpark for data processing and transformation, ensuring efficient handling of large-scale datasets- Leveraged AWS Glue for ETL automation, reducing manual effort and enhancing data reliability- Implemented serverless data processing workflows using AWS Lambda, maximizing resource utilization and minimizing costs- Expertise in utilizing AWS Iceberg for efficient table management and versioning in data lakes- Proficient in querying and analyzing data at scale with AWS Athena, enabling quick and efficient data exploration- Designed and optimized data warehouses on Redshift, ensuring high-performance analytics and reporting capabilities- Utilized Databricks for collaborative and scalable data analytics and machine learning workflows- Implemented real-time analytics solutions using Druid, enabling instant insights into streaming data.**Skills:**- Programming Languages: Python, SQL - Big Data: PySpark,AWS Glue, AWS Lambda, AWS Iceberg,AWS Athena, Redshift, Databricks, Druid - Cloud Platforms: Amazon Web Services (AWS)- Data Quality Great Expectation - Databases Oracle PL/SQL, MS-SQL, MongoDB, Postgres - Data Modelling Proficient in designing efficient data model- Programming Python, Shell-script - Visualizations PowerBI, Tableu, Matplotlib, Seaborn - Miscellaneous Outlier Detection, Git, Service Now, Agile (Jira, Confluence)**Open to new opportunities and collaborations! Let's connect and explore how we can drive impactful data-driven solutions together.**