Shivam Surya

Background

About Shivam Surya

Data Engineer | DevOps Engineer | Transforming Data into Actionable Insights ** Passionate about architecting robust data solutions and streamlining DevOps processes with cutting-edge technologies. Specializing in scalable data architectures, ETL pipelines, and DevOps practices for seamless integration and continuous deployment.**Key Skills:**- Data Engineering: ETL, Big Data (Hadoop, Spark), Data Warehousing, Database Management (SQL, NoSQL), Data Modeling - DevOps: CI/CD Automation, Containerization (Docker, Kubernetes), IaC (Terraform), Cloud Platforms (AWS/Azure), Monitoring & Logging **Tools & Technologies:**- ETL: Apache Airflow - Big Data: Hadoop, Spark - Databases: MySQL, PostgreSQL, MongoDB - DevOps: Jenkins, Docker, Kubernetes, Terraform, Ansible - Cloud: AWS (S3, Redshift), Azure (Blob Storage, Azure DevOps)**Cloud Expertise:**- Proficient in deploying and managing data solutions on major cloud platforms, ensuring scalability, security, and cost-effectiveness.**Professional Experience:**-**Data Engineering:**- ETL Pipeline Design: Leading scalable pipeline implementations for diverse datasets- Data Modeling: Applying advanced techniques for optimal storage and retrieval- Database Management: Optimizing SQL/NoSQL databases, ensuring data integrity- Collaborative Projects: Leading cross-functional teams for business-aligned projects-**DevOps:**- CI/CD Implementation: Architecting pipelines for efficient software delivery- Containerization: Utilizing Docker/Kubernetes for scalable deployment- IaC: Implementing Terraform for consistent infrastructure deployment- Cloud Platform Management: Optimizing AWS, Azure for performance and security.**Education:**- B.Tech in Computer Science and Engineering - Dr. A.P.J. Abdul Kalam Technical University, 2021 **Certifications:**- Microsoft Certified Azure Fundamentals (AZ-900)**Continuous Learner:**- Actively engaged in staying at the forefront of industry trends through webinars, courses, and conferences.**Let's connect!** Open to collaboration, networking, and discussions on the intersection of data engineering and DevOps. Feel free to reach out for exciting opportunities or industry insights.