Mallappa Malagi

Background

About Mallappa Malagi

Spark Developer: Key Skills: Apache Spark, Scala, Apache NiFi, Amazon Web Services(EMR & S3), Apache Kafka, Hive, GIT 6.3 years of IT experience and have good experience in working with near real-time structured streaming data coming from different source systems Good understanding of Spark Architecture and underlying Spark framework for processing large amount of data near real-time. Handled structured and unstructured data coming from different source systems and processed using Spark framework. Created Nifi data ingestion flows for different types of data coming from different source systems. Writing Spark jobs using Scala to process batch data and structured streaming data from various source systems. Exposed in working with Spark SQL, DataFrame and Dataset API's and optimized the spark codes. Build and deployment of Spark application to Amazon EMR cluster using Jenkins and Monitor the jobs. Expertise in ETL, writing T-SQL Queries, sub-queries and complex joins for generating Complex Stored Procedures. Strong Analytical and programming skills in using technology to develop effective complex business solutions. Good working knowledge of product life cycles phases like requirement specification, software designing and development, testing and maintenance.