Manoj Kumar Das

Background

About Manoj Kumar Das

Hadoop Developer having around 5 years of IT experience in developing, delivering of software using wide variety of technologies in all phases of the development life cycle, including 2 years in hands-on experience in Big-data/Hadoop Technologies and 3 years of extensive experience in JAVA/J2EE Technologies, Database development, SQL, Data Analytics.>experience in JAVA/J2EE Technologies, Database development, ETL Tools, Data Analytics. Hands on experience in Apache Hadoop ecosystem components like HDFS, Hadoop Map Reduce, Zoo Keeper, Oozie, Hive, Sqoop, HBase,Pig, Spark, Spark Sql and Scala. • Expertise in writing UDFs for analyzing data using Hive and Pig. • Very good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance. • Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs, Python and Scala. • Experience in working with Map Reduce programs using Apache Hadoop for working with Big Data. • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and vice-versa. • In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce concepts. • Experience in analyzing data using Hive QL, Pig Latin, and custom Map Reduce programs in Java. • Knowledge of job workflow scheduling and monitoring tools like Oozie and Zookeeper. • Experience in optimization of Map reduces algorithm using Combiners and Partitioner to deliver the best results. • Developed SQL scripts using Spark for handling different data sets and verifying the performance over Map Reduce jobs. • Good understanding of NoSQL databases like HBase, MongoDB,Cassandra. • Expertise in core Java, Multithreading, JDBC, Shell Scripting and proficient in using Java API’s for application development.