Shivam Chanchal

Background

About Shivam Chanchal

Skills: Bigdata|Hadoop|ApacheSpark|Sqoop|Hive|Scala|Yarn|Nosql|Hbase • With 6 + Years of Experience in Hadoop, Sqoop & Spark Technology-Based Applications and working with Different variety of components within the Hadoop Eco System.• Good understanding on HDFS Architecture & various components such as HDFS, Resource Manager, Node Manager, Name Node, Data Node (YARN).• Experience in analyzing the data using HiveQL ( HQL ), HBase, Apache Spark (using Scala).• Experience in developing HiveQL( HQL ) Scripts.• Has Knowledge in Data Ingestion from RDBMS to HDFS and vice versa.• Worked on creating the Managed/External tables and implementing performance tuning mechanisms such as dynamic partitioning, Bucketing to improve the HiveQL query performance in Apache Hive.• Experience in transforming semi-structured data to structured format using various inbuilt functions and user Defined function• Good Knowledge in creating Spark Core RDD APIs, Data Frames APIs, Spark and Hive integration, Loading data from MySQL tables (RDBMS) to Spark, working with semi-structured data in Spark.• Good analytical and adaptable capabilities mixed with excellent decision-making skills.• Major strengths are eager to learn new technologies and methodologies, self-motivated, and quick learner with excellent interpersonal, technical, and communication skills.• Handled Complex data Solutions and Complex data Generations in Apache Spark