Bharathi Balan

Background

About Bharathi Balan

Work experience on Big Data software stacks such as HDFS, Sqoop, Hive, Spark, Scala, Kafka, Nifi, HBase, Oozie • Worked in the big data processing using Hadoop technologies Map Reduce, Apache Spark and Yarn. • Knowledge in streaming applications using Apache Kafka • Experience in managing HBase tables, column families, filter data from column families and alter tables based on the required attribute • Handled Sqoop incremental data load from RDBMS to HDFS, Hive tables for daily data growth • Basic understanding on Nifi data flow • Actively participated in software development lifecycle (scope, design, development, testing and implementation) • Hands on Experience in Linux Shell Scripting • Worked on RDDs, Data Frame creation, cache/persist, checkpoint RDD for the source data chunks • Good experience in handling XML files as source • Understanding about data sets, read data different source files like csv, Parquet, Avro, Json, Sequence files and store it in HDFS/Hive tables using Spark • Handled storage and retrieval of data in Amazon S3 buckets objects create/copy/move/deletion • Experience in Google Cloud Platform(GCP) creating cloud compute instances, scalability and high availability for Hadoop cluster