Divya Venkat

Background

About Divya Venkat

4 years of IT experience, as a HADOOP administrator 3.5 years and other skills like Linux with AWS cloud Administrator. Good working experience on HADOOP framework and its Eco-System. Around Expertise in HADOOP architecture, design and development of Big Data platform including large clusters, HADOOP ecosystem projects. Expertise to install HADOOP and its related components in a multi-node cluster environment. Expertise in HDFS Architecture and Cluster concepts. Worked in 24x7 environment for production support in an on-call rotation. Expertise in Cluster Installation for Lab, Staging and Production environment. Expertise in HADOOP job schedulers such as Fair scheduler and Capacity scheduler. Knowledge of Cluster coordination services using Zoo Keeper. Experience in configuring other HADOOP data distribution services like HBASE Hive, Impala etc. on a need basis. Experience in AWS services like EC2 for installing and managing HDP clusters. Cluster planning and maintenance by adding and removal of nodes. Good experience in big data components such as HDFS, YARN and knowledge on hive, pig, SQOOP, flume, map reduce etc. Good experience in monitoring cluster and scheduling the jobs. Commissioning and decommissioning the nodes in a cluster. WORKING ON different RDBMS system like Oracle, MYSQL etc. Troubleshooting, diagnosing, tuning and solving the HADOOP issues. Exposure in HADOOP shell commands, HADOOP upgrade and rollback, backup and restore. Uploading data from different sources to the HDFS. Monitoring and scheduling of Oozie work flow to support production jobs. Good working Knowledge on CLOUDERA distribution. Manage and review HADOOP log files. HADOOP support and maintenance Knowledge on Kerberos with AD(Active Directory) and LDAP. Ability to create shell scripts and automate the regular manual tasks. Working together with infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability. Excellent communication, organizational and analytical skills and always willing to learn. using ansible tool to push the configuration changes over the cluster. creating the documents for day to day issues and updating same on Confluence