Jenil Thayalan

Background

About Jenil Thayalan

Experienced Big Data developer with a strong passion for working on Big Data and Cloud Computing projects.Proficient in the Hadoop framework and adept at handling large sets of structured and semi-structured data using Spark SQL.Skilled in utilizing PySpark for working with JSON and XML data.Well-versed in writing efficient HIVE queries and leveraging PIG scripts for data processing.Experienced in utilizing Sqoop jobs for seamless data import and export from HDFS.Proficient in Python programming language and adept at Unix shell scripting.Strong knowledge in querying, managing, retrieving, and storing data in various SQL databases including MySQL, Db2, and MS SQL.Specialized in handling massive datasets, scaling up to terabytes of data using Spark Scala.Experienced in implementing CI/CD pipelines using GitHub and Jenkins for continuous integration and deployment.Proficient in utilizing Azure and Databricks for cloud-based Big Data solutions.Skilled in creating DevOps pipelines, deploying function apps, and configuring blob locations for efficient data processing.