Prafulla Pati

Background

About Prafulla Pati

Professional, result-oriented, skilled Senior Data Engineer with 16 years of experience in Data Engineering, Data Pipeline Design, Software Development, Maintenance, Operational & Infrastructure Support-Major contribution in handling automated ETL framework for data ingestion, transformations, validation and loading-In-depth Knowledge and expertise on Databricks, SnowFlake, Spark, and ETL tools-Hands-on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python/Spark SQL, Unity Catalog and Databricks Live Table(DLT) framework-Expert in implementing data pipelines and orchestration using MWAA Airflow-Proficient in AWS data related services like EMR, Redshift, S3, Kinesis Firehose, Glue, Athena-Expertise in working with different databases like Postgres, Oracle, MySQL and Good knowledge in using NoSQL database MongoDB-Expertise in Python programming and scripting with Flask framework and SOAP/REST API-Proficient in AWS infrastructure services like VPC, EC2, S3, ELB, AutoScalingGroups(ASG), EBS, RDS, IAM, CloudFormation, Terraform, Route 53, CloudWatch, CloudFront, CloudTrail-Worked with various HDFS file formats like JSON, Parquet, Avro and various compression formats like Snappy, Gzip-Fair Experience on Machine Learning and Natural Language Processing (Machine learning) using Scikit Learn, NLTP, pandas, and numpy-Worked with JSON, YAML, XML, CSS3, HTML5 and JavaScript-Worked in an Agile(Scrum/Kanban) environment using different tools like JIRA, and Version One-Experience with several Version Control and Devops(CICD) tools like GIT, Jenkin, JFrog, UrbanCode Deploy-In-depth knowledge on ITIL concepts like Incident, Change and Problem Management using ServiceNow.