Pradip Thoke

Background

About Pradip Thoke

Over 16+ years of Data Engineering Leadership experience in building Self Serve Data Platforms. Experienced in Big Data Framework – Spark, Hadoop (HDFS, MapReduce, Pig, Sqoop, Hive, HCat, Oozie, Falcon, HBase, Phoenix, Logstash, Kafka, Camus, Flume, AWS, EMR, EC2, S3, Athena, AWS Data pipelines and related ecosystems) On-premise Hortonworks and Cloudera implementations, Cloud - AWS, GCP and Azure deployments and expertise in Snaplogic, Informatica, MSBI, Business Objects, Tableau, Looker, Unix Shell Scripting, Java and Oracle, Teradata, PostGres, Greenplum, Redshift, Snowflake, BigQuery, Hbase, Cassandra, Aurora, MS SQL, MySQL Databases, and over 13+ years of experience in Scrum, Agile development, specifically in Big Data Senior Architect Role. Being a Big Data Enthusiast - Architected and delivered Data Platform solutions using modern technology stack in a batch and real time analytics using Flink, Apache NIFI, Druid, Kafka, Spark Streaming, KSQL, and ELK stack. Implemented Data Lake/Lakehouse architectures and data acquisition, processing, storage and serving through self serve data platforms/products. Data observability, Data Governace, auto deployment, continuous delivery, incremental (hcatalog versioning), parallel development (virtual containers), monitoring frameworks for data applications. Agile based delivery professional.