Prashant Ahire

Background

About Prashant Ahire

Highly accomplished Lead Data Engineer with 9+ years of comprehensive IT experience, specializing in Data Warehousing, ETL, Data Modeling, and large-scale data solutions. Proven ability to lead teams in delivering highly scalable and robust solutions on distributed systems and on GCP. Expertise encompasses both development of complex data pipelines and applications also seamless migration from diverse platforms. Key Skills & Experience:* GCP Proficiency: Extensive hands-on experience with core GCP services, including BigQuery, Cloud SQL, Cloud Storage, Compute Engine, Cloud Logging, Cloud Composer (Airflow), Dataflow, and Data Catalog.* Big Data Technologies: Deep understanding and practical implementation of Hadoop ecosystem components, Hive, spark, flink and PySpark, enabling the development of efficient and scalable data processing solutions.* Data Engineering & Development: Demonstrated expertise in designing, developing, and deploying end-to-end data pipelines for both data migration and new service development. This includes building robust ETL/ELT processes, implementing data quality checks, and optimizing performance for large datasets.* Data Migration Expertise: Proven track record of successfully migrating data from various legacy systems to GCP, ensuring data integrity and minimal disruption.* Programming & Scripting: Proficient in Python, with a focus on data manipulation and automation, particularly using PySpark for distributed data processing.* Workflow Orchestration: Skilled in utilizing Airflow (Cloud Composer) for scheduling and managing complex data workflows.* Team Leadership: Proven ability to lead and mentor data engineering teams, fostering a collaborative and high-performing environment.* Solution Architecture: Designing and implementing high-performance solutions that leverage cloud-based big data platforms, ensuring scalability, reliability, and cost-effectiveness. BigData and Other- Hadoop, Hive, Spark, Pyspark, Sqoop, Databricks Programming languages- Python, SQL, Shell scripting Database technologies- Mysql, Oracle SQL Server, Teradata, Hbase, Snowflake GCP Services: Compute- Compute Engine, GKE, Cloud Run, Cloud Functions,Pub/Sub Database and Storage- GCS, Cloud SQL, Cloud Bigtable, DTS Data Analytics- BigQuery, Cloud Dataflow, Cloud Dataproc, Cloud Pub/sub, Looker, Cloud Composer Security- IAM,KMS, Secret Manager,DLP, Logging