Joydeep Sarkar

Background

About Joydeep Sarkar

Lead Data Engineer with 10+ years of experience designing and implementing scalable data platforms using AWS, Azure, Databricks, and Informatica. Proven expertise delivering data solutions for banking (credit risk technology, CECL models, and Basel reportings), P&C insurance (Guidewire claims/policy data), and retail ERP systems. Proficient in end-to-end data pipeline development, data lake architecture, and real-time processing with Apache Spark, Hive, and Kafka. Skilled in data modeling, pipeline orchestration, CI/CD, and leading cross-functional teams to deliver analytics-ready data systems for business intelligence and machine learning. TECHNICAL SKILLS : Cloud Platforms - AWS (S3, Redshift, Glue, Lambda, Athena, CloudWatch), Azure (ADF, Databricks, ADLS Gen2, Synapse) Big Data and Processing - Spark, PySpark, PySQL, Hive, Kafka, Hadoop, Delta Lake, Parquet, ORC, Avro ETL and Orchestration - Informatica PowerCenter and IDMC/IICS, Autosys, Airflow, Oozie and Control-M Programming and CI/CD - Python, SQL, Unix Shell, GitHub, Bitbucket, Azure DevOps, Jenkins Visualization and Reporting - Power BI and Tableau Modeling and Architecture - Star and Snowflake Schema, Data Lakehouse, Medallion Architecture Data Governance - GDPR, HIPAA, CCPA and SOC2 Project Delivery - Agile, Scrum, Jira, Confluence, Stakeholder Collaboration and Project & team management