Pradeep Varma

Background

About Pradeep Varma

Experienced Big Data Engineer with over 10 years of expertise in building large-scale, high- performance ETL pipelines and real-time data streaming solutions using PySpark, AWS (S3, EMR, Glue), Kafka, and Airflow. • Adept at designing and optimizing distributed data processing architectures that drive operational efficiency and deliver business insights. • Proven track record in leading data integration and transformation initiatives across banking, telecom, and enterprise domains. Skilled in handling end-to-end data workflow from ingestion and storage to transformation and analytics while ensuring performance, scalability, and reliability. • I thrive in fast-paced, Agile environments, and bring a solution-oriented mindset backed by hands- on experience with Hadoop, Spark (Scala & Python), SQL/NoSQL databases, and modern cloud data platforms. • Currently focused on expanding expertise into Databricks and Snowflake to align with evolving data ecosystems.