Anjul Gupta

Background

About Anjul Gupta

I am currently working as a Data Engineer in the BFSI domain at Infosys, where I design, optimize, and maintain data pipelines that power critical financial systems. My focus is on building scalable and reliable data solutions that enable business teams to make smarter and faster decisions. At Infosys, I have been actively involved in- Designing and optimizing ETL pipelines using PySpark, Databricks, and Airflow to process high-volume financial data- Implementing real-time streaming pipelines with Confluent Kafka for time-sensitive workloads- Delivering cloud-based solutions across Azure, Snowflake, and BigQuery, improving performance and reducing latency- Building data quality automation scripts in SQL + Python to ensure accuracy and trust in production-grade pipelines. Previously, I worked as an SDET in the BFSI domain, where I built automation frameworks using Selenium, Cucumber, and Java and validated large-scale data migration from Citi’s legacy STARS system to Pega downstream application. I also worked on Oracle upstream applications, validating data feeds and ensuring their accuracy before integration with multiple downstream systems. That role gave me strong coding discipline, debugging expertise, and a unique perspective on data quality and validation — a foundation I continue to leverage as a Data Engineer. 🧑‍Technical Expertise - Data Processing & Pipelines: SQL, Apache Spark (PySpark), Databricks, Hadoop, Hive - Streaming & Messaging: Confluent Kafka - Workflow Orchestration: Apache Airflow - Databases: MongoDB, Cassandra (NoSQL), Oracle (RDBMS)- Cloud & Warehousing: Azure, Snowflake, BigQuery - Modern Data Lakehouse: Apache Iceberg, Apache Hudi, Apache Trino - Data Quality & Automation: Test Automation (SDET background), CI/CD, Monitoring I am curious, quick to learn, and driven by complex challenges that push me to explore the latest in data and automation. My work reflects a passion for combining automation-first thinking with modern data engineering practices to deliver secure, scalable, and high-performing data systems. Alongside technical expertise, I bring strong DevOps and collaboration skills with tools like Git, GitHub, Bitbucket, JIRA, and Confluence, ensuring smooth delivery in cross-functional, fast-paced environments. Let’s connect if you’re building in the space of AI-led automation, scalable data platforms, or intelligent systems that drive real impact.