Ajay Dubey

Background

About Ajay Dubey

With 15+ years of hands-on experience, I have spearheaded the design, architecture, and development of cutting-edge data & AI platforms for both batch and real-time needs. I have consistently led initiatives that modernize data ecosystems and drive business-critical insights at scale. Currently, I oversee multiple high-performing engineering teams responsible for building scalable & Intelligent data & AI Platforms,Enabling capabilities like Iceberg migration, data governance, data quality, and observability frameworks. I champion best practices in system design and delivery across distributed environments.Key Achievements:• Architected and developed a configuration-driven, real-time processing platform to handle high-throughput batch and streaming workloads.• Building Multi Agent based System to improve Efficiency of system and reducing TAT• Architected and developed a flexible in-house OLAP engine, drawing inspiration from open source OLAP cubes to support analytical use cases.• Architected a configuration-driven, real-time fraud management and Anomaly Detection system• Led globally distributed engineering teams and ensured timely, high-quality product releases through disciplined SDLC execution.Technical Skills:• Languages: Java, Scala, C#, Python• Big Data Ecosystems: Apache Spark, Flink, Hadoop HDFS, Presto, MapReduce, Hive, Sqoop, Zookeeper, Hue, Kudu, Yarn• AI Landscape: Gen AI, Agentic AI, Multi Agent, RAG based systems• NoSQL Databases: MongoDB, DocumentDB, Redis, Cosmos DB• Databases: SQL Server, Sybase, PostgreSQL• In-Memory Databases: H2• Streaming Technologies: Kafka, Spark Streaming, Flink• Query Engines: Hive, Trino, Waggledance, Presto• Distributions: CDH, Open Source, EMR• Message Queues: Kafka, RabbitMQ, ZeroMQ• Microservices: Spring Boot, Web API, gRPC, REST API, Docker, Kubernetes• Cloud Providers: Azure, AWS• Logging/Metrics/Observability: Splunk, Datadog, Elasticsearch• Orchestration: Oozie, Airflow• Reporting Tools: Power BI, Tableau• Data Pipelining: NiFi• Containers: Docker, Kubernetes• Miscellaneous: Performance Improvements, System Design, Distributed Systems, Highly Scalable Systems• CI/CD: Jenkins, Spinnaker,GitHub ActionsMotivated by building systems that are not just robust and scalable, but also elegant in design. I excel in dynamic, fast-paced environments where my leadership and technical depth foster innovation and deliver measurable business outcomes. I continuously strive for operational excellence and embrace a mindset of learning, mentorship, and strategic impact.