Sourav Halder

Background

About Sourav Halder

I have over five years of experience as a Software Engineer, specializing in backend servers, data pipelines, integration, and DevOps. Currently, I am a Software Engineer at Snap Inc, where I engineer auto-scalable streaming and batch pipelines using Dataflow, Python, and Apache Beam, automating a previously manual client integration process and reducing integration time by 4x. I also design and execute a comprehensive monitoring plan, delivering a monitoring dashboard for data pipelines using Stackdriver, Gcloud monitoring, and VictorOps. This solution not only enables the detection and debugging of elusive system crashes but also helps to improve overall throughput. Previously, I was a Senior Software Engineer and Team Lead at ConvertCart, where I led a team of six developers using Agile Scrum methodologies to develop Email Marketing Software, driving a 22% increase in client retention. I achieved a tenfold improvement in email delivery speed through the implementation of load-balanced pub/sub architecture and horizontal scaling, addressing performance issues with Prometheus and Grafana. I also played a pivotal role in the design of key components, including the Workflow Engine, Bulk Emailing tool, and Email Editor. I am proficient in Node.js, Python, Apache Beam, Terraform, MySQL, and BigQuery, and skilled in orchestrating auto-scalable pipelines and crafting innovative monitoring solutions. I thrive in dynamic tech environments and enjoy solving complex problems with creative and collaborative approaches. My goal is to leverage my expertise and passion for data engineering to create value for my company and its users.