Dhiraj B.

Background

About Dhiraj B.

I've spent the past 12+ years building web crawling systems that work at scale. Most of my work involves reverse engineering websites, understanding how anti-bot platforms like Akamai, Cloudflare, and DataDome detect scrapers, and finding clean ways to get past them. I deal with TLS fingerprinting, browser detection, CAPTCHAs, proxy rotation, and all the other stuff that makes large-scale scraping hard. Right now I'm at TrustYou, where I run the crawling platform for the hospitality space. We extract structured data from millions of bot-protected pages daily, and my job is keeping that pipeline fast, reliable, and adaptable when sites change their defenses. Before this, I spent close to 4 years at FIS Global leading an 8-person team building scrapers for the energy sector - real-time pricing data, market intelligence, that kind of thing. And before that, I worked at Amdocs and Accenture on data pipelines and automation in telecom. What I work with: Scraping - Scrapy, Crawlee, Playwright, Selenium, curl-cffi, BeautifulSoup Anti-bot - Akamai, Cloudflare, DataDome, Kasada, reCAPTCHA/hCaptcha bypass Techniques - TLS/JA3 fingerprinting, proxy rotation, browser emulation, headless Chrome Infra - Docker, Kubernetes, AWS, Elasticsearch, Grafana, Kibana Languages - Python (primary), JavaScript, Java, Bash Always happy to talk about crawling challenges or anti-bot research. Feel free to connect.