Suriya Kumar

Background

About Suriya Kumar

As a Data Engineer, I have a proven track record of delivering high-quality data solutions. I have extracted and processed data from over 50 websites, including large-scale projects involving 5M+ records within a single week. My expertise in Python, along with libraries like Pandas, NumPy, BeautifulSoup, Scrapy, Requests, and Selenium, allows me to efficiently collect, process, and analyze massive datasets. I have integrated APIs from 20+ diverse sources—ranging from social media to e-commerce and government databases—streamlining data ingestion for analytics. My optimizations have reduced scraping error rates by over 80% and saved clients more than 50 hours per week in manual data collection. I am skilled in PostgreSQL for data storage and management, ensuring accuracy and structure for downstream analytics. In addition to my data engineering and scraping expertise, I recently earned a Post Graduate Certificate in DevOps from Simplilearn (Caltech), gaining hands-on experience in tools and practices such as Linux, Jenkins, Ansible, Terraform, Docker, and Git. This combination of data engineering and DevOps enables me to design scalable pipelines, automate workflows, and deploy robust solutions. I am passionate about continuous learning, optimizing data processes, and collaborating with cross-functional teams to deliver impactful, business-ready data solutions.