Soumak Motayed

Background

About Soumak Motayed

As Data Engineering Specialist at BT, below are my key responsibilities - Manage and maintain the entire Datalake platform for Global Voice process of british telecom. This includes various tasks like building data pipelines, look after data ingestion, verify consistency of data across platform, develop dashboards and visualizations which enables meaningful reporting and look after the entire architecture of datalake platform- Administration of the Elasticsearch Observability platform, troubleshoot performance issues, build pipelines, provision and enablement of new resources and data streams, create and manage the visualization and monitoring platforms- Perform periodic maintenance acitivities of Azure VMs, upgrade ELK clusters, backup & restores, management of ILM policies are some day to day responsibilities- Development of features for Ops team as per the requirements given by design team in order to enable monitoring of any new services in the platform- Work with APM for application performance monitoring, real user monitoring using elasticsearch- Troubleshoot log parsing errors, cluster health and performance errors etc of ELK environment- Manage the data streams on Kafka, debug and troubleshoot issues with Kafka, mirrormaker or performance issues- Provisioning monitoring agents using prometheus and exporters- Adept handling the entire ELK Stack including Elasticsearch, Logstash, Kibana, Filebeat, Metricbeat- Proficient in administration of devops tools like docker, kubernetes and azure devops for pipeline building, deployments, containerization and azure cloud.