Lida Guan

Background

About Lida Guan

Self Introduction My name is Guan Lida. I am a data engineer/machine learning engineer in the IT industry. By using the knowledge of big data and machine learning, I solve many problems of the real business. My technical skill covers business issue formulation, system design, big data ETL/platform operation(pyspark,delta), machine learning models/APIs, and public cloud environment(AWS, GCP) development. I also have experiences of toB products(Databricks, BytePlus) I have a solid academic background and got a master degree in Informatics. My research topic is about the application of multimodal learning between Computer Vision and Natural language processing by using statistical machine learning models. After my graduation, I became a data engineer at Yahoo Japan. I worked on solving the actual business issues and applying big data ETL solutions in the internet advertisement field. Seeking deeper engagement in machine learning and system development, I joined CyberAgent in 2021 as a machine learning engineer. Then I focused on the machine learning models/APIs development, ML based system design and cloud migration(GCP) of the ABEMA recommendation system. To challenge more business by using the big data and AI, I joined Databricks Japan in 2023 as a Forward Deployed Engineer. I focused on the professional service of Databricks to help our clients to improve their business through the technologies like Pyspark, delta lake, delta live table in big data fields, MLFlow and LLM in AI fields. I join the ByteDance Japan as a technical project manager to help clients to implement their recommend systems end-to-end. From the data design, data synchronization to the API integration, I help the clients to customize the most personalized ML model for their own business. As a TPM, I need to communicate with clients often to get the precise status, decide the timeline and milestones and also manage the risks.