Paul Kot

Background

About Paul Kot

As a Data Engineer for the City of Vancouver, I am at the forefront of driving digital transformation by modernizing our technology stack. My work focuses on interconnecting disparate on-premises databases using advanced tools like Azure Data Factory, Azure Databricks, and Microsoft Fabric. By doing so, I aim to empower the city through data, making it more agile and interconnected for the benefit of all citizens. In my current role, I orchestrate the ETL process using Azure Data Factory, while leveraging Python and SQL scripts to drive the data transformations. My focus is on building robust, flexible, and reusable pipelines through metadata-driven designs. This approach allows us to dynamically adapt our solutions for various projects without the need for extensive refactoring or hardcoding. Utilizing a metadata catalog within Databricks, our pipelines are guided by a philosophy of automation and efficiency. I am also gaining expertise in CI/CD processes, and I actively practice DataOps, using Azure DevOps for repositories and release pipelines to manage our diverse environments. What truly excites me is the impact our work has on the citizens of Vancouver. Knowing that the products we develop today will shape the city’s future is incredibly fulfilling. While I am still exploring the fields of machine learning and AI with the goal of transitioning into a Data Scientist role, I currently relish my position within our data team. Being part of the entire data lifecycle, from architecture to analysis, and collaborating with data professionals from various disciplines, makes this my dream job. I am driven by the knowledge that every project I work on contributes directly to the well-being of the city’s residents. I believe in the power of ideas and the importance of flexibility, openness to change, and respect for diverse perspectives. I thrive in environments where I can learn from others, especially those with more experience, as it allows me to grow and push into new territories. My work philosophy is grounded in the pursuit of continuous improvement and learning. Outside of work, I’m an avid rock climber with nearly 20 years of experience. My passion for climbing mirrors my approach to work: it’s all about creativity, finding new and efficient ways to solve problems, and knowing when to pause and reassess before pushing forward. I also love the mountains, and spending my free time skiing, hiking, and backpacking helps me reset and relax, giving me the clarity and energy to tackle challenges at work.