Miles Herr

Background

About Miles Herr

I’m a highly motivated Data Engineer with a passion for building scalable, high-performance data platforms that solve complex business problems—especially in healthcare technology and advertising. I bring a unique mix of deep technical expertise and stakeholder leadership, enabling me to design robust architectures while ensuring they align with business goals. In my current role, I own end-to-end pipelines using Airflow, Python, PostgreSQL (Crunchy Bridge), S3, and Fivetran—from ingestion through transformation and delivery. I’ve led major migrations from legacy MySQL systems to centralized PostgreSQL environments, implemented Lambda-style architectures for real-time analytics, and introduced innovative ingestion frameworks using PostgreSQL’s MERGE + strategic hashing to reduce overhead and increase flexibility. My work spans performance optimization (strategic indexing, EXPLAIN ANALYZE, DuckDB integration), data quality improvements (logical replication for isolated transformations), and stakeholder-facing tools (dashboards, operational controls, documentation). Within my first 9 months, I served as a critical stakeholder and owner of multiple new workstreams, influencing platform direction and cross-functional priorities. Core Technical Strengths: Languages: Python, SQL, Bash; OOP & functional programming Databases: PostgreSQL, MySQL, RDS; OLTP/OLAP patterns; Iceberg tables Data Lakes/Warehousing: AWS S3, Glue, Athena, AWS Wrangler/Boto3, BigQuery Analytics & Orchestration: Airflow, Prefect, DBT, Pandas, NumPy, Matplotlib, Tableau, Streamlit Cloud & DevOps: AWS, GCS, Terraform, Docker, AWS ECR, GitHub Actions, Flask APIs