ABOUT CLIENT This independent research group focuses on tracking and forecasting infectious diseases. Initially studying illnesses like influenza and dengue, they later expanded to global outbreaks such as COVID-19. The team gathers unique data sources, extracts key indicators of disease activity, and shares them publicly to support real-time monitoring and short-term forecasts. Their mission is to strengthen global readiness for future epidemics through data-driven insights and predictive modeling. PROJECT TECH STACK Apache Airflow 3.0, PostgreSQL PROJECT STAGE Live product QUALIFICATIONS AND SKILLS * 5+ years of experience with Airflow, with a focus on quality and depth of understanding, not just duration on the platform. * Proven experience designing, deploying, and maintaining production-grade ETL workflows using Apache Airflow, with a strong understanding of DAG orchestration, performance optimization, and operation in managed environments such as Astronomer. * Senior-level expertise in scaling, best practices, maintainability, and cost management — not just someone who can build pipelines. * Strong DBT skills would be a plus (the team has not yet adopted DBT, but is considering it). * Solid knowledge of Postgres optimization and the ability to clearly explain not only how to implement optimizations but also why they are needed. * Excellent communication skills are needed as the team needs guidance to enhance their capabilities more than immediate technical fixes.
RESPONSIBILITIES * Ensure and help define best practices that promote maintainability and high code quality across the team. * Assist in resolving performance issues as they arise and proactively identify potential performance concerns. * Help the team detect bugs and problem areas early in the development process. * Guide the building of scalable solutions and the effective management of hosting costs.
