Weather Prediction Pipeline with Airflow

An individual training project.

Project overview

The objective was to express a workflow as explicit Airflow tasks.

My contribution

I built the training workflow as an individual exercise.

Architecture / workflow

Fetch
Transform
Train A
Train B
Select model

Implementation highlights

  • Airflow DAG task dependencies.
  • Parallel training before selection.
  • Docker-based environment.
AirflowPythonscikit-learnDocker

What I learned

The exercise clarified task separation and dependencies.