Stacc/Roadmaps/MLOps

MLOps learning roadmap

Take the model you built in Data Science to production: test it, ship it, monitor it, and improve it safely.

5 modules About 131 hoursFree resources

Complete Data Science first

Start with short learning sessions here. Continue coding and project work on your laptop with the same GitHub account.

Start this path
What you’ll build

Credit risk ML platform

Your Data Science model, run like a production system on Docker Compose: tracked training, CI gates, safe releases, rollback and monitoring while labels arrive late, built locally and then run on AWS. It continues in your Data Science repo, so the model and its production setup live together.

Tap a milestone to see what you’ll build on your laptop.

  1. 1Tracked, Repeatable Training

    Bring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.

    What to show: docker-compose.yml, the training flow, MLflow runs and a data contract.

  2. 2CI/CD for ML

    Add CI tests that block a release when quality, cost or speed gets worse.

    What to show: The CI workflow, regression tests and docs/release_gates.md.

  3. 3Serving and Safe Releases

    Run a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.

    What to show: Compose services, routing tests, load results and a rollback that works.

Tools: Grafana, Retrain.

Data + modelData + modelYour credit-risk data and champion model from Data Science. Given, not built.Your credit-risk data and champion model from Data Science.
01
MLflowMilestone 01Tracked, Repeatable TrainingBring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.Reviewer looks for: docker-compose.yml, the training flow, MLflow runs and a data contract.Tracked, containerised training. Bring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.
02
CI gatesMilestone 02CI/CD for MLAdd CI tests that block a release when quality, cost or speed gets worse.Reviewer looks for: The CI workflow, regression tests and docs/release_gates.md.Code, data and model tests; immutable artifacts. Add CI tests that block a release when quality, cost or speed gets worse.
03
ServingMilestone 03Serving and Safe ReleasesRun a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.Reviewer looks for: Compose services, routing tests, load results and a rollback that works.Batch + online, staged release, rollback. Run a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.
Account riskAccount riskThe monitoring system and reviewers that use the model. Given, not built.The monitoring system and reviewers that use the model.

Runs on

04
GrafanaMilestone 04Monitoring and IncidentsMonitor service, data, model and business numbers while labels arrive late, and run an incident drill.Reviewer looks for: docs/monitoring.md, alerts and an incident runbook you have used.Service, data, model and business health. Monitor service, data, model and business numbers while labels arrive late, and run an incident drill.
05
RetrainMilestone 05MLOps CapstoneRelease the platform with triggered retraining, approved promotion in MLflow, the champion live on AWS, service targets and a walkthrough video.Reviewer looks for: The retraining workflow, promotion rules, SLOs and a walkthrough link.Drift-triggered retraining, registry promotion, Terraform, SLOs. Release the platform with triggered retraining, approved promotion in MLflow, the champion live on AWS, service targets and a walkthrough video.
Hover a part to see what you build. Numbers are the milestones; dashed tiles are the data you start with and the people who use the result. Scroll sideways to see the whole system.

What you'll build

Credit risk ML platform

Your Data Science model, run like a production system on Docker Compose: tracked training, CI gates, safe releases, rollback and monitoring while labels arrive late, built locally and then run on AWS. It continues in your Data Science repo, so the model and its production setup live together.

Data

Your Data Science model and the same UCI credit-card data. It is one historical snapshot, so late labels and shifted data are simulated. Say so wherever you report them.

  • Default of Credit Card Clients (UCI, CC BY 4.0)

One GitHub repo for the whole path. You connect it once, and each module adds a verified milestone.

You need: A laptop with 8 GB of RAM, Docker, about 10 GB of free disk, and an AWS account on the Free plan. If AWS will not accept your card, a GitHub-only route gets you through the same checks.

Tap a milestone to see what you’ll build on your laptop.

  1. 1Tracked, Repeatable Training

    Bring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.

    What to show: docker-compose.yml, the training flow, MLflow runs and a data contract.

  2. 2CI/CD for ML

    Add CI tests that block a release when quality, cost or speed gets worse.

    What to show: The CI workflow, regression tests and docs/release_gates.md.

  3. 3Serving and Safe Releases

    Run a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.

    What to show: Compose services, routing tests, load results and a rollback that works.

Tools: Grafana, Retrain.

Data + modelData + modelYour credit-risk data and champion model from Data Science. Given, not built.Your credit-risk data and champion model from Data Science.
01
MLflowMilestone 01Tracked, Repeatable TrainingBring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.Reviewer looks for: docker-compose.yml, the training flow, MLflow runs and a data contract.Tracked, containerised training. Bring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.
02
CI gatesMilestone 02CI/CD for MLAdd CI tests that block a release when quality, cost or speed gets worse.Reviewer looks for: The CI workflow, regression tests and docs/release_gates.md.Code, data and model tests; immutable artifacts. Add CI tests that block a release when quality, cost or speed gets worse.
03
ServingMilestone 03Serving and Safe ReleasesRun a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.Reviewer looks for: Compose services, routing tests, load results and a rollback that works.Batch + online, staged release, rollback. Run a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.
Account riskAccount riskThe monitoring system and reviewers that use the model. Given, not built.The monitoring system and reviewers that use the model.

Runs on

04
GrafanaMilestone 04Monitoring and IncidentsMonitor service, data, model and business numbers while labels arrive late, and run an incident drill.Reviewer looks for: docs/monitoring.md, alerts and an incident runbook you have used.Service, data, model and business health. Monitor service, data, model and business numbers while labels arrive late, and run an incident drill.
05
RetrainMilestone 05MLOps CapstoneRelease the platform with triggered retraining, approved promotion in MLflow, the champion live on AWS, service targets and a walkthrough video.Reviewer looks for: The retraining workflow, promotion rules, SLOs and a walkthrough link.Drift-triggered retraining, registry promotion, Terraform, SLOs. Release the platform with triggered retraining, approved promotion in MLflow, the champion live on AWS, service targets and a walkthrough video.
Hover a part to see what you build. Numbers are the milestones; dashed tiles are the data you start with and the people who use the result. Scroll sideways to see the whole system.
Final demo question
A new model passes its tests, then its speed and risk-flag rate drift before the labels arrive. Show how you spot it, roll back, evaluate later and approve a fix.

Module by module

  1. 1Tracked, Repeatable Training

    Log every training run, chain the steps into a pipeline and package it so it reruns the same anywhere.

    Bring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.

    Tracking runs with MLflow · Training pipelines · Repeatable runs in Docker

    01

    Tracked, Repeatable Training

    Bring in your Data Science model, add serving and rollback to the design doc, track runs in MLflow and rebuild it the same way in Docker.

    24h
  2. 2CI/CD for ML

    Test every change to code, data and model automatically before it can be released.

    Add CI tests that block a release when quality, cost or speed gets worse.

    Automated ML tests · Versioned model builds · Approved releases

    02

    CI/CD for ML

    Add CI tests that block a release when quality, cost or speed gets worse.

    22h
  3. 3Serving and Safe Releases

    Serve predictions in batches or live, send a new model a small share of traffic first, locally and then on AWS, and roll back fast.

    Run a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.

    Batch and live serving · Canary releases · Health checks and rollback

    03

    Serving and Safe Releases

    Run a canary locally with Docker Compose, then for real on AWS Lambda with a weighted alias, and roll back when it fails.

    29h
  4. 4Monitoring and Incidents

    Watch the service, data, model and business numbers, and know who acts and how when something breaks.

    Monitor service, data, model and business numbers while labels arrive late, and run an incident drill.

    What to monitor · Detecting drift · Handling incidents

    04

    Monitoring and Incidents

    Monitor service, data, model and business numbers while labels arrive late, and run an incident drill.

    26h
  5. 5MLOps Capstone

    Ship a platform that retrains your model, promotes it only with approval and meets clear service targets.

    Release the platform with triggered retraining, approved promotion in MLflow, the champion live on AWS, service targets and a walkthrough video.

    Automatic retraining · Approved model promotion · Service targets (SLOs)

    05

    MLOps Capstone

    Release the platform with triggered retraining, approved promotion in MLflow, the champion live on AWS, service targets and a walkthrough video.

    30h

More roadmaps

  • Foundations roadmapPython, SQL, Git and statistics. The base every data role builds on.
  • Data Engineering roadmapBuild one data platform end to end: ingest, transform, schedule, deploy and monitor it.
  • Data Analysis roadmapTurn messy data and vague questions into analysis people trust and act on.
  • Data Science roadmapFrame a problem, build and validate a model, then deploy it and watch it in production.

Turn this map into shipped work.

Finish with Credit risk ML platform on your GitHub.

Start this path