Courses / Data Engineering

Data Engineering

Learn to design, build and maintain the data pipelines that move and transform data into warehouses and other storage, while keeping data accurate, consistent and reliable.

Advanced Live + self-pacedCertificate of completion

Course outline

SQL & data modeling

Query, join and structure data the right way.

SQL & data modeling: overview Lesson
Relational databases, keys and normalization Lesson
Querying data: SELECT, filtering and sorting Lesson
Joins without surprises Lesson
Aggregations and GROUP BY Lesson
Window functions Lesson
CTEs, readable SQL and query performance Lesson
Modeling data for analytics Lesson
SQL & data modeling: hands-on lab Hands-on lab
Module quiz: SQL & data modeling Quiz

Python for data engineering

Write scripts that clean and process data.

Python for data engineering: overview Lesson
Python essentials for data work Lesson
Files and formats: CSV, JSON and Parquet Lesson
Calling APIs and handling JSON Lesson
DataFrames with pandas and Polars Lesson
Talking to databases from Python Lesson
Production-ready scripts: logging, config, errors and tests Lesson
Git and project structure for data engineers Lesson
Python for data engineering: hands-on lab Hands-on lab
Module quiz: Python for data engineering Quiz

ETL / ELT pipeline design

Extract, transform and load data step by step.

ETL / ELT pipeline design: overview Lesson
ETL vs ELT and the modern data stack Lesson
Ingestion patterns: full, incremental and CDC Lesson
Managed ingestion: Fivetran, Airbyte and dlt Lesson
Pipeline design: idempotency, backfills and late data Lesson
Transforming with dbt: models, sources and refs Lesson
dbt in practice: materializations, tests and docs Lesson
ETL / ELT pipeline design: hands-on lab Hands-on lab
Module quiz: ETL / ELT pipeline design Quiz

Data warehousing

Dimensional modeling and warehouse best practices.

Data warehousing: overview Lesson
Cloud data platforms: Snowflake, BigQuery, Databricks and Redshift Lesson
Dimensional modeling: facts, dimensions and grain Lesson
Slowly changing dimensions and snapshots Lesson
Snowflake essentials: warehouses, loading and time travel Lesson
Layered architecture: staging, intermediate and marts Lesson
Performance and cost control Lesson
Serving data: BI tools and semantic layers Lesson
Data warehousing: hands-on lab Hands-on lab
Module quiz: Data warehousing Quiz

Big data, NoSQL & streaming

Spark, lakehouse tables, NoSQL stores and Kafka streaming.

Big data, NoSQL & streaming: overview Lesson
NoSQL databases: document, key-value, wide-column and graph Lesson
Data lakes and cloud object storage Lesson
Apache Spark and PySpark fundamentals Lesson
Lakehouse table formats: Delta Lake and Apache Iceberg Lesson
Databricks in practice Lesson
Event streaming with Apache Kafka Lesson
Stream processing basics Lesson
Big data, NoSQL & streaming: hands-on lab Hands-on lab
Module quiz: Big data, NoSQL & streaming Quiz

Data quality & orchestration

Schedule pipelines and keep data reliable.

Data quality & orchestration: overview Lesson
Orchestration concepts: DAGs, schedules and retries Lesson
Apache Airflow: DAGs, tasks and the TaskFlow API Lesson
Running dbt and pipelines with Airflow, Dagster or Prefect Lesson
Data quality: dimensions and tests Lesson
Data observability, lineage and data contracts Lesson
DataOps: Git, CI/CD and Docker for data Lesson
Governance and security basics Lesson
Data quality & orchestration: hands-on lab Hands-on lab
Module quiz: Data quality & orchestration Quiz

Capstone pipeline project

Build an end-to-end data pipeline for your portfolio.

Capstone pipeline project: overview Lesson
Capstone pipeline project: hands-on lab Hands-on lab

Career & interview prep

Resume, mock interviews and job-search strategy.

Career & interview prep: overview Lesson
Career & interview prep: hands-on lab Hands-on lab