Engineers / Intermediate

Databricks data engineering

From the platform basics to pipelines you deploy as code: medallion layers, bundles, CI/CD and Terraform, finished with the Data Engineer exams.

Who it is for

Data engineers who can write SQL and Python and want to build production pipelines on Databricks.

Steps
9
Level
Intermediate

What you can do afterwards

  • Build a bronze, silver and gold pipeline with Lakeflow Spark Declarative Pipelines
  • Deploy it to dev and test through a bundle and a pipeline, never by hand
  • Describe the surrounding infrastructure in Terraform
  • Sit the Data Engineer Associate and Professional exams

The path, step by step

  1. Course

  2. Course

  3. Read

  4. Build

    A medallion pipeline, deployed by a bundle

    Goal. Ingest a public dataset into bronze, clean it into silver, aggregate it into gold, and deploy the whole thing from a bundle.

    What to do

    1. Pick a public dataset with a date column and about a million rows.
    2. Write the three layers as a declarative pipeline, with an expectation on every silver table.
    3. Put the pipeline and its job in a bundle with a dev and a test target.
    4. Deploy both targets from a CI pipeline on every merge. Nobody deploys from a laptop.

    What good looks like. A new commit reaches test on its own, a failed expectation stops the run, and you can explain every table in one sentence.

  5. Course

  6. Read

  7. Check

  8. Certify

  9. Certify

Course details come from each provider. Check the provider page for the latest.

Next step

Want your team to learn this together?

We give workshops to company teams and students, on-site or online. Tell us who the participants are and what they should be able to do afterwards.

Accepting projects for Q4 2026