Build
A medallion pipeline, deployed by a bundle
Goal. Ingest a public dataset into bronze, clean it into silver, aggregate it into gold, and deploy the whole thing from a bundle.
What to do
- Pick a public dataset with a date column and about a million rows.
- Write the three layers as a declarative pipeline, with an expectation on every silver table.
- Put the pipeline and its job in a bundle with a dev and a test target.
- Deploy both targets from a CI pipeline on every merge. Nobody deploys from a laptop.
What good looks like. A new commit reaches test on its own, a failed expectation stops the run, and you can explain every table in one sentence.