r/DataBuildTool • u/Wide_Importance_8559 • 18h ago
Show and tell dbt + DuckDB beginner project (one commit per lesson): from raw Parquet to sources, models, Jinja, docs, tests, CI with GitHub Actions and a public warehouse, built on a year of NYC taxi data
I made a beginner dbt + DuckDB project, recorded step by step on video, and wanted to share it here. Disclosure: I work on Rosetta DBT Studio, the app I use in the videos.
Everything in it is open source and free: DuckDB, dbt Core, dbt-duckdb, Rosetta DBT Studio, and the course code itself. The data is public too. No cloud account, no warehouse bill, no paid tier needed. Everything also works with plain dbt from the command line if you prefer your own editor.
Video : https://youtu.be/6nt5JRKIS0A
Code (one commit per lesson): https://github.com/Nuri1977/nyc-taxi-dbt
The data is the NYC TLC green taxi trips for 2025: 12 monthly Parquet files (~14 MB, 591,375 trips) plus the 265-row taxi zone lookup as a seed. It runs on a laptop in seconds.
What the course covers:
- Creating a dbt project on DuckDB and loading the raw Parquet with read_parquet(union_by_name)
- Sources and seeds
- First models, then linking them with ref() and Jinja
- Properties: describing models and columns in YAML
- Docs and the DAG (lineage graph)
- Materializations: keeping a thin view and making the marts tables, with a project default plus a per-model config override
- Data tests: unique, not_null, accepted_values, relationships, and dbt build running everything in DAG order
- CI with GitHub Actions: a fresh build on every push, with the prod DuckDB file published as a GitHub release
- Docs on GitHub Pages, a README with a build badge, and a warehouse anyone can query by attaching the .duckdb file straight from the release URL
Feedback welcome, especially on anything that could be done more idiomatically in dbt.


