r/DataBuildTool • • Sep 29 '26

Show and tell We built a free, open-source desktop app for dbt Core, with SQL, notebooks, dashboards, DuckLake/Iceberg and AI agents in one place

21 Upvotes

One dbt project. Too many tools. So we built one app for all of it šŸ‘‡

Rosetta DBT Studio is a free, open-source desktop studio for dbt Coreā„¢: connections, modeling, runs, SQL, dashboards, data lakes and AI agents in one place.

⭐ If you like it, star us on GitHub. It really helps an open-source project grow:

https://github.com/rosettadb/dbt-studio

#dbt #DuckDB #DuckLake #ApacheIceberg #Iceberg #DataEngineering #AnalyticsEngineering #OpenSource


r/DataBuildTool • • Apr 09 '26

Show and tell I built an open source tool to replace standard dbt docs

20 Upvotes

Hey Everyone, at my last role we had dbt Cloud, but still hosted our dbt docs generated from dbt docs generate on an internal web page for the rest of the business to use.

I always felt that there had to be something better that wasn't a 5-6 figure contract data catalog for this.

So, I built Docglow: a better dbt docs serve for teams running dbt Core. It's an open-source replacement for the default dbt docs process. It generates a modern, interactive documentation site from your existing dbt artifacts.

Live demo: https://demo.docglow.com
Install: pip install docglow
Repo: https://github.com/docglow/docglow

Some of the included features:

  • Interactive lineage explorer (drag, filter, zoom)

  • Column-level lineage tracing via sqlglot.

    • Click through to upstream/downstream dependencies & view column lineage right in the model page.

  • Full-text search across models, sources, and columns

  • Single-file mode for sharing via email/Slack

  • Organize models into staging/transform/mart layers with visual indicators

  • AI chat for asking questions about your project (BYOK — bring your own API key)

  • MCP server for integrating with Claude, Cursor, etc.

It should work with any dbt Core project. Just Point it at your target/ directory and go.

Looking for early feedback, especially from teams with 200+ models. What's missing? What would you like to see next? Let me know!


r/DataBuildTool • • Mar 24 '26

Show and tell I built a free VS Code extension for animated column-level lineage in dbt projects

17 Upvotes

I got frustrated that dbt's built-in docs only show model-level lineage, you can see thatĀ dim_artistsĀ depends onĀ stg_artists, but not which specific columns flow where or how they're transformed.

So I builtĀ dbt Flow Lineage,Ā a VS Code extension that shows column-level lineage with animated data flow.

What it does:

  • Click any column → traces its full upstream/downstream path across models

  • Color-coded edges: passthrough (blue), rename (green), transform (yellow), aggregate (purple)

  • Animated particles flowing along edges

  • Right-click a .sql file → see only that model's lineage

  • Filter by upstream or downstream

  • Drag nodes to rearrange, export as PNG

What you need:

  • Columns defined inĀ schema.yml

  • RunĀ dbt compile

  • That's it. SELECT *, CTEs, Jinja all work.

What it doesn't need:

  • No dbt Cloud

  • No paid tier

  • No separate server

  • No API key

Works on VS Code, Cursor, Windsurf.

Install: Search "dbt Flow Lineage" in VS Code Extensions tab

GitHub (open source, MIT):Ā https://github.com/tripleaceme/dbt-flow-lineage

Screenshots in the repo. Would love feedback, especially on what transformations aren't being detected correctly.


r/DataBuildTool • • Oct 16 '26

Show and tell 5 short dbt Power User demos: profiling, column lineage, docs and tests, CTE debugging, macro hover

16 Upvotes

Hey all, disclosure first: I work at Altimate, which builds dbt Power User. We recorded one short video per workflow, 4 to 8 minutes each.

  1. Profile Query: review a model's SQL for bugs and cost in one click. https://youtu.be/uMptd4t_mGI

  2. Column-level lineage, with AI chat about the model. https://youtu.be/A-z_R0QJig0

  3. Docs, data tests and unit tests in one editor. https://youtu.be/NrEYqEUcpHY

  4. Explain, optimize and profile each CTE from inside the model. https://youtu.be/MDN2PSgVAmA

  5. Hover over a ref() or macro to see what it does. https://youtu.be/kbRZ-hrENyc

Which of these would you like us to go deeper on?


r/DataBuildTool • • Aug 25 '26

Show and tell Your dbt Incremental Model Is Probably Not Incremental Enough

Thumbnail
medium.com
16 Upvotes

A deep dive into why dbt incremental models can still end up scanning huge amounts of data, especially on Snowflake. Cover micro-partition pruning, MERGE costs, late-arriving data, watermarks and backfills.


r/DataBuildTool • • Aug 01 '25

Show and tell I created my own study guide for the Analytics Engineer certification with practical steps and comprehensive documentation/blog posts to review

16 Upvotes

Hi everyone! I'd like to share a link to the study guide I created for the Analytics Engineer certification: https://andrealeonel.substack.com/p/study-for-the-dbt-analytics-engineering

I've been preparing for this exam for a few weeks but had been finding it really hard to structure my study routine and to practice on a dummy project. So, I thoroughly researched what other people who passed the exam did and came up with this study guide.

It includes documentation/blog posts to review, my study notes (as I go through the topics) and practical steps to apply to a dummy project (with a link for datasets you can work with).

It's a work in progress and I'll be tweaking it as I go, but I hope it helps fellow analysts looking to get this certification. Study notes are added weekly and I'll also write posts updating on my progress, struggles, etc. Hope it's motivating too as it can be quite tricky studying on your own!


r/DataBuildTool • • Feb 05 '26

Show and tell dbt-ui — a modern web-based user interface for dbt-core projects

Thumbnail
github.com
15 Upvotes

Hi guys,

dbt-ui is a modern web-based user interface for dbt-core projects. I was building it to use in my own projects. Recently, I open sourced its code and would like to share it with the community as somebody else might benefit from using it

Happy to answer any questions


r/DataBuildTool • • Aug 21 '25

dbt news and updates Vent alert! DBT are playing dirty.

15 Upvotes

I noticed a bunch of deprecations added recently, e.g. new params argument, disallowing use of itertools, etc. This looks to me like forcing users to change their code so that when time comes to migrate to Fusion, they can happily announce:" look, no code changes, it just works!"

And the way it is introduced is also harsh: you want to introduce the new style arguments gradually? No can do! if you set the flag to ignore the deprecation, you can't use the new style args.

And on top of that they make us pay for the cloud version, even though we're their beta testers like everyone else.


r/DataBuildTool • • May 27 '25

dbt news and updates This sub just hit 1000 members. Thanks all

15 Upvotes

r/DataBuildTool • • Jan 30 '25

We’re at 750 members

14 Upvotes

Thank you all for your questions and expert advice in the dbt sub!


r/DataBuildTool • • Jan 14 '25

dbt news and updates dbt Labs acquires SDF Labs

Thumbnail
getdbt.com
14 Upvotes

r/DataBuildTool • • Oct 25 '25

Question How to get better with dbt

12 Upvotes

Hi I just have start learning dbt currently using dbt core I would like to know what resource are you guys using to get better in this tool,I am a data analyst with strong sql skills and planning to switch to data engineering I have learned spark and currently studying databricks fundamentals like delta tables any guidance will be very helpfull


r/DataBuildTool • • Apr 19 '25

Show and tell Spotted in the wild at the Tableau Conference (and yes, I snagged a dbt hat)

Post image
12 Upvotes

r/DataBuildTool • • Oct 20 '24

Show and tell dbt-nvim: dbt plugin for Neovim

12 Upvotes

A Neovim plugin for working with dbt (Data Build Tool) projects.

Features:

  • Run dbt models (dbt run)

  • Test models (dbt test)

  • Compile models (dbt compile)

  • Generate model.yaml for a model usingĀ dbt-codegen

  • List upstream and downstream dependencies with Telescope integration

Any issues or feature-requests - open issue. :-)


r/DataBuildTool • • Sep 05 '24

This sub is now open. Welcome all. Spammers get reported and banned.

12 Upvotes

Let's chat about all things data modeling and dbt!


r/DataBuildTool • • 8d ago

Show and tell MUST WATCH - 45-min dbt Power User walkthrough (Jaffle Shop | Core, Cloud & Fusion)

11 Upvotes

The walkthrough turns VS Code or Cursor into a full dbt IDE. It covers the features data engineers and analysts use every day.

  1. Run a model and see results, compiled SQL and run history in one panel.

  2. Profile Query finds aggregation before a join, SELECT * and hard-coded values. It changes nothing until you approve.

  3. Explain and optimize any model in one click.

  4. Execute a single CTE, or profile every CTE for runtime and row count.

Video: https://youtu.be/1yWejM5YW1o

Disclosure first: I work at Altimate, which builds dbt Power User - AI Agents for data teams.


r/DataBuildTool • • Sep 03 '25

Question Tips for talking about DBT in interviews

11 Upvotes

Hi, I am a relatively new DBT user - I have been taking courses and messing around with some example projects using the tutorial snowflake data because I see it listed in plenty of job listings. At this point I'm confident I can use it, at least the basics - but what are some common issues or workarounds that you've experienced that would require some working knowledge to know about? What's a scenario that comes up often that I wouldn't learn in a planned course? Appreciate any tips!


r/DataBuildTool • • Sep 03 '25

Question How do you showcase your dbt portfolio?

11 Upvotes

Do you put it in GitHub? Do you use real models you have deployed from the company you have been working at?


r/DataBuildTool • • Apr 12 '26

Question How do you structure your analytics dbt project around dimensional modeling — and where do dimensional models actually live?

10 Upvotes

Curious how people handle this in practice, because I’ve seen it done a few different ways and I don’t think there’s a clear consensus.

The staging layer seems pretty universal — 1:1 with raw source tables, light cleaning, renaming, casting. Optional intermediate layer for reusable business logic before you get to the ā€œrealā€ models. That part feels settled.

Where it diverges is where dimensional models (dims and facts) actually sit in the project structure:

  1. Their own layer — e.g. a warehouse/ or dimensional/ folder, separate from marts. I’ve seen this from Kahan Data Solutions and a few others. The idea being dims/facts are a distinct architectural layer.

  2. Inside marts — dims and facts live in marts/, and marts are your dimensional models. The mart is the end product.

  3. Inside intermediate or marts, with OBTs on top — dims and facts are treated as building blocks, and the actual end-user-facing layer is wide OBTs (one big tables) built off them. Marts become the denormalized read layer, not the dimensional layer.

Which brings me to what I think is the real underlying question: how do you think about dimensional models conceptually?

• Are they the end product — what you expose to BI tools and end users directly?

• Or are they building blocks — an intermediate step toward marts that are OBTs or other denormalized structures?

When you answer, would love if you also share your folder/naming conventions alongside your philosophy on this. I suspect the structure people choose is a direct consequence of how they answer that second question.


r/DataBuildTool • • Mar 25 '26

Show and tell Auto-generate a coding agent skill from your dbt project

Thumbnail
github.com
10 Upvotes

I've been increasingly using coding agents to work with my dbt project. I got frustrated with the agent frequently behaving like a bull in a china shop.

Coding agents don't know:

  • What tables exist and what they contain

  • What each column means

  • How tables relate to each other

  • Which grain to use for aggregation

  • What business logic is embedded in transformations ...

So I made + open sourced dbt-skillz. It distills this information into a compact skill with multiple sub-skills.

It's useful across four use cases:

  1. help "data consumers" get more reliable answers when querying data via an agent

  2. help "data producers" keep the agent on track while developing a dbt project.

  3. run automatically on PRs and merged in CI/CD to keep the skill fresh

  4. in review agents to more accurately review downstream dashboards, PRs, and other dbt-related code.


r/DataBuildTool • • Mar 12 '26

Show and tell How I set up Claude Code with dbt Agent Skills and the dbt MCP Server so it works really well with my dbt projects

Thumbnail
youtube.com
10 Upvotes

I've been using AI coding tools with dbt and I've had the best results after setting up Claude Code with the dbt Agent Skills and dbt MCP Server, so I wanted to share what I did here. In the video, I set up a demo project with DuckDB from scratch to try these two tools from dbt Labs together.

The dbt Agent Skills loads your dbt conventions into the AI's context, ref/source usage, test strategies, model organization. Works with Claude Code, Cursor, Windsurf, Codex, and any other coding agent.

The dbt MCP Server gives the AI live access to your project's DAG lineage, column schemas, and existing test coverage at runtime, so it has access to all the data it needs to be successful.

What I've found most useful is asking Claude Code to audit and enhance my pipelines with both tools set up. In the video, I asked it to review test coverage but skip columns already tested upstream. It pulled the lineage from the MCP Server, checked what was covered at each node, and made genuine enhancements to the models using dbt best practices.

Has anyone else tried the Agent Skills or MCP Server on their dbt project? Curious how it works on larger repos with more complex lineage.It's pretty quick to set up if you follow along with the video, and the demo repo is open so anyone can try it locally:

https://github.com/kyle-chalmers/dbt-agentic-development

Has anyone else tried the Agent Skills or MCP Server on their dbt project? Curious if it has worked as well for others as it has for me


r/DataBuildTool • • Feb 20 '26

Show and tell Testing dbt logic without running the warehouse

10 Upvotes

dbt tests used to just validate data after execution.

Unit tests let you mock inputs and verify SQL logic directly.

Feels much closer to real dev workflows.

https://medium.com/@sendoamoronta/dbt-unit-tests-deep-dive-testing-sql-logic-without-data-or-warehouse-dependencies-e327ae1d5b03


r/DataBuildTool • • Feb 10 '26

Show and tell dbtective: Rust-based dbt metadata 'detective' and linter

10 Upvotes

Hi

I just released dbtective v0.2.0!šŸ•µļø

dbtective is a Rust-powered 'detective' for dbt metadata best practices in your project, CI pipeline & pre-commit. The idea is to have best practices out of the box, with the flexibility to customize to your team's specific needs. Let me know if you have any questions!

Check out a demo here:
- GitHub: https://github.com/feliblo/dbtective
- Docs: https://feliblo.github.io/dbtective/

Or try it out now:
pip install dbtective
dbtective init
dbtective run


r/DataBuildTool • • Nov 29 '25

Question I’m new to dbt — what is the best way to start learning in 2025?

10 Upvotes

Hi everyone,

I’m completely new to dbt and want to learn it properly for data engineering / analytics work.
I already know SQL and I’m learning Snowflake right now.

I’m a bit confused about:

  • Where should a complete beginner start?

  • dbt Core vs dbt Cloud — which is better for learning?

  • What’s the recommended folder/project structure for beginners?

  • Any must-learn concepts before starting (Jinja, Git, Warehouse basics)?

  • What first project should I build to actually understand dbt?

If you have any tutorials, YouTube channels, docs, or example projects you recommend, please share!