r/DataBuildTool • • Mar 18 '26

Question Can Claude Code (easily) write DBT code? Yes or no.

0 Upvotes

Here's the crux:

- DBT Cloud pushes developers to work inside its proprietary, browser-based ide. Claude Code is a command line tool that edits local files on a developer's machine.

- DBT Cloud also pushes developers to use its rigid "on rails" git workflow.

These are both obvious barriers to Claude Code's intended workflow - using Claude Code to edit files on your machine, managing version control using generic git.

Can these tools NATUARLLY work together, without forcing the developer to jump through hoops to make it work?

Does anyone have any first-hand experience working with Claude Code/DBT together? How does the experience compare to using Claude Code's "normal" development workflow (editing files on your local machine)?

I've done some googling on the subject, but I can't seem to find a straight answer to what I believe is a straightforward question.

I do see that Claude Code has an DBT MCP. I'm highly skeptical of its efficacy. Wedging an MCP layer between Claude Code and the file it's editing, on the surface, sound like it would drastically reduce Claude Code's capabilities. Is that assumption right?

Any on-topic insight/first-hand experiences would be appreciated.

Edit: I should have clarified - I'm talking about DBT Cloud.


r/DataBuildTool • • Oct 15 '26

Show and tell Optimization in DBT

0 Upvotes

r/DataBuildTool • • May 19 '26

Show and tell Build a Complete Jaffle Shop dbt Project with AI in Minutes

1 Upvotes

Watch the Rosetta DBT Studio AI Agent build the classic Jaffle Shop dbt project from scratch in under two minutes. From importing the repository to generating staging models, mart models, and tests, see how autonomous AI accelerates your data engineering workflow.

🔍 Topics covered in this video:
• One-click import: Cloning the Jaffle Shop repository directly from GitHub
• Connecting to your database (DuckDB, PostgreSQL, Snowflake, and more)
• Prompting the AI Agent to autonomously generate staging and mart models
• Watching the Agent write clean SQL, create YAML configs, and add descriptions/tests
• Real-time validation: The Agent automatically runs dbt compile to ensure your code works
• Exploring the final project structure and ready-to-run DAG

⚙️ Powered by the Vercel AI SDK with support for OpenAI, Anthropic, Gemini, and Ollama (local models).

📥 Download Rosetta DBT Studio (macOS, Windows, Linux):
https://rosettadb.io/download-dbtstudio
⭐ Star us on GitHub:
https://github.com/rosettadb/dbt-studio

📺 More tutorials and walkthroughs:
u/rosettadb
---
#AIAgent #dbt #DataEngineering #AnalyticsEngineering #JaffleShop #OpenSource #RosettaDBT #LLM #DuckDB #DataPlatform #DataStack #Ollama #Anthropic #OpenAI


r/DataBuildTool • • Jun 11 '26

Show and tell Built a tool that audits any dbt repo instantly and wanted to share it here

3 Upvotes

Hey, I'm an analytics engineer and built this as a side project in my own time.

The problem I kept hitting: jumping into an unfamiliar dbt project and spending hours just getting oriented. And when a number was wrong, debugging it manually was slow.

So I built dbt Context. Paste any public or private GitHub repo and it parses your manifest, SQL, YAML, tests and lineage to give you an immediate audit of the project. It finds risky incremental models, orphaned staging models, missing tests and undocumented marts, with file-level evidence and suggested next steps for each finding.

You can also describe a specific problem in the optional box like "revenue doesn't match NetSuite" and it switches into investigation mode, traces the relevant models through the project, and generates warehouse-specific SQL checks to run.

Works with public and private repos. Private repos need a GitHub PAT with repo scope.

dbt-context.com

Happy to answer any questions about how it works.


r/DataBuildTool • • Sep 20 '25

Question One Ppt slide to describe dbt

0 Upvotes

Where can I grab a simple PPT to explain DBT to my boss?


r/DataBuildTool • • 20d ago

Show and tell Medallion Layer Enforcement

Thumbnail
gallery
1 Upvotes

As dbt projects grow and more people contribute, keeping standards consistent gets harder. Someone could make a silver model (cleansed data) read from another silver model. Someone could make a gold model (business-ready data) read straight from bronze (raw data).

 

That’s why I think enforcing medallion layer dependencies matters: silver should read from bronze, and gold should read from silver.

 

This isn’t just tidiness. If a gold table skips silver and reads raw data directly, a report on billable surgical procedures could be built on data that was never cleaned. Duplicates, bad values and missing fields flow straight into the numbers people make decisions on.

 

There’s an engineering cost too. When models read from each other within a layer, two models can end up depending on each other. dbt can’t build either one due to cycle errors, and fixing it means time lost re-engineering models.

 

dbt checks (new in dbt 2.0) can enforce this. You apply it by writing a SQL query in a checks folder, plus a small YAML file for settings, that looks at every model and what it depends on and returns anything that breaks the rule. Per the dbt docs, checks are enforced “before any warehouse work runs.” If the project violates a rule, the build stops before a single model is compiled or built.

 

I tested it by pointing a gold model straight at a raw table, and a silver model at another silver model. The build failed and showed exactly which connections broke the rule (see the last image).

Rules people must remember get broken. Rules the build enforces don’t.

#dbt #AnalyticsEngineering #DataEngineering


r/DataBuildTool • • Jan 13 '26

Question Real-world Snowflake / dbt production scenarios?

0 Upvotes

Hi all,

I’m preparing for Data Engineer interviews and many questions are around Snowflake + dbt real-world scenarios.

If you’ve worked with these tools, could you share:

  • Common dbt model failures in prod

  • Handling late-arriving data / incremental models

  • Snowflake performance or cost issues

  • Data quality checks that actually matter in prod

High-level explanations are perfect — I’m not looking for sensitive details.


r/DataBuildTool • • Feb 10 '26

Question Html conversion in snowflake/dbt

0 Upvotes

How to change html (text with html tags) into text (remove htmltags) but to keep simple formatting in snowflake/dbt code (dbt runs on snowflake):

New line (br tag)

New lines (p tag)

Bullet plus indents (li tag)


r/DataBuildTool • • Jun 30 '26

Show and tell Thought this may be helpful to some of you…

Post image
2 Upvotes

r/DataBuildTool • • Oct 20 '26

Show and tell DBT OPTIMIZATION

0 Upvotes

r/DataBuildTool • • Jun 14 '26

Question Question ⁉️

2 Upvotes

I'm new to data engineering. I joined my company last year after graduation as a Data Engineer. I had never worked in data engineering before, but the company needed someone who was good at Python and SQL. Since I was strong in both, I became a core member of the team.

The original structure of our pipeline was a Spark-based ETL process, but it was very slow and took hours to complete. We have now moved to a dbt-based ELT pipeline.

We were using provisioned Redshift, which performed well for incremental models. However, we recently shifted to Redshift Serverless. It provides significantly better performance overall compared to provisioned Redshift, but the catch is that incremental models perform worse, while full refreshes and models materialized as tables perform extremely well.

For every incremental model, a full refresh is actually faster. Theoretically, incremental models should be faster, but in practice we're seeing the opposite.

Even with all models materialized as tables, our complete run now takes about 45 minutes, compared to 1 hour 30 minutes on provisioned Redshift. The original Spark-based ETL pipeline took around 6 hours.

I believe incremental models should allow us to achieve even better performance. Can anyone help me understand what might be causing this behavior?


r/DataBuildTool • • Aug 08 '22

Can anyone please let me know if we can get the Udemy courses for free on DBT?

0 Upvotes

r/DataBuildTool • • Feb 21 '26

Show and tell We just released DBT Studio 1.3.1 - Now with DuckLake CRUD Operations & New Cloud Providers!

Thumbnail
youtube.com
0 Upvotes

r/DataBuildTool • • Oct 07 '26

Question How to implement idempotent incremental loads after an initial full snapshot without breaking on full refresh?

0 Upvotes

Hello guys,

I have a question regarding some data I am working with. I have a source system where the initial dataset arrives as a one-time full load, followed by periodic incremental (delta) loads.

I wanted to achieve a design the ingestion/merge strategy so running a full refresh (or reprocessing the initial snapshot) doesn't duplicate records, violate constraints, or break the pipeline.

What is the recommended design pattern and checklist for this scenario in dbt?

Thank you!


r/DataBuildTool • • Aug 01 '26

Question What is the case for adopting dbt as usage of snowflake increases?

Thumbnail reddit.com
0 Upvotes

r/DataBuildTool • • Apr 24 '25

dbt news and updates I’m sure most of you know this, but early bird pricing for Coalesce is $695 through May 25th, then the price goes up to $1,595.

Thumbnail
coalesce.getdbt.com
4 Upvotes

r/DataBuildTool • • Sep 14 '26

Show and tell The dbt CI problem nobody talks about: incremental models

Thumbnail
medium.com
5 Upvotes

CI for dbt often tests a dataset that doesn't really look like production.

How to make CI more production-faithful for incremental models, including the problems with state, historical data and detecting regressions that only appear after multiple runs.


r/DataBuildTool • • 13d ago

Question When an agent writes a dbt model for you, what do you check before it runs?

5 Upvotes

I find the SQL is usually fine, at first glance. But what about the stuff around it, like the grain, backfills, incremental logic, etc.

Curious what other people look at first - or do you just leave it to the agent written tests to decide? 🫣🧐


r/DataBuildTool • • Jan 20 '26

Show and tell Made a dbt package for evaluating LLMs output without leaving your warehouse

5 Upvotes

In our company, we've been building a lot of AI-powered analytics using data warehouse native AI functions. Realized we had no good way to monitor if our LLM outputs were actually any good without sending data to some external eval service.

Looked around for tools but everything wanted us to set up APIs, manage baselines manually, deal with data egress, etc. Just wanted something that worked with what we already had.

So we built this dbt package that does evals in your warehouse:

  • Uses your warehouse's native AI functions

  • Figures out baselines automatically

  • Has monitoring/alerts built in

  • Doesn't need any extra stuff running

Supports Snowflake Cortex, BigQuery Vertex, and Databricks.

Figured we open sourced it and share in case anyone else is dealing with the same problem - https://github.com/paradime-io/dbt-llm-evals


r/DataBuildTool • • May 04 '26

Show and tell dbt as a control plane instead of just transformations?

Thumbnail
medium.com
6 Upvotes

The article argues dbt is effectively a compiler + DAG engine + execution framework, not just SQL modeling.
Focus on custom materializations to control performance and cost.
Curious how far people here push dbt beyond defaults.


r/DataBuildTool • • 21d ago

Show and tell Are you using Claude Code or Codex for data engineering? Would you let it near prod?

6 Upvotes

Quick question for data engineers: are you using Claude Code or Codex in your daily work?

I'm asking because we've been going back and forth on this while building Rosetta AI, the agent inside dbt Studio.

Claude Code and Codex give the agent a real shell and keep it in check with an OS sandbox. It's on by default in Codex and opt-in in Claude Code. For coding, that works really well. The agent can run any CLI, write a quick script, or install whatever it needs.

Data work feels different to me, though. A sandbox knows which files and hosts a command can reach, not what the command actually does. Once your warehouse is reachable, a SELECT and a DROP TABLE look exactly the same to it. And by default, Claude Code's sandbox still lets commands read most of your machine, credential files included, unless you lock it down.

So we went the other way. Rosetta AI has no shell at all. It can run dbt, but only a short list of commands, and only after you click approve. Any SQL that changes data asks first too. Credentials stay in the OS keychain through keytar, so the model only ever sees env_var() references, never the actual passwords.

That has a cost. Every capability has to be built as a tool, so the agent can't improvise the way it can with a shell. We haven't fully settled which trade-off is right.

So I'd love to hear from you. Are you using Claude Code or Codex for data engineering? And would you let it anywhere near a production warehouse?

dbt Studio is open source if you want to look under the hood: github.com/rosettadb/dbt-studio


r/DataBuildTool • • Oct 07 '26

Question Snapshot redesign

1 Upvotes

I’m fairly new to DBT. Please help me and be kind enough to answer my question.

I need to redesign the existing flow, creating a snapshot model(which is not done right).

We have existing flow like this

Raw1–> snapshot1–>dim1–✒️
dim
Raw2–>snapshot2–>dim2-🖊️

From the above flow we are missing direct history tracking and goal is to create common snapshot for final dimension by eliminating dim1 and dim 2

Also, currently airflow run dependency had set like after snapshot dag run completion dim dag will start.

And project folder is as follows
-model
|_dags
|_bronze
|_silver
|_gold
|_consumer
-snapshots

If anybody has any idea about how to proceed in this case please help. TIA


r/DataBuildTool • • Jul 11 '26

Show and tell Useful Medium publication for dbt practitioners

Thumbnail medium.com
1 Upvotes

Sharing this Medium publication for anyone interested in dbt and analytics engineering


r/DataBuildTool • • Jul 01 '26

Show and tell Rosetta DBT Studio v1.5.7: SQL, lineage, AI, and Git in one desktop app

Post image
1 Upvotes

Rosetta DBT Studio is the local-first, open-source desktop workspace for dbt teams - build models, explore SQL, trace lineage, manage Git, preview cloud data, and work with AI agents from one app.

v1.5.7 is all about giving analytics engineers one place to build, understand, and ship dbt work without bouncing between terminals, browsers, and disconnected tools.

AI Agent for dbt - ask the agent to explain models, generate SQL, update YAML, run dbt commands, inspect project context, and help reason through lineage and grain before you make a change.

Project-aware SQL editor - write queries with Monaco autocomplete, schema browsing, saved queries, result previews, and export workflows across DuckDB and supported warehouses.

End-to-end dbt lineage - trace models, sources, and downstream impact so you can understand what a change touches before it reaches production.

SQL Notebooks with AI - work in a cell-based notebook that combines SQL, markdown, results, and AI-assisted iteration in one analysis flow.

Cloud Explorer with DuckDB-powered preview - browse and preview files from S3, Azure Blob, GCS, and compatible object storage without leaving the Studio.

DuckLake and lakehouse tooling - explore schemas, tables, snapshots, and metadata from one workspace, then query them directly in the SQL editor and notebooks.

Built-in Git workflows - review local changes, manage branches, and keep project version control close to the editor instead of split across tools.

Multi-provider AI - use OpenAI, Anthropic, Gemini, Ollama, LM Studio, and OpenAI-compatible providers with project context.

Plus secure credential storage, multi-database connections, Rosetta CLI integration, cloud profile sync, and a full desktop workflow for local dbt development.

100% open source, local-first, and yours.

GitHub - https://github.com/rosettadb/dbt-studio