top of page

The Adoption of dbt: From Silicon Valley to Bill in Ohio

Oct 8, 2024

1 min read

1

32

2

Last week I attended the Data Engineering & Machine Learning Summit. Amidst the technical questions, one comment made me pause.

“I get that dbt is all the buzz in Silicon Valley, but I live in Ohio, and no one is talking about it here.”


It got me thinking: where does dbt sit on the product adoption curve?


ree
© chameleon

Dbt launched in 2016, developed by Fishtown Analytics (now dbt Labs) to make SQL-based data transformations more accessible. By 2022, dbt was already valued as a billion-dollar powerhouse, transforming data stacks with simplicity and efficiency. Databricks' 2023 State of Data & AI report even spotlighted it as the fastest-growing data product with an impressive 206% year-over-year customer increase.


And I was one of them. My team in D.C. adopted dbt in 2022, trading in a tangled mess of custom scripts in our Redshift instance for dbt's cleaner, faster, and more reliable data processing. The result? Our nightly ETL ran in an eighth of the time, and we could cleanly trace data back to its raw source with no headaches.


But then, what about Bill in Ohio?


Perhaps he represents the “early majority” adopters, while the coasts and tech hubs are buzzing in the “early adopter” phase?


I dug into the data.


ree
Google search interest for "dbt data" over the past five years by sub region


Bill was right. Silicon Valley sat at the top, with Austin, Denver, Boston, Seattle, and New York trailing closely behind. And Ohio? A humble 27th of the 50 states in search interest.


This paints an interesting picture of dbt’s adoption curve, suggesting that as it continues to sweep the coasts, it’s only a matter of time before Bill in Ohio—and beyond—joins in the dbt transformation.

Oct 8, 2024

1 min read

1

32

2

Related Posts

Comments (2)

Oleg Sklyarsky
Oleg Sklyarsky
Oct 08, 2024

It’s not surprising that tech hubs tend to be early adopters of tools like dbt. Do you think it’s more due to a lack of awareness for “Bill from Ohio”, or his risk aversion? Some companies might wait for a technology to become more tested and widely adopted before committing to changing their tech stack. How likely do you think it is for a better and cheaper competitor to challenge dbt and similar tools? I don’t use it, and my company still has Redshift for our SQL database.

Like
Kristin Keohan
Kristin Keohan
Admin
Oct 09, 2024
Replying to

100%. This is an n=1, so there could be multiple variables at play re: risk aversion etc. Despite the lack of power in the sample, I find that these types of questions can lead to interesting insights to answer as a data analyst and recommending the "so what." The so what for Bill is that he will have to take the role of evangelizer within his space. In this way, he can provide value beyond the day-to-day and establish himself as a thought leader, perhaps even test out the tool to verify its value.


As someone who has been through this dbt transition, it's not so much the risk in moving tech stacks--we saw the value immediately. In fact, there was more risk in staying with our outdated custom script. The cost was in the time required to make the transition given that we were still expected to keep all of the companies' data and product analytics functions up and running. We timed it for a lull within our business to capitalize on the time. Lots of preplanning required for the leap! I'm sure there will be other competitors that will break into the space, but the fact that dbt is already integrating with other tech stacks means its ahead of the game and will be a big contender.

Edited
Like
Asset 7 (4).png
bottom of page