Skip to main content

Data Build Tool is a tool for managing and transforming your data, creating scheduled jobs, and enabling an Analytic Engineer to have a working process similar to a software engineer. Last but not least, you can easily create and manage models, define dependencies between them, and deploy your models to your data warehouse.

In this tutorial, we’ll show you how to connect to your data warehouse, create a deployment and a development environment, and create dbt models using the dbt Cloud.

Create your dbt account

To start with dbt Cloud you need to create an account. You can sign up for a free trial here. Once you’ve signed up, you’ll be taken to your dashboard.

Create a New Project

To create a new dbt Cloud project, click on the “Create Project” button in the top right corner of the dashboard. Give your project a name and select the data warehouse you’ll be using. For this article, we will configure the Snowflake data warehouse connection. To connect to our Snowflake data warehouse we need to provide our Snowflake account (you can find it in the URL link), the role that holds the privileges to make any transformation in the data, the database name for the raw data, and the virtual warehouse.

Set up the environments

Generally, there are two main environments; Development and Deployment (Production).

All the transformations we do on the raw data will be held in the Development environment. Also, dbt will automatically create a new schema in this database that will allow the deployment of our models. Below, you can see the settings for the credentials that dbt requires to connect with Snowflake and run our newly created project.

It is important to note that we provide two different database names. In the above example, we use the DEVELOPMENT and RAW_DATA databases. For the Account settings and the project settings, we need the database that our raw data are stored. For the development credentials, we need the database that we have created in Snowflake, which is empty, and is where the newly created schema with new models will be stored.

Conclusion

In this tutorial, we discussed how to set up a new dbt Cloud project and connect it to your data warehouse using the dbt Cloud IDE. We’ve also shown you how to create a new model, write SQL code and run your model. With these tools, you’ll be well on your way to managing your data transformation process with dbt and dbt Cloud.

Don’t forget to check out the rest of our Blogs! If you have a question we most probably have the answer!

Auteur

  • Dimitris Lampriadis

    Dimitris holds a Master's degree as an Urban Technologist - Geospatial Data Analyst from MaCT/UPC in Barcelona. There he discovered a passion for geospatial data analysis and Urban Analytics, but most importantly how data-driven strategies are crucial for making efficient decisions, and how to translate raw data into handy and easy-to-read insights. With his sights set on becoming an Analytics Engineer, Dimitris sought out a company that would help him grow his skills and knowledge. That's when he found Nimbus Intelligence. Nimbus provided the necessary space to combine his existing knowledge and skills, with a suite of powerful tools, like; Snowflake, Tableau, Alteryx, and dbt. He's also managed to develop valuable business skills that enable him to solve complex problems and deliver tangible results. He enjoys giving answers to modern business problems and aims to bring knowledge, to every team he is part of, that binds his understanding of spatial relationships and Analytics Engineering. He is always looking for ways to share his expertise and collaborate with others.

Dimitris Lampriadis

Dimitris holds a Master's degree as an Urban Technologist - Geospatial Data Analyst from MaCT/UPC in Barcelona. There he discovered a passion for geospatial data analysis and Urban Analytics, but most importantly how data-driven strategies are crucial for making efficient decisions, and how to translate raw data into handy and easy-to-read insights. With his sights set on becoming an Analytics Engineer, Dimitris sought out a company that would help him grow his skills and knowledge. That's when he found Nimbus Intelligence. Nimbus provided the necessary space to combine his existing knowledge and skills, with a suite of powerful tools, like; Snowflake, Tableau, Alteryx, and dbt. He's also managed to develop valuable business skills that enable him to solve complex problems and deliver tangible results. He enjoys giving answers to modern business problems and aims to bring knowledge, to every team he is part of, that binds his understanding of spatial relationships and Analytics Engineering. He is always looking for ways to share his expertise and collaborate with others.