Setup Airbyte, BigQuery, dbt, Metabase, and everything else you need to run a Modern Data Stack using Terraform.

What is a Modern Data Stack

A Modern Data Stack (MDS) is a stack of technologies that makes a modern data warehouse perform 10–10000x better than a legacy data warehouse. Ultimately, an MDS saves time, money, and effort. …

The tale of a Data Analyst who evolves into an Analytics Engineer and resources so you can use to be like her.

Analytics Engineer is a new position coined (and made possible) by dbt. If a Data Engineer (DE) marries a Data Analyst (DA) and they have a baby girl, that baby girl will be an Analytics Engineer (AE). Well, it does not work that way, but you get the point.

Learn how to modify the dbt code used by Airbyte to partition and cluster BigQuery tables.

Originally published here.

As your business grows, the size of your BigQuery tables will inevitably grow as well. Scanning entire tables to answer business questions will become slower and more expensive as a result. Fortunately, modern data warehouses provide options to limit how much data each query scans.

In this…

Some basic concepts and project structure to help you get started with a dbt project.

For analysts not from a technical background, working with dbt can be intimidating at first. Writing codes to configure everything takes some time to get used to, especially if you are used to setting everything up using a UI.

If you consider dbt for your team or just started with…

A Guide to staying focus in today’s distracted world—a review of Deep Work by Cal Newport.

We are living in a connected world, where the pace of innovation is astonishing. Never before do we have access to so much information and can easily connect to others within seconds. The fourth…

What to know in terms of security when setting up a data environment in BigQuery.

We have all seen and heard about data breaches and the damages, both in terms of financial and reputation, that they can inflict. As we rely more and more on our data to make better decisions, data is becoming a critical asset for any organization. …

Video games don’t deserve the bad raps they often get. Here are the ones that shaped me (literally and figuratively).

The first video game ever created was all the way back in 1958. Since then, the global gaming market has grown tremendously and is worth USD 173.70 …

How to (and not to) deploy dbt to production.

With the rise of the Modern Data Stack, more and more people use dbt as the main tool for data transformations, aka data modeling. The folks at Fishtown create an amazing dbt Cloud offering that suits the needs of data teams, large and small. …

My review of the book “How to take smart notes” by Sönke Ahrens and my journey towards building a Personal Knowledge Management system.

I am a bookworm, and over the years, I have read and logged nearly 200 books. However, I must admit that for many of the books I…

My 8 tips for people started using VSCode for the first time or switching from another IDE.

Getting your way around an IDE is a vital part, whether you are an engineer or an analyst. Watching a senior developer jumping around in Vim or VSCode can be intimidating for people with less familiarity. However, I assure you that there is no magic here. …

Tuan Nguyen

CTO & Board member @Joon Solutions. Check out my website https://tuanchris.com

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store