Christophe Blefari

MARCH 1, 2023

Jinja templating — Jinja is a templating engine that seems to exist forever in Python. By default you can recognise a Jinja syntax with the double curly brackets—e.g. {{ something }}. a macro — a macro is a Jinja function that either do something or return SQL or partial SQL code.

Data Warehouse 278

Data Warehouse SQL Metadata Raw Data 278

Towards Data Science

DECEMBER 1, 2023

dbt (data build tool) facilitates modularization of SQL queries, enabling the reuse and version control of SQL workflows, just like software code is typically managed. The important features of dbt are Jinja and macros that you can weave into SQL, enhancing its impact and reusability. You need to create a workflow .yml

Data Engineering 72

Data Engineering Data Engineer Project Engineering 72

dbt Developer Hub

JULY 2, 2023

You can think of these Raw Vault components as LEGO bricks: they are modular and you can combine them in many different ways to build a wide variety of different, cohesive structures. dbt's macros feature is a lifesaver in terms of templating your code. Data Vault follows the insert-only principle with incremental loading strategy.

Cloud 52

Cloud Data Warehouse Data BI 52

dbt Developer Hub

NOVEMBER 28, 2021

They’re easy to install, accessible and at the end of the day, it’s just SQL (with sprinklings of git and jinja). So I challenge you after reading this article to test out your skillsets, think about the code that you find yourself reusing again and again, and build a package. So let’s get started on your journey.

Building 52

Building SQL Coding Datasets 52

dbt Developer Hub

JANUARY 23, 2023

Aggregating test failure results using Jinja macros and pre-configured metadata to pull together high level summary tables. Building views on top of the base table to split tests by owner or severity, and creating visualizations using our tool of choice. It should be noted that this framework is for dbt v1.0+ on BigQuery.

Metadata 52

Metadata High Quality Data SQL Data Integration 52

Grouparoo

DECEMBER 13, 2021

Tracking dbt run metadata If you aren’t currently keeping track of metadata from your dbt runs, you can use a macro along with an on-run-end hook to generate one automatically. In this file, we used Jinja and SQL to build out a dbt_meta table. status ~ " node: " ~ res. unique_id ~ " message: " ~ res. error = ns.

Metadata 52

Metadata Data Warehouse SQL Utilities 52

dbt Developer Hub

NOVEMBER 28, 2021

We build a product based on the standards, conventions, and capabilities that are created there, and at least 70% of our engineering time is spent in contribution. For more information about defining sources, take a look at the Sources page in the dbt docs. Once I build that, I'm likely to change this model into a table.

Raw Data 52

Raw Data Metadata Datasets Database 52