article thumbnail

97 things every data engineer should know

Grouparoo

Tianhui Michael Li The Three Rs of Data Engineering by Tobias Macey Data testing and quality Automate Your Pipeline Tests by Tom White Data Quality for Data Engineers by Katharine Jarmul Data Validation Is More Than Summary Statistics by Emily Riederer The Six Words That Will Destroy Your Career by Bartosz Mikulski Your Data Tests Failed!

article thumbnail

Audit_helper in dbt: Bringing data auditing to a higher level

dbt Developer Hub

However, ensuring that the values in the original table and in the refactored one match used to be a hard task that involved a lot of manual coding and some generalistic tests (such as counting the amount of rows or summing all values in a column).