article thumbnail

Data News — Week 23.42

Christophe Blefari

Rise of the data generalist: smaller teams, bigger impact — You don't need to convince me. Data contracts and schema enforcement with dbt — It comes with dbt Mesh and gives a lot of new metadata over your models to bring more software engineering practices to dbt development. As an echo of last bullet point.

article thumbnail

Data Architect: Role Description, Skills, Certifications and When to Hire

AltexSoft

This specialist supervises data engineers’ work and thus, must be closely familiar with a wide range of data-related technologies like SQL/NoSQL databases, ETL/ELT tools, and so on. This means a data architect should have a good grasp on the data lifecycle management (DLM) and understand the way metadata is used during each step of DLM.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

15+ Must Have Data Engineer Skills in 2023

Knowledge Hut

NoSQL If you think that Hadoop doesn't matter as you have moved to the cloud, you must think again. Data Mining Tools Metadata adds business context to your data and helps transform it into understandable knowledge. Generalist These data engineers are generally employed by small businesses and enterprises.

article thumbnail

97 things every data engineer should know

Grouparoo

This provided a nice overview of the breadth of topics that are relevant to data engineering including data warehouses/lakes, pipelines, metadata, security, compliance, quality, and working with other teams. For example, grouping the ones about metadata, discoverability, and column naming might have made a lot of sense.