Data Engineering Podcast

JUNE 5, 2022

Summary The best way to make sure that you don’t leak sensitive data is to never have it in the first place. The team at Skyflow decided that the second best way is to build a storage system dedicated to securely managing your sensitive information and making it easy to integrate with your applications and data systems.

Data Security 100

Data Security Metadata MongoDB Scala 100

AltexSoft

MARCH 2, 2023

As the amount of enterprise data continues to surge, businesses are increasingly recognizing the importance of data governance — the framework for managing an organization’s data assets for accuracy, consistency, security, and effective use. What is data governance? billion in 2020 to $5.28

Data Governance 52

Data Governance Government Healthcare Programming 52

Monte Carlo

MAY 31, 2023

Here are some of the requirements you’ll need to define at the outset of developing your data integrity framework: Regulatory requirements According to Compliance Online , regulatory requirements for data integrity include: Frequent, comprehensive data back-ups Physical data security (i.e.,

Building 52

Building Data Validation Healthcare Data Integration 52

Christophe Blefari

JUNE 16, 2023

The power of pre-commit and SQLFluff —SQL is a query programming language used to retrieve information from data storages, and like any other programming language, you need to enforce checks at all times. Malloy's Near Term Roadmap — I've shared recently Malloy demo , which was awesome. but I missed it).

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Snowflake

MARCH 5, 2024

While every organization should keep both options on the table, to quickly deliver value, the key is to identify and deploy use cases that can deliver value using prompt engineering and retrieval augmented generation (RAG), as these can be fast and cost-effective approaches to get value from enterprise data with LLMs.

Government 95

Government AWS Data Preparation Data Governance 95

Snowflake

AUGUST 21, 2023

With demonstrable success across a range of industries, organizations are increasingly pursuing cutting-edge data mesh architectures to enhance self-service data use. Federated computational governance: Whether manual or automated, global data governance and security measures ensure protection and compliance throughout domains.

Pipeline-centric 52

Pipeline-centric Architecture Government Data Architect 52

Monte Carlo

APRIL 24, 2023

One weakness of the data lake architecture was the need to “bolt on” a data store such as Hive or Glue. This was largely overcome when Databricks announced their Unity Catalog feature which fully integrates those metastores along with other partnering data catalog and data security technologies.

Data Lake 52

Data Lake Google Cloud Data Warehouse AWS 52