Data Engineering Weekly

APRIL 14, 2024

Meta: OpenEQA - From word models to world models Will AI agents soon become a common fixture in our homes and an integral part of our daily lives? The highlight of the design is the unique blending of batch and real-time events with the common feature definition. It's a good read that familiarizes you with the LakeHouse formats.

Data Engineering 62

Data Engineering Data Engineer Engineering Business Intelligence 62

Data Engineering Podcast

FEBRUARY 25, 2024

Over the decades of research and development into building these software systems there are a number of common components that are shared across implementations. __init__ covers the Python language, its community, and the innovative ways it is being used. Go to dataengineeringpodcast.com/dagster today to get started.

Database 162

Database Technology Data Lake High Quality Data 162

Cloudera

MARCH 28, 2024

More recently, that value has been made clear by the emergence of AI-powered technologies like generative AI (GenAI) and the use of Large Language Models (LLMs). In fact, two thirds of respondents agreed that data lakehouses were crucial to reducing pipeline complexity.

Data Architecture 95

Data Architecture Architecture Data Lake Data 95

Cloudera

JUNE 9, 2022

In the first blog of the Universal Data Distribution blog series , we discussed the emerging need within enterprise organizations to take control of their data flows. There are three common classes of data distribution use cases that we often see: . Data distribution customer use cases.

Data Collection 95

Data Collection Data Lake Unstructured Data Retail 95

Cloudera

DECEMBER 15, 2022

Since we announced the general availability of Apache Iceberg in Cloudera Data Platform (CDP), Cloudera customers, such as Teranet , have built open lakehouses to future-proof their data platforms for all their analytical workloads. Cloudera partners are also benefiting from Apache Iceberg in CDP. Multi-cloud deployment with CDP public cloud.

Cloud 81

Cloud Metadata Google Cloud Data Warehouse 81

AltexSoft

JANUARY 26, 2022

In recent years, it’s getting more common to see organizations looking for a mysterious analytics engineer. Such specialists use Python and programming languages for statistical analysis like R and SAS. Data scientists also sit on the side of data analysis and business logic, but this side is more sophisticated.

Engineering 59

Engineering Software Engineer Software Engineering Data Warehouse 59

Data Science Blog: Data Engineering

NOVEMBER 15, 2023

New big data architectures and, above all, data sharing concepts such as Data Mesh are ideal for creating a common database for many data products and applications. They offer consistency and standardization across data structures, improving data accuracy and integrity.

Architecture 52

Architecture Database-centric Process BI 52