Cloudera

FEBRUARY 9, 2021

A typical approach that we have seen in customers’ environments is that ETL applications pull data with a frequency of minutes and land it into HDFS storage as an extra Hive table partition file. In this way, the analytic applications are able to turn the latest data into instant business insights. Design Detail.

Data Warehouse 69

Data Warehouse Cloud Kafka Cloud Storage 69

Cloudera

FEBRUARY 8, 2024

Overview This blog post describes support for materialized views for the Iceberg table format. Apache Iceberg is a high-performance open table format for petabyte-scale analytic datasets. Such a query pattern is quite common in BI queries. Both full and incremental rebuild of the materialized view are supported.

Metadata 88

Metadata Data Warehouse BI AWS 88

Cloudera

MARCH 6, 2018

This leads to extra cost, effort, and risk to stitch together a sub-optimal platform for multi-disciplinary, cloud-based analytics applications. If catalog metadata and business definitions live with transient compute resources, they will be lost, requiring work to recreate later and making auditing impossible.

Cloud 40

Cloud Metadata Big Data AWS 40

Cloudera

DECEMBER 7, 2017

That data may be hard to discover for other users and other applications. Worse, the metadata and context associated with that data may be lost forever if a transient cluster is shut down and the resources released. A way to leverage the benefits of cloud for multi-disciplinary analytics, without all of those problems.

Building 40

Building Management Government BI 40

AltexSoft

OCTOBER 21, 2022

The tool takes care of storing metadata about partitions and brokers. Hadoop fits heavy, not time-critical analytics applications that generate insights for long-term planning and strategic decisions. If you are interested in web development, take a look at our blog post on. ZooKeeper issue. Kafka vs ETL.

Kafka 93

Kafka Hadoop ETL Tools Big Data 93

Cloudera

JUNE 16, 2022

This blog aims to answer two questions as illustrated in the diagram below: How have stream processing requirements and use cases evolved as more organizations shift to “streaming first” architectures and attempt to build streaming analytics pipelines? Meet Laila, a very opinionated practitioner of Cloudera Stream Processing.

Kafka 84

Kafka Manufacturing Data Lake SQL 84

phData: Data Engineering

JULY 18, 2023

CDWs are designed for running large and complex queries across vast amounts of data, making them ideal for centralizing an organization’s analytical data for the purpose of business intelligence and data analytics applications. Allowing data diff analysis and code generation.

Data Warehouse 52

Data Warehouse Pipeline-centric Government Data 52