Remove operating-apache-kafka-with-cruise-control
article thumbnail

Scaling Kafka Brokers in Cloudera Data Hub

Cloudera

This blog post will provide guidance to administrators currently using or interested in using Kafka nodes to maintain cluster changes as they scale up or down to balance performance and cloud costs in production deployments. Kafka brokers contained within host groups enable the administrators to more easily add and remove nodes.

Kafka 77
article thumbnail

Data Engineering Weekly #141

Data Engineering Weekly

See: Bundling Vs. Unbundling: The Tale of Airflow Operator and dbt Ref ]. Access the Report AWS: A side-by-side comparison of Apache Spark and Apache Flink for common streaming use cases Is Flink a better choice for streaming or Spark streaming? We've overcome some unexpected hiccups, and guess what?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Operating Apache Kafka with Cruise Control

Cloudera

About Cruise Control. There are two big gaps in the Apache Kafka project when we think of operating a cluster. There are no solutions for these inside the Kafka project but there are many good 3rd party tools for both problems. Cruise Control is integrated with Kafka through metrics reporting.

Kafka 70
article thumbnail

Upgrade Journey: The Path from CDH to CDP Private Cloud

Cloudera

The customer also wanted to utilize the new features in CDP PvC Base like Apache Ranger for dynamic policies, Apache Atlas for lineage, comprehensive Kafka streaming services and Hive 3 features that are not available in legacy CDH versions. Attribute-based access control and SparkSQL fine-grained access control.

Cloud 131
article thumbnail

Cloudera DataFlow’s key milestones and wins in 2020

Cloudera

Spin up clusters of NiFi, Kafka, or Flink very quickly onto your public cloud environments on AWS or Azure. Extending the Kafka ecosystem to CDP – Cloudera (and Hortonworks) has always prided itself on its investment and innovations around Apache Kafka.

Kafka 59
article thumbnail

New Features in Cloudera Streams Messaging for CDP Public Cloud 7.2.14

Cloudera

In this release , the Streams Messaging templates in Data Hub will come with Apache Kafka 2.8 and Cruise Control 2.5 KConnect has been added and gains additional capabilities with new connectors and Stateless Apache NiFi capabilities which can run NiFi Flows as connectors. Kafka & Cruise Control Updates.

Cloud 102
article thumbnail

New Features in Cloudera Streams Messaging Public Cloud 7.2.12

Cloudera

From this release, Streams Messaging templates will support scaling with automatic rebalancing allowing you to grow or shrink your Apache Kafka cluster based on demand. Kafka Scaling. Support up and downscale operations. Support automatic partition rebalancing with Cruise Control.

Cloud 87