Cloudera

SEPTEMBER 15, 2022

The gathering in 2022 marked the sixteenth year for top data and analytics professionals to come to the MIT campus to explore current and future trends. A key area of focus for the symposium this year was the design and deployment of modern data platforms. Ramsey International Modern Data Platform Architecture.

Data Lake 81

Data Lake Analytics Application Cloud Storage Architecture 81

Cloudera

SEPTEMBER 1, 2020

DDE is a new template flavor within CDP Data Hub in Cloudera’s public cloud deployment option (CDP PC). It is designed to simplify deployment, configuration, and serviceability of Solr-based analytics applications. Includes a drag-n-drop style, GUI-based Search Dashboard Designer. What does DDE entail?

Cloud Storage 68

Cloud Storage Unstructured Data AWS Analytics Application 68

Cloudera

FEBRUARY 9, 2021

A typical approach that we have seen in customers’ environments is that ETL applications pull data with a frequency of minutes and land it into HDFS storage as an extra Hive table partition file. In this way, the analytic applications are able to turn the latest data into instant business insights. Design Detail.

Data Warehouse 70

Data Warehouse Cloud Kafka Cloud Storage 70

Towards Data Science

APRIL 26, 2023

Photo by László Glatz on Unsplash In this post we will show how to build a simple end-to-end application in the cloud on a serverless infrastructure. The purpose is simple: we want to show that we can develop directly against the cloud while minimizing the cognitive overhead of designing and building infrastructure.

Engineering 67

Engineering Data Lake AWS BI 67

Rockset

AUGUST 4, 2021

Without performant data ingestion, you run the risk of querying outdated values and returning irrelevant analytics. The first, bulk loading, loads data from files in cloud storage or a local machine. Then it stages them into a Snowflake cloud storage location. Rockset is designed for real-time analytics.

Data Ingestion 40

Data Ingestion Cloud Storage Data Warehouse Data Lake 40

ProjectPro

SEPTEMBER 6, 2021

Amazon brought innovation in technology and enjoyed a massive head start compared to Google Cloud, Microsoft Azure , and other cloud computing services. It developed and optimized everything from cloud storage, computing, IaaS, and PaaS. AWS S3 and GCP Storage Amazon and Google both have their solution for cloud storage.

AWS 52

AWS Amazon Web Services Google Cloud Cloud Storage 52

AltexSoft

OCTOBER 21, 2022

After trying all options existing on the market — from messaging systems to ETL tools — in-house data engineers decided to design a totally new solution for metrics monitoring and user activity tracking which would handle billions of messages a day. Kafka is designed to handle numerous clients from both sides.

Kafka 93

Kafka Hadoop ETL Tools Big Data 93