Cloudera

AUGUST 26, 2021

Ozone natively provides Amazon S3 and Hadoop Filesystem compatible endpoints in addition to its own native object store API endpoint and is designed to work seamlessly with enterprise scale data warehousing, machine learning and streaming workloads. Learn more about the impacts of global data sharing in this blog, The Ethics of Data Exchange.

Data Science 110

Data Science Cloud Hadoop Metadata 110

Cloudera

JANUARY 15, 2021

Cloud data warehouses allow users to run analytic workloads with greater agility, better isolation and scale, and lower administrative overhead than ever before. The results demonstrate superior price performance of Cloudera Data Warehouse on the full set of 99 queries from the TPC-DS benchmark. Introduction.

Data Warehouse 93

Data Warehouse Cloud Consulting SQL 93

Data Engineering Podcast

MAY 27, 2021

Summary The data warehouse has become the focal point of the modern data platform. With increased usage of data across businesses, and a diversity of locations and environments where data needs to be managed, the warehouse engine needs to be fast and easy to manage. Firebolt is the fastest cloud data warehouse.

Data Warehouse 100

Data Warehouse Cloud PostgreSQL Kafka 100

Teradata

MARCH 11, 2021

Getting your Cloud data architecture right starts with understanding which data products you need, the roles they perform, & the functional & non-functional characteristics that those roles demand.

Cloud 110

Cloud Systems Data Architecture Architecture 110

Cloudera

JULY 15, 2021

The release of Cloudera Data Platform (CDP) Private Cloud Base edition provides customers with a next generation hybrid cloud architecture. Private Cloud Base Overview. The storage layer for CDP Private Cloud, including object storage. Traditional data clusters for workloads not ready for cloud.

Architecture 99

Architecture Cloud Kafka Hadoop 99

DataKitchen

DECEMBER 23, 2021

The post 2022 Big Data Predictions from the Cloud first appeared on DataKitchen.

Big Data 98

Big Data Cloud Data 98

Cloudera

JUNE 25, 2021

Many Cloudera customers are making the transition from being completely on-prem to cloud by either backing up their data in the cloud, or running multi-functional analytics on CDP Public cloud in AWS or Azure. CDP Data Lake cluster versions – CM 7.4.0, For context, the setup used is as follows. Runtime 7.2.8.

Cloud 69

Cloud Data Lake Cloud Storage Metadata 69

Cloudera

FEBRUARY 9, 2021

Today’s customers have a growing need for a faster end to end data ingestion to meet the expected speed of insights and overall business demand. This ‘need for speed’ drives a rethink on building a more modern data warehouse solution, one that balances speed with platform cost management, performance, and reliability.

Data Warehouse 69

Data Warehouse Cloud Kafka Cloud Storage 69

Cloudera

APRIL 2, 2021

Some of the most forward-operational elements of the United States federal government are making strides in leveraging data through hybrid cloud environments—and they’re constantly evaluating progress and recalibrating their approaches along the way. Geographically, where do we store compute power? It’s really mission-driven.

Cloud 72

Cloud Data Machine Learning Government 72

Cloudera

DECEMBER 6, 2021

It takes vision, purpose, and skill to unlock the power of data. For ExxonMobil, Ares Trading (Merck), and the University of California San Diego (UCSD), the right strategy is taking full advantage of the cloud. ExxonMobil has accumulated 100 years’ worth of data in millions of digital records. ExxonMobil.

Architecture 81

Architecture Cloud Medical Electronics 81

Cloudera

NOVEMBER 30, 2021

Some organizations have taken this as an opportunity for positive change by moving workloads to the cloud and utilizing enterprise data strategies that are key to their business resiliency. The Enterprise Data Maturity Model – Putting resiliency to the test. Their current uses of data and analytics.

Cloud 73

Cloud Utilities Data Government 73

Start Data Engineering

NOVEMBER 11, 2021

Writing an end-to-end data pipeline test 4. Introduction Data pipelines can have multiple software components. If you are wondering What is the best way to end-to-end test data pipelines? In this post, we go over some techniques that you can use to set up end-to-end tests for your data pipelines. Conclusion 5.

Data Pipeline 130

Data Pipeline Cloud Data 130

Confluent

DECEMBER 6, 2021

At Confluent, we’re serious about security, and we’re focused on simplifying security visibility across our cloud and on-premises solution. This blog demonstrates how to monitor Confluent Cloud authorization events using […].

Cloud 112

Cloud Data 112

Confluent

JULY 30, 2021

It’s about maintaining the right data even when no one is watching. Last year, Confluent announced support for Infinite Storage, which fundamentally changes data retention in Apache Kafka® by allowing […].

Data Integration 135

Data Integration Cloud Kafka Data 135

KDnuggets

NOVEMBER 18, 2021

This is the guide on how to build a serverless data pipeline on AWS with a Machine Learning model deployed as a Sagemaker endpoint.

Data Pipeline 154

Data Pipeline AWS Building Cloud 154

ProjectPro

AUGUST 11, 2021

“Data Lake vs Data Warehouse = Load First, Think Later vs Think First, Load Later” The terms data lake and data warehouse are frequently stumbled upon when it comes to storing large volumes of data. Data Warehouse Architecture What is a Data lake? Is Hadoop a data lake or data warehouse?

Data Lake 52

Data Lake Data Warehouse Cloud Hadoop 52

DataKitchen

JULY 16, 2021

The post How to build a successful cloud data architecture first appeared on DataKitchen.

Data Architecture 52

Data Architecture Architecture Cloud Building 52

RudderStack

MAY 11, 2021

To create the Data Silos, RudderStack reveals the reason that why the Cloud SaaS tools were in use and managed by the Marketing, Sales and Product Teams.

Cloud 40

Cloud Data Management 40

KDnuggets

NOVEMBER 18, 2021

This is the guide on how to build a serverless data pipeline on AWS with a Machine Learning model deployed as a Sagemaker endpoint.

Data Pipeline 83

Data Pipeline AWS Building Cloud 83

Netflix Tech

JUNE 7, 2021

At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight. Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices.

Transportation 130

Transportation AWS Cloud Metadata 130

François Nguyen

MARCH 22, 2021

TL;DR After setting up and organizing the teams, we are describing 4 topics to make data mesh a reality. TL;DR After setting up and organizing the teams, we are describing 4 topics to make data mesh a reality. How do we build data products ? How can we interoperate between the data domains ?

Architecture 130

Architecture Technology Google Cloud Metadata 130

Start Data Engineering

AUGUST 17, 2021

Batch Data Pipelines 1.1 Process => Data Warehouse 1.2 Process => Cloud Storage => Data Warehouse 2. Near Real-Time Data pipelines 2.1 Data Stream => Consumer => Data Warehouse 2.2 Near Real-Time Data pipelines 2.1 Data Stream => Consumer => Data Warehouse 2.2

Data Warehouse 130

Data Warehouse Cloud Storage Data Pipeline Data 130

Confluent

FEBRUARY 4, 2021

How do you process IoT data, change data capture (CDC) data, or streaming data from sensors, applications, and sources in real time? Apache Kafka® and Azure Databricks are widely adopted […].

Kafka 86

Kafka Cloud Data Process 86

Teradata

FEBRUARY 1, 2021

Vantage Trial provides free, 30-day access to Teradata Vantage in the cloud for analysts, developers, and operations personnel. Find out more.

Cloud 40

Cloud Data Analytics Accessible Accessibility 40

Cloudera

JUNE 1, 2021

Cloudera will become a private company with the flexibility and resources to accelerate product innovation, cloud transformation and customer growth. This means we can double down on our strategy – continuing to win the Hybrid Data Cloud battle in the IT department AND building new, easy-to-use cloud solutions for the line of business.

Cloud 144

Cloud Data Lake Big Data Finance 144

Start Data Engineering

OCTOBER 11, 2021

Leetcode: data structures and algorithms 4. Data modeling 4.1 Data warehousing 4.2 Data pipelines 6. Cloud computing 11. Introduction Skills 1. Distributed system fundamentals 7. Event streaming 8. System design 9. Business questions 10.

Data Engineering 130

Data Engineering Data Engineer Engineering Cloud Computing 130

Maxime Beauchemin

MARCH 8, 2021

For those reasons, it is not surprising that it has taken over most of the modern data stack: infrastructure, databases, orchestration, data processing, AI/ML and beyond. That’s without mentioning the fact that for a cloud-native company, Tableau’s Windows-centric approach at the time didn’t work well for the team.

Business Intelligence 130

Business Intelligence BI Database-centric Google Cloud 130

Cloudera

AUGUST 31, 2021

Cloudera and Accenture demonstrate strength in their relationship with an accelerator called the Smart Data Transition Toolkit for migration of legacy data warehouses into Cloudera Data Platform. Accenture’s Smart Data Transition Toolkit . Are you looking for your data warehouse to support the hybrid multi-cloud?

Data Warehouse 82

Data Warehouse Database-centric Metadata Cloud 82

Cloudera

AUGUST 22, 2021

Cloudera recently appointed a Cloud Director for Asia Pacific (APAC), Stevie Walsh, to help drive our hybrid and multi-cloud offerings in the region, supporting our customers in accelerating their digital transformation journey. What drew you to work in the cloud space? What drew you to work in the cloud space?

Cloud 103

Cloud Telecommunication Insurance Manufacturing 103

Cloudera

JULY 9, 2021

If you’ve followed Cloudera for a while, you know we’ve long been singing the praises—or harping on the importance, depending on perspective—of a solid, standalone enterprise data strategy. The ways data strategies are implemented, the resulting outcomes and the lessons learned along the way provide important guardrails.

Government 110

Government Building Cloud Data Ingestion 110

Teradata

SEPTEMBER 28, 2021

Our latest global industry survey, in partnership with Vanson Bourne, reveals that enterprises are contemplating long-term, data-focused IT investments to address changing market conditions.

Technology 52

Technology IT Data Management Cloud 52

Cloudera

DECEMBER 21, 2021

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. Data pipelines are composed of multiple steps with dependencies and triggers. Autoscaling speed and scale.

Data Engineering 117

Data Engineering Data Engineer Engineering Data Pipeline 117

Data Council

JANUARY 21, 2021

Storing Cold Metadata with Alki (Dropbox) Dropbox shared insights into Alki , the petabyte-scale metadata store it designed for infrequently accessed metadata (“cold data”). Here's our January 2021 roundup of links from across the web that could be relevant to you: 1.

Metadata 52

Metadata AWS Cloud Database 52

Teradata

MAY 31, 2021

Learn about the capabilities and benefits of NOS WRITE -- the latest offering within the Native Object Store feature, which was released in early 2020.

Cloud Storage 52

Cloud Storage IT Cloud Data 52

Cloudera

JANUARY 27, 2021

We believe security is the cornerstone of any legitimate data platform, and we’re excited to announce that Cloudera has successfully achieved SOC 2 Type II certification for Cloudera Data Platform (CDP) Public Cloud. Data backup and disaster recovery. Why is SOC 2 Important? What’s Next?

Certification 102

Certification Cloud Data Warehouse Machine Learning 102

Cloudera

AUGUST 3, 2021

In summary, predicting future supply chain demands using last year’s data, just doesn’t work. Accurate demand forecasting can’t rely upon last year’s data based upon dated consumer preferences, lifestyle and demand patterns that just don’t exist today – the world has changed. Leveraging data where it lies.

Manufacturing 108

Manufacturing Retail Entertainment Government 108

DataKitchen

APRIL 13, 2021

This is not surprising given that DataOps enables enterprise data teams to generate significant business value from their data. Companies that implement DataOps find that they are able to reduce cycle times from weeks (or months) to days, virtually eliminate data errors, increase collaboration, and dramatically improve productivity.

Consulting 123

Consulting Machine Learning Data Science Data Pipeline 123