Cloudera

JUNE 27, 2023

The way to achieve this balance is by moving to a modern data architecture (MDA) that makes it easier to manage, integrate, and govern large volumes of distributed data. When you deploy a platform that supports MDA you can consolidate other systems, like legacy data mediation and disparate data storage solutions.

Data Architecture 63

Data Architecture Architecture Government Data Governance 63

Monte Carlo

FEBRUARY 21, 2023

Today, as data sources become increasingly varied, data management becomes more complex, and agility and scalability become essential traits for data leaders, data fabric is quickly becoming the future of data architecture. If data fabric is the future, how can you get your organization up-to-speed?

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Monte Carlo

FEBRUARY 21, 2023

Today, as data sources become increasingly varied, data management becomes more complex, and agility and scalability become essential traits for data leaders, data fabric is quickly becoming the future of data architecture. If data fabric is the future, how can you get your organization up-to-speed?

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Cloudera

AUGUST 9, 2022

With all of the buzz around cloud computing, many companies have overlooked the importance of hybrid data. The truth is, the future of data architecture is all about hybrid. We’ve seen this from all of our customers and are emphasizing building and iterating on modern data architectures. Do we need more than one?

Data Architecture 94

Data Architecture Architecture Cloud Computing Cloud 94

Snowflake

JULY 27, 2023

Over the course of this journey, HomeToGo’s data needs have evolved considerably. Combining these services is helping the company to make cost-effective, data-driven business decisions, as well as giving us the confidence that our data architecture is robust and secure.

Data Architecture 52

Data Architecture Architecture Building Structured Data 52

Cloudera

SEPTEMBER 29, 2022

Each of these trends claim to be complete models for their data architectures to solve the “everything everywhere all at once” problem. Data teams are confused as to whether they should get on the bandwagon of just one of these trends or pick a combination. First, we describe how data mesh and data fabric could be related.

Architecture 76

Architecture Data Architecture Metadata Data Warehouse 76

DataKitchen

JULY 22, 2021

Learn about four data architectures patterns for agility - DataOps, Data Fabric, Data Mesh & Functional Data Engineering - & an example combining all four. The post DataOps: The Foundation for Your Agile Data Architecture first appeared on DataKitchen.

Data Architecture 52

Data Architecture Architecture Data Data Engineering 52

KDnuggets

FEBRUARY 10, 2022

Going forward, data professionals have found a new way to address the scalability of sources through data mesh.

Data Architecture 108

Data Architecture Architecture IT Data 108

KDnuggets

FEBRUARY 16, 2022

How to Learn Math for Machine Learning; Data Mesh & Its Distributed Data Architecture; 5 Ways to Apply AI to Small Data Sets; Top 5 Free Machine Learning Courses; Junior Data Scientist: The Next Level.

Machine Learning 108

Machine Learning Data Architecture Architecture IT 108

databricks

MAY 1, 2024

Modern data stacks provide the necessary flexibility and efficiency for analytics and AI. Learn how the Databricks Data Intelligence Platform makes use of them.

Data Architecture 105

Data Architecture Architecture Data 105

databricks

APRIL 26, 2023

One of Lakehouse's outstanding achievements is the ability to combine workloads for modern use cases, such as traditional BI, machine learning & AI.

Data Architecture 112

Data Architecture Architecture BI Machine Learning 112

KDnuggets

APRIL 5, 2023

Learn about Apache Kafka architecture and its implementation using a real-world use case of a taxi booking app.

Kafka 108

Kafka Architecture Data Architecture Building 108

DataKitchen

AUGUST 3, 2021

The post Building a Modern Data Architecture for the 2020s first appeared on DataKitchen.

Data Architecture 59

Data Architecture Architecture Building Data 59

DataKitchen

JULY 16, 2021

The post How to build a successful cloud data architecture first appeared on DataKitchen.

Data Architecture 52

Data Architecture Architecture Cloud Building 52

Data Engineering Podcast

SEPTEMBER 7, 2020

For analytical use cases you often want to combine data across multiple sources and storage locations. This frequently requires cumbersome and time-consuming data integration. Summary Databases are limited in scope to the information that they directly contain.

Architecture 100

Architecture Data Architecture SQL Engineering 100

Confluent

OCTOBER 30, 2020

A fundamental challenge with today’s “data explosion” is finding the best answer to the question, “So where do I put my data?” while avoiding the longer-term problem of data warehouses, […].

Data Architecture 114

Data Architecture Architecture Kafka Building 114

Rockset

JULY 21, 2020

Lessons from scaling facebook's online data infrastructure There are 3 growth numbers that stand out when I look back at the hyper-growth years of facebook from 2007 until 2015, when I was managing facebook's online data infrastructure team: user growth, team growth and infrastructure growth.

Data Architecture 40

Data Architecture Architecture Building Programming Language 40

Data Engineering Weekly

AUGUST 6, 2024

CDC tools fuel analytical apps and mission-critical data feeds in banking and regulated industries, with use cases ranging from data synchronization, managing risk, and preventing fraud to driving personalization. This approach simplifies data architecture and enhances performance by reducing data movement and latency.

Data Lake 117

Data Lake Data Warehouse Database Data Architecture 117

Towards Data Science

JANUARY 16, 2024

When I heard the words ‘decentralised data architecture’, I was left utterly confused at first! In my then limited experience as a Data Engineer, I had only come across centralised data architectures and they seemed to be working very well. So what was missing?

Data Warehouse 64

Data Warehouse Data Architecture Relational Database NoSQL 64

Hevo

JULY 17, 2024

Every data-centric organization uses a data lake, warehouse, or both data architectures to meet its data needs. Data Lakes bring flexibility and accessibility, whereas warehouses bring structure and performance to the data architecture.

Data Ingestion 52

Data Ingestion Data Lake Data Architecture Architecture 52

KDnuggets

OCTOBER 30, 2023

A comparative overview of data warehouses, data lakes, and data marts to help you make informed decisions on data storage solutions for your data architecture.

Data Lake 139

Data Lake Data Warehouse Data Storage Data 139

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Cloudera

AUGUST 21, 2024

Many businesses understand the need for effective AI and analytics within their own operations but struggle with getting their data architectures to support it. Cloudera’s platform offers portable, cloud-native, analytics deployable across infrastructures, all while maintaining consistent data governance and security.

Unstructured Data 67

Unstructured Data Business Intelligence Data Architecture Data Warehouse 67

Simon Späti

APRIL 3, 2023

This article is the first in a three-part series that will shine a spotlight on the fascinating world of data modeling, delving into its crucial importance within the broader context of data engineering.

Data Engineering 130

Data Engineering Data Engineer Engineering Data Architecture 130

Simon Späti

APRIL 3, 2023

This article is the first in a three-part series that will shine a spotlight on the fascinating world of data modeling, delving into its crucial importance within the broader context of data engineering.

Data Engineering 130

Data Engineering Data Engineer Engineering Data Architecture 130

Cloudera

AUGUST 20, 2024

Trusted data is what makes the outputs of AI not just accurate, but impactful in decision making. Ensuring data is trustworthy comes with its own complications. Cloudera’s State of Enterprise AI and Modern Data Architecture survey identified several challenges when it comes to data.

Government 77

Government Data Lake Data Governance Data Architecture 77

Confluent

JANUARY 19, 2021

On a recent episode of Streaming Audio, Gwen Shapira, Michael Noll, and Ben Stopford joined me to hold forth about the near future of Apache Kafka® and software architecture in […].

Kafka 43

Kafka Architecture Data Architecture Data 43

Cloudera

MARCH 28, 2024

But, even with the backdrop of an AI-dominated future, many organizations still find themselves struggling with everything from managing data volumes and complexity to security concerns to rapidly proliferating data silos and governance challenges.

Data Architecture 95

Data Architecture Architecture Data Lake Data 95

Striim

AUGUST 20, 2024

One powerful way to achieve this transformation is by modernizing data architecture and migrating to the cloud. For retailers, modernizing data architecture is not just about upgrading technology—it’s about empowering teams with better, faster access to data while future-proofing their infrastructure.

Retail 52

Retail Cloud Google Cloud Data Architecture 52

Cloudera

APRIL 11, 2024

By bringing together various partners, we provide comprehensive solutions that address specific use cases and modernize data architecture. Without our partners, achieving true hybridity, enabling AI capabilities, or modernizing data architecture would be challenging.

Food 92

Food Data Architecture Architecture Programming 92

Cloudera

MAY 28, 2024

It’s not enough for businesses to implement and maintain a data architecture. The unpredictability of market shifts and the evolving use of new technologies means businesses need more data they can trust than ever to stay agile and make the right decisions.

Data Architecture 90

Data Architecture Architecture Data Lake Data Warehouse 90

Snowflake

DECEMBER 18, 2023

Here are 50 Data Leaders to watch in 2024: Amin Venjara , CDO, ADP Andrew Bonnici , Vice President – Product, Platforms, and Data, IGT PlayDigital Andrew Curry , CDO, ExxonMobil Aravind Jagannathan , VP and CDO, Freddie Mac Arno Huhn , Managing Director Data and AI, Schwarz Group Ashok Chennuru , Global Chief Data & Insights Officer, Elevance (..)

Transportation 109

Transportation Insurance Data Architecture Technology 109

Snowflake

OCTOBER 23, 2023

This flexibility in language and programming constructs not only optimizes data architecture but also turbocharges development cycles, fortifies governance, enhances security, and more.

Python 141

Python Cloud Data Science Machine Learning 141

Start Data Engineering

AUGUST 29, 2021

You are given a quick overview of the business and data architecture and are assigned your very first data engineering task. Breakdown into sub-tasks 3.3. Delivering the finished task 4. Conclusion 5. Further reading 1. Introduction Congratulations!

Data Engineering 130

Data Engineering Data Engineer Engineering Data Architecture 130

Cloudyard

JULY 22, 2024

By the end of this post, you’ll have a comprehensive understanding of how to leverage this powerful integration to enhance your data architecture. Lambda Kinesis Step6: Attach function to S3 Bucket: Attach Lambda Step7: Upload file to the Bucket and this would trigger Lambda function which in turn will call kinesis data stream.

AWS 52

AWS Data Ingestion Data Architecture Architecture 52

Cloudera

JUNE 7, 2022

Companies can now capitalize on the value in all their data, by delivering a hybrid data platform for modern data architectures with data anywhere. Cloudera Data Platform (CDP) is designed to address the critical requirements for modern data architectures today and tomorrow.

IT 114

IT Unstructured Data Data Architecture Government 114