Cloudera

MARCH 28, 2024

But, even with the backdrop of an AI-dominated future, many organizations still find themselves struggling with everything from managing data volumes and complexity to security concerns to rapidly proliferating data silos and governance challenges.

Data Architecture 94

Data Architecture Architecture Data Lake Data 94

Cloudera

MAY 28, 2024

It’s not enough for businesses to implement and maintain a data architecture. The unpredictability of market shifts and the evolving use of new technologies means businesses need more data they can trust than ever to stay agile and make the right decisions.

Data Architecture 88

Data Architecture Architecture Data Lake Data Warehouse 88

Cloudera

SEPTEMBER 6, 2022

Data has continued to grow both in scale and in importance through this period, and today telecommunications companies are increasingly seeing data architecture as an independent organizational challenge, not merely an item on an IT checklist. Why telco should consider modern data architecture. The challenges.

Telecommunication 84

Telecommunication Data Architecture Architecture Government 84

Cloudera

JUNE 29, 2023

To improve the way they model and manage risk, institutions must modernize their data management and data governance practices. Implementing a modern data architecture makes it possible for financial institutions to break down legacy data silos, simplifying data management, governance, and integration — and driving down costs.

Data Architecture 85

Data Architecture Architecture Management Banking 85

KDnuggets

FEBRUARY 10, 2022

Going forward, data professionals have found a new way to address the scalability of sources through data mesh.

Data Architecture 108

Data Architecture Architecture IT Data 108

Towards Data Science

OCTOBER 3, 2024

Three important lessons I have learned on my journey as data engineer and architect Continue reading on Towards Data Science »

Data Architecture 75

Data Architecture Architecture Data Science Data 75

KDnuggets

FEBRUARY 16, 2022

How to Learn Math for Machine Learning; Data Mesh & Its Distributed Data Architecture; 5 Ways to Apply AI to Small Data Sets; Top 5 Free Machine Learning Courses; Junior Data Scientist: The Next Level.

Machine Learning 107

Machine Learning Data Architecture Architecture IT 107

Cloudera

AUGUST 1, 2024

While every business has adopted some form of data architecture, the types they use vary widely. Leveraging Modern Data Architectures In today’s landscape, the only way to ensure data reliability is through the adoption of modern data architectures. EMEA and APAC regions.

Data Architecture 82

Data Architecture Architecture Deep Learning Data Security 82

Confluent

OCTOBER 30, 2020

A fundamental challenge with today’s “data explosion” is finding the best answer to the question, “So where do I put my data?” while avoiding the longer-term problem of data warehouses, […].

Data Architecture 119

Data Architecture Architecture Kafka Building 119

Cloudera

AUGUST 30, 2022

Modern data architectures. To eliminate or integrate these silos, the public sector needs to adopt robust data management solutions that support modern data architectures (MDAs). Deploying modern data architectures. Lack of sharing hinders the elimination of fraud, waste, and abuse.

Data Architecture 79

Data Architecture Architecture Data Lake NoSQL 79

Cloudera

AUGUST 9, 2022

With all of the buzz around cloud computing, many companies have overlooked the importance of hybrid data. The truth is, the future of data architecture is all about hybrid. We’ve seen this from all of our customers and are emphasizing building and iterating on modern data architectures. Do we need more than one?

Data Architecture 92

Data Architecture Architecture Cloud Computing Cloud 92

databricks

APRIL 26, 2023

One of Lakehouse's outstanding achievements is the ability to combine workloads for modern use cases, such as traditional BI, machine learning & AI.

Data Architecture 119

Data Architecture Architecture BI Machine Learning 119

databricks

MAY 1, 2024

Modern data stacks provide the necessary flexibility and efficiency for analytics and AI. Learn how the Databricks Data Intelligence Platform makes use of them.

Data Architecture 125

Data Architecture Architecture Data 125

KDnuggets

APRIL 5, 2023

Learn about Apache Kafka architecture and its implementation using a real-world use case of a taxi booking app.

Kafka 108

Kafka Architecture Data Architecture Building 108

Monte Carlo

NOVEMBER 12, 2024

A data engineering architecture is the structural framework that determines how data flows through an organization – from collection and storage to processing and analysis. It’s the big blueprint we data engineers follow in order to transform raw data into valuable insights.

Architecture 96

Architecture Data Engineering Data Engineer Engineering 96

Confluent

OCTOBER 25, 2024

Proceed further by establishing your own headless data architecture—formalizing a data access layer at the center of your org, accessible by both analytics and operations.

Data Architecture 59

Data Architecture Architecture Data Accessible 59

Confluent

OCTOBER 17, 2024

A headless data architecture separates data storage, management, optimization, and access from services that write, process, and query it—creating a single point of access control.

Data Architecture 59

Data Architecture Architecture Data Storage Data 59

Cloudera

JULY 29, 2022

This does not mean ‘one of each’ – a public cloud data strategy and an on-prem data strategy. Rather, it means a holistic and comprehensive enterprise data strategy, spanning both, supported by a modern data architecture. . The telco industry has also increased its spend by 48% on similar initiatives. .

Data Architecture 89

Data Architecture Architecture Unstructured Data Government 89

Data Engineering Podcast

SEPTEMBER 7, 2020

For analytical use cases you often want to combine data across multiple sources and storage locations. This frequently requires cumbersome and time-consuming data integration. Summary Databases are limited in scope to the information that they directly contain.

Architecture 100

Architecture Data Architecture SQL Engineering 100

Cloudera

SEPTEMBER 29, 2022

Each of these trends claim to be complete models for their data architectures to solve the “everything everywhere all at once” problem. Data teams are confused as to whether they should get on the bandwagon of just one of these trends or pick a combination. First, we describe how data mesh and data fabric could be related.

Architecture 74

Architecture Data Architecture Metadata Data Warehouse 74

Cloudera

JUNE 27, 2023

The way to achieve this balance is by moving to a modern data architecture (MDA) that makes it easier to manage, integrate, and govern large volumes of distributed data. When you deploy a platform that supports MDA you can consolidate other systems, like legacy data mediation and disparate data storage solutions.

Data Architecture 62

Data Architecture Architecture Government Data Governance 62

Data Engineering Podcast

MAY 29, 2022

Summary A large fraction of data engineering work involves moving data from one storage location to another in order to support different access and query patterns. Singlestore aims to cut down on the number of database engines that you need to run so that you can reduce the amount of copying that is required.

Database 100

Database Architecture Data Architecture PostgreSQL 100

The Modern Data Company

JULY 29, 2024

BCG research reveals a striking trend: the number of unique data vendors in large companies has nearly tripled over the past decade, growing from about 50 to 150. This dramatic increase in vendors hasn’t led to the expected data revolution. It’s a final, frustrating hurdle in the race to become truly data-driven.

Data Architecture 52

Data Architecture Architecture Building Pipeline-centric 52

Hevo

DECEMBER 15, 2024

Introduction to Data Architecture Data architecture shows how data is managed, from collection to transformation to distribution and consumption. It tells about how data flows through the data storage systems. Data architecture is an important piece of data management.

Data Architecture 40

Data Architecture Architecture Data Storage Data 40

Striim

FEBRUARY 12, 2024

This approach can turn data challenges into advantages, helping companies grow, work more efficiently, and stand out in their industry. Want to see how Striim’s Data Mesh and AI can benefit your organization? The post Transforming Data Architecture through Data Mesh and Striim appeared first on Striim.

Data Architecture 52

Data Architecture Architecture Data Data Lake 52

Cloudera

DECEMBER 17, 2024

The introduction of these faster, more powerful networks has triggered an explosion of data, which needs to be processed in real time to meet customer demands. Traditional data architectures struggle to handle these workloads, and without a robust, scalable hybrid data platform, the risk of falling behind is real.

Building 62

Building Telecommunication Data Architecture Architecture 62

Precisely

JANUARY 9, 2025

The goal of this post is to understand how data integrity best practices have been embraced time and time again, no matter the technology underpinning. In the beginning, there was a data warehouse The data warehouse (DW) was an approach to data architecture and structured data management that really hit its stride in the early 1990s.

Data Integration 119

Data Integration Hadoop Data Warehouse Data Lake 119

Towards Data Science

JANUARY 31, 2025

Follow me through the steps on how to evolve your architecture to align with your business needs Continue reading on Towards Data Science

Architecture 48

Architecture Data Architecture Data Science Data 48

Monte Carlo

JANUARY 14, 2025

After multiple acquisitions and updates to the business, the Kargo team consolidated their data platform in Snowflake to centralize their data function, and they built a data stack consisting of Airflow, Looker, Nexla, and Databricks. But transforming their data architecture was just one small step.

Data 98

Data Data Engineering Data Engineer Media 98

Cloudera

DECEMBER 6, 2024

The AI Forecast: Data and AI in the Cloud Era , sponsored by Cloudera, aims to take an objective look at the impact of AI on business, industry, and the world at large. AI is only as successful as the data behind it.

Manufacturing 82

Manufacturing Retail Finance Metadata 82

KDnuggets

OCTOBER 30, 2023

A comparative overview of data warehouses, data lakes, and data marts to help you make informed decisions on data storage solutions for your data architecture.

Data Lake 139

Data Lake Data Warehouse Data Storage Data Architecture 139

Hevo

SEPTEMBER 17, 2024

Organizations have begun to built data warehouses and lakes to analyze large amounts of data for insights and business reports. Often time they bring data from multiple data silos into their data lake and also have data stored in particular data stores like NoSQL databases to support different use cases.

Data Architecture 40

Data Architecture Architecture NoSQL Data Lake 40

Towards Data Science

JANUARY 16, 2024

When I heard the words ‘decentralised data architecture’, I was left utterly confused at first! In my then limited experience as a Data Engineer, I had only come across centralised data architectures and they seemed to be working very well. So what was missing?

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

Start Data Engineering

AUGUST 29, 2021

You are given a quick overview of the business and data architecture and are assigned your very first data engineering task. Breakdown into sub-tasks 3.3. Delivering the finished task 4. Conclusion 5. Further reading 1. Introduction Congratulations!

Data Engineering 130

Data Engineering Data Engineer Engineering Data Architecture 130

Simon Späti

NOVEMBER 28, 2018

However, this is still not common in the Data Warehouse (DWH) field. In my recent blog, I researched OLAP technologies, for this post I chose some open-source technologies and used them together to build a full data architecture for a Data Warehouse system. Why is this?

Data Warehouse 130

Data Warehouse Data Storage Data Architecture Architecture 130

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130