KDnuggets

OCTOBER 13, 2023

Let’s explore Data Mesh, a modern approach to data architecture that decentralizes data ownership and management.

Data Architecture 120

Data Architecture Architecture Data Management 120

Monte Carlo

JANUARY 5, 2024

You know what they always say: data lakehouse architecture is like an onion. …ok, Data lakehouse architecture combines the benefits of data warehouses and data lakes, bringing together the structure and performance of a data warehouse with the flexibility of a data lake. Table of Contents What is data lakehouse architecture?

Architecture 52

Architecture Data Lake Metadata Unstructured Data 52

Monte Carlo

JANUARY 5, 2024

You know what they always say: data lakehouse architecture is like an onion. …ok, Data lakehouse architecture combines the benefits of data warehouses and data lakes, bringing together the structure and performance of a data warehouse with the flexibility of a data lake. Table of Contents What is data lakehouse architecture?

Architecture 52

Architecture Data Lake Metadata Unstructured Data 52

The Modern Data Company

FEBRUARY 26, 2024

With each new product launch and market expansion, the data architecture that once supported its growth now threatened to be its Achilles’ heel. The need for evolutionary architecture Companies must be able to evolve without disrupting day-to-day operations. Evolutionary architecture embodies this principle.

Architecture 52

Architecture Data Architecture Data Technology 52

Simon Späti

MAY 26, 2023

In this third part, we’ll delve into data architecture patterns and their influence on data modeling. .” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Simon Späti

MAY 26, 2023

In this third part, we’ll delve into data architecture patterns and their influence on data modeling. .” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Scott Logic

JUNE 6, 2023

In this post, I will look at the impact of these tools on coding and use that to predict how they will impact the design of software architecture. But what can these new capabilities do to help with the design of software architecture? So, how is AI likely to impact how software architecture decisions are made?

Architecture 69

Architecture Coding Designing Systems 69

François Nguyen

MARCH 22, 2021

How to build Data Products or never call me Data Pipeline any more You have this interesting schema in her second article on Data Mesh by Zhamak Dehghani : “Data mesh introduces the concept of data product as its architectural quantum. We are Data Teams versus we have to patch the server with the latest version and do the tests.

Architecture 130

Architecture Technology Google Cloud Metadata 130

Knowledge Hut

SEPTEMBER 22, 2023

My personal experience has taught me how stressful it can be to be surrounded by confusing architectural blueprints. Fortunately, architectural project managers are always available to lend a helping hand. This article lists simple answers on how to become a project manager in architecture. Let’s have a look!

Architecture 52

Architecture Project Management Certification 52

Cloudera

SEPTEMBER 29, 2022

They are being bombarded with literature about seemingly independent new trends like data mesh and data fabric while dealing with the reality of having to work with hybrid architectures. Each of these trends claim to be complete models for their data architectures to solve the “everything everywhere all at once” problem.

Architecture 74

Architecture Data Architecture Metadata Data Warehouse 74

Uber Engineering

MARCH 11, 2020

Foundational to our platform’s power is its microservice-based architecture … The post Why We Leverage Multi-tenancy in Uber’s Microservice Architecture appeared first on Uber Engineering Blog.

Architecture 145

Architecture Engineering IT 145

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. By exploring the benefits of using Data Mesh for your event streaming architecture, this article will help you decide if it’s the right solution for your organization.

Architecture 52

Architecture Generalist Government Datasets 52

Data Engineering Podcast

JULY 3, 2022

These technological shifts have brought about corresponding changes in data and platform architectures for managing data and analytical workflows. She also discusses her views on the role of the data lakehouse as a building block for these architectures and the ongoing influence that it will have as the technology matures.

Architecture 100

Architecture Metadata MongoDB MySQL 100

U-Next

MARCH 12, 2023

Introduction Cloud computing architecture is straightforward and lists all of its constituent parts and subparts in detail. Supports Remote Procedural Calls Development of components across the company EJBs (JavaBeans) and.NET elements has expanded in architectural and enterprise deployments.

Cloud Computing 98

Cloud Computing Architecture Cloud Transportation 98

Precisely

JUNE 6, 2023

At Precisely’s Trust ’23 conference, Chief Operating Officer Eric Yau hosted an expert panel discussion on modern data architectures. The group kicked off the session by exchanging ideas about what it means to have a modern data architecture. Conventional architectures simply cannot deliver that because they’re too rigid.

Data Architecture 52

Data Architecture Architecture Metadata Data Lake 52

KDnuggets

APRIL 5, 2023

Learn about Apache Kafka architecture and its implementation using a real-world use case of a taxi booking app.

Kafka 106

Kafka Architecture Data Architecture Building 106

Uber Engineering

JULY 27, 2021

At its core, we capture a consumer’s intent and fulfill it by matching it with the right … The post Uber’s Fulfillment Platform: Ground-up Re-architecture to Accelerate Uber’s Go/Get Strategy appeared first on Uber Engineering Blog.

Architecture 139

Architecture Engineering IT 139

Databand.ai

AUGUST 30, 2023

DataOps Architecture: 5 Key Components and How to Get Started Ryan Yackel August 30, 2023 What Is DataOps Architecture? A DataOps architecture is the structural foundation that supports the implementation of DataOps principles within an organization. As a result, they can be slow, inefficient, and prone to errors.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

Cloudera

JUNE 27, 2023

The way to achieve this balance is by moving to a modern data architecture (MDA) that makes it easier to manage, integrate, and govern large volumes of distributed data. This is no less crucial today, as telcos balance the needs to cut costs and improve efficiencies while delivering innovative products and services.

Data Architecture 62

Data Architecture Architecture Data Governance Government 62

Monte Carlo

FEBRUARY 21, 2023

Enter data fabric: a data management architecture designed to serve the needs of the business, not just those of data engineers. A data fabric is an architecture and associated data products that provide consistent capabilities across a variety of endpoints spanning multiple cloud environments. Table of Contents What is a data fabric?

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Monte Carlo

FEBRUARY 21, 2023

Enter data fabric: a data management architecture designed to serve the needs of the business, not just those of data engineers. A data fabric is an architecture and associated data products that provide consistent capabilities across a variety of endpoints spanning multiple cloud environments. Table of Contents What is a data fabric?

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Monte Carlo

DECEMBER 20, 2023

So what is the optimal data observability architecture or data quality coverage strategy? The best data observability architecture is a deployed one Just like oftentimes the best decision is a decision that actually gets made, the best data observability architecture is often the one that lets you get started quickly.

Architecture 40

Architecture Data Datasets Machine Learning 40

Data Engineering Podcast

AUGUST 27, 2021

The team at Cinchy are working to bring about a new paradigm of software architecture that puts the data as the central element. Can you describe the technical architecture of the Cinchy platform? How has the architecture and design of the system evolved to reflect that updated understanding?

Data Integration 100

Data Integration Architecture Data Warehouse Data Lake 100

Confluent

SEPTEMBER 19, 2023

Discover the top 5 best practices for building event-driven architectures using Confluent and AWS Lambda. Learn how to optimize your architecture for scalability, reliability, and performance.

AWS 67

AWS Architecture Building 67

Confluent

NOVEMBER 18, 2020

This blog post presents the use cases and architectures of REST APIs and Confluent REST Proxy, and explores a new management API and improved integrations into Confluent Server and Confluent […].

Architecture 125

Architecture Kafka Management Data Governance 125

Confluent

NOVEMBER 25, 2019

Potential advantages of hybrid cloud architectures include avoiding vendor lock-in, increasing system resilience, optimizing costs, and inducing price competition among cloud providers. Hybrid cloud architectures require the ability to securely […].

Architecture 98

Architecture Cloud Systems 98

Yelp Engineering

MARCH 2, 2023

This blog post will explain why we made these changes, describe the new architecture we implemented, and share some of the lessons we learned along. To achieve this, we made some significant changes to our internal deployment model for React pages in late 2019.

Architecture 64

Architecture Engineering 64

Data Engineering Podcast

MARCH 9, 2020

In this episode Tim Ward describes an architecture that he has used successfully with multiple organizations to scale compliance. Upcoming events include the Software Architecture Conference in NYC, Strata Data in San Jose, and PyCon US in Pittsburgh. Can you start by giving an overview of the goals of a data hub architecture?

Data Governance 100

Data Governance Government Architecture Data 100

U-Next

SEPTEMBER 9, 2022

The JVM architecture in Java uses a Just-In-Time (JIT) compiler to compile Java bytecode into native machine code on the fly. By understanding the basics of the JVM architecture , developers can create code that is portable and efficient. The post JVM Architecture Explained appeared first on Jigsaw Academy. Conclusion .

Architecture 40

Architecture Java Programming Language Programming 40

Towards Data Science

FEBRUARY 20, 2023

How well does it answer your business needs? Dilemma of a choice. Continue reading on Towards Data Science »

Architecture 79

Architecture Data Science Data Data Architecture 79

KDnuggets

MAY 11, 2022

The objective of data mesh is to establish coherence between data coming from different domains across an enterprise. The domains are handled autonomously to eliminate the challenges of data availability and accessibility for cross-functional teams.

Architecture 118

Architecture Data Management Management Data 118

AltexSoft

AUGUST 29, 2023

This article explains what a data lake is, its architecture, and diverse use cases. Instead of relying on traditional hierarchical structures and predefined schemas, as in the case of data warehouses, a data lake utilizes a flat architecture. An example of a data lake architecture. Data warehouse vs. data lake in a nutshell.

Data Lake 52

Data Lake Architecture IT Amazon Web Services 52

Confluent

AUGUST 25, 2021

To effectively use ksqlDB, the streaming database for Apache Kafka®, you should of course be familiar with its features and syntax. However, a deeper understanding of what goes on underneath […].

Architecture 144

Architecture Kafka Database IT 144

Rockset

JUNE 14, 2022

In this 30 minute video overview, CTO and Rockset Co-founder Dhruba Borthakur discusses Rockset's ALT architecture , how data is ingested, stored and queried in Rockset, and why Rockset is simple to use, incredibly fast, and capable of the highly efficient execution of complex distributed queries across diverse data sets.

Architecture 52

Architecture Lambda Architecture Hadoop Database 52

Rockset

APRIL 26, 2023

We’ve noticed many common patterns across streaming data architectures and we’ll be sharing a blueprint for three of the most popular: anomaly detection, IoT, and recommendations. Our example architecture for anomaly detection will leverage both historical data and website activity to search for suspiciously low transaction counts.

Architecture 52

Architecture Transportation Data Lake Insurance 52

Confluent

MAY 12, 2023

With Confluent Cloud, Loggi migrated to an event-driven architecture, powering real-time analytics, boosting productivity, and cutting costs.

Architecture 57

Architecture Designing Engineering Cloud 57