ProjectPro

JUNE 6, 2025

AWS DevOps Architecture AWS DevOps tools 1. AWS DevOps Architecture Implementing DevOps on AWS facilitates the integration of your organization's tasks by leveraging infrastructure-as-code services like AWS Cloud Development Kit (CDK) and AWS CloudFormation. Table of Contents What is DevOps? What is AWS? What is AWS DevOps?

AWS 65

AWS Architecture Amazon Web Services Certification 65

ProjectPro

JUNE 6, 2025

Explore what is a RAG architecture, understand its components, and see real-world applications from tech giants like Google, Amazon, Microsoft, etc. Despite its promising potential, building a RAG architecture can be challenging due to its recent emergence in the field of Generative AI. Table of Contents What is RAG Architecture?

Architecture 52

Architecture Data Ingestion Google Cloud AWS 52

ProjectPro

JUNE 6, 2025

Deep learning architectures are at the forefront of transforming artificial intelligence (AI) by introducing innovative capabilities. Deep learning architectures have led to remarkable advancements in applications like image recognition and natural language processing , revolutionizing how machines interact with and interpret information.

Deep Learning 60

Deep Learning Architecture Medical Data 60

Edureka

MAY 27, 2025

What Constitutes the Microsoft Fabric Architecture’s Fundamental Elements? What Are the Core Components of Microsoft Fabric Architecture? The architecture of Microsoft Fabric is based on several essential elements that work together to simplify data processes: 1.

Architecture 52

Architecture BI Data Lake Business Intelligence 52

Teradata

MAY 30, 2025

Register now Home Insights Artificial Intelligence Article Build a Data Mesh Architecture Using Teradata VantageCloud on AWS Explore how to build a data mesh architecture using Teradata VantageCloud Lake as the core data platform on AWS. The data mesh architecture Key components of the data mesh architecture 1.

AWS 52

AWS Architecture Building Amazon Web Services 52

ArcGIS

JUNE 13, 2025

Learn how to manage enterprise geodatabase upgrades in ArcGIS service-based architectures. Understand when upgrades are needed, which client to use, and how to apply them using ArcGIS Pro or ArcGIS Enterprise.

Architecture 52

Architecture Management Data Management Data 52

ProjectPro

JUNE 6, 2025

The result was Apache Iceberg, a modern table format built to handle the scale, performance, and flexibility demands of today’s cloud-native data architectures. Apache Iceberg Architecture 1. Let us explore that its architecture to answer that. Let us explore more about it. Table of Contents What is Apache Iceberg?

Architecture 40

Architecture Data Lake Metadata Cloud Storage 40

ProjectPro

JUNE 6, 2025

Apache Spark Streaming Use Cases Spark Streaming Architecture: Discretized Streams Spark Streaming Example in Java Spark Streaming vs. Structured Streaming Spark Streaming Structured Streaming What is Kafka Streaming? We will understand the architecture of Spark(discretized streams) in detail. Table of Contents What is Spark streaming?

Architecture 45

Architecture Kafka Java Scala 45

Scott Logic

JUNE 10, 2025

In this episode, I dive into the world of Event-Driven Architecture (EDA) with Tom Fairbairn from Solace and Scott Logic’s Gordon Campbell. The discussion explores whether EDA has matured beyond the hype into a practical strategy for modern systems integration, or if it’s just another architectural buzzword.

Architecture 52

Architecture Data Integration Retail Finance 52

ProjectPro

JUNE 6, 2025

Yet, understanding them means digging into the nitty-gritty of Hive architecture. However, it's not merely enough to acknowledge these figures; rather, delving into the details of Hive architecture becomes crucial for unlocking their true potential. Table of Contents Understanding Hive Architecture: What is Hive?

Big Data 40

Big Data Architecture Project Hadoop 40

ProjectPro

JUNE 6, 2025

This blog acts as an Azure Data Lake architecture tutorial as it discusses what is Azure Data Lake, the Azure Data Lake architecture and its key components to help you better understand the various features of the Azure Data Lake architecture. What is Azure Data Lake ?

Data Lake 40

Data Lake Big Data Architecture Cloud 40

ProjectPro

JUNE 6, 2025

This blog will give you an in-depth knowledge of what is a data pipeline and also explore other aspects such as data pipeline architecture, data pipeline tools, use cases, and so much more. Features of a Data Pipeline Data Pipeline Architecture How to Build an End-to-End Data Pipeline from Scratch? What is a Big Data Pipeline?

Data Pipeline 40

Data Pipeline Architecture Kafka Data Lake 40

Precisely

JANUARY 9, 2025

In the beginning, there was a data warehouse The data warehouse (DW) was an approach to data architecture and structured data management that really hit its stride in the early 1990s. Data marts soon evolved as a core part of a DW architecture to eliminate this noise. financial reporting, customer analytics, supply chain management).

Data Integration 119

Data Integration Hadoop Data Warehouse Data Lake 119

Jesse Anderson

MAY 5, 2025

Shane diagrams Monte Carlo’s architecture, explaining how it uses agents, metadata, and query logs to provide lineage and monitor data health across complex stacks (Snowflake, Databricks, etc.). We then dive deep into Monte Carlo Data, defining data observability and the crucial concept of “data downtime” (TTD + TTR).

Unstructured Data 130

Unstructured Data Finance Metadata Architecture 130

databricks

JUNE 11, 2025

Lakebase introduces a new architecture for Postgres, that includes separation of compute and storage for independent scaling and branching. They give organizations the confidence that their data architecture won’t be locked into a single vendor or platform. Lakebases share the same architecture.

Entertainment 81

Entertainment Data Lake Manufacturing Consulting 81

ProjectPro

JUNE 6, 2025

However, if you're here to choose between Kafka vs. RabbitMQ, we would like to tell you this might not be the right question to ask because each of these big data tools excels with its architectural features, and one can make a decision as to which is the best based on the business use case. What is Kafka? Why Kafka vs RabbitMQ ?

Kafka 72

Kafka Java Big Data Architecture 72

The Pragmatic Engineer

NOVEMBER 29, 2024

The last 12 months, The Pragmatic Engineer covered a variety of deepdives, revealing previously unshared details like: * What Stripe's engineering culture is like * The architecture evolution of Bluesky * How the ChatGPT scaled to meet demand * How Anthropic builds products * How and why hardware startup Oxide built two new computers from

Engineering 141

Engineering Architecture Building Computer Science 141

The Pragmatic Engineer

OCTOBER 10, 2023

We originally built M3 to support Uber’s scale on a microservices/container (cloud native) architecture. It was that very architecture that created the scale, reliability, performance and cost-efficiency challenges. None of the existing vendors had built and optimized for a cloud-native architecture.

Software Engineer 324

Software Engineer Software Engineering Architecture Media 324

Data Engineering Podcast

FEBRUARY 18, 2024

And Starburst does all of this on an open architecture with first-class support for Apache Iceberg, Delta Lake and Hudi, so you always maintain ownership of your data. What are the technical/architectural/UX challenges that have hindered the progression of lakehouses? Want to see Starburst in action? Want to see Starburst in action?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Jesse Anderson

FEBRUARY 11, 2025

We delve into the architecture of Kuzu, an embedded graph database designed for high performance, exploring its unique storage format, query planning techniques like Sideway Information Passing (SIP), and the rationale behind its schema-based approach.

Computer Science 130

Computer Science Database Design Software Engineer Software Engineering 130

Yelp Engineering

JANUARY 21, 2025

At Yelp, we encountered challenges that prompted us to enhance the training time of our ad-revenue generating models, which use a Wide and Deep Neural Network architecture for predicting ad click-through rates (pCTR). These models handle large tabular datasets with small parameter spaces, requiring innovative data solutions.

Datasets 104

Datasets Architecture Data Solutions Data 104

Start Data Engineering

SEPTEMBER 18, 2024

Data flow architecture 3. Define SLAs so stakeholders know what to expect 3.1.4. Define checks to ensure the output dataset is usable 3.2. Identify what tool to use to process data 3.3.

Building 240

Building Project Datasets Architecture 240

Snowflake

APRIL 2, 2025

Data storage has been evolving, from databases to data warehouses and expansive data lakes, with each architecture responding to different business and data needs. Traditional databases excelled at structured data and transactional workloads but struggled with performance at scale as data volumes grew.

Data Lake 97

Data Lake Cloud Storage Metadata Data Warehouse 97

Snowflake

NOVEMBER 12, 2024

As part of Snowflake Unistore , Hybrid Tables unify both transactional and analytical workloads on a single database to simplify architectures as well as governance and security. Today we're thrilled to announce the general availability of Hybrid Tables in all AWS commercial regions (with a few exceptions ).

Food 97

Food Metadata Education Data Architect 97

Data Engineering Weekly

DECEMBER 28, 2024

The debate around table formats and Lakehouse architectures continues, but the focus is on unifying data ecosystems to enable AI-driven insights. The shift towards intelligent data platforms will continue, with enterprises seeking to seamlessly integrate structured and unstructured data, ensuring quality, governance, and trustworthiness.

Unstructured Data 112

Unstructured Data Metadata Government Data 112

Towards Data Science

JANUARY 30, 2025

Methodology I used LeNet-5 as my model architecture. Experiment with how model architecture impacts the performance of data pruning strategies. Then using one of the strategies below I pruned the training dataset of MNIST and trained a model. Testing was done against the full testset. Full code and results available here onGitHub.

Database-centric 106

Database-centric Datasets Data Architecture 106

databricks

JUNE 11, 2025

160 Spear Street, 15th Floor San Francisco, CA 94105 1-866-330-0121 See Careers at Databricks © Databricks 2025.

Entertainment 98

Entertainment Manufacturing Consulting Retail 98

Cloudera

OCTOBER 10, 2024

The open data lakehouse is quickly becoming the standard architecture for unified multifunction analytics on large volumes of data. The Road Ahead The features we are launching in Cloudera Lakehouse Optimizer solve two very important challenges for companies who want to move to an open data lakehouse architecture.

IT 84

IT Data Lake Metadata Data Warehouse 84

Precisely

JANUARY 30, 2025

Metadata maturity is key to a strong foundation Metadata management maturity is growing in importance, especially with the rise of new data management architectures like data mesh (which takes a decentralized approach) and data fabric (which takes a unified approach).

Data Governance 103

Data Governance Government Metadata Data 103

Confessions of a Data Guy

JANUARY 30, 2025

When it comes to building modern Lake House architecture, we often get stuck in the past, doing the same old things time after time. We are human; we are lemmings; it’s just the trap we fall into. Usually, that pit we fall into is called Spark. Now, don’t get me wrong; I love Spark.

AWS 100

AWS Architecture Building IT 100

ProjectPro

JUNE 6, 2025

‘Man and machine together can be better than the human’ All thanks to deep learning frameworks like PyTorch, Tensorflow, Keras, Caffe, and DeepLearning4j for making machines learn like humans with special brain-like architectures known as Neural Networks. Tensorflow is in a relationship with TF 2.0

Deep Learning 97

Deep Learning Machine Learning Programming Language Python 97

Cloudera

JANUARY 7, 2025

Leveraging Clouderas hybrid architecture, the organization optimized operational efficiency for diverse workloads, providing secure and compliant operations across jurisdictions while improving response times for public health initiatives. This transition streamlined data analytics workflows to accommodate significant growth in data volumes.

Cloud 82

Cloud Government AWS Unstructured Data 82