KDnuggets

FEBRUARY 16, 2022

How to Learn Math for Machine Learning; Data Mesh & Its Distributed Data Architecture; 5 Ways to Apply AI to Small Data Sets; Top 5 Free Machine Learning Courses; Junior Data Scientist: The Next Level.

Machine Learning 102

Machine Learning Data Architecture Architecture IT 102

Monte Carlo

APRIL 16, 2022

The data warehouse is the foundation of the modern data stack, so it caught our attention when we saw Convoy head of data Chad Sanderson declare, “ the data warehouse is broken ” on LinkedIn. I’ll let you decide for yourself if the “immutable data warehouse” (or active vs passive ETL) is the right path for your data team.

Data Warehouse 52

Data Warehouse Architecture Data Government 52

Propel Data

OCTOBER 13, 2022

Developers looking to learn about event-driven architectures.

Architecture 52

Architecture Data Analytics Data 52

Propel Data

NOVEMBER 14, 2022

Learn the key AWS services to implement a performant and cost-effective serverless event-driven architecture.

AWS 52

AWS Architecture Data Analytics Data 52

KDnuggets

MAY 19, 2022

Read the best books on Programming, Statistics, Data Engineering, Web Scraping, Data Analytics, Business Intelligence, Data Applications, Data Management, Big Data, and Cloud Architecture.

Data Science 160

Data Science Business Intelligence Big Data Architecture 160

Data Engineering Podcast

MAY 15, 2022

Summary Designing a data platform is a complex and iterative undertaking which requires accounting for many conflicting needs. Designing a platform that relies on a data lake as its central architectural tenet adds additional layers of difficulty. Missing data? Struggling with broken pipelines? Stale dashboards?

Data Lake 100

Data Lake Building BI Architecture 100

Data Engineering Podcast

AUGUST 21, 2022

Summary Data has permeated every aspect of our lives and the products that we interact with. In this episode Shruti Bhat gives her view on the state of the ecosystem for real-time data and the work that she and her team at Rockset is doing to make it easier for engineers to build those experiences.

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Confluent

DECEMBER 2, 2022

ksqlDB use case: see how apps can use ksqlDB to ingest, filter, enrich, aggregate, and query data directly with Kafka—no complex architectures or data stores needed.

Kafka 144

Kafka Building Architecture Data 144

Cloudera

JUNE 7, 2022

We live in a hybrid data world. In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB.

IT 109

IT Unstructured Data Data Architecture Government 109

Data Engineering Podcast

MAY 1, 2022

Summary Building a data platform is an iterative and evolutionary process that requires collaboration with internal stakeholders to ensure that their needs are being met. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Warehouse 100

Data Warehouse Data Lake Architecture Data 100

Data Engineering Podcast

MAY 22, 2022

Summary Machine learning has become a meaningful target for data applications, bringing with it an increase in the complexity of orchestrating the entire data flow. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Machine Learning 130

Machine Learning Data Engineering Data Engineer Cloud 130

Data Engineering Podcast

NOVEMBER 13, 2022

Summary CreditKarma builds data products that help consumers take advantage of their credit and financial capabilities. To make that possible they need a reliable data platform that empowers all of the organization’s stakeholders. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code.

MongoDB 100

MongoDB Scala MySQL Google Cloud 100

Data Engineering Podcast

SEPTEMBER 25, 2022

Summary Data integration from source systems to their downstream destinations is the foundational step for any data product. With the increasing expecation for information to be instantly accessible, it drives the need for reliable change data capture. Data teams are increasingly under pressure to deliver.

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

OCTOBER 16, 2022

Summary The "data lakehouse" architecture balances the scalability and flexibility of data lakes with the ease of use and transaction support of data warehouses. Enter Metaplane, the industry’s only self-serve data observability tool. Data teams are increasingly under pressure to deliver.

Data Lake 100

Data Lake Food MongoDB Scala 100

Data Engineering Podcast

OCTOBER 9, 2022

In this episode Purvi Shah, the VP of Enterprise Big Data Platforms at American Express, explains how they have invested in the cloud to power this visibility and the complex suite of integrations they have built and maintained across legacy and modern systems to make it possible. Data teams are increasingly under pressure to deliver.

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

OCTOBER 9, 2022

Summary The core of any data platform is the centralized storage and processing layer. For many that is a data warehouse, but in order to support a diverse and constantly changing set of uses and technologies the data lakehouse is a paradigm that offers a useful balance of scale and cost, with performance and ease of use.

Metadata 100

Metadata AWS MongoDB MySQL 100

KDnuggets

JUNE 8, 2022

21 Cheat Sheets for Data Science Interviews; Top 18 Data Science Group on LinkedIn; A Beginner's Guide to Q Learning; 3 Ways Understanding Bayes Theorem Will Improve Your Data Science; Machine Learning Is Not Like Your Brain Part 3: Fundamental Architecture.

Data Science 111

Data Science Machine Learning Architecture Data 111

Cloudera

AUGUST 11, 2022

But information broadly, and the management of data specifically, is still “the” critical factor for situational awareness, streamlined operations, and a host of other use cases across today’s tech-driven battlefields. . Universal Data Distribution Solves DoD Data Transport Challenges.

Transportation 91

Transportation Data Ingestion Architecture Data 91

Cloudera

SEPTEMBER 15, 2022

Cloudera Contributor: Mark Ramsey, PhD ~ Globally Recognized Chief Data Officer. July brings summer vacations, holiday gatherings, and for the first time in two years, the return of the Massachusetts Institute of Technology (MIT) Chief Data Officer symposium as an in-person event. Luke: What is a modern data platform?

Data Lake 80

Data Lake Analytics Application Cloud Storage Architecture 80

Confluent

MARCH 9, 2022

Imagine your team wants to design a data streaming architecture and you’re in charge of creating the prototype. Within a few minutes, you provision a fully managed Apache Kafka® cluster […].

Kafka 123

Kafka Cloud Architecture Designing 123

Data Engineering Podcast

JUNE 12, 2022

Summary Unstructured data takes many forms in an organization. From a data engineering perspective that often means things like JSON files, audio or video recordings, images, etc. Another category of unstructured data that every business deals with is PDFs, Word documents, workstation backups, and countless other types of information.

Unstructured Data 130

Unstructured Data MongoDB Scala MySQL 130

Data Engineering Podcast

NOVEMBER 6, 2022

Summary Despite the best efforts of data engineers, data is as messy as the real world. Entity resolution and fuzzy matching are powerful utilities for cleaning up data from disconnected sources, but it has typically required custom development and training machine learning models.

MongoDB 130

MongoDB Scala MySQL Data Lake 130

Data Engineering Podcast

JUNE 5, 2022

Summary The best way to make sure that you don’t leak sensitive data is to never have it in the first place. The team at Skyflow decided that the second best way is to build a storage system dedicated to securely managing your sensitive information and making it easy to integrate with your applications and data systems.

Data Security 100

Data Security Metadata MongoDB Scala 100

Jesse Anderson

DECEMBER 12, 2022

They were the first companies to commercialize open source big data technologies and pushed the marketing and commercialization of Hadoop. With an immutable file system like HDFS, we needed scalable databases to read and write data randomly. Apache Kafka came in 2011 and gave the industry a much better way to move real-time data.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

Cloudera

OCTOBER 19, 2022

The telecommunications industry continues to develop hybrid data architectures to support data workload virtualization and cloud migration. With multiple speaking tracks focusing on technology, networks, and data & AI, industry leaders repeatedly highlighted the hybrid nature of their infrastructure. .

Cloud 78

Cloud Telecommunication Data Governance Government 78

Cloudera

JUNE 18, 2022

Cloudera customers run some of the biggest data lakes on earth. These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. On data warehouses and data lakes. But with vastly different architectural worldviews.

Data Lake 91

Data Lake Data Warehouse BI SQL 91

Data Engineering Podcast

JUNE 26, 2022

Summary The most complicated part of data engineering is the effort involved in making the raw data fit into the narrative of the business. Master Data Management (MDM) is the process of building consensus around what the information actually means in the context of the business and then shaping the data to match those semantics.

Data Management 100

Data Management Management MongoDB Scala 100

Data Engineering Podcast

SEPTEMBER 11, 2022

Summary Any business that wants to understand their operations and customers through data requires some form of pipeline. Building reliable data pipelines is a complex and costly undertaking with many layered requirements. Data stacks are becoming more and more complex. Sifflet also offers a 2-week free trial.

Data Pipeline 130

Data Pipeline Building MongoDB Scala 130

Data Engineering Podcast

APRIL 16, 2022

Summary Putting machine learning models into production and keeping them there requires investing in well-managed systems to manage the full lifecycle of data cleaning, training, deployment and monitoring. Acryl Data provides DataHub as an easy to consume SaaS product which has been adopted by several companies.

Data Engineering 100

Data Engineering Data Engineer Engineering IT 100

Cloudera

JANUARY 26, 2022

Modern, real-time businesses require accelerated cycles of innovation that are expensive and difficult to maintain with legacy data platforms. The hybrid cloud’s premise—two data architectures fused together—gives companies options to leverage those solutions and to address decision-making criteria, on a case-by-case basis. .

Cloud 84

Cloud Cloud Computing Hadoop Data Warehouse 84

KDnuggets

FEBRUARY 17, 2022

Data Mesh in Action by Jacek Majchrzak, Sven Balnojan, and Marian Siwiak reveals how this new groundbreaking decentralized architecture looks for both small startups and large enterprises.

Architecture 96

Architecture Data 96

Cloudera

JULY 11, 2022

The need for data fabric. As Cloudera CMO David Moxey outlined in his blog , we live in a hybrid data world. Data is growing and continues to accelerate its growth. Cloudera data fabric and analyst acclaim. Data fabrics are one of the more mature modern data architectures. As a result, it’s getting ??progressively

Data Architecture 105

Data Architecture Architecture Data Government 105

Cloudera

FEBRUARY 23, 2022

Their processes are ‘data driven’, their networks are trending towards automation, and AI systems are powering customer engagement in store , online and at home. This is all based on an enterprise IT architecture that is integrated, data rich, and agile.

Telecommunication 91

Telecommunication Cloud Media Government 91

Cloudera

NOVEMBER 1, 2022

These systems also pose security risks, including the inability to use current security best practices, such as data encryption and multi-factor authentication, making these systems particularly vulnerable to malicious cyber activity. These are challenges that must be assessed and mitigated and ultimately resolved with data. .

Cloud 86

Cloud Government Cloud Computing Data Architecture 86

Netflix Tech

NOVEMBER 17, 2022

Encoding drastically reduces the amount of video data that needs to be streamed to your device, by leveraging spatial and temporal redundancies that exist in a video. Architecture of the deep downscaler model, consisting of a preprocessing block followed by a resizing block. Video encoding using a conventional video codec, like AV1.

Media 117

Media Architecture Algorithm Designing 117

Cloudera

MARCH 24, 2022

Critical for Techcos: Data and AI . Data and AI are key competencies and unique features for the techco. Telco as an industry has been doing big data for many, many years – far longer than even some of those leading technology providers – and has the processes and the culture of data that those teams may lack.

Telecommunication 123

Telecommunication Cloud Technology Big Data 123