Christophe Blefari

MAY 12, 2023

Sorting the news ( credits ) Hey you, new Friday means Data News. I hope you will enjoy it as much as me. You can listen the episode on Spotify , Apple Podcast and Deezer. We had 3 talks, that you can find on YouTube. This week is pretty stacked in term of content, especially video / audio content.

Data 130

Data Data Storage SQL Coding 130

Christophe Blefari

SEPTEMBER 1, 2023

If you want a first glimpse of the Dagster code, you can look at it on Github , not yet documented but commits messages are clean. Data News is back, but with the same recipe: a weekly newsletter to let you catch up on the previous weeks' articles. — Ari catalogs the kind of tests you can write with dbt.

Food 130

Food Data SQL Python 130

Cloudera

APRIL 1, 2024

Cloudera has over 25 Exabytes of high-value business data under management, making us one of the larger data hyperscalers in this MQ. Cloudera has over 25 Exabytes of high-value business data under management, making us one of the larger data hyperscalers in this MQ.

Cloud 102

Cloud Unstructured Data Metadata Datasets 102

Christophe Blefari

NOVEMBER 18, 2023

I hope you will enjoy the selection. I hope you will enjoy the selection. Not sure there are still free seats, but if you want to come reach me. Mainly they announced GPTs , a no-code UI to create custom versions of ChatGPT. It was a necessary break for me and a blank page syndrome at the same time.

Food 147

Food Data Data Lake Retail 147

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The problems that are easiest to fix are the ones that you prevent from happening in the first place. In this episode CEO and founder Salma Bakouk shares her views on the causes and impacts of "data entropy" and how you can tame it before it leads to failures.

Data Lake 130

Data Lake Data Ingestion MongoDB Scala 130

Cloudera

JANUARY 31, 2024

Streams Replication Manager (SRM) is an enterprise-grade replication solution that enables fault tolerant, scalable, and robust cross-cluster Kafka topic replication. Introduction Kafka as an event streaming component can be applied to a wide variety of use cases. This makes it difficult to manage multiple clusters.

Management 69

Management Kafka Big Data Cloud 69

Towards Data Science

FEBRUARY 9, 2024

Ideal for those new to data systems or language model applications, this project is structured into two segments: This initial article guides you through constructing a data pipeline utilizing Kafka for streaming, Airflow for orchestration, Spark for data transformation, and PostgreSQL for storage. Overview of the data pipeline.

Kafka 76

Kafka Data Engineering Data Engineer PostgreSQL 76

Cloudera

NOVEMBER 27, 2023

Flink Forward is a great opportunity to learn about the cutting edge of streaming and stream processing technologies. This blog is a summary of what we observed there for anyone who was unable to attend or just wants to stay on top of what’s happening in streaming. Flink is, relatively speaking, a newer technology.

Kafka 80

Kafka SQL ETL Tools Data Lake 80

Data Engineering Podcast

JUNE 19, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

Metadata 130

Metadata MongoDB Scala MySQL 130

Cloudera

MAY 1, 2023

Businesses everywhere have engaged in modernization projects with the goal of making their data and application infrastructure more nimble and dynamic. release of Cloudera’s SQL Stream Builder (available on CDP Public Cloud 7.2.16 All of these resources together make up the project. What is a Project in SSB?

SQL 77

SQL Project Kafka Accessible 77

Snowflake

NOVEMBER 28, 2023

Maxa unifies multiple ERP and data systems into a single stream of pre-computed financial, operational and supply chain insights that are ready to be consumed by business users and executives. The technical and manual labor required to make sense of ERP data and answer business analytical needs is intensive.

Finance 80

Finance Government Accessible Accessibility 80

Snowflake

FEBRUARY 21, 2023

In this Q&A, we hear from Nico Acosta, CEO and Co-Founder of Propel, about how his company is building an API platform to equip developers to build with data, and why data architecture is the most important technical decision a company will make. What inspires you as a founder? We want to change that. APIs do just that.

AWS 116

AWS Raw Data Building Architecture 116

Data Engineering Podcast

SEPTEMBER 25, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Setup takes 30 minutes.

Food 100

Food MongoDB Scala MySQL 100

Snowflake

DECEMBER 12, 2023

If you missed the event or need a refresh of what was presented, watch any Snowday session on demand. Iceberg Tables also make it easier and cheaper to onboard without requiring upfront ingestion. Let’s dive into all new releases in September, October and November. Learn more about Iceberg Tables here. Learn more here.

Metadata 84

Metadata Python AWS Government 84

Snowflake

NOVEMBER 15, 2023

Join our two-day virtual global conference and learn how to build with the app dev innovations you heard about at Snowflake Summit and Snowday. We have more demos and hands-on virtual labs than ever before—and you won’t find a bunch of slideware here. Here are five reasons why this year’s global virtual summit is a must-attend: 1.

Building 105

Building Accessible Accessibility IT 105

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode she shares the story behind the project, the details of how it is implemented, and how you can use it for your own data projects. RudderStack helps you build a customer data platform on your warehouse or data lake. No more shipping and praying, you can now know exactly what will change in your database!

MongoDB 130

MongoDB Scala MySQL Data Lake 130

Scott Logic

APRIL 21, 2024

but what if you are still using a 2.4.x If you go through the pain of updating to the latest version, what do you gain? Apache Spark SQL has gone through a major evolution, now supporting ANSI SQL, and adding many new features and making many performance improvements. Apache Spark has now reached version 3.5.1,

Scala 52

Scala Java SQL Python 52

Knowledge Hut

DECEMBER 28, 2023

When planning to take the next step towards making a career in UI/UX design, salary is an essential parameter which you might be exploring. You enjoy every bit of this profession and are enthusiastic about the success that may yield to you - but on the career front, salary and other benefits can narrow down your job hunt.

Designing 52

Designing Portfolio Education Consulting 52

Data Engineering Podcast

JUNE 12, 2022

Aparavi was created to tame the sprawl of information across machines, datacenters, and clouds so that you can reduce the amount of duplicate data and save time and money on managing your data assets. Summary Unstructured data takes many forms in an organization. And don’t forget to thank them for their continued support of this show!

Unstructured Data 130

Unstructured Data MongoDB Scala MySQL 130

Data Engineering Podcast

AUGUST 21, 2022

In this episode Shruti Bhat gives her view on the state of the ecosystem for real-time data and the work that she and her team at Rockset is doing to make it easier for engineers to build those experiences. The biggest challenge with modern data systems is understanding what data you have, where it is located, and who is using it.

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Lyft Engineering

JUNE 28, 2023

However, streaming data was not supported as a first-class citizen across many of the platform’s systems — such as training, complex monitoring, and others. However, streaming data was not supported as a first-class citizen across many of the platform’s systems — such as training, complex monitoring, and others.

Machine Learning 115

Machine Learning Building Metadata Kafka 115

Netflix Tech

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. Engineers want their alerting system to be realtime, reliable, and actionable. It allows us to overcome high dimensionality/cardinality limitations of the time-series database.

Database 115

Database Architecture Consulting Systems 115

Netflix Tech

NOVEMBER 29, 2023

We were, however, missing the systematic ability to measure perceptual quality ( VMAF ) of HDR streams since VMAF was limited to standard dynamic range (SDR) video signals. The arrival of HDR-VMAF allowed us to create HDR streams with DO applied, i.e., HDR-DO encodes. By June 2023 the entire HDR catalog was optimized.

Metadata 100

Metadata Electronics Algorithm Software Engineer 100

Cloudera

AUGUST 10, 2022

Cloudera has a strong track record of providing a comprehensive solution for stream processing. Cloudera Stream Processing (CSP), powered by Apache Flink and Apache Kafka, provides a complete stream management and stateful processing solution. Cloudera Stream Processing Community Edition.

Process 87

Process Kafka PostgreSQL MySQL 87

Knowledge Hut

APRIL 18, 2023

you should know that React.js It simplifies the development of complicated user interfaces by letting developers design reusable UI components. is lightweight, efficient, and can take many concurrent connections, making it a popular choice for building scalable web applications. When it comes to React vs Node.js While Node.js

Architecture 97

Architecture Database Coding Programming 97

Data Engineering Podcast

SEPTEMBER 11, 2022

Summary Any business that wants to understand their operations and customers through data requires some form of pipeline. With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Data Pipeline 130

Data Pipeline Building MongoDB Scala 130

Knowledge Hut

DECEMBER 26, 2023

A BCA makes you adept at the technology application level, whereas a BTech (Bachelor of Technology) makes you skilled at the technical level. A BCA is the minimum certification or degree requirement you must have to break into the tech world. After completing this degree, you can go into various career streams.

Certification 92

Certification Consulting Java Data Science 92

Cloudera

FEBRUARY 9, 2023

Cloudera Stream Processing aims to take real-time data analytics to the next level. We’re excited to highlight job monitoring with notifications, a new feature for SQL Stream Builder (SSB). Overview In SSB you can manage multiple projects. What problem are we solving with job notifications?

SQL 79

SQL Kafka Aggregated Data Architecture 79

Data Engineering Podcast

OCTOBER 23, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Setup takes 30 minutes.

Database 100

Database MySQL Cloud MongoDB 100

Data Engineering Podcast

NOVEMBER 13, 2022

To make that possible they need a reliable data platform that empowers all of the organization’s stakeholders. With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

MongoDB 100

MongoDB Scala MySQL Google Cloud 100

Knowledge Hut

DECEMBER 26, 2023

Whether you want to learn something for fun or to further your career, there is sure to be an Online Course that is right for you.  These courses are typically self-paced and can be taken at any time, making them convenient for busy students. What are Online Courses ? Reasons to Learn Online Courses  in 2024 1.

Certification 95

Certification Java Google Cloud Education 95

LinkedIn Engineering

AUGUST 3, 2023

As I worked closely with iOS, I wanted to learn everything I could about the UI and dedicated my time to coding files and researching how to build apps. As my interest in UI grew, I began searching for a new role aligned with my app development passion. While interviewing for the role, my manager, Neeta, impressed me so much.

Building 68

Building Software Engineer Software Engineering Computer Science 68

Data Engineering Podcast

OCTOBER 9, 2022

Summary For any business that wants to stay in operation, the most important thing they can do is understand their customers. You wake up to a Slack message from your CEO, who’s upset because the company’s revenue dashboard is broken. You can literally get up and running with Metaplane by the end of this podcast.

Food 100

Food MongoDB Scala MySQL 100

Cloudera

JULY 18, 2022

In part 1 of this blog we discussed how Cloudera DataFlow for the Public Cloud (CDF-PC), the universal data distribution service powered by Apache NiFi, can make it easy to acquire data from wherever it originates and move it efficiently to make it available to other applications in a streaming fashion. Data decays!

Process 87

Process Kafka Scala SQL 87

Data Engineering Podcast

OCTOBER 16, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Setup takes 30 minutes.

Data Lake 100

Data Lake Food MongoDB Scala 100

Monte Carlo

FEBRUARY 20, 2024

At the heart of every data-driven decision is a deceptively simple question: How do you get the right data to the right place at the right time? One thing’s for certain: you definitely don’t want to be writing pipelines in Python anymore. Times have changed and there are better ways of doing things now.

Data Ingestion 52

Data Ingestion Google Cloud Kafka AWS 52

Data Engineering Podcast

SEPTEMBER 18, 2022

Summary In order to improve efficiency in any business you must first know what is contributing to wasted effort or missed opportunities. RudderStack helps you build a customer data platform on your warehouse or data lake. And don’t forget to thank them for their continued support of this show!

Hospitality 100

Hospitality Food MongoDB Scala 100