The Pragmatic Engineer

JULY 20, 2023

Venture funding is on a downward trend , and we seem to be at the start – or the middle – of a “startup purge” event. This news is hot off the press, publicly announced by Postman and by Akita yesterday, and you are among the early ones to hear about this event. We pivoted to API observability in 2020.

Building 198

Building Programming Language Programming Python 198

Knowledge Hut

FEBRUARY 29, 2024

Event handling essentially allows the user to interact with a webpage and do something specific when a certain event like a click or a hover happens. When the user interacts with the application, events are fired, for example, mouseover, key press, change event, and so on. React events are written in camelCase.

Python 52

Python Coding Certification IT 52

LinkedIn Engineering

OCTOBER 19, 2023

Authors: Bingfeng Xia and Xinyu Liu Background At LinkedIn, Apache Beam plays a pivotal role in stream processing infrastructures that process over 4 trillion events daily through more than 3,000 pipelines across multiple production data centers.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Snowflake

SEPTEMBER 12, 2023

Data Cloud Industry Day 2023 is a free virtual event on September 28, 2023, dedicated to what’s possible for you and your industry in the world of data. The event will feature industry-specific sessions hosted by Snowflake’s industry leaders along with exciting customer guest speakers. Attendance at this event is totally FREE.

Cloud 86

Cloud Manufacturing Retail Healthcare 86

Data Engineering Podcast

JANUARY 28, 2024

Summary Monitoring and auditing IT systems for security events requires the ability to quickly analyze massive volumes of unstructured log data. The majority of products that are available either require too much effort to structure the logs, or aren't fast enough for interactive use cases.

Data Lake 147

Data Lake Building High Quality Data AWS 147

Confluent

NOVEMBER 30, 2022

Putting Apache Kafka To Use: A Practical Guide to Building an Event Streaming Platform.

Kafka 104

Kafka Building Process 104

Data Engineering Podcast

APRIL 16, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. How have the recent breakthroughs in large language models (LLMs) improved your ability to build features in Zenlytic? Who are the target users?

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Confluent

DECEMBER 7, 2022

Learn how to build a real-time streaming application using Apache Kafka® and.NET producer and consumer clients.

Building 57

Building Kafka Process 57

Data Engineering Podcast

MARCH 5, 2023

It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. By bringing all the layers of the data stack together, TimeXtender helps you build data solutions up to 10 times faster and saves you 70-80% on costs. What do you have planned for the future of this topic at Data Council events?

Building 147

Building Database Design Metadata Machine Learning 147

Data Engineering Podcast

OCTOBER 15, 2023

Summary Building streaming applications has gotten substantially easier over the past several years. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. How can you get the best results for your use case?

Process 182

Process Building SQL BI 182

Scott Logic

APRIL 18, 2024

You build something! From the main IAP web app (the admin app), the user clicks a button, which sends a request to AWS CodeBuild through the SDK, triggering a build. Developers can configure build jobs, and then CodeBuild runs the build scripts, without needing to configure servers.

AWS 52

AWS Building Consulting Architecture 52

Data Engineering Podcast

JUNE 11, 2023

Summary Data engineering is all about building workflows, pipelines, systems, and interfaces to provide stable and reliable data. In this episode Gleb Mezhanskiy shares some valuable advice and insights into how you can build reliable and well-tested data assets with dbt and data-diff. RudderStack also supports real-time use cases.

Project 130

Project Building Data Lake Machine Learning 130

Knowledge Hut

APRIL 25, 2023

In this article, we will look at how a scrum master facilitates events such as daily scrum meetings, sprint planning, sprint review, and sprint retrospective meetings. They lead the team through the Scrum process, making sure that everyone is involved and that all events are carried out successfully.

Utilities 70

Utilities Project Certification Process 70

dbt Developer Hub

NOVEMBER 3, 2022

Let’s discuss how to convert events from an event-driven microservice architecture into relational tables in a warehouse like Snowflake. We use Snowflake as our data warehouse where we build dashboards both for internal use and for customers. So our solution was to start using an intentional contract: Events.

Kafka 52

Kafka ETL Tools BI Database 52

Workfall

SEPTEMBER 26, 2023

Reading Time: 9 minutes In this blog, we will cover: What are Server-Sent Events? Why Stream Data Using Server-Sent Events (SSE)? Hands-On Conclusion What are Server-Sent Events? These events can carry information like notifications, updates, or alerts. What is FastAPI?

Python 85

Python Bytes Coding Data 85

Snowflake

NOVEMBER 15, 2023

BUILD 2023 is where AI gets real. Join our two-day virtual global conference and learn how to build with the app dev innovations you heard about at Snowflake Summit and Snowday. As always, BUILD is created by builders, for builders, so you’ll find plenty to spark your interest and boost your skill set.

Building 103

Building Accessible Accessibility IT 103

Confluent

SEPTEMBER 21, 2022

A deep dive into how microservices work, why it’s the backbone of real-time applications, and how to build event-driven microservices applications with Python and Kafka.

Kafka 98

Kafka Python Building 98

Towards Data Science

FEBRUARY 9, 2024

How to build a modern, scalable data platform to power your analytics and data science projects (updated) Table of Contents: What’s changed? Orchestration I mentioned modularity as a core concept of building a modern data platform in my 2021 article, but I failed to emphasize the importance of data orchestration.

Building 81

Building Transportation Data Lake Metadata 81

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. In this article, we will explore the advantages and limitations of data mesh, while also providing best practices for building and optimizing a data mesh with Striim.

Architecture 52

Architecture Generalist Government Datasets 52

Workfall

JUNE 27, 2023

In this blog, we’ll explore how to harness the power of Kafka to streamline event streaming within a microservices architecture and unlock its full potential for building scalable and responsive systems. In the event of server failure, Kafka can autonomously restart itself, ensuring uninterrupted data flow. Let’s get started!

Kafka 75

Kafka Architecture AWS Transportation 75

Knowledge Hut

APRIL 16, 2024

Going for CSM certification training and knowing how to build a self-organizing team as a Scrum master will help you get trained well. Most Agile-Scrum organizations emphasize on building the self-organizing team - why? How Do You Build a Self-Organizing Team as a Scrum Master?

Building 78

Building Certification Project Management 78

Confluent

AUGUST 2, 2023

Learn how to combine Lambda and Confluent to build event-driven serverless applications.

Building 52

Building AWS Cloud 52

Data Engineering Podcast

AUGUST 10, 2020

Summary Event based data is a rich source of information for analytics, unless none of the event structures are consistent. The team at Iteratively are building a platform to manage the end to end flow of collaboration around what events are needed, how to structure the attributes, and how they are captured.

Data Collection 100

Data Collection Data Engineering Data Engineer Education 100

Confluent

DECEMBER 14, 2021

This oft-talked-about architecture has no shortage of blog posts, conference talks, podcasts, and discussions. One thing that you may have found lacking is a concrete guide on precisely […].

Building 128

Building Architecture Data 128

Confluent

SEPTEMBER 11, 2023

See how you can leverage a data streaming platform to build event-driven microservices and do stream processing for faster, better customer onboarding.

Cloud 67

Cloud Building Process Data 67

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode Nick King discusses how you can be intentional about data creation in your applications and services to reduce the friction and errors involved in building data products and ML applications. What are the organizational patterns that are required to support effective workflows for building data generation capabilities?

Building 130

Building IT Metadata MongoDB 130

Snowflake

APRIL 17, 2024

In today’s data-driven world, developer productivity is essential for organizations to build effective and reliable products, accelerate time to value, and fuel ongoing innovation. Or, experience these features firsthand at our free Dev Day event on June 6th in the Demo Zone.

Data Pipeline 99

Data Pipeline Python Data Engineering Data Engineer 99

Precisely

DECEMBER 28, 2023

This article explores what streaming data pipelines are, how they work, and how to build this data pipeline architecture. Streaming data pipelines, by extension, offer an architecture capable of handling large volumes of data, accommodating millions of events in near real time. That’s where streaming data pipelines come into play.

Data Pipeline 91

Data Pipeline Building Kafka Big Data 91

Confluent

NOVEMBER 25, 2020

The event provided an opportunity for participants to learn, build, and showcase […]. As part of this year’s Kafka Summit, the Confluent Community team hosted a community hackathon named Kafkathon 2020.

Kafka 104

Kafka Building 104

Lyft Engineering

JUNE 28, 2023

On the flip side, there was a substantial appetite to build real-time ML systems from developers at Lyft. The Event Driven Decisions capability in particular turned out to be general enough as to be applicable to a wide range of use cases. One key component is the Analytics Event Abstraction layer.

Machine Learning 115

Machine Learning Building Metadata Software Engineer 115

Pinterest Engineering

JANUARY 4, 2024

In order to build a distributed and replicated service using RocksDB, we built a real time replicator library: Rocksplicator. Maintaining these disparate systems and building common functionality among them was adding a huge overhead to the teams. RocksDB is a single node key value store.

Database 76

Database Building Datasets Relational Database 76

Engineering at Meta

MAY 16, 2023

Over the last few years, we have implemented MySQL Raft, a Raft consensus engine that was integrated with MySQL to build a replicated state machine. The MySQL transactions would be encoded as a series of events (e.g., Update Rows event) with a start and end for each transaction. On a primary, Raft would write to a binlog.

MySQL 136

MySQL Building Engineering Database 136

Confluent

NOVEMBER 30, 2022

This guide will contain specific advice on how to go about building an event streaming platform in your organization. This is the second part of our guide on streaming data and Apache Kafka.

Kafka 52

Kafka Building Data Process 52

Workfall

SEPTEMBER 12, 2023

This makes it a powerful tool for building interactive and dynamic web applications that require instant data exchange between clients and servers, such as chat applications, online gaming, collaborative tools, and more. Its user-friendly API simplifies development, embracing an event-driven structure for custom interactions.

Building 89

Building MongoDB Programming Language Coding 89

Snowflake

OCTOBER 2, 2023

To help customers overcome these challenges, RudderStack and Snowflake recently launched Profiles , a new product that allows every data team to build a customer 360 directly in their Snowflake Data Cloud environment. Now teams can leverage their existing data engineering tools and workflows to build their customer 360.

Cloud 96

Cloud Building Insurance Data Engineering 96

LinkedIn Engineering

AUGUST 3, 2023

As I worked closely with iOS, I wanted to learn everything I could about the UI and dedicated my time to coding files and researching how to build apps. While browsing one day, I found an opportunity at LinkedIn for a software engineer on the events team. For example, if I wanted to learn more about what's happening in the U.S.

Building 68

Building Software Engineer Software Engineering Computer Science 68

KDnuggets

NOVEMBER 30, 2021

Learn best practice guidelines for building AI solutions responsibly. Join AI experts from Microsoft and BCG at Put Responsible AI into Practice—a free Azure digital event on December 7.

Building 104

Building 104