Sun.Jun 09, 2024

article thumbnail

X-Ray Vision For Your Flink Stream Processing With Datorios

Data Engineering Podcast

Summary Streaming data processing enables new categories of data products and analytics. Unfortunately, reasoning about stream processing engines is complex and lacks sufficient tooling. To address this shortcoming Datorios created an observability platform for Flink that brings visibility to the internals of this popular stream processing system. In this episode Ronen Korman and Stav Elkayam discuss how the increased understanding provided by purpose built observability improves the usefulness

Process 147
article thumbnail

Why we should care about process by Dave Ogle

Scott Logic

Self-Organizing Teams One of the principles behind the Manifesto for Agile Software Development is: “The best architectures, requirements, and designs emerge from self-organizing teams.” It’s a simple statement but it hides a big idea. The first and maybe most obvious question is, “What is a self-organizing team?” The Scrum guide has this to say: “Self-organizing teams choose how best to accomplish their work, rather than being directed by others outside the team.

Process 52
article thumbnail

What is a System Engineer? Skills, Roles and Responsibilities

Knowledge Hut

Systems engineering is a diverse field of information technology engineering and engineering management that focuses on the design and administration of composite systems throughout their life cycles. In the complex digital world, the systems engineer is critical because they identify the customer's or stakeholder demands and a system's fundamental performance in the early phases of a service or product development cycle.

Systems 52