Remove tag microservice-architecture
article thumbnail

How DoorDash Migrated from StatsD to Prometheus

DoorDash Engineering

Challenges Faced With StatsD StatsD was a great asset for our early observability needs, but we began encountering constraints such as losing metrics during surge events, difficulties with naming/standardized tags, and a lack of reporting tools. We’ll briefly introduce StatD’s history before diving into those specific issues.

AWS 82
article thumbnail

Scalable Annotation Service?—?Marken

Netflix Tech

Our team, Asset Management Platform, decided to create a generic service called Marken which allows any microservice at Netflix to annotate their entity. Annotations Sometimes people describe annotations as tags but that is a limited definition. An annotation must be associated with some entity which belongs to some microservice.

Algorithm 113
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

A Complete Guide to Scale Your Data Pipelines and Data Products with Contract Testing and Dbt

Towards Data Science

Not too long ago, almost all data architectures and data team structures followed a centralized approach. Centralized data architecture developed and maintained by one team The proliferation of use cases and data sources increased the complexity of managing data and the amount of people needed to create and maintain data systems.

article thumbnail

Building a Control Plane for Lyft’s Shared Development Environment

Lyft Engineering

in microservice architectures. Lyft runs hundreds of microservices to power the company’s offerings. Our team, the Developer Infrastructure team, aims to build the best tools to enable microservice owners (our “customers”) to reliably and quickly test changes in a local and/or end-to-end environment.

article thumbnail

Improved Alerting with Atlas Streaming Eval

Netflix Tech

High Level Architecture The idea, at a high level, was to avoid the need to query the Atlas database almost entirely and transition most alert queries to streaming evaluation. First and foremost, we have successfully alleviated our initial scalability problem with the polling based architecture. OK, Results?

Database 115
article thumbnail

PinCompute: A Kubernetes Backed General Purpose Compute Platform for Pinterest

Pinterest Engineering

In this article, we discuss the PinCompute primitives, architecture, control plane and data plane capabilities, and showcase the value that PinCompute has delivered for innovation and efficiency at Pinterest. Architecture PinCompute is a regional Platform-as-a-Service (PaaS) that builds on top of Kubernetes.

article thumbnail

Platform Engineering and Third Generation Microservices in Dublin

Zalando Engineering

They presented on topics ranging from multi-lingual analysis of fashion content, image tagging with TensorFlow , to infrastructure for model hierarchies. In combination with a microservices architecture , it’s proving a viable way to spin up new teams to solve new problems and maintain consistent team sizes.