Remove tag pinterest
article thumbnail

Improving Efficiency Of Goku Time Series Database at Pinterest (Part?—?1)

Pinterest Engineering

Initial Architecture For Goku Short Term Ingestion Figure 1: Old push based ingestion pipeline into GokuS At Pinterest, we have a sidecar metrics agent running on every host that logs the application system metrics time series data points (metric name, tag value pairs, timestamp and value) into dedicated kafka topics.

article thumbnail

Migrating Policy Delivery Engines with (almost) Nobody Knowing

Pinterest Engineering

Jeremy Krach | Staff Security Engineer, Platform Security Background Several years ago, Pinterest had a short incident due to oversights in the policy delivery engine. Pinterest provides a wrapper service around OPA in order to manage policy distribution, agent configuration metrics, logging, and simplified APIs.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

PinCompute: A Kubernetes Backed General Purpose Compute Platform for Pinterest

Pinterest Engineering

At Pinterest, we are evolving our compute platform to provide an application-centric and fully managed compute API for the 90th percentile of use cases. We refer to this next generation compute platform as PinCompute, and our multi-year vision is for PinCompute to run the most mission critical applications and services at Pinterest.

article thumbnail

Analyzing Time Series for Pinterest Observability

Pinterest Engineering

Brian Overstreet | Software Engineer, Observability; Humsheen Geo | Software Engineer, Observability Time series is a critical part of Observability at Pinterest, powering 60,000 alerts and 5,000 dashboards. This blog post describes TScript and how we use it at Pinterest. Performing operations on the returned time series.

article thumbnail

Build Your Analytics With A Collaborative And Expressive SQL IDE Using Querybook

Data Engineering Podcast

Frustrated with the lack of a modern IDE and collaborative workflow for managing the SQL queries and analysis of their big data environments, the team at Pinterest created Querybook. The tag line calls out the fact that Querybook is an IDE for "big data" What are the manifestations of that focus in the feature set and user experience?

SQL 100
article thumbnail

Watch your Manifest

Pinterest Engineering

At Pinterest, however, we have been actively monitoring the manifest after realizing it does change every so often. The PR developer must then adjust the snapshot manifest if the changes are necessary, or add the proper “remove” tags to keep the new components out of the final manifest. If a difference is detected, we fail the build.

article thumbnail

Top Tech Stack Startups in United States

Knowledge Hut

It is a structure that has sections, bulleted points, and tables that can be used to create with HTML tags. Pinterest A creative web-based application that has come a long way to explore the lifestyle sections like recipes, home ideas, style inspiration, and many others is Pinterest. CSS- The stylist of the webpage is the CSS.

MongoDB 52