article thumbnail

Patching the PostgreSQL JDBC Driver

Zalando Engineering

Introduction This blog post describes a recent contribution from Zalando to the Postgres JDBC driver to address a long-standing issue with the driver’s integration with Postgres’ logical replication that resulted in runaway Write-Ahead Log (WAL) growth. However as you may imagine, this blog post concerns a path that is anything but happy.

article thumbnail

Staying in the Zone: How DoorDash used a service mesh to manage  data transfer, reducing hops and cloud spend

DoorDash Engineering

In this blog post, we describe the journey DoorDash took using a service mesh to realize data transfer cost savings without sacrificing service quality. Storage traffic: Includes traffic from microservices to stateful systems such as Aurora PostgreSQL, CockroachDB, Redis, and Kafka.

Bytes 84
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Postgres Aurora DB major version upgrade with minimal downtime

Lyft Engineering

This blog would be of immense help to understand what happens under the hood with AWS blue/green deployment! Footnotes ¹ PostgreSQL: Documentation: 16: 49.2. Logical Decoding Concepts ² Cloning a volume for an Amazon Aurora DB cluster ³ PostgreSQL: Documentation: 16: Chapter 50. The diff_bytes is 0 now!

Bytes 78
article thumbnail

Launching the Engineering Blog

Zalando Engineering

Our Engineering Blog was launched in June 2020 after a long break of the previous tech blog. What customizations we applied to design the blog and the publishing process. Static Site Generator Our previous tech blog used a CMS which only a limited number of people had access to. So which static site generator to choose?

article thumbnail

BPFAgent: eBPF for Monitoring at DoorDash

DoorDash Engineering

For a more detailed introduction to BPF portability and CO-RE, see Andrii Nakryiko’s blog post on the subject. We also have an unmarshalling function to convert the raw bytes from the kernel into our structure. The post BPFAgent: eBPF for Monitoring at DoorDash appeared first on DoorDash Engineering Blog.

Bytes 84
article thumbnail

PgBouncer on Kubernetes and how to achieve minimal latency

Zalando Engineering

Why do we quite often need a connection pooler for PostgreSQL (and in fact for many other databases too)? At the moment for PostgreSQL there are couple of available options (listed in no particular order): PgBouncer Pgpool-II Odyssey pgagroal PgBouncer is probably the most popular and the oldest solution. Why is that?

article thumbnail

HDFS Data Encryption at Rest on Cloudera Data Platform

Cloudera

sent 11,286 bytes received 172 bytes 2,546.22 However, we can continue without enabling TLS for the purpose of this blog. Ranger KMS supports MySQL, Postgresql as well as Oracle. The post HDFS Data Encryption at Rest on Cloudera Data Platform appeared first on Cloudera Blog. keytrustee ccycloud-3.cdpvcb.root.hwx.site:/var/lib/keytrustee/.

MySQL 70