article thumbnail

Patching the PostgreSQL JDBC Driver

Zalando Engineering

Postgres Logical Replication at Zalando Builders at Zalando have access to a low-code solution that allows them to declare event streams that source from Postgres databases. In Postgres, the Write Ahead Log (WAL) is a strictly ordered sequence of events that have occurred in the database.

article thumbnail

Postgres Aurora DB major version upgrade with minimal downtime

Lyft Engineering

Upgrading the database in-place would have resulted in ~30 mins of downtime. Considered Upgrade Approaches In-place upgrade This is the simplest method to upgrade the PG database. Part 2: Setup subscriber (PG13) Clone the PG10 database cluster . Photo by Frank Olsen UNDER CC BY-SA 3.0 Capture the LSN in the cloned DB.

Bytes 78
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

What is Amazon Redshift? How to use it?

Knowledge Hut

What is a column-oriented database? This type of database management system uses sections of columns instead of rows to store the data. Other benefits of reducing a column-oriented database are that the need for joins is reduced and queries are resolved quickly. It is based on PostgreSQL 8.0.2’s

IT 52
article thumbnail

BPFAgent: eBPF for Monitoring at DoorDash

DoorDash Engineering

We also have an unmarshalling function to convert the raw bytes from the kernel into our structure. sk) { return 0; } u64 key = (u64)sk; struct source *src; src = bpf_map_lookup_elem(&socks, &key); When capturing the connection close event, we include how many bytes were sent and received over the connection.

Bytes 84
article thumbnail

PgBouncer on Kubernetes and how to achieve minimal latency

Zalando Engineering

Why do we quite often need a connection pooler for PostgreSQL (and in fact for many other databases too)? At the moment for PostgreSQL there are couple of available options (listed in no particular order): PgBouncer Pgpool-II Odyssey pgagroal PgBouncer is probably the most popular and the oldest solution.

article thumbnail

15 Essential Java Full Stack Developer Skills in 2024

Knowledge Hut

This type of developer works with the Full stack of a software application, beginning with Front end development and going through back-end development, Database, Server, API, and version controlling systems. Databases and Web Storage Full stack developer skills in Java would have to include good learning of databases and Web Storage.

Java 98
article thumbnail

Kafka Connect Deep Dive – JDBC Source Connector

Confluent

One of the most common integrations that people want to do with Apache Kafka ® is getting data in from a database. That is because relational databases are a rich source of events. The existing data in a database, and any changes to that data, can be streamed into a Kafka topic. Bytes, Decimals, Numerics and oh my.

Kafka 86