Scott Logic

JUNE 16, 2023

During the final stages of development, we introduced key stakeholders from Interop.io. However, we maintained ongoing conversations over Slack, which allowed us to exchange information, address queries, and maintain awareness of their progress. Although Connectifi, Sail and OpenFin were part of the project, their 2.0

Finance 52

Finance Programming Certification Project 52

LinkedIn Engineering

JULY 19, 2023

This unification is crucial for simplifying lakehouse management, organizing data for optimal query performance, instituting governance, and declarative metadata management - all to provide an enhanced developer experience. Unfortunately, there is currently no system in open source that unifies them through a single control plane.

Big Data 78

Big Data Data Management Management Metadata 78

DoorDash Engineering

FEBRUARY 7, 2023

DoorDash’s expansion from food delivery into new verticals like convenience and grocery introduced a number of new business challenges that would need to be supported by our technical stack. Our team’s goal was to utilize CockroachDB to build a scalable and reliable backend service that could fully support our business.

PostgreSQL 119

PostgreSQL Retail SQL Database 119

Rockset

MAY 3, 2023

Rockset is a database used for real-time search and analytics on streaming data. Throughput measures the rate at which data is processed, impacting the database's ability to efficiently support high-velocity data streams. In this blog, we’ll walk through the benchmark framework, configuration and results.

Data Ingestion 59

Data Ingestion Kafka Database Architecture 59

DoorDash Engineering

JANUARY 23, 2024

Our logistics teams — which range across a number of functions, including Dashers, assignment, payment processes, and time estimations — seek to achieve these goals by tuning a variety of configurations for each use case and type of business. This reduces time and effort to manage configuration and also avoids forgetting to revert.

Architecture 74

Architecture Metadata Bytes Systems 74

Lyft Engineering

MARCH 27, 2023

This allowed us to see what happened if we increased the queries per second or number of connections even further. This approach involved custom code, and we quickly realized several issues — it was difficult and costly in time to create and restore huge database backups (this actually required a support ticket with our vendor each time).

Coding 131

Coding Database Systems Engineering 131

Zalando Engineering

JUNE 23, 2020

we have implemented couple of new interesting features , including connection pooling support. Let's try to dig into the topic, and take a look at the performance aspect of connection pooler support, mostly from a scaling perspective. Introduction In the new Postgres Operator release 1.5 But first let's make an introduction.

PostgreSQL 52

PostgreSQL Bytes Database SQL 52

phData: Data Engineering

JANUARY 3, 2022

This commonly introduces: Database or Data Warehouse API/EDI Integrations ETL software Business intelligence tooling By leveraging off-the-shelf tooling, your company separates disciplines by technology. The separate disciplines begin to slow down due to the complexity and dependencies that have resulted over time.

IT 52

IT AWS Software Engineer Software Engineering 52

Rockset

AUGUST 27, 2019

DynamoDB partition keys Given the simplicity in using DynamoDB, a developer can get pretty far in a short time. As we mentioned before, DynamoDB is a NoSQL datastore, which means the operations it supports efficiently are GET (by primary key or index) and PUT. These partitions are all managed automatically and not exposed to the user.

NoSQL 40

NoSQL Relational Database AWS Retail 40

ProjectPro

JULY 27, 2021

This blog is your one-stop solution for the top 100+ Data Engineer Interview Questions and Answers. In this blog, we have collated the frequently asked data engineer interview questions based on tools and technologies that are highly useful for a data engineer in the Big Data industry. Takes less time for query execution.

Data Engineering 40

Data Engineering Data Engineer Engineering Hadoop 40

Confluent

SEPTEMBER 20, 2019

This has changed over time, and we’d like to share some tips on how you can go about choosing the best option. This blog post goes over: The complexities that users will run into when self-managing Apache Kafka on the cloud and how users can benefit from building event streaming applications with a fully managed service for Apache Kafka.

Kafka 21

Kafka Management Cloud AWS 21

Monte Carlo

MAY 17, 2023

In less than three years it has gone from an idea sketched out in a Barr Moses blog post to climbing the Gartner Hype Cycle for Emerging Technology. Query Change Detection 11. Query Simplification 12. Profile Data Save Time 18. Save Data Engineer’s Time 19. Save Data Analyst And Data Scientist’s Time 21.

Data 52

Data Data Pipeline Data Engineering Data Engineer 52

Monte Carlo

MAY 17, 2023

In less than three years it has gone from an idea sketched out in a Barr Moses blog post to climbing the Gartner Hype Cycle for Emerging Technology. Query change detection 11. Query simplification 12. Profile data Save Time 18. Save data engineer’s time 19. Save data analyst and data scientist’s time 21.

Data Pipeline 52

Data Pipeline Data Data Engineering Data Engineer 52

Cloudera

FEBRUARY 22, 2021

Providing a comprehensive set of diverse analytical frameworks for different use cases across the data lifecycle (data streaming, data engineering, data warehousing, operational database and machine learning) while at the same time seamlessly integrating data content via the Shared Data Experience (SDX), a layer that separates compute and storage.

Data Warehouse 76

Data Warehouse Data Governance Government Cloud 76