Lyft Engineering

NOVEMBER 29, 2023

Druid at Lyft Apache Druid is an in-memory, columnar, distributed, open-source data store designed for sub-second queries on real-time and historical data. Druid enables low latency (real-time) data ingestion, flexible data exploration and fast data aggregation resulting in sub-second query latencies.

Kafka 104

Kafka Data Ingestion Datasets Architecture 104

Knowledge Hut

MARCH 20, 2024

An Azure Data Engineer is a professional specializing in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. They possess expertise in various aspects of data engineering. As an Azure data engineer myself, I was responsible for managing data storage, processing, and analytics.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Governance 52

Knowledge Hut

MARCH 15, 2024

An Azure Data Engineer is a professional specializing in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. They possess expertise in various aspects of data engineering. As an Azure data engineer myself, I was responsible for managing data storage, processing, and analytics.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Governance 52

Rockset

APRIL 18, 2023

Rockset offers a number of benefits along with vector search support to create relevant experiences: Real-Time Data: Ingest and index incoming data in real-time with support for updates. Feature Generation: Transform and aggregate data during the ingest process to generate complex features and reduce data storage volumes.

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105

DareData

JANUARY 30, 2023

In this post, we'll discuss some key data engineering concepts that data scientists should be familiar with, in order to be more effective in their roles. These concepts include concepts like data pipelines, data storage and retrieval, data orchestrators or infrastructure-as-code.

Data Engineering 52

Data Engineering Data Engineer NoSQL Engineering 52

AltexSoft

SEPTEMBER 21, 2023

Speed and performance Speed and performance are foundational to Elasticsearch’s appeal, setting it apart from traditional data storage and retrieval systems. With native integrations for major cloud platforms like AWS, Azure, and Google Cloud, sending data to Elastic Cloud is straightforward.

Engineering 52

Engineering NoSQL Programming Language Java 52

ProjectPro

FEBRUARY 8, 2023

Smooth Integration with other AWS tools AWS Glue is relatively simple to integrate with data sources and targets like Amazon Kinesis, Amazon Redshift, Amazon S3, and Amazon MSK. It is also compatible with other popular data storage that may be deployed on Amazon EC2 instances.

AWS 98

AWS Scala Metadata Data Lake 98