The Modern Data Company

MAY 8, 2023

Data lakes, data warehouses, data hubs, data lakehouses, and data operating systems are data management and storage solutions designed to meet different needs in data analytics, integration, and processing. See it in action and schedule a demo with one of our data experts today.

Data Management 52

Data Management Data Lake Management Data Governance 52

The Modern Data Company

MAY 8, 2023

Data lakes, data warehouses, data hubs, data lakehouses, and data operating systems are data management and storage solutions designed to meet different needs in data analytics, integration, and processing. See it in action and schedule a demo with one of our data experts today.

Data Management 52

Data Management Data Lake Management Data Governance 52

The Modern Data Company

MAY 8, 2023

Data lakes, data warehouses, data hubs, data lakehouses, and data operating systems are data management and storage solutions designed to meet different needs in data analytics, integration, and processing.

Data Management 52

Data Management Data Lake Management Data Governance 52

DataKitchen

MAY 10, 2024

The Five Use Cases in Data Observability: Effective Data Anomaly Monitoring (#2) Introduction Ensuring the accuracy and timeliness of data ingestion is a cornerstone for maintaining the integrity of data systems. This process is critical as it ensures data quality from the onset.

Data Ingestion 40

Data Ingestion Transportation High Quality Data Data Schemas 40

DataKitchen

MAY 10, 2024

This use case is vital for organizations that rely on accurate data to drive business operations and strategic decisions. Data Ingestion Continuous monitoring during data ingestion ensures that updates to existing data sources are accurate and consistent.

Data Ingestion 40

Data Ingestion Datasets Data Coding 40

Snowflake

APRIL 18, 2024

Legacy SIEM cost factors to keep in mind Data ingestion: Traditional SIEMs often impose limits to data ingestion and data retention. Snowflake allows security teams to store all their data in a single platform and maintain it all in a readily accessible state, with virtually unlimited cloud data storage capacity.

Data Lake 76

Data Lake Data Ingestion Bytes Cloud Computing 76

Rockset

MARCH 1, 2023

When you deconstruct the core database architecture, deep in the heart of it you will find a single component that is performing two distinct competing functions: real-time data ingestion and query serving. When data ingestion has a flash flood moment, your queries will slow down or time out making your application flaky.

Data Ingestion 144

Data Ingestion Database Architecture Cloud Storage 144

Data Engineering Podcast

NOVEMBER 20, 2022

In this episode CEO and founder Salma Bakouk shares her views on the causes and impacts of "data entropy" and how you can tame it before it leads to failures. report having current investments in automation, 85% of data teams plan on investing in automation in the next 12 months. In fact, while only 3.5%

Data Lake 130

Data Lake Data Ingestion MongoDB Scala 130

Data Engineering Podcast

JULY 23, 2023

In this episode he explains how investing in high performance and operationally simplified streaming with a familiar API can yield significant benefits for software and data teams together. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Building 130

Building SQL Machine Learning Data Ingestion 130

Rockset

MARCH 21, 2019

When we started Rockset, we envisioned building a powerful cloud data management system that was really easy to use. Making the data stack simpler is fundamental to making data usable by developers and data scientists. The data management should feel limitless.

SQL 52

SQL Data Management Management Engineering 52

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode she shares the story behind the project, the details of how it is implemented, and how you can use it for your own data projects. report having current investments in automation, 85% of data teams plan on investing in automation in the next 12 months. In fact, while only 3.5% That’s where our friends at Ascend.io

MongoDB 130

MongoDB Scala MySQL Data Lake 130

Databand.ai

AUGUST 30, 2023

DataOps is a collaborative approach to data management that combines the agility of DevOps with the power of data analytics. It aims to streamline data ingestion, processing, and analytics by automating and integrating various data workflows.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

Data Engineering Podcast

JUNE 12, 2022

In this episode Rod Christensen shares the story behind Aparavi and how you can use it to cut costs and gain value for the long tail of your unstructured data. report having current investments in automation, 85% of data teams plan on investing in automation in the next 12 months. In fact, while only 3.5% In fact, while only 3.5%

Unstructured Data 130

Unstructured Data MongoDB Scala MySQL 130

Data Engineering Weekly

MARCH 24, 2024

[link] Freshworks: Modernizing analytics data ingestion pipeline from legacy engine to distributed processing engine The article discusses Freshworks' journey in modernizing its analytics data platform to handle increasing volumes of data efficiently.

Data Engineering 62

Data Engineering Data Engineer Engineering Metadata 62

Databand.ai

AUGUST 30, 2023

DataOps , short for data operations, is an emerging discipline that focuses on improving the collaboration, integration, and automation of data processes across an organization. These tools help organizations implement DataOps practices by providing a unified platform for data teams to collaborate, share, and manage their data assets.

Data Cleanse 52

Data Cleanse Data Pipeline Data Ingestion Data Validation 52

Cloudera

NOVEMBER 1, 2023

The connector makes it easy to update the LLM context by loading, chunking, generating embeddings, and inserting them into the Pinecone database as soon as new data is available. High-level overview of real-time data ingest with Cloudera DataFlow to Pinecone vector database.

Machine Learning 107

Machine Learning Data Ingestion Database Architecture 107

Knowledge Hut

APRIL 23, 2024

Big Data Training online courses will help you build a robust skill-set working with the most powerful big data tools and technologies. Big Data vs Small Data: Velocity Big Data is often characterized by high data velocity, requiring real-time or near real-time data ingestion and processing.

Big Data 52

Big Data Datasets Data Analysis Media 52

Lyft Engineering

NOVEMBER 29, 2023

Druid at Lyft Apache Druid is an in-memory, columnar, distributed, open-source data store designed for sub-second queries on real-time and historical data. Druid enables low latency (real-time) data ingestion, flexible data exploration and fast data aggregation resulting in sub-second query latencies.

Kafka 104

Kafka Data Ingestion Datasets Architecture 104

Data Engineering Podcast

AUGUST 21, 2022

In this episode Shruti Bhat gives her view on the state of the ecosystem for real-time data and the work that she and her team at Rockset is doing to make it easier for engineers to build those experiences. report having current investments in automation, 85% of data teams plan on investing in automation in the next 12 months.

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Data Engineering Podcast

JUNE 19, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

Metadata 130

Metadata MongoDB Scala MySQL 130

Data Engineering Podcast

JULY 17, 2022

In this episode Joe Reis, founder of Ternary Data and co-author of "Fundamentals of Data Engineering", turns the tables and interviews the host, Tobias Macey, about his journey into podcasting, how he runs the show behind the scenes, and the other things that occupy his time. In fact, while only 3.5% Links Podcast.__init__

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Data Engineering Podcast

NOVEMBER 13, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

MongoDB 100

MongoDB Scala MySQL Google Cloud 100

Ascend.io

AUGUST 29, 2023

Just as every play and position in baseball is key to a win, each component of a data pipeline is integral to effective data management. Similarly , in data, every step of the pipeline, from data ingestion to delivery, plays a pivotal role in delivering impactful results.

Data Pipeline 52

Data Pipeline Pipeline-centric Database-centric Data Ingestion 52

Databand.ai

AUGUST 30, 2023

The DataOps framework is a set of practices, processes, and technologies that enables organizations to improve the speed, accuracy, and reliability of their data management and analytics operations. This can be achieved through the use of automated data ingestion, transformation, and analysis tools.

Data Governance 52

Data Governance Data Pipeline Government Data Cleanse 52

Data Engineering Podcast

OCTOBER 30, 2022

In this episode he shares his experiences working with organizations to adopt analytics engineering patterns and the ways that Optimus and dbt were combined to let data analysts deliver insights without the roadblocks of complex pipeline management. Interview Introduction How did you get involved in the area of data management?

Engineering 100

Engineering MongoDB Scala MySQL 100

Data Engineering Podcast

AUGUST 13, 2022

In this episode Shinji Kim discusses the challenges of data discovery and how to collect and preserve additional context about each piece of information so that you can find what you need when you don’t even know what you’re looking for yet. In fact, while only 3.5% That’s where our friends at Ascend.io In fact, while only 3.5%

Metadata 100

Metadata MongoDB Scala MySQL 100

Data Engineering Podcast

OCTOBER 23, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

Database 100

Database MySQL Cloud MongoDB 100

Data Engineering Podcast

JULY 24, 2022

Summary The current stage of evolution in the data management ecosystem has resulted in domain and use case specific orchestration capabilities being incorporated into various tools. In this episode Nick Schrock discusses the importance of orchestration and a central location for managing data systems, the road to Dagster’s 1.0

MongoDB 100

MongoDB Scala MySQL Data Lake 100

Data Engineering Podcast

OCTOBER 16, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

Data Lake 100

Data Lake Food MongoDB Scala 100

Data Engineering Podcast

SEPTEMBER 25, 2022

In this episode Mark Van de Wiel explains how they integrated CDC functionality into their existing product, discusses the nuances of different approaches to change data capture from various sources. report having current investments in automation, 85% of data teams plan on investing in automation in the next 12 months.

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

SEPTEMBER 11, 2022

In this episode he shares his journey from building a consumer product to launching a data pipeline service and how his frustrations as a product owner have informed his work at Hevo Data. report having current investments in automation, 85% of data teams plan on investing in automation in the next 12 months.

Data Pipeline 130

Data Pipeline Building MongoDB Scala 130

Data Engineering Podcast

SEPTEMBER 18, 2022

He discusses the challenges of making data collection purposeful and efficient without distracting employees from their primary duties and how business owners can use the provided analytics to support their staff in their duties. In fact, while only 3.5% That’s where our friends at Ascend.io Closing Announcements Thank you for listening!

Hospitality 100

Hospitality Food MongoDB Scala 100

Data Engineering Podcast

JUNE 5, 2022

In this episode Sean Falconer explains the idea of a data privacy vault and how this new architectural element can drastically reduce the potential for making a mistake with how you manage regulated or personally identifiable information. In fact, while only 3.5% That’s where our friends at Ascend.io

Data Security 100

Data Security Metadata MongoDB Scala 100

Data Engineering Podcast

MAY 29, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

Architecture 100

Architecture Database Data Architecture PostgreSQL 100

Data Engineering Podcast

AUGUST 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

Building 100

Building MongoDB Scala MySQL 100

Data Engineering Podcast

JULY 31, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. In fact, while only 3.5%

Data Analysis 100

Data Analysis MongoDB Scala Algorithm 100

Cloudera

AUGUST 4, 2021

Using a scalable data management and analytics platform built on Cloudera Enterprise, Sikorsky can process and store data in a reliable way, and analyze full data sets across entire fleets. images, video, text, spectral data) or other input such as thermographic or acoustic signals. .

Unstructured Data 98

Unstructured Data Data Ingestion Government Machine Learning 98