Confluent

MAY 6, 2021

Today, Confluent is announcing the general availability (GA) of the fully managed MongoDB Atlas Source and MongoDB Atlas Sink Connectors within Confluent Cloud. Now, with just a few simple clicks, […].

MongoDB 52

MongoDB Cloud Management Kafka 52

Confluent

JULY 17, 2019

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers.

MongoDB 21

MongoDB Kafka Medical Database 21

Knowledge Hut

APRIL 25, 2024

There are a variety of big data processing technologies available, including Apache Hadoop, Apache Spark, and MongoDB. The most popular NoSQL database systems include MongoDB, Cassandra, and HBase. In general, Hadoop and Spark are good choices for batch processing, while Kafka and Storm are better suited for streaming applications.

Big Data 98

Big Data Technology NoSQL Hadoop 98

Rockset

SEPTEMBER 14, 2021

We’re introducing a new Rockset Integration for Apache Kafka that offers native support for Confluent Cloud and Apache Kafka, making it simpler and faster to ingest streaming data for real-time analytics. With the Kafka Integration, users no longer need to build, deploy or operate any infrastructure component on the Kafka side.

Kafka 52

Kafka SQL MongoDB Computer Science 52

Confluent

JULY 29, 2020

Change Data Capture (CDC) is an excellent way to introduce streaming analytics into your existing database, and using Debezium enables you to send your change data through Apache Kafka®. Although […].

Kafka 104

Kafka Database MongoDB Data 104

Confluent

APRIL 9, 2019

I’m excited to announce that we’re partnering with Google Cloud to make Confluent Cloud, our fully managed offering of Apache Kafka ® , available as a native offering on Google Cloud Platform (GCP). Confluent’s founders didn’t just write the original code of Apache Kafka, we also ran it as a service at massive scale.

Google Cloud 100

Google Cloud Kafka Cloud MongoDB 100

Data Engineering Podcast

AUGUST 21, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Striim

AUGUST 26, 2023

Users often have to grapple with intricate, low-level Kafka elements like topics, brokers, partitions, taking focus away from more strategic tasks. AWS MSK : An Apache Kafka-compatible managed streaming platform that also allows users to access other AWS services directly. Frequently Asked Questions What is Apache Kafka?

MongoDB 52

MongoDB Google Cloud Kafka AWS 52

Data Engineering Podcast

SEPTEMBER 11, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Data Pipeline 130

Data Pipeline Building MongoDB Scala 130

Confluent

JUNE 5, 2020

Most organisations maintain fleets, a collection of vehicles put to use for day-to-day operations. Telcos use a variety of vehicles including cars, vans, and trucks for service, delivery, and maintenance. […].

MongoDB 105

MongoDB Cloud Management Kafka 105

Rockset

JUNE 2, 2020

MongoDB World is going all virtual with MongoDB.live. If you’re short on time, fear not- here are our top 10 MongoDB sessions to watch out for: 10 Join the Data Movement: MongoDB and Apache Kafka One of the go-to picks for companies that need a streaming platform is Apache Kafka. Are REST APIs are your jam?

MongoDB 52

MongoDB Data Lake Kafka NoSQL 52

Data Engineering Podcast

DECEMBER 4, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

SEPTEMBER 25, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

AUGUST 28, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Building 100

Building MongoDB Scala MySQL 100

Data Engineering Podcast

MARCH 8, 2021

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Links Molecula Pilosa Podcast Episode The Social Dilemma Feature Store Cassandra Elasticsearch Podcast Episode Druid MongoDB SwimOS Podcast Episode Kafka Kafka (..)

IT 100

IT Data Warehouse MongoDB Kafka 100

Data Engineering Podcast

JULY 10, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

Data Engineering Podcast

AUGUST 6, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Data Engineering Podcast

AUGUST 6, 2017

Contact Information Email @rywalker on Twitter Links Astronomer Kiss Metrics Segment Marketing tools chart Clickstream HIPAA FERPA PCI Mesos Mesos DC/OS Airflow SSIS Marathon Prometheus Grafana Terraform Kafka Spark ELK Stack React GraphQL PostGreSQL MongoDB Ceph Druid Aries Vault Adapter Pattern Docker Kinesis API Gateway Kong AWS Lambda Flink Redshift (..)

PostgreSQL 100

PostgreSQL MongoDB Data Pipeline Kafka 100

Data Engineering Podcast

JANUARY 13, 2019

Contact Info Ajay @acoustik on Twitter LinkedIn Mike LinkedIn Website @michaelfreedman on Twitter Timescale Website Documentation Careers timescaledb on GitHub @timescaledb on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Database 100

Database PostgreSQL SQL MongoDB 100

Data Engineering Podcast

APRIL 19, 2020

The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA Support Data Engineering Podcast Summary Modern applications frequently require access to real-time data, but building and maintaining the systems that make that possible is a complex and time consuming endeavor.

Building 100

Building PostgreSQL MongoDB SQL 100

Data Engineering Podcast

MAY 27, 2018

It’s easy to get one started but difficult to manage as new requirements are added and greater scalability becomes necessary.

Data Pipeline 100

Data Pipeline MongoDB Scala Google Cloud 100

Rockset

AUGUST 30, 2021

Apache Kafka has made acquiring real-time data more mainstream, but only a small sliver are turning batch analytics, run nightly, into real-time analytical dashboards with alerts and automatic anomaly detection. But until this release, all these data sources involved indexing the incoming raw data on a record by record basis.

SQL 52

SQL Kafka MongoDB MySQL 52

Cloud Academy

JANUARY 27, 2022

Microsoft SQL Server Document-oriented database: MongoDB (classified as NoSQL) The Basics of Data Management, Data Manipulation and Data Modeling This learning path focuses on common data formats and interfaces. MongoDB Configuration and Setup Watch an example of deploying MongoDB to understand its benefits as a database system.

Certification 52

Certification Data Engineering Data Engineer Engineering 52

Confluent

JULY 13, 2021

In Data Science projects, we distinguish between descriptive analytics and statistical models running in production. Overall, these can be seen as one process. You start with analyzing historical data to […].

Data Analysis 138

Data Analysis Kafka Data Science Data 138

Data Engineering Podcast

FEBRUARY 11, 2018

Links Timescale PostGreSQL Citus Timescale Design Blog Post MIT NYU Stanford SDN Princeton Machine Data Timeseries Data List of Timeseries Databases NoSQL Online Transaction Processing (OLTP) Object Relational Mapper (ORM) Grafana Tableau Kafka When Boring Is Awesome PostGreSQL RDS Google Cloud SQL Azure DB Docker Continuous Aggregates Streaming Replication (..)

PostgreSQL 100

PostgreSQL NoSQL Google Cloud MongoDB 100

Rockset

NOVEMBER 9, 2021

CDC with Update Timestamps and Kafka One of the simplest ways to implement a CDC solution in both MySQL and Postgres is by using update timestamps. Kafka Connect also has connectors to target systems that can then write these records for you. To simplify this process we can use Kafka Connect.

MySQL 52

MySQL Kafka AWS Database 52

Knowledge Hut

APRIL 25, 2023

Data processing: Data engineers should know data processing frameworks like Apache Spark, Hadoop, or Kafka, which help process and analyze data at scale. MongoDB MongoDB is a NoSQL document-oriented database that is widely used by data engineers for building scalable and flexible data-driven applications.

Data Engineering 52

Data Engineering Data Engineer Engineering Google Cloud 52

Confluent

MAY 12, 2020

Imagine you’ve got a stream of data; it’s not “big data,” but it’s certainly a lot. Within the data, you’ve got some bits you’re interested in, and of those bits, […].

Kafka 141

Kafka Building Big Data MongoDB 141

Rockset

OCTOBER 13, 2022

Avoid frequent updates Modern databases like DynamoDB and MongoDB offer CDC streams. If you ever see Kafka events or Snowpipe streaming into your warehouse, just mutter son of a batch and walk away. Your stakeholders ask for fresher data. Snowflake is built for batch.

MongoDB 52

MongoDB BI Kafka Database 52

Confluent

OCTOBER 13, 2021

Machine learning on real-time data is a powerful combination because you gain direct insights into your data, can make powerful decisions, and consequently improve your business processes and outcomes. It […].

Kafka 89

Kafka Machine Learning Process MongoDB 89

Knowledge Hut

JUNE 20, 2023

Languages Python, SQL, Java, Scala R, C++, Java Script, and Python Tools Kafka, Tableau, Snowflake, etc. Kafka: Kafka is a top engineering tool highly valued by big data experts. You should be skilled in SQL and knowledgeable about NoSQL databases like Cassandra, MongoDB, and HBase.

Machine Learning 52

Machine Learning Data Engineering Data Engineer Engineering 52

Knowledge Hut

SEPTEMBER 6, 2023

Big Data Frameworks : Familiarity with popular Big Data frameworks such as Hadoop, Apache Spark, Apache Flink, or Kafka are the tools used for data processing. Implement ETL & Data Pipelines with Bash, Airflow & Kafka; architect, populate, deploy Data Warehouses; create BI reports & interactive dashboards.

Big Data 52

Big Data Certification Hadoop Scala 52

Rockset

OCTOBER 19, 2018

A plethora—some will call it a zoo—of open-source projects soon followed, including household names like Spark, Kafka, and MongoDB. Count Hadoop, Spark, Kafka, MongoDB, and Elasticsearch among the open-source projects that have as-a-service offerings which provide an abstraction on both hardware and software.

MongoDB 40

MongoDB Hadoop Kafka Data Warehouse 40

ProjectPro

FEBRUARY 1, 2017

The data architecture is based on open source standards Pentaho and is used for managing, preparing and integrating data that runs through their environments including Cloudera Hadoop Distribution , HP Vertica, Flume and Kafka. Source : [link] How Hadoop helps Experian crunch credit reports. Source : [link] ) Bringing Hadoop to the mainframe.

Hadoop 52

Hadoop MongoDB Big Data Kafka 52

Rockset

AUGUST 11, 2022

Our talk follows an earlier video roundtable hosted by Rockset CEO Venkat Venkataramani, who was joined by a different but equally-respected panel of data engineering experts, including: DynamoDB author Alex DeBrie ; MongoDB director of developer relations Rick Houlihan ; Jeremy Daly , GM of Serverless Cloud.

Bytes 52

Bytes Consulting Kafka MongoDB 52

ProjectPro

DECEMBER 7, 2021

In addition, to extract data from the eCommerce website, you need experts familiar with databases like MongoDB that store reviews of customers. You can use big-data processing tools like Apache Spark , Kafka , and more to create such pipelines. However, it is not straightforward to create data pipelines.

Data Pipeline 52

Data Pipeline Architecture Kafka AWS 52

Ascend.io

SEPTEMBER 14, 2023

Be it PostgreSQL, MySQL, MongoDB, or Cassandra, Python ensures seamless interactions. Tailored libraries like PySpark Streaming and Kafka-Python have made real-time data analysis and event processing a streamlined affair in Python. Use Case: Processing streaming tweets from pyspark.streaming import StreamingContext from pyspark.

Data Engineering 52

Data Engineering Data Engineer Python Engineering 52