Confluent

AUGUST 31, 2023

Get a high-level overview of source connector tuning: What can and cannot be tuned, and tuning methodology for any and all source connectors.

Kafka 69

Kafka 69

Cloudyard

JULY 5, 2023

Read Time: 1 Minute, 24 Second During the last post we discussed how Snowflake ODBC connector use with Azure Data factory to ingest data into Snowflake hosted on AWS cloud platform. Create the ODBC connector inside the System Admin as discussed in earlier steps. ODBC setup Create the Dataset pointing to the ODBC linked service.

AWS 52

AWS Datasets Cloud Systems 52

Cloudyard

JULY 3, 2023

Read Time: 3 Minute, 10 Second During this post we are going to discuss how Snowflake ODBC connector use with Azure Data factory to ingest data into Snowflake hosted on AWS cloud platform. COPY Error As per the error we can use only Snowflake hosted on AZURE as sink connector.

AWS 52

AWS Datasets Cloud Database 52

Confluent

DECEMBER 7, 2021

In our February 2020 blog post Celebrating Over 100 Supported Apache Kafka® Connectors, we announced support for more than 100 connectors on Confluent Platform. Since then, we have been focused […].

AWS 103

AWS Kafka Management 103

Confluent

JANUARY 22, 2024

The new fully managed BigQuery Sink V2 connector for Confluent Cloud offers streamlined data ingestion and cost-efficiency. Learn about the Google-recommended Storage Write API and OAuth 2.0 support.

Data Ingestion 74

Data Ingestion Cloud Management Data 74

Confluent

AUGUST 31, 2021

Today, as part of our expanded partnership with Elastic, we are announcing an update to the fully managed Elasticsearch Sink Connector in Confluent Cloud. This update allows you to take […].

Cloud 119

Cloud Data Management Kafka 119

Confluent

MARCH 4, 2020

The Elasticsearch sink connector helps you integrate Apache Kafka® and Elasticsearch with minimum effort. You can take data you’ve stored in Kafka and stream it into Elasticsearch to then be […].

Kafka 118

Kafka IT Data 118

Confluent

DECEMBER 6, 2022

Building, testing, and deploying Kafka connectors require time and resources. Confluent’s fully managed connectors ensure instant, real-time data quality, consistency, and reliability.

Kafka 52

Kafka Management Building Data 52

Confluent

AUGUST 10, 2021

Today, Confluent is announcing the general availability (GA) of the fully managed Azure Cosmos DB Sink Connector within Confluent Cloud. Now, with just a few simple clicks, you can link […].

Cloud 98

Cloud Management Data Pipeline Kafka 98

Confluent

JUNE 26, 2020

We are excited to announce the preview release of the fully managed Snowflake sink connector in Confluent Cloud, our fully managed event streaming service based on Apache Kafka®. Our managed […].

Kafka 104

Kafka Cloud Management 104

Confluent

SEPTEMBER 18, 2020

Since the MongoDB Atlas source and sink became available in Confluent Cloud, we’ve received many questions around how to set up these connectors in a secure environment. By default, MongoDB […].

MongoDB 97

MongoDB Management Cloud AWS 97

Confluent

FEBRUARY 9, 2021

There are a large number of existing connectors, and you can also […]. Kafka Connect is part of Apache Kafka®, providing streaming integration of external systems in and out of Kafka.

Kafka 83

Kafka Systems 83

Confluent

SEPTEMBER 2, 2022

Manage connectors declaratively with Confluent for Kubernetes.

Management 52

Management 52

Confluent

JULY 6, 2020

We are excited to announce the preview release of the fully managed Elasticsearch Service Sink Connector in Confluent Cloud, our fully managed event streaming service based on Apache Kafka®. Our […].

Kafka 93

Kafka Cloud Management 93

Snowflake

APRIL 17, 2024

Our previous Python connector API , primarily available for those who need to run SQL via a Python script, enabled a connection to Snowflake from Python applications. While the Python API connector remains available for specific SQL use cases, the new API is designed to be your go-to solution.

Data Pipeline 103

Data Pipeline Python Data Engineering Data Engineer 103

Confluent

JUNE 8, 2020

We are excited to announce the preview release of the fully managed MongoDB Atlas source and sink connectors in Confluent Cloud, our fully managed event streaming service based on Apache […].

MongoDB 74

MongoDB Cloud Management Kafka 74

Confluent

MAY 6, 2021

Today, Confluent is announcing the general availability (GA) of the fully managed MongoDB Atlas Source and MongoDB Atlas Sink Connectors within Confluent Cloud. Now, with just a few simple clicks, […].

MongoDB 52

MongoDB Cloud Management Kafka 52

Rockset

JULY 29, 2021

To enable these workloads, Rockset provides a fully managed sync to DynamoDB tables with its built-in connector. As such, the DynamoDB connector is one of our most widely used data connectors. We see users move massive amounts of data–TBs worth of data–using the DynamoDB connector. hours, end to end!

NoSQL 40

NoSQL AWS Database Architecture 40

databricks

MARCH 4, 2024

StreamNative, a leading Apache Pulsar-based real-time data platform solutions provider, and Databricks, the Data Intelligence Platform, are thrilled to announce the enhanced Pulsar-Spark.

Data Process 112

Data Process Process Data 112

Confluent

MARCH 27, 2020

Kafka connectors are perfect for this. There are many connectors out there, usually for well-known and […]. Do you have data you need to get into or out of Apache Kafka®?

Kafka 59

Kafka Data 59

Hevo

DECEMBER 26, 2023

Extracting meaningful insights from the millions of rows of data collected in real-time is always a huge challenge for organizations globally. Data Visualisations Tools like Power BI allow business teams to build visually stunning and informative dashboards & reports to keep a tab on their goals & objectives.

BI 52

BI Data Collection Building Data 52

Confluent

FEBRUARY 19, 2020

We just released Confluent Platform 5.4, which is one of our most important releases to date in terms of the features we’ve delivered to help enterprises take Apache Kafka® and […].

Kafka 128

Kafka 128

Rockset

DECEMBER 14, 2022

Rockset’s native connector for Amazon Managed Streaming for Apache Kafka (MSK) makes it simpler and faster to ingest streaming data for real-time analytics. Amazon MSK is a fully managed AWS service that gives users the ability to build and run applications using Apache Kafka.

Kafka 52

Kafka MongoDB SQL AWS 52

databricks

JANUARY 11, 2023

This is a collaborative post from Databricks and Microsoft. We thank Mahesh Prakriya (Director in Intelligence Platform, Microsoft) and Bob Zhang (Sr. Technical.

BI 94

BI 94

Snowflake

MARCH 14, 2024

SNP Group is tackling this challenge head-on, leveraging the Snowflake Native App Framework (generally available on AWS and Azure, private preview on GCP) to create its SNP Glue Connector for SAP. Try SNP Glue Connector for SAP: Get it now! What’s the challenge with unlocking SAP data?

IT 89

IT Data Ingestion Data AWS 89

Confluent

FEBRUARY 16, 2021

One of the most common relational database systems that connects to Apache Kafka® is Oracle, which often holds highly critical enterprise transaction workloads. While Oracle Database (DB) excels at many […].

Relational Database 126

Relational Database Kafka Database Systems 126

Confluent

FEBRUARY 14, 2024

brings upgrading for existing clusters from ZooKeeper to KRaft, compaction support for Tiered Storage, OAuth (early access), improvements to the Oracle CDC premium connector, and more. Confluent Platform 7.6

Accessible 118

Accessible Accessibility 118

Confluent

MARCH 23, 2022

The choice of how to get your data in and out of your Apache Kafka® clusters is one that merits thoughtful consideration. On one hand, you can choose to develop […].

Management 61

Management Kafka AWS Data 61

Confluent

OCTOBER 14, 2021

Many Oracle Database customers currently still leverage Oracle 12c or 18c in their production environments, with some even using Oracle 11g. Most of these customers have moved to 19c or […].

Database 74

Database Kafka 74

Hevo

JUNE 15, 2023

Database administrators used to capture changes by getting access control rights and then string such changes to the source databases manually. But, they could not track the real-time changes due to an increase in the amount of modification in the digital world. The real-time changes in databases can be tracked by one of the most […]

Database 52

Database Accessible Accessibility Data Integration 52

Towards Data Science

JUNE 19, 2023

Meerschaum Compose serves a similar purpose: in a mrsm-compose.yml file, you specify everything you might need for a project: the expected environment , plugins , pipes , and connectors. Pipes have input and output connectors and store parameters to configure the behavior of their syncing processes.

PostgreSQL 81

PostgreSQL SQL Python Project 81

databricks

JUNE 15, 2023

We are excited to announce the official launch of the Google Pub/Sub connector for the Databricks Lakehouse Platform. This new connector adds to.

Google Cloud 103

Google Cloud Data Process Process Cloud 103

Confluent

APRIL 20, 2020

The goal of this post is to illustrate PUSH to web from Apache Kafka® with a hands-on example. Our business users are always wanting their data faster so they can […].

Kafka 92

Kafka Java Data 92

Cloudera

MARCH 2, 2023

In the next example, we will explore how to create a table using the Iceberg connector and Hive Metastore. The catalog-name is a user-specified string that is used internally by the connector when creating the underlying iceberg catalog. This option is required as the connector doesn’t provide a default value. ssb_default`.`iceberg_hive_example`

Process 112

Process SQL Kafka Database 112

Confluent

MARCH 19, 2024

Check out the latest features on Confluent Cloud including improvements to 80+ connectors, stream governance updates, enterprise cluster savings, and much more.

Data Pipeline 65

Data Pipeline Building Government Cloud 65

Confluent

JULY 29, 2021

Data is at the center of our world today, especially with the ever-increasing amount of machine-generated log data collected from applications, devices, and sensors from almost every modern technology. The […].

Data Collection 90

Data Collection Data Technology Kafka 90

Snowflake

APRIL 23, 2024

Snowflake has announced the general availability of the Snowflake Connector for ServiceNow, available on Snowflake Marketplace. The connector provides immediate access to up-to-date ServiceNow data without the need to manually integrate against API endpoints.

Data Warehouse 91

Data Warehouse Data Integration Consulting Metadata 91