Snowflake

MAY 31, 2023

Today, we’re excited to announce the Snowflake Connector for Microsoft Power Platform is now available. This connector provides instant access to up-to-date data within your Snowflake instance without manually integrating against API endpoints. How does the Snowflake Connector for Power Platform work?

BI 55

BI Coding Machine Learning Data Science 55

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode Nick King discusses how you can be intentional about data creation in your applications and services to reduce the friction and errors involved in building data products and ML applications. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions.

Building 130

Building IT Metadata MongoDB 130

Cloudera

MARCH 2, 2023

In the next example, we will explore how to create a table using the Iceberg connector and Hive Metastore. The catalog-name is a user-specified string that is used internally by the connector when creating the underlying iceberg catalog. This option is required as the connector doesn’t provide a default value. ssb_default`.`iceberg_hive_example`

Process 112

Process SQL Kafka Database 112

Data Engineering Podcast

OCTOBER 30, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions.

Business Intelligence 130

Business Intelligence Metadata MongoDB MySQL 130

Data Engineering Podcast

OCTOBER 16, 2022

In this episode Adrian Kosowski explains how the Pathway product got started, how its design simplifies the creation of data products that support supply chain operations, and how developers can help to build an ecosystem of applications that allow businesses to accelerate their time to insight.

Database 100

Database Metadata MongoDB MySQL 100

Towards Data Science

DECEMBER 1, 2023

Choose your preferred method and set up the Google Calendar connector. You can visit the connector webpage to see the schema diagram here. In my example workflow, you can see a two-step deployment process: dbt build for the development environment and in case of success, also dbt build for the production environment.

Data Engineering 74

Data Engineering Data Engineer Project Engineering 74

Data Engineering Podcast

DECEMBER 4, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions.

Business Intelligence 100

Business Intelligence Metadata BI MongoDB 100

Cloudyard

FEBRUARY 19, 2023

Or we can leverage third party ETL tools but for this scenario me and my colleague Gautam has focused on Salesforce product features. Salesforce to Snowflake: Tableau CRM Sync Out : connector to provide integration among Salesforce with Snowflake. Moreover, Connector moves Salesforce data directly into Snowflake.

ETL Tools 52

ETL Tools Datasets Python Accessible 52

Snowflake

SEPTEMBER 7, 2023

This provides Snowflake customers the power and flexibility of Airbyte’s 350+ connectors within Snowflake’s convenience and security posture.” Snowpark External Access is leveraged to build a Ingest and Reverse ETL data pipeline for production workload. This has eliminated any additional cost or dependency on external orchestrators.

Amazon Web Services 110

Amazon Web Services AWS Government Python 110

Data Engineering Podcast

OCTOBER 2, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions.

Metadata 100

Metadata Electronics MongoDB MySQL 100

Data Engineering Podcast

SEPTEMBER 25, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions.

Building 100

Building Metadata MongoDB MySQL 100

Data Engineering Podcast

OCTOBER 9, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions.

Metadata 100

Metadata MongoDB AWS MySQL 100

Cloudera

FEBRUARY 16, 2021

You can use Cloudera Streaming Analytics that offers an Apache HBase connector that enables you to use COD as a data sink. You can use the connector to store the output from a real-time processing application in COD. You can use the Phoenix-Spark connector plugin to perform READ and WRITE operations on COD.

Database 81

Database Machine Learning Data Lake Kafka 81

Cloudera

JUNE 7, 2021

Now we are releasing a new version of our product that takes the user experience, technical capabilities, and platform integration to the next level. Custom connector support. You can use Flink’s powerful lookup join syntax to join your incoming streams with static data from Hive, Kudu or databases through the JDBC connector.

Kafka 100

Kafka SQL Accessible Accessibility 100

Ascend.io

JUNE 22, 2023

Data-driven organizations are increasingly looking for ways to enable both centralized and distributed teams to build, share and collaborate on analytical data products. Ascend’s intelligent MotherDuck Write Connector takes advantage of advanced, partition-aware logic to load data into databases in MotherDuck.

NoSQL 52

NoSQL MySQL Google Cloud Data Pipeline 52

Confluent

MAY 15, 2023

Confluent introduces the new Kora Engine, enhanced performance, data quality, and flexibility with Data Quality Rules, Custom Connectors, Stream Sharing, and more in the Q2 ‘23 product launch.

Engineering 52

Engineering Process Data 52

Snowflake

JANUARY 31, 2024

You can purchase, install and run Snowflake Native Apps—ranging from connectors to clean rooms—directly in your Snowflake account. Browse Cybersyn’s data products on Snowflake Marketplace. “Maxa’s mission is to reinvent the way ERP insights are made and consumed. Explore Mapbox’s data products on Snowflake Marketplace.

AWS 89

AWS Government Programming Data Science 89

Knowledge Hut

DECEMBER 5, 2023

In other words, an influence diagram PMP can be used to identify the behavioral relationships and manage stak eholders expectations (for example, when a project manager requests changes from the customer and when successful delivery of a product or service is impacted by changes in one or more product characteristics).

Certification 52

Certification Project Management Utilities 52

Snowflake

NOVEMBER 30, 2023

If a read-only instance isn’t available, you can load backup files from production to a lower environment and extract from there. TCS Data Migrator Tool has connectors for standard RDBMS, warehouse and file systems that you can leverage for historical data migration.

Data Warehouse 91

Data Warehouse Banking Data Cloud 91

Snowflake

DECEMBER 5, 2023

Engaging with partners and customers — and showcasing what’s new on the Snowflake product front — made for a dynamic time in Las Vegas. Here are highlights from the collaborations, integrations and product enhancements that we were proud to dig in to throughout the week.

AWS 92

AWS Amazon Web Services Government Cloud Computing 92

Ascend.io

MARCH 6, 2023

While on the topic of connectors, you have been able to ingest from IBM DB2 on iSeries/AS400 for some time. Today, we also added the ability to reverse ETL to these systems, with a write connector that includes isolation-level override.

Management 52

Management Data Pipeline Data Ingestion Cloud 52

Ascend.io

MARCH 6, 2023

While on the topic of connectors, you have been able to ingest from IBM DB2 on iSeries/AS400 for some time. Today, we also added the ability to reverse ETL to these systems, with a write connector that includes isolation-level override.

Management 52

Management Data Pipeline Data Ingestion Cloud 52

Scott Logic

MARCH 27, 2024

Industry leaders are shifting their focus towards bringing new differentiated, highly personalised products and services to their customers. Take retail banking, for example, where products and services (loans, savings accounts, current accounts etc.) have become highly commoditised. APIs enable data sets (e.g.

Insurance 52

Insurance Banking Retail Education 52

Ascend.io

MARCH 20, 2023

As you know, data for pipelines is sourced from any location through Read Connectors , and finished data product is delivered to any location with Write Connectors. This pattern is a great fit for intelligent pipelines, which access older and newer data based on its relevance to delivering data products.

Management 52

Management AWS Cloud Storage Data Pipeline 52

Ascend.io

MARCH 20, 2023

As you know, data for pipelines is sourced from any location through Read Connectors , and finished data product is delivered to any location with Write Connectors. This pattern is a great fit for intelligent pipelines, which access older and newer data based on its relevance to delivering data products.

Management 52

Management AWS Cloud Storage Data Pipeline 52

Striim

AUGUST 26, 2023

Best Confluent Alternatives Striim: An end-to-end streaming platform offering connectors, change data capture, high-speed streaming SQL, and support for both historical and real-time data, along with streaming visualizations. While Confluent has CDC connectors, they are not designed to support reliably emit data.

MongoDB 52

MongoDB Google Cloud Kafka AWS 52

Confluent

MAY 13, 2019

Not only that, as we had previously promised, we are also introducing three of the most popular components of Confluent Platform as fully managed services: Confluent Schema Registry, the Kafka S3 sink connector, and Confluent KSQL. Fully managed Schema Registry, Kafka S3 sink connector, and KSQL in Confluent Cloud. per GB per month.

Kafka 100

Kafka Cloud Management Building 100

Data Engineering Podcast

AUGUST 21, 2022

Summary Data has permeated every aspect of our lives and the products that we interact with. With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Data Engineering Podcast

JULY 3, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Random data doesn’t do it — and production data is not safe (or legal) for developers to use. does exactly that.

Data Integration 100

Data Integration MongoDB Scala MySQL 100

Pinterest Engineering

NOVEMBER 7, 2023

From dev velocity and service stability improvements to seamless migrations from native client to PSC, we would like to share some of our findings from running a unified PubSub client library in production. We have observed 0 incidents so far with migrations and do not expect this number to increase.

Kafka 98

Kafka Java Software Engineer Software Engineering 98

Knowledge Hut

DECEMBER 22, 2023

It was released as a standalone product in July 2015 after adding more features including enterprise-level data connectivity and security options, apart from its original Excel features like Power Query, Power Pivot, and Power View. Power BI, originally called Project Crescent, was launched in July 2011, bundled with SQL Server.

BI 98

BI Business Intelligence Machine Learning Data Cleanse 98

Cloudera

MAY 1, 2023

By breaking down monolithic apps into microservices architectures, for example, or making modularized data products, organizations do their best to enable more rapid iterative cycles of design, build, test, and deployment of innovative solutions. release of Cloudera’s SQL Stream Builder (available on CDP Public Cloud 7.2.16

SQL 75

SQL Project Kafka Accessible 75

Data Engineering Podcast

AUGUST 28, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. All thanks to 50+ quality checks, extensive column-level lineage, and 20+ connectors across the Data Stack.

Building 100

Building MongoDB Scala MySQL 100

Data Engineering Podcast

MAY 10, 2021

The team at Tinybird wants to make it easy to turn a continuous stream of data into a production ready API or data product. This is a great conversation about the challenges of building a maintainable business from a technical and product perspective. What do you have planned for the future of the product and business?

PostgreSQL 100

PostgreSQL Data Warehouse Data Pipeline Kafka 100

Data Engineering Podcast

JUNE 26, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Random data doesn’t do it — and production data is not safe (or legal) for developers to use. does exactly that.

Data Management 100

Data Management Management MongoDB Scala 100

Rockset

JULY 28, 2022

MongoDB provides Kafka source and sink connectors that can be used to write the change events to a Kafka topic and then output those changes to another system such as a database or data lake. The out-of-the-box connectors make it fairly simple to set up the CDC solution, however they do require the use of a Kafka cluster.

MongoDB 52

MongoDB Kafka NoSQL Data Lake 52

Data Engineering Weekly

JANUARY 28, 2024

The Macquarie team writes about implementing CDC by comparing Solace vs. Kafka as a possible connector along with Debezium. However, incorporating LLM into an existing user experience and the product features is a bigger challenge for many organizations. It is exciting to see Atlassian sharing such product features utilizing LLM.

Data Engineering 57

Data Engineering Data Engineer Engineering Recruitment 57