Propel Data

OCTOBER 11, 2022

The main difference between data lakes and data warehouses is data lakes allow unstructured data, but data warehouses need structured data.

Data Lake 40

Data Lake Data Warehouse Unstructured Data Data Analytics 40

Propel Data

AUGUST 24, 2022

With Snowflake, it’s possible to build an enterprise data warehouse (EDW), an operational data store (ODS), or a team-specific data mart.

Data Warehouse 40

Data Warehouse Data Analytics Data Building 40

Cloudera

FEBRUARY 9, 2021

Today’s customers have a growing need for a faster end to end data ingestion to meet the expected speed of insights and overall business demand. This ‘need for speed’ drives a rethink on building a more modern data warehouse solution, one that balances speed with platform cost management, performance, and reliability.

Data Warehouse 69

Data Warehouse Cloud Kafka Cloud Storage 69

Cloudera

SEPTEMBER 24, 2020

Some of the most powerful results come from combining complementary superpowers, and the “dynamic duo” of Apache Hive LLAP and Apache Impala, both included in Cloudera Data Warehouse , is further evidence of this. Both Impala and Hive can operate at an unprecedented and massive scale, with many petabytes of data.

Data Warehouse 68

Data Warehouse SQL Engineering Metadata 68

Propel Data

JANUARY 10, 2023

Create and query an API on top of your Snowflake data warehouse using Propel’s blazing-fast Serverless Analytics API Platform

Data Analytics 72

Data Analytics Building Data Warehouse Data 72

Cloudera

SEPTEMBER 10, 2018

Among the many reasons that a majority of large enterprises have adopted Cloudera Data Warehouse as their modern analytic platform of choice is the incredible ecosystem of partners that have emerged over recent years. Informatica’s Big Data Manager and Qlik’s acquisition of Podium Data are just 2 examples.

Data Warehouse 43

Data Warehouse BI Unstructured Data Data 43

Data Engineering Podcast

NOVEMBER 26, 2019

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Links Sentry Podcast.__init__

Data Warehouse 100

Data Warehouse Building PostgreSQL Kafka 100

databricks

JANUARY 31, 2024

Welcome to the blog series covering product advancements in 2023 for Databricks SQL, the serverless data warehouse from Databricks. This is part 2.

SQL 110

SQL Programming Data Warehouse Data 110

Propel Data

MARCH 14, 2023

Learn how to set up Segment for your web application and store the captured data in Snowflake, a popular data warehouse solution.

Data Analytics 52

Data Analytics Data Warehouse Building Data 52

Christophe Blefari

APRIL 19, 2024

This blog shows how you can use Gen AI to evaluate inputs like translations with added reasons. How we build Slack AI to be secure and private — How Slack uses VPC and Amazon SageMaker with your data secured and private. — A great blog to answer a great question. Is SQLMesh the dbt Core 2.0 ?

MySQL 130

MySQL Data Datasets SQL 130

databricks

MARCH 6, 2024

This blog continues our series looking at advancements from 2023 to the serverless data warehouse Databricks SQL. The best data warehouse is.

SQL 52

SQL Data Warehouse Data 52

Cloudera

SEPTEMBER 17, 2018

These trends and demands lead to stress for existing data warehouse solutions – scale, efficiency, security integrations, IT budgets, ease of access. Cloudera recently launched Cloudera Data Warehouse, a modern data warehousing solution.

Data Warehouse 52

Data Warehouse SQL Portfolio MySQL 52

Propel Data

JULY 25, 2022

Need to build a Snowflake data app? Here's how to create and query a Metric on top of Snowflake data warehouse using Propel’s GraphQL API.

Building 40

Building Data Analytics Data Warehouse Data 40

Christophe Blefari

JANUARY 20, 2024

Data engineering inherits from years of data practices in US big companies. Hadoop initially led the way with Big Data and distributed computing on-premise to finally land on Modern Data Stack — in the cloud — with a data warehouse at the center. My advice on this point is to learn from others.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

Snowflake

NOVEMBER 30, 2023

At TCS , we help companies shift their enterprise data warehouse (EDW) platforms to the cloud as well as offering IT services. We’re extremely familiar with just how tricky a cloud migration can be, especially when it involves moving historical business data. Use separate data warehouses for cost-effective data loading.

Data Warehouse 98

Data Warehouse Banking Data Cloud 98

Hevo

APRIL 12, 2024

As analytics in your company graduates from a MySQL/PostgreSQL/SQL Server, a pertinent question that you need to answer is which data warehouse is best suited for you. This blog tries to compare Redshift vs BigQuery – two very famous cloud data warehouses today.

PostgreSQL 40

PostgreSQL MySQL Data Warehouse SQL 40

Propel Data

JULY 14, 2022

Multi-cluster virtual warehouses auto-scale compute resources based on the demands on the data warehouse. Here’s how they work in Snowflake.

Data Analytics 40

Data Analytics Data Warehouse Data 40

Cloudera

OCTOBER 4, 2023

A unique architecture to optimize for real-time data warehousing and business analytics: Cloudera Data Platform (CDP) offers Apache Kudu as part of our Data Hub cloud service, providing a consistent, dependable way to support the ingestion of data streams into our analytics environment, in real time, and at any scale.

Telecommunication 84

Telecommunication Data Warehouse Java Manufacturing 84

Knowledge Hut

APRIL 25, 2024

It is especially true in the world of big data. If you want to stay ahead of the curve, you need to be aware of the top big data technologies that will be popular in 2024. In this blog post, we will discuss such technologies. The two most popular data warehouse systems are Teradata and Oracle Exadata.

Big Data 98

Big Data Technology NoSQL Hadoop 98

databricks

JANUARY 25, 2023

This is a collaborative post between Databricks and Matillion. We thank David Willmer, Product Marketing at Matillion, for his contributions. As more and.

Data Warehouse 76

Data Warehouse Data 76

Hevo

APRIL 26, 2024

Everyone in your organization, from content writers who embed tweets into blog articles to data teams who reconcile data warehouses following a merger, can perform their duties more successfully with the help of coordinated data. Choosing the best tool for the […]

Data Integration 40

Data Integration Data Warehouse Data Technology 40

Hevo

APRIL 26, 2024

Amazon Redshift is a serverless, fully managed leading data warehouse in the market, and many organizations are migrating their legacy data to Redshift for better analytics. In this blog, we will discuss the best Redshift ETL tools that you can use to load data into Redshift.

ETL Tools 40

ETL Tools Data Warehouse Management Data 40

Workfall

JULY 4, 2023

With DBT, they weave powerful SQL spells to create data models that capture the essence of their organization’s information. DBT’s superpowers include seamlessly connecting with databases and data warehouses, performing amazing transformations, and effortlessly managing dependencies to ensure high-quality data.

Data Warehouse 69

Data Warehouse SQL PostgreSQL Database 69

Simon Späti

NOVEMBER 28, 2018

However, this is still not common in the Data Warehouse (DWH) field. In my recent blog, I researched OLAP technologies, for this post I chose some open-source technologies and used them together to build a full data architecture for a Data Warehouse system. These days, everyone talks about open-source.

Data Warehouse 130

Data Warehouse Data Storage Data Architecture Architecture 130

Cloudera

JANUARY 19, 2024

As described in our recent blog post , an SQL AI Assistant has been integrated into Hue with the capability to leverage the power of large language models (LLMs) for a number of SQL tasks. This is a real game-changer for data analysts on all levels and will make SQL development faster, easier, and less error-prone.

SQL 71

SQL Data Warehouse AWS Architecture 71

Christophe Blefari

FEBRUARY 24, 2023

This is something I struggle with, I really like writing, I really like this newsletter, I really like the blog, but it takes me one day per week to be done. At the moment the best way to develop in your data warehouse is still in the query editor of BigQuery / Snowflake / etc., Often they are right.

Kafka 130

Kafka Data Lake Data Storage Data 130

Knowledge Hut

MARCH 28, 2024

This demonstrates the increasing need for Microsoft Certified Data Engineers. In this blog, I will explore Azure data engineer jobs and the top 10 job roles in this field where you can begin your career. Implement ETL processes to load data into the data warehouse from various source systems.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Data Science Blog: Data Engineering

SEPTEMBER 24, 2021

Data Warehousing is applied Big Data Management and a key success factor in almost every company. Without a data warehouse, no company today can control its processes and make the right decisions on a strategic level as there would be a lack of data transparency for all decision makers.

Data Lake 52

Data Lake Data Warehouse Data Transparency Database 52

Data Engineering Podcast

FEBRUARY 9, 2020

Summary Designing the structure for your data warehouse is a complex and challenging process. As businesses deal with a growing number of sources and types of information that they need to integrate, they need a data modeling strategy that provides them with flexibility and speed.

Data Lake 100

Data Lake Data Warehouse Hadoop NoSQL 100

Cloudera

FEBRUARY 12, 2024

In this blog, we’ll take you through our tried and tested best practices for setting up your DNS for use with Cloudera on Azure. For data warehouse: create data warehouses through the Cloudera command line interface with the parameter “privateDNSZoneAKS”: set to”None.”

MySQL 52

MySQL PostgreSQL Data Warehouse Machine Learning 52

Cloudera

JANUARY 20, 2021

Most of what is written though has to do with the enabling technology platforms (cloud or edge or point solutions like data warehouses) or use cases that are driving these benefits (predictive analytics applied to preventive maintenance, financial institution’s fraud detection, or predictive health monitoring as examples) not the underlying data.

Manufacturing 105

Manufacturing Data Warehouse Kafka Retail 105

Cloudera

JUNE 18, 2022

These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. In recent years, the term “data lakehouse” was coined to describe this architectural pattern of tabular analytics over data in the data lake.

Data Lake 90

Data Lake Data Warehouse BI SQL 90

Cloudera

AUGUST 31, 2021

Cloudera and Accenture demonstrate strength in their relationship with an accelerator called the Smart Data Transition Toolkit for migration of legacy data warehouses into Cloudera Data Platform. Accenture’s Smart Data Transition Toolkit . Are you looking for your data warehouse to support the hybrid multi-cloud?

Data Warehouse 80

Data Warehouse Database-centric Metadata Cloud 80

Data Engineering Weekly

APRIL 14, 2024

The blog post brings in-depth insights into how Apache Hudi works on the right side, read side & underlying storage formats. link] Intel: Four Data Cleaning Techniques to Improve Large Language Model (LLM) Performance If someone asks me to define LLM, this is my one-line definition. High-quality data is the cornerstone of LLM.

Data Engineering 62

Data Engineering Data Engineer Engineering Business Intelligence 62

ThoughtSpot

OCTOBER 27, 2023

Every business that analyzes their operational (or transactional) data needs to build a custom data pipeline involving several batch or streaming jobs to extract transactional data from relational databases , transform it, and load it into the data warehouse. Create a new data connection to Amazon Redshift.

Building 70

Building MySQL Data Warehouse SQL 70

Workfall

JUNE 12, 2023

So, embrace the power of Change Data Capture, and embark on a captivating journey where the magic of real-time data awaits. In this blog, we will cover: What Is CDC and Its Benefits? CDC also plays a crucial role in data integration and ETL processes. We will come up with more such use cases in our upcoming blogs.

Telecommunication 80

Telecommunication Metadata Healthcare Finance 80

Workfall

SEPTEMBER 18, 2023

In this digital era, businesses thrive on data, and making this data dance harmoniously with your analytics tools is crucial. Pair this with Snowflake , the cloud data warehouse that acts as a vault for your insights, and you have a recipe for data-driven success. In this blog, we will cover: What is Airbyte?

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93