Monte Carlo

FEBRUARY 6, 2023

So, you’re planning a cloud data warehouse migration. But be warned, a warehouse migration isn’t for the faint of heart. As you probably already know if you’re reading this, a data warehouse migration is the process of moving data from one warehouse to another. A worthy quest to be sure.

Data Warehouse 52

Data Warehouse AWS Data Validation Data 52

Cloudera

FEBRUARY 9, 2021

Today’s customers have a growing need for a faster end to end data ingestion to meet the expected speed of insights and overall business demand. This ‘need for speed’ drives a rethink on building a more modern data warehouse solution, one that balances speed with platform cost management, performance, and reliability.

Data Warehouse 67

Data Warehouse Cloud Kafka Cloud Storage 67

Cloudera

JULY 16, 2021

Did you know Cloudera customers, such as SMG and Geisinger , offloaded their legacy DW environment to Cloudera Data Warehouse (CDW) to take advantage of CDW’s modern architecture and best-in-class performance? Today, we are pleased to announce the general availability of HPL/SQL integration in CDW public cloud.

Data Warehouse 115

Data Warehouse SQL PostgreSQL MySQL 115

Cloudera

SEPTEMBER 29, 2020

Performance is one of the key, if not the most important deciding criterion, in choosing a Cloud Data Warehouse service. In today’s fast changing world, enterprises have to make data driven decisions quickly and for that they rely heavily on their data warehouse service. . benchmark.

Data Warehouse 116

Data Warehouse Cloud Storage Metadata Cloud 116

Data Engineering Podcast

FEBRUARY 8, 2021

In this episode Zeeshan Qureshi and Michelle Ark share their experiences using DBT to manage the data warehouse for Shopify. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. What kinds of data sources are you working with?

Data Warehouse 100

Data Warehouse Building BI SQL 100

Data Engineering Podcast

JANUARY 18, 2021

Summary The data warehouse has become the central component of the modern data stack. This is an interesting conversation about the importance of the data warehouse and how it can be used beyond just internal analytics. How do you keep data up to date between the warehouse and downstream systems?

Data Warehouse 100

Data Warehouse BI Data Data Pipeline 100

Data Engineering Podcast

OCTOBER 14, 2019

Summary Managing a data warehouse can be challenging, especially when trying to maintain a common set of patterns. What are some of the challenges and mistakes that are common among engineers and analysts with regard to versioning and evolving schemas and the accompanying data?

Data Warehouse 100

Data Warehouse PostgreSQL AWS Programming Language 100

Monte Carlo

APRIL 16, 2022

The data warehouse is the foundation of the modern data stack, so it caught our attention when we saw Convoy head of data Chad Sanderson declare, “ the data warehouse is broken ” on LinkedIn. Treating data like an API. Immutable data warehouses have challenges too.

Data Warehouse 52

Data Warehouse Architecture Data Government 52

Cloudera

DECEMBER 11, 2020

In this blog post, we compare Cloudera Data Warehouse (CDW) on Cloudera Data Platform (CDP) using Apache Hive-LLAP to EMR 6.0 (also powered by Apache Hive-LLAP) on Amazon using the TPC-DS 2.9 Cloudera Data Warehouse vs EMR. Learn more about Cloudera Data Warehouse on CDP.

Data Warehouse 106

Data Warehouse Metadata Datasets Data 106

Analytics Vidhya

MARCH 24, 2023

Docker is still considered one of the top tools for creating containers by building Images between containerization platforms or cloud platforms.

Cloud 218

Cloud Building Data Warehouse IT 218

Data Engineering Podcast

MAY 29, 2022

Summary The latest generation of data warehouse platforms have brought unprecedented operational simplicity and effectively infinite scale. In order to ensure that you can explore and analyze your data without spending money on inefficient queries Mingsheng Hong and Zheng Shao created Bluesky Data.

Cloud 100

Cloud Data Warehouse Data Lake Data 100

Analytics Vidhya

FEBRUARY 1, 2023

Introduction Nowadays, organizations are looking for multiple solutions to deal with big data and related challenges. If you’re preparing for the Snowflake interview, […] The post A Comprehensive Guide Of Snowflake Interview Questions appeared first on Analytics Vidhya.

Data Cleanse 216

Data Cleanse Data Warehouse Big Data Cloud 216

Confluent

JULY 26, 2021

Twenty years ago, the data warehouses of choice were Oracle and Teradata. Since then, growth and innovation has shifted to the cloud, and a new generation of data systems have […].

Systems 113

Systems Cloud Designing Data Warehouse 113

dbt Developer Hub

NOVEMBER 14, 2021

This article will go over how the DATEADD function works, the nuances of using it across the major cloud warehouses, and how to standardize the syntax variances using dbt macro. dbt (and the dbt_utils macro package) helps us smooth out these wrinkles of writing SQL across data warehouses.

Data Warehouse 52

Data Warehouse SQL Software Engineer Software Engineering 52

Teradata

OCTOBER 10, 2020

Successful companies need to squeeze maximum value from all of their data & do it at the lowest possible cost. But they often get hit with unexpected budget overruns. Teradata can help.

Data Warehouse 98

Data Warehouse Cloud Data IT 98

dbt Developer Hub

JULY 2, 2023

The Data Vault data model is designed using a few well-applied principles, and in practice, pools source data so it is available for use by all downstream consumers. This promotes a scalable data warehouse through reusability and modularity. Should you consider Data Vault for your data warehouse?

Cloud 52

Cloud Data Warehouse Data BI 52

Cloudera

OCTOBER 13, 2020

On September 24, 2019, Cloudera launched CDP Public Cloud (CDP-PC) as the first step in delivering the industry’s first Enterprise Data Cloud. Over the past year, we’ve not only added Azure as a supported cloud platform, but we have improved the orginal services while growing the CDP-PC family significantly: Improved Services.

Cloud 92

Cloud Data Warehouse AWS NoSQL 92

Cloudera

NOVEMBER 12, 2020

Cloud has given us hope, with public clouds at our disposal we now have virtually infinite resources, but they come at a different cost – using the cloud means we may be creating yet another series of silos, which also creates unmeasurable new risks in security and traceability of our data. A solution.

Cloud 101

Cloud Data Warehouse Banking Data 101

Christophe Blefari

MARCH 1, 2023

dbt Core is an open-source framework that helps you organise data warehouse SQL transformation. dbt Labs also develop dbt Cloud which is a cloud product that hosts and runs dbt Core projects. This switch has been lead by modern data stack vision. With the public clouds—e.g. Enter the ELT.

Data Warehouse 278

Data Warehouse SQL Metadata Raw Data 278

Cloudera

MAY 10, 2021

The introduction of CDP Public Cloud has dramatically reduced the time in which you can be up and running with Cloudera’s latest technologies, be it with containerised Data Warehouse , Machine Learning , Operational Database or Data Engineering experiences or the multi-purpose VM-based Data Hub style of deployment.

Cloud 104

Cloud Consulting Data Warehouse Machine Learning 104

Data Engineering Podcast

MARCH 27, 2022

Summary Data governance is a practice that requires a high degree of flexibility and collaboration at the organizational and technical levels. The growing prominence of cloud and hybrid environments in data management adds additional stress to an already complex endeavor.

Data Governance 130

Data Governance Government Cloud Building 130

Cloud Academy

JUNE 7, 2022

How Do We Transform and Model Data at Cloud Academy? “Data is the new gold”: a common phrase over the last few years. For all organizations, data and information have become crucial to making good decisions for the future and having a clear understanding of how they’re making progress — or otherwise.

Cloud 52

Cloud Data Warehouse Raw Data Business Intelligence 52

Analytics Vidhya

FEBRUARY 25, 2023

The need for a data lake arises from the growing volume, variety, and velocity of data companies need to manage and analyze.

Cloud Storage 157

Cloud Storage Data Lake Cloud Unstructured Data 157

Cloud Academy

NOVEMBER 6, 2022

At Cloud Academy , we manage a lot of data every day. We have different sources we get data from such as feedback, events, and platform usage, and we need to get it, apply transformations, and finally present the data to our internal stakeholders and our customers. This is the responsibility of the BI tool.

Cloud 52

Cloud BI Data Warehouse Business Intelligence 52

Analytics Vidhya

FEBRUARY 8, 2023

Introduction Amazon Redshift is a fully managed, petabyte-scale data warehousing Amazon Web Services (AWS). It allows users to easily set up, operate, and scale a data warehouse in the cloud.

Amazon Web Services 221

Amazon Web Services AWS Data Warehouse Cloud 221

Cloudera

JANUARY 28, 2022

As I meet with our customers, there are always a range of discussions regarding the use of the cloud for financial services data and analytics. Customers vary widely on the topic of public cloud – what data sources, what use cases are right for public cloud deployments – beyond sandbox, experimentation efforts.

Cloud 111

Cloud Banking Data Governance Government 111

Cloudera

JANUARY 19, 2022

Gartner® recognized Cloudera in three recent reports – Magic Quadrant for Cloud Database Management Systems (DBMS), Critical Capabilities for Cloud Database Management Systems for Analytical Use Cases and Critical Capabilities for Cloud Database Management Systems for Operational Use Cases.

Database 88

Database Cloud Data Warehouse Data Lake 88

Cloudera

NOVEMBER 1, 2022

In the private sector, excluding highly regulated industries like financial services, the migration to the public cloud was the answer to most IT modernization woes, especially those around data, analytics, and storage. It’s here where the private cloud delivers.

Cloud 85

Cloud Government Cloud Computing Data Architecture 85

Cloudera

MAY 17, 2021

CDP (Cloudera Data Platform) Private Cloud 1.2 was recently released and builds on the success of CDP Private Cloud Base (see the 7.1.6 While Private Cloud Base is the ideal modernization of both CDH and HDP deployments for traditional workloads, Private Cloud adds cloud-native capabilities. Private Cloud 1.2

Cloud 88

Cloud Machine Learning Certification Data Warehouse 88

Snowflake

FEBRUARY 27, 2023

Data, a driving force for business performance In light of such massive growth, data management has steadily become more complex, to the point of introducing tangible risks. ” The migration from the existing data warehouse to the Snowflake platform took six months, with both being run in parallel during the last month.

Cloud 52

Cloud Retail Data Warehouse Data 52

Towards Data Science

MARCH 23, 2023

The difference between tables and views and how to use them Continue reading on Towards Data Science »

Data Warehouse 76

Data Warehouse Data Science Data Cloud Computing 76

Cloudera

JANUARY 27, 2021

We believe security is the cornerstone of any legitimate data platform, and we’re excited to announce that Cloudera has successfully achieved SOC 2 Type II certification for Cloudera Data Platform (CDP) Public Cloud. Achieving SOC 2 is one of the first milestones on our aggressive security and compliance roadmap.

Certification 101

Certification Cloud Data Warehouse Machine Learning 101

Data Engineering Podcast

OCTOBER 21, 2019

In this episode Dipti Borkar explains how the emerging category of data orchestration tools fills this need, some of the existing projects that fit in this space, and some of the ways that they can work together to simplify projects such as cloud migration and hybrid cloud environments.

Cloud 100

Cloud Data Lake Hadoop Programming Language 100

Snowflake

NOVEMBER 30, 2023

At TCS , we help companies shift their enterprise data warehouse (EDW) platforms to the cloud as well as offering IT services. We’re extremely familiar with just how tricky a cloud migration can be, especially when it involves moving historical business data.

Data Warehouse 93

Data Warehouse Banking Data Cloud 93

Christophe Blefari

APRIL 19, 2024

Up to 30TBs > Cloud warehouse or Spark Over 30TBs > Go Theseus. Hydra: the Postgres data warehouse — Postgres is one of the most used database, this week I discovered Hydra an open-source columnar port of Postgres aiming to create an open-source Snowflake. This is crazy how Theseus outperform Spark.

MySQL 130

MySQL Data Datasets SQL 130

Confessions of a Data Guy

JANUARY 12, 2023

Anyone who’s been roaming around the forest of Data Engineering has probably run into many of the newish tools that have been growing rapidly around the concepts of Data Warehouses, Data Lakes, and Lake Houses … the merging of the old relational database functionality with TB and PB level cloud-based file storage systems.

Data Lake 162

Data Lake Relational Database Data Warehouse Data Engineering 162

Cloudera

JANUARY 26, 2022

Modern, real-time businesses require accelerated cycles of innovation that are expensive and difficult to maintain with legacy data platforms. Cloud technologies and respective service providers have evolved solutions to address these challenges. . But how did the hybrid cloud come to dominate the data sector?

Cloud 84

Cloud Cloud Computing Hadoop Data Warehouse 84