Rockset

AUGUST 2, 2023

With 90% of trade being transported via sea , this data is crucial to keeping the global supply chain on track but can be difficult to disentangle and take action on. In 2022, Windward embarked on several changes to its application prompting a reconsideration of its underlying data stack.

Database-centric 52

Database-centric PostgreSQL Transportation Insurance 52

Cloudera

APRIL 3, 2023

In this blog, we will share with you in detail how Cloudera integrates core compute engines including Apache Hive and Apache Impala in Cloudera Data Warehouse with Iceberg. We will publish follow up blogs for other data services. Iceberg basics Iceberg is an open table format designed for large analytic workloads.

Data Warehouse 79

Data Warehouse Metadata Java Data 79

Airbnb Tech

NOVEMBER 28, 2023

In fact, more data, especially if you can’t rely on its quality, can hinder a company by slowing down decision-making or causing poor decisions. billion cumulative guest arrivals as of year-end 2022, Airbnb’s growth pushed us to an inflection point where diminishing data quality began to hinder our data practitioners.

Data Warehouse 98

Data Warehouse Metadata Data Certification 98

Cloudera

DECEMBER 16, 2022

We are pleased to announce that Cloudera has been named a Leader in the 2022 Gartner ® Magic Quadrant for Cloud Database Management Systems. Cloudera has long had the capabilities of a data lakehouse, if not the label. 4-Ready for modern data fabric architectures. 4-Ready for modern data fabric architectures.

Database 88

Database Cloud Systems Management 88

Data Engineering Weekly

JANUARY 15, 2023

SiliconANGLE theCUBE: Analyst Predictions 2023 - The Future of Data Management By far one of the best analyses of trends in Data Management. 2023 predictions from the panel are; Unified metadata becomes kingmaker. The blog narrates the causal machine-learning approach in designing promotional artwork for their TV shows.

Data Engineering 52

Data Engineering Data Engineer Engineering Metadata 52

AltexSoft

NOVEMBER 7, 2022

Other tech professionals working with the tool are solution architects , software developers, DevOps specialists, and data scientists. 2022 Airflow user overview. Metadata database. A metadata database stores information about user permissions, past and current DAG and task runs, DAG configurations, and more.

PostgreSQL 52

PostgreSQL Metadata Python MySQL 52

Monte Carlo

NOVEMBER 21, 2022

Pro-tip: be sure to check out his talk from IMPACT: The Data Observability Summit. That gives a lot of credence to the idea you can look at Snowflake’s revenues as a proxy for what’s happening in the larger data ecosystem. billion in four years, which underscores the terrific demand there is for cloud data warehouses.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Cloudera

JUNE 30, 2022

With Cloudera’s vision of hybrid data , enterprises adopting an open data lakehouse can easily get application interoperability and portability to and from on premises environments and any public cloud without worrying about data scaling. Why integrate Apache Iceberg with Cloudera Data Platform?

Data Lake 84

Data Lake Business Intelligence Metadata Data Warehouse 84

Cloudera

SEPTEMBER 9, 2022

This is the promise of the modern data lakehouse architecture. analyst Sumit Pal, in “Exploring Lakehouse Architecture and Use Cases,” published January 11, 2022: “Data lakehouses integrate and unify the capabilities of data warehouses and data lakes, aiming to support AI, BI, ML, and data engineering on a single platform.”

Architecture 97

Architecture Metadata Unstructured Data Machine Learning 97

Databand.ai

JULY 28, 2022

What is Data Lineage? Niv Sluzki 2022-07-28 10:20:02 The term “data lineage” has been thrown around a lot over the last few years. There are several commonly used techniques for data lineage that collect and store information about data throughout its lifecycle to allow for a visual representation.

Metadata 52

Metadata Data Lake Datasets Data Warehouse 52

Data Engineering Weekly

DECEMBER 4, 2022

The author narrates why the data models are still important for managing data assets' structure, content, and relationships but also need to keep agility in mind to bring business velocity. The article highlights the challenges of maintaining data models in a world where SQL data warehouses are no longer the primary data platform.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52

ProjectPro

JANUARY 31, 2022

As the demand for big data grows, an increasing number of businesses are turning to cloud data warehouses. The cloud is the only platform to handle today's colossal data volumes because of its flexibility and scalability. Launched in 2014, Snowflake is one of the most popular cloud data solutions on the market.

Architecture 52

Architecture IT Data Warehouse Amazon Web Services 52

dbt Developer Hub

NOVEMBER 3, 2022

In this blog post we’ll dive into how we tackled one source of quality issues: directly relying on upstream database schemas. We use Snowflake as our data warehouse where we build dashboards both for internal use and for customers. Under the hood, the Merit platform consists of a series of microservices.

Kafka 52

Kafka ETL Tools BI Database 52

Databand.ai

DECEMBER 29, 2022

The Top Data Strategy Influencers and Content Creators on LinkedIn Eitan Chazbani 2022-12-29 14:08:41 What’s the latest in the data world? Chad writes on data management, contracts, and products on his Substack blog and serves as an advisor and investor to several startups.

BI 52

BI Consulting Data Science Data Governance 52

Cloudera

JUNE 16, 2022

CSP was recently recognized as a leader in the 2022 GigaOm Radar for Streaming Data Platforms report. The DevOps/app dev team wants to know how data flows between such entities and understand the key performance metrics (KPMs) of these entities. The post Turning Streams Into Data Products appeared first on Cloudera Blog.

Kafka 84

Kafka Manufacturing Data Lake SQL 84

Snowflake

JUNE 27, 2023

We’re going to summarize these new capabilities in this blog post. Between when we began tracking the SPI on August 25, 2022 to April 30, 2023, query duration time improved by 15 percent for customers’ stable workloads in Snowflake. Based on internal Snowflake data from August 25, 2022 to April 30, 2023.

Data Governance 57

Data Governance Unstructured Data Government SQL 57