DataKitchen

MAY 10, 2021

As organizations strive to become more data-driven, Forrester recommends 5 actions to take to move from one stage of insights-driven business maturity to another. . Intermediates: Build on your successes and work to scale your IDB capabilities across the enterprise using agile and adaptive DevOps, DataOps, and ModelOps processes. .

Data Architecture 52

Data Architecture Machine Learning Data Science Government 52

Ascend.io

AUGUST 31, 2023

In the dynamic world of data, many professionals are still fixated on traditional patterns of data warehousing and ETL, even while their organizations are migrating to the cloud and adopting cloud-native data services. Modern platforms like Redshift , Snowflake , and BigQuery have elevated the data warehouse model.

Data Lake 52

Data Lake ETL Tools Data Warehouse Data Pipeline 52

Rockset

JANUARY 3, 2023

This blog compiles real-time data predictions from industry leaders so you know what’s coming in 2023. Confluent’s State of Data in Motion Report found that 97% of companies around the world are using streaming data, making it central to the data landscape.

Data Warehouse 52

Data Warehouse Education Database Data 52

Databand.ai

DECEMBER 13, 2022

The Top 25 Data Engineering Influencers and Content Creators on LinkedIn Ryan Yackel 2022-12-13 10:23:19 Interested in data engineering? LinkedIn is full of influencers sharing new ideas and sparking conversations on all kinds of topics, and data engineering is no exception. You’ve come to the right place. Happy following!

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Monte Carlo

APRIL 16, 2022

The data warehouse is the foundation of the modern data stack, so it caught our attention when we saw Convoy head of data Chad Sanderson declare, “ the data warehouse is broken ” on LinkedIn. I’ll let you decide for yourself if the “immutable data warehouse” (or active vs passive ETL) is the right path for your data team.

Data Warehouse 52

Data Warehouse Architecture Data Government 52

Data Engineering Podcast

MARCH 24, 2024

Summary A core differentiator of Dagster in the ecosystem of data orchestration is their focus on software defined assets as a means of building declarative workflows. Data lakes are notoriously complex. Go to dataengineeringpodcast.com/dagster today to get started. Your first 30 days are free! Want to see Starburst in action?

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Data Engineering Weekly

APRIL 28, 2024

Intuit: The Data Mesh Strategy Behind Intuit’s Global Financial Technology Platform The Data Product Builder platform is becoming increasingly important in enterprise data engineering. It offers more targeted and customized data asset building than the general-purpose data stack.

Data Engineering 52

Data Engineering Data Engineer Engineering Hospitality 52

Snowflake

FEBRUARY 6, 2023

The mantra is “earn your turns.” Now think of the growing demand for data and insights. Now think of the growing demand for data and insights. Data mesh offers an answer in four principles The data mesh paradigm set out to solve some of these issues. But it’s not a free-for-all.

Government 64

Government Data Data Pipeline Architecture 64

Cloudera

JULY 11, 2022

The need for data fabric. As Cloudera CMO David Moxey outlined in his blog , we live in a hybrid data world. Data is growing and continues to accelerate its growth. Driving insight and value from it all is as much of an opportunity as it is a challenge. Cloudera data fabric and analyst acclaim.

Data Architecture 109

Data Architecture Architecture Data Government 109

Knowledge Hut

JANUARY 18, 2024

Picture this: every day, we generate a mind-boggling amount of data. From social media posts and online transactions to sensor readings and healthcare records, data is the fuel that powers modern businesses and organizations. To put that into perspective, that's equivalent to 212,765,957 DVDs worth of data!

Data Analytics 52

Data Analytics Healthcare Machine Learning Algorithm 52

Cloudera

AUGUST 30, 2022

Data is the fuel that drives government, enables transparency, and powers citizen services. That should be easy, but when agencies don’t share data or applications, they don’t have a unified view of people. Legacy data sharing involves proliferating copies of data, creating data management, and security challenges.

Data Architecture 80

Data Architecture Architecture Data Lake NoSQL 80

Cloudera

MAY 2, 2022

As digital transformation accelerates, and digital commerce increasingly becomes the dominant form of all commerce, regulators and governments around the world are recognizing the increased need for consumer protections and data protection measures.

Cloud 104

Cloud Government Healthcare Metadata 104

Picnic Engineering

JULY 26, 2022

Data Mesh, or Hub-and-Spoke? and other reflections on building data governance. What are your thoughts on the topic of Data Mesh, and whether to adopt it at Picnic? As a Data Lead, I feel that I don’t have the best seat at the organizational table. What exactly is a “lakeless” Data Warehouse?

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Data Engineering Podcast

MAY 18, 2021

Summary Data lineage is the common thread that ties together all of your data pipelines, workflows, and systems. In order to get a holistic understanding of your data quality, where errors are occurring, or how a report was constructed you need to track the lineage of the data from beginning to end.

Metadata 100

Metadata Kafka Data Warehouse Hadoop 100

Monte Carlo

NOVEMBER 21, 2022

What’s next for the future of data engineering? Each year, we chat with one of our industry’s pioneering leaders about their predictions for the modern data stack – and share a few of our own. Pro-tip: be sure to check out his talk from IMPACT: The Data Observability Summit.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Monte Carlo

APRIL 24, 2023

In an evolving data landscape, the explosion of new tooling solutions—from cloud-based transforms to data observability —has made the question of “build versus buy” increasingly important for data leaders. But it’s not just our data platform that impacts how we define the problem and its solution.

Data Pipeline 52

Data Pipeline Building Data Ingestion BI 52

AltexSoft

AUGUST 22, 2022

The landscape of enterprise data is fragmented. Organizations have data stored in public and private clouds, as well as in various on-premises data repositories. Some would say that it’s not a big deal, however, these mixed environments have resulted in the complexities of managing disjointed data and business processes.

Architecture 52

Architecture Metadata Data Lake Machine Learning 52

Monte Carlo

JANUARY 12, 2024

The concept of big data – complicated datasets that are too dense for traditional computing setups to deal with – is nothing new. But what is new, or still developing at least, is the extent to which data engineers can manage, data scientists can experiment, and data analysts can analyze this treasure trove of raw business insights.

Big Data 59

Big Data Data Analytics Data Science Data Lake 59

Snowflake

JULY 13, 2023

As we continue to revolutionize the way businesses operate, allowing them to solve their most pressing problems and drive revenue through the Data Cloud, the insights, expertise, and experiences we offer at Summit have continued to grow. More customers are using native applications to power modern customer experiences.

Entertainment 57

Entertainment Manufacturing Retail Media 57

Databand.ai

DECEMBER 20, 2022

The Top Data Analytics and Science Influencers and Content Creators on LinkedIn Ryan Yackel 2022-12-20 11:06:32 If you’re looking to brush up on all things data analytics and science, then LinkedIn certainly has no shortage of content. But for all the nuggets of wisdom, there’s a lot of noise to sift through.

Data Analytics 52

Data Analytics Google Cloud Data Science Data Mining 52

Monte Carlo

MAY 19, 2022

In his seminal 2017 blog post, The Downfall of the Data Engineer , Maxime Beauchemin wrote that the data engineer had the worst seat at the table. So, if the data engineer no longer has the worst seat at the table, who then on the data team has inherited this unfortunate title? Quite the opposite in fact.

Generalist 52

Generalist Data Governance Government Metadata 52

Knowledge Hut

SEPTEMBER 29, 2023

Jenkins vs Azure DevOps: Platform Support With Jenkins' agent-centric model, builds and deployments across multiple platforms were feasible. Azure DevOps, especially through Azure Pipelines, mirrored this proficiency, rendering extensive cross-platform support. In stark contrast, Azure DevOps provides an amalgamated experience.

Pipeline-centric 52

Pipeline-centric Cloud Coding Project 52

phData: Data Engineering

JULY 18, 2023

The Ultimate Modern Data Stack Migration Guide phData Marketing July 18, 2023 This guide was co-written by a team of data experts, including Dakota Kelley, Ahmad Aburia, Sam Hall, and Sunny Yan. Imagine a world where all of your data is organized, easily accessible, and routinely leveraged to drive impactful outcomes.

Data Warehouse 52

Data Warehouse Pipeline-centric Government Data 52

Data Engineering Weekly

JULY 30, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles, so you can quickly ship actionable, enriched data to every downstream team. We handle Petabytes of data!!! All our data is in S3!!! See how it works today.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Towards Data Science

NOVEMBER 4, 2023

Platform Specific Tools and Advanced Techniques Photo by Christopher Burns on Unsplash The modern data ecosystem keeps evolving and new data tools emerge now and then. In this article, I want to talk about crucial things that affect data engineers. Are your data pipelines efficient? Data warehouse exmaple.

Data Engineering 87

Data Engineering Data Engineer Engineering BI 87

Monte Carlo

APRIL 20, 2023

Data lineage is a visual diagram showing how data flows through your ETL pipeline from ingestion to consumption. Solutions with automated data lineage capabilities constantly update these graphs and illustrate them as nodes and edges, or in other words, the objects through which the data travels and the relationship between them.

Data Warehouse 52

Data Warehouse BI Government Data 52

Monte Carlo

AUGUST 19, 2023

A data platform, often referred to as a ‘modern data stack,’ is the central processing hub for an organization’s data ecosystem. A comprehensive data platform solution powers data acquisition, storage, preparation, delivery, governance, and even the robust security needs of users and applications.

Building 52

Building BI Data Lake Data Governance 52

Christophe Blefari

NOVEMBER 18, 2023

Still I've accumulated a lot of articles that I think should fit in the Data News so this week might be a huge recap of content that has been produce in the last month. On Monday I'll also give a talk at Berlin MotherDuck meetup : DuckDB experiments, a glimpse of the future. I hope you will enjoy the selection.

Food 147

Food Data Data Lake Retail 147