Cloudera

JUNE 18, 2022

Cloudera customers run some of the biggest data lakes on earth. These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. On data warehouses and data lakes. Iterations of the lakehouse.

Data Lake 89

Data Lake Data Warehouse BI SQL 89

databricks

FEBRUARY 23, 2023

In the previous article Prescriptive Guidance for Implementing a Data Vault Model on the Databricks Lakehouse Platform, we explained core concepts of data.

Data 94

Data 94

databricks

JUNE 13, 2023

To provide customers with a framework for planning and implementing their data lakehouse, we are pleased to announce that we have recently published.

Data 87

Data 87

databricks

MAY 31, 2023

Data ingestion into the Lakehouse can be a bottleneck for many organizations, but with Databricks, you can quickly and easily ingest data of.

Data Ingestion 85

Data Ingestion Data 85

Confluent

MARCH 19, 2024

Seamlessly integrate Apache Kafka data into your lakehouse as Apache Iceberg tables, bridging the operational and analytical divide, with Tableflow. Read more in our blog post.

Kafka 132

Kafka Data 132

Data Engineering Weekly

APRIL 14, 2024

Discover how a universal semantic layer is transforming modern business intelligence, making data more accessible and reliable for organizations striving for informed business decisions. The blog post brings in-depth insights into how Apache Hudi works on the right side, read side & underlying storage formats.

Data Engineering 62

Data Engineering Data Engineer Engineering Business Intelligence 62

databricks

NOVEMBER 8, 2023

This blog is the first of a series of blog posts highlighting industry-leading data providers we collaborate with and Marketplace data providers. Special.

Management 96

Management Data Manufacturing 96

Cloudera

APRIL 23, 2024

The Hackathon was intended to provide data science experts with access to Cloudera machine learning to develop their own Accelerated Machine Learning Project (AMP) focused on solving one of the many environmental challenges facing the world today. appeared first on Cloudera Blog.

Machine Learning 85

Machine Learning Data Science Retail Consulting 85

Cloudera

DECEMBER 1, 2023

These government-led efforts have had a profound impact on the development and adoption of AI solutions in the public sector, paving the way for a future where data-driven decision-making and automation are the norm. This requires a holistic approach that addresses the key areas of security, governance, and trustworthy data.

Building 105

Building Government Transportation Data Governance 105

databricks

NOVEMBER 3, 2023

In this four-part blog series "Lessons learned from building Cybersecurity Lakehouses," we will discuss a number of challenges organizations face with data engineering.

Data Engineering 79

Data Engineering Data Engineer Engineering Building 79

Data Engineering Weekly

MARCH 3, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Editor’s Note: Chennai, India Meetup - March-08 Update We are thankful to Ideas2IT to host our first Data Hero’s meetup.

Data Engineering 67

Data Engineering Data Engineer Pipeline-centric Engineering 67

databricks

NOVEMBER 8, 2023

In this four-part blog series “Lessons learned building Cybersecurity Lakehouses,” we are discussing a number of challenges organizations face with data engineering when bui.

Data Engineering 76

Data Engineering Data Engineer Engineering Building 76

databricks

AUGUST 30, 2023

It’s no secret that modern organizations are doubling down on their investments in data - investments that uncover deep customer insights that provide a.

Data 114

Data 114

Christophe Blefari

MARCH 17, 2023

If you live in a cave or if you only read my newsletter to get news about the data world you might have missed that GPT-4 has been announced and released this week. Data with Rust — This is a handbook that will showcase how to work in data engineering with Rust. How to be a good data analyst without good data.

Data 130

Data SQL Deep Learning Kafka 130

Data Engineering Weekly

NOVEMBER 26, 2023

It’s the end of the year, and there will be a lot of buzz about what the next five years in data engineering might bring. 🕵️‍♂️📈 Before we delve into the patterns, it's important to remember that data infrastructure maturity model. Who knows what insights we might uncover?

Data Engineering 70

Data Engineering Data Engineer Engineering Kafka 70

Cloudera

SEPTEMBER 26, 2023

Organizations increasingly rely on streaming data sources not only to bring data into the enterprise but also to perform streaming analytics that accelerate the process of being able to get value from the data early in its lifecycle.

Kafka 90

Kafka Technology IT Government 90

databricks

JUNE 20, 2023

This blog is the first of a 3-part series chronicling TD Bank's Data Platform transformation and the enablement of their Data as a.

Banking 96

Banking Data 96

databricks

JUNE 27, 2023

Generative AI will have a transformative impact on every business. Databricks has been pioneering AI innovations for a decade, actively collaborating with thousands.

Building 105

Building Data 105

Christophe Blefari

JUNE 3, 2023

I wanted to write more about Microsoft Fabric and the states of data that were published last week but I'll do it another time. The article is saying that it lays down with Japanese new strategy to become a leader in AI technologies, by removing barriers on training data they hope to open doors. Or several needles.

Data Pipeline 130

Data Pipeline Data SQL Algorithm 130

databricks

OCTOBER 25, 2023

Predictive Optimization intelligently optimizes your Lakehouse table data layouts for peak performance and cost-efficiency - without you needing to lift a finger.

Data 107

Data 107

Data Engineering Podcast

MARCH 10, 2024

Summary Data lakehouse architectures are gaining popularity due to the flexibility and cost effectiveness that they offer. The link that bridges the gap between data lake and warehouse capabilities is the catalog. Data lakes are notoriously complex. Your first 30 days are free! Want to see Starburst in action?

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Cloudera

JUNE 2, 2022

Since 2015, the Cloudera DataFlow team has been helping the largest enterprise organizations in the world adopt Apache NiFi as their enterprise standard data movement tool. This need has generated a market opportunity for a universal data distribution service. Why does every organization need it when using a modern data stack?

Systems 99

Systems Data Lake Google Cloud Data Collection 99

Data Engineering Weekly

MARCH 10, 2024

Editor’s Note: Chennai Meetup Wrap-Up & Preparation work started for DEWCon I am so grateful for the enthusiastic participants who made our Chennai Data Heroes- Community for Data Folks meetup vibrant! Big thanks to our insightful speakers, Hareshkumar Selvakumar - Talks about his work on Data Products for PayPal.

Data Engineering 52

Data Engineering Data Engineer Engineering Datasets 52

databricks

APRIL 26, 2023

One of Lakehouse's outstanding achievements is the ability to combine workloads for modern use cases, such as traditional BI, machine learning & AI.

Data Architecture 96

Data Architecture Architecture BI Machine Learning 96

Cloudera

AUGUST 9, 2022

With all of the buzz around cloud computing, many companies have overlooked the importance of hybrid data. The truth is, the future of data architecture is all about hybrid. As a leader in hybrid data, Cloudera is positioned to help organizations take on the challenge of managing and analyzing data wherever it resides.

Data Architecture 88

Data Architecture Architecture Cloud Computing Cloud 88

databricks

AUGUST 3, 2023

As cryptocurrencies, particularly Bitcoin, have grown in popularity, so has the phenomenon of Bitcoin mining. While normal mining operations are critical for blockchain.

Data 76

Data 76

Cloudera

AUGUST 8, 2022

In June 2022, Cloudera announced the general availability of Apache Iceberg in the Cloudera Data Platform (CDP). Iceberg is a 100% open-table format, developed through the Apache Software Foundation , which helps users avoid vendor lock-in and implement an open lakehouse. . Cloudera Data Engineering (Spark 3) with Airflow enabled.

Data Warehouse 88

Data Warehouse BI Machine Learning SQL 88

Cloudera

MARCH 26, 2024

Cloudera: Your Trusted Partner in AI With over 25 Exabytes of Data Under Management and hundreds of customers leveraging our platform for Machine Learning, Cloudera has a long and successful history as an industry leader. ” said Sanjeev Mohan, Principal, SanjMo & Former Gartner Research VP, Data & Analytics.

Machine Learning 79

Machine Learning Banking Professional Services Architecture 79

Cloudera

SEPTEMBER 15, 2022

Cloudera Contributor: Mark Ramsey, PhD ~ Globally Recognized Chief Data Officer. July brings summer vacations, holiday gatherings, and for the first time in two years, the return of the Massachusetts Institute of Technology (MIT) Chief Data Officer symposium as an in-person event. Luke: What is a modern data platform?

Data Lake 79

Data Lake Analytics Application Cloud Storage Architecture 79

Cloudera

JUNE 7, 2022

We live in a hybrid data world. In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB.

IT 108

IT Unstructured Data Data Architecture Government 108

databricks

JUNE 14, 2023

Collecting, analyzing, and acting on proprietary data is critical for companies to achieve a competitive edge in customer experience. But it can be.

Data 71

Data IT 71

Cloudera

FEBRUARY 23, 2023

Solving this crisis can and should be supported by insights gained from the vast amounts of data available to healthcare providers and government agencies. With CDP, KMC was able to develop the aptly named Controlled Substance Analytics platform to leverage data analytics in the fight against opioid abuse and misuse.

Data Analytics 76

Data Analytics Electronics Pharmaceutical Medical 76

Data Engineering Weekly

JUNE 8, 2023

Welcome to another episode of Data Engineering Weekly. Aswin and I select 3 to 4 articles from each edition of Data Engineering Weekly and discuss them from the author’s and our perspectives. A couple of thing stands out for me in the blog. Instacart adoption of Databricks ecosystem along with Snowflake.

Architecture 57

Architecture SQL Data Pipeline Data Engineering 57

databricks

AUGUST 14, 2023

One of the key challenges that organizations face when adopting the open data lakehouse is selecting the optimal format for their data.

Data 94

Data Engineering 94

Christophe Blefari

JULY 3, 2023

This is a small wrap-up from the Snowflake and Databricks Data + AI summits which have taken place last week. 💡 If you want another view on both the conferences Ananth from Data Engineering Weekly wrote about the conferences extravaganza and a few trends he wanted to chat about. Still here the newsletter for last week.

SQL 130

SQL Data Kafka AWS 130

databricks

APRIL 5, 2023

This is a collaborative post between Databricks and Quest Software. We thank Vani Mishra, Director of Product Management at Quest Software for her.

Data 72

Data Management 72

databricks

SEPTEMBER 12, 2023

As the lakehouse becomes increasingly mission-critical to data-forward organizations, so too grows the risk that unexpected events, outages, and security incidents may derail.

Systems 79

Systems Data 79