Cloudera

AUGUST 9, 2022

With all of the buzz around cloud computing, many companies have overlooked the importance of hybrid data. The truth is, the future of data architecture is all about hybrid. We’ve seen this from all of our customers and are emphasizing building and iterating on modern data architectures. Do we need more than one?

Data Architecture 90

Data Architecture Architecture Cloud Computing Cloud 90

Snowflake

JULY 27, 2023

In this guest blog post, HomeToGo’s director of data, Stephan Claus, explains why the company migrated to Snowflake to meet its data needs. This article is based on Stephan’s presentation during the Snowflake Data World Tour 2022. Over the course of this journey, HomeToGo’s data needs have evolved considerably.

Data Architecture 52

Data Architecture Architecture Building Structured Data 52

Cloudera

SEPTEMBER 29, 2022

Each of these trends claim to be complete models for their data architectures to solve the “everything everywhere all at once” problem. Data teams are confused as to whether they should get on the bandwagon of just one of these trends or pick a combination. First, we describe how data mesh and data fabric could be related.

Architecture 74

Architecture Data Architecture Metadata Data Warehouse 74

Cloudera

JULY 29, 2022

As my colleague Wim Stoop previously shared, “A well-planned enterprise data strategy helps companies get the most of their data, making it known, discoverable, available, trusted, and compliant. This does not mean ‘one of each’ – a public cloud data strategy and an on-prem data strategy.

Data Architecture 86

Data Architecture Architecture Unstructured Data Government 86

Cloudera

MAY 14, 2024

To attain that level of data quality, a majority of business and IT leaders have opted to take a hybrid approach to data management, moving data between cloud, on-premises -or a combination of the two – to where they can best use it for analytics or feeding AI models. appeared first on Cloudera Blog.

Cloud 96

Cloud Data Governance Unstructured Data Data Architecture 96

Cloudera

NOVEMBER 7, 2023

Are you struggling to manage the ever-increasing volume and variety of data in today’s constantly evolving landscape of modern data architectures? This blog post is intended to provide guidance to Ozone administrators and application developers on the optimal usage of the bucket layouts for different applications.

Systems 103

Systems Hadoop Unstructured Data Media 103

Cloudera

MAY 10, 2024

Iceberg, a high-performance open-source format for huge analytic tables, delivers the reliability and simplicity of SQL tables to big data while allowing for multiple engines like Spark, Flink, Trino, Presto, Hive, and Impala to work with the same tables, all at the same time.

Government 101

Government Data Governance Data Pipeline Big Data 101

Cloudera

FEBRUARY 15, 2024

Seeing the future in a modern data architecture The key to successfully navigating these challenges lies in the adoption of a modern data architecture. The promise of a modern data architecture might seem like a distant reality, but we at Cloudera believe data can make what is impossible today, possible tomorrow.

Insurance 86

Insurance Banking Data Architecture Data Ingestion 86

Snowflake

JUNE 28, 2023

By bringing compute closer to the data businesses can eliminate data silos, address security and governance challenges, and optimize operations, leading to enhanced efficiency, all while avoiding the management overhead associated with additional systems and infrastructure.

Python 52

Python Accessible Accessibility Pipeline-centric 52

Cloudera

MAY 30, 2024

They offer strategic advisory, implementation services, and support around Cloudera products, utilizing Cloudera’s Enterprise Data Hub to create a unified platform for clients to store, access, and analyze unlimited data from multiple frameworks securely and efficiently.

Data Analytics 79

Data Analytics Banking Insurance Finance 79

Data Engineering Weekly

APRIL 28, 2024

[link] Netflix: Data Gateway — A Platform for Growing and Protecting the Data Tier Netflix's Data Gateway is a platform designed to enhance and safeguard the data tier by providing a unified interface for accessing data across various sources while ensuring security and compliance.

Data Engineering 52

Data Engineering Data Engineer Engineering Hospitality 52

Cloudera

OCTOBER 19, 2023

While navigating so many simultaneous data-dependent transformations, they must balance the need to level up their data management practices—accelerating the rate at which they ingest, manage, prepare, and analyze data—with that of governing this data.

Telecommunication 75

Telecommunication Data Architecture Government Architecture 75

Cloudera

FEBRUARY 2, 2024

We do this by integrating the data capture, movement, message brokering, stream processing, and analytics capabilities of Nifi, Kafka, and Flink into a single platform with developer tooling to maintain development velocity as organizations scale, take on new data sources, and evolve to meet changing business requirements.

Kafka 100

Kafka Architecture Data Architecture Cloud 100

Cloudera

MAY 9, 2023

The company also provides a variety of solutions for enterprises, including data centers, cloud, security, global, artificial intelligence (AI), IoT, and digital marketing services. Supporting Data Access to Achieve Data-Driven Innovation Due to the spread of COVID-19, demand for digital services has increased at SoftBank.

Data Security 89

Data Security Telecommunication Data Lake Data Governance 89

Cloudera

JANUARY 30, 2023

And this doesn’t even touch on the data generated by citizen services interfaces, machine or device-generated data such as video feeds, sensors, and communications data. The purpose of this blog isn’t to emphasize the cyber risk of dark data but to spotlight its implications. The list could go on and on.

Media 82

Media Government Data Lake Professional Services 82

Cloudera

DECEMBER 1, 2023

This summer’s MOVEit data breach has impacted over 2,600 organizations and 70,500,000 people worldwide, including Maximus (11 million), the state of Maine (1.3 The post Building Trust in Public Sector AI Starts with Trusting Your Data appeared first on Cloudera Blog. million), among others.

Building 108

Building Government Transportation Data Governance 108

Data Engineering Weekly

JULY 30, 2023

Oh, just throw this data in S3 and possibly apply intelligent tiering. data engineer, you won’t be surprised to hear this. The blog from All Things Distributed goes behind the scene on the challenges of operating S3 with the data placement strategy and managing machine heat and human factors. If you’re a.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Cloudera

JUNE 7, 2022

Companies can now capitalize on the value in all their data, by delivering a hybrid data platform for modern data architectures with data anywhere. Cloudera Data Platform (CDP) is designed to address the critical requirements for modern data architectures today and tomorrow.

IT 110

IT Unstructured Data Data Architecture Government 110

DataKitchen

AUGUST 3, 2021

The data mesh design pattern breaks giant, monolithic enterprise data architectures into subsystems or domains, each managed by a dedicated team. The communication between business units and data professionals is usually incomplete and inconsistent. Introduction to Data Mesh. Source: Thoughtworks.

Pharmaceutical 98

Pharmaceutical Data Lake Data Architecture Scala 98

Cloudera

MAY 2, 2022

But increasingly at Cloudera, our clients are looking for a hybrid cloud architecture in order to manage compliance requirements. This is not just to implement specific governance rules — such as tagging, metadata management, access controls, or anonymization — but to prepare for the potential for rules to change in the future. .

Cloud 101

Cloud Government Healthcare Metadata 101

Snowflake

FEBRUARY 21, 2023

In this Q&A, we hear from Nico Acosta, CEO and Co-Founder of Propel, about how his company is building an API platform to equip developers to build with data, and why data architecture is the most important technical decision a company will make. Businesses that can’t fully use their data will eventually die.

AWS 121

AWS Raw Data Building Architecture 121

Snowflake

MARCH 7, 2024

In this blog post, we’ll walk through what the actual capabilities of LLMs are, and the steps financial organizations should take to harness this technology effectively and safely. How do Gen AI/LLMs “democratize” access to insights? But what might this transformation look like, from practical applications to potential risks?

Unstructured Data 83

Unstructured Data Government Data Architecture Architecture 83

Cloudera

OCTOBER 19, 2022

The telecommunications industry continues to develop hybrid data architectures to support data workload virtualization and cloud migration. Telco organizations are planning to move towards hybrid multi-cloud to manage data better and support their workforces in the near future. 2- AI capability drives data monetization.

Cloud 78

Cloud Telecommunication Data Governance Government 78

Cloudera

FEBRUARY 22, 2022

Over the past decade, the successful deployment of large scale data platforms at our customers has acted as a big data flywheel driving demand to bring in even more data, apply more sophisticated analytics, and on-board many new data practitioners from business analysts to data scientists.

Metadata 107

Metadata Datasets BI SQL 107

Cloudera

SEPTEMBER 12, 2022

Combining and analyzing both structured and unstructured data is a whole new challenge to come to grips with, let alone doing so across different infrastructures. Both obstacles can be overcome using modern data architectures, specifically data fabric and data lakehouse. Unified data fabric. Better together.

Unstructured Data 74

Unstructured Data Data Lake Data Architecture Data 74

Cloudera

SEPTEMBER 8, 2022

The management of data assets in multiple clouds is introducing new data governance requirements, and it is both useful and instructive to have a view from the TM Forum to help navigate the changes. . The post New Practices in Data Governance and Data Fabric for Telecommunications appeared first on Cloudera Blog.

Telecommunication 78

Telecommunication Data Governance Government Portfolio 78

Cloudera

MARCH 17, 2023

As the use of ChatGPT becomes more prevalent, I frequently encounter customers and data users citing ChatGPT’s responses in their discussions. I love the enthusiasm surrounding ChatGPT and the eagerness to learn about modern data architectures such as data lakehouses, data meshes, and data fabrics.

Education 62

Education Unstructured Data Data Lake Data Warehouse 62

Cloudera

OCTOBER 7, 2021

In this blog, I will demonstrate the value of Cloudera DataFlow (CDF) , the edge-to-cloud streaming data platform available on the Cloudera Data Platform (CDP) , as a Data integration and Democratization fabric. Components of a Data Mesh. How CDF enables successful Data Mesh Architectures.

Architecture 124

Architecture Metadata Government Kafka 124

AltexSoft

FEBRUARY 11, 2023

What’s more, investing in data products, as well as in AI and machine learning was clearly indicated as a priority. This suggests that today, there are many companies that face the need to make their data easily accessible, cleaned up, and regularly updated. This privacy law must be kept in mind when building data architecture.

Data Architect 87

Data Architect Certification Generalist Big Data 87

Snowflake

DECEMBER 20, 2023

Accessing the necessary resources from cloud providers demands careful planning and up to month-long wait times due to the high demand for GPUs. You can read more about their experience with Snowpark Container Services in this two-part blog series ( part 1 , part 2 ). What makes Snowpark Container Services unique?

Scala 119

Scala Government Java AWS 119

Snowflake

AUGUST 21, 2023

Given the popularity and continued growth of data mesh, many of today’s leading compute, storage, and data security platforms are also evolving to support and enable it. Data-as-a-product: By considering data resources through a product lens, teams can adopt practices centered around quality and ease of use.

Pipeline-centric 52

Pipeline-centric Architecture Government Data Architect 52

Data Engineering Weekly

MARCH 3, 2024

This approach led to a successful expansion of Copilot access across the engineering team, resulting in a significant increase in productivity and adoption, demonstrating a commitment to enhancing developer experience while maintaining safety and security standards. link] Nvidia: What Is Sovereign AI?

Data Engineering 67

Data Engineering Data Engineer Pipeline-centric Engineering 67

Cloudera

JULY 19, 2023

As Ozone scales to exabytes of data, it is important to ensure that Ozone Manager can perform at scale. In this blog post, we will highlight the work done recently to improve the performance of Ozone Manager to scale to exabytes of data. The hardware specifications are included at the end of this blog.

Management 70

Management Metadata Datasets Architecture 70

Cloudera

NOVEMBER 27, 2023

This blog is a summary of what we observed there for anyone who was unable to attend or just wants to stay on top of what’s happening in streaming. By democratizing access to streaming data, and bringing domain expert users into the development cycle, we help accelerate iterations on stream processing applications. Takeaway No.

Kafka 82

Kafka SQL ETL Tools Data Lake 82

Cloudera

NOVEMBER 1, 2022

Through modern data architectures powered by CDP, including Cloudera-enabled data fabric, data lakehouse, and data mesh , DoD agencies can rapidly provision and manage innovative data engineering, data warehouse, and machine learning environments, with access to secured supply chain data stored in CDP Private Cloud.

Cloud 87

Cloud Government Cloud Computing Data Architecture 87

Data Engineering Weekly

FEBRUARY 25, 2024

link] Berkeley Artificial Intelligence Research (BAIR): The Shift from Models to Compound AI Systems The Berkeley AI Research (BAIR) blog discusses the evolution from focusing on single large language models (LLMs) to developing compound AI systems that integrate multiple components, including LLMs, for superior performance.

Data Engineering 62

Data Engineering Data Engineer Engineering Kafka 62

Cloudera

JUNE 30, 2022

Companies, on the other hand, have continued to demand highly scalable and flexible analytic engines and services on the data lake, without vendor lock-in. Organizations want modern data architectures that evolve at the speed of their business and we are happy to support them with the first open data lakehouse. .

Data Lake 86

Data Lake Business Intelligence Metadata Data Warehouse 86