Cloudera

MARCH 26, 2024

Cloudera: Your Trusted Partner in AI With over 25 Exabytes of Data Under Management and hundreds of customers leveraging our platform for Machine Learning, Cloudera has a long and successful history as an industry leader. ” said Sanjeev Mohan, Principal, SanjMo & Former Gartner Research VP, Data & Analytics.

Machine Learning 81

Machine Learning Banking Professional Services Architecture 81

Pinterest Engineering

JANUARY 9, 2024

In this blog we will deep dive into some of our recent advancements in machine learning modeling to connect pinners with the most relevant ads. This blog post will focus on our recent improvements on improving the models that predict offsite conversions given a user request on Pinterest.

Machine Learning 76

Machine Learning Architecture Engineering Utilities 76

The Modern Data Company

JANUARY 31, 2023

Another year, another chance to learn more about the world of data. In 2023, The Modern Data Company (Modern) hopes to reach more companies and organizations with our data operating system, build incredible value from existing and upcoming data assets, and share insights into major shifts in what it means to be data-driven.

Retail 98

Retail Healthcare Data Architecture Data Pipeline 98

Christophe Blefari

JANUARY 20, 2023

Summer in coming ( credits ) Hey, new Friday, new Data News edition. Thank you for every recommendation you do about the blog or the Data News. The current state of data This week Benjamin Rogojan livestreamed an online conference featuring awesome data voices: state of data infra.

Google Cloud 130

Google Cloud Data Hadoop Machine Learning 130

Cloudera

SEPTEMBER 26, 2023

Organizations increasingly rely on streaming data sources not only to bring data into the enterprise but also to perform streaming analytics that accelerate the process of being able to get value from the data early in its lifecycle.

Kafka 92

Kafka Technology IT Government 92

Data Engineering Weekly

APRIL 28, 2024

Intuit: The Data Mesh Strategy Behind Intuit’s Global Financial Technology Platform The Data Product Builder platform is becoming increasingly important in enterprise data engineering. It offers more targeted and customized data asset building than the general-purpose data stack.

Data Engineering 52

Data Engineering Data Engineer Engineering Hospitality 52

Snowflake

APRIL 18, 2024

Legacy security information and event management (SIEM) solutions, like Splunk, are powerful tools for managing and analyzing machine-generated data. This model can force security teams to make difficult decisions on what data to ingest. This blog post explores how Snowflake can help with this challenge.

Data Lake 80

Data Lake Data Ingestion Bytes Cloud Computing 80

Pinterest Engineering

MAY 13, 2024

Alberto Ordonez Pereira | Senior Staff Software Engineer; Lianghong Xu | Senior Manager, Engineering; This blog marks the first of a three-part series describing our journey at Pinterest transition from managing multiple online storage services supported by HBase to a brand new serving architecture with a new datastore and a unified storage service.

NoSQL 69

NoSQL MySQL Database Systems 69

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. Atlan is the metadata hub for your data ecosystem.

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Christophe Blefari

DECEMBER 30, 2022

💡 You can also read the 2021's must-read that I've done one year and half ago or how to learn data engineering that contains key articles to understand the field. Once again thank you everyone for your support this year and see you next week for the first Data News of 2023. Now let's jump to my selection.

Data Warehouse 130

Data Warehouse BI Data Machine Learning 130

Data Engineering Weekly

APRIL 14, 2024

Discover how a universal semantic layer is transforming modern business intelligence, making data more accessible and reliable for organizations striving for informed business decisions. The blog post brings in-depth insights into how Apache Hudi works on the right side, read side & underlying storage formats.

Data Engineering 62

Data Engineering Data Engineer Engineering Business Intelligence 62

Cloudera

FEBRUARY 1, 2024

Delivering transformational innovation and accurate business decisions requires harnessing the full potential of your organization’s entire data ecosystem. Ultimately, this boils down to how reliable and trustworthy the underlying data that feeds your insights and applications is. How does Cloudera support Day 2 operations?

Cloud 81

Cloud Architecture Utilities Designing 81

Data Engineering Podcast

JUNE 19, 2022

Summary Metadata is the lifeblood of your data platform, providing information about what is happening in your systems. In order to level up their value a new trend of active metadata is being implemented, allowing use cases like keeping BI reports up to date, auto-scaling your warehouses, and automated data governance.

Metadata 130

Metadata MongoDB Scala MySQL 130

Data Engineering Weekly

APRIL 7, 2024

Poor data quality and unlcear data ownership remains the top challenges for the data teams. Data Mesh continuously gaining popularity among the enterprises. It is a stark difference from the Gartner report about data mesh. I guess only the time will tell who wins in the data mesh vs data fabric war.

Data Engineering 70

Data Engineering Data Engineer Engineering Unstructured Data 70

Cloudera

JUNE 27, 2023

During the COVID-19 pandemic, telcos made unprecedented use of data and data-driven automation to optimize their network operations, improve customer support, and identify opportunities to expand into new markets. There are savings to be made in modernizing the data stack itself, in addition to applying data across the enterprise.

Data Architecture 62

Data Architecture Architecture Data Governance Government 62

Cloudera

AUGUST 9, 2022

With all of the buzz around cloud computing, many companies have overlooked the importance of hybrid data. The truth is, the future of data architecture is all about hybrid. As a leader in hybrid data, Cloudera is positioned to help organizations take on the challenge of managing and analyzing data wherever it resides.

Data Architecture 89

Data Architecture Architecture Cloud Computing Cloud 89

Data Engineering Weekly

MARCH 3, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Editor’s Note: Chennai, India Meetup - March-08 Update We are thankful to Ideas2IT to host our first Data Hero’s meetup.

Data Engineering 67

Data Engineering Data Engineer Pipeline-centric Engineering 67

Data Engineering Weekly

NOVEMBER 5, 2023

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Netflix: Streaming SQL in Data Mesh Learnings from our journey In hindsight, we wish we had invested in enabling Flink SQL on the DataMesh platform much earlier.

Data Engineering 52

Data Engineering Data Engineer Engineering SQL 52

Cloudera

JUNE 7, 2022

We live in a hybrid data world. In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB.

IT 109

IT Unstructured Data Data Architecture Government 109

Data Engineering Weekly

FEBRUARY 11, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Editors Note: A Survey on the current state of Data Products. What do you think of Data Products? Is Modern Data Stack still a useful idea?

Data Engineering 62

Data Engineering Data Engineer Engineering SQL 62

Cloudera

DECEMBER 13, 2023

Implementing a cohesive data vision LGIM’s Global Chief Operating Office is responsible for the company’s technology, data, client servicing and the management of its strategic operating agenda. This includes delivering a transformation project to modernize LGIM, enable growth, and introduce more scalable and seamless services.

Pipeline-centric 88

Pipeline-centric Professional Services Datasets BI 88

Data Engineering Weekly

SEPTEMBER 24, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. Airflow isn’t meant to process the data. See how it works today.

Data Engineering 67

Data Engineering Data Engineer Engineering Kafka 67

Cloudera

SEPTEMBER 15, 2022

Cloudera Contributor: Mark Ramsey, PhD ~ Globally Recognized Chief Data Officer. July brings summer vacations, holiday gatherings, and for the first time in two years, the return of the Massachusetts Institute of Technology (MIT) Chief Data Officer symposium as an in-person event. Luke: What is a modern data platform?

Data Lake 80

Data Lake Analytics Application Cloud Storage Architecture 80

Knowledge Hut

DECEMBER 22, 2023

Benefits: Personalized User Experience Automation and Efficiency Advanced Data Analysis Chatbots and Virtual Assistants Examples: Implementing chatbots on websites to provide instant customer support and assistance. Utilizing machine learning algorithms to analyze user data and deliver personalized content recommendations.

Entertainment 105

Entertainment Utilities Machine Learning AWS 105

Data Engineering Podcast

MAY 1, 2022

Summary Building a data platform is an iterative and evolutionary process that requires collaboration with internal stakeholders to ensure that their needs are being met. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Warehouse 100

Data Warehouse Data Lake Architecture Data 100

Data Engineering Weekly

NOVEMBER 26, 2023

It’s the end of the year, and there will be a lot of buzz about what the next five years in data engineering might bring. 🕵️‍♂️📈 Before we delve into the patterns, it's important to remember that data infrastructure maturity model. Who knows what insights we might uncover?

Data Engineering 70

Data Engineering Data Engineer Engineering Kafka 70

Cloudera

NOVEMBER 1, 2022

It’s no secret that IT modernization is a top priority for the US federal government. These systems also pose security risks, including the inability to use current security best practices, such as data encryption and multi-factor authentication, making these systems particularly vulnerable to malicious cyber activity.

Cloud 86

Cloud Government Cloud Computing Data Architecture 86

Data Engineering Podcast

FEBRUARY 6, 2022

Summary Along with globalization of our societies comes the need to analyze the geospatial and geotemporal data that is needed to manage the growth in commerce, communications, and other activities. Atlan is a collaborative workspace for data-driven teams, like Github for engineering or Figma for design teams.

SQL 100

SQL Building IT Google Cloud 100

Cloudera

DECEMBER 1, 2023

These government-led efforts have had a profound impact on the development and adoption of AI solutions in the public sector, paving the way for a future where data-driven decision-making and automation are the norm. This requires a holistic approach that addresses the key areas of security, governance, and trustworthy data.

Building 107

Building Government Transportation Data Governance 107

Data Engineering Podcast

APRIL 16, 2022

Summary Putting machine learning models into production and keeping them there requires investing in well-managed systems to manage the full lifecycle of data cleaning, training, deployment and monitoring. Acryl Data provides DataHub as an easy to consume SaaS product which has been adopted by several companies.

Data Engineering 100

Data Engineering Data Engineer Engineering IT 100

Data Engineering Weekly

MAY 16, 2023

In the first part of this series, we talked about design patterns for data creation and the pros & cons of each system from the data contract perspective. In the second part, we will focus on architectural patterns to implement data quality from a data contract perspective. Why is Data Quality Expensive?

Engineering 110

Engineering Kafka Data Pipeline Data Warehouse 110

Cloudera

JUNE 2, 2021

Data pipelines are in high demand in today’s data-driven organizations. As critical elements in supplying trusted, curated, and usable data for end-to-end analytic and machine learning workflows, the role of data pipelines is becoming indispensable.

Data Pipeline 91

Data Pipeline Data Warehouse Machine Learning Data Architect 91

Snowflake

NOVEMBER 30, 2023

At TCS , we help companies shift their enterprise data warehouse (EDW) platforms to the cloud as well as offering IT services. We’re extremely familiar with just how tricky a cloud migration can be, especially when it involves moving historical business data. How many tables and views will be migrated, and how much raw data?

Data Warehouse 99

Data Warehouse Banking Data Cloud 99

Databand.ai

AUGUST 30, 2023

DataOps Architecture: 5 Key Components and How to Get Started Ryan Yackel August 30, 2023 What Is DataOps Architecture? DataOps is a collaborative approach to data management that combines the agility of DevOps with the power of data analytics. As a result, they can be slow, inefficient, and prone to errors.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

Cloudera

DECEMBER 1, 2022

Full-stack observability is a critical requirement for effective modern data platforms to deliver the agile, flexible, and cost-effective environment organizations are looking for. RI is a global leader in the design and deployment of large-scale, production-level modern data platforms for the world’s largest enterprises.

Data Lake 82

Data Lake Data Pipeline Data Governance Analytics Application 82

Cloudera

OCTOBER 19, 2022

The telecommunications industry continues to develop hybrid data architectures to support data workload virtualization and cloud migration. With multiple speaking tracks focusing on technology, networks, and data & AI, industry leaders repeatedly highlighted the hybrid nature of their infrastructure. .

Cloud 77

Cloud Telecommunication Data Governance Government 77

Snowflake

MARCH 2, 2023

Snowflake enables organizations to be data-driven by offering an expansive set of features for creating performant, scalable, and reliable data pipelines that feed dashboards, machine learning models, and applications. But before data can be transformed and served or shared, it must be ingested from source systems.

Kafka 125

Kafka Data Ingestion Data Pipeline Cloud Storage 125