The Modern Data Company

FEBRUARY 26, 2024

A startup manages to disrupt an entire industry only to find itself at a critical juncture a few years down the road. Data, the lifeblood of its operations, was becoming increasingly complex and unwieldy. It’s a tale as old as time.

Architecture 52

Architecture Data Architecture Data Technology 52

Hevo

APRIL 26, 2024

Efficient data management is a crucial part of an enterprise’s success. Data architecture helps streamline data management and workloads. It also enables you to establish a data governance framework that improves the data quality and gives useful business insights.

Architecture 40

Architecture Database Data Governance Data Architecture 40

Cloudera

JUNE 7, 2022

The cause is hybrid data – the massive amounts of data created everywhere businesses operate – in clouds, on-prem, and at the edge. Only a fraction of data created is actually stored and managed, with analysts estimating it to be between 4 – 6 ZB in 2020. Today, we are leading the way in hybrid data.

IT 112

IT Unstructured Data Data Architecture Government 112

AltexSoft

FEBRUARY 11, 2023

To get a better understanding of a data architect’s role, let’s clear up what data architecture is. Data architecture is the organization and design of how data is collected, transformed, integrated, stored, and used by a company. Sample of a high-level data architecture blueprint for Azure BI programs.

Data Architect 87

Data Architect Certification Generalist Big Data 87

Data Engineering Podcast

JULY 3, 2022

Summary The ecosystem for data tools has been going through rapid and constant evolution over the past several years. These technological shifts have brought about corresponding changes in data and platform architectures for managing data and analytical workflows. Closing Announcements Thank you for listening!

Architecture 100

Architecture Metadata MongoDB MySQL 100

Databand.ai

AUGUST 30, 2023

DataOps Architecture: 5 Key Components and How to Get Started Ryan Yackel August 30, 2023 What Is DataOps Architecture? DataOps is a collaborative approach to data management that combines the agility of DevOps with the power of data analytics. As a result, they can be slow, inefficient, and prone to errors.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

Knowledge Hut

MARCH 28, 2024

Data Engineer Career: Overview Currently, with the enormous growth in the volume, variety, and veracity of data generated and the will of large firms to store and analyze their data, data management is a critical aspect of data science. That’s where data engineers are on the go.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Cloudera

SEPTEMBER 26, 2023

IBM and Cloudera’s common goal is to accelerate data-driven decision making for enterprise customers, working on defining and executing the best solution for each customer. You can now elevate your data potential and activate AI’s capabilities through the synergic integration between IBM watsonx and Cloudera.

Kafka 95

Kafka Technology IT Government 95

Towards Data Science

OCTOBER 25, 2023

Not too long ago, almost all data architectures and data team structures followed a centralized approach. As a data or analytics engineer, you knew where to find all the transformation logic and models because they were all in the same codebase. Your organization may be undergoing the decentralization of data.

Data Pipeline 82

Data Pipeline SQL Data Architecture Data 82

The Modern Data Company

APRIL 15, 2024

Value Proposition : Aiming for consistency, high production, and responsiveness to feedback mirrors the goals of data product development, emphasizing the importance of meeting and exceeding user expectations. These considerations underline the shared principles of product development: adaptability, quality, efficiency, and customer focus.

Building 52

Building Raw Data Food Data 52

Databand.ai

JULY 19, 2023

This capability is useful for businesses, as it provides a clear and comprehensive view of their data’s history and transformations. Data lineage tools are not a new concept. In this article: Why Are Data Lineage Tools Important? It provides context for data, making it easier to understand and manage.

Pipeline-centric 52

Pipeline-centric Data Governance Metadata Government 52

Cloudera

JUNE 29, 2023

To improve the way they model and manage risk, institutions must modernize their data management and data governance practices. Up your liquidity risk management game Historically, technological limitations made it difficult for financial institutions to accurately forecast and manage liquidity risk.

Data Architecture 86

Data Architecture Architecture Management Banking 86

Data Engineering Podcast

SEPTEMBER 23, 2018

In this episode Todd Walter shares his considerable experience in data curation to clarify the many aspects that are necessary for a successful platform for your business. How do you define data curation? How does the size and maturity of a company affect the ways that they architect and interact with their data systems?

Data Lake 100

Data Lake Data Warehouse Data Architecture Architecture 100

Cloudera

OCTOBER 19, 2022

The telecommunications industry continues to develop hybrid data architectures to support data workload virtualization and cloud migration. Telco organizations are planning to move towards hybrid multi-cloud to manage data better and support their workforces in the near future. But not just the public cloud.

Cloud 80

Cloud Telecommunication Data Governance Government 80

Cloudera

MARCH 28, 2024

But, even with the backdrop of an AI-dominated future, many organizations still find themselves struggling with everything from managing data volumes and complexity to security concerns to rapidly proliferating data silos and governance challenges. Let’s explore some of the most important findings that the survey uncovered.

Data Architecture 94

Data Architecture Architecture Data Lake Data 94

Data Engineering Podcast

AUGUST 20, 2021

Summary Data lakes have been gaining popularity alongside an increase in their sophistication and usability. Despite improvements in performance and data architecture they still require significant knowledge and experience to deploy and manage. Can you describe what Cuelake is and the story behind it?

Building 100

Building Data Lake Data Warehouse SQL 100

The Modern Data Company

JANUARY 31, 2023

With such a severe statistic on the table, companies need a way to manage their customer data with finesse and granularity. Consumers are more than willing to share personal data with companies — so long as they see the positive results from that trust in the form of an unforgettable customer experience.

Retail 98

Retail Healthcare Data Architecture Data Pipeline 98

Cloudera

OCTOBER 11, 2022

Different data types need different types of analytics – real-time, streaming, operational, data warehouses. As Mason said, all the data management, data analytics, and data science tools should easily work together and run against all this shared data. It should run on any cloud or on-prem.

Data Science 94

Data Science Aggregated Data Data Consulting 94

Monte Carlo

JANUARY 24, 2024

Data is among your company’s most valuable commodities, but only if you know how to manage it. More data, more access to data, and more regulations mean data governance has become a higher-stakes game. Plus, a growing number of companies are leveraging cloud-based, distributed data architectures like data mesh.

Data Governance 52

Data Governance Government Data Lake Data Architecture 52

Knowledge Hut

MARCH 26, 2024

Extensive experience in software development, architecture design, and system integration. Strong communication and stakeholder management skills. Proficiency in relevant technologies, frameworks, and architectural patterns. Extensive experience in enterprise architecture, solution design, and IT governance.

Amazon Web Services 52

Amazon Web Services Google Cloud Computer Science AWS 52

Cloudera

JANUARY 30, 2024

While AI stands to drive smart intelligent factories, optimize production processes, enable predictive maintenance and pattern analysis, personalization, sentiment analysis, knowledge management, as well as detect abnormalities, and many other use cases, without a robust data management strategy, the road to effective AI is an uphill battle.

Manufacturing 81

Manufacturing Data Lake Data Science Cloud 81

Cloudera

NOVEMBER 1, 2022

Through modern data architectures powered by CDP, including Cloudera-enabled data fabric, data lakehouse, and data mesh , DoD agencies can rapidly provision and manage innovative data engineering, data warehouse, and machine learning environments, with access to secured supply chain data stored in CDP Private Cloud.

Cloud 89

Cloud Government Cloud Computing Data Architecture 89

Towards Data Science

DECEMBER 15, 2023

Having principles around how we think about data retention and usage are important to help guide us in these situations. Institutional Considerations While I am on this topic of data management, I should mention—I recently started a new role! How are you going to strategically plan for the future of your data systems?

Machine Learning 93

Machine Learning Data Science Data Security Data Storage 93

Cloudera

SEPTEMBER 8, 2022

The management of data assets in multiple clouds is introducing new data governance requirements, and it is both useful and instructive to have a view from the TM Forum to help navigate the changes. . What about data fabric? for machine learning), and other enterprise policies.

Telecommunication 80

Telecommunication Data Governance Government Portfolio 80

Data Engineering Podcast

DECEMBER 8, 2019

In this episode Kent Graziano, chief technical evangelist for SnowflakeDB, explains how it is differentiated from other managed platforms and traditional data warehouse engines, the features that allow you to scale your usage dynamically, and how it allows for a shift in your workflow from ETL to ELT.

Data Warehouse 100

Data Warehouse Cloud AWS Relational Database 100

Data Engineering Podcast

AUGUST 12, 2019

This is a great conversation to listen to for a better understanding of the challenges inherent in synchronizing your data. Upcoming events include the O’Reilly AI Conference, the Strata Data Conference, and the combined events of the Data Architecture Summit and Graphorum. Integration of multiple data sources (e.g.

Media 100

Media Data Warehouse Data Big Data 100

Data Engineering Weekly

MARCH 3, 2024

There will be food, networking, and real-world talks around data engineering. Here is the agenda, 1) Data Application Lifecycle Management - Harish Kumar( Paypal) Hear from the team in PayPal on how they build the data product lifecycle management (DPLM) systems. 4) Building Data Products and why should you?

Data Engineering 67

Data Engineering Data Engineer Pipeline-centric Engineering 67

Data Engineering Podcast

NOVEMBER 11, 2019

Summary The practice of data management is one that requires technical acumen, but there are also many policy and regulatory issues that inform and influence the design of our systems. This week’s episode is also sponsored by Datacoral, an AWS-native, serverless, data infrastructure that installs in your VPC.

Designing 100

Designing Data Pipeline Programming Language Data 100

Data Engineering Podcast

AUGUST 26, 2019

He also explains useful patterns for collaboration between data engineers and data analysts, and what they can learn from each other. We have partnered with organizations such as O’Reilly Media, Dataversity, Corinium Global Intelligence, and Data Counsil. Closing Announcements Thank you for listening!

Building 100

Building Data Analytics Media Data Engineering 100

Data Engineering Podcast

OCTOBER 7, 2019

In this episode CEO Venkat Venkataramani and SVP of Product Shruti Bhat explain the origins of Rockset, how it is architected to allow for fast and flexible SQL analytics on your data, and how their serverless platform can save you the time and effort of implementing portions of your own infrastructure.

Structured Data 100

Structured Data Cloud SQL Programming Language 100

Data Engineering Podcast

JULY 22, 2019

Summary The current trend in data management is to centralize the responsibilities of storing and curating the organization’s information to a data engineering team. This organizational pattern is reinforced by the architectural pattern of data lakes as a solution for managing storage and access.

Data Lake 100

Data Lake Hadoop Data Architecture 100

Data Engineering Podcast

SEPTEMBER 30, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Pipeline 100

Data Pipeline Machine Learning Media Data 100

Data Engineering Podcast

NOVEMBER 18, 2019

Summary With the constant evolution of technology for data management it can seem impossible to make an informed decision about whether to build a data warehouse, or a data lake, or just leave your data wherever it currently rests. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

Data Lake 100

Data Lake Scala Data Warehouse Hadoop 100

Data Engineering Podcast

OCTOBER 28, 2019

In this episode he explains his motivation for creating a product for data management, how the programming model simplifies the work of building testable and maintainable pipelines, and his vision for the future of data programming. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

Building 100

Building Data Pipeline Programming Language Metadata 100

Data Engineering Podcast

JULY 28, 2019

If you are struggling to maintain a tangle of data pipelines then you might find some new ideas for reducing your workload. We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference. What are the limitations or edge cases that you have found when using this pattern?

Data Integration 100

Data Integration Metadata Media Architecture 100

Data Engineering Podcast

OCTOBER 21, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Cloud 100

Cloud Data Lake Hadoop Programming Language 100

Data Engineering Podcast

OCTOBER 14, 2019

Summary Managing a data warehouse can be challenging, especially when trying to maintain a common set of patterns. They provide an AWS-native, serverless, data infrastructure that installs in your VPC. Datacoral helps data engineers build and manage the flow of data pipelines without having to manage any infrastructure.

Data Warehouse 100

Data Warehouse PostgreSQL AWS Programming Language 100