Data Engineering Podcast

JUNE 17, 2023

In this episode Satish Jayanthi explores the benefits of incorporating column-aware tooling in the data modeling process. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 130

Data Lake Metadata Data Architecture Machine Learning 130

The Modern Data Company

FEBRUARY 26, 2024

With each new product launch and market expansion, the data architecture that once supported its growth now threatened to be its Achilles’ heel. Mixing metaphors aside, this startup knows that to sustain growth and outmaneuver competitors, it needs to evolve its approach to data management.

Architecture 52

Architecture Data Architecture Data Technology 52

Data Engineering Podcast

JULY 3, 2022

Summary The ecosystem for data tools has been going through rapid and constant evolution over the past several years. These technological shifts have brought about corresponding changes in data and platform architectures for managing data and analytical workflows. When is a lakehouse the wrong choice?

Architecture 100

Architecture Metadata MongoDB MySQL 100

AltexSoft

FEBRUARY 11, 2023

To get a better understanding of a data architect’s role, let’s clear up what data architecture is. Data architecture is the organization and design of how data is collected, transformed, integrated, stored, and used by a company. Sample of a high-level data architecture blueprint for Azure BI programs.

Data Architect 87

Data Architect Certification Generalist Big Data 87

Knowledge Hut

MARCH 28, 2024

Data Engineer Career: Overview Currently, with the enormous growth in the volume, variety, and veracity of data generated and the will of large firms to store and analyze their data, data management is a critical aspect of data science. That’s where data engineers are on the go.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Databand.ai

AUGUST 30, 2023

DataOps Architecture: 5 Key Components and How to Get Started Ryan Yackel August 30, 2023 What Is DataOps Architecture? DataOps is a collaborative approach to data management that combines the agility of DevOps with the power of data analytics. As a result, they can be slow, inefficient, and prone to errors.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

Cloudera

JUNE 7, 2022

Companies can now capitalize on the value in all their data, by delivering a hybrid data platform for modern data architectures with data anywhere. Cloudera Data Platform (CDP) is designed to address the critical requirements for modern data architectures today and tomorrow.

IT 106

IT Unstructured Data Data Architecture Government 106

Snowflake

NOVEMBER 2, 2023

Over the years, the technology landscape for data management has given rise to various architecture patterns, each thoughtfully designed to cater to specific use cases and requirements. Each of these architectures has its own unique strengths and tradeoffs.

Data Lake 86

Data Lake Data Warehouse Cloud Unstructured Data 86

Striim

FEBRUARY 19, 2024

Central to unlocking the potential of these frameworks is Striim, a platform that facilitates real-time data integration, analytics, and event processing, providing businesses can fully leverage their data. Data Fabric uses advanced technology, such as AI and machine learning, to automatically find, manage, and combine data.

Data Integration 52

Data Integration Government Data Data Governance 52

Knowledge Hut

MARCH 26, 2024

An essential position in IT is that of a solution architect who develops and deploys technological solutions that are customized to satisfy certain business requirements. They have a thorough understanding of a variety of technologies. Provide technical leadership and mentorship to junior architects and development teams.

Amazon Web Services 52

Amazon Web Services Google Cloud Computer Science AWS 52

Data Engineering Podcast

OCTOBER 2, 2021

If you need to deal with massive data, at high velocities, in milliseconds, then Aerospike is definitely worth learning about. Your host is Tobias Macey and today I’m interviewing Lenley Hensarling about Aerospike and building real-time data platforms Interview Introduction How did you get involved in the area of data management?

Building 100

Building BI Data Architecture Architecture 100

Data Engineering Podcast

APRIL 3, 2022

This allows everyone in the business to participate in data analysis in a sustainable manner. What are the pitfalls in data architecture patterns that you commonly see organizations fall prey to? This allows everyone in the business to participate in data analysis in a sustainable manner.

Data Warehouse 100

Data Warehouse Data Workflow Data Architecture SQL 100

Cloudera

OCTOBER 19, 2022

The telecommunications industry continues to develop hybrid data architectures to support data workload virtualization and cloud migration. With multiple speaking tracks focusing on technology, networks, and data & AI, industry leaders repeatedly highlighted the hybrid nature of their infrastructure. .

Cloud 77

Cloud Telecommunication Data Governance Government 77

Knowledge Hut

JANUARY 18, 2024

But here's the fascinating part - it's estimated that by 2025, a whopping 463 exabytes of data will be created globally every single day. To put that into perspective, that's equivalent to 212,765,957 DVDs worth of data! The data analytics future is brimming with exciting possibilities. Are Data Analysts in Demand?

Data Analytics 52

Data Analytics Healthcare Machine Learning Algorithm 52

Cloudera

JANUARY 30, 2024

As we navigate the fourth and fifth industrial revolution, AI technologies are catalyzing a paradigm shift in how products are designed, produced, and optimized. Quality: Use cases like visual inspection, yield optimization, fault detection, and classification are enhanced with AI technologies. That is a very low number.

Manufacturing 77

Manufacturing Data Lake Data Science Cloud 77

Monte Carlo

JANUARY 24, 2024

More data, more access to data, and more regulations mean data governance has become a higher-stakes game. Data Governance Trends The biggest data governance trend isn’t really a trend at all—rather, it’s a state of mind. At the same time, data governance technologies are growing more intelligent.

Data Governance 52

Data Governance Government Data Lake Data Architecture 52

Cloudera

NOVEMBER 1, 2022

A quick trip in the congressional time machine to revisit 2017’s Modernizing Government Technology Act surfaces some of the most salient points regarding agencies’ challenges: The federal government spends nearly 75% of its annual information technology funding on operating and maintaining existing legacy information technology systems.

Cloud 83

Cloud Government Cloud Computing Data Architecture 83

Data Engineering Podcast

SEPTEMBER 23, 2018

He also explains which layers are useful for the different members of the business, and which pitfalls to look out for along the path to a mature and flexible data platform. How do you define data curation? How does the size and maturity of a company affect the ways that they architect and interact with their data systems?

Data Lake 100

Data Lake Data Warehouse Data Architecture Architecture 100

Cloudera

MARCH 28, 2024

At a time when AI is exploding in popularity and finding its way into nearly every facet of business operations, data has arguably never been more valuable. More recently, that value has been made clear by the emergence of AI-powered technologies like generative AI (GenAI) and the use of Large Language Models (LLMs).

Data Architecture 88

Data Architecture Architecture Data Lake Data 88

The Modern Data Company

APRIL 15, 2024

There’s a common saying about not wanting to know how the sausage is made, suggesting that the process behind many things we enjoy—be it our favorite food or the conveniences of modern technology—might not be as appealing as the end product itself. This analogy rings especially true in the world of data.

Building 52

Building Raw Data Food Data 52

Knowledge Hut

DECEMBER 21, 2023

Data engineering involves a lot of technical skills like Python, Java, and SQL (Structured Query Language). For a data engineer career, you must have knowledge of data storage and processing technologies like Hadoop, Spark, and NoSQL databases. What are the Data Engineer Career Opportunities?

Data Engineering 52

Data Engineering Data Engineer Engineering MongoDB 52

The Modern Data Company

JANUARY 31, 2023

And at MIT CDOIQ, we finally got the chance to bring our passion for transformed data to a broader audience. MIT’s Chief Data Officer and Information Quality (CDOIQ) symposium is a key event for sharing cutting-edge ideas about the world of data and information technology. Experts couldn’t stop mentioning it.

Retail 98

Retail Healthcare Data Architecture Data Pipeline 98

Data Engineering Podcast

AUGUST 20, 2021

Summary Data lakes have been gaining popularity alongside an increase in their sophistication and usability. Despite improvements in performance and data architecture they still require significant knowledge and experience to deploy and manage. Can you describe what Cuelake is and the story behind it?

Building 100

Building Data Lake Data Warehouse SQL 100

Data Engineering Podcast

SEPTEMBER 1, 2021

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 100

Data Lake Cloud AWS SQL 100

Data Engineering Podcast

JULY 28, 2019

If you are struggling to maintain a tangle of data pipelines then you might find some new ideas for reducing your workload. We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference. How much up-front modeling is necessary to make this a viable approach to data integration?

Data Integration 100

Data Integration Metadata Media Architecture 100

Snowflake

FEBRUARY 12, 2024

With a projected attendance of around 90,000 people, MWC is a global networking hub that attracts key players, decision-makers and innovators in multiple telecom areas (including mobile service providers, device manufacturers, technology providers and digital services) and almost every industry imaginable. We’re at the heart of it.

Python 79

Python Manufacturing Cloud Government 79

Data Engineering Podcast

NOVEMBER 11, 2019

Summary The practice of data management is one that requires technical acumen, but there are also many policy and regulatory issues that inform and influence the design of our systems. We have partnered with organizations such as O’Reilly Media, Dataversity, Corinium Global Intelligence, Alluxio, and Data Council.

Designing 100

Designing Data Pipeline Programming Language Data 100

Precisely

MARCH 14, 2023

New technologies are making it easier for customers to process increasingly large datasets more rapidly. And the desire to leverage those technologies for analytics, machine learning, or business intelligence (BI) has grown exponentially as well. Simply design data pipelines, point them to the cloud environment, and execute.

Data Integration 52

Data Integration High Quality Data BI Data 52

Towards Data Science

DECEMBER 15, 2023

Essentially, the more data we have, the more the chance that some of it goes missing or gets accessed by someone inappropriately. In addition, more people having access to data means more opportunities for breach or data loss, because human beings are the biggest risk vector in the technology space.

Machine Learning 94

Machine Learning Data Science Data Security Data Storage 94

Data Engineering Podcast

SEPTEMBER 3, 2021

This is a valuable conversation about how to approach the work of selecting the tools that you use to power your data systems and considerations for how they can be woven together for a unified experience across your various stakeholders. Who are the stakeholders in a data platform? How do you measure the success of a data platform?

Designing 100

Designing Building SQL BI 100

Data Engineering Podcast

DECEMBER 8, 2019

If you are evaluating your options for building or migrating a data platform, then this is definitely worth a listen. You listen to this show to learn and stay up to date with what’s happening in databases, streaming platforms, big data, and everything else you need to know about modern data management.

Data Warehouse 100

Data Warehouse Cloud AWS Relational Database 100

Data Engineering Podcast

AUGUST 12, 2019

This is a great conversation to listen to for a better understanding of the challenges inherent in synchronizing your data. Upcoming events include the O’Reilly AI Conference, the Strata Data Conference, and the combined events of the Data Architecture Summit and Graphorum. Integration of multiple data sources (e.g.

Media 100

Media Data Warehouse Data Big Data 100

Data Engineering Podcast

JULY 1, 2019

It was an interesting conversation about how he stress tested the Instaclustr managed service for benchmarking an application that has real-world utility. We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference. At CluedIn they call it “eventual connectivity”.

Kafka 100

Kafka Finance Media Architecture 100

Data Engineering Podcast

JULY 22, 2019

Summary The current trend in data management is to centralize the responsibilities of storing and curating the organization’s information to a data engineering team. This organizational pattern is reinforced by the architectural pattern of data lakes as a solution for managing storage and access.

Data Lake 100

Data Lake Hadoop Data Architecture 100

Cloudera

OCTOBER 11, 2022

The article goes on to share insights from experts at Gartner, PwC, John Deere, and Cloudera that shine a light on the critical role that data plays in scaling AI. . Julian Sanchez, director of emerging technology at John Deere hit the nail on the head, “the thing about AI is that it “looks like magic.

Data Science 89

Data Science Aggregated Data Data Consulting 89

Data Engineering Podcast

NOVEMBER 18, 2019

Summary With the constant evolution of technology for data management it can seem impossible to make an informed decision about whether to build a data warehouse, or a data lake, or just leave your data wherever it currently rests. What do you have planned for the future of the platform and business?

Data Lake 100

Data Lake Scala Data Warehouse Hadoop 100

Data Engineering Podcast

OCTOBER 21, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Cloud 100

Cloud Data Lake Hadoop Programming Language 100