Data Engineering Podcast

SEPTEMBER 11, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Systems 100

Systems Metadata Building MongoDB 100

Data Engineering Podcast

OCTOBER 9, 2022

For many that is a data warehouse, but in order to support a diverse and constantly changing set of uses and technologies the data lakehouse is a paradigm that offers a useful balance of scale and cost, with performance and ease of use. Can you describe what Iomete is and the story behind it? When is Iomete the wrong choice?

Metadata 100

Metadata AWS MongoDB MySQL 100

Data Engineering Podcast

DECEMBER 21, 2020

The team at Immuta has built a platform that aims to tackle that problem in a flexible and maintainable fashion so that data teams can easily integrate authorization, data masking, and privacy enhancing technologies into their data infrastructure. If you hand a book to a new data engineer, what wisdom would you add to it?

Data Governance 130

Data Governance Government Data Lake Banking 130

Data Engineering Podcast

DECEMBER 11, 2021

In this episode he explains how it can be used to build rich and useful profiles of your users, the system architecture that powers it, and some of the ways that it is being integrated into an organization’s broader data ecosystem. Start trusting your data with Monte Carlo today! Start trusting your data with Monte Carlo today!

Data Warehouse 100

Data Warehouse Raw Data Data Lake BI 100

Data Engineering Podcast

DECEMBER 4, 2021

The whole process of hiring is an important organizational skill to cultivate and this is an interesting exploration of the specific challenges involved in finding data professionals. Start trusting your data with Monte Carlo today! Interview Introduction How did you get involved in the area of data management?

Data Warehouse 100

Data Warehouse Data Lake BI Business Intelligence 100

Data Engineering Podcast

SEPTEMBER 4, 2022

In this episode founders Barr Moses and Lior Gavish rejoin the show to reflect on the evolution and adoption of data observability technologies and the capabilities that are being introduced as the broader ecosystem adopts the practices. RudderStack helps you build a customer data platform on your warehouse or data lake.

IT 100

IT Metadata MongoDB MySQL 100

Data Engineering Podcast

AUGUST 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Engineering 100

Data Engineering Data Engineer MongoDB Metadata 100

Data Engineering Podcast

OCTOBER 28, 2021

He also explains why he started Decodable to address that limitation and the work that he and his team have done to let data engineers build streaming pipelines entirely in SQL. Start trusting your data with Monte Carlo today! What are the complexities that data engineers encounter when building pipelines on streaming systems?

Data Pipeline 100

Data Pipeline SQL Data Warehouse Data Lake 100

Data Engineering Podcast

NOVEMBER 20, 2021

Summary The technology for scaling storage and processing of data has gone through massive evolution over the past decade, leaving us with the ability to work with massive datasets at the cost of massive complexity. Start trusting your data with Monte Carlo today! Visit dataengineeringpodcast.com/montecarlo to learn more.

Data Warehouse 100

Data Warehouse Data Lake BI Business Intelligence 100

Data Engineering Podcast

JANUARY 1, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Will it be the same in 2022?

Data Warehouse 100

Data Warehouse Data Lake SQL Hadoop 100

Data Engineering Podcast

DECEMBER 19, 2021

In this episode Pardhu Gunnam and Mars Lan explain how they have designed the architecture and user experience to allow everyone to collaborate on the data lifecycle and provide opportunities for automation and extensible workflows. Start trusting your data with Monte Carlo today! Start trusting your data with Monte Carlo today!

Systems 100

Systems Building Metadata Data Warehouse 100

Data Engineering Podcast

NOVEMBER 10, 2021

Summary A significant source of friction and wasted effort in building and integrating data management systems is the fragmentation of metadata across various tools. Start trusting your data with Monte Carlo today! This is an ambitious and exciting project, so listen and try it out today. What are the goals of the project?

Metadata 100

Metadata Data Warehouse Data Lake BI 100

ProjectPro

JULY 22, 2016

For the same cost, organizations can now store 50 times as much data as in a Hadoop data lake than in a data warehouse. Data lake is gaining momentum across various organizations and everyone wants to know how to implement a data lake and why.

Data Lake 40

Data Lake Data Warehouse Hadoop Unstructured Data 40

Data Engineering Podcast

JANUARY 4, 2021

Summary As more organizations are gaining experience with data management and incorporating analytics into their decision making, their next move is to adopt machine learning. Monte Carlo’s end-to-end Data Observability Platform monitors and alerts for data issues across your data warehouses, data lakes, ETL, and business intelligence.

Python 100

Python Data Lake Machine Learning Computer Science 100

Data Engineering Podcast

JANUARY 11, 2021

This is a fascinating conversation on the technical challenges involved, the opportunities that such as system provides, and the complexities inherent to building a successful business on open source. There are a number of different reasons and methods for versioning data, such as the work being done with Datomic, LakeFS, DVC, etc.

PostgreSQL 100

PostgreSQL Python Data Lake Computer Science 100

Data Engineering Podcast

APRIL 16, 2023

In this episode Paul Blankley and Ryan Janssen explore the power of natural language driven data exploration combined with semantic modeling that enables an intuitive way for everyone in the business to access the data that they need to succeed in their work. Business intelligence is a crowded market.

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Monte Carlo

AUGUST 31, 2023

Data is a priority for your CEO, as it often is for digital-first companies, and she is fluent in the latest and greatest business intelligence tools. Your CTO is excited about migrating to the cloud, and constantly sends your team articles highlighting performance measurements against some of the latest technologies.

Data Lake 52

Data Lake Data Pipeline Unstructured Data Data Warehouse 52

Knowledge Hut

DECEMBER 28, 2023

Human society in 2023 is a digital world, and its fuel - its currency - is data. Today, organizations seek skilled professionals who can harness data’s power to drive informed decisions. As technology evolves, cloud platforms have emerged as the cornerstone of modern data management.

Certification 52

Certification Data Engineering Data Engineer Engineering 52

Knowledge Hut

DECEMBER 26, 2023

In recent years, with the advent of technology, data has been considered to be a valuable asset in both large-scale and small-scale organizations. Data as a resource requires skilled professionals to be collected, interpreted, and stored safely. Data Management Data management is an integral part of high-scale organizations.

Data Science 52

Data Science Scala Programming Language R (Programming) 52

Data Engineering Podcast

MAY 19, 2019

In this episode Drew Banin, creator of dbt, explains how it got started, how it is designed, and how you can start using it today to create reliable and well-tested reports in your favorite data warehouse. We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference.

Data Analytics 100

Data Analytics Building Engineering Data Warehouse 100

Ascend.io

JANUARY 3, 2023

Businesses are increasingly reliant on new technologies to enable the use of data in new and innovative ways. However, most data leaders are finding that technology alone does not cause the organization to deliver new and valuable insights fast enough. What technology is used to access them?

Data 52

Data Data Lake Business Intelligence Big Data 52

AltexSoft

FEBRUARY 11, 2023

It serves as a foundation for the entire data management strategy and consists of multiple components including data pipelines; , on-premises and cloud storage facilities – data lakes , data warehouses , data hubs ;, data streaming and Big Data analytics solutions ( Hadoop , Spark , Kafka , etc.);

Data Architect 87

Data Architect Certification Generalist Big Data 87

Knowledge Hut

JUNE 30, 2023

Data engineers are experts who specialize in the design and execution of data systems and infrastructure. They have unique skills, including competence in software engineering, data management, and analytics. Investigate alternative data storage solutions, such as databases and data lakes.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

ProjectPro

OCTOBER 6, 2021

The benefits it offers start from data management and manipulation to machine learning tools on the GCP platform. GCP offers 90 services that span computation, storage, databases, networking, operations, development, data analytics , machine learning , and artificial intelligence , to name a few. Source : 1.bp.blogspot.com

Google Cloud 52

Google Cloud Project Data Lake Healthcare 52

Knowledge Hut

JANUARY 19, 2024

Business Intelligence Transforming raw data into actionable insights for informed business decisions. This subject equips you with skills in handling various BI (Business Intelligence) methods and tools. Data Warehousing Data warehousing is like a well-organized library for data.

Data Science 52

Data Science Machine Learning Datasets Algorithm 52

Snowflake

NOVEMBER 2, 2023

Over the years, the technology landscape for data management has given rise to various architecture patterns, each thoughtfully designed to cater to specific use cases and requirements. Use cases change, needs change, technology changes – and therefore data infrastructure should be able to scale and evolve with change.

Data Lake 89

Data Lake Data Warehouse Cloud Unstructured Data 89

Knowledge Hut

SEPTEMBER 25, 2023

Many professional associations or academic institutions offer data analytics certifications, which include a wide range of abilities. Others may originate from data analytics software providers, where the certification typically attests to your proficiency with the company's analytics technology.

Certification 52

Certification Business Analyst Big Data Data Analysis 52

ProjectPro

DECEMBER 7, 2021

Generally, data pipelines are created to store data in a data warehouse or data lake or provide information directly to the machine learning model development. Keeping data in data warehouses or data lakes helps companies centralize the data for several data-driven initiatives.

Data Pipeline 52

Data Pipeline Architecture Kafka AWS 52

Rockset

AUGUST 10, 2020

While traditional “business intelligence” has come a long way in the past 20 years, the world of real-time analytics is still in its early days. Traditional BI had its Renaissance moments with the advent of Big Data technologies such as Hadoop, and then cloud data lakes and warehouses have brought everyone to the Modern era.

BI 40

BI Data Lake Hadoop SQL 40

Knowledge Hut

DECEMBER 26, 2023

Cloudera Certified Associate (CCA) Data Analyst Cloudera has a well-earned reputation in the IT sector, and its Associate Data analyst certification can help bolster the resume of Business intelligence specialists, system architects, data analysts, database administrators as well as developers.

Certification 52

Certification Data Analytics BI AWS 52

Rockset

JANUARY 3, 2023

Moving to real-time streaming data stacks open up new possibilities for using low latency data across the organization for anomaly detection, personalization, logistics tracking and more.

Data Warehouse 52

Data Warehouse Education Database Data 52

Monte Carlo

AUGUST 25, 2023

That’s why it’s essential for teams to choose the right architecture for the storage layer of their data stack. But, the options for data storage are evolving quickly. Different vendors offering data warehouses, data lakes, and now data lakehouses all offer their own distinct advantages and disadvantages for data teams to consider.

Data Lake 52

Data Lake Data Warehouse Unstructured Data Raw Data 52

ProjectPro

SEPTEMBER 26, 2021

Several industries across the globe are using Big Data tools and technology in their processes and operations. According to a study, the Big Data market in the banking sector will reach $62.10 Healthcare is another primary application area of Big Data analytics , and its market will touch $67.82 billion by 2025.

Big Data 52

Big Data Data Engineering Data Engineer Engineering 52

U-Next

SEPTEMBER 7, 2022

The terms “ Data Warehouse ” and “ Data Lake ” may have confused you, and you have some questions. Structuring data refers to converting unstructured data into tables and defining data types and relationships based on a schema. What is Data Warehouse? . What is Data Lake? .

Data Lake 52

Data Lake Data Warehouse Unstructured Data Amazon Web Services 52

Data Engineering Podcast

DECEMBER 29, 2022

In this episode she shares the strategic and tactical elements of how to make more effective use of the technical and organizational resources that are available to you for getting work done with data. Trusted by the data teams at Fox, JetBlue, and PagerDuty, Monte Carlo solves the costly problem of broken data pipelines.

Management 130

Management Metadata Business Intelligence Data Lake 130

Data Engineering Podcast

JANUARY 8, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data and analytics leaders, 2023 is your year to sharpen your leadership skills, refine your strategies and lead with purpose. Can you describe what the SQLake product is and the story behind it?

PostgreSQL 130

PostgreSQL Data Lake Data Warehouse BI 130

Advancing Analytics: Data Engineering

JULY 2, 2019

It’s not always the most accurate indicator, but a quick glance at google trends sees Data Engineer rocketing in popularity, compared to more traditional functions such as BI and ETL Developer: google trends Now, that’s not saying that the other roles are going away, not by a long stretch.

Business Intelligence 52

Business Intelligence Data Engineering Data Engineer Engineering 52