Data Engineering Podcast

MAY 26, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Can you start by sharing some of your experiences with data migration projects? Closing Announcements Thank you for listening! Don't forget to check out our other shows.

Systems 130

Systems Data Lake High Quality Data Google Cloud 130

Data Engineering Podcast

FEBRUARY 18, 2024

In this episode Dain Sundstrom, CTO of Starburst, explains how the combination of the Trino query engine and the Iceberg table format offer the ease of use and execution speed of data warehouses with the infinite storage and scalability of data lakes. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Data Engineering Podcast

MARCH 27, 2022

Summary Data governance is a practice that requires a high degree of flexibility and collaboration at the organizational and technical levels. The growing prominence of cloud and hybrid environments in data management adds additional stress to an already complex endeavor. Closing Announcements Thank you for listening!

Data Governance 130

Data Governance Government Cloud Building 130

Snowflake

NOVEMBER 2, 2023

Over the years, the technology landscape for data management has given rise to various architecture patterns, each thoughtfully designed to cater to specific use cases and requirements. In keeping up with ever-evolving data management needs, we’re announcing new capabilities that support customers across all of these patterns.

Data Lake 91

Data Lake Data Warehouse Cloud Unstructured Data 91

Striim

DECEMBER 12, 2023

Exciting news is on the horizon as Striim proudly announces its Technology Partnership with YugabyteDB, a collaboration set to reshape the landscape of data management. Together, these two companies bring a wealth of expertise to the table, promising a comprehensive solution that addresses the complexities of modern data management.

Data Management 59

Data Management Database-centric Management PostgreSQL 59

Picnic Engineering

OCTOBER 17, 2023

Building the data foundation for world’s best online supermarket The Importance of MDM In the fast-paced world of technology, it’s easy to be captivated by the allure of artificial intelligence. The truth is, as companies want to unlock the power of data this starts with strong MDM. Picnic’s MDM Journey Picnic was founded in 2015.

Data Management 52

Data Management Management Food Data 52

Precisely

SEPTEMBER 5, 2023

Data is pivotal for the success of business operations. With cloud computing, the capacity to extract value from data is greater than ever. As this realization grows, businesses are shifting their investments from hardware to technologies that optimize data assets. Search: What data is available and from where?

Data Governance 52

Data Governance Government Data Management Management 52

Data Engineering Podcast

OCTOBER 26, 2020

If you are putting your workflows into production, then you need to consider how you are going to implement data security, including access controls and auditing. Different databases and storage systems all have their own method of restricting access, and they are not all compatible with each other.

Data Security 100

Data Security Coding Cloud MongoDB 100

Data Engineering Podcast

APRIL 7, 2024

Summary Maintaining a single source of truth for your data is the biggest challenge in data engineering. Different roles and tasks in the business need their own ways to access and analyze the data in the organization. Dagster offers a new approach to building and running data platforms and data pipelines.

Data Lake 162

Data Lake High Quality Data BI Data Workflow 162

Data Engineering Podcast

NOVEMBER 16, 2020

In this episode CEO and co-founder of Isima Darshan Rawal explains how the biOS platform is architected to enable ease of use, the challenges that were involved in building an entirely new system from scratch, and how it can integrate with the rest of your data platform to allow for incremental adoption. What is the story behind the name?

Data Management 100

Data Management Management BI Business Intelligence 100

Data Engineering Podcast

APRIL 21, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. Go to dataengineeringpodcast.com/dagster today to get started. Your first 30 days are free!

Data Lake 182

Data Lake High Quality Data Data Pipeline Machine Learning 182

Snowflake

NOVEMBER 21, 2023

See how Deliveroo uses the scalability of Snowflake’s Data Cloud to support its rapidly growing business — and meet the unique needs of its three-sided marketplace. Deliveroo uses Snowflake to ingest all of its important business data. Sometimes the best ideas come from an appetite for change.

Cloud 85

Cloud Food Data Warehouse Data 85

Knowledge Hut

JANUARY 3, 2024

Cloud Computing is a revolutionary technology transforming enterprises and accelerating digital transformation. It is said that more businesses around the world will increase their investments in Cloud technology solutions, and there has been a sudden spike in Cloud deployments ever since the COVID-19 pandemic started.

Cloud Computing 52

Cloud Computing Cloud Amazon Web Services Government 52

Knowledge Hut

MARCH 19, 2024

All of this is possible because of cloud computing, the unsung hero of the computer industry. Come into the cloud and intervene to rescue the day. In this article, I will take you across some of the cool cloud computing case study examples and highlight cloud implementation in those cases. What is Cloud Computing?

Cloud Computing 52

Cloud Computing Cloud Amazon Web Services AWS 52

Knowledge Hut

OCTOBER 12, 2023

Cloud computing is becoming increasingly popular. According to Statista, the public cloud computing industry is expected to exceed $525.60 With more organizations embracing cloud computing and digitalization, there has been a surge in the need for individuals who can design and manage the systems and services people rely on.

Cloud 52

Cloud Cloud Computing AWS Certification 52

Data Engineering Podcast

FEBRUARY 11, 2024

In this episode Andrew Jefferson explains the complexities of building a robust system for data sharing, the techno-social considerations, and how the Bobsled platform that he is building aims to simplify the process. Dagster offers a new approach to building and running data platforms and data pipelines. tabular, image, etc.)

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

Knowledge Hut

NOVEMBER 17, 2023

In the digital age, cloud computing has become a necessary part of almost every industry. This technology enables businesses to store and access files from one centralized online server. Many of our readers have inquired about cloud computing jobs and how they can begin building this skill set in their own careers.

Cloud Computing 52

Cloud Computing Cloud Google Cloud Amazon Web Services 52

Data Engineering Podcast

MARCH 24, 2024

In this episode Pete Hunt, CEO of Dagster labs, outlines these new capabilities, how they reduce the burden on data teams, and the increased collaboration that they enable across teams and business units. How is it different from the current Dagster Cloud product? Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

LinkedIn Engineering

JULY 19, 2023

Leveraging data to drive decisions allows us to serve our members with better job insights, and connect the world’s professionals with each other. All accesses to table data must go through a table interface; no direct read/write is permitted to files or blobs on distributed storage for tabular data.

Big Data 78

Big Data Data Management Management Metadata 78

Cloudera

OCTOBER 12, 2020

We are thrilled to announce that Cloudera has acquired Eventador , a provider of cloud-native services for enterprise-grade stream processing. We recently delivered all three of these streaming capabilities as cloud services through Cloudera Data Platform (CDP) Data Hub on AWS and Azure.

Cloud 131

Cloud Process Scala Kafka 131

Knowledge Hut

DECEMBER 21, 2023

Cloud computing is a fast-growing area in the technical landscape due to its recent developments. If we look ahead to 2024, there are new research topics in cloud computing that are getting more traction among researchers and practitioners. To master a cloud computing field, we need to check these Cloud Computing online courses.

Cloud Computing 52

Cloud Computing Cloud Algorithm Healthcare 52

Knowledge Hut

SEPTEMBER 21, 2023

Cloud computing centralizes data, applications, and computer services, offering unparalleled flexibility. If not properly secured, data stored in the cloud can be at risk of theft or loss. Cloud security is all about putting protective measures in place to defend this computing infrastructure.

Cloud Computing 52

Cloud Computing Cloud AWS Accessible 52

Knowledge Hut

SEPTEMBER 22, 2023

AWS is the biggest, most potent, and most well-known cloud platform, offering more than 200 fully featured services from data centers across the globe. Throughout my journey in this dynamic realm, I've observed a rising demand for competent cloud computing professionals. What Does An AWS Cloud Practitioner Do?

AWS 52

AWS Cloud Amazon Web Services Cloud Computing 52

U-Next

NOVEMBER 18, 2022

Among many things, AI finds innumerable applications in cloud computing. Cloud computing delivers computing services—including servers, storage, databases, networking, software, analytics, and intelligence—over the Internet (“the cloud”) to offer faster innovation, flexible resources, and economies of scale.

Cloud Computing 52

Cloud Computing Cloud Data Cleanse Data Mining 52

Snowflake

JANUARY 24, 2024

Governments face many challenges that could be addressed almost immediately by the effective application of AI solutions accompanied by the use of data management platforms. Effective data management, coupled with AI, has the power to unlock the information needed to serve the public good.

Government 98

Government Data Management Cloud Data 98

Data Engineering Podcast

APRIL 14, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is brought to you by Datafold – a testing automation platform for data engineers that prevents data quality issues from entering every part of your data workflow, from migration to dbt deployment.

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Knowledge Hut

JULY 14, 2023

Cloud computing is steadily paving its way into every industry. While an increasing number of businesses are adapting to cloud services, one industry is taking the time to adopt the concept on a holistic level: the banking sector. Here’s your comprehensive guide to the transition process of cloud computing in banking sector.

Cloud Computing 52

Cloud Computing Banking Cloud Cloud Storage 52

Data Engineering Podcast

SEPTEMBER 29, 2021

There have been many attempts to harness all of the data that you generate for gaining useful insights about yourself, but they are generally difficult to set up and manage or require software development experience. What are the sources of complexity that you are facing when managing access/privacy of user’s data?

Cloud 100

Cloud Data Lake Business Intelligence Data 100

Knowledge Hut

NOVEMBER 27, 2023

In today's rapidly evolving digital landscape, harnessing the power of cloud computing has become essential for organizations seeking to stay ahead of the curve. Do try to upskill yourself by taking up online Cloud training courses. Are you ready to take the google cloud skills challenge?

Google Cloud 52

Google Cloud Cloud Cloud Computing Pipeline-centric 52

Precisely

FEBRUARY 22, 2023

According to 451 Research , 90% of enterprise executives surveyed believe that data will become more important to their organizations 12 months from now than it is today with use of a cloud environment. Data is no longer just a byproduct of core business activities; the effective use of data is now a core objective unto itself.

Cloud 52

Cloud Data Integration Data Data Management 52

ThoughtSpot

JUNE 23, 2023

ThoughtSpot Sage empowers non-technical users to run live analysis on top of Snowpark data models, using natural language search to forecast trends and better predict business outcomes.

Cloud 79

Cloud Programming Language Government Data Security 79

Knowledge Hut

NOVEMBER 2, 2023

As an AWS Cloud Practitioner with experience in delivering multiple AWS cloud practitioner projects, I vividly recall assisting a startup to prove the scalability of their AI solution on AWS during one of my early projects. This experience ignited my passion for architecting cost-effective, scalable solutions on the AWS platform.

AWS 52

AWS Coding Cloud Project 52

Cloudera

NOVEMBER 1, 2022

In the private sector, excluding highly regulated industries like financial services, the migration to the public cloud was the answer to most IT modernization woes, especially those around data, analytics, and storage. It’s here where the private cloud delivers.

Cloud 87

Cloud Government Cloud Computing Data Architecture 87

Ascend.io

JUNE 6, 2023

In the world of cloud computing, efficiency isn’t just about running operations faster or smoother — it’s also about achieving more with less. Understanding and controlling cloud costs is a fundamental part of how Ascend manages the cloud infrastructure of our dedicated deployment customers.

Cloud 52

Cloud Data Pipeline Data Ingestion Cloud Storage 52

Data Engineering Podcast

FEBRUARY 4, 2024

In this episode Yingjun Wu explains how it is architected to power analytical workflows on continuous data flows, and the challenges of making it responsive and scalable. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex.

SQL 173

SQL Data Lake High Quality Data Data Pipeline 173

Cloudera

FEBRUARY 4, 2021

I am pleased to announce that Cloudera was just named the Risk Data Repository and Data Management Product of the Year in the Risk Markets Technology Awards 2021. . Supporting the industry’s risk data depository and data management needs. End-to-end Data Lifecycle. Highly Scalable.

Technology 88

Technology Data Management Management Insurance 88

Snowflake

JANUARY 15, 2024

Leading companies around the world rely on Informatica data management solutions to manage and integrate data across various platforms from virtually any data source and on any cloud. Enterprise Data Integrator is fueled by Informatica Superpipe for Snowflake, which enables up to 3.5x

Data Integration 98

Data Integration BI Cloud Data 98