Data Engineering Podcast

MARCH 31, 2024

Identifying and accounting for those errors is a critical piece of building trust in the organization that your data is accurate and up to date. Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises.

Project 130

Project Data Lake High Quality Data Data Workflow 130

Data Engineering Podcast

FEBRUARY 4, 2024

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex.

SQL 173

SQL Data Lake High Quality Data Data Pipeline 173

Data Engineering Podcast

FEBRUARY 11, 2024

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. There are numerous business rules and regulatory concerns that need to be applied. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

Cloudera

APRIL 18, 2024

In those discussions, it was clear that everyone understood the need to treat data estates more cohesively as a whole—that means bringing more attention to security, data governance, and metadata management, the latter of which has become increasingly popular. Do I trust my data to be ready for use in AI?

Metadata 95

Metadata Government Data Governance Data 95

Data Engineering Podcast

MARCH 3, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Summary Artificial intelligence technologies promise to revolutionize business and produce new sources of value.

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

MARCH 17, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Summary A significant portion of data workflows involve storing and processing information in database engines.

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

DECEMBER 24, 2023

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems.

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Data Engineering Podcast

FEBRUARY 25, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Summary Building a database engine requires a substantial amount of engineering effort and time investment.

Database 162

Database Technology Data Lake High Quality Data 162

Data Engineering Podcast

MARCH 10, 2024

Your team can get up and running in minutes thanks to Dagster Cloud, an enterprise-class hosted solution that offers serverless and hybrid deployments, enhanced security, and on-demand ephemeral test deployments. Summary Data lakehouse architectures are gaining popularity due to the flexibility and cost effectiveness that they offer.

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Snowflake

MARCH 18, 2024

And as the need to securely share data — both within and beyond the enterprise — becomes mission critical, the ability to manage and create robust and trusted data pipelines is key. Think back just a few years ago when most enterprises were either planning or just getting started on their cloud journeys. petabytes daily in 2021.

Unstructured Data 82

Unstructured Data Government Data Pipeline Cloud 82

Data Engineering Podcast

DECEMBER 31, 2023

Summary Working with financial data requires a high degree of rigor due to the numerous regulations and the risks involved in security breaches. Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises.

Designing 130

Designing Data Lake High Quality Data SQL 130

Cloudera

APRIL 2, 2024

Data is critical to driving the innovation and decision-making that improves services, streamlines operations and strengthens national security. Moreover, as emerging technologies like generative AI proliferate across Federal use cases, the need for trusted data that is secure, governed and ready for AI has never been more acute.

Designing 96

Designing Process Government Metadata 96

Snowflake

JANUARY 30, 2024

Fortunately, the “lunch” actually spanned breakfast, a pre-lunch reception, lunch, and then discussion panels and networking into the late afternoon — a full day to promote the Swedish values of sustainability, equality, innovation and inclusive growth, all prerequisites to this year’s theme of Peace and Security. Yes, data flows!

Food 82

Food Government Education Data 82

Data Engineering Podcast

JANUARY 7, 2024

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Summary Data processing technologies have dramatically improved in their sophistication and raw throughput. Want to see Starburst in action?

Data Process 147

Data Process Process Data Lake High Quality Data 147

Snowflake

APRIL 10, 2024

Cloud Computing Compliance Controls Catalog (C5) C5 is an audited standard establishing baselines for cloud security. It was initially created for government agencies and organizations that work with the government to ensure security baselines are met by their cloud service providers (CSPs).

Certification 85

Certification Manufacturing Government Cloud Computing 85

Cloudera

DECEMBER 1, 2023

It focuses on five key pillars: investing in research and development; unleashing government AI resources; setting standards and policy; building the AI workforce; and advancing trust and security. This requires a holistic approach that addresses the key areas of security, governance, and trustworthy data.

Building 105

Building Government Transportation Data Governance 105

Data Engineering Podcast

JANUARY 21, 2024

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Summary Databases and analytics architectures have gone through several generational shifts. Want to see Starburst in action?

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Snowflake

NOVEMBER 2, 2023

Snowflake Horizon is Snowflake’s built-in governance solution with a unified set of compliance, security, privacy, interoperability, and access capabilities. Snowflake continues to advance Snowflake Horizon with additional capabilities for compliance, security, privacy, interoperability, and access.

Metadata 97

Metadata Government AWS Medical 97

Edureka

APRIL 19, 2024

In order to obtain the background knowledge needed for the next attack, such as potential points of access and lax security measures, the attacker first looks into the intended victim. Building Trust: To establish rapport and win their targets’ trust, attackers employ a variety of strategies.

Engineering 52

Engineering Media Banking Education 52

Data Engineering Podcast

NOVEMBER 26, 2023

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Summary Building a data platform that is enjoyable and accessible for all of its end users is a substantial challenge.

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Cloudera

MARCH 22, 2024

As a trusted enterprise Linux OS, RHEL boasts certification across hundreds of clouds and thousands of hardware and software vendors. This integration will accelerate InfoSec approvals for Cloudera customers, enhance their security posture, and deliver a long-term, vendor-backed and supported operating system.

Cloud 112

Cloud Certification Systems Architecture 112

Snowflake

DECEMBER 11, 2023

The authorization furthers Snowflake’s commitment to helping our government customers secure and mobilize their mission-critical data It’s a milestone moment for Snowflake to have achieved FedRAMP High authorization on the AWS GovCloud (US-West and US-East Regions).

AWS 83

AWS Hospitality Education Government 83

Cloudera

FEBRUARY 1, 2024

This applies to modern generative AI solutions that are particularly reliant on trusted, accurate, and context-specific data. This applies to modern generative AI solutions that are particularly reliant on trusted, accurate, and context-specific data.

Cloud 82

Cloud Architecture Utilities Designing 82

Data Engineering Podcast

DECEMBER 17, 2023

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Data Lake 130

Data Lake High Quality Data SQL Architecture 130

Cloudera

JANUARY 30, 2024

The universal industrial data challenge Data — as the foundation of trusted AI — can lead the way to transform business processes and help manufacturers innovate, define new business models, and establish new revenue streams. There are many functional areas within manufacturing where manufacturers will see AI’s massive benefits.

Manufacturing 78

Manufacturing Data Lake Data Science Cloud 78

Knowledge Hut

MARCH 18, 2024

It provides a wide range of tools, templates, and services to help developers create secure and scalable blockchain systems. Azure Active Directory Integration: Integration with Azure Active Directory ensures secure and seamless identity management. What is Azure?

Pharmaceutical 52

Pharmaceutical Healthcare Manufacturing Cloud Computing 52

Knowledge Hut

APRIL 23, 2024

Think of it as a mighty fortress that shields your smartphones, tablets, laptops, and computers, providing a robust defense against malicious entities that threaten their security. If you are interested to have a career in this field, then you can try out Cyber Security certifications.

Database 52

Database Programming Education Cloud 52

Data Engineering Podcast

NOVEMBER 19, 2023

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Summary The dbt project has become overwhelmingly popular across analytics and data engineering teams.

Project 147

Project Data Lake High Quality Data SQL 147

Cloudera

OCTOBER 24, 2023

But to truly drive transformation telcos must ensure AI models are driven by accurate, high-quality, trusted data, and determine how to manage and govern massive volume at scale. This is the essence of “Trusted AI Everywhere.” Trusted AI Everywhere” explained Trusted AI poses significant challenges.

Government 77

Government Finance Deep Learning Data Governance 77

Data Engineering Podcast

NOVEMBER 5, 2023

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. When an application is slow, there is a good probability that the database needs some attention. Want to see Starburst in action?

PostgreSQL 147

PostgreSQL Data Lake High Quality Data SQL 147

Snowflake

NOVEMBER 7, 2023

Cybersecurity has become more than a question of IT infrastructure—it’s the cornerstone of safeguarding national security, protecting critical infrastructure, preserving privacy, and maintaining public trust. Successful businesses are listed on the National Cyber Security Centre and IASME website. Research from the U.K.

Certification 75

Certification Government Data Security Education 75

Precisely

APRIL 11, 2024

Overcoming Challenges: A Testament to Resilience One of the most significant challenges we encountered was the rigorous application security (AppSec) and penetration testing (PenTest) required to gain AWS certification. This rigorous testing process not only tested our resolve but also provided a unique opportunity to enhance our product.

AWS 72

AWS Amazon Web Services Cloud Cloud Computing 72

Cloudera

JUNE 7, 2023

By now, almost everyone across the tech landscape has heard of the Zero Trust (ZT) security model, which assumes that every device, application, or user attempting to access a network is not to be trusted (see NIST definitions below). This is the balancing act of security. It’s a win-win.

Government 79

Government Metadata Data Lake Data 79

Monte Carlo

NOVEMBER 9, 2023

In my opinion, enterprise ready generative AI must be: Secure & private: Your AI application must ensure that your data is secure, private, and compliant, with proper access controls. Put simply, the underlying infrastructure to scale, secure, and operate LLM applications is not there yet. Remember NFTs?).

Unstructured Data 86

Unstructured Data Database Data Pipeline Architecture 86

Data Engineering Podcast

DECEMBER 10, 2023

Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Andrew Maguire got tired of solving that problem for each of the different roles he has ended up in, so he created the open source Anomstack project.

Data Lake 130

Data Lake High Quality Data SQL Architecture 130

Snowflake

SEPTEMBER 7, 2023

Functions or procedures written by users in these languages are executed inside of Snowpark’s secure sandbox environment , which runs on the warehouse. We are excited to announce the public preview of External Access, which enables customers to reach external endpoints from Snowpark seamlessly and securely.

Amazon Web Services 111

Amazon Web Services AWS Government Python 111

Cloudera

DECEMBER 19, 2023

Earlier this month, I had the opportunity to lead a roundtable discussion at the PSN Government Innovation show ( 2023 Government Innovation Show – Federal – Public Sector Network ) in Washington, DC. I’ll highlight some key insights and takeaways from my conversations in the paragraphs that follow.

Government 86

Government Education Unstructured Data Datasets 86