Data Engineering Podcast

APRIL 7, 2024

What are the challenges involved in retrofitting a semantic layer into a production data system? The Machine Learning Podcast helps you go from idea to production with machine learning. What are the challenges involved in retrofitting a semantic layer into a production data system? dbt, BI, warehouse marts, etc.)

Data Lake 162

Data Lake High Quality Data BI Data Workflow 162

The Modern Data Company

APRIL 15, 2024

The elegance of Data Products is undeniable, but many leaders question the efficacy of their data strategies: Why does the return on data investments often disappoint? What Exactly Is a Data Product? The term “Data Product” has become a buzzword, often misused or overstretched.

Government 52

Government Metadata Data Data Lake 52

The Modern Data Company

JANUARY 22, 2024

While traditional approaches involve piecing together disparate data products, DataOS® offers a composable framework that seamlessly integrates with existing technology stacks. Data products contain data and its metadata, code, and infrastructure so that each product is self-contained and usable independently.

Data Integration 87

Data Integration Metadata Government Unstructured Data 87

Snowflake

MARCH 20, 2024

Having frequently worked with governments around the world over the course of my career, I’ve had all kinds of discussions about the global impact of generative AI. Here is the basic formula: Infrastructure + Products = Revolution in X A revolutionary innovation requires infrastructure that makes the underlying technology readily available.

Government 75

Government Algorithm Banking Telecommunication 75

Data Engineering Podcast

FEBRUARY 11, 2024

What are the requirements around governance and auditability of data access that need to be addressed when sharing data? The Machine Learning Podcast helps you go from idea to production with machine learning. What are the requirements around governance and auditability of data access that need to be addressed when sharing data?

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

Data Engineering Podcast

APRIL 14, 2024

The Machine Learning Podcast helps you go from idea to production with machine learning. With enterprise-grade hosting on Dagster Cloud, you gain even more capabilities, adding cost management, security, and CI support to further boost your teams' productivity. Don't forget to check out our other shows.

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Data Engineering Podcast

MARCH 31, 2024

While there are numerous products available to provide that visibility, they all have different technologies and workflows that they focus on. Over the past ~3 years there were numerous data observability systems/products created. The Machine Learning Podcast helps you go from idea to production with machine learning.

Project 130

Project Data Lake High Quality Data Data Workflow 130

Data Engineering Podcast

JANUARY 21, 2024

Recent years have seen the adoption of reverse ETL, cloud data warehouses, and sophisticated product analytics suites. What are the governance policy and enforcement challenges that are added with the expansion of access and responsibility? The Machine Learning Podcast helps you go from idea to production with machine learning.

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Data Engineering Podcast

DECEMBER 31, 2023

Get all of the details and try the new product today at dataengineeringpodcast.com/rudderstack You shouldn't have to throw away the database to build with fast-changing data. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!

Designing 130

Designing Data Lake High Quality Data SQL 130

Data Engineering Podcast

JANUARY 28, 2024

The majority of products that are available either require too much effort to structure the logs, or aren't fast enough for interactive use cases. How have the design and goals of the product changed since you first started working on it? The Machine Learning Podcast helps you go from idea to production with machine learning.

Data Lake 147

Data Lake Building High Quality Data AWS 147

Cloudera

APRIL 2, 2024

It’s been said that the Federal Government is one of, if not the largest, producer of data in the United States, and this data is at the heart of mission delivery for agencies across the civilian to DoD spectrum. FedRAMP requires that we meet strict security standards to protect government data.

Designing 95

Designing Process Government Metadata 95

databricks

MAY 3, 2024

Moving generative AI applications from the proof of concept stage into production requires control, reliability and data governance. Organizations are turning to open.

Data Governance 66

Data Governance Government Data 66

Data Engineering Podcast

FEBRUARY 4, 2024

The Machine Learning Podcast helps you go from idea to production with machine learning. With enterprise-grade hosting on Dagster Cloud, you gain even more capabilities, adding cost management, security, and CI support to further boost your teams' productivity. Don't forget to check out our other shows. Starburst : ![Starburst

SQL 173

SQL Data Lake High Quality Data Data Pipeline 173

Data Engineering Podcast

MARCH 3, 2024

How does the idea of an "AI Program" differ from an "AI Product"? The Machine Learning Podcast helps you go from idea to production with machine learning. How does the idea of an "AI Program" differ from an "AI Product"? Don't forget to check out our other shows. Data Council : ![Data

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

FEBRUARY 25, 2024

What are the elements of the overall product/user experience that you had to build to create a cohesive platform? The Machine Learning Podcast helps you go from idea to production with machine learning. What are the elements of the overall product/user experience that you had to build to create a cohesive platform?

Database 162

Database Technology Data Lake High Quality Data 162

Data Engineering Podcast

JANUARY 7, 2024

When performing research and building prototypes of the projects, what is your process for incorporating user experience into the implementation of the product? The Machine Learning Podcast helps you go from idea to production with machine learning. Don't forget to check out our other shows.

Data Process 147

Data Process Process Data Lake High Quality Data 147

Data Engineering Podcast

NOVEMBER 26, 2023

Get all of the details and try the new product today at dataengineeringpodcast.com/rudderstack You shouldn't have to throw away the database to build with fast-changing data. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Data Engineering Podcast

MARCH 17, 2024

The Machine Learning Podcast helps you go from idea to production with machine learning. With enterprise-grade hosting on Dagster Cloud, you gain even more capabilities, adding cost management, security, and CI support to further boost your teams' productivity. Don't forget to check out our other shows. Data Council : ![Data

Database 147

Database Data Lake High Quality Data Data Workflow 147

Snowflake

MARCH 19, 2024

The most marked finding was around governance. Strong data governance is essential to meet security and compliance obligations, but it is often regarded as a hindrance. Application of individual governance features (tags applied to data objects, masking policies assigned to data sets, etc.)

Data Governance 110

Data Governance Government Unstructured Data Programming Language 110

Data Engineering Podcast

MARCH 10, 2024

The Machine Learning Podcast helps you go from idea to production with machine learning. With enterprise-grade hosting on Dagster Cloud, you gain even more capabilities, adding cost management, security, and CI support to further boost your teams' productivity. Don't forget to check out our other shows.

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Knowledge Hut

APRIL 26, 2024

Datasets may also be confidential as they may contain sensitive information pertaining to a product, organization or government. In the real world, data is not open source , as it is confidential and may contain very sensitive information related to an item , user or product. Data is not available in a specific format.

Datasets 98

Datasets Machine Learning Deep Learning Finance 98

Knowledge Hut

APRIL 24, 2024

There are no professional exams you need to pass or a governing body. They are hired primarily by manufacturing firms and aid them in finding ways to maximize production while minimizing the cost of production. However, you must have a knack for mathematics and economics with commerce as your background.

Retail 98

Retail Finance Certification Banking 98

Snowflake

DECEMBER 20, 2023

Integrated governance: Snowpark Container Services runs within the same Snowflake Horizon governance framework as the data. By having the same governance over data and compute, developers can more effortlessly ensure data is protected to streamline security reviews for new developments.

Scala 116

Scala Government Java AWS 116

Data Engineering Weekly

MARCH 17, 2024

India recently announced that all AI apps require government approval and dropped the plan later. link] Jarkko Moilanen: Exploring the Frontier of Data Products - Seeking Insights on Emerging Standards Data products are becoming a central part of the data pipeline strategy, bringing a new approach to building data as an asset.

Data Engineering 70

Data Engineering Data Engineer Engineering Data Governance 70

The Modern Data Company

JULY 31, 2023

Modern Announces Partnership with Data Mesh Pioneers, ThoughtWorks In July, we collaborated with ThoughtWorks at the annual CDOIQ Conference in Cambridge, MA to discuss real-world Data Products implementation and best practices for Data Mesh. Data Products introduce a change by incorporating more deterministic software practices.

Government 98

Government Data Governance Architecture Data Pipeline 98

Snowflake

MARCH 18, 2024

Breaking down data silos, removing duplication, creating trusted data products, reducing the cost of data rework, ensuring more timely insights and cross-functional use cases, and improving user adoption. Many modern enterprises have far-flung operations, products and value chains that generate data globally and in a federated way.

Unstructured Data 80

Unstructured Data Government Data Pipeline Cloud 80

Snowflake

APRIL 11, 2024

That’s why we prioritize simplicity, governance and quality in everything we build – including our AI-powered tools. We’re thrilled to announce the public preview of Snowflake Copilot, a new solution on the bleeding edge of text-to-SQL that simplifies data analysis while maintaining robust governance.

SQL 134

SQL AWS Data Analysis High Quality Data 134

Knowledge Hut

APRIL 16, 2024

empowers enterprises to - Check the plans more quickly (Lean Startup cycle + Lean User experience) Enable fastest delivery (Scalable DevOps + Continuous Delivery pipeline) Simplify governance and improve portfolio performance (Lean Portfolio management + Lean budgets) Why is SAFe® crucial for the organizations? for teams (SP) Today, SAFe® 6.0

Certification 98

Certification Portfolio Consulting Programming 98

Knowledge Hut

APRIL 25, 2024

Farmers are using Data Science to increase crop yields, reduce water usage, and improve the quality of their products. This helps to protect consumers and ensure that food products are safe for consumption. Data can help government agencies develop policies that support agriculture.

Data Science 98

Data Science Food Data Government 98

Snowflake

MARCH 5, 2024

With Snowflake Cortex, a fully managed service that runs on NVIDIA GPU-accelerated compute, there is no need to set up integrations, manage infrastructure or move data outside of the Snowflake governance boundary to use the power of industry-leading LLMs from Mistral AI , Meta and more.

Government 87

Government AWS Data Preparation Data Governance 87

Cloudera

DECEMBER 19, 2023

Earlier this month, I had the opportunity to lead a roundtable discussion at the PSN Government Innovation show ( 2023 Government Innovation Show – Federal – Public Sector Network ) in Washington, DC. Our government leaders had several suggestions: Start small. The underlying reason?

Government 85

Government Education Unstructured Data Datasets 85

The Modern Data Company

MARCH 1, 2024

We need a new approach, a paradigm shift that delivers data with the agility and efficiency of a speedboat – enter Data Products. You don’t warehouse a vast inventory, only the components needed for current production. Data Products work similarly, offering pre-packaged, actionable data units tailored to specific business goals.

Database-centric 40

Database-centric Data Lake Government Retail 40

The Modern Data Company

APRIL 15, 2024

Unlocking Business Value with Data Product Strategy Adopting a Data Product Strategy isn’t just about upgrading your technology; it’s about elevating your entire organization to operate in a more informed, agile, and strategic manner. Think of it as the central hub of your data universe.

Raw Data 52

Raw Data Government Data Datasets 52

Snowflake

MARCH 21, 2024

Snowflake is committed to helping our customers unlock the power of artificial intelligence (AI) to drive better decisions, improve productivity and reach more customers using all types of data.

Government 115

Government Technology Cloud Building 115

Snowflake

MARCH 27, 2024

One of our partners in this area is Observe , which offers a SaaS observability product that is built and operated on the Data Cloud. This further simplifies and enhances their data governance by allowing them to keep more of their data within the secure environment of their Snowflake account.

Cloud 113

Cloud Data Governance Government Data 113

Monte Carlo

MARCH 25, 2024

Beyond our recognition in the category, we were also named one of G2Crowd’s 100 Fastest Growing Products for 2024 , signifying our unrivaled customer adoption across the U.S., Releasing new products by building solutions for pipeline runtime optimization with Performance product and ad-hoc data analysis Data Explorer.

MySQL 64

MySQL Government Data Governance Kafka 64

Snowflake

DECEMBER 5, 2023

Engaging with partners and customers — and showcasing what’s new on the Snowflake product front — made for a dynamic time in Las Vegas. Here are highlights from the collaborations, integrations and product enhancements that we were proud to dig in to throughout the week.

AWS 93

AWS Amazon Web Services Government Cloud Computing 93