Data Engineering Podcast

FEBRUARY 25, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. Data lakes are notoriously complex. Join us at the top event for the global data community, Data Council Austin.

Database 162

Database Technology Data Lake High Quality Data 162

Snowflake

MARCH 18, 2024

This time it’s all about ensuring that the data and the platform where it’s processed are ready for the new AI models. But there’s still a long way to go in an environment where the volume, velocity and complexity of data and data types is constantly increasing. And it’s not just any type of data.

Unstructured Data 82

Unstructured Data Government Data Pipeline Cloud 82

Data Engineering Podcast

MARCH 3, 2024

Colleen Tartow has worked across all stages of the data lifecycle, and in this episode she shares her hard-earned wisdom about how to conduct an AI program for your organization. Data lakes are notoriously complex. Join us at the top event for the global data community, Data Council Austin. Your first 30 days are free!

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

MARCH 17, 2024

Summary A significant portion of data workflows involve storing and processing information in database engines. In this episode Gleb Mezhanskiy, founder and CEO of Datafold, discusses the different error conditions and solutions that you need to know about to ensure the accuracy of your data. Data lakes are notoriously complex.

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

MARCH 10, 2024

Summary Data lakehouse architectures are gaining popularity due to the flexibility and cost effectiveness that they offer. The link that bridges the gap between data lake and warehouse capabilities is the catalog. Data lakes are notoriously complex. Join us at the top event for the global data community, Data Council Austin.

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Analytics Vidhya

MARCH 21, 2023

Introduction In today’s world, data is growing exponentially with time with digitalization. Organizations are using various cloud platforms like Azure, GCP, etc., to store and analyze this data to get valuable business insights from it.

Data 240

Data Cloud Data Lake Database 240

Snowflake

APRIL 1, 2024

Snowflake and Salesforce are happy to share that bidirectional data sharing between Snowflake, the Data Cloud company and Salesforce Data Cloud is now generally available. Enterprises generate valuable customer data inside Salesforce applications. It has opened up new frontiers of data collaboration.

Cloud 114

Cloud Retail Entertainment Media 114

Snowflake

APRIL 8, 2024

The list of Top 10 semi-finalists is a perfect example: we have use cases for cybersecurity, gen AI, food safety, restaurant chain pricing, quantitative trading analytics, geospatial data, sales pipeline measurement, marketing tech and healthcare. Our sincere thanks go out to everyone who participated in this year’s competition.

Pipeline-centric 119

Pipeline-centric Food Healthcare Unstructured Data 119

Snowflake

APRIL 11, 2024

Data is the lifeblood of modern businesses, but unlocking its true insights often requires complex SQL queries. At Snowflake, we believe in making the power of data accessible to all. Get ready to see Copilot in action at the Snowflake Data Cloud Summit this June 2024 !

SQL 134

SQL AWS Data Analysis High Quality Data 134

Christophe Blefari

FEBRUARY 3, 2024

Anyway this week will be a mixed Data News with links, stuff and ideas and a small wrap-up of the DuckCon + the stuff I presented on Wed. to a Modern Data Stack meetup in Paris about DuckDB WASM. State of the French data market 2 benchmarks have been published recently about the French data market. conference.

MongoDB 130

MongoDB SQL Data Data Warehouse 130

Snowflake

APRIL 16, 2024

Neither is true if we use the deprecation of third-party cookies and subsequent shift to first-party data as a positive forcing factor. The urgency around generative AI demands focus on first-party data anyway, and regulatory environments are tightening — GDPR violations alone cost companies nearly 2.1

Cloud 71

Cloud Government Data AWS 71

Knowledge Hut

APRIL 25, 2024

Big data in information technology is used to improve operations, provide better customer service, develop customized marketing campaigns, and take other actions to increase revenue and profits. It is especially true in the world of big data. It is especially true in the world of big data. What Are Big Data T echnologies?

Big Data 64

Big Data Technology NoSQL Hadoop 64

Knowledge Hut

APRIL 23, 2024

In the modern data-driven landscape, organizations continuously explore avenues to derive meaningful insights from the immense volume of information available. Two popular approaches that have emerged in recent years are data warehouse and big data. Data warehousing offers several advantages.

Data Warehouse 52

Data Warehouse Big Data Unstructured Data Hadoop 52

Snowflake

FEBRUARY 5, 2024

And it’s no wonder — this new technology has the potential to revolutionize the industry by augmenting the value of employee work, driving organizational efficiencies, providing personalized customer experiences, and uncovering new insights from vast amounts of data. One potential source is data sharing.

Unstructured Data 92

Unstructured Data Banking Government Insurance 92

Knowledge Hut

APRIL 23, 2024

Big data has revolutionized the world of data science altogether. With the help of big data analytics, we can gain insights from large datasets and reveal previously concealed patterns, trends, and correlations. Learn more about the 4 Vs of big data with examples by going for the Big Data certification online course.

Big Data 52

Big Data Media Datasets Unstructured Data 52

Snowflake

MARCH 5, 2024

An estimated 90% of the world’s data is unstructured, much of it in the form of visual content such as images and videos. Insights from analyzing this visual data can open up powerful new use cases that significantly boost productivity and efficiency, but enterprises need sophisticated computer vision technologies to achieve this.

Cloud 119

Cloud Medical Manufacturing Retail 119

Snowflake

APRIL 4, 2024

Data transformation is the process of converting data from one format to another, the “T” in ELT, or extract, load, transform, which enables organizations to get their data analytics-ready and derive insights and value from it. The Coalesce platform is uniquely built for Snowflake.

Cloud 101

Cloud Management Data Pipeline SQL 101

Snowflake

APRIL 10, 2024

One of our key objectives at Snowflake is to help enterprises fully unlock the value of their data, and an important aspect of that is making data both accessible and actionable to as many people as possible, regardless of their role or technical skill set.

Finance 101

Finance Media Cloud Data 101

Snowflake

JANUARY 15, 2024

Leading companies around the world rely on Informatica data management solutions to manage and integrate data across various platforms from virtually any data source and on any cloud. Now, Informatica customers in the Snowflake ecosystem have an even easier way to integrate data to and from the Snowflake Data Cloud.

Data Integration 91

Data Integration BI Cloud Data 91

Cloudera

APRIL 23, 2024

The Hackathon was intended to provide data science experts with access to Cloudera machine learning to develop their own Accelerated Machine Learning Project (AMP) focused on solving one of the many environmental challenges facing the world today.

Machine Learning 85

Machine Learning Data Science Retail Consulting 85

Hevo

APRIL 26, 2024

In today’s data-driven world, data storage and analysis are essential to derive deeper insights for smarter decision-making. As data volumes increase, organizations consider shifting transactional data from Oracle databases on AWS RDS to a powerful platform like Google BigQuery.

AWS 52

AWS Data Storage Database Data 52

Snowflake

DECEMBER 11, 2023

While digital advertisers and paid media professionals are on the hook to build ample sales pipeline and maximize return on ad spend (ROAS), they’re also expected to deliver personalized advertising content while navigating evolving privacy requirements and adhering to consumer expectations—all while extracting insights from siloed ad platforms.

Building 87

Building Cloud Media Algorithm 87

LinkedIn Engineering

OCTOBER 13, 2023

Co-Authors: Chaitali Parmar , Eric Stoll , and Natasha Michel At Linkedin, one of the Information Security team's core commitments is to enable an environment of trusted and secure products, platforms, and infrastructure for our employees, members, and customers. It took up a lot of time and resources to gather all the necessary information.

Management 98

Management IT Aggregated Data Programming 98

ThoughtSpot

JANUARY 31, 2024

As a result, end users expect faster response times and easier access to meaningful insights. We continue to lead from the front today, with advanced generative AI and ML capabilities infused at all layers of our platform, including ThoughtSpot Everywhere and Mode.

BI 89

BI Business Intelligence Metadata Machine Learning 89

Snowflake

OCTOBER 17, 2023

See how ctrl+s provides in-depth insights into supply chain sustainability, while protecting sensitive customer information—all through Snowflake’s powerful, scalable Data Cloud. One is a comprehensive and advanced data set of emissions factors, made up of several billion rows of data, called matter+s.

Cloud 81

Cloud Consulting Transportation Manufacturing 81

Data Engineering Weekly

APRIL 14, 2024

Github shares some insights on how Github engineers use Github Copilot. Discover how a universal semantic layer is transforming modern business intelligence, making data more accessible and reliable for organizations striving for informed business decisions. It's a good read that familiarizes you with the LakeHouse formats.

Data Engineering 62

Data Engineering Data Engineer Engineering Business Intelligence 62

Knowledge Hut

APRIL 25, 2024

Big data can be summed up as a sizable data collection comprising a variety of informational sets. It is a vast and intricate data set. Big data has been a concept for some time, but it has only just begun to change the corporate sector. What is Big Data? What are the Benefits of Big Data?

Big Data 62

Big Data Entertainment Transportation Banking 62

ThoughtSpot

APRIL 2, 2024

Over the past couple of years, ThoughtSpot and Google have collaborated on a series of seamless user experiences—enabling deployments on Google Cloud Platform, creating the ability to live query entire Google BigQuery analytics catalogs, and integrating key Looker Modeling functionality just to name a few.

Google Cloud 59

Google Cloud Cloud Accessible Accessibility 59

ThoughtSpot

APRIL 17, 2024

And this is especially true in the realm of data and analytics. Or, if you could provide all of your insurance risk managers with the ability to analyze the risk profile of their claims with the power of search and automated insights? This sentiment is also reflected in the data.

Insurance 72

Insurance Business Intelligence Certification Coding 72

ThoughtSpot

SEPTEMBER 6, 2023

Those coveted insights live at the end of a process lovingly known as the data pipeline. The pathway from ETL to actionable analytics can often feel disconnected and cumbersome, leading to frustration for data teams and long wait times for business users. Keep reading to see how it works. What is a SpotApp?

Data Workflow 91

Data Workflow Raw Data Data Lake Business Intelligence 91

ThoughtSpot

JANUARY 31, 2024

It’s an exciting time to be in the world of data and business intelligence. Recent advances in AI and machine learning are not only changing the way we interact with data, but also pushing those of us who build analytics and BI platforms to think critically about how our products can best serve our customers moving forward.

BI 88

BI Business Intelligence Machine Learning Data 88

ThoughtSpot

MARCH 5, 2024

Managing complex data pipelines is a major challenge for data-driven organizations looking to accelerate analytics initiatives. While AI-powered, self-service BI platforms like ThoughtSpot can fully operationalize insights at scale by delivering visual data exploration and discovery, it still requires robust underlying data management.

BI 94

BI Datasets Raw Data SQL 94

Snowflake

AUGUST 10, 2023

Discover how Bynder uses Snowflake’s Data Cloud to provide faster insights, support rapid growth, and unlock a new world of opportunities. But when the company started to experience rapid growth, it noticed performance issues with its data architecture. “

Cloud 52

Cloud Building Amazon Web Services BI 52

Snowflake

JANUARY 24, 2024

Governments collect more data than any other type of entity on the planet, yet their ability to use data to serve citizens more effectively has always been limited. For their full insights, read the new report, Public Sector Data + AI Predictions 2024.

Government 90

Government Data Management Cloud Data 90