Data Engineering Podcast

OCTOBER 15, 2023

Summary Building streaming applications has gotten substantially easier over the past several years. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. With Materialize, you can!

Process 182

Process Building SQL BI 182

Data Engineering Podcast

OCTOBER 1, 2023

Summary Artificial intelligence applications require substantial high quality data, which is provided through ETL pipelines. Now that AI has reached the level of sophistication seen in the various generative models it is being used to build new ETL workflows. With Materialize, you can!

Building 162

Building BI SQL Machine Learning 162

Christophe Blefari

APRIL 19, 2024

easy ( credits ) Hey, new Friday, new Data News. Evaluate anything you want with LLMs — I really like how LLMs can be used for tasks that are not the one we are first thinking of. This blog shows how you can use Gen AI to evaluate inputs like translations with added reasons. But don't worry it gonna be out soon.

MySQL 130

MySQL Data Datasets SQL 130

Christophe Blefari

SEPTEMBER 28, 2023

Make your data stack take-off ( credits ) Hello, another edition of Data News. This week, we're going to take a step back and look at the current state of data platforms. What are the current trends and why are people fighting around the concept of the modern data stack. Early September is usually conference season.

Cloud Storage 147

Cloud Storage Big Data Hadoop SQL 147

Scott Logic

APRIL 22, 2024

Large-model AI is becoming more and more influential in the market, and with the well-known tech giants starting to introduce easy-access AI stacks, a lot of businesses are left feeling that although there may be a use for AI in their business, they’re unable to see what use cases it might help them with.

BI 97

BI Software Engineer Software Engineering Algorithm 97

Precisely

MAY 6, 2024

Use data-driven insights and consistent, timely communication across channels to offer targeted promotions that increase customer engagement and revenue How can your financial institution not only keep up with the digital age, but thrive in it? To avoid confusion, frustration, and customer attrition, transformation is a must.

Retail 59

Retail Banking Technology Systems 59

Knowledge Hut

MAY 6, 2024

Systematic discovery of the system's dynamics, limitations, conditions, and illuminating principles (purpose, measure, methods, tools, etc.) Systematic discovery of the system's dynamics, limitations, conditions, and illuminating principles (purpose, measure, methods, tools, etc.) are the main objectives of systems thinking.

Systems 98

Systems Transportation Certification Healthcare 98

Precisely

DECEMBER 28, 2023

The concept of streaming data was born of necessity. But insights derived from day-old data don’t cut it. Business success is based on how we use continuously changing data. That’s where streaming data pipelines come into play. What is a streaming data pipeline? How do streaming data pipelines work?

Data Pipeline 91

Data Pipeline Building Kafka Big Data 91

Snowflake

APRIL 8, 2024

In 2020, Snowflake announced a new global competition to recognize the work of early-stage startups building their apps — and their businesses — on Snowflake, offering up to $250,000 in investment as the top prize. This year’s entries presented an impressively diverse set of use cases.

Pipeline-centric 127

Pipeline-centric Food Healthcare Unstructured Data 127

Knowledge Hut

APRIL 29, 2024

Replacing inherent social structures of a physical office, team stand-ups and in-person collaboration with tools like Slack, Microsoft Teams and Proofhub, knowledge sharing and learning new things can become much harder. There are several ways to grow your skills remotely and build momentum in your professional growth.

Data Science 98

Data Science Media Technology Big Data 98

Snowflake

MAY 1, 2024

BigGeo Crunching vast amounts of geospatial data is an intimidating, resource-consuming task. With our technology, clients can execute fast and effective geospatial queries, integrate seamlessly with Snowpark Container Services and significantly improve data visualization,” says Brent Lane, Co-Founder and CEO of BigGeo.

Media 104

Media Building Data Warehouse Technology 104

Cloudera

JANUARY 30, 2024

In the dynamic landscape of modern manufacturing, AI has emerged as a transformative differentiator, reshaping the industry for those seeking the competitive advantages of gained efficiency and innovation. Quality: Use cases like visual inspection, yield optimization, fault detection, and classification are enhanced with AI technologies.

Manufacturing 78

Manufacturing Data Lake Data Science Cloud 78

Snowflake

MAY 9, 2024

From its start with efficient batch processing with data warehouses for descriptive analytics, and the inclusion of streaming data in real time to build recommendations, we find ourselves at the forefront of a new stage of evolution: generative AI (gen AI). It’s already having a real-world impact. “It’s

61

61

Cloudera

DECEMBER 13, 2023

Implementing a cohesive data vision LGIM’s Global Chief Operating Office is responsible for the company’s technology, data, client servicing and the management of its strategic operating agenda. This includes delivering a transformation project to modernize LGIM, enable growth, and introduce more scalable and seamless services.

Pipeline-centric 89

Pipeline-centric Professional Services Datasets BI 89

Knowledge Hut

MAY 6, 2024

Introduction to Data-centric Agile Transformations Teams and Organizations adopt Agile to bring in the changes- faster turnaround, better results, quick reviews, dynamic teams. Yet, the philosophy seems nice to look at- people over tools, working software over documentation- yes everyone needs it.

IT 52

IT Data Management Building 52

Towards Data Science

DECEMBER 1, 2023

Pet Project for Data/Analytics Engineers: Explore Modern Data Stack Tools — dbt Core, Snowflake, Fivetran, GitHub Actions. This hands-on experience will allow you to develop an end-to-end data lifecycle, from extracting data from your Google Calendar to presenting it in a Snowflake analytics dashboard.

Data Engineering 72

Data Engineering Data Engineer Project Engineering 72

Snowflake

SEPTEMBER 25, 2023

Digital advancements such as smart manufacturing and automation through AI, machine learning (ML), robotics, and IoT require a connected value chain ecosystem with a secure, scalable, and flexible data platform. The unprecedented amount of volatility in supply and demand has caused economic uncertainty throughout the world.

Manufacturing 89

Manufacturing Cloud Electronics BI 89

Precisely

NOVEMBER 29, 2023

Hyperautomation is the practice of automating as many processes as possible across an entire organization as quickly as possible, using a combination of tools, systems, and techniques. Automation and digital transformation play pivotal roles in building and maintaining the agility needed to face the challenges ahead.

High Quality Data 64

High Quality Data Data Integration Process Building 64

Cloudera

DECEMBER 1, 2023

Recent Government Initiatives on Public Sector AI Solutions In recent years, governments across the globe have recognized the transformative potential of artificial intelligence (AI) and have embarked on initiatives to harness this technology to drive innovation and serve their citizens more effectively.

Building 105

Building Government Transportation Data Governance 105

Workfall

JULY 18, 2023

Behind the scenes, a team of data wizards tirelessly crunches mountains of data to make those recommendations sparkle. As one of those wizards, we’ve seen the challenges we face: the struggle to transform massive datasets into meaningful insights, all while keeping queries fast and our system scalable.

Datasets 77

Datasets Entertainment Data Workflow Data 77

Knowledge Hut

DECEMBER 26, 2023

According to the World Economic Forum, the amount of data generated per day will reach 463 exabytes (1 exabyte = 10 9 gigabytes) globally by the year 2025. Thus, almost every organization has access to large volumes of rich data and needs “experts” who can generate insights from this rich data.

Data Science 97

Data Science BI Business Intelligence Data Mining 97

Precisely

FEBRUARY 23, 2024

Insurance is an inherently data-driven industry. Even before the age of advanced analytics, experts in the industry were routinely using data to assess risk and price policies. Today, data analytics plays a more important role than ever. Innovators are in a race to see who can use it to their best advantage.

Insurance 64

Insurance Data Validation Government High Quality Data 64

DoorDash Engineering

NOVEMBER 28, 2023

DoorDash has been building an internal Machine Learning Workbench over the past year to enhance data operations and assist our data scientists, analysts, and AI/ML engineers. We also shed light on how we drove value by taking a user-centered approach while building this internal tool.

Machine Learning 90

Machine Learning Pipeline-centric Data Science Designing 90

Knowledge Hut

JANUARY 29, 2024

Some techniques add to the development of technology in the business sectors, including Data Science and Cloud Computing, essential aspects of the technology industry. With the help of data science, one can gather all the critical analyses from vast chunks of data stored in clouds. In this model, the data is not 100% secure.

Cloud Computing 98

Cloud Computing Data Science Cloud Amazon Web Services 98

Snowflake

FEBRUARY 22, 2024

And we get it — we’re talking about a transformative technology that presents seemingly limitless possibilities. With Sage AI by Braze, marketers can use generative features for quick content creation and quality assurance. A lot of the buzz around AI focuses on its future potential.

Technology 91

Technology Machine Learning Utilities Designing 91

Data Engineering Weekly

APRIL 14, 2024

With the 1-bit LLM model, the researchers are suggesting instead of FP16 (Full Precision floating-point number with 5-bits) or FP32 (Full Precision floating-point number with 6-bits), you can build an equally efficient model using ternary digit set ∈ {-1, 0, 1}.

Data Engineering 62

Data Engineering Data Engineer Engineering Business Intelligence 62

Snowflake

FEBRUARY 14, 2024

A strategic approach to data and talent strategies will distinguish leaders in a transformed business landscape. How do we build trust in AI? Why have a data strategy? Running a host of different initiatives to address this data sprawl further dilutes business density, squeezing out room for revenue.

Architecture 85

Architecture Government Data Management Management 85

Knowledge Hut

DECEMBER 7, 2023

Welcome to the comprehensive guide for beginners on harnessing the power of Microsoft's remarkable data visualization tool - Power BI. In today's data-driven world, the ability to transform raw data into meaningful insights is paramount, and Power BI empowers users to achieve just that.

BI 52

BI Raw Data Datasets Business Intelligence 52

Snowflake

SEPTEMBER 28, 2023

Data is an invaluable asset in today’s marketing ecosystem. With its unique blend of cultures, economies, and regulatory environments, the EMEA market offers a nuanced picture of how marketers harness data technologies to understand their audiences, calibrate campaigns in real time, and adhere to complex government and industry regulations.

Government 88

Government Data Integration Machine Learning Technology 88

Ascend.io

JANUARY 2, 2024

Getting your hands on the right data at the right time is the lifeblood of any forward-thinking company. But let’s be honest, creating effective, robust, and reliable data pipelines, the ones that feed your company’s reporting and analytics, is no walk in the park. What Is a Data Pipeline? But our journey doesn’t end there.

Data Pipeline 52

Data Pipeline Building Raw Data Data Warehouse 52

Knowledge Hut

MAY 2, 2024

As per Apache, “ Apache Spark is a unified analytics engine for large-scale data processing ” Spark is a cluster computing framework, somewhat similar to MapReduce but has a lot more capabilities, features, speed and provides APIs for developers in many languages like Scala, Python, Java and R. billion (2019 - 2022).

Scala 52

Scala Hospitality Healthcare Retail 52

Snowflake

SEPTEMBER 12, 2023

The first annual Data Cloud Industry Day is here! Data Cloud Industry Day 2023 is a free virtual event on September 28, 2023, dedicated to what’s possible for you and your industry in the world of data. Hear how BNY Mellon’s Pershing X is transforming the advisor experience with the Data Cloud.

Cloud 92

Cloud Manufacturing Retail Healthcare 92

Data Engineering Weekly

FEBRUARY 4, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Joe Reis: Definition of Data Modeling & What Data Modeling Is not Joe raised a very fundamental question in data engineering.

Data Engineering 62

Data Engineering Data Engineer Engineering PostgreSQL 62

The Modern Data Company

FEBRUARY 2, 2024

Ever wondered why building data-driven applications feels like an uphill battle? It’s not just you – turning raw data into something meaningful can be a real challenge. In today’s fast-paced business environment, data-driven insights are the lifeblood of staying ahead.

Raw Data 75

Raw Data Utilities Government Data 75

Knowledge Hut

JANUARY 30, 2024

In today's world, where data rules the roost, data extraction is the key to unlocking its hidden treasures. As someone deeply immersed in the world of data science, I know that raw data is the lifeblood of innovation, decision-making, and business progress. What is data extraction?

ETL Tools 52

ETL Tools Database-centric Data Mining Data Cleanse 52

Knowledge Hut

DECEMBER 22, 2023

From self-driven cars to chatbots, AI will transform the way we live, work, and interact with one another. From healthcare to finance, AI transforms the way we live and work. Acquiring an Artificial Intelligence certification or similar could be a great step toward a successful AI career.

Amazon Web Services 98

Amazon Web Services Computer Science Algorithm Programming Language 98

Ascend.io

DECEMBER 19, 2023

We’ll talk about when and why ETL becomes essential in your Snowflake journey and walk you through the process of choosing the right ETL tool. Our focus is to make your decision-making process smoother, helping you understand how to best integrate ETL into your data strategy. That’s what we call a data pipeline.

ETL Tools 52

ETL Tools IT Data Pipeline Data Warehouse 52