Simon Späti

MARCH 9, 2021

The goal is to touch on the common data engineering challenges and using promising new technologies, tools or frameworks, which most of them I wrote about in Business Intelligence meets Data Engineering with Emerging Technologies.

Data Engineering 130

Data Engineering Data Engineer Engineering Project 130

Data Engineering Podcast

DECEMBER 4, 2022

Summary Business intelligence is the foremost application of data in organizations of all sizes. Zing Data is building a mobile native platform for business intelligence. In this episode Sabin Thomas shares his experiences building the platform and the interesting ways that it is being used.

Business Intelligence 100

Business Intelligence Metadata BI MongoDB 100

Data Engineering Podcast

APRIL 29, 2018

Summary Business Intelligence software is often cumbersome and requires specialized knowledge of the tools and data to be able to ask and answer questions about the state of the organization. What have been the most challenging aspects of building and growing Metabase, both from a technical and business perspective?

Business Intelligence 100

Business Intelligence Scala Hadoop Machine Learning 100

Data Engineering Podcast

OCTOBER 23, 2022

Summary Agile methodologies have been adopted by a majority of teams for building software applications. Prefect is the modern Dataflow Automation platform for the modern data stack, empowering data practitioners to build, run and monitor robust pipelines at scale.

Project 130

Project Metadata MongoDB MySQL 130

Data Engineering Podcast

NOVEMBER 13, 2022

Summary Building data products is an undertaking that has historically required substantial investments of time and talent. In this episode he explains the design of the platform and how it builds on agile development principles to help you focus on delivering value. Can you describe what AgileData is and the story behind it?

Building 130

Building Metadata MongoDB MySQL 130

Data Engineering Podcast

JANUARY 15, 2023

Monte Carlo monitors and alerts for data issues across your data warehouses, data lakes, dbt models, Airflow jobs, and business intelligence tools, reducing time to detection and resolution from weeks to just minutes. If you've learned something or tried out a project from the show then tell us about it!

Coding 130

Coding Building PostgreSQL Data Lake 130

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode Nick King discusses how you can be intentional about data creation in your applications and services to reduce the friction and errors involved in building data products and ML applications. What are the organizational patterns that are required to support effective workflows for building data generation capabilities?

Building 130

Building IT Metadata MongoDB 130

dbt Developer Hub

APRIL 19, 2023

Part 1: Setup dbt project and database ​ Step 1: Install project dependencies ​ Before you can get started: You must have either DuckDB or PostgreSQL installed. This tutorial aims to solve this by providing the definitive guide to dimensional modeling with dbt. or above installed You must have dbt version 1.3.0

Building 145

Building PostgreSQL BI Database 145

Knowledge Hut

JUNE 19, 2023

Business intelligence (BI) is a profession that provides insightful data to help organizations make informed decisions. Since business intelligence uses information obtained from extensive data sets to provide insightful reports, it is strongly related to the discipline of data visualization.

Business Intelligence 52

Business Intelligence BI Programming Language Recruitment 52

Knowledge Hut

APRIL 23, 2024

Data Science and Business intelligence are popular terms in every business domain these days. For an organization, it is essential to know the difference between business intelligence and data science to make fair use of both and ensure significant growth. Business Intelligence only deals with structured data.

Business Intelligence 52

Business Intelligence Data Science BI Unstructured Data 52

Knowledge Hut

APRIL 25, 2024

However, with Business intelligence dashboards, knowledge is dispersed throughout the organization, enabling users to produce interactive reports, utilize data visualization, and disseminate the knowledge with internal and external stakeholders. What is a Business Intelligence Dashboard?

Business Intelligence 52

Business Intelligence BI Raw Data Data Lake 52

Data Engineering Podcast

DECEMBER 25, 2022

Summary Five years of hosting the Data Engineering Podcast has provided Tobias Macey with a wealth of insight into the work of building and operating data systems at a variety of scales and for myriad purposes. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan's active metadata capabilities.

Building 100

Building Metadata Business Intelligence Data Lake 100

Knowledge Hut

JANUARY 19, 2024

The process of gathering, storing, mining, and analyzing data comes under business intelligence. Under BI, all the data a company generates gets stored and used to make significant business growth decisions and multiply the revenue. What is Business Intelligence? What is Business Intelligence?

Business Intelligence 52

Business Intelligence BI Raw Data Data Warehouse 52

Knowledge Hut

JANUARY 19, 2024

Business Intelligence Analyst Importance The proliferation of IoT-connected objects, IoT-based sensors, rising internet usage, and sharp increases in social media activity are all enhancing businesses' ability to gather enormous amounts of data. What Does a Business Intelligence Analyst Do?

Business Intelligence 52

Business Intelligence BI Business Analyst Finance 52

U-Next

SEPTEMBER 7, 2022

As data generation and consumption continue to soar, Business Intelligence (BI) has become more relevant in this digital world. Most business organizations are motivated to transform into data-driven companies irrespective of their size. What Is Business Intelligence Dashboard? . Introduction . Forecasting .

Business Intelligence 52

Business Intelligence BI Finance Raw Data 52

Data Engineering Podcast

MAY 19, 2019

Summary In recent years the traditional approach to building data warehouses has shifted from transforming records before loading, to transforming them afterwards. The data build tool (dbt) is designed to bring battle tested engineering practices to your analytics pipelines. When is it the wrong choice?

Data Analytics 100

Data Analytics Building Engineering Data Warehouse 100

ProjectPro

JANUARY 31, 2023

Want to know who is a business intelligence engineer, what does a business intelligence engineer do, and how these BI engineers turn mountains of data into actionable insights? According to Fortune Business Insights, the global market for business intelligence is likely to grow at a CAGR of 8.7%

Business Intelligence 52

Business Intelligence Engineering BI Data Warehouse 52

ProjectPro

FEBRUARY 16, 2023

Business Intelligence and Artificial Intelligence are popular technologies that help organizations turn raw data into actionable insights. While both BI and AI provide data-driven insights, they differ in how they help businesses gain a competitive edge in the data-driven marketplace. What is Business Intelligence?

Business Intelligence 52

Business Intelligence BI Data Mining Algorithm 52

Data Engineering Podcast

DECEMBER 19, 2021

Summary Building a well managed data ecosystem for your organization requires a holistic view of all of the producers, consumers, and processors of information. The team at Metaphor are building a fully connected metadata layer to provide both technical and social intelligence about your data.

Systems 100

Systems Building Metadata Data Warehouse 100

Data Engineering Podcast

DECEMBER 29, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode.

Management 130

Management Metadata Business Intelligence Data Lake 130

Data Engineering Podcast

DECEMBER 18, 2022

In this episode Abe Gong brings his experiences with the Great Expectations project and community to discuss the technical and organizational considerations involved in implementing these constraints to your data workflows. If you've learned something or tried out a project from the show then tell us about it!

Metadata 130

Metadata Business Intelligence Data Lake BI 130

Data Engineering Podcast

MAY 15, 2022

Srivatsan Sridharan has had the opportunity to design, build, and run data lake platforms for both Yelp and Robinhood, with many valuable lessons learned from each experience. Signup for the SaaS product at dataengineeringpodcast.com/acryl RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 100

Data Lake Building Architecture BI 100

Knowledge Hut

JUNE 26, 2023

Get ready to delve into fascinating data engineering project concepts and explore a world of exciting data engineering projects in this article. Best Data Science certifications online or offline are available to assist you in establishing a solid foundation for every end-to-end data engineering project.

Data Engineering 98

Data Engineering Data Engineer Coding Project 98

Data Engineering Podcast

SEPTEMBER 11, 2022

In this episode he shares the design of the project and how it fits into your development practices. Prefect is the modern Dataflow Automation platform for the modern data stack, empowering data practitioners to build, run and monitor robust pipelines at scale. Email hosts@dataengineeringpodcast.com ) with your story.

Systems 100

Systems Metadata Building MongoDB 100

Data Engineering Podcast

FEBRUARY 5, 2023

If you've learned something or tried out a project from the show then tell us about it! If you've learned something or tried out a project from the show then tell us about it! The Machine Learning Podcast helps you go from idea to production with machine learning. Email hosts@dataengineeringpodcast.com ) with your story.

Data Engineering 147

Data Engineering Data Engineer Engineering PostgreSQL 147

Data Engineering Podcast

SEPTEMBER 25, 2022

In this episode Tom Baeyens explains their reasons for creating a new syntax for expressing and validating checks for data assets and processes, as well as how to incorporate it into your own projects. If you’ve learned something or tried out a project from the show then tell us about it!

Building 100

Building Metadata MongoDB MySQL 100

Data Engineering Podcast

SEPTEMBER 18, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Building 100

Building Metadata MongoDB MySQL 100

Data Engineering Podcast

JUNE 22, 2020

Summary The majority of analytics platforms are focused on use internal to an organization by business stakeholders. As the availability of data increases and overall literacy in how to interpret it and take action improves there is a growing need to bring business intelligence use cases to a broader audience.

Business Intelligence 100

Business Intelligence Data Engineering Data Engineer SQL 100

Snowflake

FEBRUARY 21, 2023

Welcome to Snowflake’s Startup Spotlight, where we learn about awesome companies building businesses on Snowflake. I’ve worked on building API platforms throughout my career. I led the developer experience team and the Voice product (one of the main revenue engines), and I founded the AI/ML business unit.

AWS 131

AWS Building Raw Data Architecture 131

Data Engineering Podcast

OCTOBER 22, 2021

Summary The market for business intelligence has been going through an evolutionary shift in recent years. Lightdash has fully embraced that shift by building an entire open source business intelligence framework that is powered by dbt models. What are the main goals of the project?

Engineering 100

Engineering Business Intelligence BI Data Warehouse 100

Data Engineering Podcast

MAY 22, 2022

Flyte is a project that was started at Lyft to address their internal needs for machine learning and integrated closely with Kubernetes as the execution manager. Signup for the SaaS product at dataengineeringpodcast.com/acryl RudderStack helps you build a customer data platform on your warehouse or data lake.

Machine Learning 130

Machine Learning Data Engineering Data Engineer Cloud 130

Data Engineering Podcast

APRIL 26, 2021

One of the most common and widely used methods of access is through a business intelligence dashboard. He digs into how it integrates with your data stack, how you can extend it to fit your use case, and why open source systems are a good choice for your business intelligence. Can you start by describing what Superset is?

Business Intelligence 100

Business Intelligence Data Warehouse Hadoop Data Pipeline 100

Snowflake

JUNE 21, 2024

Thousands of customers have worked with Snowflake to cost-effectively build a secure data foundation as they look to solve a growing variety of business problems with more data. Increasingly customers are looking to expand that powerful foundation to a broader set of data across their enterprise. Why use Iceberg Tables?

Data Lake 123

Data Lake BI Business Intelligence Metadata 123

Data Engineering Podcast

DECEMBER 21, 2020

I’m working with O’Reilly on a project to collect the 97 things that every data engineer should know, and I need your help. When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Governance 130

Data Governance Government Data Lake Banking 130

Data Engineering Podcast

JANUARY 8, 2023

Monte Carlo monitors and alerts for data issues across your data warehouses, data lakes, dbt models, Airflow jobs, and business intelligence tools, reducing time to detection and resolution from weeks to just minutes. If you've learned something or tried out a project from the show then tell us about it!

PostgreSQL 130

PostgreSQL Data Lake Data Warehouse BI 130

Data Engineering Podcast

NOVEMBER 27, 2022

The Arrow project is designed to eliminate wasted effort in translating between languages, and Voltron Data was created to help grow and support its technology and community. In this episode Wes McKinney shares the ways that Arrow and its related projects are improving the efficiency of data systems and driving their next stage of evolution.

Data Process 100

Data Process Process Metadata Business Intelligence 100

Data Engineering Podcast

JUNE 26, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130