Data Engineering Podcast

SEPTEMBER 11, 2022

Summary Data engineering systems are complex and interconnected with myriad and often opaque chains of dependencies. As they scale, the problems of visibility and dependency management can increase at an exponential rate. Interview Introduction How did you get involved in the area of data management?

Systems 100

Systems Metadata Building MongoDB 100

Data Engineering Podcast

DECEMBER 19, 2021

In this episode Pardhu Gunnam and Mars Lan explain how they have designed the architecture and user experience to allow everyone to collaborate on the data lifecycle and provide opportunities for automation and extensible workflows. Start trusting your data with Monte Carlo today! No more scripts, just SQL.

Systems 100

Systems Building Metadata Data Warehouse 100

Data Engineering Podcast

SEPTEMBER 3, 2018

Summary With the proliferation of data sources to give a more comprehensive view of the information critical to your business it is even more important to have a canonical view of the entities that you care about. Can you start by establishing a definition of data mastering that we can work from?

Data Management 100

Data Management Management Relational Database Business Intelligence 100

Knowledge Hut

DECEMBER 29, 2023

The market for analytics is flourishing, as is the usage of the phrase Data Science. Professionals from a variety of disciplines use data in their day-to-day operations and feel the need to understand cutting-edge technology to get maximum insights from the data, therefore contributing to the growth of the organization.

Data Science 98

Data Science Data Mining Deep Learning Programming Language 98

Knowledge Hut

MAY 9, 2024

Data science is an interdisciplinary academic domain that utilizes scientific methods, scientific computing, statistics, algorithms, processes, and systems to extrapolate or extract knowledge and insights from unstructured, structured, and noisy data. The standard salary range, however, is $95,000 to $154,000.

Data Science 52

Data Science Data Mining Data Architect Programming Language 52

Knowledge Hut

JANUARY 18, 2024

Data Science has risen to become one of the world's topmost emerging multidisciplinary approaches in technology. Recruiters are hunting for people with data science knowledge and skills these days. Data Scientists collect, analyze, and interpret large amounts of data. Choose data sets.

Data Science 98

Data Science Business Analyst ETL Method Data Architect 98

Knowledge Hut

DECEMBER 26, 2023

Thus, to build a career in Data Science, you need to be familiar with how the business operates, its business model, strategies, problems, and challenges. Data Science Roles As Data Science is a broad field, you will find multiple different roles with different responsibilities. Data Analyst Scientist.

Data Science 97

Data Science BI Business Intelligence Data Mining 97

Data Engineering Podcast

OCTOBER 22, 2021

Summary The market for business intelligence has been going through an evolutionary shift in recent years. Lightdash has fully embraced that shift by building an entire open source business intelligence framework that is powered by dbt models. No more scripts, just SQL. What are the main goals of the project?

Engineering 100

Engineering Business Intelligence BI Data Warehouse 100

Data Engineering Podcast

NOVEMBER 4, 2021

A natural outgrowth of that capability is the more recent growth of reverse ETL systems that use those analytics to feed back into the operational systems used to engage with the customer. They also discuss the current state of the market for these technological patterns and how to take advantage of them in your own work.

Data Warehouse 100

Data Warehouse Business Intelligence ETL System Data Lake 100

Data Engineering Podcast

NOVEMBER 6, 2022

He also describes the considerations involved in bringing behavioral data into your systems, and the ways that he and the rest of the Snowplow team are working to make that an easy addition to your platforms. Can you share your definition of "behavioral data" and how it is differentiated from other sources/types of data?

Building 130

Building IT Metadata MongoDB 130

Knowledge Hut

JANUARY 18, 2024

Enterprise businesses were always dynamic. But the rapid advancement in technology pushes almost every industry to change even faster. All of this work is now done by Business Analysts. I've observed that Business Analysts act as a connector between the IT department and the business department of companies.

Business Analyst 93

Business Analyst Consulting Business Intelligence Certification 93

Data Engineering Podcast

JULY 10, 2022

Summary Building a data platform is a journey, not a destination. Beyond the work of assembling a set of technologies and building integrations across them, there is also the work of growing and organizing a team that can support and benefit from that platform. Can you describe the role of data at Riskified?

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

Data Engineering Podcast

JUNE 22, 2020

Summary The majority of analytics platforms are focused on use internal to an organization by business stakeholders. As the availability of data increases and overall literacy in how to interpret it and take action improves there is a growing need to bring business intelligence use cases to a broader audience.

Business Intelligence 100

Business Intelligence Data Engineering Data Engineer SQL 100

Data Engineering Podcast

JULY 3, 2022

Summary The ecosystem for data tools has been going through rapid and constant evolution over the past several years. These technological shifts have brought about corresponding changes in data and platform architectures for managing data and analytical workflows.

Architecture 100

Architecture Metadata MongoDB MySQL 100

ProjectPro

SEPTEMBER 26, 2014

The toughest challenges in business intelligence today can be addressed by Hadoop through multi-structured data and advanced big data analytics. Big data technologies like Hadoop have become a complement to various conventional BI products and services.

Business Intelligence 40

Business Intelligence Hadoop BI Relational Database 40

Data Engineering Podcast

APRIL 26, 2021

Summary The reason for collecting, cleaning, and organizing data is to make it usable by the organization. One of the most common and widely used methods of access is through a business intelligence dashboard. Superset is becoming part of the reference architecture for a modern data stack.

Business Intelligence 100

Business Intelligence Data Warehouse Hadoop Data Pipeline 100

Data Engineering Podcast

JUNE 19, 2022

Summary Data analysis is a valuable exercise that is often out of reach of non-technical users as a result of the complexity of data systems. The "modern data stack" has enabled organizations to analyze unparalleled volumes of data. Can you describe what Canvas is and the story behind it?

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Data Engineering Podcast

DECEMBER 21, 2020

The team at Immuta has built a platform that aims to tackle that problem in a flexible and maintainable fashion so that data teams can easily integrate authorization, data masking, and privacy enhancing technologies into their data infrastructure. If you hand a book to a new data engineer, what wisdom would you add to it?

Data Governance 130

Data Governance Government Data Lake Banking 130

Data Engineering Podcast

DECEMBER 11, 2021

In this episode he explains how it can be used to build rich and useful profiles of your users, the system architecture that powers it, and some of the ways that it is being integrated into an organization’s broader data ecosystem. Start trusting your data with Monte Carlo today! No more scripts, just SQL.

Data Warehouse 100

Data Warehouse Raw Data Data Lake BI 100

Data Engineering Podcast

JUNE 5, 2022

Summary The best way to make sure that you don’t leak sensitive data is to never have it in the first place. The team at Skyflow decided that the second best way is to build a storage system dedicated to securely managing your sensitive information and making it easy to integrate with your applications and data systems.

Data Security 100

Data Security Metadata MongoDB Scala 100

Data Engineering Podcast

OCTOBER 28, 2021

Summary Streaming data systems have been growing more capable and flexible over the past few years. He also explains why he started Decodable to address that limitation and the work that he and his team have done to let data engineers build streaming pipelines entirely in SQL. Start trusting your data with Monte Carlo today!

Data Pipeline 100

Data Pipeline SQL Data Warehouse Data Lake 100

Data Engineering Podcast

JULY 31, 2022

Summary Data lineage is the roadmap for your data platform, providing visibility into all of the dependencies for any report, machine learning model, or data warehouse table that you are working with. Data lineage and metadata systems are a hot topic right now. What are the core problems that Manta aims to solve?

IT 100

IT Metadata MongoDB MySQL 100

Data Engineering Podcast

AUGUST 6, 2022

In this episode Paolo Platter shares the lessons they have learned in that process, the Data Mesh Boost platform that they have built to reduce some of the boilerplate required to make it successful, and some of the considerations to make when deciding if a data mesh is the right choice for you.

Metadata 100

Metadata MongoDB MySQL Business Intelligence 100

Data Engineering Podcast

MAY 15, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 100

Data Lake Building BI Architecture 100

Data Engineering Podcast

DECEMBER 4, 2021

The whole process of hiring is an important organizational skill to cultivate and this is an interesting exploration of the specific challenges involved in finding data professionals. Start trusting your data with Monte Carlo today! The data you’re looking for is already in your data warehouse and BI tools.

Data Warehouse 100

Data Warehouse Data Lake BI Business Intelligence 100

Data Engineering Podcast

JUNE 12, 2022

In this episode she shares her thoughts and insights on how to be intentional about establishing your own data team. Can you describe the data-related projects that were required during the merger? Contact Info LinkedIn @truptinatu on Twitter Trupti is hiring for multiple product data science roles.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Knowledge Hut

NOVEMBER 15, 2023

Here are some g eneral resume objective examples of well-written and specific career objectives for technical resumes: General R esume Objective Examples Example 1: To secure a position as an engineer in a company that specializes in the development of clean energy technologies. and Drupal.

Finance 98

Finance Business Intelligence Database-centric Certification 98

Data Engineering Podcast

MAY 8, 2022

In this episode Jon Herke shares how TigerGraph customers are taking advantage of those capabilities to achieve meaningful discoveries in their fields, the utilities that it provides for modeling and managing your connected data, and some of his own experiences working with the platform before joining the company.

Database 100

Database Data Lake BI Business Intelligence 100

Data Engineering Podcast

NOVEMBER 10, 2021

Summary A significant source of friction and wasted effort in building and integrating data management systems is the fragmentation of metadata across various tools. Start trusting your data with Monte Carlo today! The data you’re looking for is already in your data warehouse and BI tools.

Metadata 100

Metadata Data Warehouse Data Lake BI 100

Data Engineering Podcast

MAY 22, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Machine Learning 130

Machine Learning Data Engineering Data Engineer Cloud 130

Knowledge Hut

DECEMBER 26, 2023

In recent years, with the advent of technology, data has been considered to be a valuable asset in both large-scale and small-scale organizations. Data as a resource requires skilled professionals to be collected, interpreted, and stored safely.

Data Science 52

Data Science Scala Programming Language R (Programming) 52

Data Engineering Podcast

AUGUST 6, 2021

Summary Every organization needs to be able to use data to answer questions about their business. The trouble is that the data is usually spread across a wide and shifting array of systems, from databases to dashboards. The data you’re looking for is already in your data warehouse and BI tools.

Database 100

Database SQL BI Business Intelligence 100

Data Engineering Podcast

SEPTEMBER 4, 2022

Monte Carlo is in the vanguard of companies who have been enabling data teams to observe and understand their complex data systems. What are the notable changes in the Monte Carlo product and business since our last conversation in October 2020? Can you give the elevator pitch for Monte Carlo?

IT 100

IT Metadata MongoDB MySQL 100

Data Engineering Podcast

OCTOBER 16, 2022

In this episode Adrian Kosowski explains how the Pathway product got started, how its design simplifies the creation of data products that support supply chain operations, and how developers can help to build an ecosystem of applications that allow businesses to accelerate their time to insight.

Database 100

Database Metadata MongoDB MySQL 100

Data Engineering Podcast

AUGUST 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Engineering 100

Data Engineering Data Engineer MongoDB Metadata 100

Knowledge Hut

DECEMBER 22, 2023

Their roles are similar to regular business analysts (I) but are positioned higher due to their experience and wider knowledge slab. In Singapore, business analysts II can earn around SGD 105270. Business intelligence analysts in Singapore are paid around $58,000. At the same time, a healthcare business analyst need not.

Business Analyst 52

Business Analyst Insurance Recruitment Healthcare 52

Data Engineering Podcast

NOVEMBER 20, 2021

Summary The technology for scaling storage and processing of data has gone through massive evolution over the past decade, leaving us with the ability to work with massive datasets at the cost of massive complexity. Start trusting your data with Monte Carlo today! Visit dataengineeringpodcast.com/montecarlo to learn more.

Data Warehouse 100

Data Warehouse Data Lake BI Business Intelligence 100