Data Engineering Podcast

JULY 17, 2022

Summary There are extensive and valuable data sets that are available outside the bounds of your organization. Whether that data is public, paid, or scraped it requires investment and upkeep to acquire and integrate it with your systems. Crux was built to reduce the total cost of acquisition and ownership for integrating external data, offering a fully managed service for delivering those data assets in the manner that best suits your infrastructure.

Data Management 130

Data Management Management Metadata MongoDB 130

Azure Data Engineering

JULY 16, 2022

Web Activity is the easiest way to call any REST API endpoints within a Data Factory Pipeline. In today’s post, we will discuss the basic settings of Web activity. To create a new web activity , search for ‘web’ in the activities pane. Alternatively, it can be located under the General group in the activities pane. As seen in the screenshot below, the main settings for the web activity are as follows: Azure Data Factory: Web Activity URL: This is the REST API endpoint address that we would like

Datasets 130

Datasets Certification Data Coding 130

Jesse Anderson

JULY 12, 2022

My guest this week is Drew Smith , Vice President of Global Data and Analytics at Little Caesars Enterprises and Ilitch Companies. Little Caesars is a pizza franchise that is mainly in the United States. Illitch Companies owns the Detroit Tigers (baseball), Detroit Red Wings (hockey), and several stadiums. Before that, Drew worked at International Institute for Analytics (IIA), an analytics consulting company, and IKEA, the furniture retailer and manufacturer.

Recruitment 130

Recruitment Manufacturing Retail Consulting 130

KDnuggets

JULY 22, 2022

The AIoT has the potential to transform industries and society, and it is already starting to have an impact. This article will explore the principles of AIoT, its benefits, and its current use.

IT 160

IT 160

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Confluent

JULY 26, 2022

Explore GitHub Actions for your Kafka CI/CD pipeline, automate Schema Registry, and transform the development and testing of Kafka client applications.

Kafka 141

Kafka 141

Cloudera

JULY 20, 2022

This month, Cloudera Cares is excited to spotlight Burt Wagner, senior solutions engineer from Alexandria, Virginia. Burt — who joined Cloudera earlier this year — volunteers regularly with the Boy Scouts of America. He started Scouting as an eight year old; it has always been an integral part of his life and something he now enjoys sharing with his son.

Engineering 111

Engineering Programming Utilities IT 111

U-Next

JULY 13, 2022

In a world that creates 1.145 trillion MB of data per day , change is the only constant. With brand new information being seeded every other second, businesses are evolving at the speed of light. Where there’s data, there’s analytics, and thus, the demand for skilled Business Analysts. Data enthusiasts have stumbled across enough facts and figures to know what’s trending and what’s needed to master these trends, which is why over 1,000 learners hit the road to becoming highly sought-after Busine

Business Analyst 97

Business Analyst Programming Python SQL 97

Teradata

JULY 5, 2022

In the current age of AI, all digital transformations must be analytics-led. Learn the 7 steps needed to realize the promise of an analytics-led digital transformation.

98

98

KDnuggets

JULY 15, 2022

Machine learning, big data analytics or AI may steal the headlines, but if you want to hone a smart, strategic skill that can elevate your career, look no further than SQL.

SQL 158

SQL Big Data Machine Learning Data Analytics 158

Confluent

JULY 18, 2022

Newest features in Confluent’s fully managed, cloud-native data streaming platform: Confluent Terraform provider, Independent Network Lifecycle Management, and more.

Management 62

Management Cloud Data 62

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

Cloudera

JULY 18, 2022

In part 1 of this blog we discussed how Cloudera DataFlow for the Public Cloud (CDF-PC), the universal data distribution service powered by Apache NiFi, can make it easy to acquire data from wherever it originates and move it efficiently to make it available to other applications in a streaming fashion. In this blog we will conclude the implementation of our fraud detection use case and understand how Cloudera Stream Processing makes it simple to create real-time stream processing pipelines that

Process 86

Process Kafka Scala SQL 86

Data Engineering Podcast

JULY 24, 2022

Summary The current stage of evolution in the data management ecosystem has resulted in domain and use case specific orchestration capabilities being incorporated into various tools. This complicates the work involved in making end-to-end workflows visible and integrated. Dagster has invested in bringing insights about external tools’ dependency graphs into one place through its "software defined assets" functionality.

MongoDB 100

MongoDB Scala MySQL Data Lake 100

U-Next

JULY 20, 2022

Every layer of business operations today uses the power of metrics and analytics to enhance their market growth and business success. With the fourth industrial revolution increasing the dependency on emerging technologies like Data Science, Cloud Computing, IoT, Business Analytics, etc., the need to master the nuances of the same is relatively high.

Programming 75

Programming Business Analyst Education Data Science 75

Teradata

JULY 25, 2022

For many, banking is now a digital activity. But the financial services industry still trails many others in leveraging cloud technologies to build deeper, emotional attachments to their customers.

Banking 94

Banking Cloud Technology Building 94

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

KDnuggets

JULY 14, 2022

Deep learning forms the backbone of modern day artificial intelligence. Learn more about the important aspects of this connection with this freely available course.

Deep Learning 160

Deep Learning 160

dbt Developer Hub

JULY 13, 2022

There are many reasons you, as an analytics engineer, may want to capture the complete version history of data: You’re in an industry with a very high standard for data governance You need to track big OKRs over time to report back to your stakeholders You want to build a window to view history with both forward and backward compatibility These are often high-stakes situations!

Electronics 59

Electronics BI Raw Data Manufacturing 59

Cloudera

JULY 21, 2022

Co-author: Mike Godwin, Head of Marketing, Rill Data. Cloudera has partnered with Rill Data, an expert in metrics at any scale, as Cloudera’s preferred ISV partner to provide technical expertise and support services for Apache Druid customers. We want Cloudera customers that rely on Apache Druid to know that their clusters are secure and supported by the Cloudera partner ecosystem.

BI 84

BI Digital Media Data Warehouse Kafka 84

Data Engineering Podcast

JULY 17, 2022

Summary Data engineering is a large and growing subject, with new technologies, specializations, and "best practices" emerging at an accelerating pace. This podcast does its best to explore this fractal ecosystem, and has been at it for the past 5+ years. In this episode Joe Reis, founder of Ternary Data and co-author of "Fundamentals of Data Engineering", turns the tables and interviews the host, Tobias Macey, about his journey into podcasting, how he runs the show behind the sc

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

Confluent

JULY 28, 2022

Complete guide to data pipelines, data integration, and modern data flow, the key to next generation, data-driven applications, systems, and organizations.

Data Pipeline 62

Data Pipeline Building Data Data Integration 62

Teradata

JULY 14, 2022

Teradata provides the lowest cost per query for enterprise-scale analytics. Have your doubts? Then please read on.

105

105

KDnuggets

JULY 8, 2022

The combination of several machine learning algorithms is referred to as ensemble learning. There are several ensemble learning techniques. In this article, we will focus on boosting.

Machine Learning 148

Machine Learning Algorithm 148

Rockset

JULY 29, 2022

Enterprise data warehouses (EDWs) became necessary in the 1980s when organizations shifted from using data for operational decisions to using data to fuel critical business decisions. Data warehouses differ from operational databases in that while operational transactional databases collate data for multiple transactional purposes, data warehouses aggregate this transactional data for analytics.

Data Analytics 52

Data Analytics Data Warehouse Datasets Google Cloud 52

Advertisement

Outdated or absent analytics won’t cut it in today’s data-driven applications – not for your end users, your development team, or your business. That’s what drove the five companies in this e-book to change their approach to analytics. Download this e-book to learn about the unique problems each company faced and how they achieved huge returns beyond expectation by embedding analytics into applications.

Building

Cloudera

JULY 19, 2022

The dynamic and interconnected world of global ecommerce, crypto currencies, and alternative payments places increased pressure on anti-financial crime measures to keep pace and transform alongside these initiatives. Consumers worldwide are projected to use mobile devices to make more than 30.7 billion ecommerce transactions by 2026, a five-fold increase over the 6.1 billion predicted for 2022.

Banking 83

Banking Education Media Machine Learning 83

Data Engineering Podcast

JULY 10, 2022

Summary Building and maintaining reliable data assets is the prime directive for data engineers. While it is easy to say, it is endlessly complex to implement, requiring data professionals to be experts in a wide range of disparate topics while designing and implementing complex topologies of information workflows. In order to make this a tractable problem it is essential that engineers embrace automation at every opportunity.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Confluent

JULY 12, 2022

How Confluent built Intelligent Storage, for 10x more scalable and elastic Kafka storage with infinite retention, max cluster uptime, and zero operational burdens.

Kafka 57

Kafka Building Cloud 57

U-Next

JULY 27, 2022

Every layer of business operations today uses the power of metrics and analytics to enhance their market growth and business success. With the fourth industrial revolution increasing the dependency on emerging technologies like Data Science, Cloud Computing, IoT, Business Analytics, etc., the need to master the nuances of the same is relatively high.

Programming 52

Programming Business Analyst Education Data Science 52

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

KDnuggets

JULY 20, 2022

14 Essential Git Commands for Data Scientists • Statistics and Probability for Data Science • 20 Basic Linux Commands for Data Science Beginners • 3 Ways Understanding Bayes Theorem Will Improve Your Data Science • Learn MLOps with This Free Course • Primary Supervised Learning Algorithms Used in Machine Learning • Data Preparation with SQL Cheatsheet.

Data Science 147

Data Science Data Preparation Algorithm Machine Learning 147

Rockset

JULY 28, 2022

MongoDB has grown from a basic JSON key-value store to one of the most popular NoSQL database solutions in use today. It is widely supported and provides flexible JSON document storage at scale. It also provides native querying and analytics capabilities. These attributes have caused MongoDB to be widely adopted especially alongside JavaScript web applications.

MongoDB 52

MongoDB Kafka NoSQL Data Lake 52

Cloudera

JULY 1, 2022

For this month’s #ClouderaLife Spotlight we did something a little different. In celebration of Pride Month, we sat down with two Clouderans who are influential in the company’s LGBTQ+ community: Autymn Harris and Jonathan Sanford. In this Q&A discussion, we asked them about their roles at Cloudera and what the LGBTQ+ resource groups are up to for Cloudera Pride celebrations.

Recruitment 83

Recruitment Education Banking Professional Services 83

Data Engineering Podcast

JULY 10, 2022

Summary Building a data platform is a journey, not a destination. Beyond the work of assembling a set of technologies and building integrations across them, there is also the work of growing and organizing a team that can support and benefit from that platform. In this episode Inbar Yogev and Lior Winner share the journey that they and their teams at Riskified have been on for their data platform.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

Certification