Data Engineering Podcast
SEPTEMBER 11, 2022
Summary Any business that wants to understand their operations and customers through data requires some form of pipeline. Building reliable data pipelines is a complex and costly undertaking with many layered requirements. In order to reduce the amount of time and effort required to build pipelines that power critical insights Manish Jethani co-founded Hevo Data.
KDnuggets
SEPTEMBER 16, 2022
Why is Gradient Descent so important in Machine Learning? Learn more about this iterative optimization algorithm and how it is used to minimize a loss function.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Confluent
SEPTEMBER 14, 2022
How gaming enterprises like Sony and Big Fish Games use Apache Kafka®, Confluent, and ksqlDB’s data streaming technologies for the best in-game experience, ROI, and real-time capabilities.
Cloudera
SEPTEMBER 15, 2022
Cloudera Contributor: Mark Ramsey, PhD ~ Globally Recognized Chief Data Officer. July brings summer vacations, holiday gatherings, and for the first time in two years, the return of the Massachusetts Institute of Technology (MIT) Chief Data Officer symposium as an in-person event. The gathering in 2022 marked the sixteenth year for top data and analytics professionals to come to the MIT campus to explore current and future trends.
Speaker: Timothy Chan, PhD., Head of Data Science
Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.
Data Engineering Podcast
SEPTEMBER 11, 2022
Summary Data engineering systems are complex and interconnected with myriad and often opaque chains of dependencies. As they scale, the problems of visibility and dependency management can increase at an exponential rate. In order to turn this into a tractable problem one approach is to define and enforce contracts between producers and consumers of data.
KDnuggets
SEPTEMBER 15, 2022
In this article, we will discuss the importance of large language models and suggest some of the top open source models and the NLP tasks they can be used for.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Teradata
SEPTEMBER 14, 2022
At Teradata, we are committed to operating a business that takes a responsible view of our impact on society and the planet. Find out how we are living this commitment everyday.
Knoldus
SEPTEMBER 16, 2022
Reading Time: 2 minutes TensorFlow Lite is TensorFlow’s lightweight solution for mobile and embedded devices. It allows you to run machine learning models on edge devices with low latency, eliminating the need for a server. After the development of the TensorFlow model, we can convert the same to a more efficient and smaller version by converting it into a Tflite model format.
KDnuggets
SEPTEMBER 12, 2022
Standard Deviation is one of the most underrated statistical tools out there. It’s an extremely useful metric that most people know how to calculate but very few know how to use effectively.
Confluent
SEPTEMBER 15, 2022
Learn how stream data technologies are used for fraud detection, real-time analytics, and how Fortune 100 companies are using solutions like Apache Kafka® to accelerate innovation.
Speaker: Anne Steiner and David Laribee
As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.
Teradata
SEPTEMBER 15, 2022
RegTech is the word on everyone’s lips as financial services businesses look for ways to manage the avalanche of regulatory reporting precipitated by the 2008 financial crisis.
Monte Carlo
SEPTEMBER 14, 2022
Monte Carlo is a company that has put considerable time, energy, and thought into creating awesome employee experiences. One of our core principles from the start has been to meet talent where they are and build the company around them rather than vice versa. Today, we have over 150 employees spread across 13 states and 9 countries with offices in San Francisco, Santa Cruz, London, Dublin, Tel Aviv, and New York–we are truly a remote first team!
KDnuggets
SEPTEMBER 13, 2022
This article will go over the top 5 data science skills that pay you and 5 that don’t.
Confluent
SEPTEMBER 13, 2022
A year after the IPO, Confluent’s sales operations team is still growing at an extraordinary rate in EMEA. Learn what it’s like to work with us, and what the team’s achieving together.
Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage
Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.
U-Next
SEPTEMBER 13, 2022
Introduction to Cybersecurity . Cyber safety is securing internet-connected systems such as servers, networks, mobile devices, electronic systems, and data against hostile assaults. We may divide the term “cybersecurity” into two words: cyber and security. The former encompasses systems, networks, programs, and data, while the latter is concerned with safeguarding networks, applications, and data. .
Monte Carlo
SEPTEMBER 12, 2022
The field of data engineering has been growing at a breakneck pace. New frameworks, new challenges, and new technologies are constantly shifting how engineers think about their work and their roles within their organizations. Keeping up with the latest developments can feel like a full-time job—so we’re always grateful when seasoned leaders share their perspectives on which trends in data engineering actually matter.
KDnuggets
SEPTEMBER 16, 2022
This post will look at a few different ways of attempting to simplify decision tree representation and, ultimately, interpretability. All code is in Python, with Scikit-learn being used for the decision tree modeling.
Databand.ai
SEPTEMBER 12, 2022
How to analyze dataset performance and schema changes in Databand Eric Jones 2022-09-12 13:06:42 “Why did my dataset schema change?” Yeah, we hear this question a lot too. Unfortunately, most data engineers don’t realize the schema has changed until someone else downstream tells them. By then, the business impact has already happened. Databand helps fix this problem by capturing the metadata from your datasets and then alerting you when dataset operations change unexpectedly.
Advertisement
Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.
U-Next
SEPTEMBER 13, 2022
. Introduction . Learning IT fundamentals for Cyber Security is a must in present times. Rampant cyber attacks due to mass-scale digitization of business are a major nuisance, and Cyber Security awareness is the only solution. . . A cyber-attack is an offensive action targeting computer networks or devices. A cyber-attack can be carried out by individuals, groups, or even nation-states and can range from relatively unsophisticated attacks to highly sophisticated operations that can cause
Rock the JVM
SEPTEMBER 14, 2022
This article is brought to you by Mark Rudolph - his second contribution to Rock the JVM. Mark is a senior developer, who has been working with Scala for a number of years. He also has been diving into the ZIO ecosystem, and loves sharing his learnings. If you want to learn more about the core ZIO library, check out the ZIO course. If you want the video version, check below: Outline In this post, we’re going to go over an introduction to the zio-http library, and take a look at some of the basic
KDnuggets
SEPTEMBER 16, 2022
The post introduces one of the most popular recommendation algorithms, i.e., collaborative filtering. It focuses on building an intuitive understanding of the algorithm illustrated with the help of an example.
Rockset
SEPTEMBER 13, 2022
The challenges Customer expectations and the corresponding demands on applications have never been higher. Users expect applications to be fast, reliable, and available. Further, data is king, and users want to be able to slice and dice aggregated data as needed to find insights. Users don't want to wait for data engineers to provision new indexes or build new ETL chains.
Speaker: Margaret-Ann Seger, Head of Product, Statsig
Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating
U-Next
SEPTEMBER 13, 2022
Introduction . A Masters in Business Administration is one of the most sought-after post-graduation degree courses across the globe. Aspirants from a wide variety of educational backgrounds often tend to pursue an MBA degree either before they begin their professional career or after obtaining several years of experience. An MBA is immensely popular as it enhances one’s credibility as a skilled professional and exponentially increases the quality and quantity of job opportunities. .
Cloudera
SEPTEMBER 15, 2022
Apache Ozone is a distributed, scalable, and high-performance object store , available with Cloudera Data Platform (CDP), that can scale to billions of objects of varying sizes. It was designed as a native object store to provide extreme scale, performance, and reliability to handle multiple analytics workloads using either S3 API or the traditional Hadoop API.
KDnuggets
SEPTEMBER 13, 2022
Free Python for Data Science Course • How to Select Rows and Columns in Pandas Using [ ],loc, iloc,at and.iat • Everything You've Ever Wanted to Know About Machine Learning • 7 Tips for Python Beginners • 5 Tricky SQL Queries Solved.
dbt Developer Hub
SEPTEMBER 12, 2022
Why do people cherry pick into upper branches? The simplest branching strategy for making code changes to your dbt project repository is to have a single main branch with your production-level code. To update the main branch, a developer will: Create a new feature branch directly from the main branch Make changes on said feature branch Test locally When ready, open a pull request to merge their changes back into the main branch If you are just getting started in dbt and deciding which branchin
Speaker: David Bard, Principal at VP Product Coaching
In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.
U-Next
SEPTEMBER 12, 2022
Introduction . If you’re new to the world of Cloud Computing, you may be wondering what all the fuss is about. In a nutshell, Cloud computing is the delivery of computing services—including servers, storage, databases, networking, software, analytics, and intelligence—over the Internet (“the cloud”) to offer faster innovation, flexible resources, and economies of scale.
Cloudera
SEPTEMBER 12, 2022
A key part of business is the drive for continual improvement, to always do better. “Better” can mean different things to different organizations. It could be about offering better products, better services, or the same product or service for a better price or any number of things. Fundamentally, to be “better” requires ongoing analysis of the current state and comparison to the previous or next one.
KDnuggets
SEPTEMBER 14, 2022
Free Python for Data Science Course • Everything You’ve Ever Wanted to Know About Machine Learning • Progress Bars in Python with tqdm for Fun and Profit • 7 Tips for Python Beginners • 7 Data Analytics Interview Questions & Answers.
Rock the JVM
SEPTEMBER 11, 2022
This article is brought to you by Yadu Krishnan. He’s a senior developer and constantly shares his passion for new languages, libraries and technologies. After his long-form Slick tutorial , he’s coming back with a new comprehensive introduction to SBT. Please enjoy! This tutorial complements Rock the JVM’s premium Scala masterclass , as you learn to set up and configure your Scala projects. 1.
Advertisement
“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.
Expert insights. Personalized for you.
130 
Let's personalize your content