Simon Späti

APRIL 6, 2022

With burnout and mental stress at every level of our lives, I find my Personal Knowledge Management (PKM) system even more valuable. As a human, I forget lots of things. As a dad, I have more responsibilities with remembering all things related to my kid. As a developer and knowledge worker, I re-use code snippets or create new things. That’s why a PKM system such as a Second Brain to store all of it in a sustainable way is crucial to me.

Management 189

Management Coding Systems IT 189

Marc Lamberti

APRIL 4, 2022

DAG Dependencies in Apache Airflow might be one of the most popular topics. I received countless questions about DAG dependencies, is it possible? How? What are the best practices? and the list goes on. It’s funny because it comes naturally to wonder how to do that even when we are beginners. Do we like to complexify things by nature? Maybe, but that’s another question 😉 At the end of this article, you will be able to spot when you need to create DAG Dependencies, which metho

Metadata 130

Metadata IT Coding Process 130

KDnuggets

APRIL 8, 2022

Naïve Bayes is a probabilistic machine learning algorithm based on the Bayes Theorem, used in a wide variety of classification tasks. In this article, we will understand the Naïve Bayes algorithm and all essential concepts so that there is no room for doubts in understanding.

Algorithm 160

Algorithm Machine Learning 160

Data Engineering Podcast

APRIL 3, 2022

Summary Building a data platform for your organization is a challenging undertaking. Building multiple data platforms for other organizations as a service without burning out is another thing entirely. In this episode Brandon Beidel from Red Ventures shares his experiences as a data product manager in charge of helping his customers build scalable analytics systems that fit their needs.

Designing 100

Designing Data Warehouse Data Engineering Data Engineer 100

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

Confluent

APRIL 4, 2022

Our everyday digital experiences are in the midst of a revolution. Customers increasingly expect their online experiences to be interactive, immersive, and real time by default. The need to satisfy […].

Building 122

Building Cloud Programming 122

Cloudera

APRIL 6, 2022

This blog post was written by Elizabeth Howell, Ph.D as a guest author for Cloudera. . At a distance of a million miles from Earth, the James Webb Space Telescope is pushing the edge of data transfer capabilities. The observatory launched Dec. 25 2021 on a mission to look at the early universe, at exoplanets, and at other objects of celestial interest.

Big Data 100

Big Data Machine Learning Medical Insurance 100

Grouparoo

APRIL 5, 2022

We started Grouparoo to enable organizations to make better use of their data. Our experience showed that there was a large gap in how Data and Product teams worked with operational teams like Marketing, Sales, and Support. We set out to accomplish our goal in an open way, both through open-source software and by creating a company culture valuing candor and transparency.

Data Engineering 52

Data Engineering Data Engineer Engineering Cloud 52

Confluent

APRIL 5, 2022

We’re pleased to share a new multi-year partnership between Confluent and Microsoft to accelerate enterprises’ journey to cloud data streaming on Azure. Today’s announcement builds upon the partnership agreement we […].

Cloud 109

Cloud Data Building Programming 109

Cloudera

APRIL 7, 2022

As a public sector leader, you don’t need the value of data explained to you. You already understand its importance to your vital missions. . The challenge, rather, lies in locating data, streaming it, enriching it, and serving it, and then running analytics to maximize the value of the data that agencies already have — and the massive amount of new data generated every day from a wide variety of structured and unstructured sources.

Government 92

Government Data Governance Machine Learning Cloud 92

KDnuggets

APRIL 6, 2022

The near future holds incredible possibility for machine learning to solve real world problems. But we need to be be able to determine which problems are solvable by ML and which are not.

Machine Learning 158

Machine Learning 158

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

dbt Developer Hub

APRIL 4, 2022

"I forgot to mention we dropped that column and created a new one for it!” “Hmm, I’m actually not super sure why customer_id is passed as an int and not a string.” “The primary key for that table is actually the order_id , not the id field.” I think many analytics engineers, including myself, have been on the receiving end of some of these comments from their backend application developers.

Database 52

Database Data Engineering IT 52

Confluent

APRIL 6, 2022

Confluent has been offering our customers the opportunity to seamlessly connect their Apache Kafka® topics to Google BigQuery for several years. This helps accelerate data warehouse initiatives by connecting more […].

Google Cloud 62

Google Cloud Kafka Cloud Data Warehouse 62

Cloudera

APRIL 4, 2022

Vaccine development became the top priority for the life sciences industry – delivering new vaccines at unprecedented speed and maneuvering large-scale production processes. Numerous factors helped accelerate the vaccine roll-out including prior research, genome sequencing, jumping the FDA approval queue and a plethora of testing volunteers. So now that we’ve experienced these advancements, how can the industry keep momentum to speed-up innovative solutions across healthcare?

Healthcare 79

Healthcare Data Lake Manufacturing Process 79

KDnuggets

APRIL 7, 2022

According to one source, the types of questions that will generally be asked in data scientist interviews can be broken down into five categories. Let's take a closer look.

Data Science 159

Data Science Data 159

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

InData Labs

APRIL 4, 2022

Generally speaking, Spark provides 3 main abstractions to work with it. First, we will provide you with a holistic view of all of them in one place. Second, we will explore each option with examples. RDD (Resilient Distributed Dataset). The main approach to work with unstructured data. Pretty similar to a distributed collection that is. Запись Converting Spark RDD to DataFrame and Dataset впервые появилась InData Labs.

Datasets 52

Datasets Unstructured Data Data IT 52

Confluent

APRIL 8, 2022

Azure Synapse users are looking to unlock access to on-premises, open source, and hybrid cloud systems to extend advanced analytics capabilities for their organizations. Building connectivity between all your distributed […].

Management 52

Management Cloud Accessible Accessibility 52

Data Engineering Podcast

APRIL 3, 2022

Summary The flexibility of software oriented data workflows is useful for fulfilling complex requirements, but for simple and repetitious use cases it adds significant complexity. Coalesce is a platform designed to reduce repetitive work for common workflows by adopting a visual pipeline builder to support your data warehouse transformations. In this episode Satish Jayanthi explains how he is building a framework to allow enterprises to move quickly while maintaining guardrails for data workflow

Data Warehouse 100

Data Warehouse Data Workflow Data Architecture SQL 100

KDnuggets

APRIL 4, 2022

Check out the collection of the best data repositories on agriculture, audio, biology, climate, computer vision, economics, education, energy, finance, and government.

Finance 152

Finance Education Government Data 152

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

Monte Carlo

APRIL 7, 2022

Did you ever wish you had a pause button for broken data pipelines? Well, today is your lucky day. Monte Carlo is excited to announce the release of a new suite of data observability capabilities to help data teams automatically stop broken data pipelines at the orchestration layer — before they impact the business. Data engineers spend upwards of 30 percent of their time tackling data downtime , meaning periods of time when data is missing, erroneous, or otherwise inaccurate.

Data Pipeline 52

Data Pipeline Retail Portfolio Metadata 52

Confluent

APRIL 7, 2022

Moving to an entirely new company can be daunting. All you know is the job description and the impression made during the interview process. But what about the company’s ethics? […].

Process 52

Process 52

Rockset

APRIL 5, 2022

A year ago we evaluated Rockset on the Star Schema Benchmark (SSB) , an industry-standard benchmark used to measure the query performance of analytical databases. Subsequently, Altinity published ClickHouse’s results on the SSB. Recently, Imply published revised Apache Druid results on the SSB with denormalized numbers. With all the performance improvements we've been working on lately, we took another look at how these would affect Rockset's performance on the SSB.

Datasets 52

Datasets Metadata Database Kafka 52

KDnuggets

APRIL 6, 2022

Learn tricks on importing various data formats using Pandas with a few lines of code. We will be learning to import SQL databases, Excel sheets, HTML tables, CSV, and JSON files with examples.

Data Ingestion 134

Data Ingestion SQL Database Data 134

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building

Booking.com Engineering

APRIL 6, 2022

As developers, we always want our apps to offer the best user experience. When it comes to performance, we know that an “ideal” rendering performance for a regular application is 60 frames per second, or 60 fps. This gif illustrates the difference between ideal and not-so-ideal frame rendering: To have a solid 60fps, each frame needs to be rendered by the app within a 16.6ms window (1 sec = 1000ms, 1000ms / 60 = 16.6ms).

Accessible 52

Accessible Accessibility Coding Engineering 52

DareData

APRIL 6, 2022

“All happy families are alike; each unhappy family is unhappy in its own way.”, so starts Leo Tolstoy's novel Anna Karenina. This came to be known as the Anna Karenina Principle - there are many different ways one can fail, but only one way to win: by avoiding each of the routes to failure. The beauty of being a consultant is to experience this first hand.

Data 52

Data Consulting Data Pipeline Machine Learning 52

KDnuggets

APRIL 6, 2022

Using AIMET, developers can incorporate advanced model compression and quantization algorithms into their PyTorch and TensorFlow model-building pipelines for automated post-training optimization, as well as for model fine-tuning.

Algorithm 116

Algorithm Building 116

KDnuggets

APRIL 8, 2022

Have low-code solutions subverted the need for developers? Are experienced software developers going the way of the dodo? Read on to find out.

Coding 122

Coding Programming 122

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

Certification

KDnuggets

APRIL 4, 2022

An introduction to the DBSCAN algorithm and its implementation in Python.

Algorithm 160

Algorithm Machine Learning Python IT 160

KDnuggets

APRIL 6, 2022

8 Free MIT Courses to Learn Data Science Online; The Complete Collection Of Data Repositories - Part 1; DBSCAN Clustering Algorithm in Machine Learning; Introductory Pandas Tutorial; People Management for AI: Building High-Velocity AI Teams.

Data Science 104

Data Science Algorithm Machine Learning Data 104

KDnuggets

APRIL 8, 2022

Let's look through the points below for useful tips on how to choose the proper outsourcing partner to handle the labeling for your next AI model.

Data Science 116

Data Science Data 116

KDnuggets

APRIL 4, 2022

Deep dive into Logistic Regression with practical examples.

Machine Learning 160

Machine Learning 160

Advertisement

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

Building