Marc Lamberti

JANUARY 9, 2022

Airflow TaskGroups have been introduced to make your DAG visually cleaner and easier to read. They are meant to replace SubDAGs which was the historic way of grouping your tasks. The problem with SubDAGs is that they are much more than that. They bring a lot of complexity as you need to create a DAG in a DAG, import the SubDagOperator which is in fact a sensor, define the parameters properly, and so on.

Coding 130

Coding Python Process Management 130

KDnuggets

JANUARY 13, 2022

Any modern company of any significant size around the world has a data science department, and a data engineer at one company might have the same responsibilities as a marketing scientist at another company. Data science jobs are not well-labeled, so make sure to cast a wide net.

Data Science 158

Data Science Data Engineering Data Engineer Data 158

Confluent

JANUARY 11, 2022

Whether you’re a seasoned Apache Kafka® developer or just getting started you’re likely to hit a snag at some point or another—either in configuring and understanding your clients or setting […].

Kafka 138

Kafka 138

Teradata

JANUARY 10, 2022

There is a lot of hype today around data sharing and the value it brings to your business. But what exactly is data sharing, and why should you and your company care? Find out more.

Data 97

Data IT 97

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data

Netflix Tech

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. As our subscribers grow worldwide and Netflix enters the world of gaming , the number of batch workflows and real-time data pipelines increases rapidly. The data platform is built on top of several distributed systems, and due to the inherent nature of these systems, it is inevitable that these workloads run into fa

Kafka 95

Kafka Big Data Data Machine Learning 95

KDnuggets

JANUARY 10, 2022

The author shares their experience of almost winning the competition and the things they have learned from the failures. Learn more about the WiDS Datathon and tips on winning the next challenge.

Data Science 156

Data Science Data 156

Wolt

JANUARY 13, 2022

Data Platforms are an essential part of modern businesses. They enable reporting, low friction decision making, and if used correctly, can power very advanced data products in a compliant and traceable manner. Let us take you from the role of data at Wolt, through the data journey we’ve had so far and finish with a peek into what the future of this discipline may look like.

Data 52

Data Data Engineering Data Engineer Engineering 52

ProjectPro

JANUARY 11, 2022

“Machine Learning” is one of the most trending buzzwords. It is predominant in every industry sector as it empowers various organizations with innovative solutions to automate and increase the efficacy of products by reducing human intervention. You might have heard about the applications of weather forecasting, spam classification, or stock price prediction applications, so what exactly do these applications use ?

Machine Learning 52

Machine Learning Algorithm Datasets Food 52

KDnuggets

JANUARY 14, 2022

Open source Redis is being increasingly used in Machine Learning, but running it on Colab is different compared to on your local machine or with Docker. Read on for a 2-step tutorial on how to do it.

Machine Learning 154

Machine Learning IT Data Science Data 154

Grouparoo

JANUARY 11, 2022

When it comes to storing large volumes of data, a simple database will be impractical due to the processing and throughput inefficiencies that emerge when managing and accessing big data. This article looks at the options available for storing and processing big data, which is too large for conventional databases to handle. There are two main options available, a data lake and a data warehouse.

Data Lake 52

Data Lake Data Warehouse Unstructured Data Raw Data 52

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

Teradata

JANUARY 13, 2022

2021 was the year of expanding 5G coverage, building out 5G use cases and the start of the migration to 5G Stand Alone. What will the year 2022 bring to the Telco industry?

Telecommunication 52

Telecommunication Building 52

Elder Research

JANUARY 10, 2022

The post The Customer is Always Wrong – Along with the Rest of Us appeared first on Elder Research.

52

52

KDnuggets

JANUARY 12, 2022

It’s crucial to investigate the reasons why data science teams require context, consistency, and secure collaboration of their data to ensure data science success. Let's quickly examine each of these requirements so that we can better understand what data science success moving forward may look like.

Data Science 139

Data Science Data 139

RudderStack

JANUARY 11, 2022

In this update we cover our latest Destination UI feature, our new VDM for Klaviyo, new SDKs and destination integrations, and more.

40

40

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

ProjectPro

JANUARY 13, 2022

Have you heard of the Inshorts smartphone app? It is a cutting-edge news app that embodies news stories into a concise 60-word summary. Applications like Inshorts allow you to avoid reading long articles by generating a clear and concise summary. An average individual uses Google Search more than three times a day. Thanks to Featured Snippets, or Knowledge Panels, you receive better results for your search queries.

Python 52

Python Algorithm Deep Learning Data Science 52

DataKitchen

JANUARY 10, 2022

Cambridge, Mass. – June 16, 2021. Today, DataKitchen announced the release of the latest book in its groundbreaking DataOps series, Recipes for DataOps Success: The Complete Guide to An Enterprise DataOps Transformation. This book follows on the heels of its successful precursor, The DataOps Cookbook , which has been downloaded more than 14,000 times and counting.

Programming 70

Programming Certification Pharmaceutical Data Analytics 70

KDnuggets

JANUARY 12, 2022

Is Data Science a Dying Career?; Why Do Machine Learning Models Die In Silence?; SQL Interview Questions for Experienced Professionals; Deliver a Killer Presentation in Data Science Interviews; What is Transfer Learning?

Machine Learning 135

Machine Learning Data Science SQL Data 135

Netflix Tech

JANUARY 11, 2022

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , Colin McFarland , Andy Rhines , Sophia Liu , Mihir Tendulkar , Kevin Mercurio , Veronica Hannan , Ting-Po Lee Earlier posts in this series covered the basics of A/B tests ( Part 1 and Part 2 ), core statistical concepts ( Part 3 and Part 4 ), and how to build confidence in decisions based on A/B test results ( Part 5 ).

Data Science 97

Data Science Data Algorithm Engineering 97

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

ProjectPro

JANUARY 10, 2022

Time series data can be defined as a sequence of data points that need to be seen with respect to the time stamp for each sample. Data samples are indexed by the timestamps or are highly dependent on them in time series. Data for weather forecasting, stock price prediction, user subscriptions, or sales patterns are some examples of time series data.

Python 52

Python Building Machine Learning Datasets 52

KDnuggets

JANUARY 13, 2022

Learn how to query your Pandas DataFrames using the standard SQL SELECT statement, seamlessly from within your Python code.

SQL 160

SQL Python Coding 160

KDnuggets

JANUARY 10, 2022

Also: Why are More Developers Using Python for Their Machine Learning Projects?; 3 Tools to Track and Visualize the Execution of Your Python Code; SQL Interview Questions for Experienced Professionals; Deliver a Killer Presentation in Data Science Interviews.

Machine Learning 130

Machine Learning Python Data Science SQL 130

KDnuggets

JANUARY 12, 2022

Using one or two performance metrics seems sufficient to claim that your ML model is good — chances are that it’s not.

Machine Learning 160

Machine Learning 160

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building

KDnuggets

JANUARY 14, 2022

Read the second article in this series on Transfer Learning, and learn how to apply it to Image Recognition and Natural Language Processing.

Process 145

Process IT Machine Learning 145

KDnuggets

JANUARY 10, 2022

At the end of the day, the value a data scientist provides to an organization lies in their ability to apply data to real-world use cases.

Data Science 146

Data Science Data 146

KDnuggets

JANUARY 12, 2022

The new Online MS in Business Analytics for Managers from Simon Business School is the latest advancement in analytically rigorous, leadership-focused education designed to help managers and aspiring managers prepare for the future of business-wherever it may lead. Applications are being accepted now and the first 14-month class will begin August 2022.

Management 110

Management Education Designing IT 110

KDnuggets

JANUARY 11, 2022

Learn how to build feedforward neural networks that are interpretable by design using PyTorch.

Designing 150

Designing Building Machine Learning 150

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

Certification

KDnuggets

JANUARY 12, 2022

These are some of the most critical questions that I think are important to consider when selecting the next job.

Data Science 122

Data Science Data 122

KDnuggets

JANUARY 13, 2022

Focusing on the important concepts for data scientists.

SQL 160

SQL Data Science Data 160

KDnuggets

JANUARY 11, 2022

Finding the data you need is hard. So why not fake it?

Datasets 160

Datasets IT Data Data Science 160