Uber Engineering

DECEMBER 19, 2019

Every day around the world, millions of trips take place across the Uber network, giving users more reliable transportation through ridesharing, bikes, and scooters, drivers and truckers additional opportunities to earn, employees and employers more convenient business travel, and hungry … The post Uber Infrastructure in 2019: Improving Reliability, Driving Customer Satisfaction appeared first on Uber Engineering Blog.

Transportation 144

Transportation Engineering Architecture 144

KDnuggets

DECEMBER 19, 2019

The third part in a series on leveraging techniques to take a look inside the black box of AI, this guide considers methods that try to explain each prediction instead of establishing a global explanation.

131

131

Data Engineering Podcast

DECEMBER 16, 2019

Summary Building clean datasets with reliable and reproducible ingestion pipelines is completely useless if it’s not possible to find them and understand their provenance. The solution to discoverability and tracking of data lineage is to incorporate a metadata repository into your data platform. The metadata repository serves as a data catalog and a means of reporting on the health and status of your datasets when it is properly integrated into the rest of your tools.

Metadata 100

Metadata PostgreSQL Datasets Data Warehouse 100

Dataquest

DECEMBER 18, 2019

Today, Stacey Ustian is a data engineer. But the path that led her here wasn’t always easy, and there were a few bumps and twists along the way. Her journey to data science started in a rather unusual place: the law library. After earning her Master’s degree in Library and Information Science, Stacey had taken a job working in the library of a law firm.

SQL 52

SQL Python Data Engineering Data Engineer 52

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Uber Engineering

DECEMBER 17, 2019

Uber’s busy 2019 included our billionth delivery of an Uber Eats order, 24 million miles covered by bike and scooter riders on our platform, and trips to top destinations such as the Empire State Building, the Eiffel Tower, and the … The post Uber’s Data Platform in 2019: Transforming Information to Intelligence appeared first on Uber Engineering Blog.

Data 142

Data Engineering Building Big Data 142

KDnuggets

DECEMBER 18, 2019

Ready to try to get hired as a data scientist for the first time? Avoiding these common mistakes won’t guarantee an offer, but not avoiding them is a sure fire way for your application to be tossed into the trash bin.

Data 130

Data 130

Netflix Tech

DECEMBER 17, 2019

Andreas Andreakis, Ioannis Papapanagiotou Continue reading on Netflix TechBlog ».

Data 52

Data MySQL Database 52

Preset

DECEMBER 15, 2019

Announcing Elasticsearch in Superset, powered by a new open-source Python library from Preset

Python 40

Python 40

KDnuggets

DECEMBER 20, 2019

Google has started offering a new service for “explainable AI” or XAI, as it is fashionably called. Presently offered tools are modest, but the intent is in the right direction.

IT 114

IT 114

Teradata

DECEMBER 16, 2019

Enterprises either have no data strategy at all or an over-complicated one that under delivers. Find out how to create an effective data strategy by striking balance.

Data 40

Data 40

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

Confluent

DECEMBER 18, 2019

The amount of time it takes for a message to move through a system plays a big role in the performance of distributed systems like Apache Kafka®. In Kafka, the […].

Kafka 26

Kafka Systems IT 26

Netflix Tech

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. CDC is becoming increasingly popular for use cases that require keeping multiple heterogeneous datastores in sync (like MySQL and ElasticSearch) and addresses challenges that exist with traditional techniques like dual-writes and distributed transactions [3][4].

MySQL 84

MySQL PostgreSQL Database Transportation 84

KDnuggets

DECEMBER 19, 2019

Over the years new alternative providers have risen to provided a solitary data science environment hosted on the cloud for data scientist to analyze, host and share their work.

Data Science 114

Data Science Cloud Data Cloud Computing 114

KDnuggets

DECEMBER 18, 2019

Marketing scientist Kevin Gray asks Dr. Anna Farzindar of the University of Southern California about Automatic Text Summarization and the various ways it is used.

IT 118

IT 118

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

KDnuggets

DECEMBER 16, 2019

Once you have deployed your machine learning model into production, differences in real-world data will result in model drift. So, retraining and redeploying will likely be required. In other words, deployment should be treated as a continuous process. This guide defines model drift and how to identify it, and includes approaches to enable model training.

Machine Learning 111

Machine Learning Process Data IT 111

KDnuggets

DECEMBER 18, 2019

This post is about working with a mixture of color and grayscale images and needing to transform them into a uniform format - all grayscale. We'll be working in Python using the Pillow, Numpy, and Matplotlib packages.

Python 94

Python Process 94

KDnuggets

DECEMBER 16, 2019

Predictions for 2020 from a dozen innovative companies in AI, Analytics, Machine Learning, Data Science, and Data industry.

Machine Learning 105

Machine Learning Data Science Data 105

KDnuggets

DECEMBER 19, 2019

Here are six more lessons based on real life examples that I think we should all remember as people working in machine learning, whether you’re a researcher, engineer, or a decision-maker.

Machine Learning 84

Machine Learning Engineering Algorithm 84

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

KDnuggets

DECEMBER 20, 2019

By the end of this article you’ll know which technologies are becoming more popular with employers and which are becoming less popular.

Technology 135

Technology Data Data Science 135

KDnuggets

DECEMBER 17, 2019

Check out this step by step approach to building an intelligent chatbot in Python.

Building 116

Building Python 116

KDnuggets

DECEMBER 17, 2019

This second part in a series about how to "ultralearn" data science will guide you through several techniques to remove those distractions -- because your focus needs more focus.

Data Science 60

Data Science Data Education 60

KDnuggets

DECEMBER 18, 2019

Ontotext Platform 3.0 features significant technology improvements to enable simpler and faster graph navigation, including GraphQL interfaces to make it easier for application developers to access knowledge graphs without tedious development of back-end APIs or complex SPARQL.

Accessible 58

Accessible Accessibility Technology IT 58

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

KDnuggets

DECEMBER 20, 2019

This third part in a series about how to "ultralearn" data science will guide you through how to optimize your learning through five valuable techniques.

Data Science 63

Data Science Data 63

KDnuggets

DECEMBER 17, 2019

Michael Collela describes how UChicago’s Master of Science in Analytics has helped him define his career path. Michael currently works as a data scientist at dunnhumby.

Building 57

Building Data 57

KDnuggets

DECEMBER 17, 2019

Also: Your AI skills are worth less than you think; Another 10 Free Must-See Courses for Machine Learning and Data Science.

Technology 61

Technology Machine Learning Data Science Data 61

KDnuggets

DECEMBER 18, 2019

Stream data processing has gained progressive momentum with the arriving of new stream applications and big data scenarios. These streams of data evolve generally over time and may be occasionally affected by a change (concept drift). How to handle this change by using detection and adaptation mechanisms is crucial in many real-world systems.

IT 49

IT Big Data Data Process Systems 49

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

KDnuggets

DECEMBER 18, 2019

Build Pipelines with Pandas Using pdpipe; AI, Analytics, ML, DS, Technology Main Developments, Key Trends; New Poll: Does AutoML work? Ultralearn Data Science; Python Dictionary How-To; Top stories of 2019 and more.

Technology 48

Technology Building Data Science Python 48

KDnuggets

DECEMBER 16, 2019

It is an annual tradition for Xavier Amatriain to write a year-end retrospective of advances in AI/ML, and this year is no different. Gain an understanding of the important developments of the past year, as well as insights into what expect in 2020.

Machine Learning 47

Machine Learning Deep Learning Healthcare IT 47

KDnuggets

DECEMBER 20, 2019

Idiot's Guide to Precision, Recall and Confusion Matrix; 10 Free Must-Read Books for Machine Learning and Data Science; How to Speed up Pandas by 4x with one line of codes; #Math for Programmers teaches you the math you need to know.

Machine Learning 46

Machine Learning Data Science Coding Data 46

KDnuggets

DECEMBER 16, 2019

Also: Plotnine: Python Alternative to ggplot2; AI, Analytics, Machine Learning, Data Science, Deep Learning Technology Main Developments in 2019 and Key Trends for 2020; Moving Predictive Maintenance from Theory to Practice; 10 Free Top Notch Machine Learning Courses; Math for Programmers!

Machine Learning 46

Machine Learning Data Science Deep Learning Building 46

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building