Data Engineering Podcast

JUNE 17, 2017

Summary Yelp needs to be able to consume and process all of the user interactions that happen in their platform in as close to real-time as possible. To achieve that goal they embarked on a journey to refactor their monolithic architecture to be more modular and modern, and then they open sourced it! In this episode Justin Cunningham joins me to discuss the decisions they made and the lessons they learned in the process, including what worked, what didn’t, and what he would do differently

Data Pipeline 100

Data Pipeline Kafka Business Intelligence Architecture 100

Uber Engineering

JUNE 19, 2017

Uber is developing a payment platform for India that enables operations teams to more seamlessly collect and distribute cash and digital wallet payments to drivers. In this article, San Francisco-based software engineer Yijun Liu reflects on his experiences working with … The post Re-Architecting Cash and Digital Wallet Payments for India with Uber Engineering appeared first on Uber Engineering Blog.

Engineering 96

Engineering Software Engineer Software Engineering Business Intelligence 96

ProjectPro

JUNE 1, 2017

News on Hadoop - May 2017 High-end backup kid Datos IO embraces relational, Hadoop data.theregister.co.uk , May 3 , 2017. Datos IO has extended its on-premise and public cloud data protection to RDBMS and Hadoop distributions. Its RecoverX distributed database backup product of latest version v2.0 now provides hadoop support. RecoverX is described as app-centric and can back up applications data whilst being capable of recovering it at various granularity levels to enhance storage efficiency.

Hadoop 52

Hadoop Medical Pipeline-centric Database-centric 52

Zalando Engineering

JUNE 26, 2017

Information Retrieval (IR) systems are a vital component in the core of successful modern web platforms, and Zalando understand their importance incredibly well. The main goal of IR systems is to provide a communication layer that enables customers to establish a retrieval dialogue with underlying data. The immense explosion of unstructured data drives modern search applications to go beyond just fuzzy string matching, to invest in deep understanding of user queries through interpretation of use

Architecture 40

Architecture Unstructured Data Machine Learning Data Ingestion 40

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

Uber Engineering

JUNE 29, 2017

When Uber launched in 2009, our mission was simple: make transportation as reliable as running water everywhere, for everyone. While our mission remains the same today, the number of Uber use cases have grown dramatically, motivating our engineers to think … The post Engineering On-Demand Transportation for Business with Uber Central appeared first on Uber Engineering Blog.

Transportation 75

Transportation Engineering Architecture 75

Zalando Engineering

JUNE 14, 2017

Most people associate the term UX research with qualitative methods, for example, interviews with a small number of participants. These interviews are used to discover things such as customer problems, usability issues with a product, and customer journeys. Often, we concentrate on observable behavior by watching and interviewing customers while they actually use the product or prototype.

IT 40

IT Recruitment Project Building 40

Zalando Engineering

JUNE 7, 2017

As part of an effort to increase developer awareness of quality, we wanted to draw attention the fact that you should have healthy CI builds. The normal procedure revolved around emails sent to the individuals who broke the build with their last commit. With almost all of us used to receiving a lot of email-noise throughout the day, this is not a channel where you can expect an immediate reaction.

Building 52

Building Project Systems IT 52

Zalando Engineering

JUNE 20, 2017

A lot of time has passed at Zalando since the first services were started backed by PostgreSQL 9.0-rc1. Despite the adoption of other technologies, PostgreSQL remains the preferred relational database for most engineers around. You can follow some of the developments around PostgreSQL on the blog and also on GitHub where we share most of our PostgreSQL-related tooling.

PostgreSQL 40

PostgreSQL AWS Relational Database Database 40

ProjectPro

JUNE 22, 2017

What is a Hadoop Cluster? In general, a computer cluster is a collection of various computers that work collectively as a single system. “A hadoop cluster is a collection of independent components connected through a dedicated network to work as a single centralized data processing resource. “ “A hadoop cluster can be referred to as a computational computer cluster for storing and analysing big data (structured, semi-structured and unstructured) in a distributed environment.

Hadoop 52

Hadoop IT Data Analysis Big Data 52