DoorDash Engineering

NOVEMBER 8, 2022

No easy way to conduct user-level randomization With the changes of advertising dynamics such as restrictions on user data collection, users have more control over whether or not to be targeted for advertising, and thus we cannot assign truly randomized control or treatment groups. Figure 1: an example of the test design.

Designing 52

Designing Media Data Collection Building 52

Edureka

SEPTEMBER 11, 2023

The idea of artificial intelligence (AI) has always been fun, but when the word “generative” is added, it promises to be an alluring combination of automation and creativity. From healthcare and finance to art and entertainment, generative AI has been in the news recently. Table of Contents What is Generative AI?

Algorithm 52

Algorithm Entertainment Healthcare Deep Learning 52

Cloudera

AUGUST 25, 2020

Thank you for joining us for part two of our discussion around data, analytics and machine learning within the Financial Service Sector Dr. Harmon. Machine Learning and AI provide powerful predictive engines that rely on historical data to fit the models. You can catch-up and read part 1 of the series, here.

Technology 72

Technology Machine Learning Banking Government 72

Confluent

AUGUST 29, 2019

If you’ve found yourself needing to write very large JOIN statements or dealing with long paths through your data, then you are probably facing a graph problem. Looking at your data as a graph pays off tremendously when the connections between individual data items are as valuable as the items themselves.

Kafka 55

Kafka Process Algorithm Cloud 55

Pinterest Engineering

NOVEMBER 22, 2023

Goku is our in-house time series database providing cost efficient and low latency storage for metrics data. In the first blog, we will share a short summary on the GokuS and GokuL architecture, data format for Goku Long Term, and how we improved the bootstrap time for our storage and serving components.

Database 94

Database Bytes Kafka Architecture 94

ProjectPro

JANUARY 31, 2023

Data scientists and machine learning engineers often come across this scenario where the data for their project is not sufficient for training a machine learning model, often resulting in poor performance. This is particularly true when working with complex deep-learning models that require large amounts of data to perform well.

Deep Learning 52

Deep Learning Datasets Machine Learning Data 52

Cloudera

MAY 18, 2021

This article is the second in a multipart series to showcase the power and expressibility of FlinkSQL applied to market data. Code and data for this series are available on github. Flink SQL is a data processing language that enables rapid prototyping and development of event-driven and streaming applications. Intraday VaR.

SQL 99

SQL Java Data Business Analyst 99

Cloudera

MAY 4, 2021

This article is the first of a multipart series to showcase the power and expressibility of FlinkSQL applied to market data. Code and data for this series are available on github. Flink SQL is a data processing language that enables rapid prototyping and development of event-driven and streaming applications. Streaming VWAP.

SQL 81

SQL Business Analyst Data Java 81

Zalando Engineering

OCTOBER 12, 2021

In this blog post we describe an algorithm we developed when building our product image analysis infrastructure, where we use human-in-the-loop to tune the thresholds of our image classifiers. Over time the characteristics of the input product images may change, leading to a drift in the input data distribution.

Algorithm 52

Algorithm Python Coding Data Science 52

Cloudera

NOVEMBER 18, 2020

Given the increase of financial fraud this year and the upcoming holiday shopping season, which historically also leads to an increase, I am taking this opportunity to highlight 3 specific data and analytics strategies that can help in the fight against fraud across the Financial Services industry. . 1- Break down the Silos.

Banking 104

Banking Machine Learning Electronics Data 104

Netflix Tech

JULY 26, 2021

This happens at an unprecedented scale and introduces many interesting challenges; one of the challenges is how to provide visibility of Studio data across multiple phases and systems to facilitate operational excellence and empower decision making. With the latest Data Mesh Platform, data movement in Netflix Studio reaches a new stage.

Data 101

Data Data Pipeline MySQL Data Warehouse 101

Lyft Engineering

MARCH 27, 2023

We initially considered a variety of load-testing approaches before adopting simulation Historically, one of our biggest bottlenecks during these peak events was write-operations to data stores. This configurability helps us to roll out synthetic traffic to a new endpoint slowly and deliberately and fine-tune traffic patterns.

Coding 131

Coding Database Systems Engineering 131

Rockset

MAY 8, 2023

In this blog, we capture engineering stories from 5 early adopters of vector search- Pinterest, Spotify, eBay, Airbnb and Doordash- who have integrated AI into their applications. In the next sections, we’ll summarize 5 engineering blogs on vector search and highlight key implementation considerations. What is vector search?

Metadata 52

Metadata Algorithm Datasets Google Cloud 52

dbt Developer Hub

OCTOBER 17, 2022

For years working in data and analytics engineering roles, I treasured the daily camaraderie sharing a small office space with talented folks using a range of tools - from analysts using SQL and Excel to data scientists working in Python. This is especially useful in conjunction with data science use-cases.

SQL 52

SQL Python Programming Language Data Analysis 52

Cloudera

APRIL 22, 2021

Today’s enterprise data analytics teams are constantly looking to get the best out of their platforms. Storage plays one of the most important roles in the data platforms strategy, it provides the basis for all compute engines and applications to be built on top of it. Separates control and data plane enabling high performance.

Pipeline-centric 101

Pipeline-centric Data Lake Hadoop Metadata 101

DataKitchen

APRIL 13, 2021

Read the complete blog below for a more detailed description of the vendors and their capabilities. This is not surprising given that DataOps enables enterprise data teams to generate significant business value from their data. Testing and Data Observability. Download the 2021 DataOps Vendor Landscape here.

Consulting 123

Consulting Machine Learning Data Science Data Pipeline 123

Booking.com Engineering

DECEMBER 10, 2020

Based on benchmarks and blog posts out in the wild, brotli is able to get text-like payloads (HTML, Javascript, CSS) about 5–15% smaller than the gzipped size, and it’s not especially slower or more resource-intensive during decompression. This blog post from Will Hastings does a good job of explaining the optimization and showing its impact.

Bytes 52

Bytes Recruitment Coding Engineering 52

RandomTrees

FEBRUARY 6, 2024

Data engineering, the practice of collecting, transforming, and organizing data for analysis, is poised for a significant transformation with the advent of Generative Artificial Intelligence (Gen AI). Ingestion: The Art of Data Assimilation: Ensuring the digital document accurately reflects the original handwritten material.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52

LinkedIn Engineering

DECEMBER 20, 2023

This blog post delves into the AutoML framework for LinkedIn’s content abuse detection platform and its role in improving and fortifying content moderation systems at LinkedIn. It enables models to stay updated by automatically retraining on incrementally larger and more recent data with a pre-defined periodicity.

Machine Learning 90

Machine Learning Datasets Algorithm Architecture 90

Towards Data Science

OCTOBER 7, 2023

Here are 5 popular applications data teams at OpenAI, Vimeo, and other companies are putting into practice today. The hype around generative AI is real, and data and ML teams are feeling the heat. But where do most companies actually start when it comes to incorporating generative AI? Getting started with LLMs?

Unstructured Data 77

Unstructured Data Finance SQL Media 77

Monte Carlo

OCTOBER 4, 2023

The hype around generative AI is real, and data and ML teams are feeling the heat. Across industries, executives are pushing their data leaders to build AI-powered products that will save time, drive revenue, or give them a competitive advantage.

Unstructured Data 72

Unstructured Data Finance SQL Media 72

Netflix Tech

JANUARY 11, 2022

Here we describe the role of Experimentation and A/B testing within the larger Data Science and Engineering organization at Netflix, including how our platform investments support running tests at scale while enabling innovation. Curious to learn more about other Data Science and Engineering functions at Netflix?

Data Science 97

Data Science Data Algorithm Engineering 97