article thumbnail

Big Savings On Big Data

Lyft Engineering

How Lyft’s ML Platform Saves Time and Money on Big Data/ML Workloads By Anindya Saha & Han Wang Image by DALL·E Motivation In previous articles, we talked about the ML Platform of Lyft, LyftLearn , which manages ML model training as well as batch predictions. How much more did we spend in 2022 vs 2021?

article thumbnail

2021 Gift Giving Guide for Data Nerds

DataKitchen

Back by popular demand, we’ve updated our data nerd Gift Giving Guide to cap off 2021. We’ve kept some classics and added some new titles that are sure to put a smile on your data nerd’s face. Fail Fast, Learn Faster: Lessons in Data-Driven Leadership in an Age of Disruption, Big Data, and AI, by Randy Bean.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

The DataOps Vendor Landscape, 2021

DataKitchen

Download the 2021 DataOps Vendor Landscape here. DataOps is a hot topic in 2021. This is not surprising given that DataOps enables enterprise data teams to generate significant business value from their data. Prefect Technologies — Open-source data engineering platform that builds, tests, and runs data workflows.

article thumbnail

DIA Entries 2021: Judges’ Insight

Cloudera

The 2021 Data Impact Award (DIA) submissions are starting to stream in, and we know many of you are contemplating your entries – which we are excited to see. But the competitive situation has changed, and today the majority of organizations are under the gun to show stakeholders that they are actively pursuing big things with data.

article thumbnail

The Pipeline Academy Awards 2021

Pipeline Data Engineering

2021 was about the Cambrian explosion of data engineering tooling, yet you don't have to be a data scientist to be certain that 90% of the data tools will be gone in about two years or so, and for a good reason. The 2021 Pipeline Academy Awards (The Pipies) are brought to you by Pipeline Academy.

article thumbnail

Space-Based AI Shows the Promise of Big Data

Cloudera

At a distance of a million miles from Earth, the James Webb Space Telescope is pushing the edge of data transfer capabilities. 25 2021 on a mission to look at the early universe, at exoplanets, and at other objects of celestial interest. The post Space-Based AI Shows the Promise of Big Data appeared first on Cloudera Blog.

Big Data 101
article thumbnail

Data Engineering Annotated Monthly – August 2021

Big Data Tools

Even if a meteorite hits your data center, your big data is still going to be safe! Future improvements Data engineering technologies are evolving every day. Most of the topics, from data quality to DWH architecture, are hot! Follow JetBrains Big Data Tools on Twitter and subscribe to our blog for more news!