Waitingforcode

MARCH 9, 2023

There is always a gap between a disruption in the data engineering industry and its integration on the cloud. It was not different for table file formats which have started gaining interest on AWS, Azure, GCP recently.

Cloud 130

Cloud AWS Data Engineering Data Engineer 130

Uber Engineering

MARCH 9, 2023

Uber’s configuration platform team talks about how they consolidated the infrastructure for multiple configuration systems into a unified, next-gen distribution platform, reducing CPU usage by an order of magnitude.

Systems 98

Systems 98

KDnuggets

MARCH 9, 2023

This report provides an overview of the key factors affecting the time to insights, including the benefits of BI and the need for tailored solutions.

BI 99

BI Data Science Data 99

ArcGIS

MARCH 9, 2023

In ArcGIS Pro 3.1, the Points to Line tool includes three new parameters to specify how to construct lines and transfer attributes.

Transportation 96

Transportation Data Management Management Data 96

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

KDnuggets

MARCH 9, 2023

For a limited time, save up to 67% on a DataCamp Premium subscription and unlock 410+ interactive courses for all levels in Python, SQL, R, Power BI, and more.

BI 85

BI SQL Python Data 85

Precisely

MARCH 9, 2023

As cloud computing platforms make it possible to perform advanced analytics on ever larger and more diverse data sets, new and innovative approaches have emerged for storing, preprocessing, and analyzing information. Hadoop, Snowflake, Databricks and other products have rapidly gained adoption. Technology innovators have developed a diverse range of platforms, but the distinctions between them can sometimes be confusing.

Data Lake 59

Data Lake Data Warehouse Hadoop Raw Data 59

ArcGIS

MARCH 9, 2023

Learn about differences between subnetwork system diagrams and standard diagrams to decide whether system diagrams are relevant for you

Systems 64

Systems Utilities Telecommunication Data Management 64

KDnuggets

MARCH 9, 2023

Learn the basic difference between Decorators and Metaclasses in Python.

Python 103

Python 103

Rockset

MARCH 9, 2023

Blockchain technology has revolutionized the way we store and access data. The decentralized nature of blockchain allows for transparency and immutability, making it an ideal technology for a variety of industries. Originally popularized by Bitcoin in 2009, there have since been a surge in blockchain platforms launched around the world. The most prominent blockchain platform is the Ethereum blockchain, which in 2021 surpassed Bitcoin to become the most popular blockchain network in the world (as

Amazon Web Services 52

Amazon Web Services Datasets AWS Google Cloud 52

Retail Insight

MARCH 9, 2023

In June 2022, inflation peaked at 9.1% in the US, with the annual rate for the year sitting at 6.5% 1. The impact of this is that millions of US consumers are facing significant financial pressures and struggling to cover costs amidst staggering price hikes.

Retail 52

Retail Management Data 52

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

Monte Carlo

MARCH 9, 2023

An often quoted, but still painful, statistic is that only 53% of machine learning projects make it from prototype to production. As a data scientist, I can vouch that unfortunately once in deployment, it’s not exactly smooth sailing either. The model, already navigating undercurrents of skepticism from business users, is just as likely to sail into uncertain waters as it is to reach the shores of predictive validity.

Engineering 52

Engineering Data Pipeline Machine Learning Data Science 52

Confluent

MARCH 9, 2023

Event Streaming is one of many investments that the technology leaders can make. Here’s an assessment of how event streaming benefits your enterprise.

Technology 57

Technology 57

Acceldata

MARCH 9, 2023

Learn how data observability enables Snowflake data pipelines to run efficiently.

Data Pipeline 52

Data Pipeline Data 52

LinkedIn Engineering

MARCH 9, 2023

Co-authors: Shu Wang , Biao He , and Minchu Yang At LinkedIn, Apache Spark is our primary compute engine for offline data analytics such as data warehousing, data science, machine learning, A/B testing, and metrics reporting. We execute nearly 100,000 Spark applications daily in our Apache Hadoop YARN (more on how we scaled YARN clusters here ). These applications rely heavily on dependencies ( JAR files ) for their computation needs.

Hadoop 124

Hadoop Machine Learning Designing Data Pipeline 124

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

ThoughtSpot

MARCH 9, 2023

Today we’re excited to announce ThoughtSpot Sage , our new search experience that combines the power of GPT’s natural language processing and generative AI capabilities with the accuracy and security of our patented self-service analytics platform. With this new integration, data teams will be able to exponentially increase their impact across an organization as business users self-serve personalized, actionable, and trustworthy insights like never before.

SQL 91

SQL Government Architecture Algorithm 91

Lyft Engineering

MARCH 9, 2023

by Alex Hartwell and Tim Miko Across the past couple of years, different mobile app teams across Lyft have been moving to Server Driven UI (SDUI) for three main reasons: To deal with business complexity To increase release velocity To be more flexible in how we staff and build features This post is about Lyft Bikes and Scooters’ journey to SDUI, why we’ve gone down this path, and what’s worked well for us.

Architecture 84

Architecture Coding Transportation Building 84

Towards Data Science

MARCH 9, 2023

Code implementations for ML pipelines: from raw data to predictions Photo by Rodion Kutsaiev on Unsplash Real-life machine learning involves a series of tasks to prepare the data before the magic predictions take place. Filling the missing values, one hot encoding for the categorical features, standardization and scaling for the numeric ones, feature extraction, and model fitting are just some of the stages that take part during a machine learning project before making any predictions.

Machine Learning 77

Machine Learning Building Datasets Scala 77

dbt Developer Hub

MARCH 9, 2023

At Teads, we’ve been using BigQuery (BQ) to build our analytics stack since 2017. As presented in a previous article , we have designed pipelines that use multiple roll-ups that are aggregated in data marts. Most of them revolve around time series, and therefore time-based partitioning is often the most appropriate approach. Back then, only ingestion-time partitioning was available on BQ and only at a daily level.

SQL 59

SQL Designing Building IT 59

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

Snowflake

MARCH 9, 2023

The modern business has a lot of data, but turning it into something valuable can be a challenge. We caught up with Wand, to see how it’s using AI to turn data into insight in a matter of hours. Today, organizations in all industries know the value of doing more with their data. But, actually putting data to work and turning it into the insights that matter can be a huge challenge.

Cloud 63

Cloud Unstructured Data Data Data Storage 63

Engineering at Meta

MARCH 9, 2023

Meta is introducing Velox, an open source unified execution engine aimed at accelerating data management systems and streamlining their development. Velox is under active development. Experimental results from our paper published at the International Conference on Very Large Data Bases (VLDB) 2022 show how Velox improves efficiency and consistency in data management systems.

Engineering 73

Engineering Java Bytes Data Ingestion 73