The Pragmatic Engineer

JANUARY 26, 2023

Comments

307

307

Christophe Blefari

JANUARY 27, 2023

My view from the train window ( credits ) Dear Data News readers it's a joy every week to write this newsletter, we are slowly approaching the second birthday of this newsletter. In order to celebrate this together I'd love to receive your stories about data —can be short or long, anonymous or not. This is an open box, just write me with what you have on the mind and I'll bundle an edition with it.

Data 130

Data Algorithm Data Pipeline SQL 130

Seattle Data Guy

JANUARY 24, 2023

Modern data stack consultant plays an important role in companies looking to become data-driven. They help companies design and deploy centralized data sets that are easy to use and reliable. They do so by using cloud based solutions that help automate data pipelines and processes with less code than in the past. But in order… Read more The post Do You Need A Modern Data Stack Consultant appeared first on Seattle Data Guy.

Consulting 130

Consulting Data Pipeline Data Cloud 130

KDnuggets

JANUARY 24, 2023

Effective solutions exist when you don't have enough data for your models. While there is no perfect approach, five proven ways will get your model to production.

Machine Learning 160

Machine Learning Data 160

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Engineering at Meta

JANUARY 27, 2023

Managing network solutions amidst a growing scale inherently brings challenges around performance, deployment, and operational complexities. At Meta, we’ve found that these challenges broadly fall into three themes: 1.) Data center networking: Over the past decade, on the physical front, we have seen a rise in vendor-specific hardware that comes with heterogeneous feature and architecture sets (e.g., non-blocking architecture).

Engineering 125

Engineering Software Engineer Software Engineering Transportation 125

Netflix Tech

JANUARY 25, 2023

Scalable Annotation Service — Marken by Varun Sekhri , Meenakshi Jindal Introduction At Netflix, we have hundreds of micro services each with its own data models or entities. For example, we have a service that stores a movie entity’s metadata or a service that stores metadata about images. All of these services at a later point want to annotate their objects or entities.

Algorithm 113

Algorithm Media Metadata Data Ingestion 113

KDnuggets

JANUARY 26, 2023

Impress your friends and loved ones by perfecting your ChatGPT prompt engineering game with this incredibly useful resource.

Engineering 160

Engineering Process 160

Precisely

JANUARY 27, 2023

In today’s hypercompetitive business environment, companies must deliver a standout experience for their target audience. Companies that excel at customer experience (CX) are better at building brand loyalty, increasing total customer lifetime value, and turning occasional customers into brand evangelists. This compelling drive for outstanding CX coincides with an intensive shift toward digitization, personalization, and omnichannel alignment.

High Quality Data 105

High Quality Data Data Governance Government Banking 105

Uber Engineering

JANUARY 26, 2023

We recently containerized Hadoop NameNodes and upgraded hardware, improving NameNode RPC queue time from ~200 to ~20ms – A 10x improvement! With this radical change, Uber’s Hadoop customers are happier and admins rest more at night.

Hadoop 103

Hadoop Data 103

LinkedIn Engineering

JANUARY 25, 2023

Co-Authors: Xianyun Mao , Stan Xu , Rachit Kumar , Vikas R , Xia Hong , and�� Divyakumar Menghani �� As a LinkedIn member, you can subscribe to LinkedIn Premium on a monthly or annual basis. For our customers, we offer the same option for our Talent Solutions and/or Sales Navigator products. For each, LinkedIn offers subscription renewal payments. These subscription renewal payments used to go through a rule-based routing engine to selected payment gateways, which often resulted in a less-than-o

Banking 97

Banking Machine Learning Datasets Engineering 97

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

KDnuggets

JANUARY 23, 2023

Here are 6 stages of a novel Data Science Project; From Data Collection to Model in Production, backed by research and examples.

Data Collection 155

Data Collection Data Science Project Data 155

databricks

JANUARY 26, 2023

For your data-centered workloads, Databricks offers the best-in-class development experience and gives you the tools you need to adhere to code development best.

Coding 94

Coding Data 94

ArcGIS

JANUARY 27, 2023

ArcGIS Online users and administrators - learn best practices for managing ArcGIS Online credits and get answers to frequently asked questions.

Management 98

Management 98

DoorDash Engineering

JANUARY 24, 2023

As DoorDash’s business has grown with increasing order volumes and through emerging businesses including grocery delivery, our customer support experience also needed to scale up efficiently. The legacy support application that DoorDash had built to issue credits and refunds was created only to address the original food delivery service. It couldn’t handle the needs of our new verticals.

Building 72

Building Python Coding Food 72

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

KDnuggets

JANUARY 23, 2023

Get your hands on these gems to learn Python, data analytics, machine learning, and deep learning.

Data Science 160

Data Science Deep Learning Machine Learning Python 160

databricks

JANUARY 24, 2023

We are excited to announce a new AutoML capability to quickly and easily use Feature Store data to improve model outcomes. AutoML users.

Data 92

Data 92

ArcGIS

JANUARY 24, 2023

This blog will answer questions such as “What is SAR?”, “What can SAR be used for?”, and “How is SAR beneficial?”.

Education 87

Education 87

Towards Data Science

JANUARY 26, 2023

Compare tables and extract their differences with standard SQL Continue reading on Towards Data Science »

Data Science 75

Data Science SQL Google Cloud Data 75

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

KDnuggets

JANUARY 24, 2023

This article explores the knapsack problem. We will discuss why it is difficult to solve traditionally and how genetic programming can help find a "good enough" solution. We will then look at a Python implementation of this solution to test out for ourselves.

Programming 110

Programming Python IT Machine Learning 110

databricks

JANUARY 23, 2023

This is a collaborative post from Databricks and Census. We thank Parker Rogers, Data Community Advocate, at Census for his contributions. In this.

Data 88

Data 88

ArcGIS

JANUARY 26, 2023

Another five hacks in an endless stream of one-minute how-to videos.

97

97

Workfall

JANUARY 24, 2023

Reading Time: 6 minutes With reference to the previous blog on state management with React and Redux , we will look at state management in an Angular 15 application using the NgRx store in this blog. NgRx is derived from Ng(the conventional name for Angular tools and ecosystem) and Rx(Reactive Extensions). Moreover, for anyone who has used Angular, you have already used Reactive Extensions if you have used the rxjs library.

Coding 52

Coding Utilities Project Programming 52

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

KDnuggets

JANUARY 23, 2023

JupyterHub is a multi-user, container-friendly version of the Jupyter Notebook. However, it can be difficult to setup. This blog post will make you less likely to run into issues in this 15+ step process.

AWS 110

AWS Process IT 110

databricks

JANUARY 26, 2023

This is part two of a three-part series in Best Practices and Guidance for Cloud Engineers to deploy Databricks on AWS. You can.

AWS 90

AWS Cloud Engineering 90

ArcGIS

JANUARY 24, 2023

Find out how including web maps in your development workflows using the ArcGIS Maps SDKs for Native Apps can increase your productivity!

68

68

ProjectPro

JANUARY 27, 2023

From identifying fraudulent transactions to predicting market crashes, data science applications in the finance industry are endless. Imagine predicting market crashes or identifying fraudulent transactions before they occur. All this is possible now, thanks to the versatile data science applications in the finance industry. Join us as we highlight some of the most popular data science applications in finance and exciting project ideas for financial data scientists to help them stay ahead of the

Finance 52

Finance Data Science Unstructured Data Algorithm 52

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

KDnuggets

JANUARY 23, 2023

ChatGPT as a Python Programming Assistant • ChatGPT: Everything You Need to Know • Explainable AI: 10 Python Libraries for Demystifying Your Model’s …

Programming 114

Programming Python Machine Learning 114

databricks

JANUARY 27, 2023

“This blog is authored by Hai Nguyen, Senior Data Scientist at Gousto” Gousto is the UK's best value recipe box, serving up more rec.

Data 86

Data 86

Hevo

JANUARY 26, 2023

Real-time data is the need of the hour for businesses to make timely decisions, especially in cases of fraud detection or customer behavior analysis. Relying on traditional batch processing is not effective now.

Data 52

Data Technology Process Data Warehouse 52

ProjectPro

JANUARY 27, 2023

Computer vision libraries provide in-built functions and optimized algorithms for various image and video processing tasks. These libraries help data scientists and machine learning engineers save significant time and resources when performing complex image/video processing and analysis tasks with minimal coding. Using the best computer vision libraries can help you improve any machine learning model's accuracy, performance, and robustness, enhancing the capabilities of the computer vision appli

Python 52

Python Deep Learning Programming Language Algorithm 52

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building