The Pragmatic Engineer

MARCH 30, 2023

Originally published on 30 March 2023. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of five topics in today’s subscriber-only The Scoop issue. To get full issues twice a week, subscribe here. Disclaimer: I worked at Uber, Lyft's US competitor, between 2016-2020. As always, I aim to remain independent in my analysis: I hold no positions in any of the companies mentioned in this article, and have not been paid to write ab

Software Engineer 285

Software Engineer Software Engineering Retail Media 285

KDnuggets

MARCH 30, 2023

Work on data analytics, time series, natural language processing, machine learning, and ChatGPT projects to improve your chance of getting hired.

Portfolio 176

Portfolio Project Data Science Machine Learning 176

LinkedIn Engineering

MARCH 30, 2023

Our developers at LinkedIn are constantly exploring ways to enhance and strengthen our platform, aiming to provide our members and customers with the greatest possible access to knowledge and connections. With approximately 15,000 code repositories, our developers work tirelessly to make thousands of code changes each day, improving functionality and resolving any issues that may arise.

Coding 116

Coding Project Process Designing 116

Ripple Engineering

MARCH 30, 2023

Summary Managing the entire lifecycle of a machine learning (ML) model from inception to deployment in production can be a daunting task involving multiple systems and lots of moving parts. At Ripple we have a mix of cloud providers (GCP and AWS) and internally managed tools (Gitlab, Artifactory, Vault etc.), and we needed a managed solution that would help us deliver models to product use cases within a short amount of time, which led us to choose Databricks.

Machine Learning 98

Machine Learning AWS Metadata Data Collection 98

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

KDnuggets

MARCH 30, 2023

And How to Speed up your research of data science resources without wasting energy.

Data Science 124

Data Science Data 124

ArcGIS

MARCH 30, 2023

ROW and Easement Data Management improves infrastructure planning, utility maintenance, and other functions that require access to land.

Data Management 100

Data Management Management Utilities Data 100

KDnuggets

MARCH 30, 2023

Exploring the Latest Enhancements and Features of PyCaret 3.0.

Machine Learning 108

Machine Learning Coding Python 108

Meltano

MARCH 30, 2023

An isolated test environment is a set of computing resources in the form of hardware, software, and configuration files working together—but set apart from the production environment—to execute test cases and ascertain certain system behavior. It’s deployed on a separate network or computing resources so that applications running in isolation are prevented from accessing applications outside their environment.

Metadata 59

Metadata Database Python Coding 59

Confluent

MARCH 30, 2023

Why do data teams need data contracts whereas APIs suffice for everyone else? The most important is to get your data systems, as well as your software and data teams aligned.

Data 57

Data Systems 57

Hevo

MARCH 30, 2023

Big data has become a differentiator for organizations, allowing decision-makers to boost business growth. However, to leverage the potential of the collected data, organizations have to build a better relationship among the datasets. This allows data professionals to understand the business requirement and pull the necessary data to generate insights.

Datasets 52

Datasets Big Data Data Building 52

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification

Data Engineering Weekly

MARCH 30, 2023

In this episode of Data Engineering Weekly Radio, we delve into modern data stacks under pressure and the potential consolidation of the data industry. We refer to a four-part article series that explores the data infrastructure landscape and the Software as a Service (SaaS) products available in data engineering, machine learning, and artificial intelligence.

Machine Learning 52

Machine Learning Government AWS Data Engineering 52

Cloudyard

MARCH 30, 2023

Read Time: 2 Minute, 30 Second For instance, Consider a scenario where we have unstructured data in our cloud storage. However, Unstructured I assume : PDF,JPEG,JPG,Images or PNG files. Therefore, As per the requirement, Business users wants to download the files from cloud storage. But due to compliance issue, users were not authorized to login to the cloud provider.

Unstructured Data 52

Unstructured Data Accessible Accessibility Cloud Storage 52

Knowledge Hut

MARCH 30, 2023

It is proven that organizations with mature project management practices perform better across all five critical Key Performance Indicators (KPI) - the extent of the intended outcome, cost compliance, schedule compliance, scope creep, and overall project failures than organizations with immature project management processes. A Project Management Officer is the critical driver of PM maturity in organizations helping them ensure successful project management outcomes.

Project 52

Project Management Portfolio Government 52

Hevo

MARCH 30, 2023

We all are in the post-pandemic era now. Everything in the business sector has changed, including how they operate and employ tools and methods. The field of data analytics has also been touched by the winds of change. The need for up-to-date analytics has increased due to the increased urgency for business-leading data.

Data Analytics 52

Data Analytics Data Data Warehouse 52

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

ArcGIS

MARCH 30, 2023

Join our upcoming webinar on April 26th to learn how to standardize and streamline cartographic production with our national mapping experts.

52

52

Hevo

MARCH 30, 2023

The dbt tool is used in organizations that have complex business logic behind their data. It is helping data engineers to quickly transform data and support downstream processes with near-real-time data pipelines. It also enables organizations to keep track of changes made to the business logic and makes it easier to track data.

Building 52

Building Data Pipeline Data Engineering Data Engineer 52

Knowledge Hut

MARCH 30, 2023

Project management is known by the 3 Ps - Projects, Programs, and Portfolios. Each of these align symmetrically to create the outlined deliverables at each level, and are necessary for an organization to achieve the desired outcomes. The purpose of each of these management activities is focused on the respective outcomes they aim to achieve - projects aim to organize and ensure the delivery of products and services to achieve quality deliverables; programs aim to align multiple projects to achie

Portfolio 52

Portfolio Project Process Management 52

Hevo

MARCH 30, 2023

In today’s digital age, data plays a crucial role in shaping the success of businesses across various industries. To stay competitive, companies must collect, analyze, and utilize data effectively. This requires a robust data management strategy encompassing data quality, governance, and integration.

Architecture 52

Architecture Government Utilities Data Management 52

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

Snowflake

MARCH 30, 2023

“The features you use influence more than everything else the result. No algorithm alone, to my knowledge, can supplement the information gain given by correct feature engineering” —Luca Massaron, Data Scientist Snowflake continues to set the standard for data in the cloud by removing the need to perform maintenance tasks on your data platform and giving you the freedom to choose your data model methodology for the cloud.

Engineering 81

Engineering Raw Data Data Science Scala 81

Towards Data Science

MARCH 30, 2023

Back To Basics | SQL fundamentals for beginners Image by author, created on canva In order to understand the enterprise data; you have to query it a lot. When I say ‘A lot’, I mean it. Working with unfamiliar piles of data is often daunting and it’s always a good practice to take some time to explore and understand the data itself. It’s good to have basic data retrieval skills but knowing analytical functions to derive some useful insights out of your data is cherry on top of a cake and it’s fu

SQL 84

SQL MySQL Retail Data Analysis 84

Scott Logic

MARCH 30, 2023

On a recent project, I had just finished running my suite of automated end-to-end tests and was pleased to see that single line of green text in the console telling me 347 of my 347 tests had all passed. Sweet. But then it hit me – I never actually tested the system for any of those 347 so called tests, what I felt I had done was simply check that this part of the system behaved as I expected it should, according to Acceptance Criteria.

Coding 52

Coding Project Systems Building 52

Precisely

MARCH 30, 2023

Why do customers choose your brand over the competition? If they can buy a similar product from one of your rivals, perhaps even at a lower price, then why would they opt for yours? The short answer is that consumers don’t just buy products – they buy relationships. When a customer engages with your brand, it’s because they’re getting something more; they get you.

Management 52

Management Professional Services Data Integration Systems 52

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

Scott Logic

MARCH 30, 2023

The buzz and excitement around generative AI is continuing to grow as their capabilities rapidly expand. However, their ability to generate content is just the starting point. From my perspective, the emergent reasoning capability, coupled with their intelligent use of tools, is what will make this technology truly transformational, and will mark the start of a new technology epoch.

Technology 40

Technology Food Programming Media 40

AltexSoft

MARCH 30, 2023

Shell, Adobe, Burberry, Columbia, Bayer — you definitely know the names. But what do the gas and oil corporation, the computer software giant, the luxury fashion house, the top outdoor brand, and the multinational pharmaceutical enterprise have in common? The answer is simple: They use the same technology to make the most of data. Along with thousands of other data-driven organizations from different industries, the above-mentioned leaders opted for Databrick to guide strategic business decision

Scala 64

Scala Data Lake BI Google Cloud 64