The Pragmatic Engineer
NOVEMBER 3, 2022
👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of six topics in today’s subscriber-only The Scoop issue. To get this newsletter every week, subscribe here. On Wednesday, 26 October, Elon Musk entered Twitter’s headquarters in San Francisco with a sink, marking his arrival at the company he’d just bought.
Data Engineering Podcast
OCTOBER 30, 2022
Summary Business intelligence has grown beyond its initial manifestation as dashboards and reports. In its current incarnation it has become a ubiquitous need for analytics and opportunities to answer questions with data. In this episode Amir Orad discusses the Sisense platform and how it facilitates the embedding of analytics and data insights in every aspect of organizational and end-user experiences.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
KDnuggets
NOVEMBER 2, 2022
A data engineer is a fast-growing profession with amazing challenges and rewards. Which skills do you need to become a data engineer? In this post, we’ll take a look at both hard and soft skills.
Cloudera
NOVEMBER 1, 2022
It’s no secret that IT modernization is a top priority for the US federal government. A quick trip in the congressional time machine to revisit 2017’s Modernizing Government Technology Act surfaces some of the most salient points regarding agencies’ challenges: The federal government spends nearly 75% of its annual information technology funding on operating and maintaining existing legacy information technology systems.
Advertisement
Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.
Confluent
NOVEMBER 2, 2022
Learn how to pinpoint common Kafka issues, which producer metrics to monitor, and how to optimize Kafka to keep latency low and throughput high.
Data Engineering Podcast
OCTOBER 30, 2022
Summary One of the most impactful technologies for data analytics in recent years has been dbt. It’s hard to have a conversation about data engineering or analysis without mentioning it. Despite its widespread adoption there are still rough edges in its workflow that cause friction for data analysts. To help simplify the adoption and management of dbt projects Nandam Karthik helped create Optimus.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Cloudera
NOVEMBER 2, 2022
You asked. We delivered: Introducing the Cloudera Partner Network. Cloudera’s channel programs team constantly strives to improve how we engage, reward, and collaborate with our partners. And based on your feedback, we’re replacing Cloudera Connect with a new program, Cloudera Partner Network (CPN). It provides more comprehensive tools and support to help you go to market faster, as well as industry-leading incentives and promotions that we’ve aligned with your business and sales models. .
Databand.ai
NOVEMBER 4, 2022
Re-Imagining Data Observability Ryan Yackel 2022-11-04 10:36:35 Data observability has become one of the hottest topics of the year – and for good reason. Data observability provides an end-to-end view into exactly what’s happening with data pipelines across an organization’s data fabric. And it does so in real time. That means instead of the CEO getting a frantic call at 3 am that something is broken, teams can fix issues proactively before they become a bigger problem.
Trio
NOVEMBER 4, 2022
Vue.js 2 or Vue 2 has been powering interactive web development for quite a few years now. ‘The progressive JavaScript framework’ is one of the most preferred technologies for developing web interfaces, as evident in the 2022 Stack Overflow Developer Survey.
KDnuggets
OCTOBER 31, 2022
Check out this list of 15 FREE ebooks for learning machine learning and deep learning.
Speaker: Scott Sehlhorst
We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.
Pinterest Engineering
NOVEMBER 4, 2022
Xue Xia, Software Engineer, Homefeed Ranking; Neng Gu, Software Engineer, Content & User Understanding; Dhruvil Deven Badani, Engineering Manager, Homefeed Ranking; Andrew Zhai, Software Engineer, Advanced Technologies Group Image from [link] In this blog post, we will demonstrate how we improved Pinterest Homefeed engagement volume from a machine learning model design perspective — by leveraging realtime user action features in Homefeed recommender system.
Rockset
NOVEMBER 2, 2022
Developing SQL queries is an essential part of the Rockset product experience. We're excited to announce the release of a new query editor in the Rockset Console with improved performance and an updated design. Upgraded Performance The main motivation for the new query editor experience was to resolve the performance issues of our old query editor. While it was generally usable, typing in the old query editor would lag when working on large queries and become sluggish after long periods of time.
Teradata
NOVEMBER 2, 2022
Analyzing vehicle data should be transforming customer experience in the auto industry. Unfortunately, it is behind many others in terms of delivering individualized experiences based on insight.
KDnuggets
OCTOBER 31, 2022
How to Select Rows and Columns in Pandas Using [ ],loc, iloc,at and.iat • Decision Tree Algorithm, Explained • Graphs: The natural way to understand data • 7 Techniques to Handle Imbalanced Data • A Data Science Portfolio That Will Land You The Job in 2022.
Speaker: Timothy Chan, PhD., Head of Data Science
Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.
U-Next
NOVEMBER 1, 2022
. According to a report by techjury , 7 out of 10 business rate data discovery as very important. Every organization/ small business/ large business etc., today employs Business Analytics on different levels to propel their businesses ahead. Data is at the core of every technological advancement made in recent times. . It’s been over a decade since the domain of data, and its analytics had been declared the hottest jobs of the 21 st century, and yet it shows no signs of slowing down or l
Striim
NOVEMBER 1, 2022
Hosted on the Google Cloud Blog, read on to learn how relational databases like Oracle store data but Striim and Google Cloud BigQuery ensure timely and accurate analytics at scale.
Picnic Engineering
NOVEMBER 1, 2022
While we love using Java in Picnic, we also adore Python. Over the years, our tech landscape has been enriched with numerous Python services, for instance to distribute product information across our backend ecosystem. We started small, adopting aiohttp as our HTTP server framework of choice. For many years, our Python services flourished as part of the bigger Picnic machine.
KDnuggets
NOVEMBER 3, 2022
AI education is broken, how do we solve it? Individuals end up learning a specific tool or tactic in a vacuum. They are missing the real-world applicability and collaboration that is critical to building impactful AI solutions in line with the organization’s strategy.
Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage
Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.
Trio
OCTOBER 31, 2022
JavaScript has been powering web development since the early 2000s. A mainstay of interactive web development, JavaScript has been the recipient of many language enhancements over the years. One such enhancement is TypeScript.
Data Engineering Weekly
OCTOBER 30, 2022
Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. Sign up free to test out the tool today. Editor’s Note: The current state of the Data Catalog The results are out for our poll on the current state of the Data Catalogs.
Confluent
NOVEMBER 3, 2022
Kafka security is crucial, yet complex. We'll show you how to automatically secure a Kafka cluster for easy authentication and encryption to meet compliance objectives.
KDnuggets
NOVEMBER 2, 2022
The Current State of Data Science Careers • 15 Free Machine Learning and Deep Learning Books • How to Make Python Code Run Incredibly Fast • Machine Learning on the Edge • Don't Become a Commoditized Data Scientist.
Advertisement
Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.
Trio
OCTOBER 31, 2022
Python is known as a versatile, general-purpose programming language. It is an open-source high-level language that’s easy to learn due to its use of plain English syntax. Due to numerous advantages (that we’ll address later), the multi-paradigm programming language lends itself well to varied use cases.
DataKitchen
NOVEMBER 3, 2022
Chris Bergh shares how to do a Data Journey in the on-demand webinar! The post On Demand Webinar: Map And Monitor Your Data Journey first appeared on DataKitchen.
U-Next
NOVEMBER 3, 2022
Introduction . The word ‘capstone ‘ might seem confusing to you, but in simple words, capstone means ‘the high point’ or ‘completion marker’ in a student’s career. A capstone project is mainly a two-semester project that is conducted in the final year of graduation, where students are supposed to independently or collectively research their topic of interest and participate in debates on relevant topics to gain deep knowledge in the subject.
KDnuggets
OCTOBER 31, 2022
How do we bridge this gap between deep learning and human cognitive ability?
Speaker: Anne Steiner and David Laribee
As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.
Tweag
NOVEMBER 2, 2022
When one is programming, they may compile the same project dozens of times per day, often after making only small modifications. Recompiling all the modules each time would be extremely time-consuming and disrupt the programmer’s workflow. Therefore, build tools are careful to avoid recompiling files if they know the result would be identical to what is already built.
Scott Logic
NOVEMBER 1, 2022
A 2021 study revealed that the average professional spends an average of 21.5 hours in meetings every week. So meetings must be worth having right? A meta-analysis produced in 2022 looking at over a decade of research showed 90 percent of employees feel meetings are “costly” and “unproductive.” What is the reason behind this disconnect? When meetings are done well, they lead to increased collaboration, an opportunity to consider different points of view, and quicker decision making.
Rock the JVM
OCTOBER 30, 2022
This article is for Scala beginners. After you learn the language, the next big thing you need to master is how to write essential “algorithms” in Scala. As you can probably tell and as senior developers will no doubt tell you, the mindset that comes with the Scala language is very different from what we’re usually taught in school, or in programming tutorials.
KDnuggets
NOVEMBER 3, 2022
The Center for Business Analytics at the University of Cincinnati will present its annual Data Science Symposium 2022 on November 8. This all day in-person event will have three featured speakers and two tech talk tracks with four concurrent presentations in each track. The event, held at the Lindner College of Business, is open to all.
Speaker: Margaret-Ann Seger, Head of Product, Statsig
Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating
Expert insights. Personalized for you.
130 
Let's personalize your content