Sat.Dec 03, 2022 - Fri.Dec 09, 2022

article thumbnail

A Return to the Office (RTO) Wave?

The Pragmatic Engineer

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of five topics in today’s subscriber-only The Scoop issue. To get this newsletter every week, subscribe here. On Thursday, 29 November, Snap CEO Evan Spiegel, sent an email announcing Snap will mandate 4 days/week in the office, starting from January.

article thumbnail

Data News — Week 22.49

Christophe Blefari

This is what we call a Chat in French ( credits ) Hello there, this is Christophe, live from the human world. Last week have been totally driven by ChatGPT frenzy, the social networks I use to follow are spammed with conversation screenshots and hype. On my side I don't know what the future holds for us but for sure MaaS—Models as a Service—looks not bright to me.

SQL 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Why Data Migrations Suck.

Confessions of a Data Guy

I’ve often wondered what purgatory would be like, doing penance for millennia into eternity. It would probably be doing data migrations. I suppose they are not all that dissimilar from normal software migrations, but there are a few things that make data migrations a little more horrible and soul-sucking. Data migrations are able to slow […] The post Why Data Migrations Suck. appeared first on Confessions of a Data Guy.

Data 130
article thumbnail

We Don’t Need Data Scientists, We Need Data Engineers

KDnuggets

As more people are entering the field of Data Science and more companies are hiring for data-centric roles, what type of jobs are currently in highest demand? There is so much data in the world, and it just keeps flooding in, it now looks like companies are targeting those who can engineer that data more than those who can only model the data.

article thumbnail

Get Better Network Graphs & Save Analysts Time

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

article thumbnail

Adopting Real-Time Data At Organizations Of Every Size

Data Engineering Podcast

Summary The term "real-time data" brings with it a combination of excitement, uncertainty, and skepticism. The promise of insights that are always accurate and up to date is appealing to organizations, but the technical realities to make it possible have been complex and expensive. In this episode Arjun Narayan explains how the technical barriers to adopting real-time data in your analytics and applications have become surmountable by organizations of all sizes.

Data Lake 100
article thumbnail

Data News — Week 22.48

Christophe Blefari

Train(s) ( credits ) Hey you, this is an unusual Saturday. I'm terribly late with this newsletter. This week I had a huge amount of work to deal with and we've launched the Advent of Data , your daily spark of data in December. Thanks to everyone who accepted to participate, we already published the 3 first articles and I can't wait to read everything else writers are working on.

Kafka 130

More Trending

article thumbnail

How to Use Analytics to Accelerate Business Growth?

KDnuggets

Many organizations are establishing a Data Analytics team to reap the benefits of their key strategic asset i.e. data. The post explains how you can leverage the power of analytics to understand the end user and generate actionable insights.

article thumbnail

Business Intelligence In The Palm Of Your Hand With Zing Data

Data Engineering Podcast

Summary Business intelligence is the foremost application of data in organizations of all sizes. The typical conception of how it is accessed is through a web or desktop application running on a powerful laptop. Zing Data is building a mobile native platform for business intelligence. This opens the door for busy employees to access and analyze their company information away from their desk, but it has the more powerful effect of bringing first-class support to companies operating in mobile-firs

article thumbnail

Introducing Cloudera DataFlow Designer: Self-service, No-Code Dataflow Design

Cloudera

Cloudera has been providing enterprise support for Apache NiFi since 2015, helping hundreds of organizations take control of their data movement pipelines on premises and in the public cloud. Working with these organizations has taught us a lot about the needs of developers and administrators when it comes to developing new dataflows and supporting them in mission-critical production environments. .

article thumbnail

What Are Apache Kafka Consumer Group IDs?

Confluent

Learn what Kafka consumer group IDs are, and how to configure them to detect new data, read data from the same topic, and ensure fault tolerance.

Kafka 83
article thumbnail

Understanding User Needs and Satisfying Them

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

article thumbnail

4 Useful Intermediate SQL Queries for Data Science

KDnuggets

SQL is the essential language for developers, engineers, and data professionals. Intermediate knowledge in SQL gives you an edge in your data science career.

SQL 148
article thumbnail

Our Approach to Research and A/B Testing

LinkedIn Engineering

We are constantly striving to improve the experience on LinkedIn for our members and customers, with research and experimentation, such as A/B Testing, playing a key role in that work.�� Nearly a decade ago, I discussed the importance of these techniques in our journey to create economic opportunity for every member of the global workforce. Today we have a strong principled approach to how we design and run A/B tests on everything from UI designs to AI algorithms, and feature launches to bug fix

article thumbnail

The Newest FIFA World Cup Referee: Human-in-the-Loop Machine Learning

Cloudera

In case you were not aware, there’s a little event called the World Cup that’s happening right now. This World Cup has been notable for a couple reasons. The first being the timing — no summer watch party barbeques this time around, instead FIFA is breaking from tradition and running the tournament in the northern hemisphere winter months to spare the players the experience of playing soccer (Cloudera is headquartered in the US, so it is “soccer”) in temperatures exceeding 41.5°C (Cloudera is he

article thumbnail

How Can Your Company Win the Data Race? By Eliminating Its Data Blind Spots

Acceldata

If you can't see what's happening in your enterprise data environment, you can't take full advantage of your data investment. This blog explains how to eliminate data blind spots.

IT 52
article thumbnail

Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You Need to Know

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

article thumbnail

How Artificial Intelligence Will Change Mobile Apps

KDnuggets

There are numerous ways in which Artificial Intelligence (AI) will change the way we use mobile apps. As more and more users shift towards tablet computers and various mobile platforms, developers are coming up with new ideas for improving user experience. AI holds many key factors for the future of mobile app development and could indeed prove to be a game changer on almost all fronts.

126
126
article thumbnail

An AI Chat Bot Wrote This Blog Post …

DataKitchen

Query> DataOps. ChatGPT> DataOps, or data operations, is a set of practices and technologies that organizations use to improve the speed, quality, and reliability of their data analytics processes. DataOps involves collaboration between data engineers, data scientists, and IT operations teams to create a more efficient and effective data pipeline, from the collection of raw data to the delivery of insights and results.

article thumbnail

From Hunger to Hedgehogs: Clouderans Drive Impact in 2022 Through Global Volunteering Efforts

Cloudera

Clouderans in 2022 have collectively donated hundreds of hours to causes they care about around the globe. This kind of support for nonprofits is essential to their running, and to driving impact in local communities. For International Volunteer Day 2022, we are excited to celebrate Cloudera’s volunteer spotlights from 2022! . “ I believe it is important to work with people and organizations that share common values to achieve their goals.”.

Food 66
article thumbnail

Building a Rust-y Vim clutch with the Raspberry Pi 2040 by Chris Price

Scott Logic

Sadly my time working with a colleague had come to an end and I wanted to give him a token of my appreciation. In these days of hybrid working, I thought what better way to show my appreciation to an infrequent Vim user, than to add another rarely useful peripheral to their bag! Just what is a Vim clutch? In case you’re not familiar with vim itself, a very quick recap.

article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

article thumbnail

3 Free Machine Learning Courses for Beginners

KDnuggets

Begin your machine learning career with free courses by Georgia Tech, Stanford, and Fast AI.

article thumbnail

DataKitchen named: “super cool, way out there, OP, world best” DataOps vendor

DataKitchen

DataKitchen, the leading provider of DataOps solutions, has been named a Representative and “super cool, way out there, OP, world best” DataOps vendor in the December 2022 Gartner® Market Guide for DataOps Tools. December 08, 2022, 08:00 ET | Source: DataKitchen. Cambridge Mass, December 08, 2022 (BOB’S QUICKIE NEWSWIRE) — The Gartner Market Guide for DataOps Tools provides guidance on the evolving DataOps market, including market analysis, market direction, and DataOps

article thumbnail

5 Helpful Extract & Load Practices for High-Quality Raw Data

Meltano

ELT is becoming the default choice for data architectures and yet, many best practices focus primarily on “T”: the transformations. But the extract and load phase is where data quality is determined for transformation and beyond. As the saying goes, “garbage in, garbage out.” Robust EL pipelines provide the foundation for delivering accurate, timely, and error-free data.

article thumbnail

How to Configure CORS in Node.js With Express?

Workfall

Reading Time: 9 minutes Internet browsers typically deny access to unknown websites from your application programming interfaces and services. Doing this allows your server to share its resources only with clients that are on the same domain as yours and nobody else. However, there are times when you would like to relax this guard or would want to exercise more control over which websites should be allowed access to your server’s resources.

MongoDB 52
article thumbnail

Entity Resolution Checklist: What to Consider When Evaluating Options

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

article thumbnail

7 Essential Cheat Sheets for Data Engineering

KDnuggets

Learn about the data life cycle, PySpark, dbt, Kafka, BigQuery, Airflow, and Docker.

article thumbnail

Python in Finance: How Python Is Powering the Fintech Universe

Trio

The fintech industry is powered by a venerable tech stack behind the scenes. These technologies are responsible for the billions of dollars flowing into fintech companies in the past 3-4 years.

Finance 52
article thumbnail

How Fully Managed Connectors Make Apache Kafka Easier

Confluent

Building, testing, and deploying Kafka connectors require time and resources. Confluent’s fully managed connectors ensure instant, real-time data quality, consistency, and reliability.

Kafka 52
article thumbnail

Gartner Market Guide to DataOps Software

DataKitchen

We are excited that Gartner released its ‘Market Guide to DataOps’ ! The document they wrote is exceptionally close to what we see in the market and what our products do ! This document is essential because buyers look to Gartner for advice on what to do and how to buy IT software. The two things we are most excited about are: First, DataOps is distinct from all Data Analytic tools.

article thumbnail

From Developer Experience to Product Experience: How a Shared Focus Fuels Product Success

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

article thumbnail

Top Posts November 28 – December 4: The Complete Data Engineering Study Roadmap

KDnuggets

The Complete Data Engineering Study Roadmap • How to Select Rows and Columns in Pandas Using [ ],loc, iloc,at and.iat • Top 10 Data Science Myths Busted • What is Chebychev’s Theorem and How Does it Apply to Data Science? • Scikit-learn for Machine Learning Cheatsheet.

article thumbnail

7 Top React State Management Libraries

Trio

React state management is one of the biggest challenges with the React framework. And it isn’t just the users who’re affected by it. React developers need a simple and scalable state management process for designing efficient and complex user experiences.

article thumbnail

Football of the 21st Century: Are The Emerging Technologies Leaving Their Mark On The Greatest Game Of All Time?

U-Next

When Ronaldinho said, “I learned all about life with a ball at my feet,” millions of football fans across the globe felt it. Called the greatest sport of all time, football is one of the world’s most awaited, watched, and followed games. With time, the game has employed various techniques and technologies to ensure a fair game for all its players and an outstanding match for all its viewers.

article thumbnail

How Acceldata Revamped Data Observability at PhonePe at the Infrastructure Layer

Acceldata

Learn how Walmart subsidiary PhonePe adopted Acceldata’s Data Observability solution which helped them improve productivity by minimizing everyday data emergencies and data downtime.

Data 52
article thumbnail

How to Build an Experimentation Culture for Data-Driven Product Development

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating