Sat.Oct 08, 2022 - Fri.Oct 14, 2022

article thumbnail

Will Facebook / Meta do engineering layoffs?

The Pragmatic Engineer

Part of this article was originally published in The Scoop #27 , for subscribers of The Pragmatic Engineer Newsletter last week. I decided to publish this section for everyone to read after the Business Insider article claiming that 15% of Facebook employees - 12,000 people - may lose their jobs started to spread within the media. The Business Insider article was not specific to software engineers but still spread heavily within tech circles.

article thumbnail

Sparse Matrix Representation in Python

KDnuggets

Leveraging sparse matrix representations for your data when appropriate can spare you memory storage. Have a look at the reasons why, see how to create sparse matrices in with Python, and compare the memory requirements for standard and sparse representations of the same data.

Python 160
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Investing In Understanding The Customer Journey At American Express

Data Engineering Podcast

Summary For any business that wants to stay in operation, the most important thing they can do is understand their customers. American Express has invested substantial time and effort in their Customer 360 product to achieve that understanding. In this episode Purvi Shah, the VP of Enterprise Big Data Platforms at American Express, explains how they have invested in the cloud to power this visibility and the complex suite of integrations they have built and maintained across legacy and modern sy

Food 100
article thumbnail

ClearScape Analytics: Delivering Value Across the Modern Enterprise

Teradata

ClearScape Analytics provides robust functionality giving people across the organization the ability to efficiently execute their roles in the analytics process on a common platform.

Process 105
article thumbnail

From Developer Experience to Product Experience: How a Shared Focus Fuels Product Success

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

article thumbnail

AI at Scale isn’t Magic, it’s Data – Hybrid Data

Cloudera

A recent VentureBeat article , “4 AI trends: It’s all about scale in 2022 (so far),” highlighted the importance of scalability. I recommend you read the entire piece, but to me the key takeaway – AI at scale isn’t magic, it’s data – is reminiscent of the 1992 presidential election, when political consultant James Carville succinctly summarized the key to winning – “it’s the economy”.

article thumbnail

How to Build a Data Science Enablement Team: A Complete Guide

KDnuggets

A Data Science Enablement Team consists of people from various departments like marketing, sales, product development, etc. They are responsible for providing the necessary tools and resources to help the data scientists do their job more efficiently.

More Trending

article thumbnail

Generative AI Models Explained

AltexSoft

Take a look at the featured image above. Beautiful, isn’t it? The interesting thing is, it isn’t a painting drawn by some famous artist, nor is it a photo taken by a satellite. The image you see has been generated with the help of Midjourney — a proprietary artificial intelligence program that creates pictures from textual descriptions. Neural nets can create images, video, and audio content that not every person can.

article thumbnail

Why a Cookieless Identity Solution is Critical to Future Advertising

Teradata

Implementing a cookieless identity solution will help businesses maintain advertising efforts amid the phaseout of third-party cookies.

98
article thumbnail

The Complete Free PyTorch Course for Deep Learning

KDnuggets

Do you want to learn PyTorch for machine learning and deep learning? Check out this 24 hour long video course with accompanying notes and courseware for free. Did I mention it's free?

article thumbnail

How Product Teams Can Build Empathy Through Experimentation

Netflix Tech

A conversation between Travis Brooks, Netflix Product Manager for Experimentation Platform, and George Khachatryan, OfferFit CEO Note: I’ve known George for a little while now, and as we’ve talked a lot about the philosophy of experimentation, he kindly invited me to their office (virtually) for their virtual speaker series. We had a fun conversation with his team, and we realized that some parts of it might make a good blog post as well.

article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

article thumbnail

Podcast: Scaling DataOps

DataKitchen

The post Podcast: Scaling DataOps first appeared on DataKitchen.

98
article thumbnail

The Relationship Between Product Manager and UX Designer!

U-Next

Introduction . The Product Manager is the visionary and leader of the product, who leads a team of designers, engineers, and other stakeholders to build a great product interaction design. It is estimated that companies could increase their profits by more than 34 percent when their Product Manager is “fully optimized.” . The role of a Product Manager goes beyond simply managing requirements and specifications.

article thumbnail

10 Cheat Sheets You Need To Ace Data Science Interview

KDnuggets

The only cheat you need for a job interview and data professional life. It includes SQL, web scraping, statistics, data wrangling and visualization, business intelligence, machine learning, deep learning, NLP, and super cheat sheets.

article thumbnail

7 Practical Ways to Cut Snowflake Compute Cost

Rockset

The climate changed and everyone quickly noticed how expensive Snowflake is. How Snowflake fails - Benn Stancil Why is Snowflake so expensive - Stas Sajin Snowflake performance challenges - Slim Baltagi Ok, so Snowflake is expensive. But what do I do about it? Avoid frequent updates Optimize for cost-per-query with apps running 24x7 Tune slow queries Reduce auto-suspend to 1 or 2 minutes Build Snowflake chargeback dashboards Try third-party cost analyzers Set resource monitors and spend threshol

MongoDB 52
article thumbnail

How to Build an Experimentation Culture for Data-Driven Product Development

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

article thumbnail

Picnic Open-sources Error Prone Support

Picnic Engineering

We’re excited to announce that Picnic’s Error Prone Support project is now open-source! Last week, we already shared an in-depth overview of how Picnic has adopted Google’s Error Prone static analysis tool for Java code. In short, it allows us to: Improve the consistency and quality of our Java codebases. Introduce custom checks for code (anti-)patterns we value.

Java 52
article thumbnail

Why Upgrade to dbt Cloud over dbt Core?

phData: Data Engineering

So you’ve heard all the talk around dbt , but now you’re working to determine if you should go with dbt Core or dbt Cloud and you’re wanting to know what advantages dbt Cloud has over the free dbt Core offering. Upon a quick trial and look at dbt Cloud, the primary things you might notice are the IDE as well as the ease of managing deployments. However, dbt Cloud offers you much more than that.

Cloud 52
article thumbnail

Data Representation for Natural Language Processing Tasks

KDnuggets

In NLP we must find a way to represent our data (a series of texts) to our systems (e.g. a text classifier). As Yoav Goldberg asks, "How can we encode such categorical data in a way which is amenable for us by a statistical classifier?" Enter the word vector.

Process 157
article thumbnail

Making Data Intelligent with Microsoft

Striim

I am excited to share with you that Striim is a proud participant in the Microsoft Intelligent Data Platform partner ecosystem as announced at Microsoft Ignite 2022. We have a history of working with Microsoft to help provide our mutual customers with access to enhanced data insights in real time, allowing them to make decisions the moment data is created.

BI 52
article thumbnail

Entity Resolution Checklist: What to Consider When Evaluating Options

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

article thumbnail

Shift-Left iOS Testing with Focus Flows

Lyft Engineering

Pain Points of Traditional Automated UI Tests Creating a great modern-day software product requires a shift-left approach to testing by ensuring faster, more frequent, and earlier testing. Shift-left testing is an approach to software testing and system testing in which testing is performed earlier in the lifecycle (i.e., moved left on the project timeline).

article thumbnail

My Summer as a Software Engineering Intern at Pinterest Toronto!

Pinterest Engineering

Khubi Shah | (former) Software Engineer Intern, Shopping Content Mining This summer, I had the incredible opportunity to intern at the one and only Pinterest from the new engineering hub in Toronto! I am a final year undergraduate student from the University of Waterloo, majoring in Computer Science with an AI specialization. Growing up, Pinterest was always my go-to social media platform, as it inspired me with new ideas for food, fashion, design, or anything creative!

article thumbnail

A Beginner’s Guide to Web Scraping Using Python

KDnuggets

This article serves as a beginner’s guide to web scraping using Python and looks at the different frameworks and methods you can use, outlined in simple terms.

Python 160
article thumbnail

Map and Monitor Your Data Journey

DataKitchen

Can you draw a map of all the paths data takes from source systems to production insight delivery? How many tools, technologies, configurations, and paths do your data take during its production process? What is the ‘run-time lineage’ of data in your organization? The post Map and Monitor Your Data Journey first appeared on DataKitchen.

Data 52
article thumbnail

The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Communication

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

article thumbnail

A Guide To IDS And Its Tools To Optimize Cybersecurity In 2023

U-Next

The work on IDS or Intrusion Detection System was done during the years 1984 and 1986. Dorothy Denning and Peter Neumann created the Intrusion Detection Expert System with the initial iteration of the IDS (IDES). IDS is a term used to describe a method that may recognize or detect the existence of invasive activity. . In a larger sense, this refers to all the procedures used to identify the unlawful computer or network usage.

IT 52
article thumbnail

Install and Run Containers on Linux Virtual Machines – LXD/LXC

WeCloudData

Objectives This tutorial is one part of a containers series of tutorials that will walk the reader through installation of tools that can run applications in containers. By the end of these tutorials the reader will be able to Install services (container engines) that can run containers using tools such as LXD/LXC, Docker, or Podman. […] The post Install and Run Containers on Linux Virtual Machines – LXD/LXC appeared first on WeCloudData.

article thumbnail

Mathematics for Machine Learning: The Free eBook

KDnuggets

Check out this free ebook covering the fundamentals of mathematics for machine learning, as well as its companion website of exercises and Jupyter notebooks.

article thumbnail

Why Data Cleaning is Failing Your ML Models – And What To Do About It

Monte Carlo

Precise endeavors must be done to exacting standards in clean environments. Surgeons scrub in, rocket scientists work in clean rooms, and data scientists…well we try our best. We’ve all heard the platitude, “garbage in, garbage out,” so we spend most of our time doing the most tedious part of the job: data cleaning. Unfortunately, no matter how hard we scrub, poor data quality is often too pervasive and invasive for a quick shower.

IT 52
article thumbnail

Reimagined: Building Products with Generative AI

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

article thumbnail

Data Engineering Annotated Monthly – September 2022

Big Data Tools

It’s been a very bustling two months in Berlin. Indeed, it’s been so busy that I had to skip the digests. I am now delighted to have the privilege of returning to the task of collecting for you the most exciting news from the world of data engineering. Greetings from sunny Berlin! I’m Pasha Finkelshteyn , and I’ll be your guide through this month’s news.

article thumbnail

When should we automate? by Tom Gilbert

Scott Logic

A look at how building an automated regression test suite in the early days of a project will provide benefits further down the line. What is regression testing? Regression testing is a type of testing that is done to ensure that changes to the code, in the form of new features, bug fixes or enhancements, do not have a negative impact on the existing functionality of the application.

Coding 52
article thumbnail

3 Simple Ways to Speed Up Your Python Code

KDnuggets

The post explains three popular frameworks, PySpark, Dask, and Ray, and discusses various factors to select the most appropriate one for your project.

Coding 145
article thumbnail

Machine Learning Engineers & Operations: Where DevOps Meet Data Science

Elder Research

The post Machine Learning Engineers & Operations: Where DevOps Meet Data Science appeared first on Elder Research.

article thumbnail

The Big Payoff of Application Analytics

Outdated or absent analytics won’t cut it in today’s data-driven applications – not for your end users, your development team, or your business. That’s what drove the five companies in this e-book to change their approach to analytics. Download this e-book to learn about the unique problems each company faced and how they achieved huge returns beyond expectation by embedding analytics into applications.