Data Engineering Podcast

MARCH 27, 2022

Summary Data governance is a practice that requires a high degree of flexibility and collaboration at the organizational and technical levels. The growing prominence of cloud and hybrid environments in data management adds additional stress to an already complex endeavor. Privacera is an enterprise grade solution for cloud and hybrid data governance built on top of the robust and battle tested Apache Ranger project.

Data Governance 130

Data Governance Government Cloud Building 130

KDnuggets

MARCH 31, 2022

Let's revisit the automated machine learning project TPOT, and get back up to speed on using open source AutoML tools on our way to building a fully-automated prediction pipeline.

Machine Learning 156

Machine Learning Project Building 156

Jesse Anderson

MARCH 30, 2022

Data Teams are like Role Playing Games (RPG). If you’re not familiar with RPGs, there is a person or group of characters all working together for a common goal. A crucial part of the individual characters are their levels, skills, and stats. In many games, higher levels are required to unlock specific skills. Likewise, stats show how well a character can utilize their skills.

Coding Skills 100

Coding Skills Big Data Machine Learning Data 100

Cloudera

MARCH 30, 2022

Sometimes it takes a billion-dollar mistake to bring the murkier side of data ethics into sharp focus. Equifax found this out to their own cost in 2017 when they failed to protect the data of almost 150 million users globally. The catastrophic breach was bad enough on its own — but Equifax waited three months to go public with the news. As the public furore rose to a crescendo, the credit organization dragged its feet on disclosing exactly what kind of information had been leaked.

Data 119

Data Government Process Designing 119

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

Teradata

MARCH 31, 2022

In honor of Women's History Month, we are spotlighting Molly Treese, Teradata's Chief Legal Officer, as she looks back at her career in law & recounts the importance of inclusion in the workplace.

98

98

KDnuggets

MARCH 28, 2022

Let me walk you through the top 13 data science skills that you should have to become a successful data scientist. Following this outline, you’ll have a great path of digestible steps to educate yourself and be prepared to apply for data scientist positions.

Education 141

Education Data Science Data 141

Cloudera

MARCH 29, 2022

State and local governments generate and store enormous amounts of data essential to their ability to deliver citizen services. But how can they capitalize on all of their data to become engines of growth and innovation, empowering and enhancing their ability to provide services and better serve their communities? Data doesn’t arrive on the doorsteps of government offices as a neatly packaged asset.

Government 96

Government Cloud Cloud Computing Data Science 96

Teradata

MARCH 29, 2022

Consumers expect personalized experiences when they interact with a brand. But organizations are losing the ability to listen to their customers via digital channels. Fixing this is critical.

98

98

KDnuggets

MARCH 30, 2022

Create a data science learning path with courses from the world’s most prestigious university.

Data Science 160

Data Science Data 160

Confluent

MARCH 28, 2022

When Sanjana Kaundinya chose Confluent for her first job out of college, she was eager to learn as much as possible—and in the two years since, that’s exactly what she’s […].

Software Engineer 52

Software Engineer Software Engineering Engineering 52

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

Monte Carlo

APRIL 1, 2022

Today, on April 1st , Monte Carlo announced the release of Data Observability Small Batch, a next-generation platform for locally-sourced, small-batch data. The solution was painstakingly crafted by artisan developers to serve a new wave of data engineers who are nostalgic for data platforms the way they used to be. “The world is tired of over-processed data, mass-marketed to them in over-hyped dashboards,” says Barr Moses, CEO, Monte Carlo.

Metadata 52

Metadata Data Engineering Data Engineer Data 52

U-Next

MARCH 31, 2022

Let’s face it! Product Management CAN BE TOUGH, but only if you haven’t laid your hands on the best training experience for Product enthusiasts in all its glory: the PG Certificate Program in Product Management by IIM Indore & Jigsaw. Several present-day Product Experts started their journeys with this exclusive 6-month program & found multiple doors of opportunities, wide open to welcome them.

Programming 52

Programming Management Certification Designing 52

KDnuggets

MARCH 31, 2022

The most ambitious Enterprise MLOps conference is coming to New York City on May 5-6, bringing the data science community together in-person for a one-of-a-kind event. This year, you’ll hear from 30+ speakers across dozens of industries. Save 50% with the promo code KDN. Register now!

Data Science 110

Data Science Coding Data 110

A Cloud Guru: Data Engineering

MARCH 30, 2022

Considering your options when it comes to Google Cloud (GCP) certification paths? This post will talk about the various GCP cloud certifications, what each cert covers, what it could mean for your career, and how you can set (and achieve) your own personal goals. Accelerate your career Get started with ACG and transform your career with […] The post Which Google Cloud certification is best for me?

Google Cloud 52

Google Cloud Certification Cloud IT 52

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

Monte Carlo

MARCH 30, 2022

Say it with me: your data will never be perfect. Any team striving for completely accurate data will be sorely disappointed. Data testing , anomaly detection, and cataloging are important steps, but technology alone will not solve your data quality problem. Like any entropic system, data breaks. And as we’ve learned building solutions to curb the causes and downstream impact of data issues, it happens more often than you think.

Data Warehouse 52

Data Warehouse Data Machine Learning Data Engineering 52

U-Next

MARCH 31, 2022

With the onset of the 5th industrial revolution, the world is moving closer towards embracing newer technologies in almost every walk of life. In the business ecosphere, those who upskill & transform into the best professionals versions of themselves are bound to be at the forefront of this revolution. The Sales domain, too, cannot be home to traditional sales methods for too long.

Programming 52

Programming Management Certification Education 52

KDnuggets

MARCH 31, 2022

What if I tell you that there is a bug that can take you on a ride in the world of data science. Yes, if you have the bug of curiosity, consider yourself the best fit for the data science profession.

Data Science 108

Data Science Data 108

Booking.com Engineering

MARCH 30, 2022

Introduction We are going to review the subtleties and complications of trying to compare objects for equality in Java, where the problem originates, why it is important, Kotlin’s approach on the problem and some recommendations on the topic. Determining if two entities are the same is a fundamental operation in mathematics and we implement this operation in programming by the weaker notion of equivalency; the difference being that we are content with equality across a specific subset of propert

Java 52

Java Coding Designing IT 52

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

AltexSoft

MARCH 28, 2022

Vacation and short-term rentals are experiencing a post-COVID renaissance. The data clearly shows the stable, worldwide increase in demand for alternative accommodations, from apartments to farm stays to igloos. The data also indicates that more and more companies in the sector tie their bright future with… data. According to the Global Vacation Rental Report 2022 , 40 percent of property managers rely on market business intelligence (BI) or analytics services, a big leap compared to just 13 per

Hospitality 52

Hospitality Business Intelligence Datasets Machine Learning 52

Elder Research

MARCH 28, 2022

The post Previewing the MYOB Podcast appeared first on Elder Research.

52

52

KDnuggets

MARCH 29, 2022

In this blog you will see how the authors took a raw.ipynb notebook that does time series forecasting with Arima, modularized it into a Ploomber pipeline, and ran parallel jobs on Slurm.

Python 108

Python IT Machine Learning 108

DataKitchen

APRIL 1, 2022

Data 52

Data 52

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building

Data Engineering Podcast

MARCH 27, 2022

Summary At the foundational layer many databases and data processing engines rely on key/value storage for managing the layout of information on the disk. RocksDB is one of the most popular choices for this component and has been incorporated into popular systems such as ksqlDB. As these systems are scaled to larger volumes of data and higher throughputs the RocksDB engine can become a bottleneck for performance.

Relational Database 100

Relational Database Database SQL Data Warehouse 100

Elder Research

APRIL 1, 2022

The post Get with the Times appeared first on Elder Research.

52

52

KDnuggets

MARCH 29, 2022

The 100 page book on stochastic processes. Published in 2022. This off-the-beaten-path machine learning tutorial is designed for busy professionals, researchers and students eager to learn and apply methods ranging from simple to advanced, in a minimum amount of time. Offered with data sets, source code, videos, spreadsheets and solved exercises.

Machine Learning 101

Machine Learning Process Coding Designing 101

DareData

MARCH 30, 2022

Many times, a data developer is constrained by the data they were given. In Data Science / Engineering projects, it is not unusual that extra data is added from other sources - even ones that are outside of the organization. But extra data can be available in non-standard ways, that require new processing techniques. For example, when it comes to geographical data many governments provide open spatial data about their territory.

Process 52

Process IT Hospitality Data 52

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

Certification

Rockset

MARCH 31, 2022

I’ve been working as a data and software engineer for more than 20 years. Not long after I joined my current employer Sounding Board , I had to normalize nested JSON arrays in a complex document schema so that I could join the child records to other collections and then denormalize data into a single result set — and I had to do it fast. On top of that, I had to make that data available to our custom-built application via a secure RESTful endpoint with a less than one second response time.

MongoDB 52

MongoDB Data Architect Data Schemas SQL 52

Monte Carlo

MARCH 29, 2022

You may not have heard the term data downtime, but I’m willing to bet you’ve experienced it and the cost of bad data firsthand. Urgent ping from your CEO about “missing data” in a critical report? Duplicate tables wreaking havoc in your Snowflake warehouse, all titled some variation of “Mikes_Table_GOOD-V3.”? Or, perhaps you’ve unintentionally made a decision based on bad data from last year’s forecasts?

Media 52

Media Google Cloud Data Engineering Data Engineer 52

KDnuggets

MARCH 31, 2022

A loss function measures how wrong the model is in terms of its ability to estimate the relationship between x and y. Find out about several common loss functions here.

IT 103

IT Machine Learning 103

KDnuggets

MARCH 30, 2022

Let’s take a quick look at some of the key highlights and insights from a recent webinar, Accelerating Distributed AI Applications , with Ziad Asghar, Vice President, Product Management, Qualcomm Technologies, Inc. and resources that developers can use to build distributed AI solutions today.

Technology 97

Technology Building Management 97

Advertisement

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

Building