Azure Data Engineering

NOVEMBER 15, 2021

In one of the previous posts, we discussed how we can use Validation activity to design the Pipeline to wait for a scheduled time and retry. There is another way to introduce a delay in the Pipeline. Wait activity can be used to pause the execution of the Pipeline for a fixed amount of time. Sometimes, we come across scenarios where we would like the execution for the Pipeline to be Paused for some time but not cancelled.

Data 130

Data Designing 130

KDnuggets

NOVEMBER 19, 2021

The terms ‘data science’ and ‘machine learning’ are often used interchangeably. But while they are related, there are some glaring differences, so let’s take a look at the differences between the two disciplines, specifically as it relates to programming.

Machine Learning 160

Machine Learning Data Science Coding Programming 160

Cloudera

NOVEMBER 19, 2021

We are excited by the endless possibilities of machine learning (ML). We recognise that experimentation is an important component of any enterprise machine learning practice. But, we also know that experimentation alone doesn’t yield business value. Organizations need to usher their ML models out of the lab (i.e., the proof-of-concept phase) and into deployment, which is otherwise known as being “in production”. .

Machine Learning 120

Machine Learning IT Project Data Engineering 120

Confluent

NOVEMBER 19, 2021

Imagine that you have real-time data about what’s happening in the stock market, and you want to support a large number of customized dashboards displaying the data as it comes […].

SQL 104

SQL IT Data Process 104

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

AltexSoft

NOVEMBER 17, 2021

If you’ve ever been to a bookstore, you probably know the dilemma of the book location. Say you’re looking for “Atlas Shrugged”, and you know it’s a mix of science fiction, mystery, and romance genres. Now, which bookshelf will you go for to find it? Should it be on the science fiction or on the romance shelf? The problem of document classification pertains to the library, information, and computer sciences.

Machine Learning 75

Machine Learning Insurance Medical Healthcare 75

KDnuggets

NOVEMBER 18, 2021

Natural language processing research and applications are moving forward rapidly. Several trends have emerged on this progress, and point to a future of more exciting possibilities and interesting opportunities in the field.

Process 160

Process 160

Confluent

NOVEMBER 16, 2021

Some call it a challenge. Others call it a community. Whatever you call it, 100 Days Of Code is a bunch of fun and a great learning experience that helps […].

Coding 102

Coding Kafka IT 102

Teradata

NOVEMBER 14, 2021

As we emerge form months of lockdowns and pandemic restrictions it is increasingly clear that today’s retail world is a world of online AND brick & mortar shopping, not And/or.

Retail 52

Retail IT 52

KDnuggets

NOVEMBER 16, 2021

The field of computer vision has seen the development of very powerful applications leveraging machine learning. These projects will introduce you to these techniques and guide you to more advanced practice to gain a deeper appreciation for the sophistication now available.

Project 159

Project Machine Learning 159

Cloudera

NOVEMBER 15, 2021

The word “data” is ubiquitous in narratives of the modern world. And data, the thing itself, is vital to the functioning of that world. This blog discusses quantifications, types, and implications of data. If you’ve ever wondered how much data there is in the world, what types there are and what that means for AI and businesses, then keep reading! Quantifications of data.

Unstructured Data 86

Unstructured Data Pipeline-centric Database-centric Entertainment 86

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

Confluent

NOVEMBER 18, 2021

We’re pleased to announce ksqlDB 0.22.0! This release includes source streams and source tables as well as improved pull query (for key-range predicates) and push query performance. All of these […].

Process 78

Process 78

Teradata

NOVEMBER 17, 2021

Many Teradata customers are interested in integrating Vantage with Microsoft Azure first party services. This guide will help you connect Teradata QueryGrid to Azure HDInsight.

52

52

KDnuggets

NOVEMBER 17, 2021

We describe types of recommender systems, more specifically, algorithms and methods for content-based systems, collaborative filtering, and hybrid systems.

Systems 160

Systems Algorithm Engineering 160

DataKitchen

NOVEMBER 19, 2021

Learn how a DataOps Process Hub enables Business Analysts to rapidly answer stakeholders' analytic questions without waiting on the centralized IT Team. The post Solve the Analytics Last-Mile Problem with a DataOps Process Hub first appeared on DataKitchen.

Process 52

Process Business Analyst IT 52

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

ProjectPro

NOVEMBER 17, 2021

Emotions are essential, not only in personal life but in business as well. How your customers and target audience feel about your products or brand provides you with the context necessary to evaluate and improve the product, business, marketing, and communications strategy. Sentiment analysis or opinion mining helps researchers and companies extract insights from user-generated social media and web content.

Coding 52

Coding Project Entertainment Datasets 52

Grouparoo

NOVEMBER 15, 2021

Application Programming Interfaces or APIs are an integral part of modern software development and enable a wide variety of applications and workflows. Enterprises are becoming increasingly reliant on APIs to effectively connect with partners and customers. APIs come in an array of types and protocols that work great in different scenarios. In this article, we’ll examine the different types of APIs used in software development today.

Architecture 52

Architecture Database Java Designing 52

KDnuggets

NOVEMBER 19, 2021

Can artificial intelligence be rid of bias? This is an important question, and it’s equally important that we look in the right place for the answer.

160

160

dbt Developer Hub

NOVEMBER 14, 2021

Hi there, Before I get to the goods, I just wanted to quickly flag that Coalesce is less than 3 weeks away! ? If you had to choose just ONE of the 60+ sessions on tap, consider Tristan's keynote with A16z's Martin Casado. It has two of my favorite elements: 1) Spice ?️ 2) Not-actually-about-us ? Martin and Tristan will discuss something we've all probably considered with the latest wave of innovation (and funding) in our space: Is the modern data stack just another wave in a long string of trend

Cloud 52

Cloud Engineering Project Data Engineering 52

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

Preset

NOVEMBER 15, 2021

This post showcases how we at Preset achieve zero downtime web application deployment using Kubernetes (AWS EKS) with zero failed requests.

AWS 52

AWS 52

RudderStack

NOVEMBER 16, 2021

Announcing RudderStack’s new Have a Very Data Holiday Promo because, at RudderStack, we want more people to see that real-time event streaming can be painless.

Data 40

Data 40

KDnuggets

NOVEMBER 17, 2021

Faker is a Python library that generates fake data to supplement or take the place of real world data. See how it can be used for data science.

Python 159

Python Data Science Data IT 159

dbt Developer Hub

NOVEMBER 14, 2021

It is a thankless but necessary task. In SQL, often we’ll need to UNION ALL two or more tables vertically, to combine their values. Say we need to combine 3 tables: web traffic, ad spend and sales data, to form a full picture of cost per acquisition (CPA). Ultimately, we’d want to roll up data at a granularity of date, landing page URL, campaign and channel—so however we combine the 3 tables, we’ll want to wrap it in an outer query with a GROUP BY to reduce the grain.

SQL 52

SQL Software Engineer Software Engineering Coding 52

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building

DataKitchen

NOVEMBER 18, 2021

For several years now, the elephant in the room has been that data and analytics projects are failing. Gartner estimated that 85% of big data projects fail. Data from New Vantage partners showed that the number of data-driven organizations has actually declined to 24% from 37% several years ago and that only 29% of organizations are achieving transformational outcomes from their data. .

Data Engineering 98

Data Engineering Data Engineer Engineering Government 98

ProjectPro

NOVEMBER 18, 2021

Data science has been a trending buzzword in recent times. With wide applications in various sectors like healthcare, education, retail, transportation, media, and banking -data science applications are at the core of pretty much every industry out there. The possibilities are endless: analysis of frauds in the finance sector or the personalization of recommendations on eCommerce businesses.

Data Science 52

Data Science Project Food Pharmaceutical 52

KDnuggets

NOVEMBER 18, 2021

This is the guide on how to build a serverless data pipeline on AWS with a Machine Learning model deployed as a Sagemaker endpoint.

Data Pipeline 157

Data Pipeline AWS Building Cloud 157

dbt Developer Hub

NOVEMBER 14, 2021

I’ve used the dateadd SQL function thousands of times. I’ve googled the syntax of the dateadd SQL function all of those times except one, when I decided to hit the "are you feeling lucky" button and go for it. In switching between SQL dialects (BigQuery, Postgres and Snowflake are my primaries), I can literally never remember the argument order (or exact function name) of dateadd.

Data Warehouse 52

Data Warehouse SQL Software Engineer Software Engineering 52

Speaker: David Bard, Principal at VP Product Coaching

In the fast-paced world of digital innovation, success is often accompanied by a multitude of challenges - like the pitfalls lurking at every turn, threatening to derail the most promising projects. But fret not, this webinar is your key to effective product development! Join us for an enlightening session to empower you to lead your team to greater heights.

Certification

Cloudera

NOVEMBER 17, 2021

It’s no secret that Data Scientists have a difficult job. It feels like a lifetime ago that everyone was talking about data science as the sexiest job of the 21st century. Heck, it was so long ago that people were still meeting in person! Today, the sexy is starting to lose its shine. There’s recognition that it’s nearly impossible to find the unicorn data scientist that was the apple of every CEO’s eye in 2012.

Machine Learning 122

Machine Learning Algorithm Data Science Retail 122

Netflix Tech

NOVEMBER 15, 2021

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , Michael Lindon , and Colin McFarland This is the fifth post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. Need to catch up? Have a look at Part 1 (Decision Making at Netflix), Part 2 (What is an A/B Test?), Part 3 (False positives and statistical significance), and Part 4 (False negatives and power).

Building 81

Building Utilities Designing Coding 81

KDnuggets

NOVEMBER 17, 2021

With the customer at its heart, modern augmented BI platforms no longer require scripting/coding skills or the knowledge to build the back-end data models, empowering even laymen to harness the power of raw data. As a user, here are the top AI capabilities that you need to look for in BI software.

BI 125

BI Raw Data Coding Skills Coding 125

Data Engineering Podcast

NOVEMBER 14, 2021

Summary The most important gauge of success for a data platform is the level of trust in the accuracy of the information that it provides. In order to build and maintain that trust it is necessary to invest in defining, monitoring, and enforcing data quality metrics. In this episode Michael Harper advocates for proactive data quality and starting with the source, rather than being reactive and having to work backwards from when a problem is found.

Data Warehouse 100

Data Warehouse BI Data Workflow Data 100

Advertisement

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

Building