Sat.Jan 23, 2021 - Fri.Jan 29, 2021

article thumbnail

Why do you need Agile Software Development for your Data Use Case ?

François Nguyen

The agile part of DataOps In this previous article, we have defined dataops as a”combination of tools and methods inspired by Agile, Devops and Lean Manufacturing » (thanks to DataKitchen for this definition). Let’s focus on the agile part and why it is so relevant for your data use cases. “Data is like a box of chocolates, you never know what you’re gonna get.” It is about the nature of data : you cannot guess what will be the content and the quality of your data sources

article thumbnail

Confluent and Microsoft Announce Strategic Alliance

Confluent

Today, I am thrilled to announce a new strategic alliance with Microsoft to enable a seamless, integrated experience between Confluent Cloud and the Azure platform. This represents a significant milestone […].

Cloud 136
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Making It Easier To Stick B2B Data Integration Pipelines Together With Hotglue

Data Engineering Podcast

Summary Businesses often need to be able to ingest data from their customers in order to power the services that they provide. For each new source that they need to integrate with it is another custom set of ETL tasks that they need to maintain. In order to reduce the friction involved in supporting new data transformations David Molot and Hassan Syyid built the Hotlue platform.

article thumbnail

Cloudera Completes SOC 2 Type II Certification for CDP Public Cloud

Cloudera

We believe security is the cornerstone of any legitimate data platform, and we’re excited to announce that Cloudera has successfully achieved SOC 2 Type II certification for Cloudera Data Platform (CDP) Public Cloud. Achieving our SOC 2 certification is the culmination of significant work across our organization and demonstrates to independent auditors that we adhere to industry-standard security controls and processes.

article thumbnail

From Developer Experience to Product Experience: How a Shared Focus Fuels Product Success

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

article thumbnail

The very strange way of doing Data Quality at Airbnb

François Nguyen

or why you should have a look at Data Observability ! This article is the second part on how Airbnb is managing data quality : “Part 2 — A New Gold Standard” The first part can be found here and it was just good principles about roles and responsabilities. The second part is really how they do it and all the steps to have a “certification” They name it Midas, the famous king who can turn everything into gold ( with a not so good ending ).

Finance 130
article thumbnail

Apache Kafka Meets Table Football

Confluent

What happens when you let engineers go wild building an application to track the score of a table football game? This blog post shares SPOUD’s story of engineering a simple […].

Kafka 114

More Trending

article thumbnail

#ClouderaLife Spotlight: Shane Prendergast, HR Services Manager, EMEA

Cloudera

Shane Prendergast represents so much of what Cloudera values. . He is described as someone who is passionate about and drives Diversity, Equality, and Inclusion (DEI) efforts and helps the company stay aware of events and initiatives. “Flying the flag for the LBGTQ community both in and outside of work, inclusiveness is part of Shane’s DNA and he is relentless in his efforts to make everyone feel involved and heard.” said one peer. .

article thumbnail

Big Data in Retail & CPG Requires a Scalpel, Not an Axe

Teradata

To satisfy the evolving demands of customers, Chief Commercial Officers need to wield big data in Retail & CPG using a precise scalpel rather than a blunt axe.

Retail 98
article thumbnail

How Apache Kafka Enables Podium to “Ship It and See What Happens”

Confluent

This a summary of Podium’s technological journey and an example of how our engineering team is tooling ourselves to scale well into the years to come. Here at Podium, we’re […].

Kafka 65
article thumbnail

Don’t Forget Your VPNs and Tracker Blockers

Grouparoo

I was testing the new Intercom plugin that our team had built, and ran into a strange snag. When adding apps to Grouparoo, we have this handy “Test Connection” button that checks to make sure the connection details and credentials work. When I was testing this new Intercom plugin, something strange appeared this time around. I was testing locally, but the Test Connection button actually talks to an external API, so I was confused that the connection failed due to something from localhost.

Cloud 52
article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

article thumbnail

Migrating Apache NiFi Flows from HDF to CFM with Zero Downtime

Cloudera

Has your organization considered upgrading from Hortonworks Data Flow (HDF) to Cloudera Flow Management (CFM) , but thought the migration process would be too disruptive to your mission critical dataflows? In truth, many NiFi dataflows can be migrated from HDF to CFM quickly and easily with no data loss and without any service interruption. Here we explore three common use cases where a CFM cluster can assume an HDF cluster’s dataflows with minimal to no downtime.

Kafka 82
article thumbnail

Six Crucial Refinements to Conventional Wisdom About Data Strategy

Teradata

This post shines a spotlight on the difference between what you already know & the more specific guidance you really need to create a successful data strategy.

Data 80
article thumbnail

PowerBI and Quickbooks PowerQuery Fix

FreshBI

Quick Books Power BI connector not working? Because of security requirements, Quick Books has discontinued use of their online connector for several browsers including Internet Explorer. The problem with the Power BI connector is that Power BI uses Internet Explorer to authenticate its webservices. With discontinued support for this browser, Power BI can no longer authenticate the Quick Books connection.

BI 52
article thumbnail

[VIDEO] How Blinkist Increases Marketing ROI with Data Observability and Monte Carlo

Monte Carlo

Talk to us! For Blinkist , a global book insights subscription service, broken data pipelines led to unreliable marketing spend, costly data fire drills, and loss of executive trust. When COVID-19 hit, they realized the growth of their company was being hindered by bad data. They needed a way to automatically identify, resolve, and prevent data quality issues before they affected the business – in other words, they needed data observability.

article thumbnail

How to Build an Experimentation Culture for Data-Driven Product Development

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

article thumbnail

Cloudera Flow Management Continuous Delivery Architecture

Cloudera

Having introduced the flow delivery challenges and corresponding resolutions in the first article ‘ Cloudera Flow Management Continuous Delivery while Minimizing Downtime ’, we will combine all the preceding solutions into an example of flow management continuous delivery architecture. DataFlow Continuous Delivery Architecture. In the whole process, we can see the following steps. 1.Development.

article thumbnail

Modeling the Risk of COVID-19 for Effective Pandemic Response

Teradata

Teradata experts propose a risk model to quantify the risk of infection and vulnerability for COVID-19 using individual-level demographic and behavioral data.

Data 52
article thumbnail

Benefits Of Overhauling NRM | Net Revenue Management | Retail Insight

Retail Insight

For CPGs, the COVID-19 crisis has made one thing abundantly clear: to stay ahead, you have got to remain agile. Pressure on margins is growing as the pandemic causes dramatic shifts in consumer habits and retailer operations. If you cannot identify how and where to invest quickly, you will be at a significant disadvantage. That is why savvy CPGs have been adapting and evolving their net revenue management (NRM).

Retail 52
article thumbnail

How To Convert 100% of Your Proofs of Concept into Happy Customers

Monte Carlo

I’ve never done Sales before. Most of my professional history was spent working for a Customer Success company, Gainsight, where I provided the data, insights, and tools for our customer-facing teams. At Gainsight, my bonus was tied to 1) verified customer outcomes, 2) renewal rate, and 3) customer advocacy. I learned to be maniacally customer-focused.

BI 52
article thumbnail

Entity Resolution Checklist: What to Consider When Evaluating Options

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

article thumbnail

Industry X.0 – Made Real, Practical Insights Today enabling Profits Tomorrow

Cloudera

Manufacturing’s digital transformation growth is truly impressive considering it’s delivering value with explosive growth rates. Consider that Manufacturing’s Industry Internet of Things (IIOT) was valued at $161b with an impressive 25% growth rate, or that the Connected Car market will be valued at $225b by 2027 with a 17% growth rate. But then conflicting information arrives as VentureBeat reports that around 90 percent of machine learning models never make it into production?