Sat.Jun 05, 2021 - Fri.Jun 11, 2021

article thumbnail

How to Better Manage Apache Kafka by Creating Kafka Messages from within Control Center

Confluent

Managing Apache Kafka® clusters can be tricky sometimes. To solve this problem, Confluent Control Center helps you easily manage and monitor your clusters and interact with other Confluent components, such […].

Kafka 138
article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

Netflix Tech

By Alok Tiagi , Hariharan Ananthakrishnan , Ivan Porto Carrero and Keerti Lakshminarayan Netflix has developed a network observability sidecar called Flow Exporter that uses eBPF tracepoints to capture TCP flows at near real time. At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Make Sure Your Records Are Reliable With The BookKeeper Distributed Storage Layer

Data Engineering Podcast

Summary The way to build maintainable software and systems is through composition of individual pieces. By making those pieces high quality and flexible they can be used in surprising ways that the original creators couldn’t have imagined. One such component that has gone above and beyond its originally envisioned use case is BookKeeper, a distributed storage system that is optimized for durability and speed.

article thumbnail

Cloudera named a Strong Performer in The Forrester Wave™: Streaming Analytics, Q2 2021

Cloudera

Cloudera has been named as a Strong Performer in the Forrester Wave for Streaming Analytics, Q2 2021. We are excited to be recognized in this wave at, what we consider to be, such a strong position. We are proud to have been named as one of “ The 14 providers that matter most ” in streaming analytics. The report states that richness of analytics, development tool options and near-effortless scalability are what streaming analytics customers should look for in a provider. .

Kafka 101
article thumbnail

Get Better Network Graphs & Save Analysts Time

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

article thumbnail

Introducing Health+ with Confluent Platform 6.2

Confluent

For a modern, software-defined business, a platform for data in motion is critical to connecting every part of a vast digital architecture across an organization to harness the flow of […].

article thumbnail

Three Guiding Principles for Open Banking Platform Design

Teradata

Open Banking platforms require high-reliability, seamless interfaces and should be driven by efficiency. Read more.

Banking 85

More Trending

article thumbnail

What is new in Cloudera Streaming Analytics 1.4?

Cloudera

At the end of March, we released the first version of Cloudera SQL StreamBuilder as part of CSA 1.3. It enabled users to easily write, run and manage real-time SQL queries on streams from Apache Kafka with an exceptionally smooth user experience. . Since then, we have been working hard to expose the full power of Apache Flink SQL and the existing Data Warehousing tools in CDP to combine it into a state-of-the-art real-time analytics platform.

Kafka 101
article thumbnail

What Is ‘Equity As Code,’ And How Can It Eliminate AI Bias?

DataKitchen

The primary source of information about DataOps is from vendors (like DataKitchen) who sell enterprise software into the fast-growing DataOps market. There are over 70 vendors that would be happy to assist in your DataOps initiative. Here’s something you likely won’t hear from any of them (except us) – you can start your DataOps journey without buying any software.

Coding 52
article thumbnail

Connecting R&D to the Digital Thread

Teradata

With so much data being collected during the manufacturing & sales process, & augmented by connected vehicles, there are emerging opportunities for R&D teams to mine this data for new insights.

article thumbnail

Data Engineering: Perception vs. Reality

RudderStack

This article on Data Engineering: Perception vs. Reality will help you uncover various facts and trends surrounding one of the groundbreaking trends in today's market i.e. Data Engineering.

article thumbnail

Understanding User Needs and Satisfying Them

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

article thumbnail

How to use Apache Spark with CDP Operational Database Experience

Cloudera

Apache Spark is a very popular analytics engine used for large-scale data processing. It is widely used for many big data applications and use cases. CDP Operational Database Experience Experience (COD) is a CDP Public Cloud service that lets you create and manage operational database instances and it is powered by Apache HBase and Apache Phoenix. .

article thumbnail

The Game-Changing Technologies Powering the Data-Driven Enterprise in 2021 and Beyond

DataKitchen

The post The Game-Changing Technologies Powering the Data-Driven Enterprise in 2021 and Beyond first appeared on DataKitchen.

article thumbnail

Financial Crimes: Three Things You Need to Catch a Clever Criminal

Teradata

Financial crimes are here to stay. But fighting fraudsters isn’t just a matter of investing more money in analytics. Find out what your organization needs to catch a clever criminal.

52
article thumbnail

Meaningful Lead Engagement Through Product Usage Enrichment

RudderStack

This article on Meaningful Lead Engagement Through Product Usage Enrichment will highlight how placing customer usage data in the sales team’s hands unlocks their ability to have educated and well-timed conversations with potential customers.

article thumbnail

Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You Need to Know

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

article thumbnail

Cloudera Streaming Analytics 1.4: the unification of SQL batch and streaming

Cloudera

In October of 2020 Cloudera acquired Eventador and Cloudera Streaming Analytics (CSA) 1.3.0 was released early in 2021. It was the first release to incorporate SQL Stream Builder (SSB) from the acquisition, and brought rich SQL processing to the already robust Apache Flink offering. The team’s focus turned to bringing Flink Data Definition Language ( DDL) and the batch interface into SSB with that completed.

SQL 61
article thumbnail

How Master Data Management Can Help Tame the Data Governance Mayhem

DataKitchen

The post How Master Data Management Can Help Tame the Data Governance Mayhem first appeared on DataKitchen.

article thumbnail

Change Data Capture: What It Is and How to Use It

Rockset

What Is Change Data Capture? Change data capture (CDC) is the process of recognising when data has been changed in a source system so a downstream process or system can action that change. A common use case is to reflect the change in a different target system so that the data in the systems stay in sync. There are many ways to implement a change data capture system, each of which has its benefits.

IT 40
article thumbnail

Querying Federated Data Using Trino and Apache Superset

Preset

Trino unlocks new entire workflows for Apache Superset, like querying NoSQL databases (MongoDB, Cassandra, and more) and joining data from multiple but separate databases.

MongoDB 40
article thumbnail

Peak Performance: Continuous Testing & Evaluation of LLM-Based Applications

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

article thumbnail

Workforce competency key to digital transformation efforts, more possibilities available through Skillsfuture Singapore

Cloudera

A sturdy data infrastructure coupled with a proficient workforce are pillars for an organization’s digital transformation efforts. . McKinsey lists building capabilities for the workforce of the future as one of five categories of factors improving the chances of a successful digital transformation. Investing the right amount in digital talent and scaling up workforce planning and talent development could make transformation success up to three times more likely. .

Banking 58
article thumbnail

DataOps: The New Normal in Pharma

DataKitchen

Learn how four pharma companies are quickly identifying new opportunities, improving research efficiency & accelerating new product adoption with DataOps. The post DataOps: The New Normal in Pharma first appeared on DataKitchen.

52
article thumbnail

RudderStack Announces $21m Series A and Launches RSDX, the First CDP for Developers

RudderStack

Today, we are announcing RSDX: the first CDP built for developers that combine CDP's capabilities with a developer-first design.

article thumbnail

Python Chatbot Project-Learn to build a chatbot from Scratch

ProjectPro

The chatbot market is anticipated to grow at a CAGR of 23.5% reaching USD 10.5 billion by end of 2026. Facebook has over 300,000 active chatbots. According to a Uberall report, 80 % of customers have had a positive experience using a chatbot. According to IBM, organizations spend over $1.3 trillion annually to address novel customer queries and chatbots can be of great help in cutting down the cost to as much as 30%.

Python 52
article thumbnail

Entity Resolution Checklist: What to Consider When Evaluating Options

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

article thumbnail

Scaling of Uber’s API gateway

Uber Engineering

As a recap from the last article , Uber’s API Gateway provides an interface and acts as a single point of access for all of our back-end services to expose features and data to Mobile and 3rd party partners. Two … The post Scaling of Uber’s API gateway appeared first on Uber Engineering Blog.

article thumbnail

DBTA 100 2021: The Companies That Matter Most in Data

DataKitchen

The post DBTA 100 2021: The Companies That Matter Most in Data first appeared on DataKitchen.

Data 52
article thumbnail

The 4 keys to a successful manufacturing IIOT pilot

Cloudera

If you have read our previous post focusing on the challenges of planning, launching and scaling IIOT use cases , you’ve narrowed down the business problems you’re trying to solve, and you have a plan that is both created by the implementation team and supported by executive management. Here’s a plan to make sure you’ve got it all down. . Think of these success factors like the legs of a kitchen table and the results that you desire, a bowl of homemade chicken soup.

article thumbnail

Dynamic Pricing Strategy for Airlines: Exploring Current Problems and Adopting Continuous Pricing

AltexSoft

In the 1980s, American Airlines and its former president Robert Crandall started a revolution in airline pricing. Crandall is famous for many airline innovations that we use today, such as inventing the first frequent flier program and contributing to route optimization and central reservation system adoption. But he also pioneered yield management — the set of price optimization strategies that preceded revenue management.

article thumbnail

From Developer Experience to Product Experience: How a Shared Focus Fuels Product Success

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

article thumbnail

Taking A Tour Of The Google Cloud Platform For Data And Analytics

Data Engineering Podcast

Summary Google pioneered an impressive number of the architectural underpinnings of the broader big data ecosystem. Now they offer the technologies that they run internally to external users of their cloud platform. In this episode Lak Lakshmanan enumerates the variety of services that are available for building your various data processing and analytical systems.

article thumbnail

10 AI tech trends data scientists should know

DataKitchen

The post 10 AI tech trends data scientists should know first appeared on DataKitchen.

Data 52
article thumbnail

Generate Dynamic JSON Pages with Next.js

Grouparoo

Next.js is a super powerful tool for building scalable websites and web applications. Building dynamic web pages is no big thing with Next. I had a scenario pop up in which I wanted to generate and deliver JSON pages. I wanted to retrieve the data from elsewhere and then output it to a file that didn't have to change between builds. Limitations of Pages in Next.js Part of the reason Next is equal parts powerful and easy to use is a result of the opinions it brings along.

Project 52
article thumbnail

Hadoop vs Spark: Main Big Data Tools Explained

AltexSoft

Hadoop and Spark are the two most popular platforms for Big Data processing. They both enable you to deal with huge collections of data no matter its format — from Excel tables to user feedback on websites to images and video files. But which one of the celebrities should you entrust your information assets to? To come to the right decision, we need to divide this big question into several smaller ones — namely: What is Hadoop?

article thumbnail

How to Build an Experimentation Culture for Data-Driven Product Development

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating