Team Data Science

AUGUST 26, 2020

There are a huge number of tools and platforms for data engineers. It's this enormous selection that makes it difficult for newcomers to filter out the really important tools. In the course of the Data Engineer Coaching I was able to gain important experience in this regard and would like to tell you the most important tools on this basis today! During the coaching sessions I saw that a lot of tools keep coming up all the time: Kafka, Spark and AWS.

Data Engineering 130

Data Engineering Data Engineer Engineering AWS 130

Netflix Tech

AUGUST 28, 2020

by Aditya Mavlankar , Liwei Guo , Anush Moorthy and Anne Aaron Netflix has an ever-expanding collection of titles which customers can enjoy in 4K resolution with a suitable device and subscription plan. Netflix creates premium bitstreams for those titles in addition to the catalog-wide 8-bit stream profiles¹. Premium features comprise a title-dependent combination of 10-bit bit-depth, 4K resolution, high frame rate (HFR) and high dynamic range (HDR) and pave the way for an extraordinary viewing

Media 132

Media Algorithm Data Science Engineering 132

Data Engineering Podcast

AUGUST 24, 2020

Summary In order to scale the use of data across an organization there are a number of challenges related to discovery, governance, and integration that need to be solved. The key to those solutions is a robust and flexible metadata management system. LinkedIn has gone through several iterations on the most maintainable and scalable approach to metadata, leading them to their current work on DataHub.

Metadata 100

Metadata Management Kafka Data Engineering 100

Cloudera

AUGUST 28, 2020

In part 2 of the series focusing on the impact of evolving technology on the telecom industry, we sat down with Vijay Raja, Director of Industry & Solutions Marketing at Cloudera to get his views on how the sector is changing and where it goes next. Hi Vijay, thank you so much for joining us again. To continue where we left off, as industry players continue to shift toward a more 5G centric network, how is 5G impacting the industry from a data perspective?

Machine Learning 108

Machine Learning Transportation Cloud Data Lake 108

Speaker: Anne Steiner and David Laribee

As a concept, Developer Experience (DX) has gained significant attention in the tech industry. It emphasizes engineers’ efficiency and satisfaction during the product development process. As product managers, we need to understand how a good DX can contribute not only to the well-being of our development teams but also to the broader objectives of product success and customer satisfaction.

Engineering

Teradata

AUGUST 25, 2020

This post presents a simulation framework that leverages several mathematical models to simulate the spread of diseases such as COVID-19 in urban environments.

113

113

Confluent

AUGUST 28, 2020

Whether you are a developer working on a cool new real-time application or an architect formulating the plan to reap the benefits of event streaming for the organisation, the subject […].

Cloud 103

Cloud 103

Cloudera

AUGUST 27, 2020

There’s no doubt that cloud has become ubiquitous, and thank goodness for that in 2020. We wouldn’t have survived the challenges of this year without cloud. It’s supported everything, from the sudden changes in the way we work to the way we access healthcare and even shop for vital goods. While cloud is the vehicle, it’s what sits on it that makes it so valuable — data.

Telecommunication 97

Telecommunication Data Data Lake Cloud 97

Teradata

AUGUST 27, 2020

Learn why milliseconds of WAN network latency can wreak havoc on performance for analytics in the cloud. Read more.

Cloud 66

Cloud 66

Confluent

AUGUST 27, 2020

If you know me, you know two things: first, that I am committed to remote work as an effective way to build a company; I’ve been a remote employee for […].

Kafka 103

Kafka Building 103

Grouparoo

AUGUST 25, 2020

In the process of integrating Grouparoo with Zendesk , I searched the documentation for the right way to format tags, but was unable to find it. I thought I'd write up a guide to help others on the same journey. In case you are "that person" and just want the answer, here it is: Tags needs to be lowercase and not have any spaces. You can have underscores.

Database 40

Database Process IT Data 40

Speaker: Aarushi Kansal, AI Leader & Author and Tony Karrer, Founder & CTO at Aggregage

Software leaders who are building applications based on Large Language Models (LLMs) often find it a challenge to achieve reliability. It’s no surprise given the non-deterministic nature of LLMs. To effectively create reliable LLM-based (often with RAG) applications, extensive testing and evaluation processes are crucial. This often ends up involving meticulous adjustments to prompts.

Building

Cloudera

AUGUST 26, 2020

Live data-streaming offers businesses exciting new opportunities to transform the way they operate, leveraging real-time insights to drive better decision making and enhance operational efficiency. To find out more about how live-streaming data might impact the financial services sector, I sat down for a chat with Dinesh Chandrasekhar, Head of Product Marketing in Cloudera’s data-in-motion Business Unit.

Banking 80

Banking Data Ingestion Kafka Data Lake 80

Teradata

AUGUST 24, 2020

Data is the new battleground for banks; yet for all the talk about digitalization, most banks still do not have a coherent enterprise-wide strategy for data.

Banking 52

Banking Data 52

Confluent

AUGUST 24, 2020

This is the fifth month of Project Metamorphosis: an initiative that addresses the manual toil of running Apache Kafka® by bringing the best characteristics of modern cloud-native data systems to […].

Cloud 88

Cloud Project Kafka Systems 88

Rockset

AUGUST 25, 2020

In Part One , we discussed how to first identify slow queries on MongoDB using the database profiler, and then investigated what the strategies the database took doing during the execution of those queries to understand why our queries were taking the time and resources that they were taking. In this blog post, we’ll discuss several other targeted strategies that we can use to speed up those problematic queries when the right circumstances are present.

MongoDB 40

MongoDB NoSQL SQL Database 40

Speaker: Margaret-Ann Seger, Head of Product, Statsig

Experimentation is often seen as an aspirational practice, especially at smaller, fast-moving companies who are strapped for time and resources. So, how can you get your team making decisions in a more data-driven way while continuing to remain lean and maintaining ship velocity? In this webinar, Margaret-Ann Seger, Head of Product at Statsig, will teach you how to build an experimentation culture from the ground-up, graduating from just getting started with data-driven development to operating

Building

Cloudera

AUGUST 25, 2020

Evaluating anomalies and unpredicted events like pandemics and ESG concerns. In part II of the series, we sat down for an interview with Dr. Richard Harmon, Managing Director of Financial Services at Cloudera, to find out more about how the industry is adopting new technology. You can catch-up and read part 1 of the series, here. Thank you for joining us for part two of our discussion around data, analytics and machine learning within the Financial Service Sector Dr.

Technology 70

Technology Machine Learning Banking Government 70

Teradata

AUGUST 26, 2020

No operator ever made, or ever will make, a single cent or penny from purely digitizing and then storing data – they need to do something with it! Find out how.

IT 98

IT Data 98

Confluent

AUGUST 24, 2020

Here is what happened on day one of the event—spoiler alert: My first Summit was awesome. This year’s Kafka Summit is my first and I’ve been lucky to have a […].

Kafka 81

Kafka 81

Cloudera

AUGUST 25, 2020

Introducing Model Monitoring & Metrics Store In Cloudera Data Science Workbench. With only about 35% of machine learning models making into production in the enterprise ( IDC ), it’s no wonder that production machine learning has become one of the most important focus areas for data scientists and ML engineers alike. As you may remember, we recently announced a full set of MLOps capabilities in Cloudera Machine Learning , our cloud native machine learning tool for the cloud.

Machine Learning 75

Machine Learning Data Science Python Cloud 75

Advertisement

Are you trying to decide which entity resolution capabilities you need? It can be confusing to determine which features are most important for your project. And sometimes key features are overlooked. Get the Entity Resolution Evaluation Checklist to make sure you’ve thought of everything to make your project a success! The list was created by Senzing’s team of leading entity resolution experts, based on their real-world experience.

Project

Cloudera

AUGUST 24, 2020

In the last blog with Deloitte’s Marc Beierschoder, we talked about what the hybrid cloud is, why it can benefit a business and what the key blockers often are in implementation. You can read it here. . Today we are continuing our discussion with Martin Mannion , EMEA Big Data Community lead at Deloitte and Paul Mackay, the EMEA Cloud Lead at Cloudera to look at why security and governance requirements must be tackled in the early stages of data-led use case development, thereby mitigating more

Cloud 77

Cloud Building Government Metadata 77

Cloudera

AUGUST 26, 2020

On August 18, we completed our Enterprise Data Cloud vision of bringing a truly hybrid cloud experience with the general availability of Cloudera Data Platform Private Cloud (CDP Private Cloud). CDP Private Cloud, which is based on Kubernetes (RedHat OpenShift), extends cloud-native speed, simplicity and economics for the connected data lifecycle to the on-prem world, enabling IT to respond to business needs faster and deliver rock-solid service levels so people can be more productive with data.

Machine Learning 80

Machine Learning BI Big Data Data Warehouse 80