LinkedIn Engineering

OCTOBER 19, 2023

This robust framework empowers near real-time data processing for critical services and platforms, ranging from machine learning and notifications to anti-abuse AI modeling. With over 950 million members, ensuring that our platform is running smoothly is critical to connecting members to opportunities worldwide.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Knowledge Hut

NOVEMBER 17, 2023

I will walk you through the complete roadmap on how to become an Azure Architect in this blog. Here's a step-by-step roadmap to help you achieve this coveted position: Foundational Knowledge: To lay a robust foundation in cloud computing, it is essential to comprehend the basics of cloud concepts, services, and deployment models.

Cloud Computing 52

Cloud Computing Certification Cloud Consulting 52

Knowledge Hut

SEPTEMBER 26, 2023

Several organizations are onboarding the platform, therefore more skilled professionals are needed to manage and maintain it. An Azure Administrator manages and maintains an organization's cloud infrastructure on the Azure platform. Who is an Azure Administrator?

Cloud Computing 52

Cloud Computing Certification Cloud Database 52

Knowledge Hut

OCTOBER 31, 2023

This blog will examine theAzure Administrator syllabus in detail, providing you with a thorough overview of what to anticipate from this certification and advice on how to prepare for it properly. Understanding data replication, access control, and storage account monitoring are requirements.

Data Lake 52

Data Lake Certification Government Cloud Computing 52

Snowflake

AUGUST 16, 2023

Read our Summit recap blog for highlights across industries or watch Summit sessions now on-demand. At Snowflake Summit, we announced a wave of product innovations: Snowpark ML Modeling API, Snowflake Native App Framework, Dynamic Tables and more. If you missed out, not to worry! Let’s dive into all the new releases in May, June and July.

Scala 52

Scala Transportation Kafka Data Lake 52

Cloudera

DECEMBER 21, 2021

In working with thousands of customers deploying Spark applications, we saw significant challenges with managing Spark as well as automating, delivering, and optimizing secure data pipelines. We wanted to develop a service tailored to the data engineering practitioner built on top of a true enterprise hybrid data service platform.

Data Engineering 119

Data Engineering Data Engineer Engineering Data Pipeline 119

Databand.ai

JULY 5, 2023

Ensuring Data Quality Data accuracy is a critical factor in the success of any analytics or machine learning initiative. Ensuring Data Quality Data accuracy is a critical factor in the success of any analytics or machine learning initiative.

Data Pipeline 52

Data Pipeline Data Lake Data Warehouse Datasets 52

Cloudera

APRIL 20, 2021

What is Streaming Analytics? Streaming Analytics is a type of data analysis that processes data streams for real-time analytics. Streaming Analytics can be used in many industries: Healthcare: Monitoring hospital patients to get the latest and most actionable data to inform patient interactions better.

Hospitality 96

Hospitality Kafka Retail Data Ingestion 96

Knowledge Hut

NOVEMBER 17, 2023

And to become a successful Azure Data Engineer, you'll need a blend of technical skills, soft skills, and domain knowledge related to data engineering and Azure services. Their job entails Azure data engineer skills like using big data, databases, data lakes, and analytics to help firms make efficient data-driven decisions.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52

Cloudera

JULY 15, 2021

This blog post provides an overview of best practice for the design and deployment of clusters incorporating hardware and operating system configuration, along with guidance for networking and security as well as integration with existing enterprise infrastructure. Best of CDH & HDP, with added analytic and platform features .

Architecture 102

Architecture Cloud Kafka Hadoop 102

Knowledge Hut

SEPTEMBER 27, 2023

Azure's diverse services encompass computing, storage, databases, AI , and IoT, offering a comprehensive solution for a broad spectrum of needs. Microsoft Azure boasts a plethora of cloud services and resources, with the creation of an account serving as the portal to harness these capabilities.

Database-centric 52

Database-centric Cloud Computing Cloud Database 52

Knowledge Hut

SEPTEMBER 29, 2023

In this blog, I will explain all the important Azure developer skills that should be focused on for Azure developers and explore why they are important to building a great career in Azure. Azure developers use Microsoft Azure software and technologies to create, develop, test, and support cloud solutions such as apps and services.

Cloud Computing 52

Cloud Computing Database Cloud PostgreSQL 52

Cloudera

JANUARY 27, 2021

The SOC 2 certification helps ensure that applications and code are developed, reviewed, tested, and released following the AICPA Trust Services Principles. This means that the CDP Public Cloud service is continuously being developed using audited processes and controls to help ensure the highest level of trust and security.

Certification 103

Certification Cloud Data Warehouse Machine Learning 103

Cloudera

AUGUST 10, 2021

Cloudera Manager enhancements for greater efficiency and hardened platform security. Enhanced analytic features that deliver faster SQL queries and ETL with Hive on Tez and Impala, improved Spark with support for Spark 3.1 We expand on this feature later in this blog. For a detailed list of what’s included in CDP PvC Base 7.1.7,

Cloud 97

Cloud Kafka Metadata SQL 97

Netflix Tech

JANUARY 13, 2022

Troubleshooting these problems is not a trivial task and requires collecting logs and metrics from several different systems and analyzing them to identify the root cause. This blog will explore these two systems and how they perform auto-diagnosis and remediation across our Big Data Platform and Real-time infrastructure.

Kafka 95

Kafka Big Data Data Machine Learning 95

Rockset

MARCH 9, 2023

In this blog post, we will explore three different ways to query the Ethereum blockchain. You can monitor the progress of the download by checking the log messages in the terminal window. You can monitor the progress of the sync by checking the log messages in the terminal window.

Amazon Web Services 52

Amazon Web Services Datasets AWS Google Cloud 52

Knowledge Hut

NOVEMBER 16, 2023

Amazon Web Services (AWS) remains the clear leader worldwide in the public cloud services market. These certifications can help you validate your skills in cloud-based services and also build confidence and credibility. How to Get AWS Certified? AWS certifications are among the most in-demand certifications in the IT market.

AWS 52

AWS Certification Amazon Web Services Cloud Computing 52

phData: Data Engineering

SEPTEMBER 19, 2023

With the amount of data companies are using growing to unprecedented levels, organizations are grappling with the challenge of efficiently managing and deriving insights from these vast volumes of structured and unstructured data. With many data modeling methodologies and processes available, choosing the right approach can be daunting.

Data Lake 52

Data Lake Process Metadata Data Warehouse 52

ProjectPro

FEBRUARY 16, 2023

Splunk is an outstanding tool for exploring, monitoring, analyzing, and acting on your data. From monitoring and searching through big data to generating alerts, reports, and visualizations, Splunk offers several such features to help businesses achieve their goals. What do you mean by the Cloud Monitoring Console (CMC)?

Big Data 52

Big Data Big Data Tools Cloud Data 52

Netflix Tech

MARCH 10, 2023

By Meenakshi Jindal Overview At Netflix, we built the asset management platform (AMP) as a centralized service to organize, store and discover the digital media assets created during the movie production. Production assets operations are performed in parallel with older data reprocessing without any service downtime.

Management 94

Management Kafka Metadata Media 94

Cloudera

OCTOBER 4, 2022

This blog post will provide guidance to administrators currently using or interested in using Kafka nodes to maintain cluster changes as they scale up or down to balance performance and cloud costs in production deployments. Kafka brokers contained within host groups enable the administrators to more easily add and remove nodes.

Kafka 80

Kafka Data Cloud Big Data 80

Striim

NOVEMBER 30, 2022

Thousands of companies are centralizing their analytics and applications on the AWS ecosystem. Striim Cloud runs natively on AWS services like EKS, VPC, EBS, Cloudwatch, and S3 enabling it to offer infinite large-scale, high performance, and reliable data streaming. How does Striim Cloud bring value to the AWS ecosystem?

AWS 52

AWS Cloud Management Google Cloud 52

Snowflake

JUNE 27, 2023

More than 25 new Snowflake Native Apps are already available on Snowflake Marketplace , in addition to our own Snowflake Native Connectors for ServiceNow (public preview), Google Analytics (private preview), MySQL (private preview), and Postgres (private preview).

AWS 52

AWS Google Cloud MySQL Coding 52

Databand.ai

DECEMBER 13, 2022

Joseph also manages the Start Data Engineering newsletter, which features tutorials, data design patterns, open-source tools, and techniques used by data-driven companies to help others become better data engineers and land their dream data engineering job. You’ve come to the right place. Happy following!

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Knowledge Hut

APRIL 25, 2023

Data engineering tools are software applications that help data engineers manage and process large and complex data sets. Data engineering is a field that requires a range of technical skills, including database management, data modeling, and programming. While they go about it - enter big data data engineer tools.

Data Engineering 52

Data Engineering Data Engineer Engineering Google Cloud 52

Rockset

APRIL 18, 2023

To better serve real-time machine learning, Rockset integrates with the Feast Feature Store which acts as a centralized platform for deploying, monitoring and managing production ML features. In addition to standardizing how features are stored and generated, feature stores can also help monitor your training data.

Machine Learning 52

Machine Learning Datasets Database Data Pipeline 52

Lyft Engineering

APRIL 25, 2023

Building a large scale unsupervised model anomaly detection system — Part 2 Building ML Models with Observability at Scale By Rajeev Prabhakar , Han Wang , Anindya Saha Photo by Octavian Rosca on Unsplash In our previous blog we discussed the different challenges we faced for model monitoring and our strategy for addressing some of these problems.

Systems 75

Systems Building Machine Learning Datasets 75

Cloudera

JUNE 25, 2021

Many Cloudera customers are making the transition from being completely on-prem to cloud by either backing up their data in the cloud, or running multi-functional analytics on CDP Public cloud in AWS or Azure. The Replication Manager service facilitates both disaster recovery and data migration across different environments.

Cloud 71

Cloud Data Lake Cloud Storage Metadata 71

Knowledge Hut

JULY 26, 2023

Database applications have become vital in current business environments because they enable effective data management, integration, privacy, collaboration, analysis, and reporting. In this blog, we will deep dive into database system applications in DBMS, and their components and look at a list of database applications.

Database 52

Database NoSQL Telecommunication MongoDB 52

Mutt Data

JULY 13, 2023

Both retailers and advertisers are increasingly finding themselves using these platforms. We thought it was as good a time as any to dive into what RMNs are, what sets them apart, and the key components you should look out for when building one. What are the Unique Traits of a Retail Media Network? What are Retail Media Networks (RMNs)?

Media 52

Media Retail Amazon Web Services Hospitality 52

Mutt Data

JULY 13, 2023

Both retailers and advertisers are increasingly finding themselves using these platforms. We thought it was as good a time as any to dive into what RMNs are, what sets them apart, and the key components you should look out for when building one. What are the Unique Traits of a Retail Media Network? What are Retail Media Networks (RMNs)?

Media 52

Media Retail Amazon Web Services Hospitality 52

ProjectPro

JULY 23, 2021

AWS (Amazon Web Services) is the world’s leading and widely used cloud platform, with over 200 fully featured services available from data centers worldwide. This blog presents some of the most unique and innovative AWS projects from beginner to advanced levels. Blood Bank Management System 16. What is AWS?

AWS 52

AWS Project Amazon Web Services Cloud Computing 52

DataKitchen

JANUARY 25, 2021

The weekly analytics didn’t build correctly. Analytics, in the modern enterprise, span toolchains, teams, and data centers. Warnings and failures appear in logs and reports that can help the data team pinpoint problems with laser-like accuracy. It’s never good when your boss calls at 5 pm on a Friday. What happened?

Data Pipeline 97

Data Pipeline Building Process Utilities 97

ProjectPro

DECEMBER 7, 2021

This blog will give you an in-depth knowledge of what is a data pipeline and also explore other aspects such as data pipeline architecture, data pipeline tools, use cases, and so much more. As data is expanding exponentially, organizations struggle to harness digital information's power for different business use cases.

Data Pipeline 52

Data Pipeline Architecture Kafka AWS 52

Cloudera

MAY 12, 2021

We saw a record number of entries and incredible examples of how customers were using Cloudera’s platform and services to unlock the power of data. The 2021 Cloudera Data Impact Award categories aim to recognize organizations that are using Cloudera’s platform and services to unlock the power of data, with massive business and social impact.

Food 68

Food Healthcare Government Medical 68

Knowledge Hut

JUNE 30, 2023

To help you use these services efficiently, Google Cloud has introduced a number of certifications to prepare for these courses, and you can check out Cloud Computing courses to know more. This blog guides the top Google Cloud career based on your role and area of expertise, and what you will learn in each one.

Google Cloud 52

Google Cloud Cloud Cloud Computing Certification 52

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. Data Mesh is a revolutionary event streaming architecture that helps organizations quickly and easily integrate real-time data, stream analytics, and more.

Architecture 52

Architecture Generalist Government Datasets 52