Knowledge Hut

JANUARY 18, 2024

CISSP stands for Certified Information Systems Security Professional, and it is a certification in cyber security. This professional certification is developed and offered by (ISC)2, also known as International Information Systems Security Certification Consortium. This blog will help you understand the question “what is CISSP?

Systems 52

Systems Certification Consulting Education 52

DataKitchen

DECEMBER 9, 2022

This can include the use of tools for data preparation, model training, and deployment, as well as technologies for monitoring and managing data-related systems and processes. One of the key benefits of DataOps observability is the ability to improve collaboration and communication across teams and systems.

Machine Learning 52

Machine Learning Data Preparation Government Data Analytics 52

Uber Engineering

FEBRUARY 23, 2023

In this blog learn how we automated column-level drift detection in batch datasets at Uber scale, reducing the median time to detect issues in critical datasets by 5X. Data quality is of paramount importance at Uber, powering critical decisions and features.

Systems 93

Systems Datasets Data 93

Lyft Engineering

APRIL 25, 2023

Building a large scale unsupervised model anomaly detection system — Part 2 Building ML Models with Observability at Scale By Rajeev Prabhakar , Han Wang , Anindya Saha Photo by Octavian Rosca on Unsplash In our previous blog we discussed the different challenges we faced for model monitoring and our strategy for addressing some of these problems.

Systems 75

Systems Building Machine Learning Datasets 75

Cloudera

MAY 25, 2021

Recommendation systems have become a cornerstone of modern life, spanning sectors that include online retail, music and video streaming, and even content publishing. These systems help us navigate the sheer volume of content on the internet, allowing us to discover what’s interesting or important to us.

Systems 60

Systems Algorithm Retail Utilities 60

Zalando Engineering

JUNE 30, 2020

Our Engineering Blog was launched in June 2020 after a long break of the previous tech blog. What customizations we applied to design the blog and the publishing process. Static Site Generator Our previous tech blog used a CMS which only a limited number of people had access to. So which static site generator to choose?

Engineering 40

Engineering Bytes AWS Python 40

Uber Engineering

APRIL 5, 2018

This analysis powers our services and enables the delivery of more seamless and reliable user … The post Scaling Uber’s Apache Hadoop Distributed File System for Growth appeared first on Uber Engineering Blog.

Hadoop 109

Hadoop Systems Big Data Data Analysis 109

Scott Logic

NOVEMBER 15, 2023

Until now, you’ve probably expected all your tests to pass, but what happens when you test systems with inherent inbuilt randomness? You may think this will require you to run many tests, but this blog will give you a method for ensuring that we extract statistically valid results and how to do it quickly. What is the t-test?

Systems 52

Systems Architecture IT Data 52

Rockset

SEPTEMBER 2, 2022

I recently had the good fortune to host a small-group discussion on personalization and recommendation systems with two technical experts with years of experience at FAANG and other web-scale companies. Garg also blogs regularly on real-time data and recommendation systems – read and subscribe here. That’s not machine learning.

Systems 52

Systems Building Machine Learning NoSQL 52

Uber Engineering

AUGUST 7, 2019

As we scaled up to our present level of support for 14 million trips per day, the car in that … The post Migrating Functionality Between Large-scale Production Systems Seamlessly appeared first on Uber Engineering Blog.

Systems 79

Systems Engineering Building IT 79

U-Next

OCTOBER 27, 2022

An MIS ( Management Information Systems ) executive is responsible for the management of an organization’s computer systems, applications, and networks. In this blog, we will break down the MIS Executive salary in India based on these factors, making it easier for you to negotiate for a fair amount. .

Systems 52

Systems Management Telecommunication Technology 52

databricks

DECEMBER 21, 2023

We are excited to announce that Gartner has recognized Databricks as a Leader for a third consecutive year in the 2023 Gartner® Magic.

Systems 129

Systems Database Cloud Management 129

databricks

SEPTEMBER 12, 2023

As the lakehouse becomes increasingly mission-critical to data-forward organizations, so too grows the risk that unexpected events, outages, and security incidents may derail.

Systems 82

Systems Data 82

Pinterest Engineering

MAY 13, 2024

The subsequent blog post will delve into how we looked into our specific needs, evaluated multiple candidates and decided on the adoption of a new database technology. High system complexity To provide these advanced features for customers, we built several new services on top of HBase over the past few years.

NoSQL 69

NoSQL MySQL Database Systems 69

databricks

FEBRUARY 29, 2024

Special thanks to Phillip Jones, Senior Product Manager, and Harshal Brahmbhatt, Systems Engineer from Cloudflare for their contributions to this blog. Organizations across.

Engineering 116

Engineering Systems Management 116

Data Engineering Weekly

NOVEMBER 11, 2022

Not too long ago, I worked for a famous messaging platform; You may be typing on it as you read this blog. I took a break from data engineering and focused on system monitoring and observability for some time. Little did I know I would be building data pipelines to measure system efficiency instead of measuring business efficiency.

Systems 40

Systems High Quality Data Consulting Metadata 40

Netflix Tech

MAY 4, 2023

Behind the scenes, a myriad of systems and services are involved in orchestrating the product experience. These backend systems are consistently being evolved and optimized to meet and exceed customer and product expectations. This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal.

Utilities 135

Utilities Systems Architecture Coding 135

databricks

JUNE 13, 2023

We are incredibly excited to announce that the team behind Rubicon is joining Databricks. Founded by large scale infrastructure builders, Akhil Gupta and.

Systems 78

Systems 78

DataKitchen

MAY 10, 2024

This blog post introduces five critical use cases for data observability, each pivotal in maintaining the integrity and usability of data throughout its journey in any enterprise. This ensures that any new integration or code alteration does not adversely affect the existing systems, thus safeguarding the overall system integrity.

Data Ingestion 56

Data Ingestion Datasets Data Coding 56

Data Engineering Weekly

MAY 12, 2024

link] Gradient Flow: Learning from the Past - Comparing the Hype Cycles of Big Data and GenAI The blogs compare the hype cycle of Big Data with Gen AI. The blog narrates the initial hype of Big Data, followed by talent shortages and lead time to build production applications. It is one of the tools I wish Uber could open source.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52

Rockset

JULY 6, 2022

This is the fifth post in a series by Rockset's CTO and Co-founder Dhruba Borthakur on Designing the Next Generation of Data Systems for Real-Time Analytics. We'll be publishing more posts in the series in the near future, so subscribe to our blog so you don't miss them!

NoSQL 52

NoSQL SQL Systems PostgreSQL 52

Engineering at Meta

OCTOBER 23, 2023

To optimize build and performance, we developed our own build system called Buck , which was first open-sourced in 2013. We debated between using Java (like Buck1), Haskell (like the Shake build system ) or Go for the core programming language. Meta has a very large monorepo, with many different programming languages.

Programming Language 112

Programming Language Java Python Programming 112

Yelp Engineering

MARCH 25, 2024

In this blog post, we highlight how phone number masking helps build consumer trust in the services marketplace at Yelp, decreases the friction in communication with service professionals, and allows for seamless switching between the Yelp app and a user’s phone.

Project 103

Project Consulting Engineering Systems 103

DataKitchen

MAY 7, 2024

DataKitchen Training And Certification Offerings For Individual contributors with a background in Data Analytics/Science/Engineering Overall Ideas and Principles of DataOps DataOps Cookbook (200 page book over 30,000 readers, free): DataOps Certificatio n (3 hours, online, free, signup online): DataOps Manifesto (over 30,000 signatures) One (..)

Certification 64

Certification Consulting Data Analytics Engineering 64

Cloudera

FEBRUARY 1, 2024

In this blog, we’ll cover the highlights of our recently published Day 2 Operations Guide and why it matters to enterprises. Day 2 operations are akin to the housekeeping of a software system — vital for maintaining its health and stability.

Cloud 81

Cloud Architecture Utilities Designing 81

Rockset

JULY 8, 2020

Building a scalable, distributed, and real-time ETA prediction system is a tough task, but what if we could simplify its design? We’ll break our system into pieces such that each component is responsible for one primary job. Let’s take a look at components that constitute the system.

Kafka 40

Kafka Designing Systems Food 40

Zalando Engineering

MARCH 1, 2021

In order to provide an excellent customer experience, we must ensure our systems can technically handle high traffic events such as Cyber Week or other sales campaigns. Checkout and payments related systems are particularly important during sales events. We have published a detailed article on how Zalando prepares for the Cyberweek.

Systems 40

Systems Building Java Algorithm 40

Netflix Tech

JUNE 1, 2023

In this blog post, we’ll discuss the methods we used to ensure a successful launch, including: How we tested the system Netflix technologies involved Best practices we developed Realistic Test Traffic Netflix traffic ebbs and flows throughout the day in a sinusoidal pattern. Basic with ads was launched worldwide on November 3rd.

Algorithm 136

Algorithm Metadata Kafka Systems 136

Knowledge Hut

JUNE 26, 2023

If you really want to build some cool backend projects, then this blog post is for you to provide a comprehensive guide for your career goals and guidance. Top 4 Backend Project Ideas - Beginner and Final Year Students Task Management System In this project you develop a backend system to manage tasks and projects.

Portfolio 98

Portfolio Project Food Media 98

Cloudera

MARCH 22, 2024

That’s why Cloudera and Red Hat , renowned for their open-source solutions, have teamed up to bring Red Hat Enterprise Linux ( RHEL ) to Cloudera on public cloud as the operating system for all of our public cloud platform images. Let’s dive into what this means and why it’s a game-changer for our customers.

Cloud 111

Cloud Certification Systems Architecture 111

Uber Engineering

SEPTEMBER 29, 2021

a driver starting a trip) and system actions … The post Building Uber’s Fulfillment Platform for Planet-Scale using Google Cloud Spanner appeared first on Uber Engineering Blog. The platform handles billions of database transactions each day, ranging from user actions (e.g.,

Google Cloud 143

Google Cloud Cloud Building Database 143

Uber Engineering

SEPTEMBER 23, 2021

With this new ability came new challenges that needed to be solved at Uber, such as systems for ad auctions, bidding, attribution, reporting, and more. This article focuses on how we … The post Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot appeared first on Uber Engineering Blog.

Kafka 142

Kafka Process Systems Engineering 142

Tweag

FEBRUARY 8, 2023

Local remote builder macOS is a great desktop environment, but as soon as you move beyond your machine, be it to a remote server, VM or container, you most likely end up in Linux, which is a different system. As for linuxkit-nix , Gabriella Gonzales wrote in her blog post a great overview of how it is lacking in different areas.

Systems 100

Systems Building Cloud IT 100

Zalando Engineering

MAY 8, 2018

Moving from a more traditional internal IT setup to a product-driven culture I love building enterprise systems, because you get to work with your customers/users every day and literally see their lives change as you release new features. Some of these levers may require system improvements, some may not.

Systems 40

Systems Management Recruitment Retail 40

Hevo

DECEMBER 6, 2023

MySQL is a relational database management system based on the Structured Query Language (SQL), the most widely used language for accessing and managing database records. This blog talks about the 3 steps you can follow to configure and seamlessly set […] Under the GNU license, MySQL is open-source and free software.

MySQL 59

MySQL Relational Database Database SQL 59

Edureka

NOVEMBER 28, 2023

In this blog, we will learn how we can install OpenCV python on windows. Open Command Prompt Run The Following Command pip install opencv-python Successfully installed OpenCV on your system. In this blog, we have discussed the applications of OpenCV python library along with how we can install it on our systems on windows.

Python 98

Python Algorithm Machine Learning Programming Language 98

Workfall

SEPTEMBER 18, 2023

In this blog, we’re diving into the world of data integration with Airbyte, unraveling the mystery behind its simplicity, and uncovering how it seamlessly connects with Snowflake to transform your data into actionable insights. In this blog, we will cover: What is Airbyte?

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93