Netflix Tech

MARCH 10, 2020

Outside of the business logic are the Data Sources and the Transport Layer: Data Sources are adapters to different storage implementations. Transport Layer can trigger an interactor to perform business logic. The most common transport layer for microservices is the HTTP API Layer and a set of controllers that handle requests.

Architecture 138

Architecture Transportation Java Database 138

Confluent

FEBRUARY 22, 2021

Apache Kafka® is at the heart of the data transportation layer at Pinterest. The amount of data that runs through Kafka has constantly grown over the years. This growth sometimes […].

Kafka 145

Kafka Transportation Data 145

databricks

JUNE 4, 2025

As Industry Marketing Leader for Manufacturing & Transportation at Databricks, I couldnt The biggest event of the year in data and AI is upon us!

Transportation 49

Transportation Manufacturing Data 49

Uber Engineering

AUGUST 5, 2021

Uber delivers efficient and reliable transportation across the global marketplace, which is powered by hundreds of services, machine learning models, and tens of thousands of datasets.

Transportation 145

Transportation Machine Learning Datasets Data 145

Uber Engineering

DECEMBER 19, 2019

Every day around the world, millions of trips take place across the Uber network, giving users more reliable transportation through ridesharing, bikes, and scooters, drivers and truckers additional opportunities to earn, employees and employers more convenient business travel, and hungry … The post Uber Infrastructure in 2019: Improving Reliability, (..)

Transportation 145

Transportation Engineering Architecture 145

Engineering at Meta

AUGUST 5, 2024

We opted for RDMA Over Converged Ethernet version 2 (RoCEv2) as the inter-node communication transport for the majority of our AI capacity. This backend fabric utilizes the RoCEv2 protocol, which encapsulates the RDMA service in UDP packets for transport over the network.

Transportation 134

Transportation Designing Architecture Data Ingestion 134

ProjectPro

JUNE 6, 2025

Top 5 Data Science Applications in Supply Chain Data science techniques such as predictive analytics , machine learning , and artificial intelligence can also help organizations forecast demand, optimize inventory levels, reduce transportation costs, and improve overall supply chain efficiency.

Data Science 65

Data Science Transportation Consulting Machine Learning 65

Lyft Engineering

FEBRUARY 24, 2023

Optimal transport At the core of the Lyft platform is the matching algorithm that dispatches drivers to satisfy rider demand. First, define a non-negative valued transport function γ(i, j) and a cost function c(i, j). That is, we’d like our transport function to move drivers but not riders. 2021) to rectify these shortcomings.

Transportation 107

Transportation Utilities Systems Algorithm 107

KDnuggets

NOVEMBER 25, 2024

A data pipeline is just a series of procedures that transport data from one location to another, frequently changing it along the way. Building data pipelines is a very important skill that you should learn as a data engineer.

Data Pipeline 113

Data Pipeline Building Transportation Data 113

Engineering at Meta

JANUARY 31, 2023

General high-level architecture Any asynchronous computing platform is composed of the following building blocks: Ingestion and storage Transport and routing Computation Ingestion and storage Our platform is responsible for accepting the workloads and storing them for execution. The transport layer consisted of a component called “Dispatcher.”

Transportation 114

Transportation Architecture Data Warehouse MySQL 114

databricks

JANUARY 14, 2025

Electronic products are evolving at lightning speed, driven by an insatiable demand for new consumer devices, energy, transport, robotics, connectivity, data and beyond.

Electronics 107

Electronics Designing Transportation Manufacturing 107

Netflix Tech

JUNE 7, 2021

The sidecar has been implemented by leveraging the highly performant eBPF along with carefully chosen transport protocols to consume less than 1% of CPU and memory on any instance in our fleet. The choice of transport protocols like GRPC, HTTPS & UDP is runtime dependent on characteristics of the instance placement.

Transportation 131

Transportation AWS Cloud Kafka 131

Cloudera

DECEMBER 14, 2021

Roads and Transport Authority, Dubai. The Roads and Transport Authority (RTA) operating in Dubai wanted to apply big data capabilities to transportation and enhance travel efficiency. For this, the RTA transformed its data ingestion and management processes. .

Transportation 111

Transportation Telecommunication Banking Data Lake 111

KDnuggets

APRIL 11, 2022

Check out the collection of the best data repositories on healthcare, natural language, neuroscience, physics, social network, sports, time series, transportation, miscellaneous, and super data repositories.

Transportation 111

Transportation Healthcare Data Data Science 111

Knowledge Hut

DECEMBER 21, 2023

IoT: Overview IoT has numerous applications in various sectors such as healthcare, agriculture, transportation, manufacturing, and smart cities. Some of the popular smart city projects include smart transportation, smart energy, and smart waste management. If you want to know more about IoT, check out online IoT training.

Coding 98

Coding Transportation Medical Hospitality 98

Confluent

AUGUST 26, 2021

When companies need help with their vehicle fleets—including transport, storage, or renewing expired registrations—they don’t want to have to deal with multiple vehicle logistics providers. For these companies, ACERTUS provides […].

Transportation 105

Transportation Architecture 105

Edureka

MAY 8, 2025

E-commerce Supply Chain Optimization: Data Flow Across Supply Chain: Data engineers manage the flow of information between vendors, warehouses, transport systems, and customer requirements to keep the E-commerce supply chain connected. Here are the 9 prominent data engineering applications: 1. Where does data engineering find its application?

Data Engineering 52

Data Engineering Data Engineer Engineering Telecommunication 52

Snowflake

JANUARY 12, 2024

Cargill Ocean Transportation (OT) manages 650 ships at sea every single day. To support IMO’s mission, the maritime industry adopted a new metric—Carbon Intensity Indicator (CII)—which measures a vessel’s efficiency when it is transporting cargo and passengers.

Transportation 119

Transportation Manufacturing Government Accessible 119

Netflix Tech

AUGUST 1, 2022

It reads events from the upstream transports and applies some business logic to each of them. An intermediate processor writes data to another transport. Processors A processor is a Flink Job. It contains a reusable unit of data processing logic.

Process 109

Process Transportation Kafka Entertainment 109

Snowflake

OCTOBER 24, 2023

Founded nearly 70 years ago, Werner Enterprises is a North American transportation and logistics leader that operates a fleet of almost 8,300 trucks and 30,000 trailers out of 16 terminals across the United States. The company generates a massive amount of data on the constantly changing, real-time location of each of its assets.

Transportation 115

Transportation Data Warehouse Cloud Utilities 115

ProjectPro

JUNE 6, 2025

By offering a no-code pipeline building capability, Azure Data Factory is one of the most efficient data orchestrators in the market, automating data transportation to the cloud, processing, and storing it in a few clicks for future analysis. The cloud data storage handle all data transportation and transformation.

Data Engineering 40

Data Engineering Data Engineer Engineering Hospitality 40

Cloudera

AUGUST 11, 2022

To drive these data use cases, the Department of Defense (DoD) communities and branches require a reliable, scalable data transport mechanism to deliver data (from any source) from origination through all points of consumption; at the edge, on-premise, and in the cloud in a simple, secure, universal, and scalable way. edge processing.

Transportation 94

Transportation Data Ingestion Architecture Data 94

Snowflake

DECEMBER 18, 2023

Here are 50 Data Leaders to watch in 2024: Amin Venjara , CDO, ADP Andrew Bonnici , Vice President – Product, Platforms, and Data, IGT PlayDigital Andrew Curry , CDO, ExxonMobil Aravind Jagannathan , VP and CDO, Freddie Mac Arno Huhn , Managing Director Data and AI, Schwarz Group Ashok Chennuru , Global Chief Data & Insights Officer, Elevance (..)

Transportation 107

Transportation Insurance Data Architecture Technology 107

Data Engineering Podcast

DECEMBER 28, 2020

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Links Satori Data Governance Data Masking TLS == Transport Layer Security The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA Support (..)

Data Governance 130

Data Governance Government Transportation Data 130

The Pragmatic Engineer

OCTOBER 24, 2023

It's like asking a tricycle maker to pilot a spaceship because, well, it's all transportation. Tesla engineers thus resorted to measuring what most experts will tell you is completely meaningless: the quantity of code contributed to Twitter by each engineer.

Coding 245

Coding Software Engineering Software Engineer Media 245

Knowledge Hut

APRIL 25, 2024

Benefits of Big Data in Transportation Industry 5: Transportation The benefit of big data is more to the transportation industry. Increased Knowledge Big data and IoT have the potential to inform customers or users about the most efficient mode of transportation at any given time. Why Choose Big Data?

Big Data 97

Big Data Entertainment Transportation Banking 97

Towards Data Science

FEBRUARY 9, 2024

The Platform Integration Data Store Transformation Orchestration Presentation Transportation Observability Closing What’s changed? The future of the transportation layer seems destined to intersect with APIs, creating a scenario where API endpoints generated via SQL queries become as common as exporting .csv

Building 98

Building Transportation Data Lake Metadata 98

Snowflake

DECEMBER 18, 2023

Here are 50 Data Leaders to watch in 2024: Amin Venjara , CDO, ADP Andrew Bonnici , Vice President – Product, Platforms, and Data, IGT PlayDigital Andrew Curry , CDO, ExxonMobil Aravind Jagannathan , VP and CDO, Freddie Mac Arno Huhn , Managing Director Data and AI, Schwarz Group Ashok Chennuru , Global Chief Data & Insights Officer, Elevance (..)

Transportation 97

Transportation Insurance Data Architecture Technology 97

Engineering at Meta

NOVEMBER 15, 2023

Scaling RoCE Networks for AI Training Adi Gangidi, Production Network Engineer Adi Gangidi provides an overview of Meta’s RDMA deployment based on RoCEV2 transport for supporting our production AI training infrastructure.

Building 103

Building Engineering Transportation Software Engineering 103

Lyft Engineering

JUNE 8, 2023

Lyft was founded in 2012 and went public in 2019, with the mission to improve people’s lives with the world’s best transportation. We’re looking for driven engineers to fortify our European operations and solve some of the hardest problems in building large distributed systems to support rideshare, mapping, and more.

Transportation 111

Transportation Algorithm Machine Learning Engineering 111

ProjectPro

JUNE 6, 2025

With wide applications in various sectors like healthcare , education, retail, transportation, media, and banking -data science applications are at the core of pretty much every industry out there. It also has to decide on the shipping method to minimize transportation costs while meeting the promised delivery date.

Data Science 67

Data Science Project Food Pharmaceutical 67

Picnic Engineering

FEBRUARY 6, 2024

Our goods are transported in boxes with standardised sizes, called totes. Within this 250 ms, a couple of things need to happen in order: Send information on the tote to the Transport System. Raise a divert decision request to the Warehouse Control System by the Transport System. Execute the divert decision.

Cloud 97

Cloud Transportation Cloud Computing Systems 97

Cloudera

JULY 24, 2024

People need to get to work, go to the doctor, and get groceries, and it’s up to their local transportation department to ensure they make it to their destinations reliably. Similarly, transportation agencies reduce downtime through innovations like automatic inflating tire systems; so it’s about time we innovate too.

Transportation 79

Transportation Metadata Cloud Systems 79

Engineering at Meta

JANUARY 27, 2023

The talk also covers the connection of our submarine networks to our terrestrial backbone and describes how Meta designs and builds the hierarchies of the optical transport layer built on top of those fiber paths.

Engineering 141

Engineering Software Engineering Software Engineer Transportation 141

RandomTrees

DECEMBER 17, 2024

Risk factors in manufacturing, storage, and transportation activities can be easily monitored through GenAI-powered IoT sensors and systems. Personalized Solutions: GenAI is able to assess past data and propose a custom quality assurance plan for each product. Food Safety Management- through efficient real-time monitoring.

Food 52

Food Manufacturing Machine Learning Transportation 52

Engineering at Meta

FEBRUARY 7, 2023

Transportation buildings, such as airport terminals, parking garages, and metro stations, have a bluish tint to correspond with our new iconography layer. We’re now also color-coding buildings in our “areas of interest” layer, which highlights features in high traffic areas with a creamy orange tint.

Entertainment 143

Entertainment Transportation Data Schemas AWS 143

Engineering at Meta

MAY 1, 2025

Meta develops infrastructure all across the globe to transport information and content for the billions of people using our services around the world. At the core of this infrastructure are aggregation points like data centers and the digital cables that connect them.

Engineering 73

Engineering Building Transportation Project 73