DoorDash Engineering

FEBRUARY 27, 2024

Users must be able to make changes in the index schema or fleet configuration and deploy them as soon as the changes do not have internal contradictions. All search components in the same generation have the same code version, index schema, and fleet configuration. A generation has a fixed version of the search Docker image to deploy.

Engineering 129

Engineering Systems Designing Architecture 129

Engineering at Meta

JANUARY 27, 2023

They also discuss In-house software system suites, solutions for distributed provisioning and monitoring of this global fleet of hardware, and approaches to diagnosis and remediation of network failures. Yet, monitoring traffic with millisecond granularity fleet wide is challenging.

Engineering 125

Engineering Software Engineer Software Engineering Transportation 125

Data Engineering Weekly

NOVEMBER 26, 2023

We saw a fleet of announcements from Data Catalogs tools on how LLM can help to auto-generate documentation [See: How Generative AI Is Making Data Catalogs Smarter ]. We’ve seen a fleet of tools like TextToSQL ; Slack bots to ask questions to your data warehouse , Chat interface for spreadsheets , and even the English SDK for Spark !

Data Engineering 70

Data Engineering Data Engineer Engineering Kafka 70

databricks

SEPTEMBER 29, 2023

Fleets of buses worldwide run on hydrogen fuel cells made. This article represents a collaborative effort between Plotly, Ballard Power Systems, and Databricks.

Systems 78

Systems Manufacturing 78

Pinterest Engineering

NOVEMBER 28, 2023

High Fleet Cost for Perceived Throughput We measure the throughput of Goku-Ingestor using data points per min. For qualitative analysis purposes, assume THfleet is the throughput of fleet and n is the number of hosts. Pinterest metrics system Goku-Ingestor has been running and evolving for close to a decade.

Kafka 80

Kafka Bytes Architecture Utilities 80

Confluent

SEPTEMBER 27, 2023

Learn how Penske is using the power of data streaming and AI to drive better customer experiences, including maximizing fleet uptime for its trucking customers.

Data 67

Data IT 67

The Pragmatic Engineer

NOVEMBER 16, 2022

In Mexico, the company had a large initiative with private drivers and a fleet of Tesla cars. Daimler has decided to focus on their other ride-sharing service, FREE NOW, which is also a competitor to Uber in Europe. That operation is in talks of selling to other investors. Meta - 13% layoffs. Widely-reported, e.g. here.

Healthcare 130

Healthcare Software Engineer Software Engineering Data Workflow 130

The Pragmatic Engineer

JUNE 13, 2023

This group doesn’t include the software layer for infrastructure, which is a software team that builds the orchestration platform (Fleet) upon Kubernetes. Fleet, Buckbeak, Agoda’s detailed data stack and bespoke developer portal. Data centers (DCs) and availability zones. The application stack inside the private cloud.

Cloud 189

Cloud Utilities Database BI 189

Confluent

AUGUST 26, 2021

When companies need help with their vehicle fleets—including transport, storage, or renewing expired registrations—they don’t want to have to deal with multiple vehicle logistics providers. For these companies, ACERTUS provides […].

Transportation 104

Transportation Architecture 104

DoorDash Engineering

JANUARY 30, 2024

I will share what we learned as we made our fleet much more performant and cost-effective. The post Cassandra Unleashed: How We Enhanced Cassandra Fleet’s Efficiency and Performance appeared first on DoorDash Engineering Blog. In this blog pos,t we walk through DoorDash’s Cassandra optimization journey.

NoSQL 84

NoSQL Database Systems Relational Database 84

Striim

MARCH 11, 2024

Aging Fleets: Many aircraft in service today are aging, requiring more frequent maintenance interventions. Data Quality and Consistency: The success of predictive maintenance initiatives heavily relies on the fidelity and uniformity of data acquired from diverse sensors and systems.

Algorithm 52

Algorithm Utilities Data Analytics Datasets 52

Engineering at Meta

MAY 16, 2023

Automation (Python scripts, daemons) would initiate control plane operations and monitor the health of the fleet. Learning from rollouts and challenges encountered along the way Rolling out Raft to the fleet was a huge learning for the team. The no-data-loss guarantee would be provably enshrined in the server itself.

MySQL 136

MySQL Building Engineering Database 136

Snowflake

MARCH 28, 2023

Particularly for mobility services providers, anonymized telematics data is indispensable for effective fleet management. Top of mind are services that enable fleet management, boost utilization rates, facilitate handshakes with other modes of transport, or match arrival times at warehouses with time slots for offloading.

Manufacturing 52

Manufacturing Entertainment Transportation Insurance 52

Netflix Tech

JUNE 12, 2023

Plus, neither of these ideas scale to meet the needs of a fleet of Macs hundreds or thousands strong. The ideal solution would be one which can be automated across your entire fleet while not requiring any additional user interaction.

Database 77

Database Engineering Systems Management 77

Cloudera

AUGUST 4, 2021

By capturing and analyzing this data, agencies can learn how external forces are affecting fleet operation, including everything from weather, terrain, and loading to operator actions such as hard acceleration or braking. The key is active and ongoing monitoring of prognostic health data.

Unstructured Data 98

Unstructured Data Data Ingestion Government Machine Learning 98

Uber Engineering

AUGUST 22, 2019

The original carrier app was successful for owner-operators with one or two drivers, but it wasn’t optimized for larger fleets—feedback we … The post Building the New Uber Freight App as Lists of Modular, Reusable Components appeared first on Uber Engineering Blog.

Building 111

Building Engineering IT Architecture 111

Snowflake

OCTOBER 24, 2023

Founded nearly 70 years ago, Werner Enterprises is a North American transportation and logistics leader that operates a fleet of almost 8,300 trucks and 30,000 trailers out of 16 terminals across the United States. The company generates a massive amount of data on the constantly changing, real-time location of each of its assets.

Transportation 86

Transportation Data Warehouse Python Utilities 86

Cloudera

OCTOBER 28, 2021

The result is creative use cases that improve operational efficiency such as those around natural catastrophe management, telematics/fleet management, underwriting efficiency/document analysis, supply chain and construction insurance. Another example is fleet management.

Insurance 95

Insurance Transportation Unstructured Data Manufacturing 95

Snowflake

FEBRUARY 6, 2024

Vehicle manufacturers like Scania share data with fleet operators to improve maintenance and product design. Retailers like Aldi and Instacart share data with suppliers to improve demand forecasting, prevent the dreaded out-of-stock scenario and improve marketing.

Unstructured Data 95

Unstructured Data Retail Data Manufacturing 95

Engineering at Meta

APRIL 17, 2023

Millisampler runs on our server fleet collecting short, periodic snapshots of this data at 100us, 1ms, and 10ms time granularities, stores it in local disk, and makes it available for several days for on-demand analysis. Additionally, Millisampler is also able to identify in-region traffic and cross-region traffic (longer RTT).

Bytes 111

Bytes Transportation Data Collection Coding 111

Lyft Engineering

MARCH 6, 2024

LLM libraries) — a frequent ask from our engineering teams especially with recent Pythons, brings efficiency gains to our fleet to control our costs Given breaking changes in Python and its ecosystem, we can’t do everything by ourselves. linters) and libraries as they drop old Pythons or only work on the newest Pythons (e.g.

Python 72

Python Metadata Datasets Coding 72

Cloudera

JANUARY 5, 2021

Additionally, fleet maintenance costs were excessive due to unplanned downtime and the need for additional vehicles needed to anticipate the unplanned vehicle downtime. This retailer also implemented a follow-on use case of predictive analytics for maintenance, improving uptime of their delivery fleet.

Retail 91

Retail Unstructured Data Big Data Machine Learning 91

Snowflake

FEBRUARY 29, 2024

Logistics and fleet management: Optimizing routings and delivery times, and better management of fleets at scale. Sustainability and climate resilience analytics: Helping analysts to overcome the processing limitations and costs associated with handling and visualizing large raster data sets.

Insurance 78

Insurance SQL BI Consulting 78

Cloudera

OCTOBER 14, 2020

Additionally, airlines ensure availability and reliability of their fleet by leveraging maintenance, overhaul and repair (MRO) organizations, such as Lufthansa Technik. . Lufthansa Technik worked with Cloudera to build a predictive maintenance platform to service its fleet of 5000 aircraft throughout its global network of 800 MRO facilities.

Machine Learning 97

Machine Learning Building Engineering Transportation 97

Data Engineering Podcast

MAY 15, 2022

Summary Industrial applications are one of the primary adopters of Internet of Things (IoT) technologies, with business critical operations being informed by data collected across a fleet of sensors.

Designing 100

Designing MongoDB AWS SQL 100

Rockset

MAY 21, 2021

Fleet Management UPS delivers 21 million packages a day and coordinates shipments across a fleet of 123,000 vehicles on the road. As a result of these investments, companies are getting end-to-end visibility into their fleets and reducing costs. Fleet management solutions are technically challenging to build.

Retail 40

Retail Algorithm Big Data Finance 40

LinkedIn Engineering

DECEMBER 16, 2022

She highlights for us the impactful work she found here �����from ushering in LinkedIn���s next-generation, server query system that runs over a fleet of 350,000 servers, to mentoring the next generation of female engineers: In my engineering career, I���ve always followed the path less taken.

Systems 55

Systems Software Engineer Software Engineering Recruitment 55

Cloudera

OCTOBER 24, 2023

It could involve optimizing the way the fleet is deployed or developing an ability to dynamically schedule which routes they take. In addition to embedding AI to support back office (billing and payment processing, network operations, etc.) and front office (customer service, sales and marketing, etc.)

Government 77

Government Finance Deep Learning Data Governance 77

Netflix Tech

JUNE 7, 2021

The sidecar has been implemented by leveraging the highly performant eBPF along with carefully chosen transport protocols to consume less than 1% of CPU and memory on any instance in our fleet. The choice of transport protocols like GRPC, HTTPS & UDP is runtime dependent on characteristics of the instance placement.

Transportation 130

Transportation AWS Cloud Metadata 130

Ascend.io

FEBRUARY 12, 2023

You see a correlation between the weather, the number of miles driven, and the collisions in your fleet. Then, you can push those insights directly into your fleet systems, improving efficiency and safety. That’s great, but what can you do about it?

Business Analyst 52

Business Analyst Data Lake Data Pipeline Data 52

Ascend.io

FEBRUARY 12, 2023

You see a correlation between the weather, the number of miles driven, and the collisions in your fleet. Then, you can push those insights directly into your fleet systems, improving efficiency and safety. That’s great, but what can you do about it?

Business Analyst 52

Business Analyst Data Lake Data Pipeline Data 52

Ascend.io

FEBRUARY 12, 2023

You see a correlation between the weather, the number of miles driven, and the collisions in your fleet. Then, you can push those insights directly into your fleet systems, improving efficiency and safety. That’s great, but what can you do about it?

Business Analyst 52

Business Analyst Data Lake Data Pipeline Data 52

Pinterest Engineering

JANUARY 24, 2023

The intent of our compliance policies is to enforce our security hardening guidelines to ensure that the fleet of devices that are capable of accessing our tools are in compliance and in a hardened state. We currently integrate with Splunk, Chef, Workspace One, and osquery, with more integrations planned.

Certification 78

Certification Accessible Accessibility Engineering 78

Cloudera

JUNE 7, 2021

There are dozens of customers that use CDF for IoT use cases like Predictive Maintenance, Asset Tracking/Monitoring, Fleet Management, Smart Cities and many more. The Forrester Wave calls out CDF’s edge management features that enable such IoT use cases and leverage streaming analytics.

Kafka 101

Kafka Data Ingestion Architecture Cloud 101

The Pragmatic Engineer

OCTOBER 10, 2023

The company supports billions of active time series across its customer fleet. However, Martin had not written a line of production code for the last four years, as he’s taken on the role of CEO, and heads up observability scaleup Chronosphere – at more than 250 people and growing.

Software Engineer 247

Software Engineer Software Engineering Architecture Media 247

LinkedIn Engineering

DECEMBER 6, 2022

Historically, there were less rigid constraints around building snapshots and refreshing the same across our server fleet.�� Thanks, Nishan Weragama , Adam Debus , and Sean Patrick , for providing valuable feedback during the initial design and helping us stay aligned with the Fleet Compliance initiative.

Systems 55

Systems Metadata Datasets Designing 55

U-Next

MARCH 15, 2023

Validating inductive learning using inputs from the contemporary environment and achieving the high levels of dependability required for full fleet formation are the key technical challenges. Improved Fleet Effectiveness In supply chain management, timely product delivery is paramount.

Management 52

Management Manufacturing Electronics Machine Learning 52