DoorDash Engineering

MARCH 12, 2024

The DoorDash ETA team is committed to providing an accurate and reliable estimated time of arrival (ETA) as a cornerstone DoorDash consumer experience. We want to ensure that every customer can trust our ETAs, ensuring a high-quality experience in which their food arrives on time every time.

Deep Learning 89

Deep Learning Food Machine Learning Architecture 89

Christophe Blefari

NOVEMBER 18, 2023

It was a necessary break for me and a blank page syndrome at the same time. On Monday I'll also give a talk at Berlin MotherDuck meetup : DuckDB experiments, a glimpse of the future. Mainly they announced GPTs , a no-code UI to create custom versions of ChatGPT. This is linked as well to Microsoft making custom AI chips.

Food 147

Food Data Data Lake Retail 147

Striim

APRIL 22, 2024

Discovery Health, originating in South Africa, has transcended borders to extend its services to over 40 million customers across more than 40 global markets, encompassing regions in Asia, EMEA, and the Americas. The objective with Striim and CDC usage was to simplify pipelines and minimize latency for real-time decision support.”

Healthcare 52

Healthcare Insurance Portfolio Banking 52

Data Engineering Podcast

DECEMBER 17, 2023

Summary The "modern data stack" promised a scalable, composable data platform that gave everyone the flexibility to use the best tools for every job. The reality was that it left data teams in the position of spending all of their engineering effort on integrating systems that weren't designed with compatible user experiences.

Data Lake 130

Data Lake High Quality Data SQL Architecture 130

LinkedIn Engineering

OCTOBER 19, 2023

This robust framework empowers near real-time data processing for critical services and platforms, ranging from machine learning and notifications to anti-abuse AI modeling. In 2010, they introduced Apache Kafka , a pivotal Big Data ingestion backbone for LinkedIn’s real-time infrastructure.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Snowflake

MARCH 12, 2024

You’ll want to analyze not just where your nearest competitors and potential customers are, but also retail footfall numbers, historical traffic patterns, distance from distribution centers, environmental factors, potential delivery times to customers and more. You need geospatial data to make it all happen.

Business Analyst 91

Business Analyst Retail Business Intelligence Data Analysis 91

Data Engineering Podcast

DECEMBER 3, 2023

RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. You specify the customer traits, then Profiles runs the joins and computations for you to create complete customer profiles.

Systems 130

Systems Designing Data Lake SQL 130

Lyft Engineering

NOVEMBER 29, 2023

Introduction At Lyft, we have used systems like Apache ClickHouse and Apache Druid for near real-time and sub-second analytics. Sub-second query systems allow for near real-time data explorations and low latency, high throughput queries, which are particularly well-suited for handling time-series data.

Kafka 104

Kafka Data Ingestion Datasets Architecture 104

Snowflake

SEPTEMBER 13, 2023

Snowflake and Salesforce have built on our existing partnership to unify the full breadth of customer and business data and generate actionable insights for our customers. With this first-of-its-kind integration, joint customers can enhance the value of their Salesforce data by combining it with enterprise data in Snowflake.

Finance 99

Finance AWS Accessible Accessibility 99

Knowledge Hut

APRIL 26, 2024

Machine Learning without data sets will not exist because ML depends on data sets to bring out relevant insights and solve real-world problems. Machine learning uses algorithms that comb through data sets and continuously improve the machine learning model. In the real world, data sets are huge.

Datasets 81

Datasets Machine Learning Deep Learning Finance 81

Snowflake

APRIL 16, 2024

The fear is that we will have to reinvent how we target and have an even harder time measuring engagement. Neither is true if we use the deprecation of third-party cookies and subsequent shift to first-party data as a positive forcing factor. Take it one step at a time. Start with a single use case and build up from there.

Cloud 71

Cloud Government Data AWS 71

Striim

APRIL 3, 2024

This explosion in cloud application use has led to significant challenges in data integration and the delivery of insightful data to stakeholders. With its no-code, zero-maintenance approach, it offers a cost-effective solution for businesses seeking real-time data insights and monitoring. Enterprises in the U.S.

Google Cloud 52

Google Cloud Transportation Data Integration Aggregated Data 52

Cloudera

MARCH 26, 2024

Today, 44% of organizations are experimenting with generative AI, with 10% having already implemented it in operational settings. It is more important than ever for companies to support the deployment of customer AI use cases, which is why I am excited about Cloudera’s Enterprise AI Fast Start.

Machine Learning 79

Machine Learning Banking Professional Services Architecture 79

Snowflake

FEBRUARY 21, 2024

Hybrid Tables is a new table type that enables transactional use cases within Snowflake with fast, high-concurrency point operations. Get started quickly with the syntax you know Hybrid Tables are easy to use and simple to manage. Read more about MarketWise Solutions’ Hybrid Tables experience. What’s next?

Government 92

Government AWS Data Architect Architecture 92

Netflix Tech

JUNE 14, 2023

Doing this safely for 100s of millions of customers without disruption is exceptionally challenging, especially considering the many dimensions of change involved. This blog post will share broadly-applicable techniques (beyond GraphQL) we used to perform this migration. To launch Phase 1 safely, we used AB Testing.

Utilities 141

Utilities Java Systems AWS 141

DoorDash Engineering

NOVEMBER 7, 2023

Figure 1: An example of a real-time push notification to prompt purchase completion. To polish the notification experience, we want to ensure that cart abandonment notifications are sent in a timely manner — but only when users truly stop adding to their carts and abandon the app.

Designing 96

Designing Coding Process Management 96

Knowledge Hut

JANUARY 11, 2024

Data scientists have been using data science techniques to solve challenging real-world issues in healthcare, agriculture, manufacturing, automotive, and many more. An excellent way to achieve this is through reading industry data science case studies. Almost every industry uses data science in some way.

Data Science 80

Data Science Transportation Hospitality Banking 80

Netflix Tech

NOVEMBER 3, 2023

On the Data Platform team, we build the infrastructure used across the company to process data at scale. The Processors themselves are implemented as Flink jobs that use the DataStream API. Since then, we have seen many use cases (including Netflix Graph Search ) adopt Data Mesh for stream processing.

SQL 106

SQL Pipeline-centric Kafka Data 106

Knowledge Hut

APRIL 23, 2024

It offers advanced threat detection, real-time updates, and features like web browsing protection and email scanning. Kaspersky Anti-Virus: Kaspersky Anti-Virus is a highly respected cybersecurity solution that offers excellent malware protection through advanced scanning algorithms and real-time updates.

Database 52

Database Programming Education Cloud 52

Lyft Engineering

JUNE 28, 2023

On the real-time front, LyftLearn supported real-time inference and input feature validation. While several teams were using streaming data in their Machine Learning (ML) workflows, doing so was a laborious process, sometimes requiring weeks or months of engineering effort.

Machine Learning 115

Machine Learning Building Metadata Software Engineer 115

Knowledge Hut

APRIL 24, 2024

Project-based learning is a cornerstone of software engineering education, fostering key competencies and hands-on experience that surpass traditional theoretical learning. Tools such as HTML, CSS, JavaScript, React, and Firebase are used in this project. cvtColor(image, cv2.COLOR_BGR2GRAY) COLOR_BGR2GRAY) _, thresh = cv2.threshold(gray_image,

Software Engineer 52

Software Engineer Software Engineering Coding Project 52

Precisely

JANUARY 27, 2023

In today’s hypercompetitive business environment, companies must deliver a standout experience for their target audience. Companies that excel at customer experience (CX) are better at building brand loyalty, increasing total customer lifetime value, and turning occasional customers into brand evangelists.

High Quality Data 105

High Quality Data Data Governance Government Banking 105

Striim

APRIL 1, 2024

Striim Cloud for Application Integration provides a crucial solution to this issue, designed to improve the connectivity and usefulness of these applications by enabling their smooth integration into Google Cloud’s BigQuery. Secure Connectivity: Secure, OAuth connectivity and SAML 2.0

Hospitality 52

Hospitality Transportation Google Cloud Cloud 52

Engineering at Meta

MARCH 20, 2024

At Meta, we support real-time communication (RTC) for billions of people through our apps, including Messenger, Instagram, and WhatsApp. But if we look at real-time communication (RTC) applications, while the video quality also has improved over time, it has always lagged behind that of camera quality.

Algorithm 86

Algorithm Manufacturing Media Coding 86

Cloudera

OCTOBER 4, 2023

Fast moving data and real time analysis present us with some amazing opportunities. Every organization has some data that happens in real time, whether it is understanding what our users are doing on our websites or watching our systems and equipment as they perform mission critical tasks for us.

Telecommunication 85

Telecommunication Data Warehouse Java Manufacturing 85

Tweag

APRIL 17, 2024

Although the program was filled with appealing talks, we ended up spending most of our time chatting with people and visiting booths, something you can’t do as easily online. We had cool conversations around writing custom security policies as Nickel contracts with the new LSP background contract checking (introduced in 1.5)

Cloud 76

Cloud Consulting Portfolio Programming 76

Knowledge Hut

MARCH 19, 2024

In this article, I will take you across some of the cool cloud computing case study examples and highlight cloud implementation in those cases. Instead of relying on local servers or personal devices to run applications, organizations and individuals can use a remote "cloud" of " servers to store and process data."

Cloud Computing 52

Cloud Computing Cloud Amazon Web Services AWS 52

Snowflake

DECEMBER 20, 2023

The rise of generative AI (gen AI) is inspiring organizations to envision a future in which AI is integrated into all aspects of their operations for a more human, personalized and efficient customer experience. You can read more about their experience with Snowpark Container Services in this two-part blog series ( part 1 , part 2 ).

Scala 117

Scala Government Java AWS 117

Monte Carlo

JANUARY 3, 2024

For most data teams, that’s because you’re racing and it’s early and you want to gain some experience. However, it won’t be long before your users have a problem that’s best solved by GenAI, and when that happens – you will have much better adoption compared to your tiger team brainstorming ways to tie GenAI to a use case.

Technology 113

Technology Database Data Governance Data Engineering 113

Knowledge Hut

MARCH 20, 2024

But how to select the right certificate at the right time on your growing career path? In my case I picked PMP as the entrance of my project management journey in 2005. So far, you already are a strategic thinker from entire business strategy while successfully managing the complex projects and groups of projects at same time.

Certification 89

Certification Portfolio Finance Programming 89

Snowflake

DECEMBER 5, 2023

Engaging with partners and customers — and showcasing what’s new on the Snowflake product front — made for a dynamic time in Las Vegas. To ensure data remains protected from unintended use, Snowflake Cortex (now in private preview) gives users access to industry-leading LLMs (e.g.,

AWS 93

AWS Amazon Web Services Government Cloud Computing 93

Knowledge Hut

APRIL 25, 2024

Many organizations use training methods to improve potential hires' preexisting skills and knowledge. Off-the-job training method involves classroom learning methods such as projects, presentations, case studies, and assignments. After some time, they begin to carry out their tasks under the administration of a senior manager.

Manufacturing 52

Manufacturing Hospitality Education Programming 52

Knowledge Hut

APRIL 26, 2024

In this article, we will learn about penetration testing, its requirements and understand how real-world ethical hackers perform hacking attacks. Penetration testers use the same tools, techniques, and processes as attackers to find and demonstrate the business impacts of weaknesses in a system. What is P enetration T esting?

Cloud 92

Cloud Systems Database SQL 92

Precisely

NOVEMBER 20, 2023

It has been at the heart of many innovations over the past two years, powering everything from the chatbots that enhance our customer experiences to the predictive analytics engines that help us make financial decisions. They may stop using it, and they’re likely to approach future initiatives with skepticism.

Raw Data 121

Raw Data Insurance Data Retail 121

The Modern Data Company

JULY 24, 2023

By chaining data products together, organizations can unlock new levels of data-driven decision-making and drive impactful use cases. Understanding Chaining Data Products Chaining data products refers to the process of integrating and interconnecting multiple data products to create a data ecosystem that supports complex use cases.

Data Lake 85

Data Lake Transportation Algorithm Data 85

Cloudera

OCTOBER 5, 2023

Perhaps the process is time consuming and cumbersome. Or you are only currently using data for a few use cases and struggle to implement organization wide. Using data effectively is the key to competing in today’s world as customer expectations continue to rise. Maybe the insights aren’t accurate.

Data Governance 80

Data Governance Unstructured Data Government High Quality Data 80