Rockset

MARCH 18, 2024

Today, Confluent announced the general availability of its serverless Apache Flink service. Flink is one of the most popular stream processing technologies, ranked as a top five Apache project and backed by a diverse committer community including Alibaba and Apple.

Cloud 64

Cloud Building Metadata Kafka 64

Cloudera

JUNE 22, 2023

In spite of diligent digital transformation efforts, most financial services institutions still support a loose patchwork of siloed systems and repositories. The top-line benefits of a hybrid data platform include: Cost efficiency. Simplified compliance. Improved scalability and agility. Flexibility.

Data Cleanse 68

Data Cleanse Data Governance Unstructured Data Cloud Storage 68

Snowflake

JUNE 28, 2023

We’ve talked about this opportunity before and at Summit 2023, we announced a number of capabilities that come together to help our customers bring generative AI and LLMs directly to their proprietary data, all delivered through a single, secure platform. Read on to learn more about these announcements.

Pipeline-centric 73

Pipeline-centric Unstructured Data Government Data 73

Pinterest Engineering

NOVEMBER 7, 2023

Jeff Xiang | Software Engineer, Logging Platform Vahid Hashemian | Software Engineer, Logging Platform Jesus Zuniga | Software Engineer, Logging Platform At Pinterest, data is ingested and transported at petabyte scale every day, bringing inspiration for our users to create a life they love.

Kafka 99

Kafka Java Software Engineer Software Engineering 99

Lyft Engineering

JUNE 28, 2023

In early 2022, Lyft already had a comprehensive Machine Learning Platform called LyftLearn composed of model serving , training , CI/CD, feature serving , and model monitoring systems. However, streaming data was not supported as a first-class citizen across many of the platform’s systems — such as training, complex monitoring, and others.

Machine Learning 115

Machine Learning Building Metadata Kafka 115

Snowflake

AUGUST 16, 2023

Read our Summit recap blog for highlights across industries or watch Summit sessions now on-demand. Applications Snowflake Native App Framework now available in AWS – public preview Snowflake Native Apps are an entirely new way to put data to work. If you missed out, not to worry! Learn more here. Learn more here.

Scala 52

Scala Transportation Kafka Data Lake 52

Cloudera

APRIL 19, 2023

Data has become an essential driver for new monetization initiatives in the financial services industry. With the emergence of new technologies, including privacy enhancing techniques (PETs) that further protect the customer, monetizing data has become more accessible than ever before.

Banking 73

Banking Retail Portfolio Finance 73

Cloudera

OCTOBER 11, 2022

I recommend you read the entire piece, but to me the key takeaway – AI at scale isn’t magic, it’s data – is reminiscent of the 1992 presidential election, when political consultant James Carville succinctly summarized the key to winning – “it’s the economy”. It’s because of data. . Data science needs analytics.

Data Science 95

Data Science Aggregated Data Data Consulting 95

Cloudera

APRIL 20, 2021

What is Streaming Analytics? Streaming Analytics is a type of data analysis that processes data streams for real-time analytics. It continuously processes data from multiple streams and performs simple calculations to complex event processing for delivering sophisticated use cases.

Hospitality 96

Hospitality Kafka Retail Data Ingestion 96

Cloudera

APRIL 9, 2021

This is part 4 in this blog series. This blog series follows the manufacturing and operations data lifecycle stages of an electric car manufacturer – typically experienced in large, data-driven manufacturing companies. The second blog dealt with creating and managing Data Enrichment pipelines.

Machine Learning 98

Machine Learning Manufacturing Data Collection Data Science 98

Data Engineering Weekly

MARCH 10, 2024

Editor’s Note: Chennai Meetup Wrap-Up & Preparation work started for DEWCon I am so grateful for the enthusiastic participants who made our Chennai Data Heroes- Community for Data Folks meetup vibrant! Big thanks to our insightful speakers, Hareshkumar Selvakumar - Talks about his work on Data Products for PayPal.

Data Engineering 52

Data Engineering Data Engineer Engineering Datasets 52

Cloudera

FEBRUARY 4, 2021

Financial services institutions need the ability to analyze and act on massive volumes of data from diverse sources in order to monitor, model, and manage risk across the enterprise. They need a comprehensive data and analytics platform to model risk exposures on-demand. Cloudera is that platform.

Technology 90

Technology Data Management Management Insurance 90

Knowledge Hut

APRIL 23, 2024

If you are unaware of the future of Business Intelligence, this is the best platform for you. Data plays a crucial role in identifying opportunities for growth and decision-making in today's business landscape. So, BI empowers businesses to understand their respective customers, make data-driven decisions, and analyze market trends.

Business Intelligence 52

Business Intelligence BI Data Analysis Media 52

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. What is a Data Mesh and how does it work? The Data Mesh architecture is based on four core principles: scalability, resilience, elasticity, and autonomy.

Architecture 52

Architecture Generalist Government Datasets 52

Snowflake

JULY 13, 2023

As we continue to revolutionize the way businesses operate, allowing them to solve their most pressing problems and drive revenue through the Data Cloud, the insights, expertise, and experiences we offer at Summit have continued to grow. Snowflake is democratizing access to data and intelligence with AI and large language models (LLMs).

Entertainment 57

Entertainment Manufacturing Retail Media 57

Knowledge Hut

JANUARY 18, 2024

“Big data Analytics” is a phrase that was coined to refer to amounts of datasets that are so large traditional data processing software simply can’t manage them. For example, big data is used to pick out trends in economics, and those trends and patterns are used to predict what will happen in the future.

Data Process 52

Data Process Process Hadoop Scala 52

Snowflake

MARCH 21, 2023

In February, Snowflake launched new features around streaming data ingestion and data governance and improved SQL experience and performance, with enhancements to Search Optimization Service and more. Check out Felipe Hoffa’s video on how to use Snowsight to get from data to decision faster. Learn more here.

Retail 73

Retail Healthcare Data Ingestion Consulting 73

Cloudera

JANUARY 5, 2023

In the past year, businesses who doubled down on digital transformation during the pandemic saw their efforts coming to fruition in the form of cost savings and more streamlined data management. 1- Treating data as a strategic business asset . 2- Operationalizing adaptive AI systems for quicker business decision-making.

Banking 52

Banking Machine Learning Insurance Data Architecture 52

Knowledge Hut

DECEMBER 28, 2023

Human society in 2023 is a digital world, and its fuel - its currency - is data. Today, organizations seek skilled professionals who can harness data’s power to drive informed decisions. As technology evolves, cloud platforms have emerged as the cornerstone of modern data management. Who is an Azure Data Engineer?

Certification 52

Certification Data Engineering Data Engineer Engineering 52

LinkedIn Engineering

DECEMBER 20, 2023

Our members rely on us to create an environment on our platform where they can safely learn and grow in their careers. In this blog post, we discuss how we are harnessing AI to help us with abuse prevention and share an overview of our infrastructure and the role it plays in identifying and mitigating abusive behavior on our platform.

Building 91

Building Algorithm Kafka Machine Learning 91

Databand.ai

AUGUST 30, 2023

DataOps is a collaborative approach to data management that combines the agility of DevOps with the power of data analytics. It aims to streamline data ingestion, processing, and analytics by automating and integrating various data workflows. As a result, they can be slow, inefficient, and prone to errors.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

ProjectPro

FEBRUARY 6, 2023

Google Pub/Sub provides global distribution of messages making it possible to send and receive messages from across the globe. Google Cloud Pub/Sub is a global, cloud-based messaging framework that has become increasingly popular among data engineers over recent years. What is Google Pub/Sub?

Google Cloud 52

Google Cloud Cloud Cloud Storage Data Ingestion 52

Databand.ai

DECEMBER 13, 2022

The Top 25 Data Engineering Influencers and Content Creators on LinkedIn Ryan Yackel 2022-12-13 10:23:19 Interested in data engineering? LinkedIn is full of influencers sharing new ideas and sparking conversations on all kinds of topics, and data engineering is no exception. You’ve come to the right place.

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Netflix Tech

DECEMBER 8, 2021

Project by Netflix’s Cloud Infrastructure Security team ( Alex Bainbridge , Mike Grima , Nick Siow) Cloud security is a hard problem, but an even harder one is cloud security at scale. In 2020, we decided to reinvent how we handle cloud security findings by redefining how we write and respond to cloud detections.

AWS 78

AWS Metadata Cloud Utilities 78

Striim

NOVEMBER 30, 2022

Businesses of all scales and industries have access to increasingly large amounts of data, which need to be harnessed effectively. According to an IDG Market Pulse survey , companies collect data from 400 sources on average. However, fragmented data can slow down the delivery of great product experiences and internal operations.

AWS 52

AWS Cloud Management Google Cloud 52

Edureka

FEBRUARY 9, 2023

Azure Data Engineering is a rapidly growing field that involves designing, building, and maintaining data processing systems using Microsoft Azure technologies. As a certified Azure Data Engineer, you have the skills and expertise to design, implement and manage complex data storage and processing solutions on the Azure cloud platform.

Data Engineering 52

Data Engineering Data Engineer Engineering Amazon Web Services 52

LinkedIn Engineering

DECEMBER 12, 2023

We will detail our approach to add even more safeguards to viewer privacy on post analytics, which is the result of a joint venture across multiple teams at LinkedIn. We will start with a general overview of differential privacy, the gold standard of enforcing privacy for data analytics, which we adopt in post analytics.

Algorithm 77

Algorithm Metadata SQL Datasets 77

Cloudera

SEPTEMBER 9, 2021

Cloudera Machine Learning or Cloudera Data Warehouse), to deliver fast data and analytics to downstream components. The intent of this article is to demonstrate the value proposition of COD as a multi-modal operational database capability over legacy HBase deployments across three value areas: . Technology Cost Optimization.

Database 96

Database AWS Relational Database Cloud 96

Data Engineering Weekly

DECEMBER 11, 2022

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. It's the year's end, so there is plenty of 2023 predictions in Data Engineering.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Confluent

APRIL 18, 2019

Frehse and his team are using Confluent Cloud and associated IoT technologies to build a data-driven food value chain for all their partners from farm to fork. And they believe they are the only company in the industry doing so at such massive scale horizontally across all members of the value chain.

Food 83

Food Cloud Retail Kafka 83

Cloudera

APRIL 27, 2021

Cable and Satellite companies in the US have emerged from a decade of acquisitions, consolidation and shakeout and are beginning to assert themselves as full service providers in the communications and media space. All of these businesses are awash with data. The impact of siloed data. Can they interpret what they’re seeing?

Telecommunication 67

Telecommunication Entertainment Media Government 67

Cloudera

AUGUST 31, 2021

Cloudera and Accenture demonstrate strength in their relationship with an accelerator called the Smart Data Transition Toolkit for migration of legacy data warehouses into Cloudera Data Platform. Accenture’s Smart Data Transition Toolkit . Are you looking for your data warehouse to support the hybrid multi-cloud?

Data Warehouse 85

Data Warehouse Database-centric Metadata Cloud 85

Knowledge Hut

OCTOBER 29, 2023

From machine learning algorithms to data mining techniques, these ideas are sure to challenge and engage you. Till then, pick a topic from this blog and get started on your next great computer science project. Investigating the security risks associated with hospital data. Creating a database to store patient information.

Computer Science 111

Computer Science Coding Project Hospitality 111

Knowledge Hut

JULY 26, 2023

This blog talks about the important factors and distinctions between mobile and cloud computing to clarify which would suit your needs. Mobile computing refers to using portable devices like smartphones and tablets to access and use digital information and services.

Cloud Computing 52

Cloud Computing Cloud Cloud Storage Banking 52

Cloudera

SEPTEMBER 30, 2022

Cloudera DataFlow for the Public Cloud (CDF-PC) is a cloud-native service for Apache NiFi within the Cloudera Data Platform (CDP). Since its initial release in 2021, CDF-PC has been helping customers solve their data distribution use cases that need high throughput and low latency requiring always-running clusters.

Google Cloud 76

Google Cloud AWS Cloud Cloud Storage 76

Knowledge Hut

OCTOBER 26, 2023

IoT is the process of gathering and sharing data among a network of linked devices to improve decision-making. This initiative lessens reliance on weather forecasting services. The system gathers data from the temperature, humidity, and rain sensors and uses the internet to post statistics online.

Coding 98

Coding Project Electronics Cloud Computing 98

ProjectPro

FEBRUARY 16, 2023

Over 3 billion monthly searches, 2,400+ unique apps and add-ons, and 1,000+ unique data integrations make SPLUNK ‘the big data solution for the hybrid world’! With over 18000 customers worldwide, Splunk is the most popular option for businesses seeking to improve productivity, profitability, competitiveness, and security.

Big Data 52

Big Data Big Data Tools Cloud Data 52