François Nguyen

MARCH 22, 2021

Just an illustration – not the truth and you certainly can do it with other technologies. How do we build data products ? There are certainly many other ways to do the same with another technologies. More than the technology chosen, it is more interesting to talk about the spirit behind these choices.

Architecture 130

Architecture Technology Google Cloud Metadata 130

Precisely

DECEMBER 28, 2023

Enterprise technology is having a watershed moment; no longer do we access information once a week, or even once a day. This article explores what streaming data pipelines are, how they work, and how to build this data pipeline architecture. But insights derived from day-old data don’t cut it. Now, information is dynamic.

Data Pipeline 91

Data Pipeline Building Kafka Big Data 91

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. In this article, we will explore the advantages and limitations of data mesh, while also providing best practices for building and optimizing a data mesh with Striim.

Architecture 52

Architecture Generalist Government Datasets 52

Cloudera

SEPTEMBER 26, 2023

These solutions include on-premises and public cloud offerings with the data management, security and governance needed to build an enterprise data and analytic big data solution. The post IBM Technology Chooses Cloudera as its Preferred Partner for Addressing Real Time Data Movement Using Kafka appeared first on Cloudera Blog.

Kafka 91

Kafka Technology IT Government 91

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode Nick King discusses how you can be intentional about data creation in your applications and services to reduce the friction and errors involved in building data products and ML applications. What are the organizational patterns that are required to support effective workflows for building data generation capabilities?

Building 130

Building IT Metadata MongoDB 130

Lyft Engineering

JUNE 28, 2023

On the flip side, there was a substantial appetite to build real-time ML systems from developers at Lyft. The Event Driven Decisions capability in particular turned out to be general enough as to be applicable to a wide range of use cases. One key component is the Analytics Event Abstraction layer.

Machine Learning 115

Machine Learning Building Metadata Kafka 115

Data Engineering Podcast

AUGUST 10, 2020

Summary Event based data is a rich source of information for analytics, unless none of the event structures are consistent. The team at Iteratively are building a platform to manage the end to end flow of collaboration around what events are needed, how to structure the attributes, and how they are captured.

Data Collection 100

Data Collection Data Engineering Data Engineer Education 100

Snowflake

OCTOBER 2, 2023

Building resiliency into every element with Snowgrid At DTCC, the notion of resiliency is built into all our initiatives, including how we go about modernizing our applications. We have conducted at least 15 disaster recovery exercises using Snowgrid technology for business continuity. trillion per day in U.S. Curious about Snowgrid?

AWS 83

AWS Technology Data Cloud 83

Snowflake

DECEMBER 18, 2023

Data clean rooms have emerged as the technology to meet this need, enabling interoperability where multiple parties can collaborate on and analyze sensitive data in a governed way without exposing direct access to the underlying data and business logic. Snowflake’s acquisition of Samooha is subject to customary closing conditions.

Cloud 112

Cloud Building Entertainment Government 112

Workfall

SEPTEMBER 12, 2023

This makes it a powerful tool for building interactive and dynamic web applications that require instant data exchange between clients and servers, such as chat applications, online gaming, collaborative tools, and more. Its user-friendly API simplifies development, embracing an event-driven structure for custom interactions.

Building 89

Building MongoDB Programming Language Coding 89

Knowledge Hut

NOVEMBER 19, 2023

With advances in technology, wearable devices do provide some trace of your health. Furthermore, Data Scientists analyze this data, build reports and train ML models on top of it. This data can be used to build reports (batch or real-time) and train Machine Learning models. How do they collect, process, and analyze data for you?

Data Science 52

Data Science Technology Machine Learning Big Data 52

Cloudera

SEPTEMBER 13, 2023

Coupled with amazing technology was an amazing team that only grew and improved with the merger with Cloudera. It’s the Apache Software Foundation’s biggest event of the year. If a career in innovative technology is what you want and you’re excited about the open-source community, Cloudera might be the place for you.

Technology 83

Technology Hadoop Kafka Project 83

LinkedIn Engineering

AUGUST 3, 2023

As I worked closely with iOS, I wanted to learn everything I could about the UI and dedicated my time to coding files and researching how to build apps. While browsing one day, I found an opportunity at LinkedIn for a software engineer on the events team. For example, if I wanted to learn more about what's happening in the U.S.

Building 68

Building Software Engineer Software Engineering Computer Science 68

Snowflake

APRIL 17, 2024

In today’s data-driven world, developer productivity is essential for organizations to build effective and reliable products, accelerate time to value, and fuel ongoing innovation. Or, experience these features firsthand at our free Dev Day event on June 6th in the Demo Zone.

Data Pipeline 100

Data Pipeline Python Data Engineering Data Engineer 100

Snowflake

APRIL 20, 2023

Snowflake users are already taking advantage of LLMs to build really cool apps with integrations to web-hosted LLM APIs using external functions , and using Streamlit as an interactive front end for LLM-powered apps such as AI plagiarism detection , AI assistant , and MathGPT. Join us in Vegas at our Summit to learn more.

Building 113

Building Unstructured Data Government Coding 113

Confluent

MARCH 19, 2019

When should you use an event? I will attempt to articulate in layman’s terms what an event-driven architecture (EDA) is and contrast it with service-oriented architecture (SOA). In essence, this is an attempt to differentiate and/or associate APIs with events. Is not life simply a series of events? If it can, should it?

Architecture 110

Architecture Telecommunication Transportation Database 110

Snowflake

MAY 3, 2023

The free two-day event, taking place online May 17 and 18, will explore industry trends, data and technology innovations, and data strategy case studies in financial services. The post Accelerate: Why You Should Attend and Who Will Be at This Virtual Financial Services and Insurance Event appeared first on Snowflake.

Insurance 52

Insurance Banking Finance Cloud 52

Data Engineering Podcast

AUGUST 10, 2021

In this episode Mark Grover explains what he is building at Stemma, how it expands on the success of the Amundsen project, and why trust is the most important asset for data teams. It builds your customer data warehouse and your identity graph on your data warehouse, with support for Snowflake, Google BigQuery, Amazon Redshift, and more.

IT 130

IT Building Data Warehouse Python 130

Data Engineering Podcast

FEBRUARY 15, 2021

In order to help more businesses build those foundations, Tarush Aggarwal created 5xData, offering collaborative workshops to assist in setting up the technical and organizational systems that are necessary to succeed. Can you start by giving an overview of what you are building at 5xData and the story behind it?

Building 100

Building Data Warehouse BI Data Pipeline 100

Data Engineering Podcast

MARCH 27, 2022

In this episode Balaji Ganesan shares how his experiences building and maintaining Ranger in previous roles helped him understand the needs of organizations and engineers as they define and evolve their data governance policies and practices. What do you have planned for the future of Privacera? Closing Announcements Thank you for listening!

Data Governance 130

Data Governance Government Cloud Building 130

Data Engineering Podcast

SEPTEMBER 11, 2022

Building reliable data pipelines is a complex and costly undertaking with many layered requirements. In order to reduce the amount of time and effort required to build pipelines that power critical insights Manish Jethani co-founded Hevo Data. RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Pipeline 130

Data Pipeline Building MongoDB Scala 130

Data Engineering Podcast

AUGUST 31, 2020

Summary Data warehouse technology has been around for decades and has gone through several generational shifts in that time. When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Warehouse 100

Data Warehouse Cloud Building Data Lake 100

Data Engineering Podcast

AUGUST 26, 2019

Summary Data engineers are responsible for building tools and platforms to power the workflows of other members of the business. Upcoming events include the O’Reilly AI conference, the Strata Data conference, the combined events of the Data Architecture Summit and Graphorum, and Data Council in Barcelona.

Building 100

Building Data Analytics Media Data Engineering 100

Workfall

DECEMBER 19, 2023

Whether delving into team-building activities with the “Team Builder Guide” or seeking cinematic recommendations through the “Movie Recommendation” app, PartyRock delivers an expansive array of possibilities. Build Your Own App Click on “Build your own app” to create a custom app.

Building 81

Building AWS Accessible Accessibility 81

Snowflake

DECEMBER 19, 2023

But for many organizations, building this understanding is more akin to solving an ever-growing jigsaw puzzle (with no easy edge pieces!) If you don’t have to duplicate data, then you don’t have to pay egress costs or send your data across the internet, which means you can build your connections and get down to business faster.

Building 77

Building Pipeline-centric Database-centric Digital Media 77

Data Engineering Podcast

APRIL 6, 2020

In this episode John Maiden talks about how Cherre builds knowledge graphs that provide powerful insights for their customers and the engineering challenges of building a scalable graph. Upcoming events include ODSC East which has gone virtual starting April 16th. What are the main sources of data for the knowledge graph?

Building 100

Building Big Data Machine Learning Python 100

Data Engineering Podcast

JULY 27, 2021

The technology to make that possible has been around for a number of years, but the barriers to adoption have still been high due to the level of technical understanding and operational capacity that have been required to run at scale. Go to dataengineeringpodcast.com/97things today to get your copy!

Building 100

Building Management Kafka Data Warehouse 100

Data Engineering Podcast

MAY 15, 2022

Srivatsan Sridharan has had the opportunity to design, build, and run data lake platforms for both Yelp and Robinhood, with many valuable lessons learned from each experience. Signup for the SaaS product at dataengineeringpodcast.com/acryl RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 100

Data Lake Building BI Architecture 100

Data Engineering Podcast

MARCH 16, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. What is in store for the future of CouchDB?

Building 100

Building Data Warehouse NoSQL Data Lake 100

Cloudera

FEBRUARY 4, 2021

I am pleased to announce that Cloudera was just named the Risk Data Repository and Data Management Product of the Year in the Risk Markets Technology Awards 2021. . This facilitates real-time insights to improve detection, decision-making and actioning based on critical market events. Cloudera is that platform.

Technology 88

Technology Data Management Management Insurance 88

Workfall

APRIL 6, 2023

Let’s imagine a case in IoT whereby a smoke detector needs to relay information to water sprinklers in a burning building. Clients can subscribe to specific data events on the server using GraphQL Subscriptions, such as the creation of a new resource or the updating of an existing one. applications.

MongoDB 59

MongoDB Building Transportation PostgreSQL 59

Data Engineering Podcast

JANUARY 23, 2022

He also provides some excellent insights into the factors that play into the build vs. buy decision at different organizational sizes. Given the current state of the technology and services landscape, how would you approach the design and implementation of a greenfield rebuild of your platform?

Building 100

Building Management Data Pipeline Metadata 100

AltexSoft

MAY 12, 2022

But acoustic signals can tell us even more if analyze them using modern technologies. Aiming at understanding sound data, it applies a range of technologies, including state-of-the-art deep learning algorithms. It offers a non-invasive type of remote patient monitoring to detect events like falling. Voice recognition.

Machine Learning 122

Machine Learning Building Datasets Healthcare 122

Data Engineering Podcast

OCTOBER 28, 2019

In an effort to create a better abstraction for building data applications Nick Schrock created Dagster. In this episode he explains his motivation for creating a product for data management, how the programming model simplifies the work of building testable and maintainable pipelines, and his vision for the future of data programming.

Building 100

Building Data Pipeline Programming Language Metadata 100

Ascend.io

JANUARY 2, 2024

From building the connectors to ensuring that data lands smoothly in your reporting warehouse, each step requires a nuanced understanding and strategic approach. In this article, we explore how to build a data pipeline from the ground up in six steps. Which tools and technologies best align with our data needs and objectives?

Data Pipeline 52

Data Pipeline Building Raw Data Data Warehouse 52

Data Engineering Podcast

SEPTEMBER 2, 2019

In this episode Pete discusses his motivation for starting these events, how they serve to bring the data community together, and the observations that he has made about the direction that we are moving. What are some of the complexities or challenges in building one based on something as nebulous as data?

Building 100

Building Data Database Design Media 100

Data Engineering Podcast

FEBRUARY 8, 2021

Summary With all of the tools and services available for building a data platform it can be difficult to separate the signal from the noise. One of the best ways to get a true understanding of how a technology works in practice is to hear from people who are running it in production. Closing Announcements Thank you for listening!

Data Warehouse 100

Data Warehouse Building BI SQL 100