François Nguyen

MARCH 22, 2021

Just an illustration – not the truth and you certainly can do it with other technologies. There are certainly many other ways to do the same with another technologies. More than the technology chosen, it is more interesting to talk about the spirit behind these choices. How do we build data products ?

Architecture 130

Architecture Technology Google Cloud Metadata 130

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. By exploring the benefits of using Data Mesh for your event streaming architecture, this article will help you decide if it’s the right solution for your organization.

Architecture 52

Architecture Generalist Government Datasets 52

Scott Logic

JUNE 29, 2023

Every year on Global Accessibility Awareness Day , people come together to raise awareness about the barriers many users still face in the digital world. This May, we, Doro Hinrichs and Oded Sharon, attended an accessibility panel discussion and workshop with UserVision on Creating Accessible Digital Experiences.

Accessible 52

Accessible Accessibility Consulting Designing 52

Data Engineering Podcast

FEBRUARY 18, 2024

Join in with the event for the global data community, Data Council Austin. Don't miss out on their only event this year! What are the differences in terms of pipeline design/access and usage patterns when using a Trino/Iceberg lakehouse as compared to other popular warehouse/lakehouse structures?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Scott Logic

NOVEMBER 14, 2023

Rather, I am talking here about asynchronously distributing data to other services that maintain their own copy of the data in order to do their work or where we want to emit and distribute events for other services to process. That said, I’ll try and call out when a technology is better for one or another.

Technology 52

Technology Kafka AWS Data 52

Data Engineering Podcast

AUGUST 10, 2020

Summary Event based data is a rich source of information for analytics, unless none of the event structures are consistent. The team at Iteratively are building a platform to manage the end to end flow of collaboration around what events are needed, how to structure the attributes, and how they are captured.

Data Collection 100

Data Collection Data Engineering Data Engineer Education 100

Knowledge Hut

NOVEMBER 19, 2023

With advances in technology, wearable devices do provide some trace of your health. Importance of Data Science in IoT IoT and Data Science are amongst the most defining technologies of our age. Challenges of Data Science for IoT Any great technology brings along its own unique set of challenges. Here is the broad.

Data Science 52

Data Science Technology Machine Learning Big Data 52

Data Engineering Podcast

MARCH 3, 2024

Summary Artificial intelligence technologies promise to revolutionize business and produce new sources of value. Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Visit dataengineeringpodcast.com/data-council and use code dataengpod20 to register today!

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Knowledge Hut

MAY 3, 2024

Dean Wampler (Renowned author of many big data technology-related books) Dean Wampler makes an important point in one of his webinars. And hence, there is a need to understand the concept of “stream processing “and the technology behind it. Kafka offers better fault tolerance because of its event-driven processing.

Kafka 98

Kafka Scala Java Amazon Web Services 98

Data Engineering Podcast

APRIL 23, 2023

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. What are the shifts that have made them more accessible to a wider variety of teams? What do you have planned for the future of Meroxa?

Data Lake 277

Data Lake Kafka Machine Learning Data Warehouse 277

Snowflake

APRIL 11, 2024

At Snowflake, we believe in making the power of data accessible to all. Not only do we have a unique vantage point into the challenges faced by data analysts, we also possess rich metadata that feeds into Snowflake’s dedicated text-to-SQL model that Copilot leverages in combination with Mistral’s technology.

SQL 134

SQL AWS Data Analysis High Quality Data 134

Data Engineering Podcast

MARCH 17, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? When is Datafold/data-diff the wrong choice? Data Council : ![Data

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

MARCH 10, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Contact Info LinkedIn Twitter Alex's Article on Dremio's Blog Alex's Substack Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Data Engineering Podcast

NOVEMBER 26, 2023

Summary Building a data platform that is enjoyable and accessible for all of its end users is a substantial challenge. Developing event-driven pipelines is going to be a lot easier - Meet Functions! Memphis Logo]([link] Developing event-driven pipelines is going to be a lot easier - Meet Functions!

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Cloudera

FEBRUARY 4, 2021

I am pleased to announce that Cloudera was just named the Risk Data Repository and Data Management Product of the Year in the Risk Markets Technology Awards 2021. . SDX enables safe and compliant self-service access to data and analytics. They need a comprehensive data and analytics platform to model risk exposures on-demand.

Technology 88

Technology Data Management Management Insurance 88

Data Engineering Podcast

DECEMBER 24, 2023

Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems. In the event of these different cluster errors, what are the strategies for mitigating and recovering from those failures? Operating it at scale, however, is notoriously challenging.

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Knowledge Hut

MAY 2, 2024

From the most technologically savvy person working in leading digital platform companies like Google or Facebook to someone who is just a smartphone user, there are very few who have not been impacted by artificial intelligence or machine learning in some form or the other; through social media, smart banking, healthcare or even Uber.

Machine Learning 98

Machine Learning Algorithm Datasets Deep Learning 98

Cloudera

MAY 10, 2024

Building an open data lakehouse with Iceberg delivers significant benefits increasing self-service access, ease of use, flexibility, and delivering unified security and governance for all data. From data pipelines into Iceberg to data governance, the event will hit on a broad range of topics surrounding Iceberg.

Government 68

Government Data Governance Data Pipeline Big Data 68

Data Engineering Podcast

MARCH 24, 2024

Contact Info Twitter LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? What do you have planned for the future of Dagster/Dagster Cloud/Dagster+? Closing Announcements Thank you for listening! Don't forget to check out our other shows.

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Snowflake

JUNE 28, 2023

External Network Access (PrPr) – Allows users to seamlessly connect to external endpoints from their Snowpark code (UDFs/UDTFs and Stored procedures) while maintaining high security and governance. Python Tasks API (PrPr Soon) – Provides first class Python APIs for creating and managing Snowflake Tasks/DAGs.

Python 52

Python Accessible Accessibility Pipeline-centric 52

Cloudera

APRIL 18, 2024

With the arrival of the latest AI-powered technologies like large language models (LLMs) and generative AI (GenAI), there’s a vast amount of opportunities for innovation, growth, and improved business outcomes right around the corner. All of that technology, though, depends on data to be successful.

Metadata 106

Metadata Government Data Governance Data 106

Cloudera

MARCH 6, 2024

As we enter into a new month, the Cloudera team is getting ready to head off to the Gartner Data & Analytics Summit in Orlando, Florida for one of the most important events of the year for Chief Data Analytics Officers (CDAOs) and the field of data and analytics. Add a Human To The Loop: An Introduction to RLHF & DPO.

Data Analytics 106

Data Analytics Data Technology Data Engineering 106

Data Engineering Podcast

MARCH 18, 2023

Summary As with all aspects of technology, security is a critical element of data applications, and the different controls can be at cross purposes with productivity. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Join in with the event for the global data community, Data Council Austin.

Data Security 130

Data Security Machine Learning Data Science Metadata 130

The Pragmatic Engineer

NOVEMBER 21, 2023

Joshua is currently VP of Product & Strategy at VMware, a cloud computing and virtualization technology company. Joshua also writes an excellent Substack newsletter about how to design products which customers love, how to operate live services at scale, grow and optimize your technology orgs, and the history of the tech industry.

Engineering 283

Engineering Bytes Cloud Computing AWS 283

Data Engineering Podcast

APRIL 16, 2023

As the capabilities of these systems has improved and become more accessible, the target of what self-serve means changes. Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools.

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Knowledge Hut

DECEMBER 22, 2023

Voice Search Benefits: Improved User Experience Accessibility Hands-free Interaction Faster Search Results Examples: Integrating voice-enabled search boxes or chatbots on websites to allow users to perform voice-based searches. Implementing voice recognition technology and APIs to accurately transcribe and process voice inputs.

Entertainment 105

Entertainment Utilities Machine Learning AWS 105

Snowflake

APRIL 29, 2024

This regulation aims to strengthen the operational resilience of financial entities (FEs), and their third-party information and communication technology (ICT) providers. This strategy must incorporate business impact analyses as well as backup and recovery plans in the event of a security incident or loss of access to data.

Transportation 79

Transportation Data Governance Government Consulting 79

Robinhood

MARCH 26, 2024

The event is available to livestream on go.robinhood.com/presents at 7:15 pm ET on March 26 and will be available for replay. It’s why we started Robinhood and gave our customers access to features like commission free trading and the 24 Hour Market,” said Vlad Tenev, Co-Founder and CEO of Robinhood. Robinhood Credit, Inc.

Banking 120

Banking Insurance Finance Programming 120

Snowflake

FEBRUARY 12, 2024

One way telecom companies stay ahead of the curve is by attending the world’s largest and most influential telecom and connectivity event: Mobile World Congress (MWC) 2024, held February 26 – 29 in Barcelona, Spain. We’re at the heart of it.

Python 78

Python Manufacturing Cloud Government 78

Snowflake

APRIL 22, 2024

By leveraging advanced technology and data analytics, Magnite offers a comprehensive suite of tools and services designed to maximize ad revenue for publishers while helping them effectively reach their target audiences. Unforeseen events like executive realignments, acquisitions and mergers can throw a curveball at your cloud strategy.

AWS 67

AWS Cloud Storage Cloud Technology 67

Snowflake

DECEMBER 18, 2023

Data clean rooms have emerged as the technology to meet this need, enabling interoperability where multiple parties can collaborate on and analyze sensitive data in a governed way without exposing direct access to the underlying data and business logic.

Cloud 112

Cloud Building Entertainment Government 112

Precisely

DECEMBER 28, 2023

Enterprise technology is having a watershed moment; no longer do we access information once a week, or even once a day. Streaming data pipelines, by extension, offer an architecture capable of handling large volumes of data, accommodating millions of events in near real time. But insights derived from day-old data don’t cut it.

Data Pipeline 91

Data Pipeline Building Kafka Big Data 91

Data Engineering Podcast

JANUARY 28, 2024

Summary Monitoring and auditing IT systems for security events requires the ability to quickly analyze massive volumes of unstructured log data. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? When is Scanner the wrong choice?

Data Lake 147

Data Lake Building High Quality Data AWS 147

Snowflake

DECEMBER 12, 2023

At our recent Snowday event, we announced a wave of Snowflake product innovations for easier application development, new AI and LLM capabilities, better cost management and more. If you missed the event or need a refresh of what was presented, watch any Snowday session on demand. Learn more. Learn more.

Metadata 84

Metadata Python AWS Government 84

Knowledge Hut

APRIL 30, 2024

Cybersecurity is the practice of protecting computer systems and networks from unauthorized access or attack. Information risks can include unauthorized access, use, disclosure, interception, or data destruction. As our dependence on technology grows, so does our vulnerability to these attacks.

Banking 98

Banking SQL Hospitality Cloud 98

Knowledge Hut

MARCH 22, 2024

These locks are designed to automatically unlock during emergencies or power outages, ensuring swift evacuation or access for first responders. These sophisticated locks operate on the principle of maintaining secure access control, even in the event of power failure or system malfunction.

Systems 105

Systems Electronics Hospitality Architecture 105

Knowledge Hut

JANUARY 10, 2024

Whether you're a startup founder, a seasoned developer, or an aspiring cloud enthusiast, having access to AWS credits can be a game-changer. This includes access to AWS activate credits, technical support, Cloud Engineer training , and other valuable resources. But how can you secure these valuable resources without breaking the bank?

AWS 52

AWS Amazon Web Services Education Cloud Computing 52