Workfall

SEPTEMBER 26, 2023

Reading Time: 9 minutes In this blog, we will cover: What are Server-Sent Events? Why Stream Data Using Server-Sent Events (SSE)? Hands-On Conclusion What are Server-Sent Events? These events can carry information like notifications, updates, or alerts. This makes it accessible to a wider range of developers and projects.

Python 85

Python Bytes Coding Data 85

dbt Developer Hub

NOVEMBER 3, 2022

Let’s discuss how to convert events from an event-driven microservice architecture into relational tables in a warehouse like Snowflake. Quality problems lead to first responders unable to check into disaster sites or parents unable to access ESA funds. So our solution was to start using an intentional contract: Events.

Kafka 52

Kafka ETL Tools BI Database 52

Data Engineering Podcast

AUGUST 10, 2020

Summary Event based data is a rich source of information for analytics, unless none of the event structures are consistent. The team at Iteratively are building a platform to manage the end to end flow of collaboration around what events are needed, how to structure the attributes, and how they are captured.

Data Collection 100

Data Collection Data Engineering Data Engineer Education 100

Data Engineering Podcast

FEBRUARY 18, 2024

Join in with the event for the global data community, Data Council Austin. Don't miss out on their only event this year! What are the differences in terms of pipeline design/access and usage patterns when using a Trino/Iceberg lakehouse as compared to other popular warehouse/lakehouse structures?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Rockset

OCTOBER 4, 2022

Event streams, such as clickstreams, IoT data and other time series data, are common sources of data into these apps. The broad adoption of Apache Kafka has helped make these event streams more accessible. In this post, we compare two options for real-time analytics on event and CDC streams: Rockset and ClickHouse.

MySQL 52

MySQL Kafka Aggregated Data Architecture 52

Snowflake

JUNE 28, 2023

External Network Access (PrPr) – Allows users to seamlessly connect to external endpoints from their Snowpark code (UDFs/UDTFs and Stored procedures) while maintaining high security and governance. Python Tasks API (PrPr Soon) – Provides first class Python APIs for creating and managing Snowflake Tasks/DAGs.

Python 52

Python Accessible Accessibility Pipeline-centric 52

Rockset

FEBRUARY 24, 2022

Event-based architectures have been gaining popularity for some time. With increased adoption has come a flood of options for aggregating and analyzing events. Which databases are optimized for ingesting streaming events and analyzing them in real time? Supporting separation of data access (read/write) mechanisms like CQRS.

AWS 52

AWS Amazon Web Services Kafka Business Intelligence 52

Confluent

FEBRUARY 21, 2019

During a recent talk titled Hunters ATT&CKing with the Right Data , which I presented with my brother Jose Luis Rodriguez at ATT&CKcon, we talked about the importance of documenting and modeling security event logs before developing any data analytics while preparing for a threat hunting engagement. Yeah…I can do that already!

Process 81

Process Kafka Datasets SQL 81

Data Engineering Podcast

NOVEMBER 26, 2023

Summary Building a data platform that is enjoyable and accessible for all of its end users is a substantial challenge. Developing event-driven pipelines is going to be a lot easier - Meet Functions! Memphis Logo]([link] Developing event-driven pipelines is going to be a lot easier - Meet Functions!

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Data Engineering Podcast

APRIL 23, 2023

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. What are the shifts that have made them more accessible to a wider variety of teams? RudderStack also supports real-time use cases.

Data Lake 277

Data Lake Kafka Machine Learning Data Warehouse 277

The Pragmatic Engineer

APRIL 11, 2024

Confirming this suspicion is Fabrick’s status page that says Fabrick’s tech staff are involved: “We would like to inform you that the event is currently still ongoing, continuous monitoring is in place, and any slowdowns are affecting only the services provided jointly with the Sella group.

Banking 199

Banking Utilities Database Engineering 199

Data Engineering Podcast

MARCH 3, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council : ![Data

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

MARCH 17, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council : ![Data

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

FEBRUARY 25, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Promo Code: dataengpod20 Dagster : ![Dagster

Database 162

Database Technology Data Lake High Quality Data 162

Zalando Engineering

NOVEMBER 20, 2017

Zalando is using an event-driven approach for its new Fashion Platform. Conor Clifford examines why In a recent post , I wrote about how we went about building the core Article services and applications, of Zalando’s new Fashion Platform, with a strong event first focus.

Architecture 40

Architecture Systems Project Accessible 40

Data Engineering Podcast

MARCH 10, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Promo Code: dataengpod20 Dagster : ![Dagster

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Snowflake

APRIL 9, 2024

To improve go-to-market (GTM) efficiency, Snowflake created a bi-directional data share with Outreach that provides consistent access to the current version of all our customer engagement data. They always have access to the most current data, because Outreach’s updates are made and distributed automatically.

BI 73

BI Data Ingestion Data Aggregated Data 73

Data Engineering Podcast

APRIL 16, 2023

As the capabilities of these systems has improved and become more accessible, the target of what self-serve means changes. Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools.

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Data Engineering Podcast

DECEMBER 24, 2023

Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems. In the event of these different cluster errors, what are the strategies for mitigating and recovering from those failures? Operating it at scale, however, is notoriously challenging.

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Snowflake

APRIL 11, 2024

At Snowflake, we believe in making the power of data accessible to all. This aligns perfectly with Snowflake’s core mission: democratizing access to the power of AI and empowering everyone to unlock deeper data insights. Please note: Public preview access for Snowflake Copilot is currently rolling out for AWS accounts.

SQL 134

SQL AWS Data Analysis High Quality Data 134

nodeSWAT

MARCH 30, 2016

Most web applications rely on some sort of access control to keep users from accessing information not meant for them. If authentication is a lock on the main door of the hotel, then access control is the individual access card they give to each user for accessing their room. So let’s get started.

Accessible 52

Accessible Accessibility Systems Database 52

Knowledge Hut

APRIL 16, 2024

The certification offered by Scrum Alliance® enables you to gain an understanding of the agile mindset and learn about Scrum roles, events, and artifacts. It is an optional service which gives you access to benefits that are exclusively available for the members. Also, you do not get direct access to the online CSM® test.

Certification 52

Certification Accessible Accessibility Project 52

Robinhood

MARCH 26, 2024

The event is available to livestream on go.robinhood.com/presents at 7:15 pm ET on March 26 and will be available for replay. It’s why we started Robinhood and gave our customers access to features like commission free trading and the 24 Hour Market,” said Vlad Tenev, Co-Founder and CEO of Robinhood. © 2024 Robinhood.

Banking 115

Banking Insurance Finance Programming 115

Data Engineering Podcast

MARCH 18, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Join in with the event for the global data community, Data Council Austin. Don't miss out on their only event this year! Data Council Logo]([link] Join us at the event for the global data community, Data Council Austin.

Data Security 130

Data Security Machine Learning Data Science Metadata 130

Robinhood

MARCH 6, 2024

The news cycle, world events, and market moving events like earnings often happen outside of US East Coast business hours. Here’s how to access the Robinhood 24 Hour Market in-app: Select your stock or ETF. 24 Hour Market lets customers invest when they want, on their schedule.

Retail 118

Retail Accessible Accessibility 118

Towards Data Science

FEBRUARY 18, 2024

An event is a small, self-contained object that contains the details of something happened at some point in time e.g. user interaction. An event is generated by a producer (e.g. Traditional databases are ill-suited for storing events in high throughput event streams. online dashboard).

Kafka 79

Kafka Python Process Google Cloud 79

Rockset

NOVEMBER 6, 2019

Events are messages that are sent by a system to notify operators or other systems about a change in its domain. With event-driven architectures powered by systems like Apache Kafka becoming more prominent, there are now many applications in the modern software stack that make use of events and messages to operate effectively.

Kafka 40

Kafka Data Lake SQL Hadoop 40

Cloudera

MARCH 6, 2024

As we enter into a new month, the Cloudera team is getting ready to head off to the Gartner Data & Analytics Summit in Orlando, Florida for one of the most important events of the year for Chief Data Analytics Officers (CDAOs) and the field of data and analytics.

Data Analytics 104

Data Analytics Data Technology Data Engineering 104

Snowflake

FEBRUARY 12, 2024

One way telecom companies stay ahead of the curve is by attending the world’s largest and most influential telecom and connectivity event: Mobile World Congress (MWC) 2024, held February 26 – 29 in Barcelona, Spain. See you in Barcelona We look forward to seeing you at the biggest telecom and connectivity event of the year.

Python 78

Python Manufacturing Cloud Government 78

Snowflake

APRIL 18, 2024

Legacy security information and event management (SIEM) solutions, like Splunk, are powerful tools for managing and analyzing machine-generated data. Snowflake allows security teams to store all their data in a single platform and maintain it all in a readily accessible state, with virtually unlimited cloud data storage capacity.

Data Lake 73

Data Lake Data Ingestion Bytes Cloud Computing 73

Knowledge Hut

MARCH 22, 2024

These locks are designed to automatically unlock during emergencies or power outages, ensuring swift evacuation or access for first responders. These sophisticated locks operate on the principle of maintaining secure access control, even in the event of power failure or system malfunction.

Systems 92

Systems Electronics Hospitality Architecture 92

Zalando Engineering

NOVEMBER 8, 2023

Postgres Logical Replication at Zalando Builders at Zalando have access to a low-code solution that allows them to declare event streams that source from Postgres databases. At the time of writing, there are hundreds of these Postgres-sourced event streams out in the wild at Zalando. Simple, right?

PostgreSQL 139

PostgreSQL Java Database Bytes 139

Snowflake

JANUARY 29, 2024

This new connector offers immediate access to your Google Analytics data without the hassle, complexity and expense of manual integration via API endpoints and patched systems workarounds. Once your data reaches its final destination, access to the ingested data is governed by Snowflake’s built-in access controls.

Raw Data 103

Raw Data Aggregated Data Data Government 103

Robinhood

FEBRUARY 27, 2024

Money Drills will kick off at each university this week with events and speakers sharing more on how the program will come to life on campus. “By We’re proud to announce our work with Florida State University, Coastal Carolina University, and University of California, Berkeley to bring access to financial education to even more students.” “The

Education 115

Education Finance Programming Government 115

Data Engineering Podcast

MARCH 24, 2024

Trusted by the teams at Comcast and Doordash, Starburst delivers the adaptability and flexibility a lakehouse ecosystem promises, while providing a single point of access for your data and all your data governance allowing you to discover, transform, govern, and secure all in one place.

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Zalando Engineering

OCTOBER 9, 2017

Decision Time It was decided that this new platform would be primarily an event driven system - with data changes being streamed to consumers. In an event driven system it is important that the outbound events themselves have at least equal importance to the data being managed by the system.

Kafka 40

Kafka PostgreSQL Database Data Ingestion 40

Rockset

OCTOBER 1, 2019

In this blog post, we will explore a tool we built internally that gives us visibility into Kubernetes events, an excellent source of information about the state of the system, which we find useful in troubleshooting the system and understanding its long-term health. By default, only the past hour of events is preserved by etcd.

SQL 40

SQL Systems Metadata Accessible 40