In this IBM Databand product update, we focused on enhancing integration with Snowflake and adding new role-based access controls (RBAC) with Databand Groups.

  1. Snowflake Data Quality Alerts: enhanced “data-at-rest” monitoring with out-of-the-box data quality alerts on Snowflake tables.
  2. Databand Groups: groups make it easier for users to focus on the most relevant alerts and navigate between different platform assets.

Check out the product videos and support documentation to get started today!

Getting started with Snowflake observability

Watch the video below or keep reading to see how get started using Databand and Snowflake together.

Setting up the integration

Before you start using Databand’s Snowflake observability, you need to connect your Snowflake environment with Databand. Select the integration tab on the left panel and click the Add Integration button.

After choosing Snowflake, follow the support documentation to establish a connection.

Once the integration is set up, you will now see Snowflake as an option in the integration table.

Snowflake dataset logging

You can now see all the tables pulling in from Snowflake within the main Datasets screen.

In the Datasets screen, you can see all the table information from the Snowflake monitor, such as:

  • Name
  • Total Records
  • Path
  • Last Modified
  • Last operation

Analyzing Snowflake tables

When clicking on a table, you can see the overview of table, which includes daily rows written/read, daily operations and issues related to the table.

The history tab includes all the individual Snowflake transactions. This view will depend on how Snowflake relates to pipelines within Databand.

For example, if you are only importing tables from Snowflake that do not have associated pipelines in Databand, you will see a condensed view based on the Snowflake origin.

If you have data pipelines integrated with Databand that interact with Snowflake, you’ll have access to a more comprehensive view. This view provides additional details about the pipeline source and the specific transactions taking place in the queries.

Adding Snowflake data quality alerts

Setting up a data quality alert is easy in Databand. Select the alerts tab and then choose the Add Alert button.

In this example, we’re showing two different types of metrics for your Snowflake data quality alerts:

  1. Not null metric: this alert checks for NULL values in your columns.
  2. Unique metric: this alert checks for any duplicates in your columns.

To set up an alert, first choose a Snowflake table.

From there, select the specific columns you want to run quality checks on, whether it be one or multiple. Lastly, select the metric type, severity, name and description to finalize the alert.

Analyze Snowflake data quality alerts

Now that your Snowflake alerts are set, you can view all the triggered alerts in one location. Here you can see some recent Snowflake alerts related to the not null metric we created.

Now you can dive into the alert and see the trigger trend of the number of nulls found on your Snowflake columns over time. The latest alert had a trigger value of 54 nulls found in my Snowflake table named SERVICE_311_DEMO.PU‎BLIC.BOROUGH_REPORT.

Below the alert trend, you can see the impact analysis of any downstream assets affected by this alert. The example shows that a dbt pipeline was impacted.

Thanks to this feature, it is now possible to quickly analyze and address any business impacts related to the triggered alert. With access to a comprehensive view of pipelines and tables, complete observability is now achievable.

Introducing Databand Groups

Databand Groups offers teams RBAC for their specific needs, such as projects, sources and pipelines. This ensures that teams can concentrate on the data assets that matter to them rather than being overwhelmed by everything stored in Databand.

Creating a new group

To create a new group, select the setting tab and select group management. From here you can see every member of each group and their assigned assets (for example, projects, sources and pipelines).

Click the Add New Group button to start adding members. Next, you’ll be prompted to select the members and assets to assign to the group.

If you selected Project A, then you will only see the sources and pipelines associated with Project A for the other asset types. This helps narrow the large amounts of assets to choose from when assigning new assets.

Once you assign the assets and save, you’ll now be able to quickly switch back and forth between groups by selecting your name tab in the bottom left corner.

Now when you go to any tab in Databand, you will only see the assigned assets. In this example, we’re showing you the only assigned pipeline for project A.

See how Databand delivers continuous observability within your Snowflake warehouse to help detect data incidents with Snowflake tables related to data quality, freshness and volume and resolve them fast. If you’re ready to take a deeper look, book a demo today.

Was this article helpful?
YesNo

More from Databand

IBM Databand achieves Snowflake Ready Technology Validation 

< 1 min read - Today we’re excited to announce that IBM Databand® has been approved by Snowflake (link resides outside ibm.com), the Data Cloud company, as a Snowflake Ready Technology Validation partner. This recognition confirms that the company’s Snowflake integrations adhere to the platform’s best practices around performance, reliability and security.  “This is a huge step forward in our Snowflake partnership,” said David Blanch, Head of Product for IBM Databand. “Our customers constantly ask for data observability across their data architecture, from data orchestration…

Introducing Data Observability for Azure Data Factory (ADF)

< 1 min read - In this IBM Databand product update, we’re excited to announce our new support data observability for Azure Data Factory (ADF). Customers using ADF as their data pipeline orchestration and data transformation tool can now leverage Databand’s observability and incident management capabilities to ensure the reliability and quality of their data. Why use Databand with ADF? End-to-end pipeline monitoring: collect metadata, metrics, and logs from all dependent systems. Trend analysis: build historical trends to proactively detect anomalies and alert on potential…

DataOps Tools: Key Capabilities & 5 Tools You Must Know About

4 min read - What are DataOps tools? DataOps, short for data operations, is an emerging discipline that focuses on improving the collaboration, integration and automation of data processes across an organization. DataOps tools are software solutions designed to simplify and streamline the various aspects of data management and analytics, such as data ingestion, data transformation, data quality management, data cataloging and data orchestration. These tools help organizations implement DataOps practices by providing a unified platform for data teams to collaborate, share and manage…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters