Monte Carlo

MAY 16, 2024

At what level does it make sense to deploy your data monitoring coverage? For most traditional data quality tools the answer has been by table. Data teams are onboarding datasets quickly and with the power of modern platforms, that process has only been getting faster and volumes only getting bigger.

Datasets 52

Datasets Data Finance AWS 52

Snowflake

MARCH 19, 2024

A company’s data strategy is always in motion. Some emerging approaches may be seen in our newly released Snowflake Data Trends 2024 , looking at how users in the Data Cloud are working with their data. For the report, we focused on two broad aspects of data strategy. The most marked finding was around governance.

Data Governance 117

Data Governance Government Unstructured Data Programming Language 117

Cloudera

JANUARY 26, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. In a good data governance strategy, it is important to define roles that allow the business to limit the level of access that users can have to their strategic data assets.

Metadata 72

Metadata Data Governance Government Management 72

Zalando Engineering

NOVEMBER 28, 2018

While the standard tools of Search, Categorization & Attribute Filtering are par-for-the-course for purchasing items online, with an ever-expanding fashion assortment and an increase in the data available to describe a product, this browsing experience is becoming more cumbersome and time-consuming, particularly on mobile devices.

Algorithm 40

Algorithm Computer Science Python Big Data 40

Tweag

APRIL 26, 2023

Computing is all about transforming data. Moreover, these steps can be combined in different ways, perhaps omitting some or changing the order of others, producing different data processing pipelines tailored to a particular task at hand. Even then, however, GHC will not complain if we write myPipeline = monomorphize.

Data Process 98

Data Process Process Programming Data 98

Cloudera

MARCH 4, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. In a good data governance strategy, it is important to define roles that allow the business to limit the level of access that users can have to their strategic data assets.

Metadata 52

Metadata Data Governance Government Management 52

DoorDash Engineering

APRIL 23, 2024

When a merchant comes onboard at DoorDash, we add their internal SKU data — raw merchant data — to our retail catalog. SKU data from different merchants come in varying formats and quality; they may, for example, have missing or incorrect attribute values. Examples include OpenAI’s GPT-4, Google’s Bard, and Meta’s Llama.

Building 91

Building Retail Manufacturing Unstructured Data 91

Snowflake

SEPTEMBER 11, 2023

Data privacy regulations are sweeping across the globe, with some 71% of countries worldwide adopting data protection and privacy legislation. The European Union’s General Data Protection Regulation (GDPR) , one of the more well-known and far-reaching of these privacy regulations, went into effect on May 25, 2018.

Cloud 78

Cloud Electronics Government Data Governance 78

Snowflake

SEPTEMBER 27, 2023

At Snowflake, we are dedicated to helping our customers effectively mobilize their data while upholding stringent standards for compliance and data governance. We understand the importance of quick and proactive identification of objects requiring governance, as well as the implementation of protective measures using tags and policies.

Data Governance 61

Data Governance Government SQL Database 61

Monte Carlo

JANUARY 29, 2024

It’s one thing to get your data into a modern data cloud. Monte Carlo is thrilled to be part of the Snowflake Horizon partner ecosystem as we leverage many of the pre-built features Snowflake provides in order to help organizations reduce their data downtime and improve data quality at scale.

Metadata 64

Metadata High Quality Data Data Pipeline Machine Learning 64

Towards Data Science

JUNE 16, 2023

How to Identify Your Business-Critical Data Practical steps to identifying business-critical data models and dashboards and drive confidence in your data Source: synq.io This article has been co-written with Lindsay Murphy Not all data is created equal. There’s a good reason for this. Source: synq.io

BI 79

BI Data ETL Tools Machine Learning 79

RudderStack

NOVEMBER 2, 2021

Modern teams need a more robust data integration solution than GTM. Here are 4 of the reasons GTM and data engineers don’t get along plus a better solution.

Data Engineering 40

Data Engineering Data Engineer Engineering Management 40

Christophe Blefari

SEPTEMBER 28, 2023

Make your data stack take-off ( credits ) Hello, another edition of Data News. This week, we're going to take a step back and look at the current state of data platforms. What are the current trends and why are people fighting around the concept of the modern data stack. Is the modern data stack dying?

Cloud Storage 147

Cloud Storage Big Data Hadoop SQL 147

The Modern Data Company

MARCH 7, 2023

Data governance can be a powerful agent in scaling the use and distribution of trusted data throughout the company. If you missed it, make sure to catch up on Part 1 – Data Timeliness. What Is Data Taxonomy? Data that is properly classified, catalogued, and tagged is usually well-governed data.

Data Governance 52

Data Governance Government Metadata Datasets 52

Lyft Engineering

OCTOBER 3, 2023

High-quality data is necessary for the success of every data-driven company. It is now the norm for tech companies to have a well-developed data platform. This makes it easy for engineers to generate, transform, store, and analyze data at the petabyte scale. What and Where is Data Quality?

Big Data 84

Big Data Metadata Data Warehouse Data 84

Knowledge Hut

OCTOBER 26, 2023

The <figure> tag deserves special attention because it transformed how images are displayed on browsers. The <figcaption> element can be used in addition to the <figure> tag to indicate captions. Simple to learn and utilize HTML can be written using annotations known as tags.

Coding 98

Coding Project Portfolio Media 98

Towards Data Science

MARCH 1, 2023

Similarly, our flatMapWithGroupState will accumulate tags (evaluated true/false Sigma expressions) and later release them. Our Flux Capacitor function is easy to configure and let’s the user specify how and when each individual tag is stored and retrieved. This evaluator is a no-op, it simply passes the current tag value through.

Designing 75

Designing Scala Data Science Process 75

Snowflake

DECEMBER 20, 2023

Achieving 20% year-over-year growth with a 98% renewal rate (as of Q1 2023) requires a data-driven understanding of the customer journey. That’s a big reason why nearly half of ServiceNow’s employees—over 11,000 monthly active users—depend on analytics powered by its enterprise data platform (EDP).

IT 68

IT Data Government Cloud 68

Monte Carlo

JANUARY 9, 2024

Senior ops engineer Sean McAfee can recall one of the incidents that served as a catalyst for standardizing the data triage and incident management strategy for the data team at Seasoned , a job board and hiring app specifically designed for the service industry. Table of Contents Systemic challenges to effective data triaging 1.

Management 59

Management Data Datasets Data Pipeline 59

Knowledge Hut

DECEMBER 29, 2023

This markup language is made up of tags that label or indicate what the content should appear as. The HTML opening tag (<html>) and the HTML closing tag (</html>) indicate the start and end of a HTML structure. The “button” tag is used to create a button with the name “Click Me!”

Portfolio 98

Portfolio Amazon Web Services Programming Language Coding 98

DoorDash Engineering

AUGUST 1, 2023

Just when we most needed observability data, the system would leave us in the lurch. Challenges Faced With StatsD StatsD was a great asset for our early observability needs, but we began encountering constraints such as losing metrics during surge events, difficulties with naming/standardized tags, and a lack of reporting tools.

AWS 82

AWS Transportation Programming Language Government 82

KDnuggets

MAY 24, 2022

An ML system requiring thousands of tagged samples is fundamentally different from the mind of a child, which can learn from just a few experiences of untagged data.

Machine Learning 160

Machine Learning Systems Data 160

RandomTrees

MARCH 22, 2024

In the kingdom of data manipulation and analytics, one common challenge is dealing with data stored in delimited string format within a single column. This format poses difficulties for analysis and querying since the data is not readily accessible or organized. Let’s see how data is loaded to the table.

Media 52

Media Healthcare Datasets Electronics 52

Monte Carlo

MARCH 12, 2024

Data pipelines get complex quickly. A pipeline supporting a single critical use case may be ingesting data from dozens of sources and refining it via multiple layers of transformation across hundreds of tables. If there is a delay or failure in one part of this intricate web of tasks, then a cascade of data issues is around the corner.

BI 52

BI Metadata Data Pipeline Data Engineering 52

Rockset

APRIL 18, 2023

Organizations have continued to accumulate large quantities of unstructured data, ranging from text documents to multimedia content to machine and sensor data. Comprehending and understanding how to leverage unstructured data has remained challenging and costly, requiring technical depth and domain expertise.

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105

Knowledge Hut

OCTOBER 29, 2023

HTML is composed of various tags which defines the document and it's semantic. Semantic add meaning to the content as expressed by enclosing tags and it is not purely for visual presentation purpose. Then we need to use < p > tag. In fact, there were some tags which allows to style a page and change its formatting.

Project 98

Project Programming Language Java Coding 98

Snowflake

NOVEMBER 2, 2023

Over the years, the technology landscape for data management has given rise to various architecture patterns, each thoughtfully designed to cater to specific use cases and requirements. These patterns include both centralized storage patterns like data warehouse , data lake and data lakehouse , and distributed patterns such as data mesh.

Data Lake 91

Data Lake Data Warehouse Cloud Unstructured Data 91

Precisely

DECEMBER 6, 2023

The European Union’s General Data Protection Regulation (commonly known as GDPR) came into effect on the 25th May 2018. It is important to any user or processor of personally identifiable information (PII) as this new law marks a seismic change in the way that organizations must protect consumers’ data.

Retail 64

Retail Data Systems Data Integration 64

Knowledge Hut

MAY 1, 2024

HTML is recognizable the moment it is encou n tered due to its format, tags, etc , in comparison to underst a n ding that the language that has been used to im plement the interface is Java S cr ipt. Angular JS facilitates directives that help the developer in building customized HTML tags. There are certain default directives as well.

Java 52

Java Coding Python Designing 52

Towards Data Science

JUNE 2, 2023

How to improve the code quality of your dbt models with unit tests and TDD All you need to know to start unit testing your dbt SQL models Photo by Christin Hume on Unsplash If you are a data or analytics engineer, you are probably comfortable writing SQL models and testing for data quality with dbt tests.

Coding 73

Coding SQL Software Engineer Software Engineering 73

Marc Lamberti

SEPTEMBER 29, 2023

Then you will set up and run your local development environment using the Astro CLI to create your first data pipeline. Concretely, you must create data pipelines to produce valuable data for later analytics or machine learning. To create, schedule, and monitor this kind of data pipeline you need a tool.

Data Pipeline 130

Data Pipeline Python AWS Project 130

Cloudera

NOVEMBER 19, 2020

Furthermore, the same tools that empower cybercrime can drive fraudulent use of public-sector data as well as fraudulent access to government systems. In financial services, another highly regulated, data-intensive industry, some 80 percent of industry experts say artificial intelligence is helping to reduce fraud. Technology can help.

Government 117

Government Machine Learning Algorithm Raw Data 117

Towards Data Science

OCTOBER 25, 2023

Not too long ago, almost all data architectures and data team structures followed a centralized approach. As a data or analytics engineer, you knew where to find all the transformation logic and models because they were all in the same codebase. There was only one data team, two at most.

Data Pipeline 82

Data Pipeline SQL Data Architecture Data 82

Knowledge Hut

JULY 26, 2023

It's portrayed as a digital shield that keeps our data safe from prying eyes. It involves special tags and readers. The tags, which are like small chips, send out information when they come close to a reader. RFID technology works through the interaction between RFID tags, readers, and a backend system.

IT 52

IT Electronics Data Collection Technology 52

Monte Carlo

APRIL 21, 2022

Adopting a cloud data warehouse like Snowflake is an important investment for any organization that wants to get the most value out of their data. When data quality is neglected, data teams end up spending valuable time responding to broken dashboards and unreliable reports. Data can be stale or duplicative.

Metadata 52

Metadata Bytes Government Data 52

Towards Data Science

MAY 26, 2023

It is great for data & Machine Learning (ML) work. In this post, we’re going to walk you through Hamilton’s lineage capabilities that can help you quickly answer common questions that arise while working with data & ML, so that you can work more efficiently and collaborate more effectively with colleagues.

Metadata 86

Metadata Data Science Coding Machine Learning 86

Cloudera

OCTOBER 26, 2020

Just like when it comes to data access in business. Enabling data access for end-users so they can drive insight and business value is a typical area of compromise between IT and users. Data access can either be very secure but restrictive or very open yet risky. Quickly onboard data. Multi-tenant data access.

Data Security 117

Data Security IT Unstructured Data Government 117