Snowflake

NOVEMBER 13, 2023

Data is crucial to Tide, having supported its incredible growth to nearly 500,000 customers in just eight years. However, it was dealing with a large volume of data and needed to scale quickly. When its data science team lead Hendrik Brackmann came on board, the team reported to Finance and had just two employees.

Finance 81

Finance Consulting Data Warehouse Data Governance 81

Snowflake

DECEMBER 20, 2023

Achieving 20% year-over-year growth with a 98% renewal rate (as of Q1 2023) requires a data-driven understanding of the customer journey. That’s a big reason why nearly half of ServiceNow’s employees—over 11,000 monthly active users—depend on analytics powered by its enterprise data platform (EDP). We did this in parallel.”

IT 63

IT Data Government Data Security 63

Towards Data Science

JUNE 2, 2023

How to improve the code quality of your dbt models with unit tests and TDD All you need to know to start unit testing your dbt SQL models Photo by Christin Hume on Unsplash If you are a data or analytics engineer, you are probably comfortable writing SQL models and testing for data quality with dbt tests.

Coding 72

Coding SQL Software Engineer Software Engineering 72

Lyft Engineering

OCTOBER 3, 2023

High-quality data is necessary for the success of every data-driven company. It is now the norm for tech companies to have a well-developed data platform. This makes it easy for engineers to generate, transform, store, and analyze data at the petabyte scale. What and Where is Data Quality?

Big Data 84

Big Data Metadata Data Warehouse Data 84

Snowflake

FEBRUARY 21, 2023

Financial institutions also continue to be challenged to understand and identify PII to prevent inadvertently disclosing it, all while working to implement data governance policies, which result in better accountability and help identify risks while staying true to business initiatives.

Banking 57

Banking Finance Data Governance Government 57

Towards Data Science

JUNE 16, 2023

How to Identify Your Business-Critical Data Practical steps to identifying business-critical data models and dashboards and drive confidence in your data Source: synq.io This article has been co-written with Lindsay Murphy Not all data is created equal. There’s a good reason for this. Source: synq.io

BI 78

BI Data ETL Tools Machine Learning 78

Rockset

MARCH 17, 2022

If you’re thinking about implementing real-time analytics , you've probably realized that you're going to need real-time updates. Real-time updates give you the power to insert, delete and update data in place. 1) Late Arriving Data in Time-Based Window Rollups ⌛️ Let's say you have a rollup that's counting events for each hour.

Database 52

Database IT PostgreSQL MongoDB 52

The Modern Data Company

MARCH 7, 2023

Data governance can be a powerful agent in scaling the use and distribution of trusted data throughout the company. If you missed it, make sure to catch up on Part 1 – Data Timeliness. What Is Data Taxonomy? Analytic geometries 516.37 How Does Taxonomy Aid Data Governance?

Data Governance 52

Data Governance Government Metadata Datasets 52

Ascend.io

MAY 24, 2023

This article is based on a presentation given by Sarwat Fatima , Principal Data Engineer at Biome Analytics, at the Data Pipeline Automation Summit 2023. Dive right into Sarwat’s full presentation at the Data Pipeline Automation Summit 2023. Table of Contents Data is the lifeblood of the healthcare industry.

Healthcare 52

Healthcare Data Pipeline Hospitality Datasets 52

Cloudera

OCTOBER 26, 2020

Just like when it comes to data access in business. Enabling data access for end-users so they can drive insight and business value is a typical area of compromise between IT and users. Data access can either be very secure but restrictive or very open yet risky. Quickly onboard data. Multi-tenant data access.

Data Security 117

Data Security IT Unstructured Data Government 117

LinkedIn Engineering

DECEMBER 13, 2023

There are also LinkedIn Learning courses where only a subset of skills are tagged directly, with a number of relevant skills being mentioned solely in the description or in the course itself (i.e., data analytics” and “data analysis” are the same type of skill), which we represent in our skills taxonomy.

Recruitment 83

Recruitment Utilities Designing Java 83

François Nguyen

JANUARY 23, 2021

or why you should have a look at Data Observability ! This article is the second part on how Airbnb is managing data quality : “Part 2 — A New Gold Standard” The first part can be found here and it was just good principles about roles and responsabilities. Welcome to this strange way of managing data quality !

Finance 130

Finance Certification Data Pipeline Data 130

Cloudera

JUNE 26, 2023

Here are some tips and tricks of the trade to prevent well-intended yet inappropriate data engineering and data science activities from cluttering or crashing the cluster. For data engineering and data science teams, CDSW is highly effective as a comprehensive platform that trains, develops, and deploys machine learning models.

ETL Tools 76

ETL Tools Programming Language Datasets Data Pipeline 76

Knowledge Hut

NOVEMBER 16, 2023

Amazon Redshift does the same for big data analytics and data warehousing. It contains columnar data store with billions of rows of data that are parallel placed with each other. This type of database management system uses sections of columns instead of rows to store the data. What is Amazon Redshift?

IT 52

IT Bytes AWS Data Warehouse 52

Christophe Blefari

SEPTEMBER 28, 2023

Make your data stack take-off ( credits ) Hello, another edition of Data News. This week, we're going to take a step back and look at the current state of data platforms. What are the current trends and why are people fighting around the concept of the modern data stack. Is the modern data stack dying?

Cloud Storage 147

Cloud Storage Big Data Hadoop SQL 147

AltexSoft

AUGUST 29, 2023

In 2010, a transformative concept took root in the realm of data storage and analytics — a data lake. The term was coined by James Dixon , Back-End Java, Data, and Business Intelligence Engineer, and it started a new era in how organizations could store, manage, and analyze their data. What is a data lake?

Data Lake 52

Data Lake Architecture IT Amazon Web Services 52

Snowflake

DECEMBER 12, 2023

Iceberg Tables bring the easy management and great performance of Snowflake to data stored externally in an open source format. Snowflake Horizon Seamless data governance with a new user experience in Snowsight – general availability Users can effortlessly explore objects of interest and perform essential actions—all without SQL.

Metadata 83

Metadata Python Government AWS 83

Netflix Tech

JANUARY 25, 2023

Scalable Annotation Service — Marken by Varun Sekhri , Meenakshi Jindal Introduction At Netflix, we have hundreds of micro services each with its own data models or entities. Annotations Sometimes people describe annotations as tags but that is a limited definition. Teams should be able to define their data model for annotation.

Algorithm 113

Algorithm Media Metadata Data Ingestion 113

Monte Carlo

APRIL 21, 2022

Adopting a cloud data warehouse like Snowflake is an important investment for any organization that wants to get the most value out of their data. When data quality is neglected, data teams end up spending valuable time responding to broken dashboards and unreliable reports. Data can be stale or duplicative.

Metadata 52

Metadata Bytes Government Data 52

Monte Carlo

MARCH 28, 2024

When it comes to sweet treats, sunshine, and errant data quality alerts, the answer is – unfortunately – yes. Alerts for data quality incidents, like anomalies in the freshness, volume, or schema of your tables, are essential for maintaining the health and accuracy of the data flowing through your pipelines.

Data 52

Data Data Engineering Data Engineer Engineering 52

Cloudera

JUNE 27, 2023

During the COVID-19 pandemic, telcos made unprecedented use of data and data-driven automation to optimize their network operations, improve customer support, and identify opportunities to expand into new markets. There are savings to be made in modernizing the data stack itself, in addition to applying data across the enterprise.

Data Architecture 62

Data Architecture Architecture Data Governance Government 62

Snowflake

JUNE 14, 2023

Komodo Health is a technology platform company creating the new standard for real-world data and analytics by pairing the industry’s most complete view of patient encounters with enterprise software and machine learning that connects the dots between individual patient journeys and large-scale health outcomes.

Healthcare 52

Healthcare SQL Algorithm Architecture 52

Towards Data Science

OCTOBER 25, 2023

Not too long ago, almost all data architectures and data team structures followed a centralized approach. As a data or analytics engineer, you knew where to find all the transformation logic and models because they were all in the same codebase. There was only one data team, two at most.

Data Pipeline 81

Data Pipeline SQL Data Architecture Data 81

Netflix Tech

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Traces collected from various microservices are ingested in a stream processing manner into the data store.

Building 93

Building Transportation Metadata Java 93

Knowledge Hut

DECEMBER 26, 2023

The company does not need to invest in any additional hardware or equipment or purchase physical data centers for storage and management. IaaS services are policy-driven and offer a range of services, such as billing, load balancing, clustering, storage resiliency, data backups, and more.

Cloud Computing 69

Cloud Computing Cloud Amazon Web Services AWS 69

Knowledge Hut

MARCH 13, 2024

Wondering what is a big data engineer? As the name suggests, Big Data is associated with ‘big’ data, which hints at something big in the context of data. Big data forms one of the pillars of data science. Big data has been a hot topic in the IT sector for quite a long time.

Big Data 52

Big Data Data Engineering Data Engineer Engineering 52

Knowledge Hut

MARCH 13, 2024

Wondering what is a big data engineer? As the name suggests, Big Data is associated with ‘big’ data, which hints at something big in the context of data. Big data forms one of the pillars of data science. Big data has been a hot topic in the IT sector for quite a long time.

Big Data 52

Big Data Data Engineering Data Engineer Engineering 52

Data Engineering Podcast

OCTOBER 12, 2020

Rob shares some useful insights gained through his consulting work, and why he considers Power BI to be the best option on the market today for business analytics. If you hand a book to a new data engineer, what wisdom would you add to it? Go to dataengineeringpodcast.com/97things to add your voice and share your hard-earned expertise.

Business Intelligence 100

Business Intelligence BI Consulting Data Ingestion 100

Data Engineering Podcast

JUNE 29, 2020

The team at Audio Analytic are working to impart a sense of hearing to our myriad devices with their sound recognition technology. This was a great conversation about the complexities of working in a niche domain of data analysis and how to build a pipeline of high quality data from collection to analysis.

Data Collection 100

Data Collection Management High Quality Data Metadata 100

ProjectPro

JANUARY 24, 2023

With over 18000 customers across the globe, 1000 add-ons and apps available in Splunkbase marketplace, Apache Splunk is the de facto standard for machine data analytics. To generate e-commerce company statistics for this dashboard, you can combine test data with internal index data from your own instance.

Project 52

Project Data Mining Big Data Big Data Tools 52

Data Engineering Podcast

JUNE 3, 2021

Summary SQL is the most widely used language for working with data, and yet the tools available for writing and collaborating on it are still clunky and inefficient. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

SQL 100

SQL Building Big Data BI 100

Snowflake

FEBRUARY 29, 2024

While latitude and longitude columns can often be used by BI tools and Python libraries to plot points on a map, or shade common administrative boundaries such as states, provinces and countries, companies can do so much more with this valuable geospatial data to perform complex analyses. Unlike GEOGRAPHY and GEOMETRY, H3 isn’t a data type.

Insurance 78

Insurance SQL BI Consulting 78

Snowflake

JUNE 27, 2023

The world is undergoing a remarkable transformation fueled by data. Organizations have accumulated silos across their data infrastructure to support various workloads, languages, tools, and formats because of technology limitations. We’re going to summarize these new capabilities in this blog post.

Data Governance 54

Data Governance Unstructured Data Government SQL 54

Databand.ai

JULY 28, 2022

What is Data Lineage? Niv Sluzki 2022-07-28 10:20:02 The term “data lineage” has been thrown around a lot over the last few years. And getting it right matters even more to data organizations. This article will unpack everything you need to know about data lineage, including: What is it? What is data lineage?

Metadata 52

Metadata Data Lake Datasets Data Warehouse 52

Teradata

NOVEMBER 18, 2020

Learn how more accurate Telecom subscriber tagging based on enhanced data analytics enables businesses to dig into their customers' behaviors and preferences.

Data Analytics 52

Data Analytics Data 52

Knowledge Hut

NOVEMBER 16, 2023

This enables programmers to insert Java code into HTML pages using particular JSP tags. This is nothing but a data analytics course that can give you global exposure. JSP certification JSP is a Web page-building tool that allows for dynamic content.

Technology 83

Technology MySQL MongoDB Google Cloud 83

Snowflake

OCTOBER 25, 2023

All of these solutions have a common denominator with today’s modern organizations: a robust, transparent and scalable data strategy, and the prerequisite to AI is the heartbeat of modern marketing: customer data. Question #1: What kind of data are you using to train your AI models? And how are you collecting it?

Government 83

Government Accessible Accessibility Technology 83