Snowflake

NOVEMBER 2, 2023

At Snowflake, we don’t think prescribing a single pattern for all customers to adopt suits their interests. For example, customers who need a centralized store of data in large volume and variety – including JSON, text files, documents, images, and video – have built their data lake with Snowflake.

Data Lake 85

Data Lake Data Warehouse Cloud Unstructured Data 85

Data Engineering Weekly

FEBRUARY 4, 2024

link] [link] Grab: Rethinking Stream Processing - Data Exploration Grab writes an excellent blog about data exploration on stream processing. link] Michiel De Muynck: 7 Lessons Learned migrating dbt code from Snowflake to Trino SQL standards are like toothbrushes: everyone agrees they're essential, but no one wants to use someone else's.

Data Engineering 62

Data Engineering Data Engineer Engineering PostgreSQL 62

Data Engineering Weekly

NOVEMBER 26, 2023

The data industry clearly understands the power of blog storage, and using S3 as a database is not a new concept either. As Benn Stancil noted in his blog, “The data industry is going to consolidate” is a pretty boring prediction to make these days. The cost of integrating the Modern Data Stack is also pretty high.

Data Engineering 70

Data Engineering Data Engineer Engineering Kafka 70

Snowflake

FEBRUARY 29, 2024

Did you know that approximately two thirds of Snowflake customers capture the latitude and longitude of some business entity or event in their account? Today, we’re announcing the general availability of H3 in Snowflake. Uber, a popular rideshare company, had a need to optimize rideshare pricing and dispatch. We hear you, world.

Insurance 78

Insurance SQL BI Consulting 78

Snowflake

AUGUST 31, 2023

Because of its leading ecosystem of diverse adopters, contributors and commercial offerings, Iceberg helps prevent storage lock-in and eliminates the need to move or copy tables between different systems, which often translates to lower compute and storage costs for your overall data stack.

Metadata 82

Metadata AWS Data Lake Datasets 82

Snowflake

NOVEMBER 30, 2023

And when moving to Snowflake , you get the advantage of the Data Cloud’s architectural benefits (flexibility, scalability and high performance) as well as availability across multiple cloud providers and global regions. Use separate data warehouses for cost-effective data loading.

Data Warehouse 93

Data Warehouse Banking Data Cloud 93

Snowflake

MARCH 7, 2024

In this blog post, we’ll walk through what the actual capabilities of LLMs are, and the steps financial organizations should take to harness this technology effectively and safely. Its novelty will likely mature into prevalence as computing resources proliferate and the costs of adoption decrease. Financial services is no exception.

Unstructured Data 80

Unstructured Data Government Data Architecture Architecture 80

Snowflake

APRIL 17, 2023

We are excited to announce a major update to the Search Optimization Service, which will accelerate both point lookups and analytical queries while at the same time reducing cost for our customers. The fewer micro-partitions Snowflake has to scan, the faster your queries are. It cut our Search Optimization Service cost by 90%!”

Food 54

Food Structured Data Utilities Accessible 54

Snowflake

JULY 10, 2023

Snowflake Native Apps introduce a new model for cloud-based software. With Snowflake Native Apps, the application itself runs where your data lives: within Snowflake. In the Snowflake Native Apps model, providers bring their application code to their customers’ data. excluding those in Florida, Kansas, or Michigan.

Entertainment 62

Entertainment Government Retail Healthcare 62

Snowflake

AUGUST 21, 2023

In this blog post, we’ll review the core data mesh principles, highlight how both organizations and modern data platforms are putting those principles into action, and demonstrate just how achievable a secure and efficient data mesh architecture can be. So, having a focus on cost and simplicity is really important.”

Pipeline-centric 52

Pipeline-centric Architecture Government Data Architect 52

Snowflake

APRIL 19, 2023

Welcome to the third blog post in our series highlighting Snowflake’s data ingestion capabilities, covering the latest on Snowpipe Streaming (currently in public preview) and how streaming ingestion can accelerate data engineering on Snowflake.

Data Ingestion 54

Data Ingestion Kafka Java Data Pipeline 54

Monte Carlo

SEPTEMBER 8, 2023

To read more about how we built this data platform on Snowflake, check out Tenable One Exposure Management Platform: Unlocking the Power of Data. The data engineering team in Tenable has been using Monte Carlo to help monitor the Snowflake data platform powering Tenable One Exposure Management and it has proven extremely valuable.

Kafka 75

Kafka SQL Data Pipeline Database 75

Data Engineering Weekly

MARCH 3, 2024

The NVIDIA blog on Sovereign AI emphasizes the importance of countries developing artificial intelligence capabilities using local infrastructure, data, and workforce. These improvements, part of Project Lightspeed, aim to reduce latency and increase throughput for stateful streaming queries, making them more efficient and cost-effective.

Data Engineering 67

Data Engineering Data Engineer Pipeline-centric Engineering 67

Snowflake

AUGUST 22, 2023

“The future is what you make it,” declared Sheila Jordan , Chief Digital Technology Officer at Honeywell, in the opening keynote of this year’s Snowflake Summit keynote. Snowflake’s World of Data Collaboration, the theme of Snowflake Summit , was a world of data products—extending beyond data to include AI models and applications.

Metadata 73

Metadata Data AWS Business Analyst 73

Snowflake

JULY 13, 2023

Welcome to our recap of all of the great industry sessions presented at Snowflake Summit 2023, which just wrapped up in Las Vegas. In this blog post, we delve into the event highlights across our industries as well as key takeaways from Snowflake’s industry leaders. Watch the session. Watch the session. Watch the session.

Entertainment 58

Entertainment Manufacturing Retail Media 58

Snowflake

JANUARY 31, 2023

A number of blog posts, mainly from competitors, call out Snowflake as expensive. But in our conversations with customers, we frequently hear that Snowflake provides the best value for the money of any enterprise data platform option available today. So what gives?

Cloud 62

Cloud Data Programming Language SQL 62

Snowflake

JULY 27, 2023

In this guest blog post, HomeToGo’s director of data, Stephan Claus, explains why the company migrated to Snowflake to meet its data needs. This article is based on Stephan’s presentation during the Snowflake Data World Tour 2022. Something that is especially handy is Snowflake’s support for semi-structured data.

Data Architecture 52

Data Architecture Architecture Building Structured Data 52

Snowflake

MARCH 7, 2023

The data movement required with legacy systems leads to high costs of ETL and rising data management TCO. Snowflake allows organizations to seamlessly bring together internal data, portfolio warehouse data, and external vendor data into a single platform. Quants need to rebalance and run optimization in ever-narrowing time frames.

Cloud 52

Cloud Portfolio Unstructured Data Banking 52

Snowflake

JUNE 27, 2023

These silos can have major consequences in the form of greater operational burden, security vulnerabilities, increased total cost of ownership, incomplete insights, and reduced agility. This is where Snowflake’s single, unified platform comes in: helping break down silos and simplify architectures.

Data Governance 54

Data Governance Unstructured Data Government SQL 54

Snowflake

JANUARY 30, 2023

Companies are getting squeezed between rising supply chain costs and falling consumer confidence. To enable faster decisions, retail merchandisers must provide insights to ultimately influence cross-functional teams, to optimize category, dynamic placement, pricing, and promotion decisions.

Retail 52

Retail Cloud BI Data Architecture 52

Snowflake

JUNE 28, 2023

Since its launch two years ago, Snowpark has been empowering data scientists, data engineers, and application developers to streamline their architectures, accelerate development, and boost the performance of data engineering and ML/AI workloads on Snowflake.

Python 52

Python Accessible Accessibility Pipeline-centric 52

Monte Carlo

APRIL 28, 2022

Most data pros know Snowflake’s pricing model is consumption based–you pay for what you use. What many don’t know is Snowflake actually WANTS you to optimize your costs and has provided helpful features to rightsize your consumption. The key with Snowflake cost optimization initiatives is they too need to be right sized.

Data Warehouse 52

Data Warehouse Bytes SQL AWS 52

Snowflake

JUNE 7, 2023

To run a diverse set of workloads with minimal operational burden, Snowflake built an intelligent engine that plans and optimizes the execution of concurrent workloads using a multi-clustered, shared data architecture. This blog post will be a close look at key principles we wanted to adhere to and how we made it work.

Java 54

Java Python Designing Process 54

Ascend.io

JUNE 6, 2023

Understanding and controlling cloud costs is a fundamental part of how Ascend manages the cloud infrastructure of our dedicated deployment customers. But if reading is not your thing, dive right into the fascinating details of how we master cloud costs in the video below.

Cloud 52

Cloud Data Pipeline Data Ingestion Cloud Storage 52

Snowflake

SEPTEMBER 13, 2023

Maybe you’re going to help hospitals predict emergency room visits and optimize their staffing. Snowflake pricing, for example, is based on the use of storage, compute and cloud services. For listings on Snowflake Marketplace , data providers can opt for usage-based pricing by billable event or by query.

Food 94

Food Retail Hospitality Data 94

Snowflake

FEBRUARY 14, 2023

To do so, they need granular and timely insights into all aspects of the business in order to predict demand and optimize inventory, supply chains, and fulfillment. Here’s how a few of our retail customers are using Snowflake to optimize fulfillment and delivery, leading to a great customer experience.

Retail 52

Retail Portfolio Cloud Accessible 52

Ascend.io

DECEMBER 21, 2022

Solution eliminates the cost of loading and syncing data from all sources within the Ascend platform, allowing teams to focus on accelerating business value. The new feature will address three critical ingest challenges: cost, complexity, and security. MENLO PARK, Calif. , Dec. MENLO PARK, Calif. , Dec.

Data Ingestion 52

Data Ingestion Google Cloud Data Lake Cloud 52

Monte Carlo

JANUARY 23, 2024

The data engineer is a member of the data team primarily focused on building and optimizing the platform for ingesting, storing, analyzing, visualizing, and activating large amounts of data. On the flipside, costs are more constrained. “It Do analytics engineers care about the cost of running their pipelines? I don’t know.”

Data Engineering 98

Data Engineering Data Engineer Engineering Data 98

Snowflake

APRIL 20, 2023

In March, Snowflake released a number of exciting new capabilities including Python Worksheets, the Snowflake Connector for ServiceNow, and expanded support for geospatial data. Snowflake Connectors Snowflake Connector for ServiceNow – public preview Ingest data from ServiceNow into Snowflake automatically.

Medical 54

Medical Retail Python Pharmaceutical 54

Snowflake

MARCH 30, 2023

In this blog post we will use what we have learned in this Data Vault blog series to support the data preparation requirements for ML on Snowflake, using Data Vault patterns for modeling and automation. Based on Tecton blog So is this similar to data engineering pipelines into a data lake/warehouse?

Engineering 81

Engineering Raw Data Data Science Scala 81

Data Engineering Weekly

SEPTEMBER 3, 2023

One key thing to remember when running TPC-DS benchmarks comparing Hudi, Delta, and Iceberg is that by default, Delta + Iceberg is optimized for append-only workloads, while Hudi is, by default, optimized for mutable workloads. My take on this is that I admire what Instacart engineering can build on top of Snowflake.

Data Engineering 73

Data Engineering Data Engineer Engineering Data 73

Data Engineering Weekly

MARCH 5, 2023

The blog narrates how they overcome the challenge with the combination of Cassandra & ElasticSearch [link] Sponsored: [New Guide] The Ultimate Guide to Data Mesh Architecture If implementing data mesh is high on your list of priorities, you’re not alone. link] Faire: The great migration from Redshift to Snowflake Is Redshift dying?

Data Engineering 52

Data Engineering Data Engineer Engineering Datasets 52

Data Engineering Weekly

AUGUST 27, 2023

link] Sponsored: Great Data Debate–The State of Data Mesh Since 2019, the data mesh has woven itself into every blog post, event presentation, and webinar. You can’t say that one is better than the others; the author gives an excellent walkthrough of all three transformation engines.

Data Engineering 52

Data Engineering Data Engineer Engineering Machine Learning 52

Snowflake

MARCH 28, 2023

In addition, leading manufacturers offer data-driven automation solutions to help operators in their day-to-day job, such as calibrating machine settings to the overall line or cluster, thus optimizing end-to-end performance. To learn more about ingesting data into Snowflake, see this previous blog.

Manufacturing 52

Manufacturing Entertainment Transportation Insurance 52

Snowflake

FEBRUARY 16, 2023

In this second installment of our blog series on Industry 4.0, we cover the common industrial use cases our customers want to solve, and showcase how the Snowflake platform can be leveraged for Industry 4.0. There are several ways to analyze and optimize cycle time in an Industry 4.0

Manufacturing 52

Manufacturing Cloud Algorithm Data Pipeline 52

Data Engineering Podcast

MAY 1, 2022

In this episode Doron Porat and Liran Yogev explain how they arrived at their current architecture, the capabilities that they are optimizing for, and the complex process of identifying and evaluating new components to integrate into their systems. What was the scope and directive of the project for building a platform?

Data Warehouse 100

Data Warehouse Data Lake Architecture Data 100

Data Engineering Weekly

DECEMBER 4, 2022

7 Predictions We are navigating a challenging economy which brings focus on optimizations a lot. My take on this The prediction is spot on with the cost optimization, but #1 (cost optimization) & #2 (specialization) conflict. Given the market condition, what would be a leading trend in data for 2023?

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52