Pinterest Engineering

APRIL 7, 2025

Jia Zhan, Senior Staff Software Engineer, Pinterest Sachin Holla, Principal Solution Architect, AWS Summary Pinterest is a visual search engine and powers over 550 million monthly active users globally. Pinterests infrastructure runs on AWS and leverages Amazon EC2 instances for its compute fleet. 4xl with up to 12.5 4xl with up to 12.5

AWS 57

AWS Bytes Database Data Ingestion 57

Cloudyard

FEBRUARY 11, 2025

Snowflake provides detailed usage insights, but integrating this data with AWS CloudWatch using External Functions allows organizations to track cost in real-time, set up alerts, and optimize warehouse utilization. What if we could integrate Snowflake warehouse cost tracking with AWS CloudWatch? link] Create the API Integration.

AWS 59

AWS Finance Cloud Utilities 59

Edureka

APRIL 22, 2025

Understanding the AWS Shared Responsibility Model is essential for aligning security and compliance obligations. The model delineates the division of labor between AWS and its customers in securing cloud infrastructure and applications. Let us begin by defining the Shared Responsibility Model and its core purpose in the AWS ecosystem.

Amazon Web Services 40

Amazon Web Services AWS Cloud Data Governance 40

KDnuggets

JULY 9, 2024

This article is for anyone looking to maximize their use of Amazon Web Services (AWS) generative AI (GenAI) services. Here are eight courses that range from beginner to expert level.

AWS 146

AWS Amazon Web Services 146

Confessions of a Data Guy

MARCH 20, 2023

For a lot of my Data Engineering career I didn’t really think about or use AWS lambdas, I just saw them as little annoying flies […] The post AWS Lambdas. I guess I’ve taken them for granted over the years, even though they are incredibly useful. Useful for Data Engineering?

AWS 130

AWS Data Engineering Data Engineer Engineering 130

Confessions of a Data Guy

AUGUST 4, 2023

The post Introduction to AWS Lambda (deployment) appeared first on Confessions of a Data Guy.

AWS 130

AWS Data Data Engineer Data Engineering 130

databricks

FEBRUARY 6, 2025

Introducing Serverless Support for AWS Instance Profiles: Uniform Data Access At Databricks, we continuously strive to simplify data access and drive innovation across.

AWS 119

AWS Accessible Accessibility Data 119

The Pragmatic Engineer

OCTOBER 17, 2024

There is an increasing number of cloud providers offering the ability to rent virtual machines, the largest being AWS, GCP, and Azure. How the product works: they currently monitor four cloud providers (AWS, GCP, Hetzner Cloud, Azure.) We envision building something comparable to AWS Fargate , or Google Cloud Run.

Cloud 332

Cloud AWS Metadata Cloud Computing 332

Hevo

JANUARY 17, 2025

This is where the AWS data lake comes in. With the AWS data lake, organizations and businesses can store, analyze, and process structured and unstructured data of any size. Digital tools and technologies help organizations generate large amounts of data daily, requiring efficient governance and management.

Data Lake 52

Data Lake AWS Unstructured Data Building 52

Snowflake

DECEMBER 5, 2023

We had a jam-packed week alongside more than 60,000 attendees at Amazon Web Services (AWS) re:Invent, one of the largest hands-on conferences in the cloud computing industry. To learn more about these recent developments on generative AI and integrations with AWS, tune in to BUILD, Snowflake’s upcoming virtual conference for developers.

AWS 124

AWS Amazon Web Services Government Cloud Computing 124

databricks

DECEMBER 3, 2024

We’re thrilled to announce that Databricks has been recognized as a winner in multiple categories at the 2024 AWS Partner of the Year.

AWS 114

AWS 114

Analytics Vidhya

MARCH 5, 2023

Introduction S3 is Amazon Web Services cloud-based object storage service (AWS). It stores and retrieves large amounts of data, including photos, movies, documents, and other files, in a durable, accessible, and scalable manner.

Amazon Web Services 268

Amazon Web Services AWS Cloud Accessible 268

The Pragmatic Engineer

MAY 11, 2023

The company racked up huge bills for the likes of AWS, Snowflake, and also Datadog. Prometheus can be self-hosted, but several cloud providers also offer managed Prometheus services: both Google Cloud and AWS have this service in production, while Azure has it in preview. We hit an all time high in our monthly transacting users of 11.4

AWS 347

AWS Software Engineer Software Engineering Google Cloud 347

Confessions of a Data Guy

NOVEMBER 14, 2023

“Of what use is, and what good does the best and most advanced architecture […] The post Fleetclusters for Databricks + AWS to reduce Costs. Here is my question, riddle me this all you hobbits. appeared first on Confessions of a Data Guy.

AWS 113

AWS Architecture Data IT 113

databricks

DECEMBER 11, 2024

Were excited to announce the Public Preview of Hive Metastore (HMS) and AWS Glue Federation in Unity Catalog! This new capability enables Unity.

AWS 117

AWS 117

Snowflake

JANUARY 31, 2024

Today, we’re excited to announce the general availability of the Snowflake Native App Framework on AWS and Azure! The post Snowflake Native App Framework Now Generally Available on AWS and Azure appeared first on Snowflake. We’ve seen incredible momentum around Snowflake Native Apps.

AWS 122

AWS Government Programming Data Science 122

Analytics Vidhya

MARCH 5, 2023

Introduction Amazon Athena is an interactive query tool supplied by Amazon Web Services (AWS) that allows you to use conventional SQL queries to evaluate data stored in Amazon S3. Athena is a serverless service. Thus there are no servers to operate, and you pay for the queries you perform.

Amazon Web Services 246

Amazon Web Services AWS SQL Data Analysis 246

databricks

NOVEMBER 15, 2024

Databricks is turning up the heat at AWS re:Invent 2024 , and we’re bringing more than just data and AI solutions to the.

AWS 105

AWS Data 105

databricks

FEBRUARY 5, 2025

Were thrilled to announce the General Availability (GA) of Databricks Clean Rooms on AWS and Azure, a significant step forward in enabling secure.

AWS 103

AWS 103

databricks

DECEMBER 11, 2024

For Databricks and AWS, its not just about building togetherits about helping businesses succeed together. At AWS re:Invent. What makes a great partnership?

AWS 98

AWS Building IT 98

Analytics Vidhya

FEBRUARY 8, 2023

Introduction Amazon Redshift is a fully managed, petabyte-scale data warehousing Amazon Web Services (AWS). It allows users to easily set up, operate, and scale a data warehouse in the cloud. Redshift uses columnar storage techniques to store data efficiently and supports data warehousing workloads intelligence, reporting, and analytics.

Amazon Web Services 227

Amazon Web Services AWS Data Warehouse Cloud 227

databricks

NOVEMBER 28, 2023

We’re thrilled to share that Databricks has won the AWS ISV Partner of the Year award for North America. This award recognizes top I.

AWS 111

AWS 111

The Pragmatic Engineer

NOVEMBER 21, 2023

After Zynga, he rejoined Amazon, and was the General Manager (GM) for Compute services at AWS, and later chief of staff, and advisor to AWS executives like Charlie Bell and Andy Jassy (Amazon’s current CEO.) The AWS re:invent conference in 2022 hosted a good in-depth overview of Amazon’s COE process.

Engineering 345

Engineering Bytes Cloud Computing AWS 345

Towards Data Science

JANUARY 14, 2025

Learn how to create a simple, yet powerful REST API with FastAPI, DynamoDB, and AWS Lambda Functions. Continue reading on Towards Data Science

AWS 83

AWS Python Building Data Science 83

The Pragmatic Engineer

OCTOBER 10, 2024

We have seen other similar stories play out recently: In 2021, Elastisearch faced a similar “freerider” challenge from AWS. In response, AWS, GCP, Oracle, Snap and others are backing – and migrating to – the Valkey fork, which remains open source. In response, Elasticsearch ceased  being open source.

Consulting 347

Consulting AWS Engineering Software Engineer 347

KDnuggets

DECEMBER 7, 2021

A lot of missing values in the dataset can affect the quality of prediction in the long run. Several methods can be used to fill the missing values and Datawig is one of the most efficient ones.

Deep Learning 158

Deep Learning AWS Datasets Data Preparation 158

Start Data Engineering

MAY 11, 2022

AWS Infrastructure costs 4.3 Introduction 2. Objective 3. Prerequisite 4.2 Data lake structure 5. Code walkthrough 5.1 Loading user purchase data into the data warehouse 5.2 Loading classified movie review data into the data warehouse 5.3 Generating user behavior metric 5.4. Checking results 6. Tear down infra 7. Design considerations 8.

Data Engineering 246

Data Engineering Data Engineer Project Data Lake 246

Snowflake

NOVEMBER 11, 2024

With Provisional Throughput (public preview soon on AWS), customers can reserve dedicated throughput, ensuring consistent and predictable performance for their workloads. Additionally, we launched cross-region inference , allowing you to access preferred LLMs even if they aren’t available in your primary region.

Unstructured Data 98

Unstructured Data SQL AWS Healthcare 98

Towards Data Science

JANUARY 2, 2025

Introduction Data Proposed Workflow AWS Cloud Components Collecting the Data (Lambda Function 1) Writing the Data to the Table (Lambda Function 2) Converting the data in CSV

AWS 83

AWS Data Pipeline Data Cloud 83

Confluent

MARCH 27, 2025

Combine them with AWS Lambda for a serverless, cost-effective, data pipeline. Freight Clusters are ideal for high-throughput, relaxed latency workloads like telemetry and logging.

AWS 74

AWS Process Data Pipeline Data 74

The Pragmatic Engineer

JUNE 29, 2023

” Other registrars Other providers which several developers recommended, in order of popularity: AWS Route 53 : the obvious choice for those already on AWS. AWS uses Gandi under the hood for many of its domains. We see ourselves in the industry and reinforce that we as a registrar are not going away anytime soon!”

AWS 65

AWS Software Engineer Software Engineering Engineering 65

Snowflake

NOVEMBER 11, 2024

Unistore is made possible by Hybrid Tables (now generally available on AWS commercial regions with a few exceptions ), which enables fast, single-row reads and writes in order to support transactional workloads.

Data Architecture 105

Data Architecture Architecture Data Lake Kafka 105

Netflix Tech

APRIL 8, 2025

As noted in our previous blog post, our initial attribution approach relied on Sonar , an internal IP address tracking service that emits an event whenever an IP address in Netflixs AWS VPCs is assigned or unassigned to a workload. Netflixs cloud microservices operate across multiple AWS regions. With 30 c7i.2xlarge

AWS 75

AWS Kafka Cloud Programming 75

Snowflake

DECEMBER 11, 2023

The authorization furthers Snowflake’s commitment to helping our government customers secure and mobilize their mission-critical data It’s a milestone moment for Snowflake to have achieved FedRAMP High authorization on the AWS GovCloud (US-West and US-East Regions). Find out how Snowflake is leveraging modern data to advance national defense.

AWS 111

AWS Education Hospitality Government 111

The Pragmatic Engineer

SEPTEMBER 26, 2023

AWS launched in 2006, Azure in 2010, and GCP launched its first region in 2015. The segment really took off around 2018, although Cloud9 – which AWS acquired in 2017 – was founded in 2010. But the most recent 10 years suggest this is no longer the case. The Cloud is spreading and offering more capabilities.

Cloud 316

Cloud Software Engineer Software Engineering Cloud Computing 316

Snowflake

MARCH 31, 2025

Inference: Model Serving in Snowpark Container Services, now generally available in both AWS and Azure, offers easy and performant distributed inference with CPUs or GPUs for any model, regardless of where it was trained. Snowflake ML now also supports the ability to generate and use synthetic data, now in public preview.

Healthcare 96

Healthcare Medical Government Food 96

Snowflake

FEBRUARY 27, 2025

Amazon Web Services (AWS) has also committed to provide up to $1 million in free Snowflake credits on AWS over four years to support startups building and offering applications on Snowflakes platform. Access to credits to help build : AWS provides participants with free Snowflake credits to build, test and launch their applications.

Cloud 93

Cloud IT Amazon Web Services AWS 93