article thumbnail

AWS Lambdas – Python vs Rust. Performance and Cost Savings.

Confessions of a Data Guy

Someone on Linkedin recently brought up the point that companies could save gobs of money by swapping out AWS Python lambdas for Rust ones. At least it’s an excuse to […] The post AWS Lambdas – Python vs Rust. While it raised the ire of many a Python Data Engineer, I thought it sounded like a great idea.

AWS 356
article thumbnail

DuckDB … reading from s3 … with AWS Credentials and more.

Confessions of a Data Guy

What was not clear, or easy, was trying to figure out how DuckDB would LIKE to read default AWS […] The post DuckDB … reading from s3 … with AWS Credentials and more. appeared first on Confessions of a Data Guy.

AWS 113
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

What Is AWS DMS And Why You Shouldn’t Use It As An ELT

Seattle Data Guy

Recently, I’ve encountered a few projects that used AWS DMS, which is almost like an ELT solution. It was interesting to see AWS DMS used in this manner. As… Read more The post What Is AWS DMS And Why You Shouldn’t Use It As An ELT appeared first on Seattle Data Guy. But it’s not what DMS was built for.

AWS 130
article thumbnail

Handling a Regional Outage: Comparing the Response From AWS, Azure and GCP

The Pragmatic Engineer

13 June 2023: AWS. The largest AWS region (us-east-1) degraded heavily for 3 hours, impacting 104 AWS services. We did a deepdive into this incident earlier in AWS’s us-east-1 outage. We’ll also learn how this article contributed to AWS publishing its first public postmortem in two years!

AWS 232
article thumbnail

Polars vs Pandas. Inside an AWS Lambda.

Confessions of a Data Guy

Inside an AWS Lambda. I also enjoy doing simple things, things that have a “real-life” feel to them. I suppose I could be like the others […] The post Polars vs Pandas. appeared first on Confessions of a Data Guy.

AWS 240
article thumbnail

Cloudera announces ‘Interoperability Ecosystem’ with founding members AWS and Snowflake

Cloudera

But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. For example: An AWS customer using Cloudera for hybrid workloads can now extend analytics workflows to Snowflake, gaining deeper insights without moving data across infrastructures.

AWS 60
article thumbnail

Cloudera and AWS Partner to Deliver Cost-Efficient and Sustainable Infrastructure for AI and Analytics

Cloudera

To that end, we’re collaborating with Amazon Web Services (AWS) to deliver a high-performance, energy-efficient, and cost-effective solution by supporting many data services on AWS Graviton. And AWS is a crucial ally for Cloudera in enabling companies to scale AI operations responsibly.

AWS 73