The Pragmatic Engineer

SEPTEMBER 19, 2023

For example, here’s a post from 2004 from a member of the Microsoft Exchange team explaining what it means to be an SDET in their organization: “An SDET is a developer who works in a test team and not a development team. If you love doing what you are doing as an SDET then you can grow to become a Test Architect.

Software Engineer 281

Software Engineer Software Engineering Coding Engineering 281

Jesse Anderson

OCTOBER 5, 2023

I think the writing on the wall is clear for ksqlDB and remains unclear for Kafka Streams. I think this is one of the keys to our industry creating more value. In another post , I introduced a concept from Justin Coffey about how much systems can be changed from their original design. What has changed?”

Kafka 195

Kafka Finance Cloud Designing 195

Christophe Blefari

DECEMBER 30, 2022

Madison had a look a job posting to see what are the skills companies really want in Analytics Engineers. kitsch moment, from me to you ( credits ) Hey you, this is the last article of the year and it's gonna be about the articles and trends that made 2022 according to me. Preset wrote a gentle introduction to data modeling.

Data Warehouse 130

Data Warehouse BI Data Machine Learning 130

Christophe Blefari

JULY 28, 2023

Every link sent in each newsletter is tracked in 2 ways: when you click on a link it first redirect you to my blog so I know that you've clicked on it it adds ref=blef.fr I say at least because this is an low estimated number, from a projected experience I think that in the reality it's twice this number. A few numbers.

Data 130

Data SQL Python Programming 130

Data Engineering Weekly

MARCH 31, 2024

Intuit wrote an exciting article about what it learned from rolling out the internal GenAI tool. The blog further emphasizes its increased investment in Data Mesh and clean data. The blog is an excellent overview of all the improvements made to PySpark in 2023. The problem statement is certainly pretty interesting.

Data Engineering 62

Data Engineering Data Engineer Engineering Scala 62

Christophe Blefari

JANUARY 7, 2024

With the exception of my trip to Japan in 2019, I think this is the first time in my life it's happened in this way. What 2023 brought: Followers — I doubled in followers on my 3 main platforms: I reached 4000 people on the blog, 8000 on LinkedIn and almost 600 on Twitter (even if I don't post that much there).

Data 130

Data SQL Python Data Engineering 130

Christophe Blefari

NOVEMBER 18, 2023

Still I've accumulated a lot of articles that I think should fit in the Data News so this week might be a huge recap of content that has been produce in the last month. I think it will not be live but the recording will be published after the event on YouTube I think. I hope you will enjoy the selection.

Food 147

Food Data Data Lake Retail 147

Snowflake

APRIL 24, 2024

It was designed and trained using the following three key insights and innovations: 1) Many-but-condensed experts with more expert choices: In late 2021, the DeepSpeed team demonstrated that MoE can be applied to auto-regressive LLMs to significantly improve model quality without increasing compute cost. Truly Open: Apache 2.0

Amazon Web Services 145

Amazon Web Services SQL AWS Architecture 145

Christophe Blefari

MARCH 4, 2023

After last week question about your consideration of a paying subscription I got a few feedbacks and it helped me a lot realise how you see the newsletter and what it means for a you. I'll try to think about it in the following weeks to understand where I go for the third year of the newsletter and the blog.

Machine Learning 130

Machine Learning AWS Data Data Lake 130

Towards Data Science

JULY 10, 2023

Not the exact steps to take in the tool — that is all covered in innumerable blogs and tutorials. I mean how do you know the right design? This article is the result of research and experiments into how best to design and implement a dbt model. Image Source: This work by the Design Council is licensed under a CC BY 4.0

Designing 98

Designing Electronics Coding Engineering 98

Knowledge Hut

MARCH 20, 2024

The UI/UX design industry is rapidly evolving with more professionals coming into the sector. With a wide range and variety of UX design books available on the internet, professionals like you can continue to enhance your skills and broaden your knowledge base. What is UI/UX?

Designing 52

Designing Portfolio Media Certification 52

Data Engineering Podcast

MARCH 25, 2023

The peril is that building a robust and scalable streaming architecture is always more complicated and error-prone than you think it's going to be. Can you describe what Grainite is and the story behind it? What are the personas that you are focused on addressing with Grainite? We feel your pain.

MySQL 130

MySQL Python Architecture Machine Learning 130

Workfall

SEPTEMBER 18, 2023

In this blog, we’re diving into the world of data integration with Airbyte, unraveling the mystery behind its simplicity, and uncovering how it seamlessly connects with Snowflake to transform your data into actionable insights. In this blog, we will cover: What is Airbyte?

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93

Christophe Blefari

DECEMBER 31, 2023

I presented what I believe to be the future from my DuckDB experiments. In this one it details all the components in a LLM—a big part explain what's a Transformer. What I wish someone had told me — It's borderline AI news, but as the author is Sam Altman, I think it belongs here. Yeah, you know.

Data 100

Data Cloud Storage Datasets Python 100

Data Engineering Weekly

FEBRUARY 11, 2024

What do you think of Data Products? link] Solmaz Shahalizadeh: What founders need to know to build a high-performing data team “A number alone is never the answer for a great data team. It's what we’re going to do as a result of it,” says Solmaz Shahalizadeh, former vice president and head of data at Shopify.

Data Engineering 62

Data Engineering Data Engineer Engineering SQL 62

DataKitchen

APRIL 18, 2024

In this blog, we peel back the curtain to share the philosophy, journey, and, most importantly, the why behind this significant move. What is DataOps Observability? That’s what DataOps Observability promises. What is DataOps TestGen? What Makes These Tools Unique?

Data Analytics 48

Data Analytics Data SQL Software Engineer 48

Data Engineering Podcast

DECEMBER 12, 2021

In this episode Gokul Prabagaren shares his use for it in calculating your rewards points, including the auditing requirements and how he designed his pipeline to maintain all of the necessary information through a pattern of data enrichment. What are the various ways that you are using Spark at Capital One?

Building 130

Building Data Pipeline BI Data Warehouse 130

Data Engineering Weekly

MARCH 3, 2024

3) DataOPS at AstraZeneca The AstraZeneca team talks about data ops best practices internally established and what worked and what didn’t work!!! 3) DataOPS at AstraZeneca The AstraZeneca team talks about data ops best practices internally established and what worked and what didn’t work!!!

Data Engineering 67

Data Engineering Data Engineer Pipeline-centric Engineering 67

Knowledge Hut

MARCH 27, 2024

In this blog, we will learn that UI copywriting is not simply communication with users; rather, UI copywriters research user requirements, predict their questions and even create answers for them. What is UI Copywriting? Ensure bold and large CTAs with contrasting coloring (as per the designing team) to make them stand out.

Designing 52

Designing Technology Government Certification 52

Jesse Anderson

MARCH 6, 2023

This survey was designed to get information about how management uses data teams, the value they’re creating, and how they’re creating it. In this post, I’ll go through the results and analysis of what the results mean. Figure 6 – How successful do you think your big data projects are? to get an idea of what went well.

Consulting 130

Consulting Data Data Science Big Data 130

Knowledge Hut

DECEMBER 5, 2023

What comes to your mind when you hear the term “Product Designer”? What are their roles and responsibilities? All these questions may spring up when you hear the term “product designer” Product designers are creative people who put user experience before anything else.

Designing 52

Designing Portfolio Education Certification 52

Cloudera

NOVEMBER 29, 2023

Think of it as your digital vault for machine learning models, a central hub that stores, organizes, and tracks every facet of your models and their life cycle. What does the Model Registry offer? What does the Model Registry offer? That’s where the Model Registry steps in.

Machine Learning 83

Machine Learning Metadata Cloud Project 83

Rockset

FEBRUARY 22, 2024

First, we'll start with some conceptual points about how to think about DynamoDB and the problems that secondary indexes solve. What is DynamoDB, and what are DynamoDB secondary indexes? Before we get into use cases and best practices for secondary indexes, we should first understand what DynamoDB secondary indexes are.

Database 80

Database Relational Database Accessible Accessibility 80

Data Engineering Podcast

SEPTEMBER 4, 2022

What are the notable changes in the Monte Carlo product and business since our last conversation in October 2020? In your work to gain visibility and traction you invested substantially in content creation (blog posts, presentations, round table conversations, etc.). Why do you think data observability has really taken off?

IT 100

IT Metadata MongoDB MySQL 100

Netflix Tech

OCTOBER 12, 2022

We had a fun conversation with his team, and we realized that some parts of it might make a good blog post as well. So we jointly edited a bit for length and clarity, and are posting here as well as on OfferFit’s blog. And a lot of non-tech companies also are increasingly trying to be customer centric in their thinking.

Building 75

Building Designing Management Algorithm 75

Knowledge Hut

MARCH 20, 2024

In this blog, we will explore the key skills required for a bright future in the EdTech industry and the tools available to develop these educational technology skills. What is an EdTech Job EdTech job involves leveraging technology to transform education and enhance the teaching and learning experience.

Education 52

Education Programming Language Cloud Computing Technology 52

Knowledge Hut

MARCH 19, 2024

In this blog, I will describe the role of a Machine Learning Software Engineer, their responsibilities, required skills, and the path to becoming one. What Do Machine Learning Software Engineers Do? Who Is a Machine Learning Software Engineer? Here are a few key Machine Learning software engineer responsibilities : 1. Soft Skills: 1.

Software Engineer 52

Software Engineer Software Engineering Machine Learning Engineering 52

DoorDash Engineering

SEPTEMBER 19, 2023

As a tech company, it’s our products and platform – and the engineers that build them – that power what DoorDash is able to offer our Consumers, Dashers, and Merchants every day. see this blog post for how we think about great engineering management). Business Outcome comprises two subcategories: Delivery and Direction.

Engineering 89

Engineering Recruitment Certification Data Analysis 89

RandomTrees

MARCH 27, 2024

This extraordinary innovation goes about as an imaginative force to be reckoned with, equipped for creating unique content like fine art, designs, and virtual environments. Basically, generative AI goes about as an impetus for development, pushing the limits of what is conceivable in different fields.

IT 52

IT Medical Entertainment Healthcare 52

DoorDash Engineering

NOVEMBER 28, 2023

It is amusing for a human being to write an article about artificial intelligence in a time when AI systems, powered by machine learning (ML), are generating their own blog posts. Setting an initial ambitious goal to drive model development velocity, we soon assembled a team that included both design and engineering.

Machine Learning 91

Machine Learning Pipeline-centric Data Science Designing 91

Knowledge Hut

MARCH 13, 2024

All Google software products are designed to handle information at a massive scale, extending well beyond traditional web searches. What Do Google Software Engineers Do? What Do Google Software Engineers Do? The Web Designing Development course can help you learn how to work as a Google software engineer.

Software Engineer 52

Software Engineer Software Engineering Process Engineering 52

Scott Logic

APRIL 18, 2024

The Internal App Portal Project What do you do when you’re a software consultancy that uses small, internally developed applications, and you need to be able to spin those applications up on demand? Talking of the app going down, we needed to think about redundancy, and what happens if the app goes down whilst a child app build is running.

AWS 52

AWS Building Consulting Architecture 52

Knowledge Hut

MARCH 19, 2024

The demand for highly skilled UI/ UX designers is steadily increasing in the constantly evolving software industry. Firstly, the UI design involves anything and everything a web or app user engages with while exploring a digital product or service. Hence, it can be a laptop screen, audio device, keyboard, etc.

Designing 52

Designing Education Computer Science Programming 52

Tweag

JANUARY 17, 2024

Say f True x y = [ toUpper c | c <- show x ++ show y ] f False x y = show x ++ y There’s a lot left implicit here: What are the types of x , y , and c ? The typechecker is carefully designed; it’s actually very easy to come up with a sound type system which is undecidable. I recently merged linear let- and where-bindings in GHC.

Algorithm 124

Algorithm AWS Designing Systems 124

Towards Data Science

MAY 19, 2023

So what does Entropy look like in the context of a data platform? That said, you should also be thinking ahead and favor solutions that can scale with your needs and provide the level of flexibility you will require in your hyper growth phase. Some nice reads for my math nerds out there ( here and here ). The list goes on.

Pipeline-centric 105

Pipeline-centric Data Software Engineer Software Engineering 105

Robinhood

FEBRUARY 20, 2024

Hear from Abigail Spooner, a Senior Designer at Robinhood, about the campaign’s strategy to amplify Gold’s cash sweep offering, increase product awareness, and drive sign-ups—all while seamlessly integrated with the core Robinhood brand identity. Introducing the creative campaign for Robinhood Gold! Hi, I’m Abigail!

Banking 66

Banking Designing Insurance Programming 66

Edureka

DECEMBER 5, 2023

We’ll explore the depths of HCI in this blog, looking at its immense advancements, repercussions for the future, and ongoing changes to the way we work, play, and engage in a connected digital world. We will be exploring topics like: What is Human-Computer Interaction ? Evolution of HCI Why is HCI important?

Computer Science 52

Computer Science Education Entertainment Medical 52