How I Built A Cascading Data Pipeline Based on AWS (Part 2)

Automatic, scalable, and powerful

Memphis Meng
Towards Data Science
10 min readAug 25, 2023

--

Photo by Mehmet Ali Peker on Unsplash

Previously, I shared my experience in developing a data pipeline using AWS CloudFormation technology. It is not an optimal approach, though, because it leaves behind 3 more issues awaiting resolution:

  1. The deployment has to be imposed manually which could increase the chances of…

--

--