Aggregated Data Data Pipeline Demo Metadata 
WeCloudData
OCTOBER 19, 2021
It was recommended to pause the crawlers and enable glue metadata registry on the Kinesis level. We proposed a few designed changes, one of the most suitable method is to use Athena and QuickSight for data analytics and data visualization (See appendix for dashboard that WeCloudData team created).
WeCloudData
OCTOBER 19, 2021
It was recommended to pause the crawlers and enable glue metadata registry on the Kinesis level. We proposed a few designed changes, one of the most suitable method is to use Athena and QuickSight for data analytics and data visualization (See appendix for dashboard that WeCloudData team created).
Rockset
AUGUST 26, 2022
When a change is detected, the data is ingested into a data lake hosted on Amazon S3. There, the data is converted, tagged with metadata, cleaned, and de-duplicated in preparation for queries. They demoed but quickly eliminated Snowflake.
Expert insights. Personalized for you.
52 
Let's personalize your content