An overview of Apache Hudi, Apache Iceberg, and Delta Lake.

In this video, we talk about the basics of how Hudi, Iceberg, and Delta Lake work. You'll see how to insert, update, and delete data in your data lake and how each of these frameworks work behind the scenes.

Blog post: https://dacort.dev/posts/modern-data-lake-storage-layers/
GitHub Repo with CloudFormation and Notebooks: https://github.com/dacort/modern-data-lake-storage-layers

Table of Contents:

00:00 - Intro
03:21 -  Environment Setup
05:23 - Apache Hudi - Writes
07:38 - Apache Hudi - Updates
12:23 - Apache Hudi - Deletes
14:43 - Apache Hudi - Time Travel
17:19 - Apache Iceberg - Writes
23:48 - Apache Iceberg - Updates
26:49 - Apache Iceberg - Deletes
28:46 - Apache Iceberg - Time Travel
30:14 - Delta Lake - Writes
31:57 - Delta Lake - Updates
34:23 - Delta Lake - Deletes
35:35 - Delta Lake - Time Travel
36:47 - Wrapup

The main idea of this article is to show how to use CNAME of Route53 to pull or/and push images from/to AWS ECR service. By default, Amazon…