Apache Iceberg V3

Iceberg V3 deletion vectors et row lineage 2024.

Définition

Iceberg V3 (TableSpec v3) ajoute : default values per column, geospatial WKB type, variant type (semi-structured), row lineage tracking, multi-arg transforms partition, deletion vectors Position et Equality (Puffin format). Compatible Iceberg V2 backward (mais V3 features requiert V3 readers/writers). Adopté Snowflake, Databricks, AWS Athena, Google BigQuery (preview), Apache Spark, Trino.

Origine

Netflix 2017 puis Apache Software Foundation Top-Level Project 2020. V1 2018, V2 2021, V3 spec 2024.

Usage

Format emerging dominant data lakehouse 2024+. Concurrent direct Delta Lake (Databricks) et Apache Hudi.

Termes liés

• Apache Iceberg — fiche socle.
• Delta Lake V4 — concurrent direct.
• Apache Hudi — concurrent.