Apache Iceberg Reader (Technical Preview)

FME can read attribute data stored in Iceberg tables.

Apache Iceberg is an open-source table format designed for large analytic datasets on data lakes. It provides ACID (atomicity, consistency, isolation, durability) transaction capabilities, schema evolution, hidden partitioning, and time travel over data stored in open file formats such as Apache Parquet. Iceberg tables can be queried efficiently by multiple engines concurrently, making them well-suited for analytical and batch processing use cases.

Technical Preview

This format is still under active development, so please expect changes to the current behavior. Safe Software does not recommend using this format in production environments.

Product and System Requirements

Format

FME Platform

Operating System

Reader/Writer

FME Form

FME Flow

FME Flow Hosted

Windows 64-bit

Linux

Mac

Reader

Yes

Yes

Yes

Yes

Yes

Yes

Terminology: Iceberg and FME

Iceberg

FME

table

feature type

row

feature

column

attribute

Reader Overview

The Iceberg reader reads a specified set of Iceberg tables. Names and URLs of the tables must be defined in the connection parameters before they can be read.