DuckDB Reader

FME can read attribute data processed by the DuckDB system.

DuckDB is an OLAP (Online Analytical Processing) database system and processor for DuckDB, CSV, JSON, and Parquet data.

DuckDB Product and System Requirements

Compatibility  This reader is compatible with DuckDB databases versions 0.9 and 0.10. For more information, please refer to DuckDB Storage Versions and Format.

Format

FME Platform

Operating System

Reader/Writer

FME Form

FME Flow

FME Flow Hosted

Windows 64-bit

Linux

Mac

Reader

Yes

Yes

Yes

Yes

Yes

Yes

Terminology: DuckDB and FME

DuckDB

FME

table or view

feature type

row

feature

column

attribute

Reader Overview

FME considers a database dataset to be a collection of relational tables. The tables must be defined in the workspace before they can be read. All tables will be read.

The reader may also read CSV, JSON, and Parquet data.

 Using DuckDB with the SQLExecutor and SQLCreator Transformers in FME

The primary use case for DuckDB within FME involves using it within the SQLExecutor and SQLCreator transformers. Instead of using DuckDB as a traditional reader, you can leverage its powerful SQL capabilities directly within these transformers.

  • For example, you can use these transformers to import or export data from various formats, and efficiently perform SQL over the data.
  • By incorporating DuckDB within these transformers, you can enhance your data processing workflows, taking full advantage of SQL's flexibility and DuckDB’s performance.