Google BigQuery Writer (FME Desktop Package)

Licensing options for this format begin with FME Desktop Professional Edition.

The Google BigQuery writer makes it easy to load and query spatial and non-spatial features into and from Google BigQuery.

Integrating this Format with FME Desktop

Download from FME Hub

https://hub.safe.com/publishers/safe/packages/google-bigquery

What is FME Hub?

Package Filename

safe.google-bigquery-0.5.1.fpkg

To install the format package, double-click the downloaded fpkg file.

Version

0.5.1

Requirements

FME Build 19580+

Overview

BigQuery is a managed NoSQL database service offered by Google. The BigQuery reader communicates using HTTP requests managed by the Google APIs Client Library for Java.

This chapter assumes familiarity with BigQuery.

For more information, please visit the BigQuery home at

https://cloud.google.com/products/bigquery/

Writer Overview

Google BigQuery supports geometries in its columns. The writer supports generating a WKT spatial column from features and loading it into BigQuery as GEOGRAPHY type column.

The Google BigQuery writer works by writing incoming features to a temporary CSV file, which is then loaded to BigQuery using the Google Cloud BigQuery API. This CSV is removed from the system after the translation has run.

The schema can be manually set or automatically assigned based on the FME data type in the User Attributes tab. A spatial column can be added if the feature contains geometries. 2D geometries are accepted only in the LL84, LL-WGS84, EPSG:4326 coordinate systems.

Google BigQuery may reject features. This typically occurs when the schema and data do not match or spatial data is corrupt or is incompatible with BigQuery.

Writer Dataset

The writer dataset is configured in the Google BigQuery Writer Parameters.

Coordinate System

The writer will automatically reproject features to LL-WGS84 if they are tagged with a different coordinate system.