Google BigQuery Writer (FME Desktop Package)

Licensing options for this format begin with FME Desktop Professional Edition.

The Google BigQuery writer makes it easy to load and query spatial and non-spatial features into and from Google BigQuery.

Integrating this Format with FME Desktop

Download from FME Hub

https://hub.safe.com/publishers/safe/packages/google-bigquery

What is FME Hub?

Package Filename

safe.google-bigquery-1.0.1fpkg

To install the format package, double-click the downloaded fpkg file.

Other Package Components

GoogleBigQueryConnector transformer

Version

1.0.1

Requirements

FME Build 21261+

Google BigQuery Product and System Requirements

Package Format

Product

Operating System

Reader/Writer

FME Desktop License

FME Server

FME Cloud

Windows

Linux

Mac

Writer

Available in FME Professional Edition and higher

Yes

Yes

32-bit: Yes

64-bit: Yes

Yes

Yes

Dependencies

This package requires Google Cloud account credentials (either via a previously defined FME web connection, or by setting up a new FME web connection from the GoogleBigQueryConnector transformer) to access Google BigQuery services.

Overview

BigQuery is a managed NoSQL database service offered by Google. The BigQuery reader communicates using HTTP requests managed by the Google APIs Client Library for Java.

This chapter assumes familiarity with BigQuery.

For more information, please visit the BigQuery home at

https://cloud.google.com/products/bigquery/

Writer Overview

Google BigQuery supports geometries in its columns. The writer supports generating a WKT spatial column from features and loading it into BigQuery as GEOGRAPHY type column.

The Google BigQuery writer works by writing incoming features to a temporary CSV file, which is then loaded to BigQuery using the Google Cloud BigQuery API. This CSV is removed from the system after the translation has run.

The schema can be manually set or automatically assigned based on the FME data type in the User Attributes tab. A spatial column can be added if the feature contains geometries. 2D geometries are accepted only in the LL84, LL-WGS84, EPSG:4326 coordinate systems.

Google BigQuery may reject features. This typically occurs when the schema and data do not match or spatial data is corrupt or is incompatible with BigQuery.

Writer Dataset

The writer dataset is configured in the Google BigQuery Writer Parameters.

Coordinate System

The writer will automatically reproject features to LL-WGS84 if they are tagged with a different coordinate system.

Format Resources