The Google BigQuery writer makes it easy to load and query spatial and non-spatial features into and from Google BigQuery.
Integrating this Format with FME Form
|
Download from FME Hub |
https://hub.safe.com/publishers/safe/packages/google-bigquery |
|
Other Package Components |
GoogleBigQueryConnector transformer |
Google BigQuery Product and System Requirements
|
Package Format |
FME Platform |
Operating System |
||||
|---|---|---|---|---|---|---|
|
Reader/Writer |
FME Form |
FME Flow |
FME Flow Hosted |
Windows 64-bit |
Linux |
Mac |
|
Writer |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Dependencies
This package requires Google Cloud account credentials (either via a previously defined FME web connection, or by setting up a new FME web connection from the GoogleBigQueryConnector transformer) to access Google BigQuery services.
Overview
BigQuery is a managed NoSQL database service offered by Google. The BigQuery reader communicates using HTTP requests managed by the Google APIs Client Library for Java.
This chapter assumes familiarity with BigQuery.
For more information, please visit the BigQuery home at
https://cloud.google.com/products/bigquery/
Writer Overview
Google BigQuery supports geometries in its columns. The writer supports generating a WKT spatial column from features and loading it into BigQuery as GEOGRAPHY type column.
The Google BigQuery writer works by writing incoming features to a temporary CSV file, which is then loaded to BigQuery using the Google Cloud BigQuery API. This CSV is removed from the system after the translation has run.
The schema can be manually set or automatically assigned based on the FME data type in the User Attributes tab. A spatial column can be added if the feature contains geometries. 2D geometries are accepted only in the LL84, LL-WGS84, EPSG:4326 coordinate systems.
Google BigQuery may reject features. This typically occurs when the schema and data do not match or spatial data is corrupt or is incompatible with BigQuery.
Writer Dataset
The writer dataset is configured in the Google BigQuery Writer Parameters.
Coordinate System
The writer will automatically reproject features to LL-WGS84 if they are tagged with a different coordinate system.