Google BigQuery Writer Parameters

Service Connection

Credential Source

For Google Cloud authentication information, see Getting Started with Authentication.

  • Web Connection: Uses Google Cloud BigQuery API via OAuth 2.0 to authenticate and make requests.
  • Service Account: Uses the Google service account file specified in the system’s path. See Authenticating With a Service Account Key File.

About Web Connections

Connections store authentication information.

For general information about web connections, please see Using Web Connections.

For information about managing web services (including authorization credentials such as Client Id and Client Secret), please see Managing Web Services.

Connection

From the Connection parameter in a web service format, you can do one of the following:

  • Select an existing previously defined connection. For information, see the section Reusing a Web Connection in Using Web Connections.
  • Select Add Web Connection to define a new connection. The new connection can be made visible only to the current user, or can be shared among multiple users.

Account

Select web connection account for authentication.

Project

Select the Google BigQuery project.

Write Options

Table Handling

  • Write if Empty (default) – Load features to table only if the table is empty, or does not exist.
  • Append – Load features on a pre-existing table.
  • Overwrite – Overwrite the entire table with only the new features. All pre-existing data will be overwritten.

Dataset

The dataset to load features into. This dataset must exist before writing to it.

Number of errors allowed

The number of features allowed to produce errors and be ignored. These features will be skipped and not loaded onto Google BigQuery.

Value: Must be greater than 0.

Table Splitting

The number of features to write at a time to BigQuery.

The default is 0, in which features are written at the end of translation.

Spatial

Coordinate systems may be extracted from input feature data sources, may come predefined with FME, or may be user-defined. FME allows different output and input coordinate systems, and performs the required coordinate conversions when necessary. To perform this reprojection, FME uses the CS-MAP reprojection engine, which includes definitions for thousands of coordinate systems, with a large variety of projections, datums, ellipsoids, and units.

For systems that know their coordinate system, this field will display Read from Source and FME will read the coordinate system from the source dataset. For most other input sources, the field will display Unknown (which simply means that FME will use default values). In most cases, the default value is all you'll need to perform the translation.

You can always choose to override the defaults and choose a new coordinate system. Select More Coordinate Systems from the drop-down menu to open the Coordinate System Gallery.

For more information, see the links below:
  • None – Google BigQuery will infer and assign data types to columns based on the incoming data
  • Geography – A spatial column will be generated from the geometries attached to the loaded features and interpreted in WKT. The column will data type will be set to GEOGRAPHY on Google BigQuery.

When Spatial Type is set to Geography, specify the name of the column that will hold GEOGRAPHY type data.

Advanced

This setting enables the creation of tables without data features.

  • No – Tables are only created when receiving data features.
  • Yes – Tables are created without data features if possible.
Note  See Creating Tables Without Data Features for more information.