Runs SQL statements on BigQuery tables, with the option of storing the result in a destination table. Google BigQuery is a managed NoSQL database service.
For more information about BigQuery, please visit the Google Cloud BigQuery product page.
How does it work?
The GoogleBigQueryConnector uses your Google Cloud account credentials (either via a previously defined FME web connection, or by setting up a new FME web connection right from the transformer).
Configuration
Input Ports
Input
This transformer accepts any feature.
Output Ports
Output
The output port will contain attributes set in the Exposed Attributes parameter, which correspond to the columns from the ran query. Geography functions will output as WKT (well-known text).
Initiator
The incoming feature is output through this port.
<Rejected>
Features that cause the operation to fail are output through this port. An fme_rejection_code attribute, will be added, along with a more descriptive fme_rejection_message attribute which contains more specific details as to the reason for the failure.
Note: If a feature comes in to the GoogleBigQueryConnector already having a value for fme_rejection_code, this value will be removed.
Rejected Feature Handling: can be set to either terminate the translation or continue running when it encounters a rejected feature. This setting is available both as a default FME option and as a workspace parameter.
Parameters
Authentication
| Credential Source |
Credentials can be used from different sources. Using a web connection integrates best with FME but in some cases, you may wish to use one of the other sources.
|
| Account |
Available when the credential source is Web Connection. To create a Google BigQuery web connection, click the Account drop-down box and select Add Web Connection. The connection can then be managed via Tools > FME Options > Web Connections. |
| Project ID | The Google Cloud project id. Only required when the credential source is Web Connection. |
Options
Query
The SQL query to run.
Enable Destination Table
If checked, the results will be stored in a destination table. The default setting is unchecked.
Table Handling
Controls the action when loading data into the destination table. Creates a new table if the table does not exist.
- Overwrite: Replaces all existing data in the table.
- Append: Appends the data to the end of the table.
- Write if empty: Writes the data only if the table is empty.
Destination Dataset
The dataset of the destination table.
Destination Table
The table where results are stored.
Exposed Attributes
The list of attributes to output. Attributes should be the column names of the query.
Editing Transformer Parameters
Using a set of menu options, transformer parameters can be assigned by referencing other elements in the workspace. More advanced functions, such as an advanced editor and an arithmetic editor, are also available in some transformers. To access a menu of these options, click 
beside the applicable parameter. For more information, see Transformer Parameter Menu Options.
Reference
|
Processing Behavior |
|
|
Feature Holding |
No |
| Dependencies | Google Cloud Storage Account |
| FME Licensing Level | FME Base Edition and above |
| Aliases | |
| History | Released FME 2019.1 |
| Categories |
FME Community
The FME Community is the place for demos, how-tos, articles, FAQs, and more. Get answers to your questions, learn from other users, and suggest, vote, and comment on new features.
Search for all results about the GoogleBigQueryConnector on the FME Community.
Examples may contain information licensed under the Open Government Licence – Vancouver