Amazon DynamoDB Reader Parameters
AWS DynamoDB Connection
Specifies the region to use when connecting to Amazon Web Services, and dictates where tables are read from and written to. If Other Region is selected, specify a region manually under Endpoint, using the full endpoint (for example, dynamodb.eu-west-1.amazonaws.com
.)
Note: DynamoDB tables are region-dependent, so selecting an incorrect region will prevent your table from appearing in the table list.
The AWS Access Key ID of the user who will access the database.
The user must exist with appropriate DynamoDB permissions. If this entry is not found, the access key ID will be searched for in various places. These are, in order:
- a file called AwsCredentials.properties on the Java classpath
- aws.accessKeyId in the Java system properties
- the environment variable AWS_ACCESS_KEY_ID
Once a pair of credentials is found, the search will stop.
The secret access key associated with the user accessing the database.
If this parameter is not found, the secret key will be searched for in various places. These are, in order:
- a file called AwsCredentials.properties on the Java classpath
- aws.secretKey in the Java system properties
- the environment variable AWS_SECRET_KEY
Once a pair of credentials is found, the search will stop.
Constraints
After you have specified the database connection, click the Browse button to select tables for import. A connection window appears while the system compiles a table from the database.
Once the table list appears, you can select one or more tables, and then click OK to dismiss the window. The table name(s) will appear in the Table List field in the parameter box.
Note: If the table list does not display your table, ensure you have selected the appropriate region in the writer parameters. DynamoDB tables are region-dependent, so selecting an incorrect region will prevent your table from appearing in the table list.
If you wish to query against a table’s secondary index, you must select only that table from the Table List.
After you have selected a table to import, click the Browse button to select an optional secondary index to query against. A connection window appears while the system compiles a list of secondary indexes associated with the table named in the Table List field.
Once the index list appears, you can select one index, and then click OK to dismiss the window. The index name will appear in the Secondary Index field in the parameter box.
If a secondary index is selected, only a reader for the secondary index and not the table will be created.
Note: If you select a Secondary Index, the Specify Query Parameters below will use the keys from the Secondary Index.
If enabled, only items with a primary key that satisfy the specified key value conditions will be read from the table.
Partition Key Value
The partition key value of the items to read from the table.
Query Sort Key
If enabled, only items that satisfy both the partition key and sort key value conditions will be read from the table.
Sort Operator, Sort Key Value 1, Sort Key Value 2
Specifies the operator and values used to query sort keys. The following operators are supported:
= | Only items with sort key values that match the value specified in Sort Key Value 1 are read. |
< | Only items with sort key values that are less than the value specified in Sort Key Value 1 are read. |
<= | Only items with sort key values that are less than or equal to the value specified in Sort Key Value 1 are read. |
> | Only items with sort key values that are greater than the value specified in Sort Key Value 1 are read. |
>= | Only items with sort key values that are greater than or equal to the value specified in Sort Key Value 1 are read. |
Between | Only items with sort key values that are greater than or equal to the value specified in Sort Key Value 1 and less than or equal to the value specified in Sort Key Value 2 are read. |
Begins with | Only items with sort key values that begin with the value specified in Sort Key Value 1 are read. This operator can only be used with sort keys of type string or binary. |
Whether the reader outputs the original JSON for each item in the source table(s). If Yes, the original JSON is read into the dynamodb_json format attribute on each source feature.
If not set, dynamodb_json is not populated.
Schema Attributes
Use this parameter to expose Format Attributes in Workbench when you create a workspace:
- In a dynamic scenario, it means these attributes can be passed to the output dataset at runtime.
- In a non-dynamic scenario where you have multiple feature types, it is convenient to expose additional attributes using this one parameter. For example, if you have ten feature types and want to expose the same attribute in each one, it is easier to define it once than it is to set each feature type individually in the workspace.