KinesisSender
Using the Amazon Kinesis service, sends data records to an Amazon Kinesis stream.
Usage Notes
The performance of this transformer is dependent on the amount of memory allocated to the Java Virtual Machine (JVM). The following environment variables allow you to specify memory available to Java Plugins:
- FME_JVM_MIN_HEAP_SIZE: Initial heap size for initializing the JVM. Default value is 1024K.
-
FME32_JVM_MIN_HEAP_SIZE: Same as FME_JVM_MIN_HEAP_SIZE, but applies to the 32-bit version of FME Desktop on Windows, and takes precedence over FME_JVM_MIN_HEAP_SIZE.
- FME_JVM_MAX_HEAP_SIZE: Maximum heap size for initializing JVM. Default value is 16384K.
-
FME32_JVM_MAX_HEAP_SIZE: Same as FME_JVM_MAX_HEAP_SIZE, but applies to the 32-bit version of FME Desktop on Windows, and takes precedence over FME_JVM_MAX_HEAP_SIZE.
If unset, the JVM applies the default values. If set, the values must be multiples of 1024K (for example, 4M and 64M, or 4096K and 32768K).
Note: To pass additional parameters used by FME to the Java Virtual Machine, use the JAVA_TOOL_OPTIONS environment variable.
Input Ports
Input Ports
This transformer accepts any feature.
Output Ports
This transformer outputs any feature that could not be successfully sent to the Kinesis stream.
Attribute | Description |
---|---|
data_blob | The data blob of the unsuccessful data record (if applicable). |
partition_key | The partition key of the unsuccessful data record (if applicable). |
error_code | The error code corresponding to the unsuccessful data record. |
error_message | The error message corresponding to the unsuccessful data record. |
Parameters
Amazon Kinesis Parameters
The name of the Kinesis stream where data records are to be sent.
The AWS region in which the Kinesis stream was created.
An access key associated with a user with permission to send data records to the stream.
A secret key paired with the access key provided.
Sender Options
The attribute to be used as the partition key for the data record.
The attribute to be used as the data blob for the data record.
The number of data records to be sent to the Kinesis stream per write. Maximum is 500 data records.
Editing Transformer Parameters
Using a set of menu options, transformer parameters can be assigned by referencing other elements in the workspace. More advanced functions, such as an advanced editor and an arithmetic editor, are also available in some transformers. To access a menu of these options, click beside the applicable parameter. For more information, see Transformer Parameter Menu Options.
Transformer Categories
FME Licensing Level
FME Professional edition and above
Search FME Community
Search for samples and information about this transformer on the FME Community.