You are here: Reference Manual > FME Server Services > Notification Service > Publishers > Amazon S3 Watch Publisher

Amazon S3 Watch Publisher

The Amazon S3 (Simple Storage Service) Watch publisher polls activity on an Amazon S3 bucket, and publishes messages about that activity to FME Server topics. Activity can include adding, changing, and deleting files.

Note: When setting up an Amazon S3 Watch publisher, you can specify how often to poll an S3 bucket. However, keep in mind that Amazon S3 is a pay-per-use service. Every poll is one request to this service.

Configuring the Publisher

  1. In the FME Server Web User Interface, select Manage > Notifications. Select the Publications tab and click New.
  2. Provide a name for the Publication
  3. Specify the topics you want to publish to using the drop-down selector, or click Select All if you want to publish to all topics.
  4. Protocol: Select Amazon S3 Watch.
  5. Bucket to Watch: The bucket name in the Amazon S3 account, case sensitive.

    6. Note: For more information about locating buckets in the Amazon S3 Console, see Support for Viewing Data in the Console User Guide.

  6. AWS Access Key ID and AWS Secret Access Key: Provide your security credentials. For more information, see AWS Security Credentials.
  7. Path to Watch (Optional): Provide a folder location in the specified bucket to watch, using forward slashes.

    8. WARNING: Make sure the specified path is valid. The S3 Watch Publisher does not currently perform any verification that the path exists. If it does not, polling activity may produce false positive results.

    For example, any of the following is acceptable:

    • myfolders/testfolder
    • /myfolders/testfolder
    • //myfolders/testfolder
    • myfolders/testfolder/
    • /myfolders/testfolder/

    If left blank, the publisher watches everything in the bucket. If the path does not exist, the publisher will not start.

    Note: For more information about locating folders in the Amazon S3 Console, see Support for Folders in the Console User Guide.

  8. Watch Subdirectories: To watch activity in the selected directory and all subdirectories, specify Yes. To watch activity only in the selected directory and not in its subdirectories, specify No.

  9. Poll Interval: Specify how often to poll from the S3 bucket, in minutes.

    10. Note: Amazon S3 is a pay-per-use service. Every poll is one request to this service.

  10. Click OK.

Sample Notification Schemas

When a file is deleted

{

"s3watch_publisher_content": "ENTRY_DELETE test/sample_file.txt",

"s3watch_publisher_bucket": "test-bucket",

"fns_type": "s3watch_publisher"

}

When a file is changed (for example, added content)

{

"s3watch_publisher_content": "ENTRY_MODIFY test/sample_file.txt",

"s3watch_publisher_bucket": "test-bucket",

"fns_type": "s3watch_publisher"

}

When a file is added

{

"s3watch_publisher_content": "ENTRY_CREATE test/sample_file.txt",

"s3watch_publisher_bucket": "test-bucket",

"fns_type": "s3watch_publisher"

}