FME Transformers: 2024.1

Categories
Integrations
Web

Web

Related Transformers
JSONExtractor
JSONFragmenter
Tweeter
TweetSearcher
TwitterStatusFetcher

TweetStreamer

Connects to a Twitter™ stream and outputs a new feature for each tweet. The transformer allows users to set up a filter, so that the output features will only contain tweets containing certain keywords, tweets that are geotagged with a particular location, and/or tweets which are written in particular languages.

A twitter stream is an HTTP connection that never closes, so except for error cases, any workspace containing this transformer will not terminate on its own. The transformer will continue to output features until the workspace is terminated by the user. As such, workspace authors MUST ensure that the features output from the TweetStreamer do not enter any blocking transformers.

At least one feature must enter the transformer in order to start the stream. Once all the input features have arrived, the transformer will open a connection to the Twitter streaming API, and begin outputting features. Depending on the filters set up in the transformer parameters, the output from the transformer may not be continuous. There may be periods in which no tweets match the filters. This is particularly true when filtering by language and geometry.

If no keywords or geometry filters are provided, the transformer will connect to a sample stream. This stream provides a random sample of tweets as they are created. It is possible to filter this stream by language.

Note that a limited number of streaming connections is permitted per user. If too many simultaneous connections are attempted with the same user credentials, one or more of the connections will be terminated.

Configuration

Output Ports

Parameters

Editing Transformer Parameters

Transformer parameters can be set by directly entering values, using expressions, or referencing other elements in the workspace such as attribute values or user parameters. Various editors and context menus are available to assist. To see what is available, click beside the applicable parameter.

For more information, see Transformer Parameter Menu Options.

FME Community

The FME Community is the place for demos, how-tos, articles, FAQs, and more. Get answers to your questions, learn from other users, and suggest, vote, and comment on new features.

Search for all results about the TweetStreamer on the FME Community.