List of Transformers

You are here: MRF > MRF2DDuplicateRemover

MRF2DDuplicateRemover

Deletes duplicated features. Features are considered to be duplicates if their geometries are within tolerance and only features with a smaller tolerance will remain after cleaning.

Output Ports

ClosedCleaned

Each feature that is output through the Cleaned port will have a new attribute "mrf_clean_status" added to specify whether the feature was modified, created, or unchanged in the cleaning process. The possible values of this attribute are "Modified", "Created" and "Original".

Parameters

ClosedGroup By

If selected, each group of features with the same values in the Group By attributes will be processed separately from other groups.

ClosedParallel Processing Level

Note: How parallel processing works with FME: see About Parallel Processing for detailed information.

This parameter determines whether or not the transformer should perform the work across parallel processes. If it is enabled, a process will be launched for each group specified by the Group By parameter.

Parallel Processing Levels

Parameter Number of Processes
No Parallelism 1
Minimal coresThe processor, or CPU, is the physical part of the computer that performs mathematical calculations. It is the most important part of a computer system. Traditional processors have only one core on the processor, meaning that at any given time, only one set of calculations is being performed. If a processor is dual-core, this means the single chip contains hardware for two processors, now called cores to distinguish them from the single chip, running simultaneously, side by side. (Source: http://www.ehow.com/facts_5730257_computer-core-processors_.html) / 2
Moderate exact number of cores
Aggressive cores x 1.5
Extreme cores x 2

For example, on a quad-core machine, minimal parallelism will result in two simultaneous FME processes. Extreme parallelism on an 8-core machine would result in 16 simultaneous processes.

You can experiment with this feature and view the information in the Windows Task Manager and the Workbench Log window.

ClosedInput is Ordered by Group

Yes: This transformer will process input groups in order. Changes on the value of the Group By parameter on the input stream will trigger batch processing on the currently accumulating group. This will improve overall speed if groups are large/complex, but could cause undesired behavior if input groups are not truly ordered.

No: This is the default behavior. Processing will only occur in this transformer once all input is present.

Usage Notes

This transformer performs the same operation as the MRF2DCleaner with the Remove Duplicate Geometries set to Yes and no other options selected. See the MRF2DCleaner for more details.1Portions of this work are the intellectual property of the MRF Geosystems Corporation and are used under license. Copyright © 2006 MRF Geosystems Corporation. All rights reserved.

FME Licensing Level

The MRFCleaner transformers are available as an extra-cost package from Safe Software. Please contact sales@safe.com or call 604-501-9985.

Related Transformers

MRF2DConflator

MRF2DDangleRemover 

MRF2DExtender

MRF2DGeneralizer

MRF2DIntersector

MRF2DJoiner

MRF2DShortGeometryRemover

Editing Transformer Parameters

Using a set of menu options, transformer parameters can be assigned by referencing other elements in the workspace. More advanced functions, such as an advanced editor and an arithmetic editor, are also available in some transformers. To access a menu of these options, click beside the applicable parameter. For more information, see Transformer Parameter Menu Options.

Transformer Categories

MRF

Search FME Knowledge Center

Search for samples and information about this transformer on the FME Knowledge Center.