FME Flow: 2024.2

Cleaning Up FME Flow Logs and Other Files

Select System Configuration > System Cleanup > Tasks.

To ensure that logs and other files do not consume too much disk storage over time, FME Flow is configured, by default, to delete select files based on certain conditions, including their age and whether they have been auto-archived. On the Tasks tab of the System Cleanup page, you can view, edit, enable, disable, or remove these maintenance tasks, or add tasks of your own.

The tasks that are pre-configured (display by default) target log and other files created by FME Flow. You can learn more about FME Flow log files, and how log files are auto-archived, at About Log Files in FME Flow. However, maintenance tasks need not be limited to the ones already configured. You can add tasks that target other FME Flow Resources.

Note  By default, all system cleanup tasks run once per day.

When the system's free disk space reaches specified minimum levels, FME Flow triggers a Default Cleanup or Aggressive Cleanup event, in which all enabled cleanup tasks execute. In the case of an Aggressive Cleanup event, all files specified by each cleanup task are removed, regardless of the Remove Files Older Than setting.

For more information, and how to adjust these settings, see Configuring System Cleanup Settings.

To view or edit a file maintenance task

  1. Click on a task to open the Editing page.
  2. Specify the cleanup task settings:
    • Category: Specify a category in which to group the task. Categories allow you to have cleanup tasks with the same name, as long as they are in different categories.
    • Description: Optionally, enter a description for the task.
    • Source Folder: Specify a Resources folder from which files are deleted.
      • Note  You cannot specify an Amazon Web Services (AWS) S3 bucket.
    • Filter Type: If None is specified, all files in the specified source folder are deleted. If Ends With or Does Not End With is specified, only files whose names end with (Ends With) or do not end with (Does Not End With) the string specified under Pattern are removed.
    • Pattern: If Ends With or Does Not End With is specified under Filter Type, specify a file name-ending string to include or exclude from the task. A common scenario is to include or exclude a file type by specifying a file extension; for example: .log. However, you can specify any file name-ending string; for example: yr_2015.log. Regular expressions are not supported.
    • Remove Files Older Than: Only files older than the specified age, in seconds, are cleaned up.
  3. Click OK.

To add a file cleanup task

Do one of the following:

  • Check a box beside an existing task and click Duplicate. On the Editing Cleanup Task page, edit the task settings as described above, and click OK.
  • Click New. On the Create a New Cleanup Files Task page, provide a name for the task, specify the remaining settings as described above, and click OK.

To Disable, Enable, or Remove file cleanup tasks

Check a box beside one or more tasks and click Enable, Disable, or Remove.