FME Flow: 2025.0

Data Virtualization

With just basic knowledge of RESTful coding conventions, you can create data virtualization APIs that harness the power of FME workspaces to access and transform data from HTTP endpoints, while conforming to the OpenAPI standard.

The Data Virtualization page lists the APIs that are created. You can:

  • Filter the list by title, namespace, and/or owner.
  • Remove one or more APIs. Select its corresponding checkbox, click Actions, and select Remove.
  • View an aggregated log file of data virtualization APIs. Select one or more APIs and click View Log File (requires Access and List permission to the Logs folder in Resources).

How It Works

The easy-to-use interface of FME Flow Data Virtualization gives you all the tools you need to define endpoints and configure them with workspace templates. Once your endpoints and templates are configured, download the templates to FME Workbench and configure your data access and transformation requirements. Your API is complete when you republish your finished workspaces to FME Flow Data Virtualization.

Getting Started

Follow these steps to create a data virtualization API:

  1. Create the API: Give the API a name, namespace, and repository for workspaces. Configure initial security, caching, and provide other metadata. See Creating and Managing Data Virtualization APIs, below.
  2. Configure API functionality: Define endpoints and configure with workspace templates. If desired, define reusable data property schemas for endpoints. Adjust security and metadata as desired. See Configuring API Functionality, below.
  3. Download workspace templates to FME Workbench, configure data access and transformation requirements, and republish to FME Flow Data Virtualization. These steps are handled in FME Workbench. For more information, see the following topics in the FME Workbench help:

Creating and Managing Data Virtualization APIs

Configuring API Functionality

Most of the functionality for your API is configured in the Endpoints and Workspaces tabs. The Schemas, Security, and API Details tabs provide additional ways to control and configure your API.

  • Endpoints: Define the HTTP methods for receiving and processing requests for data.
  • Workspaces: Generate and manage workspaces that handle endpoint responses.
  • Schemas: Define reusable data property configurations for endpoints.
  • Security: Edit who can access the API and its individual endpoints.
  • API Details: Edit API metadata and caching.

Creating and Managing Schemas

Use the schemas tab to create schemas for defining data properties of HTTP requests in your endpoints, including the name of the data point, data type, and if the data is required. Schemas make it easy to reuse these data points across endpoints.

Creating and Managing Endpoints

HTTP endpoints specify how your API receives and processes requests for data.

To Create an Endpoint

To Edit an Endpoint

On the Endpoints tab for your API, click the endpoint you want to edit. Note that changing the Response Type of an endpoint can also be handled on the Workspaces tab (described below).

To Access Caches of an Endpoint

Data caches from endpoint execution are available depending on its Caching configuration.

Caches are accessible on the Resources page, under System > temp > cache.

To Purge the Cache of an Endpoint

You can purge the cache of a GET endpoint for which caching is enabled, either by default at the API level, or by itself.

On the Endpoints tab for your API, click the endpoint of the cache you want to purge. On the Caching tab, click Purge Cache.

To Remove an Endpoint

On the Endpoints tab for your API, click the ellipsis (...) beside the endpoint you want to remove, and select Delete.

To Create, Edit, or Remove Endpoint Tags

On the Endpoints tab for your API, click Manage Tags.

Generating and Managing Workspaces for Handling Endpoint Responses

In most cases, you will want your data virtualization API to reference one or more FME workspaces to handle endpoint responses. Each endpoint can reference a single workspace. As a first step for each workspace, you must generate a workspace template. Once generated, you can download the template to FME Workbench, configure as desired, then republish the workspace to FME Flow Data Virtualization.

To Generate a Workspace

  1. On the Workspaces tab for your API, under Workspace Endpoints, select the endpoint you want to configure with the workspace, and click Generate Workspace.
  2. On the Generate Workspace dialog, enter a name for the workspace (if not specified explicitly, a .fmw extension is added automatically), and click Generate.

To Unassign a Workspace from an Endpoint, or Reassign

On the Workspaces tab for your API, under Workspace Endpoints, select the endpoint you want to unassign, and click Unassign Workspace.

To reassign the workspace to the endpoint, click Reassign beside the endpoint.

To Change the Response Type of an Endpoint

You can change how an endpoint response is handled: from a workspace to manually, or from manually to a workspace. This change can be handled on the Workspaces tab for your API. To change an endpoint response from Workspace to Manual, select the endpoint under the Workspace Endpoints sub-tab and click Edit Response Type. To change an endpoint response from Manual to Workspace, select the endpoint under the Manual Endpoints sub-tab and click Edit Response Type.