Contribute in GitHub:
Open doc issue|Edit online
EasyETL Guide
‘ETL' stands for Extract, Transform and Load, and boils down to getting data from one place, changing it as needed and then putting it someplace else. ‘EasyETL' is a feature of IBM® Security Verify Directory Integrator that lets you do this quickly and interactively in just a few keystrokes.
Common ETL examples are:
- Exporting database records, Notes® Documents, directory entries or even incoming mail or MQ messages to a file;
- Loading data from file into a system or data store;
- Migrating data directly from one system to another, or between versions of the same system in the case of software/schema updates.
IBM® Security Verify Directory Integrator EasyETL lets you solve these and other scenarios in a few intuitive steps, resulting in solutions suitable for both one-off data movement needs, as well as for mission critical data flows in your infrastructure.
The first step in creating a new EasyETL task is to choose your Input Source and select the attributes that you want to transfer. Already at this point, IBM® Security Verify Directory Integrator lets you run your EasyETL job and collect the data read into your copy buffer for pasting. If the data needs to be transformed or computed then EasyETL lets you add transformation, re-run the ETL job and copy/paste the transformed data. And you can also choose an Output Target and have your EasyETL job write the data directly there.
Once your EasyETL solution is working as required, IBM® Security Verify Directory Integrator can generate the command line assets (batch-files or scripts) for launching and scheduling the integration task. Finally, EasyETL leverages the change detection features of IBM® Security Verify Directory Integrator to quickly turn your ETL job into a data synchronization task.
Note: The good news for
IBM® Security Verify Directory Integrator users is that each EasyETL solution is an IBM® Security Verify Directory Integrator Project with a single AssemblyLine, and it can be opened in the full-featured development environment. However, once you change it there it's no longer available as EasyETL.
Using EasyETL
Launch the IBM® Security Verify Directory Integrator Config Editor and select the workspace to use. When IBM® Security Verify Directory Integrator starts the first time it opens in the Welcome page¹.
Figure 1. Welcome screen
As shown in the screen capture above, the topmost link here opens up the EasyETL² workbench. Click this link now to open the IBM® Security Verify Directory Integrator EasyETL workbench.
Figure 2. Figure 2. EasyETL Workbench
The EasyETL workbench shows you three things:
- The Project Navigator that lists your ETL jobs. You can right-click on any Project to do things like running it or creating command line assets to launch it;
- A Simple AssemblyLine³ editor for each open project;
- Various Views as tabs along the bottom part of the screen. By default you get three Views:
- the Console output from the test IBM® Security Verify Directory Integrator Server;
- the Server status view where you can monitor both the Server and any running EasyETL Projects;
- and the Data Collector where the resulting data for each cycle is displayed in a tabular list.
You will find more information on each section as you work through this document.
¹ You can return to the Welcome page at any time by selecting
Help > Welcome from the main menu.
² EasyETL is a
IBM® Security Verify Directory Integrator perspective, and you can switch between perspectives using the menu selection:
Windows > Open Perspective > Other... If you have made changes to a perspective and would like to reset it back to default, simply select Windows > Reset Perspective.
³ An ‘AssemblyLine' is the implementation of a data flow in IBM® Security Verify Directory Integrator, so when you create or open an EasyETL Project then the underlying AssemblyLine is presented in the editor.
Note also that the term ‘AssemblyLine' is abbreviated as ‘AL' in this and other IBM® Security Verify Directory Integrator literature.