Transforming data with the transformation generator

Completing pattern transformations in App Connect Designer 12.0.7.0-r1 or later

This information is applicable to App Connect Designer 12.0.7.0-r1 or later when a target field is populated with one or more "source" mappings from previous nodes in the flow.

You can transform the data format of a single mapping that is inserted into a target field. If the target field is populated with multiple mappings, you can also choose to transform individual mappings, or you can collectively transform the entire contents of the field. If the target field includes static data, you will need to include this data in the target examples that you provide for generating the JSONata expression.

• To transform the data format of a single mapping in a target field that is populated with one or more mappings, complete the following steps:
  1. From the target field, click a single "source" mapping that you want to transform and then click Transform data format from the pop-up menu.
     
     Tip: If the target field contains a single mapping only that you want to transform, you can alternatively click within the field and then click the Transform data format link that is displayed below the field.

     

     The "Generate transformation for TargetFieldName" panel opens with five blank source and corresponding target fields that are presented as separate columns within which you can map your data formats. A Populate using sample data button is displayed above the left (source) column.

     
  2. Provide examples of source and target data formats as follows:
     • To auto-populate the fields with examples that are based on data in the source and target applications for the connected accounts, click the Populate using sample data button. This action initiates a discovery for existing data in the source and target applications. If data is discovered in the source application, the fields in the left column are populated with a random sampling of unique examples from the source application. If fewer than five examples are discovered, manually specify similar examples in any source fields that are left blank.
       

       If data is also discovered in the target application, this data is analyzed to identify the specified formats; for example, lowercase or uppercase formats. The source examples in the left column are then used to generate target examples that are based on the discovered target formats. Up to five formats can be shown within individual tabs (numbered 1 to 5) above the right (target) column. A Copy from source link is also shown below the target fields. Click each numbered tab to examine the generated target formats. If you want to accept a generated format, ensure that its numbered tab is active. If you prefer to specify a custom format, either edit the data on a numbered tab, or click the Copy from source link to add a copy of the source examples as target examples. When you begin to edit the data or when you click Copy from source, an Edited tab is appended to the existing numbered tabs, and the focus switches to this tab. The Edited tab enables you to specify a custom format, while preserving the generated formats in the numbered tabs for reselection if required. The data in the Edited tab always shows your latest update.

       

       If no data is discovered in the target application, the fields in the right column remain blank. You can use the Copy from source link to add a copy of the source examples as target examples and then edit the copied data if required. You can also manually specify examples in a preferred format.

       
       
       
     • If no data is discovered in the source and target applications after you click the Populate using sample data button, the source and target fields remain blank. The Copy from source link is also shown as initially disabled.
       

       In the left column, manually specify at least five examples for the source field. (The Copy from source link becomes enabled when you begin to add the first entry.) To complete the target fields, either click the Copy from source link to add a copy of the source examples as target examples, or manually specify examples in your preferred format.

     Tips for completing the source and target fields:

     If you need to manually specify examples:

     • Ensure that an identical data format is used for all the source field examples. Similarly ensure that an identical data format is used for all the target field examples.
     • Ensure that there is a completed example for each source/target pair of fields.
     • Ensure that each example is of the expected data type. For example, use a date format if the source and target fields are used to present dates.

     To add more examples, click Add row. You can also delete examples, but must ensure that at least five completed source/target pairs are provided in order to enable the Transform data format link.

  3. Click Transform data format to generate a JSONata expression that represents your selections.
     
  4. Click Insert transformation to insert the JSONata expression into the target field.
     
     Tip: After you've transformed a mapping in the target field, a Transform data format link is no longer displayed below the field if you click within that field. However, you can click individual mappings in that field and then use the Transform data format option in the resulting pop-up menu to additionally transform data if required.

  
  

• To transform the entire contents of a target field that contains multiple mappings, complete the following steps:
  1. Click within the field and then click the Transform data format link that is displayed below the field.
     

     The "Generate transformation for TargetFieldName" panel opens in a multi-column structure with a dividing line that separates the source and target formats. On the left side of the dividing line, individual columns are presented for each source mapping that the target field contains, and each column contains five blank source fields (as rows). To the right of the dividing line, a single column with five blank target fields is provided for specifying a concatenation of target formats for each of the source examples. A Populate using sample data button is also displayed above the left (source) columns.

     
  2. Provide examples of source and target data formats as follows:
     • To auto-populate the fields with examples that are based on data in the source and target applications for the connected accounts, click the Populate using sample data button. This action initiates a discovery for existing data in the source and target applications. If data is discovered in the source application, the fields in the left (source) columns are populated with a random sampling of unique examples from the source application. If fewer than five examples are discovered for any column, manually specify similar examples in any source fields that are left blank.
       

       If the appropriate type of data is also discovered in the target application, this data is analyzed to identify the specified formats; for example, lowercase, uppercase, or date formats. The source examples in the left columns are then used to generate target examples that are based on the discovered target formats. Up to five formats can be shown within individual tabs (numbered 1 to 5) above the right (target) column. A Copy from source link is also shown below the target fields. You can examine the generated target formats on each numbered tab, and either accept a format or specify a custom one. Ensure that the tab with your preferred format is active before attempting to transform the data.

       • Example of numbered tabs for discovered target formats

         This example illustrates how multiple discovered target formats are presented in numbered tabs.

         

         If you prefer to specify a custom format, either edit the data on one of the numbered tabs, or click the Copy from source link to add a concatenated copy of the source examples as target examples. When you begin to edit the data or when you click Copy from source, an Edited tab is appended to the existing numbered tabs, and the focus switches to this tab. The Edited tab enables you to specify a custom format, while preserving the original formats in the numbered tabs for reselection if required. The data in the Edited tab always shows your latest update.

         

       If the appropriate data is not discovered in the target application, the fields in the right column remain blank. You can use the Copy from source link to add a concatenated copy of the source examples in each row as target examples.

       

       You can then edit the copied data as required. (In the following example, the @ symbol and email domain have been removed from the email addresses in the target fields, and the time has been removed from the dates.) You can also manually specify target examples without copying the source.

       
       
       
     • If no data is discovered in the source and target applications after you click the Populate using sample data button, the source and target fields remain blank. The Copy from source link is also shown as initially disabled.

       In the left columns, manually specify at least five examples for each column of source fields. (The Copy from source link becomes enabled when you begin to add the first entry.) To complete the target fields, either click the Copy from source link to add a copy of the source examples as target examples and edit as required, or manually specify examples in your preferred format.

     Tips for completing the source and target fields:

     If you need to manually specify examples:

     • Ensure that at least five examples are specified for the source fields in each (source) column.
     • Ensure that at least five examples are specified in the (target) column. If no target examples are generated, the easiest option is to use Copy from source to add a concatenated copy of the source examples in each row to the target fields, and then edit the target formats as required. Also ensure that the concatenated target examples are listed in the same sequence as the source mappings.

       If the target field in the flow editor contains any static data, include and correctly position this data in your target examples to ensure that the target field is correctly populated when you insert the transformation.

     • Ensure that an identical data format is used for all the source field examples. Similarly ensure that an identical data format is used for all the target field examples.
     • Ensure that there is a completed example for each source/target pair of fields.
     • Ensure that each example is of the expected data type. For example, use a date format if the source and target fields are used to present dates.

     To add more examples, click Add row. You can also delete examples, but must ensure that at least five completed source/target pairs are provided in order to enable the Transform data format link.

  3. Click Transform data format to generate a JSONata expression that represents your selections.
     
  4. Click Insert transformation to insert the JSONata expression into the target field.
     
     Tip: After you've collectively transformed the inserted mappings in the target field, a Transform data format link is no longer displayed below the field if you click within that field. However, you can click an individual mapping in the field and then use the Transform data format option in the resulting pop-up menu to additionally transform data if required.

• Example of a transformation that includes static text

  This example illustrates how to transform the data in a target field that includes multiple mappings that are prefixed with some static text (in this case, Reference:). In the Generate transformation panel, the static text is added as a prefix to each of the target example formats to ensure that this text is included in the generated JSONata expression.

  

Completing pattern transformations in App Connect Designer 12.0.5.0-r1-lts or later 12.0.M.0-rX-lts, and 12.0.5.0-r2 to 12.0.6.0-r1

This information is applicable to App Connect Designer 12.0.5.0-r1-lts or later 12.0.M.0-rX-lts, and 12.0.5.0-r2 to 12.0.6.0-r1 when a target field is populated with a single "source" mapping from a previous node in the flow.

To transform the data format of an inserted mapping, complete the following steps:

1. Click the relevant "source" mapping within the target field and then click Transform data format from the pop-up menu. (If using App Connect Designer 12.0.5.0-r1-lts to 12.0.5.0-r3, click Generate transformation from the pop-up menu.)
   
   Tip: If using App Connect Designer 12.0.5.0-r4 or later, you can alternatively click within the target field that contains the mapping and then click the Transform data format link that is displayed below the field.

   

   The "Generate transformation for SourceFieldName" panel opens with five blank source and corresponding target fields that you can use for mapping data formats. When this panel opens, an attempt is made to discover data from existing records in the source and target applications, so that this data can be used to populate the source and the target fields with examples. A Populate using retrieved data link is displayed above the left (source) column if data is discovered in the source application for the connected account.

   
2. Provide examples of source and target data formats as follows:
   • If data is discovered in the source application (as indicated by the Populate using retrieved data link), click this link to populate the fields in the left column with a random sampling of unique examples from the source application. If fewer than five examples are discovered, manually specify similar examples in any source fields that are left blank.
     

     If data is additionally discovered in the target application, this data is analyzed to identify various formats; for example, lowercase or uppercase formats. The source examples in the left column are then used to generate target examples for the discovered formats. Up to five formats can be shown within individual tabs (numbered 1 to 5) above the right (target) column. A Copy from source tab is also shown as the last tab. You can either click a numbered tab to display generated target examples for a specific format, or you can click the Copy from source tab to add a copy of the source examples as target examples. You can also edit the examples if required.

     

     If no data is discovered in the target application, the fields in the right column remain blank, but a Copy from source link is displayed. You can click this link to add a copy of the source examples as target examples, and can edit the values as required.

     
     
     
   • If no data is discovered in the source and target applications, a Populate using retrieved data link is not displayed. A Copy from source link is shown as initially disabled.
     

     In the left column, manually specify at least five examples for the source field. (The Copy from source link becomes enabled after you add the first entry.) Next click Copy from source to add a copy of the source examples as target examples, and then edit the target examples if required. If you prefer not to copy the source examples, you can instead just manually specify target examples in the preferred format.

   Tip:

   If you decide to manually specify examples:

   • Ensure that an identical data format is used for all the source field examples. Similarly ensure that an identical data format is used for all the target field examples.
   • Ensure that there is a completed example for each source/target pair of fields.
   • Ensure that each example is of the expected data type. For example, use a date format if the source and target fields are used to present dates.

   To add more examples, click Add row. You can also delete examples, but must ensure that at least five completed source/target pairs are provided in order to enable the Transform data format link (or Generate transformation link if using App Connect Designer 12.0.5.0-r1-lts to 12.0.5.0-r3).

3. Click Transform data format to generate a JSONata expression that represents your selections. (If using App Connect Designer 12.0.5.0-r1-lts to 12.0.5.0-r3, click Generate transformation.)
   
4. Click Insert transformation to insert the JSONata expression into the target field.
   

Completing pattern transformations in App Connect Designer 12.0.4.0-r2 or earlier

This information is applicable to App Connect Designer 12.0.4.0-r2 or earlier when a target field is populated with a single "source" mapping from a previous node in the flow.

To transform the data format of an inserted mapping, complete the following steps:

1. Click the relevant "source" mapping within the target field and then click Generate transformation from the pop-up menu.
   

   The "Generate transformation for SourceFieldName" panel opens with five blank source and corresponding target fields that you can use for mapping data formats.

   
2. In the left column, provide at least five examples for the source field by typing in values, and then add examples in the right column to show the preferred format for the target field.
   • Ensure that an identical data format (or pattern) is used for all the source field examples.
   • Ensure that an identical data format is used for all the target field examples. To complete a target example, copy and paste the corresponding source format example and then edit the format as required.
   • Ensure that there is a completed example for each source/target pair of fields.
   • Ensure that each example is of the expected data type. For example, use a date format if the source and target fields are used to present dates.
   • To add more examples, click Add row. You can also delete examples, but must ensure that at least five completed source/target pairs are provided in order to enable the Generate transformation link.
3. Click Generate transformation to generate a JSONata expression that represents your selections.
   
4. Click Insert transformation to insert the JSONata expression into the target field.