IBM Support

How to remove empty column with null records using Field Remover processor.

How To


Summary

How to remove empty column with null records using Field Remover processor.

Objective

This article explains how to remove empty field with empty records from the incoming data in the origin stage.

  • Generally, to remove any field from the input records, we simply select the name of the field in Field Remover stage → Remove/Keep tab → Field by either giving / and selecting the field name or by selecting the field name from schema given in Select Fields Using Preview Data option.

  • However, Control hub Cloud/On-premise fails to load the schema when selecting Select Fields Using Preview Data option with the message shown in below image 1.

  • In the case of populated fields, we can specify the field name manually by entering / followed by the field name. However, if the field name is empty /' ', we are unable to remove it.

  • The cause of the issue on why specifying /' ' manually in the Fields does not work is due to the incorrect space we give between the single quotes. It seems a single space in input data but there might be multiple spaces present in between.

  • Please refer to the below steps to remove empty field.

Steps

  1. Go to Field Remover stage → Schema

  2. Copy the empty field from input schema (refer to image 2)

  3. Paste the copied field path to Remove/Keep tab → Fields

  4. Select Remove listed Fields option in Action.

Results

  • We should get the desired result after performing the above steps (image 3)

Document Location

Worldwide

[{"Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSM21Y","label":"IBM StreamSets"},"ARM Category":[{"code":"","label":""}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"}]

Document Information

Modified date:
16 March 2025

UID

ibm17186370