IBM Support

Importing huge flat files via MIF? You better use the FLATFILECONSUMER crontask

Technical Blog Post


Abstract

Importing huge flat files via MIF (Maximo Integration Framework)? You better use the FLATFILECONSUMER crontask

Body

An important part of any software implementation is data loading.
In Maximo / TPAE, one of the preferred solutions for that end is MIF or Maximo Integration Framework.
The advantage over other routines is that it goes through the MBOs and Field Classes validations to enforce all Maximo business logic over the transacted data.

If you are a Maximo user, by now you probably know that we can use flat files to load data into Maximo through MIF. Easily enough you go to the application, click a button, and load the flat file. However, loading large files might be a time consuming task. In other words, gigantic files take a while to process, holding the user session and, according to your infrastructure resources, processing power, memory and all that.

Fear not, there are ways to optimize the processing time when loading large csv files. We recommend breaking the data into smaller files as opposed to using a single large one.  Not everybody likes that so I'll show you a different way to do it using MIF.

Instead of importing a single or multiple files manually, the use the External Systems application, you can use a crontask that does it behind the scenes:

Create a new instance of the FLATFILECONSUMER crontask and set the server directory on the SOURCEDIRECTORY parameter. Don't you forget to activate the brand new instance.

image
 

Now all you have to do is place your gigantic file into that directory, sit back, and relax. The crontask takes care of things for you and will do it much faster than otherwise.  
 

[{"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSLKT6","label":"IBM Maximo Asset Management"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"","Edition":"","Line of Business":{"code":"LOB59","label":"Sustainability Software"}}]

UID

ibm11132839