IBM Support

Importing huge flat files via MIF ? You better use the FLATFILECONSUMER Crontask !

Technical Blog Post


Abstract

Importing huge flat files via MIF ? You better use the FLATFILECONSUMER Crontask !

Body

 

An important part of of any software implementation is data loading.
In Maximo / TPAE, one of the preferred solutions for that end is MIF or Maximo Integration Framework.
The advantage over other routines is that it goes through the MBOs and Field Classes validations to enforce all Maximo business logic over the transacted data.

If you are a Maximo user, by now you probably know that we may use flat files to load data into Maximo through MIF. Easily enough you just have to go to the application, click a button and load the flat file. However, loading large files may be a time consuming task. In other words, gigantic files will take a while to process, holding the user session and, according to your infrastructure resources, processing power, memory and all that, of course. No such thing as mice running around with elephants on their backs (at best you will see a few walking really, really slowly).

Fear not, there are ways to optimize processing time when loading large csv files. We recommend breaking the data in smaller files as opposed to using a single large one but, you know, not everybody likes that so I'll show you a different way to do it using MIF.

Instead of importing the a single or multiple files manually, using the External Systems application, you may use a Cron Task that will do it behind the scenes:

Create a new instance of the  of the FLATFILECONSUMER Cron Task and set the server directory on the SOURCEDIRECTORY parameter. Don't you forget to activate the brand new instance.

 

image
 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Now all you have to do is place your gigantic file into that directory, sit back and relax. The Cron Task will take care of things for you and will do it much faster than otherwise.  

You will find more information about the FLATFILECONSUMER Crontask in the IBM Knowledge Center at:

http://www-01.ibm.com/support/knowledgecenter/SSLKT6_7.5.0.5/com.ibm.mif.doc/gp_intfrmwk/r_jms_flatlfileconsumer_cron_task.html?lang=en


I hope this will help you on your data load routines.



Márcio,
 

[{"Business Unit":{"code":"BU005","label":"IoT"}, "Product":{"code":"SSLKT6","label":"Maximo Asset Management"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"","Edition":""}]

UID

ibm11132839