Topic
  • 4 replies
  • Latest Post - ‏2012-12-10T19:40:45Z by SystemAdmin
SystemAdmin
SystemAdmin
374 Posts

Pinned topic Out of Memory Error on Model Import

‏2012-12-06T22:15:32Z |
Hello,

I am trying to import a fairly large and complex ERwin model into IDA 7.5.3 using the Data Model Import function. The Erwin version is 7.x and I followed the instructions in the bridge, saving the file as an XML format and running the import. With smaller models I have successfully imported without issues, but this one just doesn't seem to work no matter what I do.

The curious part is it's clearly not hardware limitations, I have monitored the memory usage on the machine during the import process and it tops out around 30%, nowhere near any danger zones I've experienced before with memory leak issues. Has anyone run into any similar issues or have any suggestions on something to try? Thanks in advance for any assistance!

Here's the snippet from the import log showing the error I receive:

<STATUS> Saving physical data model D:/Workspaces/default/ClaimsProject\ClaimsModel.dbm
<NONE> JVMDUMP006I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" - please wait.
<NONE> JVMDUMP032I JVM requested Snap dump using 'D:\IBM\SDPShared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_1.0.3.v20110117_2337\MetaIntegration\bin\Snap.20121206.170647.2408.0001.trc' in response to an event
<NONE> JVMDUMP010I Snap dump written to D:\IBM\SDPShared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_1.0.3.v20110117_2337\MetaIntegration\bin\Snap.20121206.170647.2408.0001.trc
<NONE> JVMDUMP032I JVM requested Heap dump using 'D:\IBM\SDPShared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_1.0.3.v20110117_2337\MetaIntegration\bin\heapdump.20121206.170647.2408.0002.phd' in response to an event
<NONE> JVMDUMP010I Heap dump written to D:\IBM\SDPShared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_1.0.3.v20110117_2337\MetaIntegration\bin\heapdump.20121206.170647.2408.0002.phd
<NONE> JVMDUMP032I JVM requested Java dump using 'D:\IBM\SDPShared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_1.0.3.v20110117_2337\MetaIntegration\bin\javacore.20121206.170647.2408.0003.txt' in response to an event
<NONE> JVMDUMP010I Java dump written to D:\IBM\SDPShared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_1.0.3.v20110117_2337\MetaIntegration\bin\javacore.20121206.170647.2408.0003.txt
<NONE> JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".
<FATAL> Exception: java.lang.OutOfMemoryError
<FATAL> MIRC_F0004 Exception: null
<FATAL> JBDG_F0006 The import bridge failed
Updated on 2012-12-10T19:40:45Z at 2012-12-10T19:40:45Z by SystemAdmin
  • rraddatz
    rraddatz
    55 Posts

    Re: Out of Memory Error on Model Import

    ‏2012-12-07T13:58:44Z  
    Is it possible to share your model?

    Thanks,
    Robin
  • SystemAdmin
    SystemAdmin
    374 Posts

    Re: Out of Memory Error on Model Import

    ‏2012-12-07T19:20:03Z  
    • rraddatz
    • ‏2012-12-07T13:58:44Z
    Is it possible to share your model?

    Thanks,
    Robin
    Hi Robin,
    Thanks for your reply, unfortunately I think the full model probably has proprietary information in it which would make it difficult to share in a public forum. If you have questions about the model size or anything I'd be happy to share those with you.

    I am currently trying to experiment with the memory parameters in the .ini file for IDA to see if that allows me to get around the issue, but if there are any other ideas I would appreciate it.
  • rraddatz
    rraddatz
    55 Posts

    Re: Out of Memory Error on Model Import

    ‏2012-12-10T18:47:12Z  
    Hi Robin,
    Thanks for your reply, unfortunately I think the full model probably has proprietary information in it which would make it difficult to share in a public forum. If you have questions about the model size or anything I'd be happy to share those with you.

    I am currently trying to experiment with the memory parameters in the .ini file for IDA to see if that allows me to get around the issue, but if there are any other ideas I would appreciate it.
    Hi,
    If you are a paid IBM customer, please email me and we can discuss proprietary agreements concerning sharing your model.

    In the meantime, did you try something like this to increase your memory for MITI (tool used to import model). Not sure what version you are using, but you can

    change file MIRSetup.xml (by default, it's located in C:\Program Files\IBM\sdpshared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_xxx\MetaIntegration\conf). Change the value in the <options> element, as specified below:
    ...
    <Java>
    ...

    <!--
    Purpose: Java Run Time Environment (JRE or JDK)
    -->
    <RunTime>
    <!--
    Purpose: JRE or JDK Executable
    Value: Executable Full Path (Optional)
    e.g. javaw or java in debug mode
    Default: <Meta Integration Home>\jre\bin\javaw.exe
    Win32 e.g. C:\Program Files\Meta Integration\jre\bin\javaw.exe
    Win32 e.g. ..\..\jre\bin\javaw.exe
    Unix e.g. /usr/MetaIntegration/jre/bin/java
    -->
    <Executable>..\..\..\..\..\IDA8.1.0\jdk\jre\bin\javaw.exe</Executable>

    <!--
    Purpose: JRE or JDK execution Options
    Value: Run time option string (optional)
    Default: "-Xmx256m" to allocate more memory
    -->
    <Options>-Xmx1024m</Options> *** - this is the option I'm talking about
    </RunTime>
    </Java>
    ...

    Thanks,
    Robin (rraddatz@us.ibm.com)
  • SystemAdmin
    SystemAdmin
    374 Posts

    Re: Out of Memory Error on Model Import

    ‏2012-12-10T19:40:45Z  
    • rraddatz
    • ‏2012-12-10T18:47:12Z
    Hi,
    If you are a paid IBM customer, please email me and we can discuss proprietary agreements concerning sharing your model.

    In the meantime, did you try something like this to increase your memory for MITI (tool used to import model). Not sure what version you are using, but you can

    change file MIRSetup.xml (by default, it's located in C:\Program Files\IBM\sdpshared\plugins\com.ibm.datatools.metadata.wizards.miti.win32_xxx\MetaIntegration\conf). Change the value in the <options> element, as specified below:
    ...
    <Java>
    ...

    <!--
    Purpose: Java Run Time Environment (JRE or JDK)
    -->
    <RunTime>
    <!--
    Purpose: JRE or JDK Executable
    Value: Executable Full Path (Optional)
    e.g. javaw or java in debug mode
    Default: <Meta Integration Home>\jre\bin\javaw.exe
    Win32 e.g. C:\Program Files\Meta Integration\jre\bin\javaw.exe
    Win32 e.g. ..\..\jre\bin\javaw.exe
    Unix e.g. /usr/MetaIntegration/jre/bin/java
    -->
    <Executable>..\..\..\..\..\IDA8.1.0\jdk\jre\bin\javaw.exe</Executable>

    <!--
    Purpose: JRE or JDK execution Options
    Value: Run time option string (optional)
    Default: "-Xmx256m" to allocate more memory
    -->
    <Options>-Xmx1024m</Options> *** - this is the option I'm talking about
    </RunTime>
    </Java>
    ...

    Thanks,
    Robin (rraddatz@us.ibm.com)
    Hi Robin,

    That worked great! I added the option you mentioned to the .xml file and the model imported without hitting the out of memory issue. Thanks for the help!

    For future reference I work for Liberty Mutual Insurance and am part of their Enterprise License.

    Thanks again,

    -Matt