Text analysis fails with sqlite3 error when extracting from a very large text file.

Troubleshooting

Problem

I am running a consept analysis on a text file. When I runs this analysis on a file of size of about five million records (200 MB) the loading of the cache will end with the following error: Error: Text Mining Error: Exception: cache: sqlite3 error calling getRecordSet() sqlite3 error code : 7 sqlite3 message : SQLITE_NOMEM[7]: - Memory : 989184kb - Memory peak : 1271422kb Error: Text Mining Execution Error Information: Stream execution complete, Elapsed=621.73 sec, CPU=435.52 sec Warning: Execution was interrupted This will occur on two different files. Both files are larger in size. If he samples the data that is going out into the text mining node, he will not get this error. The error seems to occur around the 2 million record range.

[{"Product":{"code":"SS3RA7","label":"IBM SPSS Modeler"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Component":"Text Analytics","Platform":[{"code":"PF033","label":"Windows"}],"Version":"14.1","Edition":"","Line of Business":{"code":"LOB76","label":"Data Platform"}}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Historical Number

83841

Was this topic helpful?

Document Information

Modified date:
16 June 2018

UID

swg21483665

Tips