Topic
IC4NOTICE: developerWorks Community will be offline May 29-30, 2015 while we upgrade to the latest version of IBM Connections. For more information, read our upgrade FAQ.
1 reply Latest Post - ‏2013-04-02T11:41:44Z by SystemAdmin
SystemAdmin
SystemAdmin
603 Posts
ACCEPTED ANSWER

Pinned topic Web crawler application not working in biginsights 2.0

‏2013-04-02T10:15:15Z |
Hi,

Im using Biginsights 2.0. I encountered some problem while executing the web crawler application. The job status is showing as successful but when I check the workflow log it is showing the error:
Job Details
OKOK SUCCEEDED 0000013-130401184338357-oozie-e101-W@nutch java Apr 2, 2013 3:29:53 PM Apr 2, 2013 3:33:07 PM job_201304011841_0066 view jog details
1 - 1 of 1 items
10|25|50|100|All
1

Workflow Log

2013-04-02 15:29:53,280 INFO ActionStartXCommand:539 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch Start action 0000013-130401184338357-oozie-e101-W@nutch with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval 10
2013-04-02 15:29:55,716 WARN JavaActionExecutor:542 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch credentials is null for the action
2013-04-02 15:29:55,720 WARN JavaActionExecutor:542 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch Could not find credentials properties for: null
2013-04-02 15:29:58,436 INFO JavaActionExecutor:539 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch checking action, external ID job_201304011841_0066 status RUNNING
2013-04-02 15:29:58,491 WARN ActionStartXCommand:542 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch ***0000013-130401184338357-oozie-e101-W@nutch***Action status=RUNNING
2013-04-02 15:29:58,665 WARN ActionStartXCommand:542 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch ***0000013-130401184338357-oozie-e101-W@nutch***Action updated in DB!
2013-04-02 15:33:05,532 INFO CallbackServlet:539 - USER[-] GROUP[-] TOKEN[-] APP[-] JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch callback for action 0000013-130401184338357-oozie-e101-W@nutch
2013-04-02 15:33:06,821 INFO JavaActionExecutor:539 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch action completed, external ID job_201304011841_0066
2013-04-02 15:33:06,839 INFO JavaActionExecutor:539 - USERXXXX GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION0000013-130401184338357-oozie-e101-W@nutch action produced output
2013-04-02 15:33:08,513 WARN CoordActionUpdateXCommand:542 - USERxxxx GROUP-] TOKEN[ APPnutch-wf JOB0000013-130401184338357-oozie-e101-W ACTION[-] E1100: Command precondition does not hold before execution, , coord action is null, Error Code: E1100

Im not able to get the output. Any solution??

Thanks,
Hams
Updated on 2013-04-02T11:41:44Z at 2013-04-02T11:41:44Z by SystemAdmin
  • SystemAdmin
    SystemAdmin
    603 Posts
    ACCEPTED ANSWER

    Re: Web crawler application not working in biginsights 2.0

    ‏2013-04-02T11:41:44Z  in response to SystemAdmin
    Hi,

    The parameters I'm using are:
    URLs: http://www.ibm.com/
    filter: +developerworks
    output directory: tmp/crawler
    max crawl depth: 2
    max pages: 10
    Thanks in advance

    -Hams