Topic
  • 12 replies
  • Latest Post - ‏2013-10-31T16:10:52Z by pvallen
V3R0_bhaskar_barman
V3R0_bhaskar_barman
18 Posts

Pinned topic tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

‏2013-10-28T13:35:56Z |

Hi,

I tried to install HTTPUtils and JSONHelpers toolkits. However, the tool.xml has not been generated.

Can anyone please help me to install it.

 

Regards

Bhaskar

  • V3R0_bhaskar_barman
    V3R0_bhaskar_barman
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-28T14:14:23Z  
    use com.ibm.ssb.parsers.json::JSONToTuple;
    use com.ibm.ssb.inet.http::HTTPGetStreamSource;

    composite CrashTest {
    type
    Tweet = tuple<rstring id_str, int64 id>;
    graph
    stream<rstring jsonTweet> LiveTweets = HTTPGetStreamSource() 
    {
    param
    protocol : "https";
    host : "stream.twitter.com";
    baseurl : "/1/statuses/sample.json";
    params : "";
    userid : "bishalglp"; 
    password : "bhaskar09";
    }

    stream<Tweet> Tweets = JSONToTuple(LiveTweets){
    param 
    dataParamName : "jsonTweet";
    continueOnError : false;
    }

    () as TextScreen = FileSink(Tweets){
    param file : "/dev/stdout";
    format : txt;
    flush : 1u;
    }

    () as JsonLog = FileSink(LiveTweets){
    param
    file : "rawJson.dat";
    format : txt;
    flush : 100u;
    }
    }

    I am getting the below error -

     

    [root@streamstrial Twitter_sample]# sc -T -M CrashTest -t /opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.parsers.json:/opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.inet.http
    CDISP0121W WARNING: The following toolkit file is missing: /opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.parsers.json/toolkit.xml.
    CDISP0121W WARNING: The following toolkit file is missing: /opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.inet.http/toolkit.xml.
    CrashTest.spl:1:4: CDISP0760W WARNING: The com.ibm.ssb.parsers.json namespace is not defined in the use directive.
    CrashTest.spl:2:5: CDISP0760W WARNING: The com.ibm.ssb.inet.http namespace is not defined in the use directive.
    CrashTest.spl:8:40: CDISP0053E ERROR: An unknown identifier was referenced in the SPL program: HTTPGetStreamSource.
    CrashTest.spl:19:24: CDISP0053E ERROR: An unknown identifier was referenced in the SPL program: JSONToTuple.

     

    Can any one please help me.

     

    Regards

    Bhaskar

  • Kevin_Foster
    Kevin_Foster
    98 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-28T18:25:54Z  
    use com.ibm.ssb.parsers.json::JSONToTuple;
    use com.ibm.ssb.inet.http::HTTPGetStreamSource;

    composite CrashTest {
    type
    Tweet = tuple<rstring id_str, int64 id>;
    graph
    stream<rstring jsonTweet> LiveTweets = HTTPGetStreamSource() 
    {
    param
    protocol : "https";
    host : "stream.twitter.com";
    baseurl : "/1/statuses/sample.json";
    params : "";
    userid : "bishalglp"; 
    password : "bhaskar09";
    }

    stream<Tweet> Tweets = JSONToTuple(LiveTweets){
    param 
    dataParamName : "jsonTweet";
    continueOnError : false;
    }

    () as TextScreen = FileSink(Tweets){
    param file : "/dev/stdout";
    format : txt;
    flush : 1u;
    }

    () as JsonLog = FileSink(LiveTweets){
    param
    file : "rawJson.dat";
    format : txt;
    flush : 100u;
    }
    }

    I am getting the below error -

     

    [root@streamstrial Twitter_sample]# sc -T -M CrashTest -t /opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.parsers.json:/opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.inet.http
    CDISP0121W WARNING: The following toolkit file is missing: /opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.parsers.json/toolkit.xml.
    CDISP0121W WARNING: The following toolkit file is missing: /opt/ibm/InfoSphereStreams/toolkits/com.ibm.ssb.inet.http/toolkit.xml.
    CrashTest.spl:1:4: CDISP0760W WARNING: The com.ibm.ssb.parsers.json namespace is not defined in the use directive.
    CrashTest.spl:2:5: CDISP0760W WARNING: The com.ibm.ssb.inet.http namespace is not defined in the use directive.
    CrashTest.spl:8:40: CDISP0053E ERROR: An unknown identifier was referenced in the SPL program: HTTPGetStreamSource.
    CrashTest.spl:19:24: CDISP0053E ERROR: An unknown identifier was referenced in the SPL program: JSONToTuple.

     

    Can any one please help me.

     

    Regards

    Bhaskar

    It is saying that it cannot find your toolkits in the locations that you are specifying.

    Can you find them here?

    ls /opt/ibm/InfoSphereStreams/toolkits

    or did you put them somewhere else?

    -Kevin

  • V3R0_bhaskar_barman
    V3R0_bhaskar_barman
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-29T04:02:58Z  

    It is saying that it cannot find your toolkits in the locations that you are specifying.

    Can you find them here?

    ls /opt/ibm/InfoSphereStreams/toolkits

    or did you put them somewhere else?

    -Kevin

    Hi Kevin,

    When I have installed HTTPUtils and JSONHelpers toolkits in /opt/ibm/InfoSphereStreams/toolkits, two dir has been created. They are HTTPUtils and JSONHelpers.However, it did not contain the toolkits.xml.

     

    [streamsadmin@streamstrial toolkits]$ cd JSONHelpers
    [streamsadmin@streamstrial JSONHelpers]$ pwd
    /opt/ibm/InfoSphereStreams/toolkits/JSONHelpers
    [streamsadmin@streamstrial JSONHelpers]$ ls -lrt
    total 32
    -rw-r--r-- 1 streamsadmin streamsadmin 688 Jun 16 2011 info.xml
    drwxr-xr-x 3 streamsadmin streamsadmin 4096 Jun 16 2011 impl
    drwxr-xr-x 4 streamsadmin streamsadmin 4096 Jun 16 2011 com.ibm.ssb.parsers.json
    -rw-r--r-- 1 streamsadmin streamsadmin 1653 Jun 16 2011 build.xml
    -rw-r--r-- 1 streamsadmin streamsadmin 428 Jun 16 2011 Makefile
    drwxr-xr-x 2 streamsadmin streamsadmin 4096 Jun 16 2011 data
    -rw-r--r-- 1 streamsadmin streamsadmin 559 Jun 16 2011 README
    -rw-r--r-- 1 streamsadmin streamsadmin 647 Nov 8 2011 Main.spl


    [[streamsadmin@streamstrial toolkits]$ cd httputils
    [streamsadmin@streamstrial httputils]$ pwd
    /opt/ibm/InfoSphereStreams/toolkits/httputils
    [streamsadmin@streamstrial httputils]$ ls -ltr
    total 20
    -rw-r--r-- 1 streamsadmin streamsadmin  340 Jun 30  2011 Makefile
    -rw-r--r-- 1 streamsadmin streamsadmin  693 Jul 29  2011 info.xml
    -rw-r--r-- 1 streamsadmin streamsadmin 1335 Jul 29  2011 build.xml
    drwxr-xr-x 3 streamsadmin streamsadmin 4096 Jul 29  2011 impl
    drwxr-xr-x 5 streamsadmin streamsadmin 4096 Nov  8  2011 com.ibm.ssb.inet.http
    [streamsadmin@streamstrial httputils]$
     

     Please let me know if these two are the right locations.

    Regards

    Bhaskar

  • Kevin_Foster
    Kevin_Foster
    98 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-29T05:29:29Z  

    Hi Kevin,

    When I have installed HTTPUtils and JSONHelpers toolkits in /opt/ibm/InfoSphereStreams/toolkits, two dir has been created. They are HTTPUtils and JSONHelpers.However, it did not contain the toolkits.xml.

     

    [streamsadmin@streamstrial toolkits]$ cd JSONHelpers
    [streamsadmin@streamstrial JSONHelpers]$ pwd
    /opt/ibm/InfoSphereStreams/toolkits/JSONHelpers
    [streamsadmin@streamstrial JSONHelpers]$ ls -lrt
    total 32
    -rw-r--r-- 1 streamsadmin streamsadmin 688 Jun 16 2011 info.xml
    drwxr-xr-x 3 streamsadmin streamsadmin 4096 Jun 16 2011 impl
    drwxr-xr-x 4 streamsadmin streamsadmin 4096 Jun 16 2011 com.ibm.ssb.parsers.json
    -rw-r--r-- 1 streamsadmin streamsadmin 1653 Jun 16 2011 build.xml
    -rw-r--r-- 1 streamsadmin streamsadmin 428 Jun 16 2011 Makefile
    drwxr-xr-x 2 streamsadmin streamsadmin 4096 Jun 16 2011 data
    -rw-r--r-- 1 streamsadmin streamsadmin 559 Jun 16 2011 README
    -rw-r--r-- 1 streamsadmin streamsadmin 647 Nov 8 2011 Main.spl


    [[streamsadmin@streamstrial toolkits]$ cd httputils
    [streamsadmin@streamstrial httputils]$ pwd
    /opt/ibm/InfoSphereStreams/toolkits/httputils
    [streamsadmin@streamstrial httputils]$ ls -ltr
    total 20
    -rw-r--r-- 1 streamsadmin streamsadmin  340 Jun 30  2011 Makefile
    -rw-r--r-- 1 streamsadmin streamsadmin  693 Jul 29  2011 info.xml
    -rw-r--r-- 1 streamsadmin streamsadmin 1335 Jul 29  2011 build.xml
    drwxr-xr-x 3 streamsadmin streamsadmin 4096 Jul 29  2011 impl
    drwxr-xr-x 5 streamsadmin streamsadmin 4096 Nov  8  2011 com.ibm.ssb.inet.http
    [streamsadmin@streamstrial httputils]$
     

     Please let me know if these two are the right locations.

    Regards

    Bhaskar

    I need to ask more questions:

    What version of Streams are you running? Did you download a VMware image (which one?) or did you install the Streams product yourself?

    Where did you get these toolkits from? Please reply with a link to the web page and the file name(s) that you downloaded.

    Also, you said that you "installed" them underneath the Streams installation directory. What instructions did you follow for the installation, or if none, what did you do or type to install them?

    Maybe just explain for  com.ibm.ssb.parsers.json  for right now. Will be easier than mentioning both toolkits in each reply.

    -Kevin

  • V3R0_bhaskar_barman
    V3R0_bhaskar_barman
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-29T08:46:11Z  

    I need to ask more questions:

    What version of Streams are you running? Did you download a VMware image (which one?) or did you install the Streams product yourself?

    Where did you get these toolkits from? Please reply with a link to the web page and the file name(s) that you downloaded.

    Also, you said that you "installed" them underneath the Streams installation directory. What instructions did you follow for the installation, or if none, what did you do or type to install them?

    Maybe just explain for  com.ibm.ssb.parsers.json  for right now. Will be easier than mentioning both toolkits in each reply.

    -Kevin

    Hi Kevin,

    1. I am using IBM info Streams version 3.1

    2. I have downloaded the VM image for non production environment.

    3.The link for the toolkits is-  https://www.ibm.com/developerworks/community/files/app?lang=en#/collection/09ddaa56-cd45-4e04-b880-d52a3ab630c0

    4.I have downloaded the toolkits and saved it in thos path- /opt/ibm/InfoSphereStreams/toolkits

    5. I have used to commands on JSONHelpers.tgz and httputils.tgz.They are-

    For JSONHelpers

    gunzip JSONHelpers.tgz

    -rw-rw-r--  1 streamsadmin streamsadmin    40960 Oct 29 04:30 JSONHelpers.tar
    -

    [streamsadmin@streamstrial toolkits]$ tar xvf JSONHelpers.tar
    JSONHelpers/
    JSONHelpers/build.xml
    JSONHelpers/impl/
    JSONHelpers/impl/java/
    JSONHelpers/impl/java/src/
    JSONHelpers/impl/java/src/com/
    JSONHelpers/impl/java/src/com/ibm/
    JSONHelpers/impl/java/src/com/ibm/streams/
    JSONHelpers/impl/java/src/com/ibm/streams/JSONMain.java
    JSONHelpers/impl/java/src/com/ibm/streams/JSONToTuple.java
    JSONHelpers/impl/java/src/com/ibm/streams/TupleToJSON.java
    JSONHelpers/README
    JSONHelpers/data/
    JSONHelpers/data/input.dat
    JSONHelpers/Makefile
    JSONHelpers/Main.spl
    JSONHelpers/com.ibm.ssb.parsers.json/
    JSONHelpers/com.ibm.ssb.parsers.json/.namespace
    JSONHelpers/com.ibm.ssb.parsers.json/JSONToTuple/
    JSONHelpers/com.ibm.ssb.parsers.json/JSONToTuple/JSONToTuple.xml
    JSONHelpers/com.ibm.ssb.parsers.json/TupleToJSON/
    JSONHelpers/com.ibm.ssb.parsers.json/TupleToJSON/TupleToJSON.xml
    JSONHelpers/info.xml

     

    drwxr-xr-x  5 streamsadmin streamsadmin     4096 Nov  8  2011 JSONHelpers

     

     Inside JSONHelpers I have the below-


    [streamsadmin@streamstrial toolkits]$ cd JSONHelpers
    [streamsadmin@streamstrial JSONHelpers]$ ls -ltr
    total 32
    -rw-r--r-- 1 streamsadmin streamsadmin  688 Jun 16  2011 info.xml
    drwxr-xr-x 3 streamsadmin streamsadmin 4096 Jun 16  2011 impl
    drwxr-xr-x 4 streamsadmin streamsadmin 4096 Jun 16  2011 com.ibm.ssb.parsers.json
    -rw-r--r-- 1 streamsadmin streamsadmin 1653 Jun 16  2011 build.xml
    -rw-r--r-- 1 streamsadmin streamsadmin  428 Jun 16  2011 Makefile
    drwxr-xr-x 2 streamsadmin streamsadmin 4096 Jun 16  2011 data
    -rw-r--r-- 1 streamsadmin streamsadmin  559 Jun 16  2011 README
    -rw-r--r-- 1 streamsadmin streamsadmin  647 Nov  8  2011 Main.spl

     Regards

    Bhaskar

  • V3R0_bhaskar_barman
    V3R0_bhaskar_barman
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-29T08:47:32Z  

    Hi Kevin,

    1. I am using IBM info Streams version 3.1

    2. I have downloaded the VM image for non production environment.

    3.The link for the toolkits is-  https://www.ibm.com/developerworks/community/files/app?lang=en#/collection/09ddaa56-cd45-4e04-b880-d52a3ab630c0

    4.I have downloaded the toolkits and saved it in thos path- /opt/ibm/InfoSphereStreams/toolkits

    5. I have used to commands on JSONHelpers.tgz and httputils.tgz.They are-

    For JSONHelpers

    gunzip JSONHelpers.tgz

    -rw-rw-r--  1 streamsadmin streamsadmin    40960 Oct 29 04:30 JSONHelpers.tar
    -

    [streamsadmin@streamstrial toolkits]$ tar xvf JSONHelpers.tar
    JSONHelpers/
    JSONHelpers/build.xml
    JSONHelpers/impl/
    JSONHelpers/impl/java/
    JSONHelpers/impl/java/src/
    JSONHelpers/impl/java/src/com/
    JSONHelpers/impl/java/src/com/ibm/
    JSONHelpers/impl/java/src/com/ibm/streams/
    JSONHelpers/impl/java/src/com/ibm/streams/JSONMain.java
    JSONHelpers/impl/java/src/com/ibm/streams/JSONToTuple.java
    JSONHelpers/impl/java/src/com/ibm/streams/TupleToJSON.java
    JSONHelpers/README
    JSONHelpers/data/
    JSONHelpers/data/input.dat
    JSONHelpers/Makefile
    JSONHelpers/Main.spl
    JSONHelpers/com.ibm.ssb.parsers.json/
    JSONHelpers/com.ibm.ssb.parsers.json/.namespace
    JSONHelpers/com.ibm.ssb.parsers.json/JSONToTuple/
    JSONHelpers/com.ibm.ssb.parsers.json/JSONToTuple/JSONToTuple.xml
    JSONHelpers/com.ibm.ssb.parsers.json/TupleToJSON/
    JSONHelpers/com.ibm.ssb.parsers.json/TupleToJSON/TupleToJSON.xml
    JSONHelpers/info.xml

     

    drwxr-xr-x  5 streamsadmin streamsadmin     4096 Nov  8  2011 JSONHelpers

     

     Inside JSONHelpers I have the below-


    [streamsadmin@streamstrial toolkits]$ cd JSONHelpers
    [streamsadmin@streamstrial JSONHelpers]$ ls -ltr
    total 32
    -rw-r--r-- 1 streamsadmin streamsadmin  688 Jun 16  2011 info.xml
    drwxr-xr-x 3 streamsadmin streamsadmin 4096 Jun 16  2011 impl
    drwxr-xr-x 4 streamsadmin streamsadmin 4096 Jun 16  2011 com.ibm.ssb.parsers.json
    -rw-r--r-- 1 streamsadmin streamsadmin 1653 Jun 16  2011 build.xml
    -rw-r--r-- 1 streamsadmin streamsadmin  428 Jun 16  2011 Makefile
    drwxr-xr-x 2 streamsadmin streamsadmin 4096 Jun 16  2011 data
    -rw-r--r-- 1 streamsadmin streamsadmin  559 Jun 16  2011 README
    -rw-r--r-- 1 streamsadmin streamsadmin  647 Nov  8  2011 Main.spl

     Regards

    Bhaskar

    For httputils


    -rw-rw-r--  1 streamsadmin streamsadmin     8618 Oct 29 04:30 HTTPUtils V1.0.tgz


    gunzip HTTPUtils\ V1.0.tgz

     

    rw-rw-r--  1 streamsadmin streamsadmin    61440 Oct 29 04:30 HTTPUtils V1.0.tar

     

     

    [streamsadmin@streamstrial toolkits]$ tar xvf HTTPUtils\ V1.0.tar
    httputils/
    httputils/build.xml
    httputils/impl/
    httputils/impl/java/
    httputils/impl/java/src/
    httputils/impl/java/src/com/
    httputils/impl/java/src/com/ibm/
    httputils/impl/java/src/com/ibm/streams/
    httputils/impl/java/src/com/ibm/streams/HTTPResponse.java
    httputils/impl/java/src/com/ibm/streams/HTTPRequest.java
    httputils/impl/java/src/com/ibm/streams/HTTPGetStreamReaderObj.java
    httputils/impl/java/src/com/ibm/streams/HTTPGetOper.java
    httputils/impl/java/src/com/ibm/streams/HTTPGetStreamReader.java
    httputils/impl/java/src/com/ibm/streams/HTTPUtils.java
    httputils/impl/java/src/com/ibm/streams/HTTPStreamReaderMain.java
    httputils/impl/java/src/com/ibm/streams/HTTPPostOper.java
    httputils/Makefile
    httputils/com.ibm.ssb.inet.http/
    httputils/com.ibm.ssb.inet.http/HTTPGetStreamSource/
    httputils/com.ibm.ssb.inet.http/HTTPGetStreamSource/HTTPGetStreamSource.xml
    httputils/com.ibm.ssb.inet.http/.namespace
    httputils/com.ibm.ssb.inet.http/HTTPSample.spl
    httputils/com.ibm.ssb.inet.http/HTTPPostSink/
    httputils/com.ibm.ssb.inet.http/HTTPPostSink/HTTPPostSink.xml
    httputils/com.ibm.ssb.inet.http/HTTPTypes.spl
    httputils/com.ibm.ssb.inet.http/HTTPGetOper/
    httputils/com.ibm.ssb.inet.http/HTTPGetOper/HTTPGetOper.xml
    httputils/info.xml

     


    drwxr-xr-x  4 streamsadmin streamsadmin     4096 Nov  8  2011 httputils

     


    streamsadmin@streamstrial httputils]$ ls -ltr
    total 20
    -rw-r--r-- 1 streamsadmin streamsadmin  340 Jun 30  2011 Makefile
    -rw-r--r-- 1 streamsadmin streamsadmin  693 Jul 29  2011 info.xml
    -rw-r--r-- 1 streamsadmin streamsadmin 1335 Jul 29  2011 build.xml
    drwxr-xr-x 3 streamsadmin streamsadmin 4096 Jul 29  2011 impl
    drwxr-xr-x 5 streamsadmin streamsadmin 4096 Nov  8  2011 com.ibm.ssb.inet.http

    Please let me know if I am doing anyhting wrong here.

    Regarads

    Bhaskar

  • V3R0_bhaskar_barman
    V3R0_bhaskar_barman
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-31T07:25:46Z  

    I need to ask more questions:

    What version of Streams are you running? Did you download a VMware image (which one?) or did you install the Streams product yourself?

    Where did you get these toolkits from? Please reply with a link to the web page and the file name(s) that you downloaded.

    Also, you said that you "installed" them underneath the Streams installation directory. What instructions did you follow for the installation, or if none, what did you do or type to install them?

    Maybe just explain for  com.ibm.ssb.parsers.json  for right now. Will be easier than mentioning both toolkits in each reply.

    -Kevin

    Hi Kevin,

    I have provided the details above. Could you please reply.

    Regards

    Bhaskar

  • BruceGlassford
    BruceGlassford
    71 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-31T10:04:16Z  

    Hi Kevin,

    I have provided the details above. Could you please reply.

    Regards

    Bhaskar

    I  would look in the Makefile and see if there's a target that runs spl-make-toolkit, and run that. If not, just run Spl-make-toolkit yourself.. It looks like that may be what's missing.  That will generate the toolkit.xml file

  • V3R0_bhaskar_barman
    V3R0_bhaskar_barman
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-31T13:30:29Z  

    I  would look in the Makefile and see if there's a target that runs spl-make-toolkit, and run that. If not, just run Spl-make-toolkit yourself.. It looks like that may be what's missing.  That will generate the toolkit.xml file

    Hi Kevin,

    Now its generating the tool.xml.However at the compile time the spl is throwing some errors.

    The spl which I am trying to compile is-

    ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

    use com.ibm.ssb.parsers.json::JSONToTuple;
    use com.ibm.ssb.inet.http::HTTPGetStreamSource;

    composite Fetch_Social {
    type
    Tweet = tuple<rstring id_str, int64 id>;
    graph
    stream<rstring jsonTweet> LiveTweets = HTTPGetStreamSource()
    {
    param
    protocol : "https";
    host : "stream.twitter.com";
    baseurl : "/1/statuses/sample.json";
    params : "";
    userid : "bishalglp";
    password : "bhaskar09";
    }

    stream<Tweet> Tweets = JSONToTuple(LiveTweets){
    param
    dataParamName : "jsonTweet";
    continueOnError : false;
    }

    () as TextScreen = FileSink(Tweets){
    param file : "/dev/stdout";
    format : txt;
    flush : 1u;
    }

    () as JsonLog = FileSink(LiveTweets){
    param
    file : "rawJson.dat";
    format : txt;
    flush : 100u;
    }
    }

    ++++++++++++++++++++++++++++++++++++++++++++++

     The error while compiling is:

    [streamsadmin@streamstrial Twitter_sample]$ sc -T -M  Fetch_Social  -t $STREAMS_INSTALL/toolkits/httputils:$STREAMS_INSTALL/toolkits/JSONHelpers
    Creating the types.
    Creating the functions.
    Creating the operators.
    java.lang.ClassNotFoundException: com.ibm.streams.HTTPGetStreamReader
            at java.net.URLClassLoader.findClass(URLClassLoader.java:434)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:660)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:626)
            at com.ibm.streams.operator.internal.runtime.api.OperatorAdapter.loadOperatorClass(OperatorAdapter.java:348)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.verifyClassNameAndLibraries(OperatorCompileTime.java:169)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.executeCompileTimeChecks(OperatorCompileTime.java:136)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.main(OperatorCompileTime.java:107)
    ERROR: java.lang.ClassNotFoundException: com.ibm.streams.HTTPGetStreamReader
    CrashTest.spl:8:1: CDISP9164E ERROR: Operator invocation error for Java primitive com.ibm.ssb.inet.http::HTTPGetStreamSource
    CrashTest.spl:8:1: CDISP0232E ERROR: An error was encountered during the generation of the code for the LiveTweets operator.
    java.lang.ClassNotFoundException: com.ibm.streams.JSONToTuple
            at java.net.URLClassLoader.findClass(URLClassLoader.java:434)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:660)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:626)
            at com.ibm.streams.operator.internal.runtime.api.OperatorAdapter.loadOperatorClass(OperatorAdapter.java:348)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.verifyClassNameAndLibraries(OperatorCompileTime.java:169)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.executeCompileTimeChecks(OperatorCompileTime.java:136)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.main(OperatorCompileTime.java:107)
    ERROR: java.lang.ClassNotFoundException: com.ibm.streams.JSONToTuple
    CrashTest.spl:19:1: CDISP9164E ERROR: Operator invocation error for Java primitive com.ibm.ssb.parsers.json::JSONToTuple
    CrashTest.spl:19:1: CDISP0232E ERROR: An error was encountered during the generation of the code for the Tweets operator.
    Creating the processing elements.
    The standalone application is being created.

    CDISP0092E ERROR: Because of previous compilation errors, the compile process cannot continue.

  • pvallen
    pvallen
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-31T14:37:01Z  

    Hi Kevin,

    Now its generating the tool.xml.However at the compile time the spl is throwing some errors.

    The spl which I am trying to compile is-

    ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

    use com.ibm.ssb.parsers.json::JSONToTuple;
    use com.ibm.ssb.inet.http::HTTPGetStreamSource;

    composite Fetch_Social {
    type
    Tweet = tuple<rstring id_str, int64 id>;
    graph
    stream<rstring jsonTweet> LiveTweets = HTTPGetStreamSource()
    {
    param
    protocol : "https";
    host : "stream.twitter.com";
    baseurl : "/1/statuses/sample.json";
    params : "";
    userid : "bishalglp";
    password : "bhaskar09";
    }

    stream<Tweet> Tweets = JSONToTuple(LiveTweets){
    param
    dataParamName : "jsonTweet";
    continueOnError : false;
    }

    () as TextScreen = FileSink(Tweets){
    param file : "/dev/stdout";
    format : txt;
    flush : 1u;
    }

    () as JsonLog = FileSink(LiveTweets){
    param
    file : "rawJson.dat";
    format : txt;
    flush : 100u;
    }
    }

    ++++++++++++++++++++++++++++++++++++++++++++++

     The error while compiling is:

    [streamsadmin@streamstrial Twitter_sample]$ sc -T -M  Fetch_Social  -t $STREAMS_INSTALL/toolkits/httputils:$STREAMS_INSTALL/toolkits/JSONHelpers
    Creating the types.
    Creating the functions.
    Creating the operators.
    java.lang.ClassNotFoundException: com.ibm.streams.HTTPGetStreamReader
            at java.net.URLClassLoader.findClass(URLClassLoader.java:434)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:660)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:626)
            at com.ibm.streams.operator.internal.runtime.api.OperatorAdapter.loadOperatorClass(OperatorAdapter.java:348)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.verifyClassNameAndLibraries(OperatorCompileTime.java:169)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.executeCompileTimeChecks(OperatorCompileTime.java:136)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.main(OperatorCompileTime.java:107)
    ERROR: java.lang.ClassNotFoundException: com.ibm.streams.HTTPGetStreamReader
    CrashTest.spl:8:1: CDISP9164E ERROR: Operator invocation error for Java primitive com.ibm.ssb.inet.http::HTTPGetStreamSource
    CrashTest.spl:8:1: CDISP0232E ERROR: An error was encountered during the generation of the code for the LiveTweets operator.
    java.lang.ClassNotFoundException: com.ibm.streams.JSONToTuple
            at java.net.URLClassLoader.findClass(URLClassLoader.java:434)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:660)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:626)
            at com.ibm.streams.operator.internal.runtime.api.OperatorAdapter.loadOperatorClass(OperatorAdapter.java:348)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.verifyClassNameAndLibraries(OperatorCompileTime.java:169)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.executeCompileTimeChecks(OperatorCompileTime.java:136)
            at com.ibm.streams.operator.internal.compile.OperatorCompileTime.main(OperatorCompileTime.java:107)
    ERROR: java.lang.ClassNotFoundException: com.ibm.streams.JSONToTuple
    CrashTest.spl:19:1: CDISP9164E ERROR: Operator invocation error for Java primitive com.ibm.ssb.parsers.json::JSONToTuple
    CrashTest.spl:19:1: CDISP0232E ERROR: An error was encountered during the generation of the code for the Tweets operator.
    Creating the processing elements.
    The standalone application is being created.

    CDISP0092E ERROR: Because of previous compilation errors, the compile process cannot continue.

    I'm not familiar with these toolkits but from the manifests we can see that the archive does not contain the Java operator class files, only the source files. Take a look at the README file in the toolkit root directory for instructions on compiling the toolkit which should compile the Java operator classes as well as build the toolkit.xml file.

    Regards,
    Paul Allen

  • V3R0_bhaskar_barman
    V3R0_bhaskar_barman
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-31T15:31:46Z  
    • pvallen
    • ‏2013-10-31T14:37:01Z

    I'm not familiar with these toolkits but from the manifests we can see that the archive does not contain the Java operator class files, only the source files. Take a look at the README file in the toolkit root directory for instructions on compiling the toolkit which should compile the Java operator classes as well as build the toolkit.xml file.

    Regards,
    Paul Allen

    While compiling the httputils, it is giving below error-

     

    [streamsadmin@streamstrial com.ibm.ssb.inet.http]$ $STREAMS_INSTALL/bin/spl-make-toolkit -i  .
    HTTPTypes.spl:6:11: CDISP0435E ERROR: The com.ibm.ssb.inet.http namespace that is defined in the HTTPTypes.spl SPL file does not match the  namespace that is derived from the following directory path: .
     
    CDISP0092E ERROR: Because of previous compilation errors, the compile process cannot continue.
    [streamsadmin@streamstrial com.ibm.ssb.inet.http]$ pwd
    /opt/ibm/InfoSphereStreams/toolkits/httputils/com.ibm.ssb.inet.http
     
  • pvallen
    pvallen
    18 Posts

    Re: tool.xml not generated while installing HTTPUtils and JSONHelpers toolkits

    ‏2013-10-31T16:10:52Z  

    While compiling the httputils, it is giving below error-

     

    [streamsadmin@streamstrial com.ibm.ssb.inet.http]$ $STREAMS_INSTALL/bin/spl-make-toolkit -i  .
    HTTPTypes.spl:6:11: CDISP0435E ERROR: The com.ibm.ssb.inet.http namespace that is defined in the HTTPTypes.spl SPL file does not match the  namespace that is derived from the following directory path: .
     
    CDISP0092E ERROR: Because of previous compilation errors, the compile process cannot continue.
    [streamsadmin@streamstrial com.ibm.ssb.inet.http]$ pwd
    /opt/ibm/InfoSphereStreams/toolkits/httputils/com.ibm.ssb.inet.http
     

    That error would indicated that spl-make-toolkit is being run from the wrong directory (i.e. not the toolkit root directory)

    I just did the following for both toolkits:

    - download and extract

    - cd to extracted folder (e.g JSONHelpers and httputils)

    - run make

    Both toolkits compiled without error producing the toolkit.xml file and the required Java operator class files in the toolkit's impl/java/bin directory. With the toolkits now built, they can be used to build applications using the operators in those toolkits.

    Note that for these toolkits, simply running spl-make-toolkit is not sufficient. You need to run make with the supplied Makefile in order to compile the Java classes.