Topic
  • 6 replies
  • Latest Post - ‏2012-10-22T19:27:04Z by SHAHR
SHAHR
SHAHR
4 Posts

Pinned topic Error in Parallel job with Transformer Stage

‏2012-10-18T20:51:35Z |
Trying to run the trimandstrip job as depicted in the tutorial. See a lot of people have had issues with it and tried to apply some of the recommendations, but havent been able to resolve my issue. I have a windows 7 - 64 bit environment. I have tried to remove the -W/Zc:wchar_t- from APT_COMPILEOPT and APT_LINKOPT environment variables, but no difference.
Not sure, why it cant find the compiler cl. I looked at the cxx.ccg file under MKSToolKit\mksnt and see where it is having the issue (a snippet of which is attached below), but dont understand why the execv call is not returning the value 0.

if (has_shell )
  • cmd={};*
  • cmd |= shell_exe;*
  • cmd |= "-c";*
  • cmd |= "which " | compile_exe | " >nul";*
#RS Print
  • println "Test1 cmd value is " | cmd |;*
  • val = execv(cmd);*
  • println "Test1 val value is " | val |*

;
else
  • cmd={};*
  • cmd |= "cmd.exe";*
  • cmd |= "/c";*
  • cmd |= "which";*
  • cmd |= compile_exe;*
  • cmd |= ">NUL:";*
  • val = execv(cmd);*
fi

if (val != 0)
  • println "Compiler \"" | compile_exe | "\" not found.";*
  • exit 1;*
fi
The value for cmd is "C:/progra~2/MKSTOO~1/mksnt/sh.exe -c which cl>nul

The value for val is 1, hence get the cl not found error.

Can you kindly help?

Following is the error message.
##I IIS-DSEE-TFCN-00006 14:01:35(001) <main_program> conductor uname: -s=Windows_NT; -r=1; -v=6; -n=LEXBZ2193; -m=Pentium
##I IIS-DSEE-TOSH-00002 14:01:35(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 14:01:35(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 14:01:35(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 14:01:35(007) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E IIS-DSEE-TBLD-00076 14:01:36(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E IIS-DSEE-TFSR-00019 14:01:36(001) <main_program> Could not check all operators because of previous error(s)
##W IIS-DSEE-TFTM-00012 14:01:36(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W IIS-DSEE-TFEV-00025 14:01:36(003) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(004) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(005) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(006) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(007) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(008) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(009) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(010) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(011) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(012) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(013) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(014) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(015) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(016) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(017) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(018) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(019) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(020) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(021) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(022) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(023) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(024) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##I IIS-DSEE-TBLD-00079 14:01:36(025) <transform> Error when checking composite operator: cxx -O -IC:/IBM/InformationServer/Server/PXEngine/include -W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t- C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.C -o C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.tmp.o.
##I IIS-DSEE-TBLD-00000 14:01:36(026) <main_program> Error when checking composite operator: Output from subprocess: Compiler "cl" not found.
Updated on 2012-10-22T19:27:04Z at 2012-10-22T19:27:04Z by SHAHR
  • RobertDickson
    RobertDickson
    33 Posts

    Re: Error in Parallel job with Transformer Stage

    ‏2012-10-18T21:08:29Z  
    Hi,

    What compiler did you install? Did you reboot after installing? What are your LIB and INCLUDE environment variables set to?


    Regards,
    Robert
  • SHAHR
    SHAHR
    4 Posts

    Re: Error in Parallel job with Transformer Stage

    ‏2012-10-18T21:16:25Z  
    Hi,

    What compiler did you install? Did you reboot after installing? What are your LIB and INCLUDE environment variables set to?


    Regards,
    Robert
    Hi Robert, thanks for your response.

    INCLUDE has been set to - C:\PROGRA~2\IBM\SQLLIB\INCLUDE;C:\PROGRA~2\IBM\SQLLIB\LIB;"C:\Program Files (x86)\MKS Toolkit\include";"C:/Program Files (x86)/MKS Toolkit/include";

    LIB has been set to ;C:\PROGRA~2\IBM\SQLLIB\LIB

    Can you advise me on which compiler do I need to install?

    I downloaded and installed the trial version of Visual Studio 11.0

    Thanks,

    Rakesh Shah
  • RobertDickson
    RobertDickson
    33 Posts

    Re: Error in Parallel job with Transformer Stage

    ‏2012-10-18T21:28:06Z  
    • SHAHR
    • ‏2012-10-18T21:16:25Z
    Hi Robert, thanks for your response.

    INCLUDE has been set to - C:\PROGRA~2\IBM\SQLLIB\INCLUDE;C:\PROGRA~2\IBM\SQLLIB\LIB;"C:\Program Files (x86)\MKS Toolkit\include";"C:/Program Files (x86)/MKS Toolkit/include";

    LIB has been set to ;C:\PROGRA~2\IBM\SQLLIB\LIB

    Can you advise me on which compiler do I need to install?

    I downloaded and installed the trial version of Visual Studio 11.0

    Thanks,

    Rakesh Shah
    Hi,

    Take a look at http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r7/index.jsp?topic=%2Fcom.ibm.swg.im.iis.productization.iisinfsv.install.doc%2Ftopics%2Fwsisinst_set_envars_cpp.html&resultof=%22%63%6f%6d%70%69%6c%65%72%22%20%22%63%6f%6d%70%69%6c%22%20

    I do not think the compiler you installed is supported, but the link above has another link to a list of supported compilers.


    Regards,
    Robert
  • SHAHR
    SHAHR
    4 Posts

    Re: Error in Parallel job with Transformer Stage

    ‏2012-10-18T21:33:57Z  
    Hi,

    Take a look at http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r7/index.jsp?topic=%2Fcom.ibm.swg.im.iis.productization.iisinfsv.install.doc%2Ftopics%2Fwsisinst_set_envars_cpp.html&resultof=%22%63%6f%6d%70%69%6c%65%72%22%20%22%63%6f%6d%70%69%6c%22%20

    I do not think the compiler you installed is supported, but the link above has another link to a list of supported compilers.


    Regards,
    Robert
    Thanks Robert. The link doesnt seem to work.
  • RobertDickson
    RobertDickson
    33 Posts

    Re: Error in Parallel job with Transformer Stage

    ‏2012-10-18T22:41:39Z  
    • SHAHR
    • ‏2012-10-18T21:33:57Z
    Thanks Robert. The link doesnt seem to work.
    Hi,

    Interesting...

    Ok, so go to the InfoCenter for your version. For 8.7 it is http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r7/index.jsp. Then search for 'Setting up the c++ compiler'


    Regards,
    Robert
  • SHAHR
    SHAHR
    4 Posts

    Re: Error in Parallel job with Transformer Stage

    ‏2012-10-22T19:27:04Z  
    Hi,

    Interesting...

    Ok, so go to the InfoCenter for your version. For 8.7 it is http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r7/index.jsp. Then search for 'Setting up the c++ compiler'


    Regards,
    Robert
    Ok, got further, now it sees the compiler. It still doesnt compile and now gives the following error: Error when checking composite operator: Output from subprocess: [1] + Done(134) fi
    4424 Abort cl

    ##E IIS-DSEE-TCOS-00029 14:21:14(027) <main_program> Creation of a step finished with status = FAILED. (TrimAndStrip.TrimStrip)

    Detailed message below:
    Output from transformer compilation follows:

    ##I IIS-DSEE-TFCN-00001 14:21:12(000) <main_program>
    IBM WebSphere DataStage Enterprise Edition 8.5.0.5746
    Copyright (c) 2001, 2005-2008 IBM Corporation. All rights reserved

    ##I IIS-DSEE-TFCN-00006 14:21:12(001) <main_program> conductor uname: -s=Windows_NT; -r=1; -v=6; -n=LEXBZ2193; -m=Pentium
    ##I IIS-DSEE-TOSH-00002 14:21:12(002) <main_program> orchgeneral: loaded
    ##I IIS-DSEE-TOSH-00002 14:21:12(003) <main_program> orchsort: loaded
    ##I IIS-DSEE-TOSH-00002 14:21:13(000) <main_program> orchstats: loaded
    ##W IIS-DSEE-TOSH-00049 14:21:13(003) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
    ##E IIS-DSEE-TBLD-00076 14:21:14(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 34,304.
    ##E IIS-DSEE-TFSR-00019 14:21:14(001) <main_program> Could not check all operators because of previous error(s)
    ##W IIS-DSEE-TFTM-00012 14:21:14(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
    ##W IIS-DSEE-TFEV-00025 14:21:14(003) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(004) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(005) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(006) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(007) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(008) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(009) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(010) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(011) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(012) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(013) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(014) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(015) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(016) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(017) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(018) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(019) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(020) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(021) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(022) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##W IIS-DSEE-TFEV-00025 14:21:14(023) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
    ##W IIS-DSEE-TFEV-00023 14:21:14(024) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
    ##I IIS-DSEE-TBLD-00079 14:21:14(025) <transform> Error when checking composite operator: cxx -O -IC:/IBM/InformationServer/Server/PXEngine/include -W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t- C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.C -o C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.tmp.o.
    ##I IIS-DSEE-TBLD-00000 14:21:14(026) <main_program> Error when checking composite operator: Output from subprocess: [1] + Done(134) fi
    4424 Abort cl

    ##E IIS-DSEE-TCOS-00029 14:21:14(027) <main_program> Creation of a step finished with status = FAILED. (TrimAndStrip.TrimStrip)

    • Internal Generated Transformer Code follows:
    0001: //
    0002: // Generated file to implement the V0S2_TrimAndStrip_TrimStrip transform operator.
    0003: //
    0004:
    0005: // define our input/output link names
    0006: inputname 0 full_bill_to;
    0007: outputname 0 stripped_bill_to;
    0008:
    0009: initialize {
    0010: // define our control variables
    0011: int8 RowRejected0;
    0012: int8 NullSetVar0;
    0013:
    0014: }
    0015:
    0016: mainloop {
    0017:
    0018: // initialise the rejected row variable
    0019: RowRejected0 = 1;
    0020:
    0021: // evaluate columns (no constraints) for link: stripped_bill_to
    0022: stripped_bill_to.BILL_TO_NUM = full_bill_to.CUSTOMER_NUMBER;
    0023: stripped_bill_to.CUST_NAME = full_bill_to.CUST_NAME;
    0024: stripped_bill_to.ADDR_1 = full_bill_to.ADDR_1;
    0025: stripped_bill_to.ADDR_2 = full_bill_to.ADDR_2;
    0026: stripped_bill_to.CITY = full_bill_to.CITY;
    0027: stripped_bill_to.REGION_CODE = full_bill_to.REGION_CODE;
    0028: stripped_bill_to.ZIP = full_bill_to.ZIP;
    0029: stripped_bill_to.TEL_NUM = full_bill_to.TEL_NUM;
    0030: stripped_bill_to.REVIEW_MONTH = full_bill_to.REVIEW_MONTH;
    0031: stripped_bill_to.SETUP_DATE = full_bill_to.SETUP_DATE;
    0032: stripped_bill_to.STATUS_CODE = full_bill_to.STATUS_CODE;
    0033: writerecord 0;
    0034: RowRejected0 = 0;
    0035: }
    0036:
    0037: finish {
    0038: }
    0039:
    • End of Internal Generated Transformer Code