Topic
6 replies Latest Post - ‏2012-10-22T19:27:04Z by SHAHR
SHAHR
SHAHR
4 Posts
ACCEPTED ANSWER

Pinned topic Error in Parallel job with Transformer Stage

‏2012-10-18T20:51:35Z |
Trying to run the trimandstrip job as depicted in the tutorial. See a lot of people have had issues with it and tried to apply some of the recommendations, but havent been able to resolve my issue. I have a windows 7 - 64 bit environment. I have tried to remove the -W/Zc:wchar_t- from APT_COMPILEOPT and APT_LINKOPT environment variables, but no difference.
Not sure, why it cant find the compiler cl. I looked at the cxx.ccg file under MKSToolKit\mksnt and see where it is having the issue (a snippet of which is attached below), but dont understand why the execv call is not returning the value 0.

if (has_shell )
  • cmd={};*
  • cmd |= shell_exe;*
  • cmd |= "-c";*
  • cmd |= "which " | compile_exe | " >nul";*
#RS Print
  • println "Test1 cmd value is " | cmd |;*
  • val = execv(cmd);*
  • println "Test1 val value is " | val |*

;
else
  • cmd={};*
  • cmd |= "cmd.exe";*
  • cmd |= "/c";*
  • cmd |= "which";*
  • cmd |= compile_exe;*
  • cmd |= ">NUL:";*
  • val = execv(cmd);*
fi

if (val != 0)
  • println "Compiler \"" | compile_exe | "\" not found.";*
  • exit 1;*
fi
The value for cmd is "C:/progra~2/MKSTOO~1/mksnt/sh.exe -c which cl>nul

The value for val is 1, hence get the cl not found error.

Can you kindly help?

Following is the error message.
##I IIS-DSEE-TFCN-00006 14:01:35(001) <main_program> conductor uname: -s=Windows_NT; -r=1; -v=6; -n=LEXBZ2193; -m=Pentium
##I IIS-DSEE-TOSH-00002 14:01:35(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 14:01:35(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 14:01:35(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 14:01:35(007) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E IIS-DSEE-TBLD-00076 14:01:36(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E IIS-DSEE-TFSR-00019 14:01:36(001) <main_program> Could not check all operators because of previous error(s)
##W IIS-DSEE-TFTM-00012 14:01:36(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W IIS-DSEE-TFEV-00025 14:01:36(003) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(004) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(005) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(006) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(007) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(008) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(009) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(010) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(011) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(012) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(013) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(014) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(015) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(016) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(017) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(018) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(019) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(020) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(021) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(022) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##W IIS-DSEE-TFEV-00025 14:01:36(023) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
##W IIS-DSEE-TFEV-00023 14:01:36(024) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
##I IIS-DSEE-TBLD-00079 14:01:36(025) <transform> Error when checking composite operator: cxx -O -IC:/IBM/InformationServer/Server/PXEngine/include -W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t- C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.C -o C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.tmp.o.
##I IIS-DSEE-TBLD-00000 14:01:36(026) <main_program> Error when checking composite operator: Output from subprocess: Compiler "cl" not found.
Updated on 2012-10-22T19:27:04Z at 2012-10-22T19:27:04Z by SHAHR
  • RobertDickson
    RobertDickson
    33 Posts
    ACCEPTED ANSWER

    Re: Error in Parallel job with Transformer Stage

    ‏2012-10-18T21:08:29Z  in response to SHAHR
    Hi,

    What compiler did you install? Did you reboot after installing? What are your LIB and INCLUDE environment variables set to?


    Regards,
    Robert
    • SHAHR
      SHAHR
      4 Posts
      ACCEPTED ANSWER

      Re: Error in Parallel job with Transformer Stage

      ‏2012-10-18T21:16:25Z  in response to RobertDickson
      Hi Robert, thanks for your response.

      INCLUDE has been set to - C:\PROGRA~2\IBM\SQLLIB\INCLUDE;C:\PROGRA~2\IBM\SQLLIB\LIB;"C:\Program Files (x86)\MKS Toolkit\include";"C:/Program Files (x86)/MKS Toolkit/include";

      LIB has been set to ;C:\PROGRA~2\IBM\SQLLIB\LIB

      Can you advise me on which compiler do I need to install?

      I downloaded and installed the trial version of Visual Studio 11.0

      Thanks,

      Rakesh Shah
      • RobertDickson
        RobertDickson
        33 Posts
        ACCEPTED ANSWER

        Re: Error in Parallel job with Transformer Stage

        ‏2012-10-18T21:28:06Z  in response to SHAHR
        Hi,

        Take a look at http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r7/index.jsp?topic=%2Fcom.ibm.swg.im.iis.productization.iisinfsv.install.doc%2Ftopics%2Fwsisinst_set_envars_cpp.html&resultof=%22%63%6f%6d%70%69%6c%65%72%22%20%22%63%6f%6d%70%69%6c%22%20

        I do not think the compiler you installed is supported, but the link above has another link to a list of supported compilers.


        Regards,
        Robert
        • SHAHR
          SHAHR
          4 Posts
          ACCEPTED ANSWER

          Re: Error in Parallel job with Transformer Stage

          ‏2012-10-18T21:33:57Z  in response to RobertDickson
          Thanks Robert. The link doesnt seem to work.
          • RobertDickson
            RobertDickson
            33 Posts
            ACCEPTED ANSWER

            Re: Error in Parallel job with Transformer Stage

            ‏2012-10-18T22:41:39Z  in response to SHAHR
            Hi,

            Interesting...

            Ok, so go to the InfoCenter for your version. For 8.7 it is http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r7/index.jsp. Then search for 'Setting up the c++ compiler'


            Regards,
            Robert
            • SHAHR
              SHAHR
              4 Posts
              ACCEPTED ANSWER

              Re: Error in Parallel job with Transformer Stage

              ‏2012-10-22T19:27:04Z  in response to RobertDickson
              Ok, got further, now it sees the compiler. It still doesnt compile and now gives the following error: Error when checking composite operator: Output from subprocess: [1] + Done(134) fi
              4424 Abort cl

              ##E IIS-DSEE-TCOS-00029 14:21:14(027) <main_program> Creation of a step finished with status = FAILED. (TrimAndStrip.TrimStrip)

              Detailed message below:
              Output from transformer compilation follows:

              ##I IIS-DSEE-TFCN-00001 14:21:12(000) <main_program>
              IBM WebSphere DataStage Enterprise Edition 8.5.0.5746
              Copyright (c) 2001, 2005-2008 IBM Corporation. All rights reserved

              ##I IIS-DSEE-TFCN-00006 14:21:12(001) <main_program> conductor uname: -s=Windows_NT; -r=1; -v=6; -n=LEXBZ2193; -m=Pentium
              ##I IIS-DSEE-TOSH-00002 14:21:12(002) <main_program> orchgeneral: loaded
              ##I IIS-DSEE-TOSH-00002 14:21:12(003) <main_program> orchsort: loaded
              ##I IIS-DSEE-TOSH-00002 14:21:13(000) <main_program> orchstats: loaded
              ##W IIS-DSEE-TOSH-00049 14:21:13(003) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
              ##E IIS-DSEE-TBLD-00076 14:21:14(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 34,304.
              ##E IIS-DSEE-TFSR-00019 14:21:14(001) <main_program> Could not check all operators because of previous error(s)
              ##W IIS-DSEE-TFTM-00012 14:21:14(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
              ##W IIS-DSEE-TFEV-00025 14:21:14(003) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(004) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(005) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(006) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(007) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(008) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(009) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(010) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(011) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(012) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(013) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(014) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(015) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(016) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(017) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(018) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(019) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(020) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(021) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(022) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##W IIS-DSEE-TFEV-00025 14:21:14(023) <transform> Error when checking composite operator: Converting ustring to string using codepage windows-1252.
              ##W IIS-DSEE-TFEV-00023 14:21:14(024) <transform> Error when checking composite operator: Implicit conversion from source type "UString" to result type "String".
              ##I IIS-DSEE-TBLD-00079 14:21:14(025) <transform> Error when checking composite operator: cxx -O -IC:/IBM/InformationServer/Server/PXEngine/include -W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t- C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.C -o C:/IBM/InformationServer/Server/Projects/Tutorial/RT_BP4.O/V0S2_TrimAndStrip_TrimStrip.tmp.o.
              ##I IIS-DSEE-TBLD-00000 14:21:14(026) <main_program> Error when checking composite operator: Output from subprocess: [1] + Done(134) fi
              4424 Abort cl

              ##E IIS-DSEE-TCOS-00029 14:21:14(027) <main_program> Creation of a step finished with status = FAILED. (TrimAndStrip.TrimStrip)

              • Internal Generated Transformer Code follows:
              0001: //
              0002: // Generated file to implement the V0S2_TrimAndStrip_TrimStrip transform operator.
              0003: //
              0004:
              0005: // define our input/output link names
              0006: inputname 0 full_bill_to;
              0007: outputname 0 stripped_bill_to;
              0008:
              0009: initialize {
              0010: // define our control variables
              0011: int8 RowRejected0;
              0012: int8 NullSetVar0;
              0013:
              0014: }
              0015:
              0016: mainloop {
              0017:
              0018: // initialise the rejected row variable
              0019: RowRejected0 = 1;
              0020:
              0021: // evaluate columns (no constraints) for link: stripped_bill_to
              0022: stripped_bill_to.BILL_TO_NUM = full_bill_to.CUSTOMER_NUMBER;
              0023: stripped_bill_to.CUST_NAME = full_bill_to.CUST_NAME;
              0024: stripped_bill_to.ADDR_1 = full_bill_to.ADDR_1;
              0025: stripped_bill_to.ADDR_2 = full_bill_to.ADDR_2;
              0026: stripped_bill_to.CITY = full_bill_to.CITY;
              0027: stripped_bill_to.REGION_CODE = full_bill_to.REGION_CODE;
              0028: stripped_bill_to.ZIP = full_bill_to.ZIP;
              0029: stripped_bill_to.TEL_NUM = full_bill_to.TEL_NUM;
              0030: stripped_bill_to.REVIEW_MONTH = full_bill_to.REVIEW_MONTH;
              0031: stripped_bill_to.SETUP_DATE = full_bill_to.SETUP_DATE;
              0032: stripped_bill_to.STATUS_CODE = full_bill_to.STATUS_CODE;
              0033: writerecord 0;
              0034: RowRejected0 = 0;
              0035: }
              0036:
              0037: finish {
              0038: }
              0039:
              • End of Internal Generated Transformer Code