Topic
  • 5 replies
  • Latest Post - ‏2012-10-03T16:06:15Z by michaelkdown
michaelkdown
michaelkdown
36 Posts

Pinned topic Parallel Processing? Is it possible?

‏2012-10-02T16:12:47Z |
Is there a way to process things in parallel?

Short and sweet...
Updated on 2012-10-03T16:06:15Z at 2012-10-03T16:06:15Z by michaelkdown
  • Katherine Sanders
    Katherine Sanders
    47 Posts

    Re: Parallel Processing? Is it possible?

    ‏2012-10-02T16:20:57Z  
    Yes you can run multiple jobs of the same orchestration if you trigger it more than once. The number of jobs that can run in parallel is set in the WMC.

    You can also have a parent job that calls multiple child orchestrations to process in parallel if it's not suitable for the same job to run multiple times.

    If you give me more details of what you want to do I can be more specific.
  • michaelkdown
    michaelkdown
    36 Posts

    Re: Parallel Processing? Is it possible?

    ‏2012-10-03T09:37:49Z  
    Yes you can run multiple jobs of the same orchestration if you trigger it more than once. The number of jobs that can run in parallel is set in the WMC.

    You can also have a parent job that calls multiple child orchestrations to process in parallel if it's not suitable for the same job to run multiple times.

    If you give me more details of what you want to do I can be more specific.
    I know you can run the same orchestration a number of time, so simultaneous jobs. However can you do this:

    1) Start Orchestration
    2) Folk Orchestration - Do a & b in parallel
    a) Go to SAP, get info
    b) Go to SQL, get info
    3) Merge a & b

    Total 3 Steps - 2 in parallel

    Not

    1) Start Orchestration
    2) Folk Orchestration - Do a & b in parallel
    3) Go to SAP, get info
    4) Go to SQL, get info
    5) Merge a & b

    Total 5 steps - None in parallel
    Does that make more sense? So parallel processing inside of a single orchestration and single workflow.
  • michaelkdown
    michaelkdown
    36 Posts

    Re: Parallel Processing? Is it possible?

    ‏2012-10-03T09:38:54Z  
    I know you can run the same orchestration a number of time, so simultaneous jobs. However can you do this:

    1) Start Orchestration
    2) Folk Orchestration - Do a & b in parallel
    a) Go to SAP, get info
    b) Go to SQL, get info
    3) Merge a & b

    Total 3 Steps - 2 in parallel

    Not

    1) Start Orchestration
    2) Folk Orchestration - Do a & b in parallel
    3) Go to SAP, get info
    4) Go to SQL, get info
    5) Merge a & b

    Total 5 steps - None in parallel
    Does that make more sense? So parallel processing inside of a single orchestration and single workflow.
    Sorry that latter is 4 steps not 5

    1) Start Orchestration
    2) Go to SAP, get info
    3) Go to SQL, get info
    4) Merge a & b

    Total 4 steps - None in parallel
  • Katherine Sanders
    Katherine Sanders
    47 Posts

    Re: Parallel Processing? Is it possible?

    ‏2012-10-03T10:02:00Z  
    Sorry that latter is 4 steps not 5

    1) Start Orchestration
    2) Go to SAP, get info
    3) Go to SQL, get info
    4) Merge a & b

    Total 4 steps - None in parallel
    When you call a child orchestration to do work and then return a response to the parent, the parent will have to block. However, if the child puts the result of it's work somewhere else like a flat file on an FTP server or a database, it wouldn't need to send a response so the parent could move on to the next activity and then poll the place that stores the results at the end for the merging. However there would be a lot of overhead involved in this, so you'd have to try it to see if it's any faster. There is a local database (the staging database) in Cast Iron that may be faster than an external results store too.
  • michaelkdown
    michaelkdown
    36 Posts

    Re: Parallel Processing? Is it possible?

    ‏2012-10-03T16:06:15Z  
    When you call a child orchestration to do work and then return a response to the parent, the parent will have to block. However, if the child puts the result of it's work somewhere else like a flat file on an FTP server or a database, it wouldn't need to send a response so the parent could move on to the next activity and then poll the place that stores the results at the end for the merging. However there would be a lot of overhead involved in this, so you'd have to try it to see if it's any faster. There is a local database (the staging database) in Cast Iron that may be faster than an external results store too.
    Thank you very much. Unfortunately thats what i thought the answer would be; i was however hoping you were going to give me some revolutionary new method that no-one had told me about.

    Thanks for your quick response.