Information icon IBM InfoSphere DataStage and InfoSphere QualityStage, Version 8.5
space Feedback

Continuous funnel example

the example data comprises four separate data sets. Each data set contains a list of GlobalCo customers from a particular country. Here is a sample of the data for the US customers:

"JEREMY BUEHM","","GC13849","GlobalCoUS"
"3M","2807 PAYSPHERE CIRCLE","GC13933","GlobalCoUS"
"FOXWOOD APARTMENT","1701 HAMILTON AVE","GC14036","GlobalCoUS"
"PITNEY WORKS","PO BOX 85042","GC14127","GlobalCoUS"
"BRENDA GRIGG","HSI MCKINNEY WATER & SEWER #77","GC14263","GlobalCoUS"
"ROZAK EXCAVATING & CONST INC","PO BOX 710","GC14346","GlobalCoUS"
"MACEDONIA BAPTIST CHURCH","4656 PAGE RD","GC14428","GlobalCoUS"
"WORSHAM SPRINKLER **BAD DEBT**","3931-C GARWOOD AVE","GC14497","GlobalCoUS"
"WORSHAM SPRINKLER***BAD DEBT**","119 SLATE STONE DR","GC14572","GlobalCoUS"
"BINGLEMAN RESIDENCE","248 SPRINGLINE DRIVE","GC14653","GlobalCoUS"
"MOON EXCAVATING","3895 TAMPA RD.","GC14728","GlobalCoUS"
"TROPICANA NORTH AMERICA","6500 GLADES CUT OFF RD","GC14801","GlobalCoUS"
"ELECTRICAL SPECIALISTS CASH","PO BOX 2649","GC14874","GlobalCoUS"
"SEARS ROEBUCK & CO","100 GREENSPOINT MALL","GC14927","GlobalCoUS"
"MALL @ MILLENIA (#10289)","SE COR-MILLENIA BLVD & CONROY ","GC15005","GlobalCoUS"
"DIVISION ST-GORE TO WASHINGTON","DIVISION ST BETWEEN GORE & WAS","GC15094","GlobalCoUS"
"PEACHTREE LANDING APTS","LL27 9TH DIST","GC15180","GlobalCoUS"
"SW BELL TELEPHONE","PO BOX 4699","GC15248","GlobalCoUS"

The Funnel stage, when set to continuous funnel, will combine these into a single data set. The job to perform the funnel is as follows:

Shows the example funnel job taking data from seven input data sets

The continuous funnel method is selected on the Stage page Properties tab of the Funnel stage:

The continuous funnel method does not attempt to impose any order on the data it is processing. It simply writes rows as they become available on the input links. In the example the stage has written a row from each input link in turn. A sample of the final, funneled, data is as follows:

"VALUE TOOL REPAIR","4345 OKEECHOBEE BLVD STE F2","GC17697","GlobalCoUS"
"CHAPPEL HILL WSC MAIN STREET","PO BOX 215","GC17712","GlobalCoUS"
"ROBERT WILLIAMS","3615","GC17728","GlobalCoUS"
"USC TICKET OFFICE","REX ENRIGHT CENTER","GC17742","GlobalCoUS"
"STASCO INC","PO BOX 3087","GC17760","GlobalCoUS"
"VASCO BRANDS INC","PO BOX 4040","GC17786","GlobalCoUS"
"ROYAL ST WW IMPROVEMENTS*DO NO","4103 RIVER OAKS DR","GC17798","GlobalCoUS"
"KAY ROSE INC **CASH SALES**","PO BOX 617","GC17808","GlobalCoUS"
"Novatec sa","Bp 28","GC20002","GlobalCoFR"
"Casio - Esselte ","Route De Nozay","GC20012","GlobalCoFR"
"Citélis ","137 Rue Voltaire","GC20021","GlobalCoFR"
"DECATHLON ","3 Rue De La Nouvelle France","GC20032","GlobalCoFR"
"BNP : Banque Nationale de Pari","Sdap","GC20040","GlobalCoFR"
",Acton - Visserie Boulonnerie","Domaine De Voluceau","GC20049","GlobalCoFR"
"SKF France ","5 Rue Noël Pons","GC20059","GlobalCoFR"
"Admiral ","2 Rue Auguste Comte","GC20067","GlobalCoFR"
"Borland ","1 Avenue Newton","GC20076","GlobalCoFR"

PDFThis topic is also in the IBM InfoSphere DataStage and QualityStage Parallel Job Developer's Guide.

Update timestamp Last updated: 2012-10-8