IBM Integration Bus, Version 9.0.0.8 Operating Systems: AIX, HP-Itanium, Linux, Solaris, Windows, z/OS

See information about the latest product version

IBM Sterling Connect:Direct overview and concepts

An overview of IBM® Sterling Connect:Direct® and its terminology when used with IBM Integration Bus.

IBM Sterling Connect:Direct is a managed file transfer product that transfers files between, and within, enterprises.

IBM Sterling Connect:Direct, in conjunction with IBM Integration Bus uses the following terminology:
Connect:Direct server
An application that runs on a machine requiring IBM Sterling Connect:Direct functionality. Files are transferred between two Connect:Direct servers.
  • The primary Connect:Direct server, also referred to as the PNODE.
  • The secondary Connect:Direct server, also referred to as the SNODE, that receives the transferred file and places the file on the local file system.
Connect:Direct-S

Connect:Direct server which transfers files to other Connect:Direct servers.

Connect:Direct-R

Connect:Direct application that connects to a Connect:Direct server and requests that server does some form of processing. IBM Integration Bus acts as a Connect:Direct-R to request transfers or receive information about transfers.

IBM Integration Bus CDInput node

Use the IBM Integration Bus CDInput node to receive messages that have been transferred to a given Connect:Direct server.

If two or more input nodes are deployed to listen on the same Connect:Direct server, only one receives the file and which one that is cannot be determined. There is some distribution between the nodes, and this is equivalent to having two or more MQInput nodes listening on the same queue.

CDInput nodes can be used in different flows, and in different integration servers, against the same Connect:Direct server.

You can configure the CDInput node to process only a subset of files transferred to the server, based on the directory name and the file name. This allows for multiple CDInput nodes within the same integration server to receive specific files, depending on the filters used.

See IBM Sterling Connect:Direct concepts for further information on the CDInput node, CDOutput node, and Connect:Direct server.

IBM Integration Bus CDOutput node

Use the IBM Integration Bus CDOutput node to serialize the message tree to a file and then transfer it to a secondary Connect:Direct server using a primary Connect:Direct server. A directory under the work path within the integration server is used as the staging area, until the file is ready to be transferred. Once the file is transferred, it is deleted from the staging area.

Initparm

The definition of the startup parameters for the primary Connect:Direct server (PNODE) and secondary Connect:Direct server (SNODE).

Netmap

The definition of a connection between the primary and secondary Connect:Direct servers.

Processname

The name given to a process that is run in IBM Sterling Connect:Direct. More than one process can be given the same name, and each process is identified uniquely using the process number.

Note that IBM Integration Bus nodes work purely as clients connecting to the external Connect:Direct server, using the IBM Sterling Connect:Direct Java™ Application Interface.

By default, IBM Integration Bus attempts to connect to a local Connect:Direct server, on the default port:

To enable the CDOutput and CDInput nodes to connect to the local Connect:Direct server, you must set up a username and password using the mqsisetdbparms command.

IBM Sterling Connect:Direct concepts

The CDInput node receives messages that have been transferred to a given Connect:Direct server.

The node receives both the contents of the file and meta data provided by IBM Sterling Connect:Direct on the transfer. One or more CDInput nodes can be used to receive transfers, either in the same flow, different flows, or different integration servers; for any given transfer only one CDInput node receives a message.

You can also specify which transfer a CDInput node can receive, using filters based on directory and file name of the transfer. Once the transfer has been processed there are a set of options of what to do with the transferred file; for further details see CDInput node.

A simple flow that takes all transferred files from a Connect:Direct server and writes them to a WebSphere® MQ queue could contain a CDInput node and an MQOutput node.

Once the CDInput node has been notified of a file to be processed, it processes the file in the same way that a normal FileInput node does. The CDInput node is notified by the Connect:Direct server manager when a transfer occurs. The notification message is persistently stored on WebSphere MQ and survives broker and queue manager restarts.

The Connect:Direct server manager is defined and runs using a configurable service called CDServer. This configurable service is used for administering the access, and processing files using IBM Sterling Connect:Direct.

For more details on the CDServer configurable service, see CDServer configurable service

Two WebSphere MQ queues are used to store transfer details from the Connect:Direct server:
  • SYSTEM.BROKER.CD.STATS
  • SYSTEM.BROKER.CD.TRANSFERS
For each successful transfer to the Connect:Direct server, a message is placed on the TRANSFERS queue, which is used to trigger the CDInput node to process the file.

The STATS queue contains internal data used by IBM Integration Bus to record which transfers have been processed by IBM Integration Bus.

Clearing both sets of these queues causes all transfers that have occurred up to the current time to be ignored; there is no need, for example, for a restart.

The input node does not poll for transfers, but is triggered instead when they arrive. However, the Connect:Direct server manager does need to poll for events to notify the CDInput node about a transfer. The Connect:Direct server manager has a polling interval of one second.

The CDInput and CDOutput nodes go through the Connect:Direct server manager to both send and receive transfers from a given server, the name of which is set on the node. The Connect:Direct server manager properties are defined using a CDServer configurable service.

The Connect:Direct server manager organizes:
  • Monitoring the Connect:Direct server for transfers which need to be processed by the CDInput nodes.
  • Sending commands created by the CDOutput node to the Connect:Direct server to perform transfers.
In both cases, the Connect:Direct server manager can be used to configure the directory structure to a shared file system, used to both send and receive files from the Connect:Direct server.

The high-level structure of the directory might be different on the two different machines and you can define properties on the Connect:Direct server manager to give the correct mapping.

See Advanced configuration properties when using IBM Sterling Connect:Direct nodes for further information.

The Default configurable service connects to the Connect:Direct server on the local host using the default port. You can modify the default configurable service to a more complex configuration with the CD server on different ports, or a different machine, or change the node to use a completely different configurable service which is set up to use a different port and hostname.

As well as defining connections details, you can also configure other key properties, such as the location of staging directories and mapping between directories on different machines.

See Advanced configuration properties when using IBM Sterling Connect:Direct nodes for further information.

The Connect:Direct server manager is started and stopped by the CDInput and CDOutput nodes as required and is not an artifact that is deployed or seen in the deployment view; all of its function is defined by the properties in the configurable service. If transfers happen while IBM Integration Bus is stopped (or IBM Sterling Connect:Direct flows are stopped) they are not missed and are processed as soon as the flows restart. All transfers are persistent and survive both broker and queue manager restarts.

The configurable service security identity must have adequate permission for the Connect:Direct server manager within the execution group to detect all transfers that are sent to the Connect:Direct server. For example: On UNIX systems, the user's stanza within the userfile.cfg in Connect:Direct must have :cmd.selstats=A:\. This property can either be set explicitly, or inherited from the higher-level property :admin.auth=y:\. If this permission is not present, then the CDInput nodes do not detect or process files that were transferred by other users. For more information about the security identifier, see "securityIdentifier" in CDServer configurable service.

The integration node makes a number of API connections to the local Connect:Direct server to process inbound transfers, and to request outbound transfers.

The integration node creates one API connection per configurable service per integration server. This connection enables CDInput nodes to process files sent to the local Connect:Direct server. If there are multiple configurable services that relate to the same Connect:Direct server, then multiple API connections are established.

In addition to these connections, each message flow instance that uses a CDOutput node also creates an API connection to submit transfer requests to the Connect:Direct server. Where there are multiple flows that contain CDOutput nodes, or where these flows have extra defined instances, the integration node creates multiple API connections. If the number of API connections that are required exceeds the maximum that is configured in the Connect:Direct server, then the connection fails causing a BIP7951E exception, containing the following information: "Error: Logon failed! Attempted to exceed maximum API connections". Avoid this error by increasing the maximum client connections for the Connect:Direct server. The maximum number of connections that are accepted by a Connect:Direct server on UNIX is controlled by the api.max.connects parameter. For more information about this parameter, and the equivalent settings on other operating systems, see the IBM Sterling Connect:Direct product documentation: http://www.ibm.com/support/knowledgecenter/SS4PJT_5.2.0/cd_52_welcome.html.


bc14040_.htm | Last updated Friday, 21 July 2017