IBM Sterling B2B Integrator provides out-of-box service and adapters to cater most of B2B business needs, but sometimes it may happen that business requirements could not be achieved using out-of-box services and there arises a need to develop custom services.

Thanks to Kishore, Senior Solution Architect, to help us understand alternative way to develop custom service using Apache Maven. You can find link to that article at the end.

 

In scenarios where update to custom service is required, whether it can be the case while developing it or to cater change in customer's requirement or it can be a case where custom service code needs to re-compile with lower or higher version of java, you should delete existing custom service from SI before deploying the updated one.

Please find following steps to delete custom service  -

 

SI Dashboard cleanup -

Delete all instances of custom service from SI dashboard -

Development --> Services --> Configuration

 

File System Cleanup -

1. Remove entries of custom service from - install_dir\properties\dynamicclasspath.cfg and dynamicclasspath.cfg.in

2. Delete - install_dir\properties\lang\en\ Custom_Service_Name _en.properties

3. Delete - install_dir\properties\services\ Custom_Service_Name.xml

4. Delete - install_dir\installed_data\ Custom_Service directory

5. Delete - install_dir\jar\ Custom_Service directory

6. If any file/directory apart from ones mentioned above is present in install_dir, you should grep it with Custom_Service_Name and delete that object too.

 

Database Cleanup -

Execute following query in SQL manager -

 

select * from service_def where def_lookup_name like '%com.ibm.custom%'

 

(Highlighted text is package name under which custom service class resides, use appropriate string as per your implementation)

Note down the "DEF_ID" pertaining to custom service from result of the above query.

Provide this “DEF_ID” in following queries -

 

select * from service_def_guid where current_id = DEF_ID

select * from service_def_parms where def_id = DEF_ID

 

If above queries yield any result then it means there are some instances of custom service in DB, you should delete these instances too.

- delete from service_def_guid where current_id = DEF_ID

- delete from service_def_parms where def_id = DEF_ID

- delete from service_def where def_id = DEF_ID

- commit

 

This completes deletion of custom service from SI.

 

Link to develop custom service using Maven –

https://www.ibm.com/developerworks/community/blogs/583fdb3f-6645-481a-8370-2ec289aaa752/entry/Missing_MESA_for_custom_service_adapter_development_Try_Apache_Maven?lang=en

 

Happy customization

 

Note : It is always better to take backup of the objects before deleting them.

1.If you are upgrading SI with inplace upgrade then existing SI system passphrase is required to make installation success.

2.System passphrase is embeded in security.properties if it is encrypted it will get added in to system_overrides.properties as below　

security.enc_pass=rO0ABXQABkRFU2VkZXVyAAJbQqzzF/gGCFTgAgAAeHAAAAAI63oV/E/SQpFzcgARamF2YS5sYW5nLkludGVnZXIS4qCk94GHOAIAAUkABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAZXVxAH4AAQAAABDd7qLtu/7cVgg0xJSYii0B
 

3.Since it is encrypted mode, it needs to be decrypted from <si_install>/bin using decryp_string.cmd

4.Here is the sample command

decryp_string.cmd OBSCURED:rO0ABXQABkRFU2VkZXVyAAJbQqzzF/gGCFTgAgAAeHAAAAAI63oV/E/SQpFzcgARamF2YS5sYW5nLkludGVnZXIS4qCk94GHOAIAAUkABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAZXVxAH4AAQAAABDd7qLtu/7cVgg0xJSYii0B
 

5.Decrypted string is

Decrypted string is:
password

 

Note:OBSCURED to be added .

Here is the Sample window

C:\>cd SI_5263\install\bin

C:\SI_5263\install\bin>decrypt_string.cmd OBSCURED:rO0ABXQABkRFU2VkZXVyAAJbQqzzF
/gGCFTgAgAAeHAAAAAI63oV/E/SQpFzcgARamF2YS5sYW5nLkludGVnZXIS4qCk94GHOAIAAUkABXZhb
HVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAZXVxAH4AAQAAABDd7qLtu/7cVgg0x
JSYii0B

C:\SI_5263\install\bin>off
'off' is not recognized as an internal or external command,
operable program or batch file.

C:\SI_5263\install\bin>REM #####################################################
###################

C:\SI_5263\install\bin>REM Licensed Materials - Property of IBM

C:\SI_5263\install\bin>REM

C:\SI_5263\install\bin>REM (C) Copyright IBM Corp. 2007, 2011 All Rights Reserve
d.

C:\SI_5263\install\bin>REM

C:\SI_5263\install\bin>REM US Government Users Restricted Rights - Use, duplicat
ion or disclosure

C:\SI_5263\install\bin>REM restricted by GSA ADP Schedule Contract with IBM Corp
.

C:\SI_5263\install\bin>REM #####################################################
###################
Controller loading lists...

 

Decrypted string is:
password
C:\SI_5263\install\bin>

 

IBM Global Mailbox, an add-on of IBM File Gateway helps companies address demands for high availability operations and redundancy with a robust and reliable data storage solution available across geographically distributed locations. IBM Software services may be engaged to implement the IBM Global Mailbox.

IBM Global Mailbox v6.0.1 is shipped with a lesser known yet powerful invaluable tool known as healthcheckUtility. healthcheckUtility can be used time and time again for monitoring the Global Mailbox components. The capabilities of healthcheckUtility when used with the global load balancer probes, helps in determining the availability of Global Mailbox components that will directly impact the availability of protocol actions. The components monitored by healthcheckUtility are
- Apache Cassandra
- Apache Zookeeper
- Storage Mount
- Message Queue
- Event consuming application

The healthcheckUtility can be used in three different ways.
 

1.) Run manually:
The health of the Global Mailbox components can be monitored by running the following command manually:
./healthCheckUtility.sh check --appName=<app name> --interval=<seconds>
Where,
--appName: Name of the application must be B2Bi. This is a mandatory parameter.
--interval: Specifies how often to run the health checks. The default is 5 seconds.
This command starts a thread to check the health of Cassandra, ZooKeeper, shared storage, and Global Mailbox for the local data center. The command is run at the specified interval, and the status of each component is displayed on the console. The tool stays running in the foreground until the user types q or CTRL+C. The checks are done by directly testing each component. 

 

2.) Run using job schedulers:
A custom wrapper program can be developed using the above out-of-box script to monitor and alert in case of failures. The custom program can be scheduled to run automatically in the background without human intervention using job schedulers. [This topic is out of the scope for this article]

 

3.) Load Balancer health checks:
A datacenter is considered to be available if a trading partner can do both the following operations
- Authentication and
- File upload / download
If one or more Global Mailbox components are down then one or more operations may fail. If one or more operations fail then the datacenter is considered as unavailable. 
 

A load balancer is implemented to mark the datacenter as available or unavailable. The load balancer should execute arbitrary instructions as part of the health check to determine the availability of a datacenter. The return status from the arbitrary instructions will be used to determine success or failure. Following is a two-step procedure to setup the load balancer to mark the datacenter as available or unavailable.

3.1) Create a special file using healthcheckUtility

./healthCheckUtility.sh createMsg --appName=<app name> --extractUser=<user name> --mailboxName=<mailbox name> --messageName=<message name>
Where,
--appName: Name of the application must be B2Bi. This is a mandatory parameter.
--extractUser: Name of the application user that will be used to extract the health check file. This is a mandatory parameter. The --extractUser must have a valid B2Bi user. The validity of the user is not verified by the tool. The user must be a user that is specifically created for health check and must not have a virtual root assigned, because a virtual root is created when the script is run. The user has permissions to only get the health check messages from the health check mailbox. The user and the password must be configured on the load balancer on the health check file download request (Refer Section 2.2).
--mailboxName: Name of the mailbox that will contain the health check message. This is a mandatory parameter.
--messageName: Name of the health check message. This is a mandatory parameter.
A virtual root is created for the user that is specified for --extractUser under the reserved system mailbox (/.IBM) in the <app-id>/<user-name> format. If the user has a virtual root but is not ./IBM/<app-id>/<user-name>, the user is rejected.
Note: This is a one-time activity.

3.2) Periodically, execute the following arbitrary instructions (aka external checks) in the load balancer.

Let’s break this down:

• Capture the backend host and port
• Download the healthcheck file created in Section 2.1 using SFTP Get
• If the return status is “0” then the SFTP backend is marked as available
• If the return status is “1” then the SFTP backend is marked as unavailable

Note: The above instructions were written using native Linux shell scripting for HAProxy. It is a very basic script and it is only for representational purposes. You are free to use your own choice of language. You can customize the instructions and make it a fully functional script depending on the need, depending on the backend and depending on the capabilities of the load balancer.

Example:

The following statistics report depicts a four datacenter on HAProxy load balancer. If all the Global Mailbox components are active then the download request will be successful. The return status is “0” from the script as a result, load balancer marks all the datacenters as available.

 

The following statistics report depicts a four datacenter on HAProxy load balancer. If two out of three Cassandra nodes are down in DC3 datacenter then the download request will fail. The return status is “1” from the script as a result, load balancer marks DC3 datacenter as unavailable and will not route any traffic to DC3.

 

Note:

- The healthcheckUtility in Global Mailbox is not same as the healthcheck utility in B2Bi.

- HAProxy is not an IBM product.

References:

https://www.ibm.com/support/knowledgecenter/en/SS3JSW_6.0.1/reference/reference/globalmailbox/gdha_healthcheckUtility.html

Disclaimer:

Please do not cite, circulate, or copy without permission of the author. The views expressed are solely my own and this article do not express the views or opinions of my employer. Neither myself nor IBM recommend any approach or tools mentioned in the article. I shall not be accountable for and does not accept any liability or responsibility whatsoever for any inaccuracies, omissions, errors, misleading information, loss or damage howsoever arising (including without limitation, incidental, punitive, exemplary, special or consequential damages, loss of profit or damages resulting from lost data or business interruption), be it by negligence or otherwise, or expense resulting from:-
                        - Using the information and contents of this article whether with or without authorization;
                        - Relying on the information and contents of this article, whether downloaded or not;
                        - The performance, operation, functionality, non performance, unavailability, inaccessibility, or corruption of this article;
                        - Refer vendor specific documentation for any kind of latest information;

Overview

Have you ever been stumped by a complex business process logic that you couldn't solve with the IBM Sterling B2B Integrator out-of-box services or adapters alone? Take, for example, a simple Universally Unique ID generation,  a complex MQRFH2 parser and so on. Unfortunately, you cannot complete this task with only out-of-box services or adapters. In a situation such as this, you can simplify your business process code and solve the problem faster with a Java extension. 

As we come across more and more of this kind of scenarios in a day-to-day business process development, the necessity of java becomes more and more obvious. This article provides a glimpse of the various options that are available for a developer/architect to extend business processes with java. 

Options

Developers have the following five options to extend business processes - if the out-of-box services or adapters doesn't solve the problem.

1.) Custom Service / Adapter

2.) Java Task Service

3.) User Exits in Map

4.) XSLT Service / Java

5.) CLA2 Adapter / Java

 

Now, which is the correct option to         

solve the problem?

                           

 

 

 

 

 

 

 

 

 

1.) Custom Service / Adapter

MESA Developer Studio Software Development Kit (SDK) provides the tightest integration with Sterling B2B Integrator and enables you to create complex and complete services and adapters. These services use the same APIs as the services included with Sterling B2B Integrator, so all of the benefits and infrastructure of Sterling B2B Integrator are available. This flexibility and tight integration means that creating a service is more advanced and requires good knowledge of Java development, Sterling B2B Integrator APIs, and the APIs of any system that will be accessed by the service.

The MESA Developer Studio SDK helps you create and edit custom services and adapters using the Eclipse development environment. The MESA Developer Studio SDK is designed as an Eclipse plug-in and is installed locally on your computer. Use the SDK to create a service, build and export a service package within the Eclipse development environment, then install and test it with IBM Sterling B2B Integrator.

Pros:

- No known performance issues if the custom service / adapters is coded optimally.

- Runtime custom service / adapter is free from accidental code changes.

- No need of any additional skills apart from IBM Sterling B2B Integrator and Java.

- Can play-around with process data values.

Cons:

- Long development / deployment / testing cycle times.

- SBI application should be restarted for every code deployment / change.

- Need to code using an external editor like eclipse.

2.) Java Task Service

The Java Task service executes java code in Sterling B2B Integrator. It eliminates the need to create a custom service.

To execute the source code place import statements at the top followed by any set of standard java code you want to call. There are two classes automatically available to you, one called wfc (which is an instance of the workflow context of the current process), and one called log (which is an instance of the XLogger). There must be a return of a string included in the code fragment. This string will go to the log.

Pros:

- Easy to invoke java code

- Can code using any editor(service configuration parameters in GPM or any text editors).

- Short development / deployment / testing cycle times.

- No need to restart application for any kind of deployments.

- No need of any additional skills apart from IBM Sterling B2B Integrator and Java.

- Can play-around with process data values.

Cons:

- Compiles whenever it runs.

- Code is not free from accidental code changes as the deployed code is a .java source file rather than .class files.

- No automated scripts to deploy the code if the srcLocationMode is File. The java source(.java) should be placed on the file system.

 

3.) User Exits in Map

User exits perform functions that the translator does not perform during typical translation. For example, user exits can:

                - Access a database table to perform cross-references or lookups.

                - Perform complex pricing calculations that enable different prices to be calculated for multiple customers, where the seller is located, or where the product is sold.

User exits are extended rules that enable Java objects to be created and accessed. With user exits you can create custom Java classes or use third-party Java classes. User exits can create objects, access properties, or start methods.

Note: Extended rules cannot compare property or method results because property and method types are unknown prior to compilation. Also, extended rules cannot catch Java exceptions and Java methods called by extended rules cannot throw exceptions. To handle an exception, you must create a user exit containing a wrapper class that calls the real class and handles the exception.

Pros:

- Development can be done using the out-of-box Map Editor.

- Can access process data values.

Cons:

- The Map Editor does not inspect Java classes to verify the correctness of method and property names during map compilation.

- The java class needs a constructor with a string argument.

- Application restart might be required if the rules depends on the third party jar files.

- Long development / deployment / testing cycle times if the rules depends on the third party jar files.

- Requires additional mapping skills apart from Java.

4.) XSLT Service / Java

XSLT Service enables you to use XSLT style sheets in IBM Sterling B2B Integrator. In today's world - most XSLT processors written in Java also let you go the other way, integrating Java code with XSLT stylesheets.

For example, although you can do complicated string searching and replacing in XSLT, but it will be about a thousand times easier in Java, especially with a good regular expression library. Same as the case with mathematical functions like factorial and fibonacci. XSLT optimizers are not nearly as mature or as reliable as Java optimizers, and those that do exist mostly focus on optimizing XPath search and evaluation on node-sets rather than mathematical operations on numbers.

So, most of the logic can be easily written by using the power of java along with XSLT in IBM Sterling B2B Integrator though XSLT by itself doesn't provide all the required functionality.

Pros:

- Can play-around with process data easily.

- Very useful when there is a need to invoke simple static / instance methods.

Cons:

- Long development / deployment / testing cycle times if the rules depends on the external jar files.

- Requires additional XSLT skills apart from Java / IBM Sterling B2B Integrator.

- Application restart might be required if the logic depends on the third party jar files.

- Due to the nature of XSLT processing in IBM Sterling B2B Integrator there could be a possibility of performance issues.

5.) CLA2 Adapter / Java

The CLA2 / Command Line Adapter 2 is a second generation adapter that enables Sterling B2B Integrator to run a program from a command line in a business process.

The Command Line Adapter 2 operates in a remote implementation only. This does not necessarily mean that it has to run remotely. It runs in a separate JVM (Java Virtual Machine), which may be on the machine where Sterling B2B Integrator is installed or on a remote machine.

This option is considered to be a loosely coupled option - as the java code executed using CLA2 adapter can't access process data except document.

Pros:

- Java code runs in a separate JVM by providing better performance.

- Can develop and unit test using external editors like eclipse.

- Short development / deployment / unit testing cycle times.

- Runtime code is free from accidental code changes as the deployed code is a class file.

Cons:

- Java code can't retrieve values from the ProcessData / Instance Data area.

- Java code can't pass values to the ProcessData / Instance Data area.

- No automated tools to deploy the code.

 

Summary

More the options - more the headache but, here all the options carry equal weight-age depending on the type of the requirement. So, the developer / technical architect should take a decision considering the nature of the problem to be solved, and the overall performance impact.

References

1.) Custom Service / Adapter: http://pic.dhe.ibm.com/infocenter/sb2bi/v5r2/index.jsp?topic=%2Fcom.ibm.help.mesa_studio.doc%2FSI_MESACreateCustomServices.html

2.) Java Task Service: http://pic.dhe.ibm.com/infocenter/sb2bi/v5r2/index.jsp?topic=%2Fcom.ibm.help.svcs_adpts_a_l.doc%2FJava_Task_svc.html

3.) User Exits: http://pic.dhe.ibm.com/infocenter/sb2bi/v5r2/index.jsp?topic=%2Fcom.ibm.help.stds804_map_editor.doc%2Fr_STDS_ME_UserExits.html

4.) XSLT Service:

http://pic.dhe.ibm.com/infocenter/sb2bi/v5r2/topic/com.ibm.help.svcs_adpts_m_z.doc/XSLT_svc.html

http://xml.apache.org/xalan-j/extensions.html

5.) CLA2 Adapter:

http://pic.dhe.ibm.com/infocenter/sb2bi/v5r2/index.jsp?topic=%2Fcom.ibm.help.svcs_adpts_a_l.doc%2FCommand_Line_adapter_2.html

 

Disclaimer:

Please do not cite, circulate, or copy without permission of the author. The views expressed are solely my own and do not express the views or opinions of my employer. I shall not be accountable for and does not accept any liability or responsibility whatsoever for any inaccuracies, omissions, errors, misleading information, loss or damage howsoever arising (including without limitation, incidental, punitive, exemplary, special or consequential damages, loss of profit or damages resulting from lost data or business interruption), be it by negligence or otherwise, or expense resulting from:-

                        - Using the information and contents of this article whether with or without authorization;

                        - Relying on the information and contents of this article, whether downloaded or not;

                        - The performance, operation, functionality, non performance, unavailability, inaccessibility, or corruption of this article;

                        - Communicating with us or transmitting instructions to us over the internet via this website.

 

The goal of benchmarking is to understand the performance capabilities and limitations of solution built using IBM SFG. Increase in the number of partners/transactions will lead to increase in file volumes as a result benchmark results will have a short shelf-life - this is a domino effect. So, benchmarks needs to be determined on a regular basis to estimate the capacity requirements for the anticipated volumes. Considering this regular activity which is required for a high performance IBM SFG solution - it is important to setup a reusable benchmarking methodology to save time and cost in executing the benchmark tests.

Remember, there are many ways to improve performance of IBM SFG solution – so, nothing to worry by looking at performance numbers. IBM Software Services may be engaged for tuning, improving the performance and optimizing the solution design.

Now, for a very simple “Inbound FTP test case” scenario - let’s see how to artfully capture performance numbers while benchmarking IBM SFG solution using Apache JMeter. Apache JMeter is an open source testing tool which has ability to load and measure IBM SFG solution performance.

 

1.) Prerequisites

• IBM Sterling File Gateway v 2.2.6.3
• Apache JMeter v 3.2
• Apache JMeter Plugin – PerfMon, Graphs Generator, Server Agent

 

2.) SFG setup

 

      2.1) Configure FTP Server Adapter

      2.2) Create a producer, consumer partner

      2.3) Create a static routing channel template

      2.4) Create a routing channel

 

3.) JMeter setup

 

       3.1) Create a test plan as below

 

       3.2) Create a thread group as below

       3.3) Add and configure FTP Request Send sampler as below

       3.4) Add and configure CSV Data Set Config

       3.5) Add and configure following listeners

 

4.) View results (after running the test)

 

       4.1) Summary Report

 

       4.2) Bytes Throughput Over Time

       4.3) Hits per second

 

        4.4) Latencies Over Time 

       4.5) Transactions Per Second

      4.6) Response Times Over Time

      4.7) Health of SFG Server

 

Stay Tuned

Now you know the basics of measuring the FTP put performance. Your initial performance numbers can be improved greatly by tuning IBM SFG solution and re-benchmarking to validate the tuning parameters.

We will go deeper into Advanced benchmarking / testing / measuring techniques in future blog posts.

 

Note: For heavy test scenarios run JMeter in non GUI/command line mode or as recommended by Apache JMeter. It is not mandatory to use Apache JMeter for benchmarking IBM SFG solution - there are many testing tools available in the market which can be chosen depending on the convenience and enterprise’s testing methodologies.

 

Disclaimer

Please do not cite, circulate, or copy without permission of the author. The views expressed are solely my own and this article do not express the views or opinions of my employer. Neither myself nor IBM recommend any approach or tools mentioned in the article. I shall not be accountable for and does not accept any liability or responsibility whatsoever for any inaccuracies, omissions, errors, misleading information, loss or damage howsoever arising (including without limitation, incidental, punitive, exemplary, special or consequential damages, loss of profit or damages resulting from lost data or business interruption), be it by negligence or otherwise, or expense resulting from:-
                        - Using the information and contents of this article whether with or without authorization;
                        - Relying on the information and contents of this article, whether downloaded or not;
                        - The performance, operation, functionality, non performance, unavailability, inaccessibility, or corruption of this article;
                        - Refer vendor specific documentation for any kind of latest information;

 

1.Go to XSLT,search for ediintErrorNotif and Edit

2.Add below content is updated for Email Notification.

<!--Updated on 19-July-2017 -->
<!-- Errorcode & ErrorReasonCode -->
Error Code:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseStatusCode/text()"/>
<xsl:text>
ErrorDescription:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseReasonPhrase/text()"/>
<xsl:text>

3.---Here is my XSLT content for your reference----------------

<?xml version="1.0" encoding="ISO-8859-1"?>
<xsl:stylesheet version="1.0" xmlnssl="http://www.w3.org/1999/XSL/Transform">
<xsl:output method="text" version="1.0" encoding="UTF-8" indent="yes" />
<xsl:template match="/">
<xsl:text>EDIINT Email Error Notification
Unable to send or process message, check the error directory and logs for details.
</xsl:text>

<xsl:text>
AS2 Identifier:     </xsl:text><xsl:value-of select="/ProcessData/partnerID/ID/PART_AS2_ID/text()"/>
<xsl:text>

Partner ID:         </xsl:text><xsl:value-of select="/ProcessData/partnerID/ID/PARTNER_PROFILE_ID/text()"/>
<xsl:text>

B2B Contract ID:    </xsl:text><xsl:value-of select="/ProcessData/b2b-contract-id/text()"/>
<xsl:text>

File Name: </xsl:text>
<xsl:if test="/ProcessData/FileName">
<xsl:value-of select="/ProcessData/FileName/text()"/>
</xsl:if>
<xsl:if test="/ProcessData/ExtractBeginResults1/MessageName">
<xsl:value-of select="/ProcessData/ExtractBeginResults1/MessageName/text()"/>
</xsl:if>

<xsl:text>

Error Directory:    </xsl:text><xsl:value-of select="/ProcessData/ErrorDir/text()"/>
<xsl:text>

Profile ID:         </xsl:text><xsl:value-of select="/ProcessData/b2b-profile-id/text()"/>
<xsl:text>

Message ID:         </xsl:text><xsl:value-of select="/ProcessData/ACSMessageID/text()"/>
<xsl:text>

URL:                </xsl:text><xsl:value-of select="/ProcessData/URL/text()"/>
<xsl:text>

Attempt Number:     </xsl:text><xsl:value-of select="/ProcessData/totalRetries/text()"/>
<xsl:text>

Total Attempts:     </xsl:text><xsl:value-of select="/ProcessData/MaxRetries/text()"/>
<xsl:text>

Sending Process:    </xsl:text><xsl:value-of select="/ProcessData/SendingWorkflowID/text()"/>
<xsl:text>

Time:               </xsl:text><xsl:value-of select="/ProcessData/time/text()"/>
<xsl:text>
<!--Updated on 19-July-2017 -->
<!-- Errorcode & ErrorReasonCode -->
Error Code:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseStatusCode/text()"/>
<xsl:text>
ErrorDescription:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseReasonPhrase/text()"/>
<xsl:text>
</xsl:text>
<xsl:value-of select="/ProcessData/ErrorInfo/text()"/>

</xsl:template>
</xsl:stylesheet>

 

4.After AS2 communication failure as an email.

EDIINT Email Error Notification
Unable to send or process message, check the error directory and logs for details.

AS2 Identifier:     20000_IDENTITY_ORG_IDENTIFIER

Partner ID:         849a81a:15c0b873803:5cb

B2B Contract ID:    849a81a:15c0b873803:644

File Name: sandbox.cfg

Error Directory:    /xxxxxx/install/as2partner/52100_IDENTITY_ORG/20000_IDENTITY_PART/error

Profile ID:         849a81a:15c0b873803:5cb

Message ID:         <MOKOtiublrboapp100clone-node1-15d553107c2-1077418521000IDENTITY0ORG0IDENTIFIER@xxxxx.in.ibm.com>

URL:                http://xxxxxxx:20035/as2

Attempt Number:     2

Total Attempts:     5

Sending Process:    995505

Time:               2017.07.19 AD 02:59:52 IST

Error Code:          404
ErrorDescription:        Not Found

1.Go to XSLT,search for ediintErrorNotif and Edit

Deployment-->XSLT

2.Add below content is updated for Email Notification.

<!--Updated on 19-July-2017 -->
<!-- Errorcode & ErrorReasonCode -->
Error Code:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseStatusCode/text()"/>
<xsl:text>
ErrorDescription:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseReasonPhrase/text()"/>
<xsl:text>

3.---Here is my XSLT content for your reference----------------

<?xml version="1.0" encoding="ISO-8859-1"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
<xsl:output method="text" version="1.0" encoding="UTF-8" indent="yes" />
<xsl:template match="/">
<xsl:text>EDIINT Email Error Notification
Unable to send or process message, check the error directory and logs for details.
</xsl:text>

<xsl:text>
AS2 Identifier:     </xsl:text><xsl:value-of select="/ProcessData/partnerID/ID/PART_AS2_ID/text()"/>
<xsl:text>

Partner ID:         </xsl:text><xsl:value-of select="/ProcessData/partnerID/ID/PARTNER_PROFILE_ID/text()"/>
<xsl:text>

B2B Contract ID:    </xsl:text><xsl:value-of select="/ProcessData/b2b-contract-id/text()"/>
<xsl:text>

File Name: </xsl:text>
<xsl:if test="/ProcessData/FileName">
<xsl:value-of select="/ProcessData/FileName/text()"/>
</xsl:if>
<xsl:if test="/ProcessData/ExtractBeginResults1/MessageName">
<xsl:value-of select="/ProcessData/ExtractBeginResults1/MessageName/text()"/>
</xsl:if>

<xsl:text>

Error Directory:    </xsl:text><xsl:value-of select="/ProcessData/ErrorDir/text()"/>
<xsl:text>

Profile ID:         </xsl:text><xsl:value-of select="/ProcessData/b2b-profile-id/text()"/>
<xsl:text>

Message ID:         </xsl:text><xsl:value-of select="/ProcessData/ACSMessageID/text()"/>
<xsl:text>

URL:                </xsl:text><xsl:value-of select="/ProcessData/URL/text()"/>
<xsl:text>

Attempt Number:     </xsl:text><xsl:value-of select="/ProcessData/totalRetries/text()"/>
<xsl:text>

Total Attempts:     </xsl:text><xsl:value-of select="/ProcessData/MaxRetries/text()"/>
<xsl:text>

Sending Process:    </xsl:text><xsl:value-of select="/ProcessData/SendingWorkflowID/text()"/>
<xsl:text>

Time:               </xsl:text><xsl:value-of select="/ProcessData/time/text()"/>
<xsl:text>
<!--Updated on 19-July-2017 -->
<!-- Errorcode & ErrorReasonCode -->
Error Code:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseStatusCode/text()"/>
<xsl:text>
ErrorDescription:          </xsl:text><xsl:value-of select="/ProcessData/HTTPClientPostServiceResults/ServerResponse/ResponseReasonPhrase/text()"/>
<xsl:text>
</xsl:text>
<xsl:value-of select="/ProcessData/ErrorInfo/text()"/>

</xsl:template>
</xsl:stylesheet>

 

4.After AS2 communication failure as an email.

EDIINT Email Error Notification
Unable to send or process message, check the error directory and logs for details.

AS2 Identifier:     20000_IDENTITY_ORG_IDENTIFIER

Partner ID:         849a81a:15c0b873803:5cb

B2B Contract ID:    849a81a:15c0b873803:644

File Name: sandbox.cfg

Error Directory:    /xxxxxx/install/as2partner/52100_IDENTITY_ORG/20000_IDENTITY_PART/error

Profile ID:         849a81a:15c0b873803:5cb

Message ID:         <MOKOtiublrboapp100clone-node1-15d553107c2-1077418521000IDENTITY0ORG0IDENTIFIER@xxxxx.in.ibm.com>

URL:                http://xxxxxxx:20035/as2

Attempt Number:     2

Total Attempts:     5

Sending Process:    995505

Time:               2017.07.19 AD 02:59:52 IST

Error Code:          404
ErrorDescription:        Not Found

Objective: Primary objective of this document is create alert logs in the logs file when the certificate get expiry , this is applicable when alert emails are not allowed

1.Add below content in the BP --->CheckExpireCertsEmailNotif,

<process name="CheckExpireCertsEmailNotif">
    <rule name="TimestampValidation">
        <condition>number(/ProcessData/diffInDays) &lt;=30 and number(/ProcessData/diffInDays) &gt;=28 </condition>
    </rule>
    <rule name="MoreCert">
         <condition>count(/ProcessData/allCertLsit/CERTIFICATE/*) &gt; 0 </condition>
     </rule>
    <rule name="logValidation">
         <condition>(/ProcessData/log-message/text()) !=&quot;&quot; or count(/ProcessData/log-message) !=0 </condition>
     </rule>

    <sequence name="CertExpireMain">
    
       <operation name="1">
          <participant name="BPMetaDataInfoService"/>
          <output message="Xout">
          <assign to="." from="*"></assign>
          </output>
          <input message="Xin">
          <assign to="." from="*"></assign>
          </input>
       </operation>
       
       <operation name="Timestamp Utility">
          <participant name="TimestampUtilService"/>
          <output message="TimestampUtilServiceTypeInputMessage">
            <assign to="." from="*"></assign>
            <assign to="action">current_time</assign>
            <assign to="format">yyyyMMdd</assign>
          </output>
          <input message="inmsg">
            <assign to="." from="*"></assign>
          </input>
        </operation>
        
        <operation name="Assign">
          <participant name="AssignService"/>
          <output message="AssignServiceTypeInputMessage">                        
            <assign to="systime" from="/ProcessData/time/text()" />
            <assign to="allCertLsit" from="DocToDOM(PrimaryDocument,'false')/*/*/*" />
          </output>
          <input message="inmsg">
            <assign to="." from="*"></assign>
          </input>
        </operation>
        
        <sequence name="LoopOverCert">
             <choice name="cerChoice">
                 <select>
                     <case ref="MoreCert" activity="BeginCert"/>
                 </select>
                 <sequence name="BeginCert">
                    <operation name="Assign">
                      <participant name="AssignService"/>
                      <output message="AssignServiceTypeInputMessage">                        
                        <assign to="CurrentCertName" from="string(/ProcessData/allCertLsit/CERTIFICATE[1]/CERT_NAME)"/>
                        <assign to="CurrentCertExp" from="string(/ProcessData/allCertLsit/CERTIFICATE[1]/EXPIRATION_DATE)"/>
                        <assign to="exptime" from="translate(substring(/ProcessData/CurrentCertExp/text(),1,10),'-','')" />
                      </output>
                      <input message="inmsg">
                        <assign to="." from="*"></assign>
                      </input>
                    </operation>
                    
                    <operation name="JavaTask">
                      <participant name="asi_jts"/>
                      <output message="Xout" >
                        <assign to="." from="*"></assign>
                      </output>
                      <input message="Xin" >
                        <assign to="." from="*"></assign>
                      </input>
                    </operation>                    

                    <choice name="timeChoice">
                        <select>
                                <case ref="TimestampValidation" activity="proceed"/>                
                        </select>                
                        <sequence name="proceed">
                        
                            <assign to="log-message" from="concat(/ProcessData/log-message/text(),' ','Certificate Name: ', /ProcessData/CurrentCertName/text(),' ','Certificate Expire Date: ',' ',/ProcessData/CurrentCertExp/text())" />
                            
                        </sequence>
                        
                    </choice>
                    
                    <operation name="Release Service">
                     <participant name="ReleaseService"/>
                     <output message="ReleaseServiceTypeInputMessage">
                        <assign to="TARGET">/ProcessData/allCertLsit/CERTIFICATE[1] | CurrentCertName | CurrentCertExp | exptime | diffInDays </assign>
                     </output>
                     <input message="inmsg"/>
                    </operation>                    
                    
                    <repeat name="NextCert" ref="LoopOverCert"/>
                    
                </sequence>
            </choice>
        </sequence>
        
        <sequence name="createLog">
            <choice name="logChoice">
                <select>
                        <case ref="logValidation" activity="proceedLog"/>
                        <case ref="logValidation" activity="failureLog" negative="true"/>                
                </select>                
                <sequence name="proceedLog">
                    <assign to="log-message" from="concat(/ProcessData/log-message/text(),' ','For More Details please check WF-ID: ',/ProcessData/BPDATA/WORKFLOW_ID/text())" />
                    
                    <operation name="BP Fault Log">
                        <participant name="TestLog"/>
                        <output message="BPFaultLogInputMessage">
                            <assign to="." from="*"></assign>
                            <assign to="fail-on-error">false</assign>
                            <assign to="log-level">ERROR</assign>
                        </output>
                        <input message="inmsg">
                            <assign to="." from="*"></assign>
                        </input>
                    </operation>
                </sequence>
                <sequence name="failureLog">
                    <assign to="failcase">Log not created !!!</assign>
                </sequence>
            </choice>
        </sequence>        

    </sequence>
</process>

2.Create Service as below where as Logger Name is logfile name and Logger Output Path is log file folder name.

 

3.Create JTS with below code.

 

import java.util.*;
import java.lang.*;
import java.io.*;
import com.sterlingcommerce.woodstock.workflow.Document;

Calendar cal1 = new GregorianCalendar();
Calendar cal2 = new GregorianCalendar();

Object objSystime = wfc.getWFContent("/ProcessData/systime");
String strSystime = (String) objSystime;
Object objExptime = wfc.getWFContent("/ProcessData/exptime");
String strExptime = (String) objExptime;

String sY1 = strSystime.substring(0,4);
String sM1 = strSystime.substring(4,6);
String sD1 = strSystime.substring(6,8);
int iY1 = Integer.parseInt(sY1);
int iM1 = Integer.parseInt(sM1);
int iD1 = Integer.parseInt(sD1);

String sY2 = strExptime.substring(0,4);
String sM2 = strExptime.substring(4,6);
String sD2 = strExptime.substring(6,8);

int iY2 = Integer.parseInt(sY2);
int iM2 = Integer.parseInt(sM2);
int iD2 = Integer.parseInt(sD2);

//wfc.setWFContent("/ProcessData/sY1",sY1);
//wfc.setWFContent("/ProcessData/sM1",sM1);
//wfc.setWFContent("/ProcessData/sD1",sD1);
//cal1.set(2017, 04, 26);
//cal2.set(2017, 3, 27);

cal1.set(iY1, iM1, iD1);
cal2.set(iY2, iM2, iD2);

long miliSecondForDate1 = cal1.getTimeInMillis();
long miliSecondForDate2 = cal2.getTimeInMillis();
long diffInMilis = miliSecondForDate2 - miliSecondForDate1;
long diffInDays1 = diffInMilis / (24 * 60 * 60 * 1000);

String diffInDays = Long.toString(diffInDays1);
wfc.setWFContent("/ProcessData/diffInDays",diffInDays);

return "BLAHBLAHBLAH";

 

4.Execute Schedule_CheckExpireService.

5.Go to logs folder and see if any expiredcertificates file is created.

6.Log file looks as below.

2017-03-27 13:53:49.551 [expiredcertificates] ERROR: Certificate Name: CERT_CA_EXPIRE Certificate Expire Date: 2017-03-27 20:23:00.0 Certificate Name: CERT_trust_EXPIRE Certificate Expire date:2017-03-27 20:23:00.0 Certificate Name: CertificateExpiry2 Certificate Expire date: 2017-03-28 11:59:03.0

Abstract

 

This document demonstrates on how to correct wrong timing display for SI/SFG activities

Problem

 

Application timezone mismatch in the database between the local and remote connections. It resulting the almost 4 hours of time difference noticed, which means file transfer is getting displayed in SI/SFG after 4hrs.

 

This problem is occurred whenever there is change of DST(Daylight Saving Time)

 

When connecting to the database locally, it was showing the correct timezone for the database. However, when they were connecting remotely (through Listener), it was showing an incorrect timezone for the database.

Root Cause Identification

 

SI/SFG Level

a.validate the systime time zone by executing below commands if it is Unix

# date

Fri May 11 02:37:26 EDT 2018

 

cat /etc/sysconfig/clock

# The time zone of the system is defined by the contents of /etc/localtime.

# This file is only for evaluation by system-config-date, do not rely on its

# contents elsewhere.

ZONE="America/New York"

[root@tiublrboaapp040 ~]#

 

b.Execute select SESSIONTIMEZONE from DUAL from SQL Mamanger

 

 

 

Observation: It is observed that SI Server is in America/New York timezone and DB is in Asia/Calcutta.

 

DB Level Checks

 

DB OS Level

a.validate the systime time zone by executing below commands if it is Unix

$ date

Fri May 11 12:38:39 IST 2018

 

]$ cat /etc/sysconfig/clock

ZONE="Asia/Kolkata"

 

DB Server Level

1.The first thing that needs to be checked is, whether the database listener is using a different timezone than that of the database; since I am getting the mismatch only when I connect remotely through the listener.

We can check the timezone environment settings of the LISTENER by using any of the following methods

srvctl getenv listener -l LISTENER -envs "TZ"

LISTENER:

TZ=Asia/Kolkata

 

If the above method is not showing the TZ information, we can use the following alternative method.

2. Get the PID of the LISTENER process.

# ps -ef | grep tns

root        37     2  0 Jan31 ?        00:00:00 [netns]

root      6213 28525  0 02:56 pts/0    00:00:00 grep tns

oracle   17651     1  0 Jan31 ?        07:50:23 /apps/oracle/product/11.2.0.2/db_1/bin/tnslsnr LISTENER -inherit

Now, check the environment settings related to the Listener process PID using ‘cat /proc/17651/ environ’ or cat /proc/17651/environ | grep TZ. Look for TZ environment variable for timezone setup

 

 

In my case, TZ=Asia/Kolkata for Listener process. Hence, I can conclude that Listener is not playing around with the timezone while connecting to the database.
However, if we see the TZ for Listener is different from that of the database/server, we need to restart the Listener by setting the appropriate value for TZ environment variable.

 

We can use any of the following methods to set the TZ for Listener.

$ srvctl setenv listener -l [LISTENER_NAME] -env "TZ= America/New York"

$ srvctl stop listener -l [LISTENER_NAME]

$ srvctl start listener -l [LISTENER_NAME]

OR

$ export TZ=' America/New York'

$ lsnrctl stop [LISTENER_NAME]

$ lsnrctl start [LISTENER_NAME]

 

 

Since we have verified that Listener is using correct timezone; we can rule out Listener from the list of probable root cause. Lets, check if my database is using a correct timezone (America/New York') or not.

 

 

d.Get the PID of the PMON database process

 

ps -ef | grep pmon | grep ora_pmon_

oracle    7280     1  0 Apr03 ?        00:05:39 ora_pmon_orcl

 

Now, check the environment settings related to the Database PMON process PID using ‘cat /proc/7280/environ | grep TZ’. Look for TZ environment variable for timezone setup.

 

When I look for the TZ environment variable, I could see PMON is using TZ=Asia/Kolkata rather than TZ=US/Eastern. This means, the database itself is running with a different TZ=Asia/Kolkata setup rather the server timezone setup.

f. There is a possibility that, the timezone is set to a different value than the server timezone in the cluster configuration file ($GRID_HOME/crs/install/s_crsconfig_[hostname]_env.txt) file which controls the environment settings for the Clusterware components. If TZ has a different value than the server timezone for clusterware components, then using SRVCTL/CRSCTL would start the database with the clusterware TZ settings rather than the server TZ settings

cat /app/oracle/grid/12.1.0.2/crs/install/s_crsconfig_labserver_env.txt | grep TZ

TZ= Asia/Kolkata

 

As we can see, the clusterware environment configuration is pointing to US/Eastern timezone, which is why the database was started with a different timezone than the server timezone.

 

Then the obvious question,why are we getting correct timezone while querying the database locally?

This is because, when we connect to the database locally, we actually bypass the Listener and the BEQ (Bequeath) protocol spawns a dedicated server with the environment settings taken from the server. That is why, when a system call is performed to get the SYSTIMESTAMP; the dedicated server process directly performs a Operating system call to get the current system timestamp which is evaluated based on the server timezone settings as the server process was spawned with environment settings from the database server.

However, when we connect to the database remotely, PMON registers the service name as well as the environment variables for the database associated with that service name to the Listener and in turn spawns a dedicated server with environment settings passed by the PMON process. In this case, when a system call is performed to get the current system timestamp, it is evaluated based on the environment settings passed by the PMON process to the server process.

 

Fixing the Problem

Based on the component (Listener/Database) where the problem lies, we can choose different solutions to fix the problem.

1. If the problem is at Listener level, we need to restart the Listener by setting the TZ environment variable correctly.
2. If the problem is at Database level, we need to restart the database by setting the TZ environment variable correctly.
3. If the problem is at clusterware environment settings, We need correct the configuration setting in $GRID_HOME/crs/install/s_crsconfig_[hostname]_env.txt file as well as restart the clusterware stack in order to reflect the correct TZ settings.

All of the above steps requires an outage either for the Listener, database or for the entire clusterware stack.

After fixing the above problems , restarted the application and DB, we can see the data and activity as expected.

CRS level change required restart after TZ change.

 

Conclusion

 

The problem was – the server was setup with a time zone  TZ=US/Eastern while the CRS was installed with the time zone GMT.  You can check the CRS time zone at $GRID_HOME/crs/install/ s_crsconfig_<SERVER NAME>_env.txt

Whenever, there is a timezone mismatch between local and remote connections, it is the TZ environment variable that decides on which timezone to be displayed. We need to check Listener Process, Database Process and the Clusterware environment configuration file to see if the TZ environment variable is matching with the server timezone.

We can optionally set the TZ for each of the Clusterware components (Listener, Database, etc.) to have explicit values using the SRVCTL SETENV command.

Performance issues are very important in any enterprise system. When hundreds or thousands of partners/applications are connected together, complex interactions, with unforeseen consequences, are common. Frequently, this complexity leads to poor performance and no one knows why. 

 

Unfortunately, understanding IBM Sterling B2B Integrator performance is more of an art than a science. There is little theory that is actually of any use in practice. The best I can do is give rules of thumb gained from hard experience and present examples wherever necessary. IBM Software services may be engaged regularly whenever there is a huge change in the forecasted data volume for conducting capacity planning, and benchmarking.

 

There is a myth in the industry that any performance issues caused within IBM Sterling B2B Integrator are due to IBM Sterling B2B Integrator itself. Let me explain this myth with an example. When we look at an iceberg, the first thing we see is the top half or the surface of it. We do not see the bottom half or the rest of the iceberg. Like many different type of people, we tend to judge on what we see and hear first before looking deeper and finding out that there are more than what catches the eyes.

 

Similarly, we see IBM Sterling B2B Integrator which is tip of the iceberg for all performance issues. Beneath it there are hidden layers database, operating system, hardware, network which also take a piece of the pie in the whole B2B ecosystem and contribute to the performance of the system. So, let’s examine some of the causes of IBM Sterling B2B Integrator poor performance and the tools that can help to diagnosis the problems. It is not required to use all the tools to troubleshoot a single problem – the tools can be chosen depending on the symptoms.

 

Identifying the root cause requires significant research and analysis to ensure that the solution/tuning actually resolves the problem. Any improper solution/tuning will have adverse side effects. IBM Software services may be engaged for discovering the problems early and systematically eliminating the root causes for maintaining a healthy B2B system.

 

Appendix A: References

1. http://www.ibm.com/support/knowledgecenter/SS3JSW_5.2.0/com.ibm.help.performance_mgmt.doc/overview.html

 

Disclaimer:
Please do not cite, circulate, or copy without permission of the author. The views expressed are solely my own and do not express the views or opinions of my employer. I shall not be accountable for and does not accept any liability or responsibility whatsoever for any inaccuracies, omissions, errors, misleading information, loss or damage howsoever arising (including without limitation, incidental, punitive, exemplary, special or consequential damages, loss of profit or damages resulting from lost data or business interruption), be it by negligence or otherwise, or expense resulting from:-
                        - Using the information and contents of this article whether with or without authorization;
                        - Relying on the information and contents of this article, whether downloaded or not;
                        - The performance, operation, functionality, non performance, unavailability, inaccessibility, or corruption of this article;
                        - Refer vendor specific documentation for any kind of latest information;
                        - Most of the tools referred in the article are highly sensitive tools and should be run only under SME supervision;

With IBM Sterling File Gateway's and IBM MQ Managed File Transfer's(MQFTE) rapid rise in popularity, a major concern has been lack of good reference material providing the nitty-gritty of integration between these products.

 

The intention behind this article is to ramp up consultants in very less time. This article focuses only on the development deployment and not a production deployment required by the enterprises. For a production deployment, consultants should consider scalable/reliable deployment patterns, high availability, load balancing, security, performance and other aspects which are not taught through in this article. IBM Software Services may be engaged for complex customized solutions with these products to minimize risks and to maximize ROI. 

 

I hope that many years from now, consultants will fondly remember this as the article that introduced this exciting integration approach. Let’s now look under the hood to see how to integrate IBM Sterling File Gateway 2.2.6.2 with IBM MQ Managed File Transfer (IBM MQ 8.0.0.2) when both products are installed on the same machine with Windows 2012 operating system.

 

Development Architecture - Inbound

 

 

 

 

 

Development Architecture - Outbound

 

 

 

 

 

 

1) Configure

1.1) MQ configurations

1. Install Websphere MQ 8.0.0.2 with managed file transfer features (custom installation)

2. Change directory to c:\program files\ibm\websphere mq\mqfte\samples\scripts

3. Create queue manager

createHub hubQmgr=hubQM hubport=1414

4. Create test agent to send and receive files

addSpoke agentName=AGENT1 hubQmgr=hubQM connectionMode=BINDINGS

5. Create queues provided by agent creation script(addspoke)

runmqsc hubQM < C:\ProgramData\IBM\MQ\mqft\config\hubQM\agents\AGENT1\AGENT1_create.mqsc

6. Start agent

ftestartagent AGENT1

7. Start listener if not started

 

8. Start channels

9. Remove channel authentication records

10. Create a local queue – CKP.SFG.ReplyQueue (no restriction on the name)

11. Expand Managed File Transfer – connect to the queue manager (if not automatically configured then configure for the first time)

Note: Step 3 is just to simplify the agent queue manager, command queue manager, coordination queue manager setup/configuration.

 

1.2) SBI configurations

1. Install IBM Sterling B2B Integrator 5.2.6.2 with IBM Sterling File Gateway 2.2.6.2

2. No need to install any 3^rd party jars

3. Update customer_overrides.properties

filegateway.ignoreFilename=.*[.]part[0-9]*

3. Setup adapter container

4. SFG/MQ services.msc. Run all SFG services with the same user as IBM WebSphere MQ (MUSR_MQADMIN)

 

5. Create account WMQFTE

 

6. FTEMBX, FTEMX/SOURCE mailboxes (names should be same as this otherwise filegateway.properties should be updated)

7. Create virtual root for WMQFTE userid and FTEMBX mailbox

8. Create WebSphere User Map

Note: MUSR_MQADMIN/WMQFTE is for transmissions from SFG to MQFTE, administrato/AGENT1 is for transmissions from MQFTE to SFG. MQ recognizes only 12characters of userid.

 

9. Create FTP server adapter in the adapter container

 

10. Create MQFTE Agent adapter in adapter container

 

11. Note AGENT2 on MQFTE after the adapter is started

 

12. Create Async MQ Receive for processing acknowledgements (Note: if not created files will be in pending state in filegateway for transfers from SFG to MQFTE)

 

1.3) SFG configurations

1. Add WMQFTE protocol to the SFG community

2. Create partner of type producer/consumer

3. Create partner of type producer / consumer

4. Create a pass through RCT

5. Create two routing channels from ckp_producermqfte to AGENT1 and AGENT1 to ckp_producermqfte

 

2) Test

2.1) Testing - Send files from SFG to MQFTE

1. Open myfilegateway

 

2. Note successful file transfer in Activity

 

3. Note successful file transfer on MQFTE

 

2.2) Testing - Send files from MQFTE to SFG

 

1. Right-click Managed File Transfer->hubQM->New Transfer

 

 

2. Click Finish

3. Note successful file transfer on MQFTE

 

4. Note successful transfer in Activity

 

 

 

3) Troubleshoot

3.1) Troubleshooting - SFG

1. Enable trace classes in the agent adapter - com.ibm.wmqfte

2. Check for debugging information in trace file located under logs\node1ac1\trace#\ (where # is a random number)

 

3.2) Troubleshooting - MQFTE

1. Check for logs in C:\ProgramData\IBM\MQ\errors

2. Check "Transfer Log" in MQ Explorer under "Managed File Transfer\queue manager\Transfer Log"

 

 

Appendix A - References

 

1. http://www.ibm.com/support/knowledgecenter/SS3JSW_5.2.0/com.ibm.help.websphere_mq_fte_integration.doc/siprerequisitesforfteintegration.html

2. http://www.ibm.com/support/knowledgecenter/SSFKSJ_8.0.0/com.ibm.wmqfte.doc/wmqfte_intro.htm?cp=SSFKSJ_8.0.0

 

 

 

Disclaimer:

Please do not cite, circulate, or copy without permission of the author. The views expressed are solely my own and do not express the views or opinions of my employer. I shall not be accountable for and does not accept any liability or responsibility whatsoever for any inaccuracies, omissions, errors, misleading information, loss or damage howsoever arising (including without limitation, incidental, punitive, exemplary, special or consequential damages, loss of profit or damages resulting from lost data or business interruption), be it by negligence or otherwise, or expense resulting from:-

                        - Using the information and contents of this article whether with or without authorization;

                        - Relying on the information and contents of this article, whether downloaded or not;

                        - The performance, operation, functionality, non performance, unavailability, inaccessibility, or corruption of this article;

 

IBM planned to withdraw Mesa Editor and Studio, a services development kit and it will enter retired status as on the next modification or major release (after v5.2.6). I'm aware that there's a big portion of customers / software developers out there who fell in love with MESA Studio SDK and are looking for MESA alternatives for extending IBM Sterling B2B Integrator for their complex file transfer requirements. Although there are no as-is alternatives to MESA in the market at the moment but Apache Maven can help customers / developers in providing important features and simplifies custom service development.

 

I felt there is a need for "Hello, world!" program which will help the customers / software developers to get acquainted with the MESA Studio SDK alternative. Since, it is a hello world program - lets' take a simple scenario that retrieves a service parameter and updates process data. The example I have used is very simple but it still illustrates how to write and build a custom service using Apache Maven/Eclipse. IBM Software Services may be engaged for developing complex customized java extensions to IBM Sterling B2B Integrator, and to minimize risks and to maximize ROI.

 

1) Prerequisities

1.1) IBM JDK 1.7

1.2) Eclipse - Neon Release (4.6.0)

1.3) IBM Sterling B2B Integrator v5.2.6.x

 

2) Create a maven project

 

 

 

 

 

3) Update java build path with below jars

 

​4) Create local-maven-repo (local repository),folder structures(servicedefs, src->main->assembly)

 

 

5) HelloWorld.java

Create the HelloWorld.java application file. The file will be created in the directory HelloWorld/src/com.ibm.custom/com/ibm/custom/. Copy and paste the code below into the HelloWorld.java application. “processData(..)” is the entry point for the custom service.

 

 

6) HelloWorldService.xml

Create the HelloWorldService.xml file. The file will be created in the directory HelloWorld/resources/servicedefs/. Copy and paste the code below into the HelloWorldService.xml file. This file contains the definition of service and parameters.

 

 

7) Maven Assembly Plugin - default.xml

Create the Maven Assembly Plugin - default.xml file. The file will be created in the directory HelloWorld/src/main/assembly/. Copy and paste the code below into the default.xml file.

 

​8) pom.xml

Copy and paste the code below into pom.xml

 

 

 

9) HelloWorld-0.1-bin.jar

9.1) Check for compilation errors.

9.2) Right-click on pom.xml->Run As->Maven install which creates service jar – HelloWorld-0.1-bin.jar in "target" folder.

 

 

 

Acknowledgements

Thanks to Bharat Balothia, Senior Solution Architect for giving me an alternative idea to MESA Studio SDK to speed up the custom service development.

 

Disclaimer
Please do not cite, circulate, or copy without permission of the author. The views expressed are solely my own and do not express the views or opinions of my employer. I shall not be accountable for and does not accept any liability or responsibility whatsoever for any inaccuracies, omissions, errors, misleading information, loss or damage howsoever arising (including without limitation, incidental, punitive, exemplary, special or consequential damages, loss of profit or damages resulting from lost data or business interruption), be it by negligence or otherwise, or expense resulting from:-
                        - Using the information and contents of this article whether with or without authorization;
                        - Relying on the information and contents of this article, whether downloaded or not;
                        - The performance, operation, functionality, non performance, unavailability, inaccessibility, or corruption of this article;
                        - Refer vendor specific documentation for any kind of latest information;
 

3.1Pre-requisites

1.Go to SPE Install\Standards Processing Engine 9.0.0\tpuiserver\usr\servers\defaultServer\apps\spe.war\css and take back of 10x-custom.css.

2. Go to SPE Install \Standards Processing Engine 9.0.0\tpuiserver\usr\servers\defaultServer\apps\spe.war\WEB-INF\classes\META-INF\ and take back of ResourceBundle_en.properties

3.2 How to change SPE UI color.

1.Stop SPE

2.Add below lines in 10x-custom.css at

Standards Processing Engine 9.0.0\tpuiserver\usr\servers\defaultServer\apps\spe.war\css\10x-custom.css.

/* BM Standards Processing Engine and login screen color change */

.FlowPanel.TOP_BANNER{

background-color: #800000;

}

 

/* Document Envelopes Resource Manager        Systems Management Menus color  Change */

 

.TOP_BANNER .MENU.TOP_LEVEL, .TOP_BANNER .MENU_ITEM.TOP_LEVEL {

    background-color: #800000;

}

 

 

/*Before IBM Logo color change */

.TOP_BANNER .MENU_BAR {

    background-color: #800000;

}

 

/* IBM Logo color change */

.TOP_BANNER_LOGO_BOX {

    background-color: #800000;

}

3.Restart SPE

 

4.Login with credentials

 

 

 

3.3 How to change SPE UI Label

1.Stop SPE

2.Go to SPE Install \Standards Processing Engine 9.0.0\tpuiserver\usr\servers\defaultServer\apps\spe.war\WEB-INF\classes\META-INF\ and take back of ResourceBundle_en.properties and  append the DEV to  IBM Standards Processing Engine by modifying APPLICATION_DISPLAY_NAME, below is the example.

 

APPLICATION_DISPLAY_NAME = IBM Standards Processing Engine DEV

 

3.Restart SPE

4.Login with Credetinals

 

1.Introduction

This article demonstrates a rebranding of SBI Dashboard in V6
2.SBI Dashboard Background Color and Label change
2.1Pre-requisites

1.Go to SBI install_dir/repository/eardata/admin/war/images and take back of topbar_sub_integrator.gif.

2.Go to SBI install_dir/install/properties and take back of  skins.properties_style_ext

3.Go to SBI install_dir>/repository/eardata/admin/war/jsp/neo/logo_loggedIn.jsp

4.Go to install_dir>/noapp/deploy/admin_exploded/webapp/images and take back of topbar_sub_integrator.gif.

5.Edit the images with required colors.

 
2.2  How to change SBI Dashboard Background color and Label change :

1.Stop SBI

2.Go to SBI install_dir/install/properties and open open skins.properties_style_ext, comment the existing style.pageHeaderBg.value and enable below property values for respective environment.

style. pageHeaderBg.value=RGB(59,137,5)

3.Go to SBI install_dir>/repository/eardata/admin/war/jsp/neo/logo_loggedIn.jsp and edit the file with small content from  <img border="0" src="<%=logoFile%>"></td> to  <img border="0" src="<%=logoFile%>" width="100%" height="90"></td>

3.Go to install_dir>/noapp/deploy/admin_exploded/webapp/images and and copy the attached topbar_sub_integrator.gif  for respective environment.

4.Run deployer.sh from SBI install_dir/install/bin to deploy the image (topbar_sub_integrator.gif) to get reflect.

5. Restart SBI from SBI install_dir/install/bin using run.sh

Note:Clear the browser cache/cookies
 

 

Abstract

This document demonstrates how Sterling B2Bi external purge works and different with Internal Purge.

Difference between Internal Purge Vs External Purge

Internal Purge(IP)	External Purge(EP)
By default, runs every 10 minutes	High performance purge.
Deletes expired BP and Document data from the various tables.	Runs in a separate JVM & Multithreaded.
Multithreaded supported with SI JVM and Can be enhanced by modifying bp.	External Purge deletes does 100 bp´s / documents on multiple tables (30 threads)
Deletes all eligible BP’s records, in 2000 BP’s batches(internal purge will only delete from 1 table at a time.	Can run even when SBI is down and the database is available
Internal Purge bp will use thread, it makes other bps to keep in queue until it completed.	Facts
It uses the lock mechanism on the BP, so while one instance is running, the next one can't run unless the previous one finishes	External Purge should run on one cluster node only.
	Disable the default Purge service when running the external purge.
	The lock manager will contain a lock for the Hpp.Purge and PURGE_SERVICE

How it works

External Purge get enabled multithread by default, The MULTITHREAD parameter kicks off a thread for each table that needs to be processed, rather than using one thread to process each table serially.

 

If MULTITHREADED purge is enabled then the DBA can see multiple DELETE queries running parallelly on different tables and that if confirms the purge process is deleting the records.

Pre-requisites to setup external purge

1. Disable the default Purge service. Click Deployment > Schedules, search for PurgeService, and then clear the Enabled checkbox for PurgeService.

          

 

 

 

 

 

 

 

 

 

 

Make sure  screen shows internal purge service is not running as below.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

b.Turn off the "Important Schedules are Disabled" email notifications by adding the following line to the customer_overrides.properties file. This removes the Purge Service SQL query for the schedule.

resourceMonitor.ScheduleMonitor.propertyValue.1=SELECT STATUS, SERVICENAME FROM SCHEDULE WHERE SERVICENAME IN ('BackupService','IndexBusinessProcessService','AssociateBPsToDocs' ,'BPRecovery','BPLinkagePurgeService')

 

c.Go to <si_install>/bin and run below command

./control_extpurge.sh start

 

 

 

 

 

 

d. Go to <si_install> and look for the extpurge.pid file which have process id.

 

You can grep the process id from the extpurge.pid using below commands

 

ps -ef | grep pid

 

Nestat -an | grep pid

 

e.Also execute as ps -ef | grep hpp

 

It should display 2 process running with the same PID from extpurge.pid, one process as parent id and another process as child.

 

Also run ps -ef | grep purge

 

It should display 2 process running with the same PID from extpurge.pid, one process as parent id and another process as child.

Monitoring External Purge

a.Go to the <si_install>/logs/PURGE

You can find log file as extpurge.log.D20180621.T035303

 

[2018-06-27 03:21:33.582] ALL Delete rate [SIPurgeThread2]: 111.1111111111111 Purge Candidates/sec

[2018-06-27 03:21:48.412] ALL [PurgeScavenger.run] - Current Queue Size: 0

 

This log will tells the purge record delete rates.

b.you can find records by running below query and also from DB Usage screen.

 

 

 

 

 

 

 

 

 

 

 

 

 

C.Go to Operations-->Lock Manager and see if hpp and PURGE_SERVICE services are locked or not.

 

 

 

 

 

 

 

 

 

 

 

d. Go to Operations-->Support Tools-->SQL Manager and run below query

select * from locks

 

 

 

 

 

 

 

 

 

 

 

 

The ITEMNAME hpp.Purge service running on SYSTEMNAME as node1 which means , ./control_extpurge.sh start  command is executed from the node1.

 

PS: Do not release the locks for hpp.Purge and PURGE_SERVICE

 

Stopping External Purge

a.Go to the node which has hpp.Purge service running

b.Go to <si_install>/bin and run below command

./control_extpurge.sh stop

 

 

 

 

c.Go to <si_install> and look for extpurge.pid, this file should have been vanished.

d.Run below commands to see if any service is running, expected result is we should not have any results.

ps -ef | grep hpp

ps -ef | grep purge

Disabling External Purge

a.Go to Operations-->Lock Manager and unlock below service by unchecking the services.

hpp and PURGE_SERVICE.

b. Go to Operations-->Support Tools-->SQL Manager and run below query

select * from locks

 

What are the properties are used by external  purge

archivethread.properties_hpp_ext

jdbc_purge.properties_hpp_ext

Tuning

Tuning can be done using the link https://www.ibm.com/support/knowledgecenter/en/SS3JSW_5.2.0/com.ibm.help.archive_purge.doc/ArchPrg_TuningExtPurge.html

 

Back out

In case something goes wrong with external purge, we can disable the external purge by stopping and enabling the internal purge by going to  Deployment > Schedules, search for PurgeService, and then check the  checkbox for PurgeService enable.Then go to cleanup processes make sure it is enabled.

 

How to find external purge is stopped history

1. Go to <si_install>/logs and search for StopExternalPurge.sh.log
2. It will have details when was stopped and user details with PID

-----------------------------------------------------------------

Thu Jun 21 03:49:37 EDT 2018

User = root

-----------------------------------------------------------------

Killing all SI External JVM Purge related pids:

17384

 

-----------------------------------------------------------------

Thu Jun 21 03:52:29 EDT 2018

User = root

-----------------------------------------------------------------

Killing all SI External JVM Purge related pids:

18965

 

-----------------------------------------------------------------

Wed Jun 27 03:37:34 EDT 2018

User = root

-----------------------------------------------------------------

Killing all SI External JVM Purge related pids:

20347

 

 

 

 

Abstract

 

This document demonstrates on how to check-in Ldap cacerts after SI/JDK upgradation in sterling Integrator

Problem

Authentication log shows error as ERRORDTL as javax.naming.communication:simple bind failed: [Root exception is javax.net.ssl SSLHandshakeException: com.ibm.jsse2.util.j: PKIX path building failed:java.security.cert.certpathBuilderException:PKIXcertpathBuilderImple could not build a valid certpath; internal cause is ; java.security.cert.certpathValidatorException: The Certificate issued by CN=XXXX root CA is not trusted;internal Cuase is

 

 

 

Root Cause Identification

After JDK upgrade or SI Upgrade contents under si_install/jdk/jre/lib/security get vanished, LDAP authentication is looking for si_install/jdk/jre/lib/security/cacerts and finding it is missing.

How to validate the CACERTS existence

1.Go to si_install/jdk/bin and execute

./keytool -list -v -keystore si_install/jdk/jre/lib/security >output.txt

 

Password should be changeit

 

2.check below parameters in output.txt

a.Alias name

b.Owner,Issuer,Valid from and Certificate fingerprints and also Signature algorithm

Fixing the Problem

User needs to copy certificates to si_install/jdk/bin recheck-in the cacerts using keytool as below command

./keytool -importcert -trustcerts -alias <alias nam> -f <certificate name> -keystore si_install/jdk/jre/lib/security/cacerts

 

Note: If you have multiple certificates from LDAP, import the certificates as above command.

 

Please refer for LDAP authentication configuration https://www.ibm.com/support/knowledgecenter/en/SS3JSW_5.2.0/com.ibm.help.security.doc/SI_ConfigLDAPwithSI.html

 

Also LDAP_SECURITY_TRUSTSTORE= si_install/jdk/jre/lib/security/cacerts

LDAP_SECURITY_TRUSTSTORE_PASSWORD=changeit

 

After the cacerts loading, SI needs to be rebooted

Conclusion

 

SI or JDK upgrade required re-keytooling always with SI restart