December 3, 2019 By Simon Ho 4 min read

As a market-leading Full Lifecycle API technology, many large enterprises are using IBM API Connect to drive very large digital transformation projects.

For those customers, performance and scale matter a whole lot—especially when they have the potential to have hundreds of people hitting their API Catalog at any one time. 

Considering those enormous growth requirements from our IBM API Connect customers, we’ve spent time in Fix Pack 8 to allow these customers to scale-out even further.

High numbers of items fetched and numbers of items rendered were causing slower page performance.

Rationale

During our root cause analysis, we determined that application performance was dictated by two key factors: the number of items fetched and the number of items rendered. The former was causing slow API response times, and the latter was causing bad performance in the page itself. 

The initial implementation did not have the following:

  • The capability to request a subset of results (i.e., “limit” criteria in queries).
  • The capability to “jump” to a specific results (i.e., “offset” criteria in queries).
  • Large enough datasets that would impact performance in a meaningful way.

As customers increased their API Connect usage, the performance of the application deteriorated in proportion to their data growth. Since the impact was felt on both the client and server sides of the product, we needed to coordinate with the backend teams to decide on a unified solution. On the client-side, we decided to use the pagination component from the Carbon Design System, an IBM solution we already use in API Connect. For the server-side, specific APIs were enhanced to support the limit and offset criteria in request queries.

Implementation

Using the Carbon Pagination Component, we were able to add pages, next buttons, and items-per-page features to various list pages. Modifying the request queries to fetch only a subset of database entries from the server instantly improved both the response and render times of each paginated page.

Basic pagination: Shows “total pages,” “total results”, and allows for “page jumps.”

For pages where basic pagination wasn’t possible, we decided to create new pages that supported the pieces that needed paginating. For example, the application page in the API Manager previously used an accordion which listed data for each subscription. As the number of subscriptions increased for each application, the performance of the entire component also would also degrade. To resolve this, the subscriptions feature was “split” into a new paginated page to keep the application page’s performance consistent.

New page: Subscriptions “split” from Applications into a new paginated page.

For pages with only partial pagination support, we created a custom “pseudo”-pagination solution. This basically allows for paging using only the “back” and “forward” buttons that smartly compute where you should be. The algorithm recursively fetches results and limits the number of items returned based on what we deem as “acceptable” to maintain performance. As a minimal working solution, the goal was to make sure the page was still usable when the “peak” number of results were returned. 

Due to the limitations of using this approach, we had to remove “page jumps,” “total pages,” and “total results” for pages using this method. This is definitely a temporary measure and any affected pages will be upgraded to basic pagination once the relevant APIs enhancements made are available.

“Pseudo”-pagination: Does not show “total pages” or “total results” and doesn’t allow for “page jumps.”

Results

Before pagination, the time it took to load a page would range from slow to infinite. More data in the database meant slower load times. After pagination, performance increased substantially due to the reduced number of items returned. Primarily, the page rendering was decoupled from the total number of items in the database. 

The following table represents the fruits of our labour:

Learn more about IBM API Connect.

More from Announcements

IBM Hybrid Cloud Mesh and Red Hat Service Interconnect: A new era of app-centric connectivity 

2 min read - To meet customer demands, applications are expected to be performing at their best at all times. Simultaneously, applications need to be flexible and cost effective, and therefore supported by an underlying infrastructure that is equally reliant, performant and secure as the applications themselves.   Easier said than done. According to EMA's 2024 Network Management Megatrends report only 42% of responding IT professionals would rate their network operations as successful.   In this era of hyper-distributed infrastructure where our users, apps, and data…

IBM named a Leader in Gartner Magic Quadrant for SIEM, for the 14th consecutive time

3 min read - Security operations is getting more complex and inefficient with too many tools, too much data and simply too much to do. According to a study done by IBM, SOC team members are only able to handle half of the alerts that they should be reviewing in a typical workday. This potentially leads to missing the important alerts that are critical to an organization's security. Thus, choosing the right SIEM solution can be transformative for security teams, helping them manage alerts…

IBM and MuleSoft expand global relationship to accelerate modernization on IBM Power 

2 min read - As companies undergo digital transformation, they rely on APIs as the backbone for providing new services and customer experiences. While APIs can simplify application development and deliver integrated solutions, IT shops must have a robust solution to effectively manage and govern them to ensure that response times and costs are kept low for all applications. Many customers use Salesforce’s MuleSoft, named a leader by Gartner® in full lifecycle API management for seven consecutive times, to manage and secure APIs across…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters