Skip to main content

By clicking Submit, you agree to the developerWorks terms of use.

The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

All information submitted is secure.

  • Close [x]

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerworks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

By clicking Submit, you agree to the developerWorks terms of use.

All information submitted is secure.

  • Close [x]

Replication performance with network compression

Warren White, Field Engineer, Lotus Professional Services
Warren White has worked in Product Introduction Engineering since 2000 on projects involving network compression, DEAS, iNotes, and spam filtering. He started at Lotus as a Support Analyst, moved to QE for Notes 4 and 4.5, then spent three years as a Field Engineer for Lotus Professional Services.

Summary:  A follow-up to Network compression in Domino 6, this article compares R5 replication to Domino 6 replication with network compression enabled over varying line speeds. Conclusion: Domino 6 replication provides a significant improvement.

Date:  01 May 2003
Level:  Intermediate
Also available in:   Japanese

Activity:  3772 views
Comments:  

The previously published Performance Perspectives column, "Network compression in Domino 6," presented an overview of the Domino 6 network compression feature. We talked about two different types of compression: network compression and attachment compression. Network compression, a new feature introduced in Notes/Domino 6, involves compressing data sent over the network using the LZ1 compression algorithm. Network compression is available on both the Domino server and Notes client. Attachment compression (as the name implies) compresses file attachments. R5 uses Huffman compression for attachments, while Domino 6 provides a choice of Huffman or LZ1 compression. The column concluded with test results showing that compression produced a 35 to 52 percent reduction in attachment size, depending upon the algorithm method used, with relatively small increases in CPU and memory utilization.

Since the publication of the earlier column, customers have expressed interest in determining how Domino 6 network compression affects replication performance. In response, we conducted a study comparing R5 replication with Domino 6 replication with network compression enabled over varying line speeds. This article summarizes our results. (For those who can't stand the suspense, Domino 6 replication provides a significant improvement both in terms of time and amount of data transmitted.)

This article assumes that you're an experienced Domino administrator.

Test setup

Our study examined client-to-server replication performance on R5 and compared it with Notes/Domino 6 with network compression enabled, specifically at line speeds similar to dial-up, DSL, or cable modem. Network compression offers two advantages: It buffers small messages and uses the LZ1 algorithm to compress all messages. Compression reduces the size of any message that can be compressed. A "compressible" message is any message that has uncompressed content, for example, text. This reduces the amount of data that needs to be transmitted.

Our test environment consisted of:

  • Domino 6 and R5 servers, running on an IBM RS6000 H50 system with four 332 Mhz CPUs, 1 GB RAM, 2x4.5 GB drives, 40 GB RAID array, running AIX 4.3.3 fix pack 9
  • Notes 6 and R5, running on an IBM M Pro XEON P3 with one 1.6 GHz CPU, 1 GB RAM, running Windows 2000
  • The Cloud WAN Simulator, running on an IBM M Pro XEON P3 with one 1.6 GHz CPU, 1 GB RAM, running Windows NT 4 service pack 6

We created two test scenarios:

  • Creating a new replica mail database containing 200 documents
  • Adding 50 new documents to the same database via replication

Each scenario was run at 256 KBps and 56 KBps using Shunra Software The Cloud program to regulate line speed. The Cloud acts as a LAN/WAN simulator. We ran each test twice to ensure data accuracy.

We tested Notes/Domino 5.0.11 and pre-release Notes/Domino 6.0.1. The Notes client ran Windows 2000 replicating with an AIX 4.3.3 Domino server. This was a single user manual test. (The goal was to compare R5 to Notes/Domino 6 performance, not to load test the Domino server. We wanted to determine the effect Notes/Domino 6 has upon a single user replicating over a low bandwidth connection.)

We designed the comparison as a " version best case scenario" comparison with R5 configured to send Huffman compressed attachments and Domino 6 configured to send LZ1 compressed attachments with network compression turned on at the client and server. (Huffman compression is the default for both R5 and Domino 6.) Domino 6 has streaming replication by default as well. We used the R5 mail template in both tests. The mail database containing 200 documents was about 20 MB in size before updates and about 30 MB after 50 documents were added via replication.

The mail database consisted of text messages of varying size as well as a mix of text and binary (non-compressible) attachments ranging from 50 KB to 10 MB. Updates were also configured the same way with a variety of document types and sizes. We performed all testing on a private network to ensure that no other network traffic interfered with the test. Test data was collected using:

  • An internal tool upon which Server.Load is based, used to write test scripts
  • entstat (an AIX tool used for measuring network adapter statistics)
  • Log.nsf used to view replication events, comparing time and bytes transferred

Note that the SendMail database we used to populate the mail in this test was created using ODS41 for R5 and ODS43 for Domino 6, the native ODS versions for each release. (LZ1 compression only works with ODS43.)


Results

Our results show a significant reduction in both amount of data transmitted and time to completion when using Notes/Domino 6 for client/server database replication. This was not unexpected because it obviously makes sense that sending less data should take less time. But we were pleased by just how much of an improvement we saw.

56 KBps test

In our 56 KBps tests, we compared R5 and Notes/Domino 6 performance in terms of our two test scenarios, creating a new replica mail database containing 200 documents and adding 50 new documents to the same database via replication.

Creating a replica
The first table lists the results of our 56 KBps replication test:

Time to completion(minutes)Time improvement (percent)Amount of data transferred (MB)Data transferred improvement (percent)
R552.9619.38
Notes/Domino 629.1345.2811.8638.84

Adding 50 new documents
The next table shows statistics for adding 50 new documents to the newly created replica:

Time to completion(minutes)Time improvement (percent)Amount of data transferred (MB)Data transferred improvement (percent)
R520.047.494
Notes/Domino 614.97256.03719.44

As you can see, in both tests Notes/Domino 6 provided a significant improvement in both time and amount of data transferred.

256 KBps test

The results of our 256 KBps tests were similar to our 56 KBps test-Notes/Domino 6 produced better performance than R5.

Creating a replica
The following table shows the results we obtained in our 256 KBps replication test:

Time to completion(minutes)Time improvement (percent)Amount of data transferred (MB)Data transferred improvement (percent)
R512.6119.38
Notes/Domino 66.414911.8638.84

Adding 50 new documents
The final table lists the numbers for creating 50 new documents in the replica:

Time to completion(minutes)Time improvement (percent)Amount of data transferred (MB)Data transferred improvement (percent)
R54.967.494
Notes/Domino 63.2634.276.03719.44

Note that the amount of data transferred and performance improvement data are identical for both line speeds because the compression was identical in both scenarios.


Conclusions

As the previous tables show, there is an approximately 45 to 50 percent improvement when sending the new replica database with Notes/Domino 6 compared to R5. We also experienced a 25 to 35 percent improvement when updating that database with 50 documents. Of course, it helps when you are sending between 20 and 40 percent less data due to compression!

One thing you don't see in our results is the potential cost savings associated with the use of the attachment and network compression technology in Notes/Domino 6. You can download a PDF of a recent Ferris Research Report which concluded that network compression typically reduces Notes bandwidth requirements by more than 30 percent, producing potential cost savings in the range of $5 to $10 per user per month. In larger organizations, this could provide total cost savings in the hundreds of thousands of dollars or even more-a very significant sum. So network compression is likely to save you both time and money-a pretty good deal all around.


Resources

About the author

Warren White has worked in Product Introduction Engineering since 2000 on projects involving network compression, DEAS, iNotes, and spam filtering. He started at Lotus as a Support Analyst, moved to QE for Notes 4 and 4.5, then spent three years as a Field Engineer for Lotus Professional Services.

Report abuse help

Report abuse

Thank you. This entry has been flagged for moderator attention.


Report abuse help

Report abuse

Report abuse submission failed. Please try again later.


developerWorks: Sign in


Need an IBM ID?
Forgot your IBM ID?


Forgot your password?
Change your password

By clicking Submit, you agree to the developerWorks terms of use.

 


The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

Choose your display name

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerWorks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

(Must be between 3 – 31 characters.)

By clicking Submit, you agree to the developerWorks terms of use.

 


Rate this article

Comments

Help: Update or add to My dW interests

What's this?

This little timesaver lets you update your My developerWorks profile with just one click! The general subject of this content (AIX and UNIX, Information Management, Lotus, Rational, Tivoli, WebSphere, Java, Linux, Open source, SOA and Web services, Web development, or XML) will be added to the interests section of your profile, if it's not there already. You only need to be logged in to My developerWorks.

And what's the point of adding your interests to your profile? That's how you find other users with the same interests as yours, and see what they're reading and contributing to the community. Your interests also help us recommend relevant developerWorks content to you.

View your My developerWorks profile

Return from help

Help: Remove from My dW interests

What's this?

Removing this interest does not alter your profile, but rather removes this piece of content from a list of all content for which you've indicated interest. In a future enhancement to My developerWorks, you'll be able to see a record of that content.

View your My developerWorks profile

Return from help

static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Lotus
ArticleID=12832
ArticleTitle=Replication performance with network compression
publish-date=05012003
author1-email=
author1-email-cc=

Tags

Help
Use the search field to find all types of content in My developerWorks with that tag.

Use the slider bar to see more or fewer tags.

For articles in technology zones (such as Java technology, Linux, Open source, XML), Popular tags shows the top tags for all technology zones. For articles in product zones (such as Info Mgmt, Rational, WebSphere), Popular tags shows the top tags for just that product zone.

For articles in technology zones (such as Java technology, Linux, Open source, XML), My tags shows your tags for all technology zones. For articles in product zones (such as Info Mgmt, Rational, WebSphere), My tags shows your tags for just that product zone.

Use the search field to find all types of content in My developerWorks with that tag. Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere). My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Special offers