IBM Support

Tuning parameters to optimize HBase performance

Troubleshooting


Problem

HBase performance issue when using InfoSphere BigInsights with GPFS.

Symptom

Workloads dependent on HBase might result in client-side errors. The error is accompanied by a Java exception cause: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException with a RegionTooBusyException. For example, the following example shows a Java exception logged during a MapReduce job while attempting to load data into an HBase table using BigSQL:

org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 232 actions: RegionTooBusyException: 232 times,
at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(AsyncProcess.java:185)
at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$500(AsyncProcess.java:169)
at org.apache.hadoop.hbase.client.AsyncProcess.getErrors(AsyncProcess.java:782)
at org.apache.hadoop.hbase.client.HTable.backgroundFlushCommits(HTable.java:934)
at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1193)
at com.ibm.jaql.module.hbase.HBaseRecordWriter.close(HBaseRecordWriter.java:42)
at com.ibm.jaql.io.hadoop.CompositeOutputAdapter$1.close(CompositeOutputAdapter.java:383)
at org.apache.hadoop.mapred.MapTask$DirectMapOutputCollector.close(MapTask.java:806)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:439)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(AccessController.java:310)
at javax.security.auth.Subject.doAs(Subject.java:573)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1502)
at org.apache.hadoop.mapred.Child.main(Child.java:249)

[{"Product":{"code":"SSCRJT","label":"IBM Db2 Big SQL"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Component":"GPFS","Platform":[{"code":"PF016","label":"Linux"}],"Version":"2.1.2","Edition":"Enterprise Edition","Line of Business":{"code":"LOB76","label":"Data Platform"}}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
08 April 2021

UID

swg21668498

Page Feedback