Verifying the snappy compression library (V11.5.0.5 and above)

Hortonworks® bundles the snappy compression library to allow MapReduce to manage large volumes of data more quickly.

Procedure

  1. To verify that the library loads correctly, test the code using: ./hbase org.apache.hadoop.hbase.util.CompressionTest file:///tmp/test.txt snappy For example:
    • 13/07/22 12:57:51 WARN snappy.LoadSnappy: Snappy native library is available
    • 13/07/22 12:57:51 INFO snappy.LoadSnappy: Snappy native library loaded
  2. If Snappy isn't functioning, install it. Complete the following steps on all nodes in your cluster.
    1. From a terminal window, type the following for RedHat Linux®, CentOS, or Oracle Linux: 
      yum install snappy snappy-devel
    2. Make the Snappy libraries available to Hadoop by typing this command: 
      ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/