IBM Support

PI81590: AMBARI-17539 AMBARI AGENT MEMORY LEAK FIX

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as fixed if next.

Error description

  • IBM BigInsights 4.2 is based off Ambari 2.2.0
    When using Ambari 2.2.0, the ambar-agent process memory
    utilisation may increase over time from around 500 MB to huge
    values 10 GB and higher having been reported.
    
    AMBARI-17539 addresses this in IBM BigInsights 4.3 which is
    based off 2.4.2
    

Local fix

  • In a test environment where you see this behaviour:
    a. Make a backup of the file
    /usr/lib/python2.6/site-packages/ambari_agent/main.py
    b. Stop the ambari agent.
    c. Amend /usr/lib/python2.6/site-packages/ambari_agent/main.py
    exactly as follows:
    def fix_subprocess_racecondition():
      """
      !!! PLEASE NOTE THIS SHOULD BE CALLED BEFORE ANY OTHER
    INITIALIZATION was done to avoid already created links to
    subprocess or subprocess.gc or gc
      """
      # monkey patching subprocess
      import subprocess
      subprocess.gc.isenabled = lambda: True
    
      # re-importing gc to have correct isenabled for
    non-subprocess contexts
      import sys
      del sys.modules['gc']
      import gc
    
    d. Start the Ambari agent - confirm that this starts
    successfully!!
    e. Monitor memory usage over a period of time.
    f. If this does seem to address the memory growth, then apply
    this change to all nodes running ambari-agents.
    

Problem summary

Problem conclusion

Temporary fix

Comments

APAR Information

  • APAR number

    PI81590

  • Reported component name

    INFO BIGINSIGHT

  • Reported component ID

    5725C0900

  • Reported release

    420

  • Status

    CLOSED FIN

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2017-05-15

  • Closed date

    2017-05-15

  • Last modified date

    2017-05-15

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Modules/Macros

  • ambari
    

Fix information

Applicable component levels

  • R430 PSY

       UP

[{"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSCRJT","label":"IBM Db2 Big SQL"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"420","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
25 August 2020