Topic
  • 3 replies
  • Latest Post - ‏2013-12-05T17:53:03Z by Amy.S
Amy.S
Amy.S
14 Posts

Pinned topic gpfs daemon will not come up

‏2013-12-04T23:23:04Z |

I have a toy cluster with two nodes. One node is always down, even though I am able to ssh as root without password, ping it etc

[root@oc6161261781 bin]# ./mmgetstate -a

 Node number  Node name        GPFS state
------------------------------------------
       1      mygpfs1          active
       2      mygpfs2          down

The two node cluster is as follows:

[root@oc6161261781 bin]# ./mmlscluster

GPFS cluster information
========================
  GPFS cluster name:         mygpfs1
  GPFS cluster id:           4534035540837639835
  GPFS UID domain:           mygpfs1
  Remote shell command:      /usr/bin/ssh
  Remote file copy command:  /usr/bin/scp

GPFS cluster configuration servers:
-----------------------------------
  Primary server:    mygpfs1
  Secondary server:  mygpfs2

 Node  Daemon node name  IP address    Admin node name  Designation
--------------------------------------------------------------------
   1   mygpfs1           9.31.105.58   mygpfs1          quorum-manager
   2   mygpfs2           9.31.107.225  mygpfs2 

 

 

On mygpfs2 this command returns nothing ps -e | grep mmfsd even after mmstartup. I tried mmautoload on it as well.

 

Output from logs on mygpfs2:

Wed Dec  4 16:51:39 EST 2013: mmautoload: Starting GPFS ...
Wed Dec  4 17:00:46 EST 2013: mmremote: unmountFileSystems all -f ...
Wed Dec  4 17:00:51 EST 2013: mmremote: Initiating GPFS shutdown ...
Wed Dec  4 17:00:54 EST 2013: mmremote: Starting the mmsdrserv daemon ...
Wed Dec  4 17:00:57 EST 2013: mmremote: Unloading GPFS kernel modules ...
Wed Dec  4 17:00:58 EST 2013: mmremote: Completing GPFS shutdown ...

Wed Dec  4 18:06:43 EST 2013: Node rebooted.  Starting mmautoload...


 

Updated on 2013-12-04T23:24:27Z at 2013-12-04T23:24:27Z by Amy.S
  • yuri
    yuri
    206 Posts

    Re: gpfs daemon will not come up

    ‏2013-12-04T23:39:58Z  

    If this is Linux, be sure you have built kernel modules, and disabled/configured firewall.  If that doesn't help, run "DEBUG=1 mmstartup" and attach output.

    yuri

  • Amy.S
    Amy.S
    14 Posts

    Re: gpfs daemon will not come up

    ‏2013-12-05T15:06:20Z  
    • yuri
    • ‏2013-12-04T23:39:58Z

    If this is Linux, be sure you have built kernel modules, and disabled/configured firewall.  If that doesn't help, run "DEBUG=1 mmstartup" and attach output.

    yuri

    Yes, this is Linux. And I think all modules were installed correctly, I did not see errors. Is there any way to check. Firewall is also disabled.

    Please see attached the output of DEBUG=1 mmstartup. The return code seems to be 0, so I am not sure why mmgetste still shows it as down?

    Thanks,

    amina

     

    Attachments

    Updated on 2013-12-05T17:14:25Z at 2013-12-05T17:14:25Z by Amy.S
  • Amy.S
    Amy.S
    14 Posts

    Re: gpfs daemon will not come up

    ‏2013-12-05T17:53:03Z  
    • Amy.S
    • ‏2013-12-05T15:06:20Z

    Yes, this is Linux. And I think all modules were installed correctly, I did not see errors. Is there any way to check. Firewall is also disabled.

    Please see attached the output of DEBUG=1 mmstartup. The return code seems to be 0, so I am not sure why mmgetste still shows it as down?

    Thanks,

    amina

     

    It turned out that my IP address for node mygpfs2 had changed. Once I updated this information using mmchnode it worked. I noticed it in the DEBUG information. Thanks for your help.

     

    Amina